May 28 09:54:40.861420 np0000001613 systemd[1]: Started devstack@n-cpu.service - Devstack devstack@n-cpu.service.
May 28 09:54:42.506194 np0000001613 nova-compute[98321]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=98321) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:54}}
May 28 09:54:42.506830 np0000001613 nova-compute[98321]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=98321) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:54}}
May 28 09:54:42.506830 np0000001613 nova-compute[98321]: INFO os_vif [-] Loaded VIF plugins: noop, ovs
May 28 09:54:42.626451 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:54:42.636371 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.010s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:54:42.791349 np0000001613 nova-compute[98321]: INFO oslo_service.periodic_task [-] Skipping periodic task _heal_instance_info_cache because its interval is negative
May 28 09:54:43.553699 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [None req-92870608-b483-42b4-9a19-b22bba316aad None None] In native threading mode the number of concurrent builds, and snapshots should be limited to the same number. The current configuration has differing limits: max_concurrent_builds: 10, max_concurrent_snapshots: 5. Nova will use a single, overall limit of 10 for these tasks.
May 28 09:54:43.554043 np0000001613 nova-compute[98321]: INFO nova.utils [None req-92870608-b483-42b4-9a19-b22bba316aad None None] The long task thread pool MainProcess.long_task is initialized
May 28 09:54:43.554216 np0000001613 nova-compute[98321]: INFO nova.virt.driver [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Loading compute driver 'libvirt.LibvirtDriver'
May 28 09:54:43.660895 np0000001613 nova-compute[98321]: INFO nova.compute.provider_config [None req-92870608-b483-42b4-9a19-b22bba316aad None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
May 28 09:54:44.163090 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Acquiring lock "singleton_lock" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:54:44.163256 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Acquired lock "singleton_lock" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:54:44.163472 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Releasing lock "singleton_lock" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:54:44.163664 np0000001613 nova-compute[98321]: WARNING oslo_service.backend._threading.service [None req-92870608-b483-42b4-9a19-b22bba316aad None None] no_fork=True: running service in main process
May 28 09:54:44.163965 np0000001613 nova-compute[98321]: INFO nova.service [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Starting compute node (version 33.1.0)
May 28 09:54:44.666838 np0000001613 nova-compute[98321]: INFO nova.utils [None req-92870608-b483-42b4-9a19-b22bba316aad None None] The default thread pool MainProcess.default is initialized
May 28 09:54:44.667276 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:54:44.667471 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Starting event thread {{(pid=98321) start /opt/stack/nova/nova/virt/libvirt/host.py:252}}
May 28 09:54:44.667725 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Starting connection event dispatch thread {{(pid=98321) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:553}}
May 28 09:54:44.668243 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Connecting to libvirt: qemu:///system {{(pid=98321) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:558}}
May 28 09:54:45.185735 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x73c206fb5760> {{(pid=98321) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:564}}
May 28 09:54:45.188393 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x73c206fb5760> {{(pid=98321) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:585}}
May 28 09:54:45.188915 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Connection event '1' reason 'None'
May 28 09:54:45.694728 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Cannot update service status on host "np0000001613" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000001613 could not be found.
May 28 09:54:45.696518 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.mount [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Initialising _HostMountState generation 0 {{(pid=98321) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
May 28 09:54:56.185820 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Libvirt host capabilities <capabilities>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:   <host>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:     <uuid>4f389ae4-5440-4643-b4e5-95bdfbec49be</uuid>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:     <cpu>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <arch>x86_64</arch>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <model>EPYC-Milan</model>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <vendor>AMD</vendor>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <microcode version='16777317'/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <signature family='25' model='1' stepping='1'/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <topology sockets='12' dies='1' cores='1' threads='1'/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <maxphysaddr mode='emulate' bits='40'/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <feature name='x2apic'/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <feature name='tsc-deadline'/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <feature name='osxsave'/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <feature name='hypervisor'/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <feature name='tsc_adjust'/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <feature name='ospke'/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <feature name='vaes'/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <feature name='vpclmulqdq'/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <feature name='spec-ctrl'/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <feature name='stibp'/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <feature name='arch-capabilities'/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <feature name='ssbd'/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <feature name='cmp_legacy'/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <feature name='topoext'/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <feature name='stibp-always-on'/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <feature name='virt-ssbd'/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <feature name='amd-psfd'/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <feature name='lbrv'/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <feature name='tsc-scale'/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <feature name='vmcb-clean'/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <feature name='flushbyasid'/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <feature name='pause-filter'/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <feature name='pfthreshold'/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <feature name='v-vmsave-vmload'/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <feature name='vgif'/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <feature name='no-nested-data-bp'/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <feature name='lfence-always-serializing'/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <feature name='null-sel-clr-base'/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <feature name='rdctl-no'/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <feature name='skip-l1dfl-vmentry'/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <feature name='mds-no'/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <feature name='pschange-mc-no'/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <feature name='gds-no'/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <pages unit='KiB' size='4'/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <pages unit='KiB' size='2048'/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <pages unit='KiB' size='1048576'/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:     </cpu>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:     <power_management/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:     <iommu support='no'/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:     <migration_features>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <live/>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       <uri_transports>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:         <uri_transport>tcp</uri_transport>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:         <uri_transport>rdma</uri_transport>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:       </uri_transports>
May 28 09:54:56.185820 np0000001613 nova-compute[98321]:     </migration_features>
May 28 09:54:56.188079 np0000001613 nova-compute[98321]:     <topology>
May 28 09:54:56.188079 np0000001613 nova-compute[98321]:       <cells num='1'>
May 28 09:54:56.188079 np0000001613 nova-compute[98321]:         <cell id='0'>
May 28 09:54:56.188079 np0000001613 nova-compute[98321]:           <memory unit='KiB'>24607188</memory>
May 28 09:54:56.188079 np0000001613 nova-compute[98321]:           <pages unit='KiB' size='4'>6151797</pages>
May 28 09:54:56.188079 np0000001613 nova-compute[98321]:           <pages unit='KiB' size='2048'>0</pages>
May 28 09:54:56.188079 np0000001613 nova-compute[98321]:           <pages unit='KiB' size='1048576'>0</pages>
May 28 09:54:56.188079 np0000001613 nova-compute[98321]:           <distances>
May 28 09:54:56.188079 np0000001613 nova-compute[98321]:             <sibling id='0' value='10'/>
May 28 09:54:56.188079 np0000001613 nova-compute[98321]:           </distances>
May 28 09:54:56.188079 np0000001613 nova-compute[98321]:           <cpus num='12'>
May 28 09:54:56.188079 np0000001613 nova-compute[98321]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
May 28 09:54:56.188079 np0000001613 nova-compute[98321]:             <cpu id='1' socket_id='1' die_id='1' core_id='0' siblings='1'/>
May 28 09:54:56.188079 np0000001613 nova-compute[98321]:             <cpu id='2' socket_id='2' die_id='2' core_id='0' siblings='2'/>
May 28 09:54:56.188079 np0000001613 nova-compute[98321]:             <cpu id='3' socket_id='3' die_id='3' core_id='0' siblings='3'/>
May 28 09:54:56.188079 np0000001613 nova-compute[98321]:             <cpu id='4' socket_id='4' die_id='4' core_id='0' siblings='4'/>
May 28 09:54:56.188079 np0000001613 nova-compute[98321]:             <cpu id='5' socket_id='5' die_id='5' core_id='0' siblings='5'/>
May 28 09:54:56.188079 np0000001613 nova-compute[98321]:             <cpu id='6' socket_id='6' die_id='6' core_id='0' siblings='6'/>
May 28 09:54:56.188079 np0000001613 nova-compute[98321]:             <cpu id='7' socket_id='7' die_id='7' core_id='0' siblings='7'/>
May 28 09:54:56.188079 np0000001613 nova-compute[98321]:             <cpu id='8' socket_id='8' die_id='8' core_id='0' siblings='8'/>
May 28 09:54:56.188079 np0000001613 nova-compute[98321]:             <cpu id='9' socket_id='9' die_id='9' core_id='0' siblings='9'/>
May 28 09:54:56.188079 np0000001613 nova-compute[98321]:             <cpu id='10' socket_id='10' die_id='10' core_id='0' siblings='10'/>
May 28 09:54:56.188079 np0000001613 nova-compute[98321]:             <cpu id='11' socket_id='11' die_id='11' core_id='0' siblings='11'/>
May 28 09:54:56.188079 np0000001613 nova-compute[98321]:           </cpus>
May 28 09:54:56.188079 np0000001613 nova-compute[98321]:         </cell>
May 28 09:54:56.188079 np0000001613 nova-compute[98321]:       </cells>
May 28 09:54:56.188079 np0000001613 nova-compute[98321]:     </topology>
May 28 09:54:56.188079 np0000001613 nova-compute[98321]:     <cache>
May 28 09:54:56.188079 np0000001613 nova-compute[98321]:       <bank id='0' level='3' type='both' size='32' unit='MiB' cpus='0'/>
May 28 09:54:56.188079 np0000001613 nova-compute[98321]:       <bank id='1' level='3' type='both' size='32' unit='MiB' cpus='1'/>
May 28 09:54:56.188079 np0000001613 nova-compute[98321]:       <bank id='2' level='3' type='both' size='32' unit='MiB' cpus='2'/>
May 28 09:54:56.188079 np0000001613 nova-compute[98321]:       <bank id='3' level='3' type='both' size='32' unit='MiB' cpus='3'/>
May 28 09:54:56.188079 np0000001613 nova-compute[98321]:       <bank id='4' level='3' type='both' size='32' unit='MiB' cpus='4'/>
May 28 09:54:56.188079 np0000001613 nova-compute[98321]:       <bank id='5' level='3' type='both' size='32' unit='MiB' cpus='5'/>
May 28 09:54:56.188079 np0000001613 nova-compute[98321]:       <bank id='6' level='3' type='both' size='32' unit='MiB' cpus='6'/>
May 28 09:54:56.188079 np0000001613 nova-compute[98321]:       <bank id='7' level='3' type='both' size='32' unit='MiB' cpus='7'/>
May 28 09:54:56.188079 np0000001613 nova-compute[98321]:       <bank id='8' level='3' type='both' size='32' unit='MiB' cpus='8'/>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:       <bank id='9' level='3' type='both' size='32' unit='MiB' cpus='9'/>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:       <bank id='10' level='3' type='both' size='32' unit='MiB' cpus='10'/>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:       <bank id='11' level='3' type='both' size='32' unit='MiB' cpus='11'/>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:     </cache>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:     <secmodel>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:       <model>apparmor</model>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:       <doi>0</doi>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:     </secmodel>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:     <secmodel>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:       <model>dac</model>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:       <doi>0</doi>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:       <baselabel type='kvm'>+64055:+993</baselabel>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:       <baselabel type='qemu'>+64055:+993</baselabel>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:     </secmodel>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:   </host>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:   <guest>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:     <os_type>hvm</os_type>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:     <arch name='alpha'>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:       <wordsize>64</wordsize>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:       <machine maxCpus='4'>clipper</machine>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:       <domain type='qemu'/>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:     </arch>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:     <features>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:       <cpuselection/>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:       <deviceboot/>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:       <disksnapshot default='on' toggle='no'/>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:       <externalSnapshot/>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:     </features>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:   </guest>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:   <guest>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:     <os_type>hvm</os_type>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:     <arch name='armv6l'>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:       <wordsize>32</wordsize>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:       <emulator>/usr/bin/qemu-system-arm</emulator>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-8.2</machine>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>mori-bmc</machine>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>ast2600-evb</machine>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>borzoi</machine>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>spitz</machine>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>virt-2.7</machine>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>nuri</machine>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>romulus-bmc</machine>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-3.0</machine>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-5.0</machine>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>npcm750-evb</machine>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>virt-2.10</machine>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>rainier-bmc</machine>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>mps3-an547</machine>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>musca-b1</machine>
May 28 09:54:56.189061 np0000001613 nova-compute[98321]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>versatileab</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>kzm</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>virt-2.8</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>fby35-bmc</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>musca-a</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-3.1</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-5.1</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>smdkc210</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>sx1</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>virt-2.11</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>imx25-pdk</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>virt-2.9</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='4'>orangepi-pc</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>z2</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-5.2</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>tosa</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>mps2-an500</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>virt-2.12</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>mps2-an521</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='4'>sabrelite</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>mps2-an511</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>canon-a1100</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>realview-eb</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-7.0</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-4.0</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>raspi1ap</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>sx1-v1</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>n810</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>g220a-bmc</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>n800</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-7.1</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 28 09:54:56.190332 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-4.1</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>quanta-gsj</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>versatilepb</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>terrier</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>mainstone</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>integratorcp</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-7.2</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-4.2</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>mps3-an524</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>kudo-bmc</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='4'>vexpress-a9</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='4'>midway</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>musicpal</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>lm3s811evb</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>microbit</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='3'>fby35</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>mps2-an505</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>mps2-an385</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-6.0</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-8.0</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>cubieboard</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>ast1030-evb</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>verdex</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='4'>bpim2u</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>netduino2</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>mps2-an386</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-6.1</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-8.1</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='4'>raspi2b</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='4'>vexpress-a15</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>fuji-bmc</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-6.2</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>cheetah</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>virt-2.6</machine>
May 28 09:54:56.191284 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>ast2500-evb</machine>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <machine maxCpus='4'>highbank</machine>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>akita</machine>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>connex</machine>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>netduinoplus2</machine>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>collie</machine>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>raspi0</machine>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <domain type='qemu'/>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:     </arch>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:     <features>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <cpuselection/>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <deviceboot/>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <disksnapshot default='on' toggle='no'/>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <externalSnapshot/>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:     </features>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:   </guest>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:   <guest>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:     <os_type>hvm</os_type>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:     <arch name='armv7l'>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <wordsize>32</wordsize>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <emulator>/usr/bin/qemu-system-arm</emulator>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-8.2</machine>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>mori-bmc</machine>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>ast2600-evb</machine>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>borzoi</machine>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>spitz</machine>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>virt-2.7</machine>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>nuri</machine>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>romulus-bmc</machine>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-3.0</machine>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-5.0</machine>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>npcm750-evb</machine>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>virt-2.10</machine>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>rainier-bmc</machine>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>mps3-an547</machine>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>musca-b1</machine>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>versatileab</machine>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>kzm</machine>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>virt-2.8</machine>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>fby35-bmc</machine>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>musca-a</machine>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-3.1</machine>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 28 09:54:56.192494 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-5.1</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>smdkc210</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>sx1</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>virt-2.11</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>imx25-pdk</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>virt-2.9</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='4'>orangepi-pc</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>z2</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-5.2</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>tosa</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>mps2-an500</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>virt-2.12</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>mps2-an521</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='4'>sabrelite</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>mps2-an511</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>canon-a1100</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>realview-eb</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-7.0</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-4.0</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>raspi1ap</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>sx1-v1</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>n810</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>g220a-bmc</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>n800</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-7.1</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-4.1</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>quanta-gsj</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>versatilepb</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>terrier</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>mainstone</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>integratorcp</machine>
May 28 09:54:56.193457 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-7.2</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-4.2</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>mps3-an524</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>kudo-bmc</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='4'>vexpress-a9</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='4'>midway</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>musicpal</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>lm3s811evb</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>microbit</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='3'>fby35</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>mps2-an505</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>mps2-an385</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-6.0</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-8.0</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>cubieboard</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>ast1030-evb</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>verdex</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='4'>bpim2u</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>netduino2</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>mps2-an386</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-6.1</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-8.1</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='4'>raspi2b</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='4'>vexpress-a15</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>fuji-bmc</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-6.2</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>cheetah</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>virt-2.6</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>ast2500-evb</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='4'>highbank</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>akita</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>connex</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>netduinoplus2</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>collie</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>raspi0</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 28 09:54:56.194153 np0000001613 nova-compute[98321]:       <domain type='qemu'/>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:     </arch>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:     <features>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:       <cpuselection/>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:       <deviceboot/>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:       <disksnapshot default='on' toggle='no'/>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:       <externalSnapshot/>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:     </features>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:   </guest>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:   <guest>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:     <os_type>hvm</os_type>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:     <arch name='aarch64'>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:       <wordsize>64</wordsize>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-8.2</machine>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>mori-bmc</machine>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>ast2600-evb</machine>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>borzoi</machine>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>spitz</machine>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>virt-2.7</machine>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>nuri</machine>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>romulus-bmc</machine>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-3.0</machine>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-5.0</machine>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>npcm750-evb</machine>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>virt-2.10</machine>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>rainier-bmc</machine>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>mps3-an547</machine>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>virt-2.8</machine>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>musca-b1</machine>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>versatileab</machine>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>kzm</machine>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>fby35-bmc</machine>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>musca-a</machine>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-3.1</machine>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-5.1</machine>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>smdkc210</machine>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>sx1</machine>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>virt-2.11</machine>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>imx25-pdk</machine>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>virt-2.9</machine>
May 28 09:54:56.194924 np0000001613 nova-compute[98321]:       <machine maxCpus='4'>orangepi-pc</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>z2</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-5.2</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='6'>xlnx-zcu102</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>tosa</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>mps2-an500</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>virt-2.12</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>mps2-an521</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='4'>sabrelite</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>mps2-an511</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>canon-a1100</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>realview-eb</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>sbsa-ref</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-7.0</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-4.0</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>raspi1ap</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>sx1-v1</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>n810</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>g220a-bmc</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>n800</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-7.1</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-4.1</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>quanta-gsj</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>versatilepb</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>terrier</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>mainstone</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>integratorcp</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-7.2</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-4.2</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 28 09:54:56.195954 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>mps3-an524</machine>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>kudo-bmc</machine>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <machine maxCpus='4'>vexpress-a9</machine>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <machine maxCpus='4'>midway</machine>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>musicpal</machine>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>lm3s811evb</machine>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>microbit</machine>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <machine maxCpus='3'>fby35</machine>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>mps2-an505</machine>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>mps2-an385</machine>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-6.0</machine>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-8.0</machine>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <machine maxCpus='4'>raspi3ap</machine>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>cubieboard</machine>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>ast1030-evb</machine>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>verdex</machine>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <machine maxCpus='4'>bpim2u</machine>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>netduino2</machine>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <machine maxCpus='4'>xlnx-versal-virt</machine>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>mps2-an386</machine>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-6.1</machine>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-8.1</machine>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <machine maxCpus='4'>raspi3b</machine>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <machine maxCpus='4'>raspi2b</machine>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <machine maxCpus='4'>vexpress-a15</machine>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <machine maxCpus='2'>fuji-bmc</machine>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt-6.2</machine>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>cheetah</machine>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>virt-2.6</machine>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>ast2500-evb</machine>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <machine maxCpus='4'>highbank</machine>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>akita</machine>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>connex</machine>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>netduinoplus2</machine>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>collie</machine>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>raspi0</machine>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <domain type='qemu'/>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:     </arch>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:     <features>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <acpi default='on' toggle='yes'/>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <cpuselection/>
May 28 09:54:56.196947 np0000001613 nova-compute[98321]:       <deviceboot/>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:       <disksnapshot default='on' toggle='no'/>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:       <externalSnapshot/>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:     </features>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:   </guest>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:   <guest>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:     <os_type>hvm</os_type>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:     <arch name='cris'>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:       <wordsize>32</wordsize>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:       <emulator>/usr/bin/qemu-system-cris</emulator>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>axis-dev88</machine>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:       <domain type='qemu'/>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:     </arch>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:     <features>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:       <cpuselection/>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:       <deviceboot/>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:       <disksnapshot default='on' toggle='no'/>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:       <externalSnapshot/>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:     </features>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:   </guest>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:   <guest>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:     <os_type>hvm</os_type>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:     <arch name='i686'>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:       <wordsize>32</wordsize>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:       <emulator>/usr/bin/qemu-system-i386</emulator>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-noble-v2</machine>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:       <machine canonical='pc-i440fx-noble-v2' maxCpus='255'>ubuntu</machine>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-mantic</machine>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-5.2</machine>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-lunar-hpb</machine>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-mantic</machine>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.0</machine>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-kinetic</machine>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-4.2</machine>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-mantic-maxcpus</machine>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-q35-xenial</machine>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-q35-2.7</machine>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
May 28 09:54:56.197922 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-groovy</machine>
May 28 09:54:56.198903 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
May 28 09:54:56.198903 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-lunar</machine>
May 28 09:54:56.198903 np0000001613 nova-compute[98321]:       <machine maxCpus='1024'>pc-q35-mantic-hpb-maxcpus</machine>
May 28 09:54:56.198903 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
May 28 09:54:56.198903 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-7.1</machine>
May 28 09:54:56.198903 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-artful</machine>
May 28 09:54:56.198903 np0000001613 nova-compute[98321]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-trusty</machine>
May 28 09:54:56.198903 np0000001613 nova-compute[98321]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.2</machine>
May 28 09:54:56.198903 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
May 28 09:54:56.198903 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
May 28 09:54:56.198903 np0000001613 nova-compute[98321]:       <machine maxCpus='1024'>pc-q35-8.1</machine>
May 28 09:54:56.198903 np0000001613 nova-compute[98321]:       <machine maxCpus='1024'>pc-q35-jammy-maxcpus</machine>
May 28 09:54:56.198903 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
May 28 09:54:56.198903 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-mantic-hpb</machine>
May 28 09:54:56.198903 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
May 28 09:54:56.198903 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-8.1</machine>
May 28 09:54:56.198903 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
May 28 09:54:56.198903 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-6.1</machine>
May 28 09:54:56.198903 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-kinetic</machine>
May 28 09:54:56.198903 np0000001613 nova-compute[98321]:       <machine maxCpus='1024'>pc-i440fx-jammy-maxcpus</machine>
May 28 09:54:56.198903 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
May 28 09:54:56.198903 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-q35-2.4</machine>
May 28 09:54:56.198903 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
May 28 09:54:56.198903 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-7.1</machine>
May 28 09:54:56.198903 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-2.10</machine>
May 28 09:54:56.198903 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>x-remote</machine>
May 28 09:54:56.198903 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-5.1</machine>
May 28 09:54:56.198903 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-2.9</machine>
May 28 09:54:56.198903 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
May 28 09:54:56.198903 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb-maxcpus</machine>
May 28 09:54:56.198903 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-3.1</machine>
May 28 09:54:56.198903 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
May 28 09:54:56.198903 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-4.1</machine>
May 28 09:54:56.198903 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-jammy</machine>
May 28 09:54:56.198903 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
May 28 09:54:56.198903 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
May 28 09:54:56.198903 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-eoan</machine>
May 28 09:54:56.199745 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
May 28 09:54:56.199745 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
May 28 09:54:56.199745 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
May 28 09:54:56.199745 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
May 28 09:54:56.199745 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-lunar</machine>
May 28 09:54:56.199745 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>isapc</machine>
May 28 09:54:56.199745 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb</machine>
May 28 09:54:56.199745 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
May 28 09:54:56.199745 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-q35-2.6</machine>
May 28 09:54:56.199745 np0000001613 nova-compute[98321]:       <machine maxCpus='1024'>pc-q35-mantic-maxcpus</machine>
May 28 09:54:56.199745 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
May 28 09:54:56.199745 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-bionic</machine>
May 28 09:54:56.199745 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
May 28 09:54:56.199745 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
May 28 09:54:56.199745 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-2.12</machine>
May 28 09:54:56.199745 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
May 28 09:54:56.199745 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-kinetic-hpb</machine>
May 28 09:54:56.199745 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
May 28 09:54:56.199745 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-7.0</machine>
May 28 09:54:56.199745 np0000001613 nova-compute[98321]:       <machine maxCpus='1024'>pc-q35-noble-v2</machine>
May 28 09:54:56.199745 np0000001613 nova-compute[98321]:       <machine canonical='pc-q35-noble-v2' maxCpus='1024'>ubuntu-q35</machine>
May 28 09:54:56.199745 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-lunar-hpb</machine>
May 28 09:54:56.199745 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-disco</machine>
May 28 09:54:56.199745 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
May 28 09:54:56.199745 np0000001613 nova-compute[98321]:       <machine maxCpus='1024'>pc-q35-noble</machine>
May 28 09:54:56.199745 np0000001613 nova-compute[98321]:       <machine canonical='pc-q35-noble' maxCpus='1024'>q35</machine>
May 28 09:54:56.199745 np0000001613 nova-compute[98321]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.1</machine>
May 28 09:54:56.199745 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-8.0</machine>
May 28 09:54:56.199745 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-impish</machine>
May 28 09:54:56.199745 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
May 28 09:54:56.199745 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-8.0</machine>
May 28 09:54:56.199745 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
May 28 09:54:56.199745 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-6.0</machine>
May 28 09:54:56.199745 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
May 28 09:54:56.199745 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
May 28 09:54:56.199745 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
May 28 09:54:56.200605 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
May 28 09:54:56.200605 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
May 28 09:54:56.200605 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
May 28 09:54:56.200605 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-7.0</machine>
May 28 09:54:56.200605 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-5.0</machine>
May 28 09:54:56.200605 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-2.8</machine>
May 28 09:54:56.200605 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
May 28 09:54:56.200605 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-3.0</machine>
May 28 09:54:56.200605 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
May 28 09:54:56.200605 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-zesty</machine>
May 28 09:54:56.200605 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-7.2</machine>
May 28 09:54:56.200605 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-4.0</machine>
May 28 09:54:56.200605 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-focal</machine>
May 28 09:54:56.200605 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>microvm</machine>
May 28 09:54:56.200605 np0000001613 nova-compute[98321]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.3</machine>
May 28 09:54:56.200605 np0000001613 nova-compute[98321]:       <machine maxCpus='1024'>pc-q35-jammy-hpb-maxcpus</machine>
May 28 09:54:56.200605 np0000001613 nova-compute[98321]:       <machine maxCpus='1024'>pc-q35-8.2</machine>
May 28 09:54:56.200605 np0000001613 nova-compute[98321]:       <machine canonical='pc-q35-8.2' maxCpus='1024'>q35</machine>
May 28 09:54:56.200605 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-kinetic-hpb</machine>
May 28 09:54:56.200605 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
May 28 09:54:56.200605 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
May 28 09:54:56.200605 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-noble</machine>
May 28 09:54:56.200605 np0000001613 nova-compute[98321]:       <machine canonical='pc-i440fx-noble' maxCpus='255'>pc</machine>
May 28 09:54:56.200605 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
May 28 09:54:56.200605 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
May 28 09:54:56.200605 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-8.2</machine>
May 28 09:54:56.200605 np0000001613 nova-compute[98321]:       <machine canonical='pc-i440fx-8.2' maxCpus='255'>pc</machine>
May 28 09:54:56.200605 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
May 28 09:54:56.200605 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
May 28 09:54:56.200605 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-6.2</machine>
May 28 09:54:56.200605 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
May 28 09:54:56.200605 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
May 28 09:54:56.200605 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-q35-2.5</machine>
May 28 09:54:56.200605 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
May 28 09:54:56.200605 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
May 28 09:54:56.200605 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb-maxcpus</machine>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-7.2</machine>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-2.11</machine>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <domain type='qemu'/>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <domain type='kvm'/>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:     </arch>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:     <features>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <pae/>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <nonpae/>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <acpi default='on' toggle='yes'/>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <apic default='on' toggle='no'/>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <cpuselection/>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <deviceboot/>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <disksnapshot default='on' toggle='no'/>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <externalSnapshot/>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:     </features>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:   </guest>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:   <guest>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:     <os_type>hvm</os_type>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:     <arch name='m68k'>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <wordsize>32</wordsize>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>mcf5208evb</machine>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>virt-7.0</machine>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>an5206</machine>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>virt-6.0</machine>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>q800</machine>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>virt-8.1</machine>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>virt-7.2</machine>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>virt-6.2</machine>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>virt-8.0</machine>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>next-cube</machine>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>virt-7.1</machine>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>virt-6.1</machine>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>virt-8.2</machine>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <machine canonical='virt-8.2' maxCpus='1'>virt</machine>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <domain type='qemu'/>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:     </arch>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:     <features>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <cpuselection/>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <deviceboot/>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <disksnapshot default='on' toggle='no'/>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <externalSnapshot/>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:     </features>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:   </guest>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:   <guest>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:     <os_type>hvm</os_type>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:     <arch name='microblaze'>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <wordsize>32</wordsize>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>petalogix-ml605</machine>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <domain type='qemu'/>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:     </arch>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:     <features>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <cpuselection/>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <deviceboot/>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <disksnapshot default='on' toggle='no'/>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <externalSnapshot/>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:     </features>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:   </guest>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:   <guest>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:     <os_type>hvm</os_type>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:     <arch name='microblazeel'>
May 28 09:54:56.201520 np0000001613 nova-compute[98321]:       <wordsize>32</wordsize>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>petalogix-ml605</machine>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:       <domain type='qemu'/>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:     </arch>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:     <features>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:       <cpuselection/>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:       <deviceboot/>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:       <disksnapshot default='on' toggle='no'/>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:       <externalSnapshot/>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:     </features>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:   </guest>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:   <guest>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:     <os_type>hvm</os_type>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:     <arch name='mips'>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:       <wordsize>32</wordsize>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:       <emulator>/usr/bin/qemu-system-mips</emulator>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:       <machine maxCpus='16'>malta</machine>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>mipssim</machine>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:       <domain type='qemu'/>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:     </arch>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:     <features>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:       <cpuselection/>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:       <deviceboot/>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:       <disksnapshot default='on' toggle='no'/>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:       <externalSnapshot/>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:     </features>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:   </guest>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:   <guest>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:     <os_type>hvm</os_type>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:     <arch name='mipsel'>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:       <wordsize>32</wordsize>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:       <machine maxCpus='16'>malta</machine>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>mipssim</machine>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:       <domain type='qemu'/>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:     </arch>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:     <features>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:       <cpuselection/>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:       <deviceboot/>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:       <disksnapshot default='on' toggle='no'/>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:       <externalSnapshot/>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:     </features>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:   </guest>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:   <guest>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:     <os_type>hvm</os_type>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:     <arch name='mips64'>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:       <wordsize>64</wordsize>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:       <machine maxCpus='16'>malta</machine>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>mipssim</machine>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>pica61</machine>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>magnum</machine>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:       <domain type='qemu'/>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:     </arch>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:     <features>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:       <cpuselection/>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:       <deviceboot/>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:       <disksnapshot default='on' toggle='no'/>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:       <externalSnapshot/>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:     </features>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:   </guest>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:   <guest>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:     <os_type>hvm</os_type>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:     <arch name='mips64el'>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:       <wordsize>64</wordsize>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
May 28 09:54:56.203010 np0000001613 nova-compute[98321]:       <machine maxCpus='16'>malta</machine>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:       <machine maxCpus='16'>loongson3-virt</machine>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>mipssim</machine>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>pica61</machine>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>magnum</machine>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:       <machine maxCpus='16'>boston</machine>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>fuloong2e</machine>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:       <domain type='qemu'/>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:     </arch>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:     <features>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:       <cpuselection/>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:       <deviceboot/>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:       <disksnapshot default='on' toggle='no'/>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:       <externalSnapshot/>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:     </features>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:   </guest>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:   <guest>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:     <os_type>hvm</os_type>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:     <arch name='ppc'>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:       <wordsize>32</wordsize>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>g3beige</machine>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>amigaone</machine>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>virtex-ml507</machine>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>mac99</machine>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:       <machine maxCpus='32'>ppce500</machine>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>sam460ex</machine>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>pegasos2</machine>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>bamboo</machine>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>40p</machine>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>ref405ep</machine>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:       <machine maxCpus='15'>mpc8544ds</machine>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:       <domain type='qemu'/>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:     </arch>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:     <features>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:       <cpuselection/>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:       <deviceboot/>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:       <disksnapshot default='on' toggle='no'/>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:       <externalSnapshot/>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:     </features>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:   </guest>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:   <guest>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:     <os_type>hvm</os_type>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:     <arch name='ppc64'>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:       <wordsize>64</wordsize>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-noble</machine>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:       <machine canonical='pseries-noble' maxCpus='4096'>pseries</machine>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>amigaone</machine>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:       <machine maxCpus='2048'>powernv9</machine>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-4.1</machine>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:       <machine maxCpus='15'>mpc8544ds</machine>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-6.1</machine>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-2.5</machine>
May 28 09:54:56.204301 np0000001613 nova-compute[98321]:       <machine maxCpus='2048'>powernv10</machine>
May 28 09:54:56.205358 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-xenial</machine>
May 28 09:54:56.205358 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-4.2</machine>
May 28 09:54:56.205358 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-6.2</machine>
May 28 09:54:56.205358 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-yakkety</machine>
May 28 09:54:56.205358 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-2.6</machine>
May 28 09:54:56.205358 np0000001613 nova-compute[98321]:       <machine maxCpus='32'>ppce500</machine>
May 28 09:54:56.205358 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-bionic-sxxm</machine>
May 28 09:54:56.205358 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-2.7</machine>
May 28 09:54:56.205358 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-3.0</machine>
May 28 09:54:56.205358 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-8.0</machine>
May 28 09:54:56.205358 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-5.0</machine>
May 28 09:54:56.205358 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>40p</machine>
May 28 09:54:56.205358 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-lunar</machine>
May 28 09:54:56.205358 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-2.8</machine>
May 28 09:54:56.205358 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>pegasos2</machine>
May 28 09:54:56.205358 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-hirsute</machine>
May 28 09:54:56.205358 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-3.1</machine>
May 28 09:54:56.205358 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-8.1</machine>
May 28 09:54:56.205358 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-5.1</machine>
May 28 09:54:56.205358 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-eoan</machine>
May 28 09:54:56.205358 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-2.9</machine>
May 28 09:54:56.205358 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-zesty</machine>
May 28 09:54:56.205358 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>bamboo</machine>
May 28 09:54:56.205358 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-groovy</machine>
May 28 09:54:56.205358 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-focal</machine>
May 28 09:54:56.205358 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>g3beige</machine>
May 28 09:54:56.205358 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-8.2</machine>
May 28 09:54:56.205358 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-5.2</machine>
May 28 09:54:56.205358 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-disco</machine>
May 28 09:54:56.205358 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-2.12-sxxm</machine>
May 28 09:54:56.205358 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-mantic</machine>
May 28 09:54:56.205358 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-kinetic</machine>
May 28 09:54:56.205358 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-2.10</machine>
May 28 09:54:56.205358 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-7.0</machine>
May 28 09:54:56.205358 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>virtex-ml507</machine>
May 28 09:54:56.205358 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-2.11</machine>
May 28 09:54:56.205358 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-2.1</machine>
May 28 09:54:56.205358 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-7.1</machine>
May 28 09:54:56.205358 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-cosmic</machine>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-bionic</machine>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-2.12</machine>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-2.2</machine>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-7.2</machine>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>mac99</machine>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-impish</machine>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-jammy</machine>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-artful</machine>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>sam460ex</machine>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>ref405ep</machine>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-2.3</machine>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:       <machine maxCpus='2048'>powernv8</machine>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-4.0</machine>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-6.0</machine>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-2.4</machine>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:       <domain type='qemu'/>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:     </arch>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:     <features>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:       <cpuselection/>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:       <deviceboot/>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:       <disksnapshot default='on' toggle='no'/>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:       <externalSnapshot/>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:     </features>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:   </guest>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:   <guest>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:     <os_type>hvm</os_type>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:     <arch name='ppc64le'>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:       <wordsize>64</wordsize>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-noble</machine>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:       <machine canonical='pseries-noble' maxCpus='4096'>pseries</machine>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>amigaone</machine>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:       <machine maxCpus='2048'>powernv9</machine>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-4.1</machine>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:       <machine maxCpus='15'>mpc8544ds</machine>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-6.1</machine>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-2.5</machine>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:       <machine maxCpus='2048'>powernv10</machine>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-xenial</machine>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-4.2</machine>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-6.2</machine>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-yakkety</machine>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-2.6</machine>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:       <machine maxCpus='32'>ppce500</machine>
May 28 09:54:56.206316 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-bionic-sxxm</machine>
May 28 09:54:56.207648 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-2.7</machine>
May 28 09:54:56.207648 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-3.0</machine>
May 28 09:54:56.207648 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-8.0</machine>
May 28 09:54:56.207648 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-5.0</machine>
May 28 09:54:56.207648 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>40p</machine>
May 28 09:54:56.207648 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-lunar</machine>
May 28 09:54:56.207648 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-2.8</machine>
May 28 09:54:56.207648 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>pegasos2</machine>
May 28 09:54:56.207648 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-hirsute</machine>
May 28 09:54:56.207648 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-3.1</machine>
May 28 09:54:56.207648 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-8.1</machine>
May 28 09:54:56.207648 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-5.1</machine>
May 28 09:54:56.207648 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-eoan</machine>
May 28 09:54:56.207648 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-2.9</machine>
May 28 09:54:56.207648 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-zesty</machine>
May 28 09:54:56.207648 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>bamboo</machine>
May 28 09:54:56.207648 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-groovy</machine>
May 28 09:54:56.207648 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-focal</machine>
May 28 09:54:56.207648 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>g3beige</machine>
May 28 09:54:56.207648 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-8.2</machine>
May 28 09:54:56.207648 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-5.2</machine>
May 28 09:54:56.207648 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-disco</machine>
May 28 09:54:56.207648 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-2.12-sxxm</machine>
May 28 09:54:56.207648 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-mantic</machine>
May 28 09:54:56.207648 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-kinetic</machine>
May 28 09:54:56.207648 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-2.10</machine>
May 28 09:54:56.207648 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-7.0</machine>
May 28 09:54:56.207648 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>virtex-ml507</machine>
May 28 09:54:56.207648 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-2.11</machine>
May 28 09:54:56.207648 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-2.1</machine>
May 28 09:54:56.207648 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-7.1</machine>
May 28 09:54:56.207648 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-cosmic</machine>
May 28 09:54:56.207648 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-bionic</machine>
May 28 09:54:56.207648 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-2.12</machine>
May 28 09:54:56.207648 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-2.2</machine>
May 28 09:54:56.207648 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-7.2</machine>
May 28 09:54:56.207648 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>mac99</machine>
May 28 09:54:56.207648 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-impish</machine>
May 28 09:54:56.207648 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-jammy</machine>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-artful</machine>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>sam460ex</machine>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>ref405ep</machine>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-2.3</machine>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:       <machine maxCpus='2048'>powernv8</machine>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-4.0</machine>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-6.0</machine>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:       <machine maxCpus='4096'>pseries-2.4</machine>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:       <domain type='qemu'/>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:     </arch>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:     <features>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:       <cpuselection/>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:       <deviceboot/>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:       <disksnapshot default='on' toggle='no'/>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:       <externalSnapshot/>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:     </features>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:   </guest>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:   <guest>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:     <os_type>hvm</os_type>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:     <arch name='riscv32'>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:       <wordsize>32</wordsize>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt</machine>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:       <machine maxCpus='8'>spike</machine>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>opentitan</machine>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:       <machine maxCpus='5'>sifive_u</machine>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>sifive_e</machine>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:       <domain type='qemu'/>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:     </arch>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:     <features>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:       <cpuselection/>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:       <deviceboot/>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:       <disksnapshot default='on' toggle='no'/>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:       <externalSnapshot/>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:     </features>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:   </guest>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:   <guest>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:     <os_type>hvm</os_type>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:     <arch name='riscv64'>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:       <wordsize>64</wordsize>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:       <machine maxCpus='512'>virt</machine>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:       <machine maxCpus='8'>spike</machine>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:       <machine maxCpus='5'>sifive_u</machine>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>shakti_c</machine>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>sifive_e</machine>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:       <domain type='qemu'/>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:     </arch>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:     <features>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:       <cpuselection/>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:       <deviceboot/>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:       <disksnapshot default='on' toggle='no'/>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:       <externalSnapshot/>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:     </features>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:   </guest>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:   <guest>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:     <os_type>hvm</os_type>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:     <arch name='s390x'>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:       <wordsize>64</wordsize>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
May 28 09:54:56.208367 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-noble</machine>
May 28 09:54:56.209806 np0000001613 nova-compute[98321]:       <machine canonical='s390-ccw-virtio-noble' maxCpus='248'>s390-ccw-virtio</machine>
May 28 09:54:56.209806 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-8.0</machine>
May 28 09:54:56.209806 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
May 28 09:54:56.209806 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
May 28 09:54:56.209806 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
May 28 09:54:56.209806 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-7.0</machine>
May 28 09:54:56.209806 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-mantic</machine>
May 28 09:54:56.209806 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
May 28 09:54:56.209806 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
May 28 09:54:56.209806 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
May 28 09:54:56.209806 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
May 28 09:54:56.209806 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
May 28 09:54:56.209806 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
May 28 09:54:56.209806 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-8.2</machine>
May 28 09:54:56.209806 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
May 28 09:54:56.209806 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
May 28 09:54:56.209806 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
May 28 09:54:56.209806 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
May 28 09:54:56.209806 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-7.2</machine>
May 28 09:54:56.209806 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
May 28 09:54:56.209806 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
May 28 09:54:56.209806 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
May 28 09:54:56.209806 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
May 28 09:54:56.209806 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
May 28 09:54:56.209806 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
May 28 09:54:56.209806 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-lunar</machine>
May 28 09:54:56.209806 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
May 28 09:54:56.209806 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-kinetic</machine>
May 28 09:54:56.209806 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-8.1</machine>
May 28 09:54:56.209806 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
May 28 09:54:56.209806 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
May 28 09:54:56.209806 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
May 28 09:54:56.209806 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-7.1</machine>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:       <domain type='qemu'/>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:     </arch>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:     <features>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:       <cpuselection/>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:       <deviceboot/>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:       <disksnapshot default='on' toggle='no'/>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:       <externalSnapshot/>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:     </features>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:   </guest>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:   <guest>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:     <os_type>hvm</os_type>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:     <arch name='sh4'>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:       <wordsize>32</wordsize>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>shix</machine>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>r2d</machine>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:       <domain type='qemu'/>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:     </arch>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:     <features>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:       <cpuselection/>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:       <deviceboot/>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:       <disksnapshot default='on' toggle='no'/>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:       <externalSnapshot/>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:     </features>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:   </guest>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:   <guest>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:     <os_type>hvm</os_type>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:     <arch name='sh4eb'>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:       <wordsize>64</wordsize>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>shix</machine>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>r2d</machine>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:       <domain type='qemu'/>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:     </arch>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:     <features>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:       <cpuselection/>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:       <deviceboot/>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:       <disksnapshot default='on' toggle='no'/>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:       <externalSnapshot/>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:     </features>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:   </guest>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:   <guest>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:     <os_type>hvm</os_type>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:     <arch name='sparc'>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:       <wordsize>32</wordsize>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>SS-5</machine>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:       <machine maxCpus='4'>SS-20</machine>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>LX</machine>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>SPARCClassic</machine>
May 28 09:54:56.210685 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>leon3_generic</machine>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>SPARCbook</machine>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>SS-4</machine>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:       <machine maxCpus='4'>SS-600MP</machine>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:       <machine maxCpus='4'>SS-10</machine>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>Voyager</machine>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:       <domain type='qemu'/>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:     </arch>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:     <features>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:       <cpuselection/>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:       <deviceboot/>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:       <disksnapshot default='on' toggle='no'/>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:       <externalSnapshot/>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:     </features>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:   </guest>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:   <guest>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:     <os_type>hvm</os_type>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:     <arch name='sparc64'>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:       <wordsize>64</wordsize>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>sun4u</machine>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>niagara</machine>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>sun4v</machine>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:       <domain type='qemu'/>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:     </arch>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:     <features>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:       <cpuselection/>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:       <deviceboot/>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:       <disksnapshot default='on' toggle='no'/>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:       <externalSnapshot/>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:     </features>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:   </guest>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:   <guest>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:     <os_type>hvm</os_type>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:     <arch name='x86_64'>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:       <wordsize>64</wordsize>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-noble-v2</machine>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:       <machine canonical='pc-i440fx-noble-v2' maxCpus='255'>ubuntu</machine>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-mantic</machine>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-5.2</machine>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-lunar-hpb</machine>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-mantic</machine>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.0</machine>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-kinetic</machine>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-4.2</machine>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-mantic-maxcpus</machine>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
May 28 09:54:56.211898 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
May 28 09:54:56.213242 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
May 28 09:54:56.213242 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-q35-xenial</machine>
May 28 09:54:56.213242 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
May 28 09:54:56.213242 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
May 28 09:54:56.213242 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-q35-2.7</machine>
May 28 09:54:56.213242 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
May 28 09:54:56.213242 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
May 28 09:54:56.213242 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-groovy</machine>
May 28 09:54:56.213242 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
May 28 09:54:56.213242 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-lunar</machine>
May 28 09:54:56.213242 np0000001613 nova-compute[98321]:       <machine maxCpus='1024'>pc-q35-mantic-hpb-maxcpus</machine>
May 28 09:54:56.213242 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
May 28 09:54:56.213242 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-7.1</machine>
May 28 09:54:56.213242 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-artful</machine>
May 28 09:54:56.213242 np0000001613 nova-compute[98321]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-trusty</machine>
May 28 09:54:56.213242 np0000001613 nova-compute[98321]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.2</machine>
May 28 09:54:56.213242 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
May 28 09:54:56.213242 np0000001613 nova-compute[98321]:       <machine maxCpus='1024'>pc-q35-8.1</machine>
May 28 09:54:56.213242 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
May 28 09:54:56.213242 np0000001613 nova-compute[98321]:       <machine maxCpus='1024'>pc-q35-jammy-maxcpus</machine>
May 28 09:54:56.213242 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
May 28 09:54:56.213242 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-mantic-hpb</machine>
May 28 09:54:56.213242 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
May 28 09:54:56.213242 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-8.1</machine>
May 28 09:54:56.213242 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
May 28 09:54:56.213242 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-6.1</machine>
May 28 09:54:56.213242 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-kinetic</machine>
May 28 09:54:56.213242 np0000001613 nova-compute[98321]:       <machine maxCpus='1024'>pc-i440fx-jammy-maxcpus</machine>
May 28 09:54:56.213242 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
May 28 09:54:56.213242 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-q35-2.4</machine>
May 28 09:54:56.213242 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
May 28 09:54:56.213242 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-7.1</machine>
May 28 09:54:56.213242 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-2.10</machine>
May 28 09:54:56.213242 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>x-remote</machine>
May 28 09:54:56.213242 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-5.1</machine>
May 28 09:54:56.213242 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-2.9</machine>
May 28 09:54:56.213242 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
May 28 09:54:56.213987 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb-maxcpus</machine>
May 28 09:54:56.213987 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-3.1</machine>
May 28 09:54:56.213987 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
May 28 09:54:56.213987 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-4.1</machine>
May 28 09:54:56.213987 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-jammy</machine>
May 28 09:54:56.213987 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
May 28 09:54:56.213987 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
May 28 09:54:56.213987 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-eoan</machine>
May 28 09:54:56.213987 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
May 28 09:54:56.213987 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
May 28 09:54:56.213987 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
May 28 09:54:56.213987 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
May 28 09:54:56.213987 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-lunar</machine>
May 28 09:54:56.213987 np0000001613 nova-compute[98321]:       <machine maxCpus='1'>isapc</machine>
May 28 09:54:56.213987 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb</machine>
May 28 09:54:56.213987 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
May 28 09:54:56.213987 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-q35-2.6</machine>
May 28 09:54:56.213987 np0000001613 nova-compute[98321]:       <machine maxCpus='1024'>pc-q35-mantic-maxcpus</machine>
May 28 09:54:56.213987 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
May 28 09:54:56.213987 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-bionic</machine>
May 28 09:54:56.213987 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
May 28 09:54:56.213987 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
May 28 09:54:56.213987 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-2.12</machine>
May 28 09:54:56.213987 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
May 28 09:54:56.213987 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-kinetic-hpb</machine>
May 28 09:54:56.213987 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
May 28 09:54:56.213987 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-7.0</machine>
May 28 09:54:56.213987 np0000001613 nova-compute[98321]:       <machine maxCpus='1024'>pc-q35-noble-v2</machine>
May 28 09:54:56.213987 np0000001613 nova-compute[98321]:       <machine canonical='pc-q35-noble-v2' maxCpus='1024'>ubuntu-q35</machine>
May 28 09:54:56.213987 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-lunar-hpb</machine>
May 28 09:54:56.213987 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-disco</machine>
May 28 09:54:56.213987 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
May 28 09:54:56.213987 np0000001613 nova-compute[98321]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.1</machine>
May 28 09:54:56.213987 np0000001613 nova-compute[98321]:       <machine maxCpus='1024'>pc-q35-noble</machine>
May 28 09:54:56.213987 np0000001613 nova-compute[98321]:       <machine canonical='pc-q35-noble' maxCpus='1024'>q35</machine>
May 28 09:54:56.213987 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-8.0</machine>
May 28 09:54:56.214691 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
May 28 09:54:56.214691 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-impish</machine>
May 28 09:54:56.214691 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-8.0</machine>
May 28 09:54:56.214691 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
May 28 09:54:56.214691 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-6.0</machine>
May 28 09:54:56.214691 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
May 28 09:54:56.214691 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
May 28 09:54:56.214691 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
May 28 09:54:56.214691 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
May 28 09:54:56.214691 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
May 28 09:54:56.214691 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
May 28 09:54:56.214691 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-7.0</machine>
May 28 09:54:56.214691 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-5.0</machine>
May 28 09:54:56.214691 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-2.8</machine>
May 28 09:54:56.214691 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
May 28 09:54:56.214691 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-3.0</machine>
May 28 09:54:56.214691 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-zesty</machine>
May 28 09:54:56.214691 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-7.2</machine>
May 28 09:54:56.214691 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-4.0</machine>
May 28 09:54:56.214691 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
May 28 09:54:56.214691 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-focal</machine>
May 28 09:54:56.214691 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>microvm</machine>
May 28 09:54:56.214691 np0000001613 nova-compute[98321]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.3</machine>
May 28 09:54:56.214691 np0000001613 nova-compute[98321]:       <machine maxCpus='1024'>pc-q35-jammy-hpb-maxcpus</machine>
May 28 09:54:56.214691 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
May 28 09:54:56.214691 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-kinetic-hpb</machine>
May 28 09:54:56.214691 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
May 28 09:54:56.214691 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
May 28 09:54:56.214691 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-noble</machine>
May 28 09:54:56.214691 np0000001613 nova-compute[98321]:       <machine canonical='pc-i440fx-noble' maxCpus='255'>pc</machine>
May 28 09:54:56.214691 np0000001613 nova-compute[98321]:       <machine maxCpus='1024'>pc-q35-8.2</machine>
May 28 09:54:56.214691 np0000001613 nova-compute[98321]:       <machine canonical='pc-q35-8.2' maxCpus='1024'>q35</machine>
May 28 09:54:56.214691 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
May 28 09:54:56.214691 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
May 28 09:54:56.214691 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-8.2</machine>
May 28 09:54:56.214691 np0000001613 nova-compute[98321]:       <machine canonical='pc-i440fx-8.2' maxCpus='255'>pc</machine>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-6.2</machine>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-q35-2.5</machine>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb-maxcpus</machine>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <machine maxCpus='255'>pc-i440fx-7.2</machine>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <machine maxCpus='288'>pc-q35-2.11</machine>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <domain type='qemu'/>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <domain type='kvm'/>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:     </arch>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:     <features>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <acpi default='on' toggle='yes'/>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <apic default='on' toggle='no'/>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <cpuselection/>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <deviceboot/>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <disksnapshot default='on' toggle='no'/>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <externalSnapshot/>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:     </features>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:   </guest>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:   <guest>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:     <os_type>hvm</os_type>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:     <arch name='xtensa'>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <wordsize>32</wordsize>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <machine maxCpus='4'>sim</machine>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <machine maxCpus='32'>kc705</machine>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <machine maxCpus='32'>ml605</machine>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <machine maxCpus='32'>ml605-nommu</machine>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <machine maxCpus='32'>virt</machine>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <machine maxCpus='32'>lx60-nommu</machine>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <machine maxCpus='32'>lx200</machine>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <machine maxCpus='32'>lx200-nommu</machine>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <machine maxCpus='32'>lx60</machine>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <machine maxCpus='32'>kc705-nommu</machine>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <domain type='qemu'/>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:     </arch>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:     <features>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <cpuselection/>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <deviceboot/>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <disksnapshot default='on' toggle='no'/>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <externalSnapshot/>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:     </features>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:   </guest>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:   <guest>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:     <os_type>hvm</os_type>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:     <arch name='xtensaeb'>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <wordsize>32</wordsize>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <machine maxCpus='4'>sim</machine>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <machine maxCpus='32'>kc705</machine>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <machine maxCpus='32'>ml605</machine>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <machine maxCpus='32'>ml605-nommu</machine>
May 28 09:54:56.215509 np0000001613 nova-compute[98321]:       <machine maxCpus='32'>virt</machine>
May 28 09:54:56.216624 np0000001613 nova-compute[98321]:       <machine maxCpus='32'>lx60-nommu</machine>
May 28 09:54:56.216624 np0000001613 nova-compute[98321]:       <machine maxCpus='32'>lx200</machine>
May 28 09:54:56.216624 np0000001613 nova-compute[98321]:       <machine maxCpus='32'>lx200-nommu</machine>
May 28 09:54:56.216624 np0000001613 nova-compute[98321]:       <machine maxCpus='32'>lx60</machine>
May 28 09:54:56.216624 np0000001613 nova-compute[98321]:       <machine maxCpus='32'>kc705-nommu</machine>
May 28 09:54:56.216624 np0000001613 nova-compute[98321]:       <domain type='qemu'/>
May 28 09:54:56.216624 np0000001613 nova-compute[98321]:     </arch>
May 28 09:54:56.216624 np0000001613 nova-compute[98321]:     <features>
May 28 09:54:56.216624 np0000001613 nova-compute[98321]:       <cpuselection/>
May 28 09:54:56.216624 np0000001613 nova-compute[98321]:       <deviceboot/>
May 28 09:54:56.216624 np0000001613 nova-compute[98321]:       <disksnapshot default='on' toggle='no'/>
May 28 09:54:56.216624 np0000001613 nova-compute[98321]:       <externalSnapshot/>
May 28 09:54:56.216624 np0000001613 nova-compute[98321]:     </features>
May 28 09:54:56.216624 np0000001613 nova-compute[98321]:   </guest>
May 28 09:54:56.216624 np0000001613 nova-compute[98321]: </capabilities>
May 28 09:54:56.216624 np0000001613 nova-compute[98321]: 
May 28 09:54:56.216624 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=98321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 09:54:56.225108 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Libvirt host hypervisor capabilities for arch=alpha and machine_type=None:
May 28 09:54:56.225108 np0000001613 nova-compute[98321]: <domainCapabilities>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:   <path>/usr/bin/qemu-system-alpha</path>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:   <domain>qemu</domain>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:   <machine>clipper</machine>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:   <arch>alpha</arch>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:   <vcpu max='4'/>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:   <iothreads supported='yes'/>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:   <os supported='yes'>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:     <enum name='firmware'/>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:     <loader supported='yes'>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:         <value>rom</value>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:         <value>pflash</value>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:       <enum name='readonly'>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:         <value>yes</value>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:       <enum name='secure'>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:     </loader>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:   </os>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:   <cpu>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:     <mode name='host-passthrough' supported='no'/>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:     <mode name='maximum' supported='no'/>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:     <mode name='host-model' supported='no'/>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:     <mode name='custom' supported='no'/>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:   <memoryBacking supported='yes'>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:     <enum name='sourceType'>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:       <value>file</value>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:       <value>anonymous</value>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:       <value>memfd</value>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:   </memoryBacking>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:   <devices>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:     <disk supported='yes'>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:       <enum name='diskDevice'>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:         <value>disk</value>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:         <value>cdrom</value>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:         <value>floppy</value>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:         <value>lun</value>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:         <value>fdc</value>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:         <value>sata</value>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:     </disk>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:     <graphics supported='yes'>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:         <value>sdl</value>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:         <value>vnc</value>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:         <value>spice</value>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:         <value>egl-headless</value>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:         <value>dbus</value>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:     </graphics>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:     <video supported='yes'>
May 28 09:54:56.225108 np0000001613 nova-compute[98321]:       <enum name='modelType'>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:         <value>vga</value>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:         <value>cirrus</value>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:         <value>none</value>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:         <value>bochs</value>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:     </video>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:     <hostdev supported='yes'>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:       <enum name='mode'>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:         <value>subsystem</value>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:       <enum name='startupPolicy'>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:         <value>default</value>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:         <value>mandatory</value>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:         <value>requisite</value>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:         <value>optional</value>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:       <enum name='subsysType'>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:         <value>pci</value>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:       <enum name='capsType'/>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:       <enum name='pciBackend'/>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:     </hostdev>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:     <rng supported='yes'>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:         <value>random</value>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:         <value>egd</value>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:     </rng>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:     <filesystem supported='yes'>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:       <enum name='driverType'>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:         <value>path</value>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:         <value>handle</value>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:         <value>virtiofs</value>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:     </filesystem>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:     <tpm supported='no'/>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:     <redirdev supported='yes'>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:     </redirdev>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:     <channel supported='yes'>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:         <value>pty</value>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:         <value>unix</value>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:         <value>spicevmc</value>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:     </channel>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:     <crypto supported='yes'>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:         <value>qemu</value>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:     </crypto>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:   </devices>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:   <features>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:     <gic supported='no'/>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:     <vmcoreinfo supported='no'/>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:     <genid supported='no'/>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:     <backingStoreInput supported='yes'/>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:     <backup supported='yes'/>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:     <async-teardown supported='yes'/>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:     <sev supported='no'/>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:     <sgx supported='no'/>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]:   </features>
May 28 09:54:56.226735 np0000001613 nova-compute[98321]: </domainCapabilities>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 09:54:56.228788 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=98321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 09:54:56.228788 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=None:
May 28 09:54:56.228788 np0000001613 nova-compute[98321]: <domainCapabilities>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:   <path>/usr/bin/qemu-system-arm</path>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:   <domain>qemu</domain>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:   <machine>virt-8.2</machine>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:   <arch>armv6l</arch>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:   <vcpu max='512'/>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:   <iothreads supported='yes'/>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:   <os supported='yes'>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:     <enum name='firmware'/>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:     <loader supported='yes'>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:         <value>rom</value>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:         <value>pflash</value>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:       <enum name='readonly'>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:         <value>yes</value>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:       <enum name='secure'>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:     </loader>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:   </os>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:   <cpu>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:     <mode name='host-passthrough' supported='no'/>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:     <mode name='maximum' supported='yes'>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:       <enum name='maximumMigratable'>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:         <value>on</value>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:         <value>off</value>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:     <mode name='host-model' supported='no'/>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:     <mode name='custom' supported='yes'>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 28 09:54:56.228788 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 28 09:54:56.229605 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 28 09:54:56.229605 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 28 09:54:56.229605 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 28 09:54:56.229605 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 28 09:54:56.229605 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 28 09:54:56.229605 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 28 09:54:56.229605 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 28 09:54:56.229605 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 28 09:54:56.229605 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 28 09:54:56.229605 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 28 09:54:56.229605 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 28 09:54:56.229605 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 28 09:54:56.229605 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 28 09:54:56.229605 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 28 09:54:56.229605 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 28 09:54:56.229605 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 28 09:54:56.229605 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 28 09:54:56.229605 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 28 09:54:56.229605 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>max</model>
May 28 09:54:56.229605 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 28 09:54:56.229605 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 28 09:54:56.229605 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 28 09:54:56.229605 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 28 09:54:56.229605 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 28 09:54:56.229605 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 28 09:54:56.229605 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 28 09:54:56.229605 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 28 09:54:56.229605 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 28 09:54:56.229605 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 28 09:54:56.229605 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.229605 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:54:56.229605 np0000001613 nova-compute[98321]:   <memoryBacking supported='yes'>
May 28 09:54:56.229605 np0000001613 nova-compute[98321]:     <enum name='sourceType'>
May 28 09:54:56.229605 np0000001613 nova-compute[98321]:       <value>file</value>
May 28 09:54:56.229605 np0000001613 nova-compute[98321]:       <value>anonymous</value>
May 28 09:54:56.229605 np0000001613 nova-compute[98321]:       <value>memfd</value>
May 28 09:54:56.229605 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.229605 np0000001613 nova-compute[98321]:   </memoryBacking>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:   <devices>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:     <disk supported='yes'>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:       <enum name='diskDevice'>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:         <value>disk</value>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:         <value>cdrom</value>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:         <value>floppy</value>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:         <value>lun</value>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:         <value>fdc</value>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:         <value>sata</value>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:     </disk>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:     <graphics supported='yes'>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:         <value>sdl</value>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:         <value>vnc</value>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:         <value>spice</value>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:         <value>egl-headless</value>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:         <value>dbus</value>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:     </graphics>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:     <video supported='yes'>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:       <enum name='modelType'>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:         <value>vga</value>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:         <value>cirrus</value>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:         <value>none</value>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:         <value>bochs</value>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:         <value>ramfb</value>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:     </video>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:     <hostdev supported='yes'>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:       <enum name='mode'>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:         <value>subsystem</value>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:       <enum name='startupPolicy'>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:         <value>default</value>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:         <value>mandatory</value>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:         <value>requisite</value>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:         <value>optional</value>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:       <enum name='subsysType'>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:         <value>pci</value>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:       <enum name='capsType'/>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:       <enum name='pciBackend'/>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:     </hostdev>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:     <rng supported='yes'>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:         <value>random</value>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:         <value>egd</value>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:     </rng>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:     <filesystem supported='yes'>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:       <enum name='driverType'>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:         <value>path</value>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:         <value>handle</value>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:         <value>virtiofs</value>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.230495 np0000001613 nova-compute[98321]:     </filesystem>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:     <tpm supported='yes'>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:         <value>tpm-tis</value>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:         <value>passthrough</value>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:         <value>emulator</value>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:         <value>external</value>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:       <enum name='backendVersion'>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:         <value>1.2</value>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:         <value>2.0</value>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:     </tpm>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:     <redirdev supported='yes'>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:     </redirdev>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:     <channel supported='yes'>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:         <value>pty</value>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:         <value>unix</value>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:         <value>spicevmc</value>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:     </channel>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:     <crypto supported='yes'>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:         <value>qemu</value>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:     </crypto>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:   </devices>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:   <features>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:     <gic supported='yes'>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:       <enum name='version'>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:         <value>2</value>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:         <value>3</value>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:     </gic>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:     <vmcoreinfo supported='yes'/>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:     <genid supported='no'/>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:     <backingStoreInput supported='yes'/>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:     <backup supported='yes'/>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:     <async-teardown supported='yes'/>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:     <sev supported='no'/>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:     <sgx supported='no'/>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:   </features>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]: </domainCapabilities>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 09:54:56.231744 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=virt:
May 28 09:54:56.231744 np0000001613 nova-compute[98321]: <domainCapabilities>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:   <path>/usr/bin/qemu-system-arm</path>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:   <domain>qemu</domain>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:   <machine>virt-8.2</machine>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:   <arch>armv6l</arch>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:   <vcpu max='512'/>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:   <iothreads supported='yes'/>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:   <os supported='yes'>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:     <enum name='firmware'/>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:     <loader supported='yes'>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.231744 np0000001613 nova-compute[98321]:         <value>rom</value>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:         <value>pflash</value>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:       <enum name='readonly'>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:         <value>yes</value>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:       <enum name='secure'>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:     </loader>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:   </os>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:   <cpu>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:     <mode name='host-passthrough' supported='no'/>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:     <mode name='maximum' supported='yes'>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:       <enum name='maximumMigratable'>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:         <value>on</value>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:         <value>off</value>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:     <mode name='host-model' supported='no'/>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:     <mode name='custom' supported='yes'>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 28 09:54:56.232957 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>max</model>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:   <memoryBacking supported='yes'>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:     <enum name='sourceType'>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:       <value>file</value>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:       <value>anonymous</value>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:       <value>memfd</value>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:   </memoryBacking>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:   <devices>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:     <disk supported='yes'>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:       <enum name='diskDevice'>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:         <value>disk</value>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:         <value>cdrom</value>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:         <value>floppy</value>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:         <value>lun</value>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:         <value>fdc</value>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:         <value>sata</value>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:     </disk>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:     <graphics supported='yes'>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:         <value>sdl</value>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:         <value>vnc</value>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:         <value>spice</value>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:         <value>egl-headless</value>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:         <value>dbus</value>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:     </graphics>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:     <video supported='yes'>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:       <enum name='modelType'>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:         <value>vga</value>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:         <value>cirrus</value>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:         <value>none</value>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:         <value>bochs</value>
May 28 09:54:56.233722 np0000001613 nova-compute[98321]:         <value>ramfb</value>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:     </video>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:     <hostdev supported='yes'>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:       <enum name='mode'>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:         <value>subsystem</value>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:       <enum name='startupPolicy'>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:         <value>default</value>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:         <value>mandatory</value>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:         <value>requisite</value>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:         <value>optional</value>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:       <enum name='subsysType'>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:         <value>pci</value>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:       <enum name='capsType'/>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:       <enum name='pciBackend'/>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:     </hostdev>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:     <rng supported='yes'>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:         <value>random</value>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:         <value>egd</value>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:     </rng>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:     <filesystem supported='yes'>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:       <enum name='driverType'>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:         <value>path</value>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:         <value>handle</value>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:         <value>virtiofs</value>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:     </filesystem>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:     <tpm supported='yes'>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:         <value>tpm-tis</value>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:         <value>passthrough</value>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:         <value>emulator</value>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:         <value>external</value>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:       <enum name='backendVersion'>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:         <value>1.2</value>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:         <value>2.0</value>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:     </tpm>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:     <redirdev supported='yes'>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:     </redirdev>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:     <channel supported='yes'>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:         <value>pty</value>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:         <value>unix</value>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:         <value>spicevmc</value>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:     </channel>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:     <crypto supported='yes'>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:         <value>qemu</value>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:     </crypto>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:   </devices>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:   <features>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:     <gic supported='yes'>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:       <enum name='version'>
May 28 09:54:56.234725 np0000001613 nova-compute[98321]:         <value>2</value>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:         <value>3</value>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:     </gic>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:     <vmcoreinfo supported='yes'/>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:     <genid supported='no'/>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:     <backingStoreInput supported='yes'/>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:     <backup supported='yes'/>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:     <async-teardown supported='yes'/>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:     <sev supported='no'/>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:     <sgx supported='no'/>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:   </features>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]: </domainCapabilities>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 09:54:56.236092 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=98321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 09:54:56.236092 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Libvirt host hypervisor capabilities for arch=armv7l and machine_type=virt:
May 28 09:54:56.236092 np0000001613 nova-compute[98321]: <domainCapabilities>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:   <path>/usr/bin/qemu-system-arm</path>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:   <domain>qemu</domain>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:   <machine>virt-8.2</machine>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:   <arch>armv7l</arch>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:   <vcpu max='512'/>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:   <iothreads supported='yes'/>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:   <os supported='yes'>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:     <enum name='firmware'>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:       <value>efi</value>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:     <loader supported='yes'>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:         <value>rom</value>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:         <value>pflash</value>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:       <enum name='readonly'>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:         <value>yes</value>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:       <enum name='secure'>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:     </loader>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:   </os>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:   <cpu>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:     <mode name='host-passthrough' supported='no'/>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:     <mode name='maximum' supported='yes'>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:       <enum name='maximumMigratable'>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:         <value>on</value>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:         <value>off</value>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:     <mode name='host-model' supported='no'/>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:     <mode name='custom' supported='yes'>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 28 09:54:56.236092 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 28 09:54:56.236988 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 28 09:54:56.236988 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 28 09:54:56.236988 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 28 09:54:56.236988 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 28 09:54:56.236988 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 28 09:54:56.236988 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 28 09:54:56.236988 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 28 09:54:56.236988 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 28 09:54:56.236988 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 28 09:54:56.236988 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 28 09:54:56.236988 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 28 09:54:56.236988 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 28 09:54:56.236988 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 28 09:54:56.236988 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 28 09:54:56.236988 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 28 09:54:56.236988 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 28 09:54:56.236988 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 28 09:54:56.236988 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 28 09:54:56.236988 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 28 09:54:56.236988 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 28 09:54:56.236988 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 28 09:54:56.236988 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 28 09:54:56.236988 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>max</model>
May 28 09:54:56.236988 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 28 09:54:56.236988 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 28 09:54:56.236988 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 28 09:54:56.236988 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 28 09:54:56.236988 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 28 09:54:56.236988 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 28 09:54:56.236988 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 28 09:54:56.236988 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 28 09:54:56.236988 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:   <memoryBacking supported='yes'>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:     <enum name='sourceType'>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:       <value>file</value>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:       <value>anonymous</value>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:       <value>memfd</value>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:   </memoryBacking>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:   <devices>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:     <disk supported='yes'>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:       <enum name='diskDevice'>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:         <value>disk</value>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:         <value>cdrom</value>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:         <value>floppy</value>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:         <value>lun</value>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:         <value>fdc</value>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:         <value>sata</value>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:     </disk>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:     <graphics supported='yes'>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:         <value>sdl</value>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:         <value>vnc</value>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:         <value>spice</value>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:         <value>egl-headless</value>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:         <value>dbus</value>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:     </graphics>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:     <video supported='yes'>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:       <enum name='modelType'>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:         <value>vga</value>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:         <value>cirrus</value>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:         <value>none</value>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:         <value>bochs</value>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:         <value>ramfb</value>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:     </video>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:     <hostdev supported='yes'>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:       <enum name='mode'>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:         <value>subsystem</value>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:       <enum name='startupPolicy'>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:         <value>default</value>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:         <value>mandatory</value>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:         <value>requisite</value>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:         <value>optional</value>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:       <enum name='subsysType'>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:         <value>pci</value>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:       <enum name='capsType'/>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:       <enum name='pciBackend'/>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:     </hostdev>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:     <rng supported='yes'>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.237473 np0000001613 nova-compute[98321]:         <value>random</value>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:         <value>egd</value>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:     </rng>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:     <filesystem supported='yes'>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:       <enum name='driverType'>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:         <value>path</value>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:         <value>handle</value>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:         <value>virtiofs</value>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:     </filesystem>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:     <tpm supported='yes'>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:         <value>tpm-tis</value>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:         <value>passthrough</value>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:         <value>emulator</value>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:         <value>external</value>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:       <enum name='backendVersion'>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:         <value>1.2</value>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:         <value>2.0</value>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:     </tpm>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:     <redirdev supported='yes'>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:     </redirdev>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:     <channel supported='yes'>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:         <value>pty</value>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:         <value>unix</value>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:         <value>spicevmc</value>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:     </channel>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:     <crypto supported='yes'>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:         <value>qemu</value>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:     </crypto>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:   </devices>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:   <features>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:     <gic supported='yes'>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:       <enum name='version'>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:         <value>2</value>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:         <value>3</value>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:     </gic>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:     <vmcoreinfo supported='yes'/>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:     <genid supported='no'/>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:     <backingStoreInput supported='yes'/>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:     <backup supported='yes'/>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:     <async-teardown supported='yes'/>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:     <sev supported='no'/>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:     <sgx supported='no'/>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:   </features>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]: </domainCapabilities>
May 28 09:54:56.238820 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 09:54:56.238820 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=98321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 09:54:56.239899 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Libvirt host hypervisor capabilities for arch=aarch64 and machine_type=virt:
May 28 09:54:56.239899 np0000001613 nova-compute[98321]: <domainCapabilities>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:   <path>/usr/bin/qemu-system-aarch64</path>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:   <domain>qemu</domain>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:   <machine>virt-8.2</machine>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:   <arch>aarch64</arch>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:   <vcpu max='512'/>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:   <iothreads supported='yes'/>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:   <os supported='yes'>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:     <enum name='firmware'>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:       <value>efi</value>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:     <loader supported='yes'>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF_CODE.ms.fd</value>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF_CODE.secboot.fd</value>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF_CODE.no-secboot.fd</value>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:         <value>rom</value>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:         <value>pflash</value>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:       <enum name='readonly'>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:         <value>yes</value>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:       <enum name='secure'>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:     </loader>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:   </os>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:   <cpu>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:     <mode name='host-passthrough' supported='no'/>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:     <mode name='maximum' supported='yes'>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:       <enum name='maximumMigratable'>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:         <value>on</value>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:         <value>off</value>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:     <mode name='host-model' supported='no'/>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:     <mode name='custom' supported='yes'>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>neoverse-n2</model>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-a57</model>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 28 09:54:56.239899 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-a76</model>
May 28 09:54:56.240710 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>a64fx</model>
May 28 09:54:56.240710 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 28 09:54:56.240710 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>neoverse-v1</model>
May 28 09:54:56.240710 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 28 09:54:56.240710 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 28 09:54:56.240710 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 28 09:54:56.240710 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 28 09:54:56.240710 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 28 09:54:56.240710 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 28 09:54:56.240710 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 28 09:54:56.240710 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 28 09:54:56.240710 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 28 09:54:56.240710 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 28 09:54:56.240710 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 28 09:54:56.240710 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 28 09:54:56.240710 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-a710</model>
May 28 09:54:56.240710 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 28 09:54:56.240710 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 28 09:54:56.240710 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 28 09:54:56.240710 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>max</model>
May 28 09:54:56.240710 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-a53</model>
May 28 09:54:56.240710 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 28 09:54:56.240710 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 28 09:54:56.240710 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-a72</model>
May 28 09:54:56.240710 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 28 09:54:56.240710 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 28 09:54:56.240710 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-a55</model>
May 28 09:54:56.240710 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 28 09:54:56.240710 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 28 09:54:56.240710 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>neoverse-n1</model>
May 28 09:54:56.240710 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 28 09:54:56.240710 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-a35</model>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:   <memoryBacking supported='yes'>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:     <enum name='sourceType'>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:       <value>file</value>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:       <value>anonymous</value>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:       <value>memfd</value>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:   </memoryBacking>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:   <devices>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:     <disk supported='yes'>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:       <enum name='diskDevice'>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:         <value>disk</value>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:         <value>cdrom</value>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:         <value>floppy</value>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:         <value>lun</value>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:         <value>fdc</value>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:         <value>sata</value>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:     </disk>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:     <graphics supported='yes'>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:         <value>sdl</value>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:         <value>vnc</value>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:         <value>spice</value>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:         <value>egl-headless</value>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:         <value>dbus</value>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:     </graphics>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:     <video supported='yes'>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:       <enum name='modelType'>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:         <value>vga</value>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:         <value>cirrus</value>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:         <value>none</value>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:         <value>bochs</value>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:         <value>ramfb</value>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:     </video>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:     <hostdev supported='yes'>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:       <enum name='mode'>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:         <value>subsystem</value>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:       <enum name='startupPolicy'>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:         <value>default</value>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:         <value>mandatory</value>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:         <value>requisite</value>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:         <value>optional</value>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:       <enum name='subsysType'>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:         <value>pci</value>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:       <enum name='capsType'/>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:       <enum name='pciBackend'/>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:     </hostdev>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:     <rng supported='yes'>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.241292 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:         <value>random</value>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:         <value>egd</value>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:     </rng>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:     <filesystem supported='yes'>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:       <enum name='driverType'>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:         <value>path</value>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:         <value>handle</value>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:         <value>virtiofs</value>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:     </filesystem>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:     <tpm supported='yes'>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:         <value>tpm-tis</value>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:         <value>passthrough</value>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:         <value>emulator</value>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:         <value>external</value>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:       <enum name='backendVersion'>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:         <value>1.2</value>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:         <value>2.0</value>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:     </tpm>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:     <redirdev supported='yes'>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:     </redirdev>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:     <channel supported='yes'>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:         <value>pty</value>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:         <value>unix</value>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:         <value>spicevmc</value>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:     </channel>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:     <crypto supported='yes'>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:         <value>qemu</value>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:     </crypto>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:   </devices>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:   <features>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:     <gic supported='yes'>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:       <enum name='version'>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:         <value>2</value>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:         <value>3</value>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:     </gic>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:     <vmcoreinfo supported='yes'/>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:     <genid supported='no'/>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:     <backingStoreInput supported='yes'/>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:     <backup supported='yes'/>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:     <async-teardown supported='yes'/>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:     <sev supported='no'/>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:     <sgx supported='no'/>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:   </features>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]: </domainCapabilities>
May 28 09:54:56.242518 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 09:54:56.243707 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Getting domain capabilities for cris via machine types: {None} {{(pid=98321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 09:54:56.243707 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Libvirt host hypervisor capabilities for arch=cris and machine_type=None:
May 28 09:54:56.243707 np0000001613 nova-compute[98321]: <domainCapabilities>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:   <path>/usr/bin/qemu-system-cris</path>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:   <domain>qemu</domain>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:   <machine>axis-dev88</machine>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:   <arch>cris</arch>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:   <vcpu max='1'/>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:   <iothreads supported='yes'/>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:   <os supported='yes'>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:     <enum name='firmware'/>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:     <loader supported='yes'>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:         <value>rom</value>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:         <value>pflash</value>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:       <enum name='readonly'>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:         <value>yes</value>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:       <enum name='secure'>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:     </loader>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:   </os>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:   <cpu>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:     <mode name='host-passthrough' supported='no'/>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:     <mode name='maximum' supported='no'/>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:     <mode name='host-model' supported='no'/>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:     <mode name='custom' supported='no'/>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:   <memoryBacking supported='yes'>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:     <enum name='sourceType'>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:       <value>file</value>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:       <value>anonymous</value>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:       <value>memfd</value>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:   </memoryBacking>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:   <devices>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:     <disk supported='yes'>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:       <enum name='diskDevice'>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:         <value>disk</value>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:         <value>cdrom</value>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:         <value>floppy</value>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:         <value>lun</value>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:         <value>fdc</value>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:     </disk>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:     <graphics supported='yes'>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:         <value>sdl</value>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:         <value>vnc</value>
May 28 09:54:56.243707 np0000001613 nova-compute[98321]:         <value>spice</value>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:         <value>egl-headless</value>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:         <value>dbus</value>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:     </graphics>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:     <video supported='yes'>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:       <enum name='modelType'>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:         <value>none</value>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:     </video>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:     <hostdev supported='yes'>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:       <enum name='mode'>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:         <value>subsystem</value>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:       <enum name='startupPolicy'>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:         <value>default</value>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:         <value>mandatory</value>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:         <value>requisite</value>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:         <value>optional</value>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:       <enum name='subsysType'>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:         <value>pci</value>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:       <enum name='capsType'/>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:       <enum name='pciBackend'/>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:     </hostdev>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:     <rng supported='yes'>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:       <enum name='model'/>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:         <value>random</value>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:         <value>egd</value>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:     </rng>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:     <filesystem supported='yes'>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:       <enum name='driverType'>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:         <value>path</value>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:         <value>handle</value>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:     </filesystem>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:     <tpm supported='no'/>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:     <redirdev supported='no'/>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:     <channel supported='yes'>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:         <value>pty</value>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:         <value>unix</value>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:         <value>spicevmc</value>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:     </channel>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:     <crypto supported='yes'>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:       <enum name='model'/>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:         <value>qemu</value>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:     </crypto>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:   </devices>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:   <features>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:     <gic supported='no'/>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:     <vmcoreinfo supported='no'/>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:     <genid supported='no'/>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:     <backingStoreInput supported='yes'/>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:     <backup supported='yes'/>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:     <async-teardown supported='yes'/>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:     <sev supported='no'/>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:     <sgx supported='no'/>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:   </features>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]: </domainCapabilities>
May 28 09:54:56.244784 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 09:54:56.246025 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu-q35', 'ubuntu', 'pc'} {{(pid=98321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 09:54:56.246025 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
May 28 09:54:56.246025 np0000001613 nova-compute[98321]: <domainCapabilities>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:   <path>/usr/bin/qemu-system-i386</path>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:   <domain>qemu</domain>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:   <machine>pc-q35-noble</machine>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:   <arch>i686</arch>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:   <vcpu max='1024'/>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:   <iothreads supported='yes'/>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:   <os supported='yes'>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:     <enum name='firmware'/>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:     <loader supported='yes'>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:         <value>rom</value>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:         <value>pflash</value>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:       <enum name='readonly'>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:         <value>yes</value>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:       <enum name='secure'>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:     </loader>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:   </os>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:   <cpu>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:     <mode name='host-passthrough' supported='no'/>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:     <mode name='maximum' supported='yes'>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:       <enum name='maximumMigratable'>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:         <value>on</value>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:         <value>off</value>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:     <mode name='host-model' supported='yes'>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:       <model fallback='forbid'>EPYC</model>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:       <vendor>AMD</vendor>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:       <feature policy='require' name='acpi'/>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:       <feature policy='require' name='ss'/>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:       <feature policy='require' name='monitor'/>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:       <feature policy='require' name='hypervisor'/>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:       <feature policy='require' name='erms'/>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:       <feature policy='require' name='mpx'/>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:       <feature policy='require' name='pcommit'/>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:       <feature policy='require' name='clwb'/>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:       <feature policy='require' name='umip'/>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:       <feature policy='require' name='pku'/>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:       <feature policy='require' name='vaes'/>
May 28 09:54:56.246025 np0000001613 nova-compute[98321]:       <feature policy='require' name='la57'/>
May 28 09:54:56.246974 np0000001613 nova-compute[98321]:       <feature policy='require' name='rdpid'/>
May 28 09:54:56.246974 np0000001613 nova-compute[98321]:       <feature policy='require' name='pks'/>
May 28 09:54:56.246974 np0000001613 nova-compute[98321]:       <feature policy='require' name='fsrm'/>
May 28 09:54:56.246974 np0000001613 nova-compute[98321]:       <feature policy='require' name='fzrm'/>
May 28 09:54:56.246974 np0000001613 nova-compute[98321]:       <feature policy='require' name='fsrs'/>
May 28 09:54:56.246974 np0000001613 nova-compute[98321]:       <feature policy='require' name='fsrc'/>
May 28 09:54:56.246974 np0000001613 nova-compute[98321]:       <feature policy='require' name='3dnowext'/>
May 28 09:54:56.246974 np0000001613 nova-compute[98321]:       <feature policy='require' name='3dnow'/>
May 28 09:54:56.246974 np0000001613 nova-compute[98321]:       <feature policy='require' name='xsaveerptr'/>
May 28 09:54:56.246974 np0000001613 nova-compute[98321]:       <feature policy='require' name='wbnoinvd'/>
May 28 09:54:56.246974 np0000001613 nova-compute[98321]:       <feature policy='require' name='npt'/>
May 28 09:54:56.246974 np0000001613 nova-compute[98321]:       <feature policy='require' name='vgif'/>
May 28 09:54:56.246974 np0000001613 nova-compute[98321]:       <feature policy='require' name='svme-addr-chk'/>
May 28 09:54:56.246974 np0000001613 nova-compute[98321]:       <feature policy='disable' name='vme'/>
May 28 09:54:56.246974 np0000001613 nova-compute[98321]:       <feature policy='disable' name='xsavec'/>
May 28 09:54:56.246974 np0000001613 nova-compute[98321]:       <feature policy='disable' name='fxsr_opt'/>
May 28 09:54:56.246974 np0000001613 nova-compute[98321]:       <feature policy='disable' name='lm'/>
May 28 09:54:56.246974 np0000001613 nova-compute[98321]:       <feature policy='disable' name='misalignsse'/>
May 28 09:54:56.246974 np0000001613 nova-compute[98321]:       <feature policy='disable' name='osvw'/>
May 28 09:54:56.246974 np0000001613 nova-compute[98321]:       <feature policy='disable' name='topoext'/>
May 28 09:54:56.246974 np0000001613 nova-compute[98321]:       <feature policy='disable' name='nrip-save'/>
May 28 09:54:56.246974 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.246974 np0000001613 nova-compute[98321]:     <mode name='custom' supported='yes'>
May 28 09:54:56.246974 np0000001613 nova-compute[98321]:       <model usable='no' vendor='unknown'>qemu64</model>
May 28 09:54:56.246974 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 28 09:54:56.246974 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>phenom</model>
May 28 09:54:56.246974 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 28 09:54:56.246974 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 28 09:54:56.246974 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>pentium</model>
May 28 09:54:56.246974 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='Intel'>n270</model>
May 28 09:54:56.246974 np0000001613 nova-compute[98321]:       <model usable='no' vendor='unknown'>kvm64</model>
May 28 09:54:56.246974 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 28 09:54:56.246974 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 28 09:54:56.246974 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>core2duo</model>
May 28 09:54:56.246974 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='AMD'>athlon</model>
May 28 09:54:56.246974 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 28 09:54:56.246974 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Westmere</model>
May 28 09:54:56.246974 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 28 09:54:56.246974 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 28 09:54:56.247757 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 28 09:54:56.247757 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 28 09:54:56.247757 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 28 09:54:56.247757 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 28 09:54:56.247757 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 28 09:54:56.247757 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 28 09:54:56.247757 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 28 09:54:56.247757 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 28 09:54:56.247757 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Penryn</model>
May 28 09:54:56.247757 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 28 09:54:56.247757 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 28 09:54:56.247757 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 28 09:54:56.247757 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 28 09:54:56.247757 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 28 09:54:56.247757 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 28 09:54:56.247757 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 28 09:54:56.247757 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 28 09:54:56.247757 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 28 09:54:56.247757 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 28 09:54:56.247757 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 28 09:54:56.247757 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 28 09:54:56.247757 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 28 09:54:56.247757 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 28 09:54:56.247757 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Haswell</model>
May 28 09:54:56.247757 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 28 09:54:56.247757 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 28 09:54:56.247757 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 28 09:54:56.247757 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 28 09:54:56.247757 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>EPYC</model>
May 28 09:54:56.247757 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 28 09:54:56.247757 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 28 09:54:56.247757 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Conroe</model>
May 28 09:54:56.247757 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>486</model>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:   <memoryBacking supported='yes'>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:     <enum name='sourceType'>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:       <value>file</value>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:       <value>anonymous</value>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:       <value>memfd</value>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:   </memoryBacking>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:   <devices>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:     <disk supported='yes'>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:       <enum name='diskDevice'>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:         <value>disk</value>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:         <value>cdrom</value>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:         <value>floppy</value>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:         <value>lun</value>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:         <value>fdc</value>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:         <value>sata</value>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:     </disk>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:     <graphics supported='yes'>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:         <value>sdl</value>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:         <value>vnc</value>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:         <value>spice</value>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:         <value>egl-headless</value>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:         <value>dbus</value>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:     </graphics>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:     <video supported='yes'>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:       <enum name='modelType'>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:         <value>vga</value>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:         <value>cirrus</value>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:         <value>vmvga</value>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:         <value>qxl</value>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:         <value>none</value>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:         <value>bochs</value>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:         <value>ramfb</value>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:     </video>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:     <hostdev supported='yes'>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:       <enum name='mode'>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:         <value>subsystem</value>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:       <enum name='startupPolicy'>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:         <value>default</value>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:         <value>mandatory</value>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:         <value>requisite</value>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:         <value>optional</value>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:       <enum name='subsysType'>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.248554 np0000001613 nova-compute[98321]:         <value>pci</value>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:       <enum name='capsType'/>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:       <enum name='pciBackend'/>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:     </hostdev>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:     <rng supported='yes'>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:         <value>random</value>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:         <value>egd</value>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:     </rng>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:     <filesystem supported='yes'>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:       <enum name='driverType'>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:         <value>path</value>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:         <value>handle</value>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:         <value>virtiofs</value>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:     </filesystem>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:     <tpm supported='yes'>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:         <value>tpm-tis</value>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:         <value>tpm-crb</value>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:         <value>passthrough</value>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:         <value>emulator</value>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:         <value>external</value>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:       <enum name='backendVersion'>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:         <value>1.2</value>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:         <value>2.0</value>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:     </tpm>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:     <redirdev supported='yes'>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:     </redirdev>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:     <channel supported='yes'>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:         <value>pty</value>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:         <value>unix</value>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:         <value>spicevmc</value>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:     </channel>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:     <crypto supported='yes'>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:         <value>qemu</value>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:     </crypto>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:   </devices>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:   <features>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:     <gic supported='no'/>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:     <vmcoreinfo supported='yes'/>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:     <genid supported='yes'/>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:     <backingStoreInput supported='yes'/>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:     <backup supported='yes'/>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:     <async-teardown supported='yes'/>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:     <sev supported='no'/>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:     <sgx supported='no'/>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:     <hyperv supported='yes'>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:       <enum name='features'>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:         <value>relaxed</value>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:         <value>vapic</value>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:         <value>spinlocks</value>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:         <value>vpindex</value>
May 28 09:54:56.249704 np0000001613 nova-compute[98321]:         <value>runtime</value>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:         <value>synic</value>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:         <value>stimer</value>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:         <value>reset</value>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:         <value>vendor_id</value>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:         <value>frequencies</value>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:         <value>reenlightenment</value>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:         <value>tlbflush</value>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:         <value>ipi</value>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:         <value>avic</value>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:     </hyperv>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:   </features>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]: </domainCapabilities>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 09:54:56.251023 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
May 28 09:54:56.251023 np0000001613 nova-compute[98321]: <domainCapabilities>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:   <path>/usr/bin/qemu-system-i386</path>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:   <domain>qemu</domain>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:   <machine>pc-q35-noble-v2</machine>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:   <arch>i686</arch>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:   <vcpu max='1024'/>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:   <iothreads supported='yes'/>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:   <os supported='yes'>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:     <enum name='firmware'/>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:     <loader supported='yes'>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:         <value>rom</value>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:         <value>pflash</value>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:       <enum name='readonly'>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:         <value>yes</value>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:       <enum name='secure'>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:     </loader>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:   </os>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:   <cpu>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:     <mode name='host-passthrough' supported='no'/>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:     <mode name='maximum' supported='yes'>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:       <enum name='maximumMigratable'>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:         <value>on</value>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:         <value>off</value>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:     <mode name='host-model' supported='yes'>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:       <model fallback='forbid'>EPYC</model>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:       <vendor>AMD</vendor>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:       <feature policy='require' name='acpi'/>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:       <feature policy='require' name='ss'/>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:       <feature policy='require' name='monitor'/>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:       <feature policy='require' name='hypervisor'/>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:       <feature policy='require' name='erms'/>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:       <feature policy='require' name='mpx'/>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:       <feature policy='require' name='pcommit'/>
May 28 09:54:56.251023 np0000001613 nova-compute[98321]:       <feature policy='require' name='clwb'/>
May 28 09:54:56.252124 np0000001613 nova-compute[98321]:       <feature policy='require' name='umip'/>
May 28 09:54:56.252124 np0000001613 nova-compute[98321]:       <feature policy='require' name='pku'/>
May 28 09:54:56.252124 np0000001613 nova-compute[98321]:       <feature policy='require' name='vaes'/>
May 28 09:54:56.252124 np0000001613 nova-compute[98321]:       <feature policy='require' name='la57'/>
May 28 09:54:56.252124 np0000001613 nova-compute[98321]:       <feature policy='require' name='rdpid'/>
May 28 09:54:56.252124 np0000001613 nova-compute[98321]:       <feature policy='require' name='pks'/>
May 28 09:54:56.252124 np0000001613 nova-compute[98321]:       <feature policy='require' name='fsrm'/>
May 28 09:54:56.252124 np0000001613 nova-compute[98321]:       <feature policy='require' name='fzrm'/>
May 28 09:54:56.252124 np0000001613 nova-compute[98321]:       <feature policy='require' name='fsrs'/>
May 28 09:54:56.252124 np0000001613 nova-compute[98321]:       <feature policy='require' name='fsrc'/>
May 28 09:54:56.252124 np0000001613 nova-compute[98321]:       <feature policy='require' name='3dnowext'/>
May 28 09:54:56.252124 np0000001613 nova-compute[98321]:       <feature policy='require' name='3dnow'/>
May 28 09:54:56.252124 np0000001613 nova-compute[98321]:       <feature policy='require' name='xsaveerptr'/>
May 28 09:54:56.252124 np0000001613 nova-compute[98321]:       <feature policy='require' name='wbnoinvd'/>
May 28 09:54:56.252124 np0000001613 nova-compute[98321]:       <feature policy='require' name='npt'/>
May 28 09:54:56.252124 np0000001613 nova-compute[98321]:       <feature policy='require' name='vgif'/>
May 28 09:54:56.252124 np0000001613 nova-compute[98321]:       <feature policy='require' name='svme-addr-chk'/>
May 28 09:54:56.252124 np0000001613 nova-compute[98321]:       <feature policy='disable' name='vme'/>
May 28 09:54:56.252124 np0000001613 nova-compute[98321]:       <feature policy='disable' name='xsavec'/>
May 28 09:54:56.252124 np0000001613 nova-compute[98321]:       <feature policy='disable' name='fxsr_opt'/>
May 28 09:54:56.252124 np0000001613 nova-compute[98321]:       <feature policy='disable' name='lm'/>
May 28 09:54:56.252124 np0000001613 nova-compute[98321]:       <feature policy='disable' name='misalignsse'/>
May 28 09:54:56.252124 np0000001613 nova-compute[98321]:       <feature policy='disable' name='osvw'/>
May 28 09:54:56.252124 np0000001613 nova-compute[98321]:       <feature policy='disable' name='topoext'/>
May 28 09:54:56.252124 np0000001613 nova-compute[98321]:       <feature policy='disable' name='nrip-save'/>
May 28 09:54:56.252124 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.252124 np0000001613 nova-compute[98321]:     <mode name='custom' supported='yes'>
May 28 09:54:56.252124 np0000001613 nova-compute[98321]:       <model usable='no' vendor='unknown'>qemu64</model>
May 28 09:54:56.252124 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 28 09:54:56.252124 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>phenom</model>
May 28 09:54:56.252124 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 28 09:54:56.252124 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 28 09:54:56.252124 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>pentium</model>
May 28 09:54:56.252124 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='Intel'>n270</model>
May 28 09:54:56.252124 np0000001613 nova-compute[98321]:       <model usable='no' vendor='unknown'>kvm64</model>
May 28 09:54:56.252124 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 28 09:54:56.252124 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 28 09:54:56.252124 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>core2duo</model>
May 28 09:54:56.252124 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='AMD'>athlon</model>
May 28 09:54:56.252124 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 28 09:54:56.252124 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Westmere</model>
May 28 09:54:56.252974 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 28 09:54:56.252974 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 28 09:54:56.252974 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 28 09:54:56.252974 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 28 09:54:56.252974 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 28 09:54:56.252974 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 28 09:54:56.252974 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 28 09:54:56.252974 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 28 09:54:56.252974 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 28 09:54:56.252974 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 28 09:54:56.252974 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Penryn</model>
May 28 09:54:56.252974 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 28 09:54:56.252974 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 28 09:54:56.252974 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 28 09:54:56.252974 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 28 09:54:56.252974 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 28 09:54:56.252974 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 28 09:54:56.252974 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 28 09:54:56.252974 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 28 09:54:56.252974 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 28 09:54:56.252974 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 28 09:54:56.252974 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 28 09:54:56.252974 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 28 09:54:56.252974 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 28 09:54:56.252974 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 28 09:54:56.252974 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Haswell</model>
May 28 09:54:56.252974 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 28 09:54:56.252974 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 28 09:54:56.252974 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 28 09:54:56.252974 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 28 09:54:56.252974 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>EPYC</model>
May 28 09:54:56.252974 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 28 09:54:56.252974 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Conroe</model>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>486</model>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:   <memoryBacking supported='yes'>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:     <enum name='sourceType'>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:       <value>file</value>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:       <value>anonymous</value>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:       <value>memfd</value>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:   </memoryBacking>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:   <devices>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:     <disk supported='yes'>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:       <enum name='diskDevice'>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:         <value>disk</value>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:         <value>cdrom</value>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:         <value>floppy</value>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:         <value>lun</value>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:         <value>fdc</value>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:         <value>sata</value>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:     </disk>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:     <graphics supported='yes'>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:         <value>sdl</value>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:         <value>vnc</value>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:         <value>spice</value>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:         <value>egl-headless</value>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:         <value>dbus</value>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:     </graphics>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:     <video supported='yes'>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:       <enum name='modelType'>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:         <value>vga</value>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:         <value>cirrus</value>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:         <value>vmvga</value>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:         <value>qxl</value>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:         <value>none</value>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:         <value>bochs</value>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:         <value>ramfb</value>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:     </video>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:     <hostdev supported='yes'>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:       <enum name='mode'>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:         <value>subsystem</value>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:       <enum name='startupPolicy'>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:         <value>default</value>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:         <value>mandatory</value>
May 28 09:54:56.253528 np0000001613 nova-compute[98321]:         <value>requisite</value>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:         <value>optional</value>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:       <enum name='subsysType'>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:         <value>pci</value>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:       <enum name='capsType'/>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:       <enum name='pciBackend'/>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:     </hostdev>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:     <rng supported='yes'>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:         <value>random</value>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:         <value>egd</value>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:     </rng>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:     <filesystem supported='yes'>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:       <enum name='driverType'>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:         <value>path</value>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:         <value>handle</value>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:         <value>virtiofs</value>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:     </filesystem>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:     <tpm supported='yes'>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:         <value>tpm-tis</value>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:         <value>tpm-crb</value>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:         <value>passthrough</value>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:         <value>emulator</value>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:         <value>external</value>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:       <enum name='backendVersion'>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:         <value>1.2</value>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:         <value>2.0</value>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:     </tpm>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:     <redirdev supported='yes'>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:     </redirdev>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:     <channel supported='yes'>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:         <value>pty</value>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:         <value>unix</value>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:         <value>spicevmc</value>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:     </channel>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:     <crypto supported='yes'>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:         <value>qemu</value>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:     </crypto>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:   </devices>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:   <features>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:     <gic supported='no'/>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:     <vmcoreinfo supported='yes'/>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:     <genid supported='yes'/>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:     <backingStoreInput supported='yes'/>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:     <backup supported='yes'/>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:     <async-teardown supported='yes'/>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:     <sev supported='no'/>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:     <sgx supported='no'/>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:     <hyperv supported='yes'>
May 28 09:54:56.254831 np0000001613 nova-compute[98321]:       <enum name='features'>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:         <value>relaxed</value>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:         <value>vapic</value>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:         <value>spinlocks</value>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:         <value>vpindex</value>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:         <value>runtime</value>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:         <value>synic</value>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:         <value>stimer</value>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:         <value>reset</value>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:         <value>vendor_id</value>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:         <value>frequencies</value>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:         <value>reenlightenment</value>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:         <value>tlbflush</value>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:         <value>ipi</value>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:         <value>avic</value>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:     </hyperv>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:   </features>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]: </domainCapabilities>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 09:54:56.256291 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
May 28 09:54:56.256291 np0000001613 nova-compute[98321]: <domainCapabilities>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:   <path>/usr/bin/qemu-system-i386</path>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:   <domain>qemu</domain>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:   <machine>pc-i440fx-noble-v2</machine>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:   <arch>i686</arch>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:   <vcpu max='255'/>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:   <iothreads supported='yes'/>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:   <os supported='yes'>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:     <enum name='firmware'/>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:     <loader supported='yes'>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:         <value>rom</value>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:         <value>pflash</value>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:       <enum name='readonly'>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:         <value>yes</value>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:       <enum name='secure'>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:     </loader>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:   </os>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:   <cpu>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:     <mode name='host-passthrough' supported='no'/>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:     <mode name='maximum' supported='yes'>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:       <enum name='maximumMigratable'>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:         <value>on</value>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:         <value>off</value>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:     <mode name='host-model' supported='yes'>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:       <model fallback='forbid'>EPYC</model>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:       <vendor>AMD</vendor>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:       <feature policy='require' name='acpi'/>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:       <feature policy='require' name='ss'/>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:       <feature policy='require' name='monitor'/>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:       <feature policy='require' name='hypervisor'/>
May 28 09:54:56.256291 np0000001613 nova-compute[98321]:       <feature policy='require' name='erms'/>
May 28 09:54:56.257507 np0000001613 nova-compute[98321]:       <feature policy='require' name='mpx'/>
May 28 09:54:56.257507 np0000001613 nova-compute[98321]:       <feature policy='require' name='pcommit'/>
May 28 09:54:56.257507 np0000001613 nova-compute[98321]:       <feature policy='require' name='clwb'/>
May 28 09:54:56.257507 np0000001613 nova-compute[98321]:       <feature policy='require' name='umip'/>
May 28 09:54:56.257507 np0000001613 nova-compute[98321]:       <feature policy='require' name='pku'/>
May 28 09:54:56.257507 np0000001613 nova-compute[98321]:       <feature policy='require' name='vaes'/>
May 28 09:54:56.257507 np0000001613 nova-compute[98321]:       <feature policy='require' name='la57'/>
May 28 09:54:56.257507 np0000001613 nova-compute[98321]:       <feature policy='require' name='rdpid'/>
May 28 09:54:56.257507 np0000001613 nova-compute[98321]:       <feature policy='require' name='pks'/>
May 28 09:54:56.257507 np0000001613 nova-compute[98321]:       <feature policy='require' name='fsrm'/>
May 28 09:54:56.257507 np0000001613 nova-compute[98321]:       <feature policy='require' name='fzrm'/>
May 28 09:54:56.257507 np0000001613 nova-compute[98321]:       <feature policy='require' name='fsrs'/>
May 28 09:54:56.257507 np0000001613 nova-compute[98321]:       <feature policy='require' name='fsrc'/>
May 28 09:54:56.257507 np0000001613 nova-compute[98321]:       <feature policy='require' name='3dnowext'/>
May 28 09:54:56.257507 np0000001613 nova-compute[98321]:       <feature policy='require' name='3dnow'/>
May 28 09:54:56.257507 np0000001613 nova-compute[98321]:       <feature policy='require' name='xsaveerptr'/>
May 28 09:54:56.257507 np0000001613 nova-compute[98321]:       <feature policy='require' name='wbnoinvd'/>
May 28 09:54:56.257507 np0000001613 nova-compute[98321]:       <feature policy='require' name='npt'/>
May 28 09:54:56.257507 np0000001613 nova-compute[98321]:       <feature policy='require' name='vgif'/>
May 28 09:54:56.257507 np0000001613 nova-compute[98321]:       <feature policy='require' name='svme-addr-chk'/>
May 28 09:54:56.257507 np0000001613 nova-compute[98321]:       <feature policy='disable' name='vme'/>
May 28 09:54:56.257507 np0000001613 nova-compute[98321]:       <feature policy='disable' name='xsavec'/>
May 28 09:54:56.257507 np0000001613 nova-compute[98321]:       <feature policy='disable' name='fxsr_opt'/>
May 28 09:54:56.257507 np0000001613 nova-compute[98321]:       <feature policy='disable' name='lm'/>
May 28 09:54:56.257507 np0000001613 nova-compute[98321]:       <feature policy='disable' name='misalignsse'/>
May 28 09:54:56.257507 np0000001613 nova-compute[98321]:       <feature policy='disable' name='osvw'/>
May 28 09:54:56.257507 np0000001613 nova-compute[98321]:       <feature policy='disable' name='topoext'/>
May 28 09:54:56.257507 np0000001613 nova-compute[98321]:       <feature policy='disable' name='nrip-save'/>
May 28 09:54:56.257507 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.257507 np0000001613 nova-compute[98321]:     <mode name='custom' supported='yes'>
May 28 09:54:56.257507 np0000001613 nova-compute[98321]:       <model usable='no' vendor='unknown'>qemu64</model>
May 28 09:54:56.257507 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 28 09:54:56.257507 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>phenom</model>
May 28 09:54:56.257507 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 28 09:54:56.257507 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 28 09:54:56.257507 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>pentium</model>
May 28 09:54:56.257507 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='Intel'>n270</model>
May 28 09:54:56.257507 np0000001613 nova-compute[98321]:       <model usable='no' vendor='unknown'>kvm64</model>
May 28 09:54:56.257507 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 28 09:54:56.257507 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 28 09:54:56.257507 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>core2duo</model>
May 28 09:54:56.258831 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='AMD'>athlon</model>
May 28 09:54:56.258831 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 28 09:54:56.258831 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Westmere</model>
May 28 09:54:56.258831 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 28 09:54:56.258831 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 28 09:54:56.258831 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 28 09:54:56.258831 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 28 09:54:56.258831 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 28 09:54:56.258831 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 28 09:54:56.258831 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 28 09:54:56.258831 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 28 09:54:56.258831 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 28 09:54:56.258831 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 28 09:54:56.258831 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Penryn</model>
May 28 09:54:56.258831 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 28 09:54:56.258831 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 28 09:54:56.258831 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 28 09:54:56.258831 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 28 09:54:56.258831 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 28 09:54:56.258831 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 28 09:54:56.258831 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 28 09:54:56.258831 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 28 09:54:56.258831 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 28 09:54:56.258831 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 28 09:54:56.258831 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 28 09:54:56.258831 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 28 09:54:56.258831 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 28 09:54:56.258831 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 28 09:54:56.258831 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Haswell</model>
May 28 09:54:56.258831 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 28 09:54:56.258831 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 28 09:54:56.258831 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 28 09:54:56.258831 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>EPYC</model>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Conroe</model>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>486</model>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:   <memoryBacking supported='yes'>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:     <enum name='sourceType'>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:       <value>file</value>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:       <value>anonymous</value>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:       <value>memfd</value>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:   </memoryBacking>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:   <devices>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:     <disk supported='yes'>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:       <enum name='diskDevice'>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:         <value>disk</value>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:         <value>cdrom</value>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:         <value>floppy</value>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:         <value>lun</value>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:         <value>ide</value>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:         <value>fdc</value>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:         <value>sata</value>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:     </disk>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:     <graphics supported='yes'>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:         <value>sdl</value>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:         <value>vnc</value>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:         <value>spice</value>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:         <value>egl-headless</value>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:         <value>dbus</value>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:     </graphics>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:     <video supported='yes'>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:       <enum name='modelType'>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:         <value>vga</value>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:         <value>cirrus</value>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:         <value>vmvga</value>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:         <value>qxl</value>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:         <value>none</value>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:         <value>bochs</value>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:         <value>ramfb</value>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:     </video>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:     <hostdev supported='yes'>
May 28 09:54:56.259487 np0000001613 nova-compute[98321]:       <enum name='mode'>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:         <value>subsystem</value>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:       <enum name='startupPolicy'>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:         <value>default</value>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:         <value>mandatory</value>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:         <value>requisite</value>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:         <value>optional</value>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:       <enum name='subsysType'>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:         <value>pci</value>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:       <enum name='capsType'/>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:       <enum name='pciBackend'/>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:     </hostdev>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:     <rng supported='yes'>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:         <value>random</value>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:         <value>egd</value>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:     </rng>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:     <filesystem supported='yes'>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:       <enum name='driverType'>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:         <value>path</value>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:         <value>handle</value>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:         <value>virtiofs</value>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:     </filesystem>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:     <tpm supported='yes'>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:         <value>tpm-tis</value>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:         <value>tpm-crb</value>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:         <value>passthrough</value>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:         <value>emulator</value>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:         <value>external</value>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:       <enum name='backendVersion'>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:         <value>1.2</value>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:         <value>2.0</value>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:     </tpm>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:     <redirdev supported='yes'>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:     </redirdev>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:     <channel supported='yes'>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:         <value>pty</value>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:         <value>unix</value>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:         <value>spicevmc</value>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:     </channel>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:     <crypto supported='yes'>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:         <value>qemu</value>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:     </crypto>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:   </devices>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:   <features>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:     <gic supported='no'/>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:     <vmcoreinfo supported='yes'/>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:     <genid supported='yes'/>
May 28 09:54:56.260793 np0000001613 nova-compute[98321]:     <backingStoreInput supported='yes'/>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:     <backup supported='yes'/>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:     <async-teardown supported='yes'/>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:     <sev supported='no'/>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:     <sgx supported='no'/>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:     <hyperv supported='yes'>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:       <enum name='features'>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:         <value>relaxed</value>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:         <value>vapic</value>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:         <value>spinlocks</value>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:         <value>vpindex</value>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:         <value>runtime</value>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:         <value>synic</value>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:         <value>stimer</value>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:         <value>reset</value>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:         <value>vendor_id</value>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:         <value>frequencies</value>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:         <value>reenlightenment</value>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:         <value>tlbflush</value>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:         <value>ipi</value>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:         <value>avic</value>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:     </hyperv>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:   </features>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]: </domainCapabilities>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 09:54:56.262255 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
May 28 09:54:56.262255 np0000001613 nova-compute[98321]: <domainCapabilities>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:   <path>/usr/bin/qemu-system-i386</path>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:   <domain>qemu</domain>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:   <machine>pc-i440fx-noble</machine>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:   <arch>i686</arch>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:   <vcpu max='255'/>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:   <iothreads supported='yes'/>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:   <os supported='yes'>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:     <enum name='firmware'/>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:     <loader supported='yes'>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:         <value>rom</value>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:         <value>pflash</value>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:       <enum name='readonly'>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:         <value>yes</value>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:       <enum name='secure'>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:     </loader>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:   </os>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:   <cpu>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:     <mode name='host-passthrough' supported='no'/>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:     <mode name='maximum' supported='yes'>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:       <enum name='maximumMigratable'>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:         <value>on</value>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:         <value>off</value>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:     <mode name='host-model' supported='yes'>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:       <model fallback='forbid'>EPYC</model>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:       <vendor>AMD</vendor>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:       <feature policy='require' name='acpi'/>
May 28 09:54:56.262255 np0000001613 nova-compute[98321]:       <feature policy='require' name='ss'/>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:       <feature policy='require' name='monitor'/>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:       <feature policy='require' name='hypervisor'/>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:       <feature policy='require' name='erms'/>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:       <feature policy='require' name='mpx'/>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:       <feature policy='require' name='pcommit'/>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:       <feature policy='require' name='clwb'/>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:       <feature policy='require' name='umip'/>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:       <feature policy='require' name='pku'/>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:       <feature policy='require' name='vaes'/>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:       <feature policy='require' name='la57'/>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:       <feature policy='require' name='rdpid'/>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:       <feature policy='require' name='pks'/>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:       <feature policy='require' name='fsrm'/>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:       <feature policy='require' name='fzrm'/>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:       <feature policy='require' name='fsrs'/>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:       <feature policy='require' name='fsrc'/>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:       <feature policy='require' name='3dnowext'/>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:       <feature policy='require' name='3dnow'/>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:       <feature policy='require' name='xsaveerptr'/>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:       <feature policy='require' name='wbnoinvd'/>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:       <feature policy='require' name='npt'/>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:       <feature policy='require' name='vgif'/>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:       <feature policy='require' name='svme-addr-chk'/>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:       <feature policy='disable' name='vme'/>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:       <feature policy='disable' name='xsavec'/>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:       <feature policy='disable' name='fxsr_opt'/>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:       <feature policy='disable' name='lm'/>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:       <feature policy='disable' name='misalignsse'/>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:       <feature policy='disable' name='osvw'/>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:       <feature policy='disable' name='topoext'/>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:       <feature policy='disable' name='nrip-save'/>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:     <mode name='custom' supported='yes'>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:       <model usable='no' vendor='unknown'>qemu64</model>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>phenom</model>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>pentium</model>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='Intel'>n270</model>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:       <model usable='no' vendor='unknown'>kvm64</model>
May 28 09:54:56.263359 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 28 09:54:56.264198 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 28 09:54:56.264198 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>core2duo</model>
May 28 09:54:56.264198 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='AMD'>athlon</model>
May 28 09:54:56.264198 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 28 09:54:56.264198 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Westmere</model>
May 28 09:54:56.264198 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 28 09:54:56.264198 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 28 09:54:56.264198 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 28 09:54:56.264198 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 28 09:54:56.264198 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 28 09:54:56.264198 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 28 09:54:56.264198 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 28 09:54:56.264198 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 28 09:54:56.264198 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 28 09:54:56.264198 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 28 09:54:56.264198 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Penryn</model>
May 28 09:54:56.264198 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 28 09:54:56.264198 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 28 09:54:56.264198 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 28 09:54:56.264198 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 28 09:54:56.264198 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 28 09:54:56.264198 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 28 09:54:56.264198 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 28 09:54:56.264198 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 28 09:54:56.264198 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 28 09:54:56.264198 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 28 09:54:56.264198 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 28 09:54:56.264198 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 28 09:54:56.264198 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 28 09:54:56.264198 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 28 09:54:56.264198 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Haswell</model>
May 28 09:54:56.264198 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 28 09:54:56.264198 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>EPYC</model>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Conroe</model>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>486</model>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:   <memoryBacking supported='yes'>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:     <enum name='sourceType'>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:       <value>file</value>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:       <value>anonymous</value>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:       <value>memfd</value>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:   </memoryBacking>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:   <devices>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:     <disk supported='yes'>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:       <enum name='diskDevice'>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:         <value>disk</value>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:         <value>cdrom</value>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:         <value>floppy</value>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:         <value>lun</value>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:         <value>ide</value>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:         <value>fdc</value>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:         <value>sata</value>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:     </disk>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:     <graphics supported='yes'>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:         <value>sdl</value>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:         <value>vnc</value>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:         <value>spice</value>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:         <value>egl-headless</value>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:         <value>dbus</value>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:     </graphics>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:     <video supported='yes'>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:       <enum name='modelType'>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:         <value>vga</value>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:         <value>cirrus</value>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:         <value>vmvga</value>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:         <value>qxl</value>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:         <value>none</value>
May 28 09:54:56.264730 np0000001613 nova-compute[98321]:         <value>bochs</value>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:         <value>ramfb</value>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:     </video>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:     <hostdev supported='yes'>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:       <enum name='mode'>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:         <value>subsystem</value>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:       <enum name='startupPolicy'>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:         <value>default</value>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:         <value>mandatory</value>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:         <value>requisite</value>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:         <value>optional</value>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:       <enum name='subsysType'>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:         <value>pci</value>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:       <enum name='capsType'/>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:       <enum name='pciBackend'/>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:     </hostdev>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:     <rng supported='yes'>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:         <value>random</value>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:         <value>egd</value>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:     </rng>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:     <filesystem supported='yes'>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:       <enum name='driverType'>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:         <value>path</value>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:         <value>handle</value>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:         <value>virtiofs</value>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:     </filesystem>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:     <tpm supported='yes'>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:         <value>tpm-tis</value>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:         <value>tpm-crb</value>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:         <value>passthrough</value>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:         <value>emulator</value>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:         <value>external</value>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:       <enum name='backendVersion'>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:         <value>1.2</value>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:         <value>2.0</value>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:     </tpm>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:     <redirdev supported='yes'>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:     </redirdev>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:     <channel supported='yes'>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:         <value>pty</value>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:         <value>unix</value>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:         <value>spicevmc</value>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:     </channel>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:     <crypto supported='yes'>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:         <value>qemu</value>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:     </crypto>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:   </devices>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:   <features>
May 28 09:54:56.265719 np0000001613 nova-compute[98321]:     <gic supported='no'/>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:     <vmcoreinfo supported='yes'/>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:     <genid supported='yes'/>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:     <backingStoreInput supported='yes'/>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:     <backup supported='yes'/>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:     <async-teardown supported='yes'/>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:     <sev supported='no'/>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:     <sgx supported='no'/>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:     <hyperv supported='yes'>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:       <enum name='features'>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:         <value>relaxed</value>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:         <value>vapic</value>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:         <value>spinlocks</value>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:         <value>vpindex</value>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:         <value>runtime</value>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:         <value>synic</value>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:         <value>stimer</value>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:         <value>reset</value>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:         <value>vendor_id</value>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:         <value>frequencies</value>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:         <value>reenlightenment</value>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:         <value>tlbflush</value>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:         <value>ipi</value>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:         <value>avic</value>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:     </hyperv>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:   </features>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]: </domainCapabilities>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 09:54:56.267290 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=98321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 09:54:56.267290 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=None:
May 28 09:54:56.267290 np0000001613 nova-compute[98321]: <domainCapabilities>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:   <path>/usr/bin/qemu-system-m68k</path>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:   <domain>qemu</domain>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:   <machine>mcf5208evb</machine>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:   <arch>m68k</arch>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:   <vcpu max='1'/>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:   <iothreads supported='yes'/>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:   <os supported='yes'>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:     <enum name='firmware'/>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:     <loader supported='yes'>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:         <value>rom</value>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:         <value>pflash</value>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:       <enum name='readonly'>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:         <value>yes</value>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:       <enum name='secure'>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:     </loader>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:   </os>
May 28 09:54:56.267290 np0000001613 nova-compute[98321]:   <cpu>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:     <mode name='host-passthrough' supported='no'/>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:     <mode name='maximum' supported='no'/>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:     <mode name='host-model' supported='no'/>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:     <mode name='custom' supported='no'/>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:   <memoryBacking supported='yes'>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:     <enum name='sourceType'>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:       <value>file</value>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:       <value>anonymous</value>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:       <value>memfd</value>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:   </memoryBacking>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:   <devices>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:     <disk supported='yes'>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:       <enum name='diskDevice'>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:         <value>disk</value>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:         <value>cdrom</value>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:         <value>floppy</value>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:         <value>lun</value>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:         <value>fdc</value>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:     </disk>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:     <graphics supported='yes'>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:         <value>sdl</value>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:         <value>vnc</value>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:         <value>spice</value>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:         <value>egl-headless</value>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:         <value>dbus</value>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:     </graphics>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:     <video supported='yes'>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:       <enum name='modelType'>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:         <value>none</value>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:     </video>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:     <hostdev supported='yes'>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:       <enum name='mode'>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:         <value>subsystem</value>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:       <enum name='startupPolicy'>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:         <value>default</value>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:         <value>mandatory</value>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:         <value>requisite</value>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:         <value>optional</value>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:       <enum name='subsysType'>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:         <value>pci</value>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:       <enum name='capsType'/>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:       <enum name='pciBackend'/>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:     </hostdev>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:     <rng supported='yes'>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:         <value>random</value>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:         <value>egd</value>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:     </rng>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:     <filesystem supported='yes'>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:       <enum name='driverType'>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:         <value>path</value>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:         <value>handle</value>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:         <value>virtiofs</value>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:     </filesystem>
May 28 09:54:56.268303 np0000001613 nova-compute[98321]:     <tpm supported='no'/>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:     <redirdev supported='no'/>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:     <channel supported='yes'>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:         <value>pty</value>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:         <value>unix</value>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:         <value>spicevmc</value>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:     </channel>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:     <crypto supported='yes'>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:         <value>qemu</value>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:     </crypto>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:   </devices>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:   <features>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:     <gic supported='no'/>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:     <vmcoreinfo supported='no'/>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:     <genid supported='no'/>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:     <backingStoreInput supported='yes'/>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:     <backup supported='yes'/>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:     <async-teardown supported='yes'/>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:     <sev supported='no'/>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:     <sgx supported='no'/>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:   </features>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]: </domainCapabilities>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 09:54:56.269567 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=virt:
May 28 09:54:56.269567 np0000001613 nova-compute[98321]: <domainCapabilities>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:   <path>/usr/bin/qemu-system-m68k</path>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:   <domain>qemu</domain>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:   <machine>virt-8.2</machine>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:   <arch>m68k</arch>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:   <vcpu max='1'/>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:   <iothreads supported='yes'/>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:   <os supported='yes'>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:     <enum name='firmware'/>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:     <loader supported='yes'>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:         <value>rom</value>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:         <value>pflash</value>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:       <enum name='readonly'>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:         <value>yes</value>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:       <enum name='secure'>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:     </loader>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:   </os>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:   <cpu>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:     <mode name='host-passthrough' supported='no'/>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:     <mode name='maximum' supported='no'/>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:     <mode name='host-model' supported='no'/>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:     <mode name='custom' supported='no'/>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:   <memoryBacking supported='yes'>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:     <enum name='sourceType'>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:       <value>file</value>
May 28 09:54:56.269567 np0000001613 nova-compute[98321]:       <value>anonymous</value>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:       <value>memfd</value>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:   </memoryBacking>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:   <devices>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:     <disk supported='yes'>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:       <enum name='diskDevice'>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:         <value>disk</value>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:         <value>cdrom</value>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:         <value>floppy</value>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:         <value>lun</value>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:         <value>fdc</value>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:     </disk>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:     <graphics supported='yes'>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:         <value>sdl</value>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:         <value>vnc</value>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:         <value>spice</value>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:         <value>egl-headless</value>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:         <value>dbus</value>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:     </graphics>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:     <video supported='yes'>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:       <enum name='modelType'>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:         <value>none</value>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:     </video>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:     <hostdev supported='yes'>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:       <enum name='mode'>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:         <value>subsystem</value>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:       <enum name='startupPolicy'>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:         <value>default</value>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:         <value>mandatory</value>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:         <value>requisite</value>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:         <value>optional</value>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:       <enum name='subsysType'>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:         <value>pci</value>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:       <enum name='capsType'/>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:       <enum name='pciBackend'/>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:     </hostdev>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:     <rng supported='yes'>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:         <value>random</value>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:         <value>egd</value>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:     </rng>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:     <filesystem supported='yes'>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:       <enum name='driverType'>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:         <value>path</value>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:         <value>handle</value>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:         <value>virtiofs</value>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:     </filesystem>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:     <tpm supported='no'/>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:     <redirdev supported='no'/>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:     <channel supported='yes'>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:         <value>pty</value>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:         <value>unix</value>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:         <value>spicevmc</value>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:     </channel>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:     <crypto supported='yes'>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.270627 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:         <value>qemu</value>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:     </crypto>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:   </devices>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:   <features>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:     <gic supported='no'/>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:     <vmcoreinfo supported='no'/>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:     <genid supported='no'/>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:     <backingStoreInput supported='yes'/>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:     <backup supported='yes'/>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:     <async-teardown supported='yes'/>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:     <sev supported='no'/>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:     <sgx supported='no'/>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:   </features>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]: </domainCapabilities>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 09:54:56.272071 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=98321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 09:54:56.272071 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Libvirt host hypervisor capabilities for arch=microblaze and machine_type=None:
May 28 09:54:56.272071 np0000001613 nova-compute[98321]: <domainCapabilities>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:   <path>/usr/bin/qemu-system-microblaze</path>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:   <domain>qemu</domain>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:   <machine>petalogix-s3adsp1800</machine>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:   <arch>microblaze</arch>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:   <vcpu max='1'/>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:   <iothreads supported='yes'/>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:   <os supported='yes'>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:     <enum name='firmware'/>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:     <loader supported='yes'>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:         <value>rom</value>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:         <value>pflash</value>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:       <enum name='readonly'>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:         <value>yes</value>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:       <enum name='secure'>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:     </loader>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:   </os>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:   <cpu>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:     <mode name='host-passthrough' supported='no'/>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:     <mode name='maximum' supported='no'/>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:     <mode name='host-model' supported='no'/>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:     <mode name='custom' supported='no'/>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:   <memoryBacking supported='yes'>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:     <enum name='sourceType'>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:       <value>file</value>
May 28 09:54:56.272071 np0000001613 nova-compute[98321]:       <value>anonymous</value>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:       <value>memfd</value>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:   </memoryBacking>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:   <devices>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:     <disk supported='yes'>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:       <enum name='diskDevice'>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:         <value>disk</value>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:         <value>cdrom</value>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:         <value>floppy</value>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:         <value>lun</value>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:         <value>fdc</value>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:     </disk>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:     <graphics supported='yes'>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:         <value>sdl</value>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:         <value>vnc</value>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:         <value>spice</value>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:         <value>egl-headless</value>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:         <value>dbus</value>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:     </graphics>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:     <video supported='yes'>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:       <enum name='modelType'>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:         <value>none</value>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:     </video>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:     <hostdev supported='yes'>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:       <enum name='mode'>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:         <value>subsystem</value>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:       <enum name='startupPolicy'>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:         <value>default</value>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:         <value>mandatory</value>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:         <value>requisite</value>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:         <value>optional</value>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:       <enum name='subsysType'>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:         <value>pci</value>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:       <enum name='capsType'/>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:       <enum name='pciBackend'/>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:     </hostdev>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:     <rng supported='yes'>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:       <enum name='model'/>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:         <value>random</value>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:         <value>egd</value>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:     </rng>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:     <filesystem supported='yes'>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:       <enum name='driverType'>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:         <value>path</value>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:         <value>handle</value>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:     </filesystem>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:     <tpm supported='no'/>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:     <redirdev supported='no'/>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:     <channel supported='yes'>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:         <value>pty</value>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:         <value>unix</value>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:         <value>spicevmc</value>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:     </channel>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:     <crypto supported='yes'>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:       <enum name='model'/>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:         <value>qemu</value>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.273001 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:     </crypto>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:   </devices>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:   <features>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:     <gic supported='no'/>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:     <vmcoreinfo supported='no'/>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:     <genid supported='no'/>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:     <backingStoreInput supported='yes'/>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:     <backup supported='yes'/>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:     <async-teardown supported='yes'/>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:     <sev supported='no'/>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:     <sgx supported='no'/>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:   </features>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]: </domainCapabilities>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 09:54:56.274360 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=98321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 09:54:56.274360 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Libvirt host hypervisor capabilities for arch=microblazeel and machine_type=None:
May 28 09:54:56.274360 np0000001613 nova-compute[98321]: <domainCapabilities>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:   <path>/usr/bin/qemu-system-microblazeel</path>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:   <domain>qemu</domain>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:   <machine>petalogix-s3adsp1800</machine>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:   <arch>microblazeel</arch>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:   <vcpu max='1'/>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:   <iothreads supported='yes'/>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:   <os supported='yes'>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:     <enum name='firmware'/>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:     <loader supported='yes'>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:         <value>rom</value>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:         <value>pflash</value>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:       <enum name='readonly'>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:         <value>yes</value>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:       <enum name='secure'>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:     </loader>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:   </os>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:   <cpu>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:     <mode name='host-passthrough' supported='no'/>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:     <mode name='maximum' supported='no'/>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:     <mode name='host-model' supported='no'/>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:     <mode name='custom' supported='no'/>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:   <memoryBacking supported='yes'>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:     <enum name='sourceType'>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:       <value>file</value>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:       <value>anonymous</value>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:       <value>memfd</value>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:   </memoryBacking>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:   <devices>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:     <disk supported='yes'>
May 28 09:54:56.274360 np0000001613 nova-compute[98321]:       <enum name='diskDevice'>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:         <value>disk</value>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:         <value>cdrom</value>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:         <value>floppy</value>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:         <value>lun</value>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:         <value>fdc</value>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:     </disk>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:     <graphics supported='yes'>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:         <value>sdl</value>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:         <value>vnc</value>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:         <value>spice</value>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:         <value>egl-headless</value>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:         <value>dbus</value>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:     </graphics>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:     <video supported='yes'>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:       <enum name='modelType'>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:         <value>none</value>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:     </video>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:     <hostdev supported='yes'>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:       <enum name='mode'>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:         <value>subsystem</value>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:       <enum name='startupPolicy'>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:         <value>default</value>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:         <value>mandatory</value>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:         <value>requisite</value>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:         <value>optional</value>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:       <enum name='subsysType'>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:         <value>pci</value>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:       <enum name='capsType'/>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:       <enum name='pciBackend'/>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:     </hostdev>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:     <rng supported='yes'>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:       <enum name='model'/>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:         <value>random</value>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:         <value>egd</value>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:     </rng>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:     <filesystem supported='yes'>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:       <enum name='driverType'>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:         <value>path</value>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:         <value>handle</value>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:     </filesystem>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:     <tpm supported='no'/>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:     <redirdev supported='no'/>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:     <channel supported='yes'>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:         <value>pty</value>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:         <value>unix</value>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:         <value>spicevmc</value>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:     </channel>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:     <crypto supported='yes'>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:       <enum name='model'/>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:         <value>qemu</value>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:     </crypto>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:   </devices>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:   <features>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:     <gic supported='no'/>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:     <vmcoreinfo supported='no'/>
May 28 09:54:56.275445 np0000001613 nova-compute[98321]:     <genid supported='no'/>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:     <backingStoreInput supported='yes'/>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:     <backup supported='yes'/>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:     <async-teardown supported='yes'/>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:     <sev supported='no'/>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:     <sgx supported='no'/>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:   </features>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]: </domainCapabilities>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 09:54:56.276932 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Getting domain capabilities for mips via machine types: {None} {{(pid=98321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 09:54:56.276932 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Libvirt host hypervisor capabilities for arch=mips and machine_type=None:
May 28 09:54:56.276932 np0000001613 nova-compute[98321]: <domainCapabilities>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:   <path>/usr/bin/qemu-system-mips</path>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:   <domain>qemu</domain>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:   <machine>malta</machine>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:   <arch>mips</arch>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:   <vcpu max='16'/>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:   <iothreads supported='yes'/>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:   <os supported='yes'>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:     <enum name='firmware'/>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:     <loader supported='yes'>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:         <value>rom</value>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:         <value>pflash</value>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:       <enum name='readonly'>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:         <value>yes</value>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:       <enum name='secure'>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:     </loader>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:   </os>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:   <cpu>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:     <mode name='host-passthrough' supported='no'/>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:     <mode name='maximum' supported='no'/>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:     <mode name='host-model' supported='no'/>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:     <mode name='custom' supported='no'/>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:   <memoryBacking supported='yes'>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:     <enum name='sourceType'>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:       <value>file</value>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:       <value>anonymous</value>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:       <value>memfd</value>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:   </memoryBacking>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:   <devices>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:     <disk supported='yes'>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:       <enum name='diskDevice'>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:         <value>disk</value>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:         <value>cdrom</value>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:         <value>floppy</value>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:         <value>lun</value>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.276932 np0000001613 nova-compute[98321]:         <value>ide</value>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:         <value>fdc</value>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:         <value>sata</value>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:     </disk>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:     <graphics supported='yes'>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:         <value>sdl</value>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:         <value>vnc</value>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:         <value>spice</value>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:         <value>egl-headless</value>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:         <value>dbus</value>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:     </graphics>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:     <video supported='yes'>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:       <enum name='modelType'>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:         <value>vga</value>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:         <value>cirrus</value>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:         <value>vmvga</value>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:         <value>none</value>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:         <value>bochs</value>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:     </video>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:     <hostdev supported='yes'>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:       <enum name='mode'>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:         <value>subsystem</value>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:       <enum name='startupPolicy'>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:         <value>default</value>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:         <value>mandatory</value>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:         <value>requisite</value>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:         <value>optional</value>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:       <enum name='subsysType'>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:         <value>pci</value>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:       <enum name='capsType'/>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:       <enum name='pciBackend'/>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:     </hostdev>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:     <rng supported='yes'>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:         <value>random</value>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:         <value>egd</value>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:     </rng>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:     <filesystem supported='yes'>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:       <enum name='driverType'>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:         <value>path</value>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:         <value>handle</value>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:         <value>virtiofs</value>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:     </filesystem>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:     <tpm supported='no'/>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:     <redirdev supported='yes'>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:     </redirdev>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:     <channel supported='yes'>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.277957 np0000001613 nova-compute[98321]:         <value>pty</value>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:         <value>unix</value>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:         <value>spicevmc</value>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:     </channel>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:     <crypto supported='yes'>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:         <value>qemu</value>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:     </crypto>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:   </devices>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:   <features>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:     <gic supported='no'/>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:     <vmcoreinfo supported='no'/>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:     <genid supported='no'/>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:     <backingStoreInput supported='yes'/>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:     <backup supported='yes'/>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:     <async-teardown supported='yes'/>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:     <sev supported='no'/>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:     <sgx supported='no'/>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:   </features>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]: </domainCapabilities>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 09:54:56.279139 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=98321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 09:54:56.279139 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Libvirt host hypervisor capabilities for arch=mipsel and machine_type=None:
May 28 09:54:56.279139 np0000001613 nova-compute[98321]: <domainCapabilities>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:   <path>/usr/bin/qemu-system-mipsel</path>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:   <domain>qemu</domain>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:   <machine>malta</machine>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:   <arch>mipsel</arch>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:   <vcpu max='16'/>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:   <iothreads supported='yes'/>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:   <os supported='yes'>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:     <enum name='firmware'/>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:     <loader supported='yes'>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:         <value>rom</value>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:         <value>pflash</value>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:       <enum name='readonly'>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:         <value>yes</value>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:       <enum name='secure'>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:     </loader>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:   </os>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:   <cpu>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:     <mode name='host-passthrough' supported='no'/>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:     <mode name='maximum' supported='no'/>
May 28 09:54:56.279139 np0000001613 nova-compute[98321]:     <mode name='host-model' supported='no'/>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:     <mode name='custom' supported='no'/>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:   <memoryBacking supported='yes'>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:     <enum name='sourceType'>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:       <value>file</value>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:       <value>anonymous</value>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:       <value>memfd</value>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:   </memoryBacking>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:   <devices>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:     <disk supported='yes'>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:       <enum name='diskDevice'>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:         <value>disk</value>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:         <value>cdrom</value>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:         <value>floppy</value>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:         <value>lun</value>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:         <value>ide</value>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:         <value>fdc</value>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:         <value>sata</value>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:     </disk>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:     <graphics supported='yes'>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:         <value>sdl</value>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:         <value>vnc</value>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:         <value>spice</value>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:         <value>egl-headless</value>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:         <value>dbus</value>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:     </graphics>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:     <video supported='yes'>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:       <enum name='modelType'>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:         <value>vga</value>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:         <value>cirrus</value>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:         <value>vmvga</value>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:         <value>none</value>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:         <value>bochs</value>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:     </video>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:     <hostdev supported='yes'>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:       <enum name='mode'>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:         <value>subsystem</value>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:       <enum name='startupPolicy'>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:         <value>default</value>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:         <value>mandatory</value>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:         <value>requisite</value>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:         <value>optional</value>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:       <enum name='subsysType'>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:         <value>pci</value>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:       <enum name='capsType'/>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:       <enum name='pciBackend'/>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:     </hostdev>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:     <rng supported='yes'>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:         <value>random</value>
May 28 09:54:56.280088 np0000001613 nova-compute[98321]:         <value>egd</value>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:     </rng>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:     <filesystem supported='yes'>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:       <enum name='driverType'>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:         <value>path</value>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:         <value>handle</value>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:         <value>virtiofs</value>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:     </filesystem>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:     <tpm supported='no'/>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:     <redirdev supported='yes'>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:     </redirdev>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:     <channel supported='yes'>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:         <value>pty</value>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:         <value>unix</value>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:         <value>spicevmc</value>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:     </channel>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:     <crypto supported='yes'>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:         <value>qemu</value>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:     </crypto>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:   </devices>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:   <features>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:     <gic supported='no'/>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:     <vmcoreinfo supported='no'/>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:     <genid supported='no'/>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:     <backingStoreInput supported='yes'/>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:     <backup supported='yes'/>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:     <async-teardown supported='yes'/>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:     <sev supported='no'/>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:     <sgx supported='no'/>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:   </features>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]: </domainCapabilities>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 09:54:56.281392 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=98321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 09:54:56.281392 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Libvirt host hypervisor capabilities for arch=mips64 and machine_type=None:
May 28 09:54:56.281392 np0000001613 nova-compute[98321]: <domainCapabilities>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:   <path>/usr/bin/qemu-system-mips64</path>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:   <domain>qemu</domain>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:   <machine>malta</machine>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:   <arch>mips64</arch>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:   <vcpu max='16'/>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:   <iothreads supported='yes'/>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:   <os supported='yes'>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:     <enum name='firmware'/>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:     <loader supported='yes'>
May 28 09:54:56.281392 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:         <value>rom</value>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:         <value>pflash</value>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:       <enum name='readonly'>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:         <value>yes</value>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:       <enum name='secure'>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:     </loader>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:   </os>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:   <cpu>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:     <mode name='host-passthrough' supported='no'/>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:     <mode name='maximum' supported='no'/>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:     <mode name='host-model' supported='no'/>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:     <mode name='custom' supported='no'/>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:   <memoryBacking supported='yes'>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:     <enum name='sourceType'>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:       <value>file</value>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:       <value>anonymous</value>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:       <value>memfd</value>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:   </memoryBacking>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:   <devices>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:     <disk supported='yes'>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:       <enum name='diskDevice'>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:         <value>disk</value>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:         <value>cdrom</value>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:         <value>floppy</value>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:         <value>lun</value>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:         <value>ide</value>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:         <value>fdc</value>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:         <value>sata</value>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:     </disk>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:     <graphics supported='yes'>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:         <value>sdl</value>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:         <value>vnc</value>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:         <value>spice</value>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:         <value>egl-headless</value>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:         <value>dbus</value>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:     </graphics>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:     <video supported='yes'>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:       <enum name='modelType'>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:         <value>vga</value>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:         <value>cirrus</value>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:         <value>vmvga</value>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:         <value>none</value>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:         <value>bochs</value>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:     </video>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:     <hostdev supported='yes'>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:       <enum name='mode'>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:         <value>subsystem</value>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:       <enum name='startupPolicy'>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:         <value>default</value>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:         <value>mandatory</value>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:         <value>requisite</value>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:         <value>optional</value>
May 28 09:54:56.282582 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:       <enum name='subsysType'>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:         <value>pci</value>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:       <enum name='capsType'/>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:       <enum name='pciBackend'/>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:     </hostdev>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:     <rng supported='yes'>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:         <value>random</value>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:         <value>egd</value>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:     </rng>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:     <filesystem supported='yes'>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:       <enum name='driverType'>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:         <value>path</value>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:         <value>handle</value>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:         <value>virtiofs</value>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:     </filesystem>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:     <tpm supported='no'/>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:     <redirdev supported='yes'>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:     </redirdev>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:     <channel supported='yes'>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:         <value>pty</value>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:         <value>unix</value>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:         <value>spicevmc</value>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:     </channel>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:     <crypto supported='yes'>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:         <value>qemu</value>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:     </crypto>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:   </devices>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:   <features>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:     <gic supported='no'/>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:     <vmcoreinfo supported='no'/>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:     <genid supported='no'/>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:     <backingStoreInput supported='yes'/>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:     <backup supported='yes'/>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:     <async-teardown supported='yes'/>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:     <sev supported='no'/>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:     <sgx supported='no'/>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:   </features>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]: </domainCapabilities>
May 28 09:54:56.284145 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 09:54:56.284145 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=98321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 09:54:56.285548 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Libvirt host hypervisor capabilities for arch=mips64el and machine_type=None:
May 28 09:54:56.285548 np0000001613 nova-compute[98321]: <domainCapabilities>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:   <path>/usr/bin/qemu-system-mips64el</path>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:   <domain>qemu</domain>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:   <machine>malta</machine>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:   <arch>mips64el</arch>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:   <vcpu max='16'/>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:   <iothreads supported='yes'/>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:   <os supported='yes'>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:     <enum name='firmware'/>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:     <loader supported='yes'>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:         <value>rom</value>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:         <value>pflash</value>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:       <enum name='readonly'>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:         <value>yes</value>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:       <enum name='secure'>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:     </loader>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:   </os>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:   <cpu>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:     <mode name='host-passthrough' supported='no'/>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:     <mode name='maximum' supported='no'/>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:     <mode name='host-model' supported='no'/>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:     <mode name='custom' supported='no'/>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:   <memoryBacking supported='yes'>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:     <enum name='sourceType'>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:       <value>file</value>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:       <value>anonymous</value>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:       <value>memfd</value>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:   </memoryBacking>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:   <devices>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:     <disk supported='yes'>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:       <enum name='diskDevice'>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:         <value>disk</value>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:         <value>cdrom</value>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:         <value>floppy</value>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:         <value>lun</value>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:         <value>ide</value>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:         <value>fdc</value>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:         <value>sata</value>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:     </disk>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:     <graphics supported='yes'>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:         <value>sdl</value>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:         <value>vnc</value>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:         <value>spice</value>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:         <value>egl-headless</value>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:         <value>dbus</value>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.285548 np0000001613 nova-compute[98321]:     </graphics>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:     <video supported='yes'>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:       <enum name='modelType'>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:         <value>vga</value>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:         <value>cirrus</value>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:         <value>vmvga</value>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:         <value>none</value>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:         <value>bochs</value>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:     </video>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:     <hostdev supported='yes'>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:       <enum name='mode'>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:         <value>subsystem</value>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:       <enum name='startupPolicy'>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:         <value>default</value>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:         <value>mandatory</value>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:         <value>requisite</value>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:         <value>optional</value>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:       <enum name='subsysType'>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:         <value>pci</value>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:       <enum name='capsType'/>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:       <enum name='pciBackend'/>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:     </hostdev>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:     <rng supported='yes'>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:         <value>random</value>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:         <value>egd</value>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:     </rng>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:     <filesystem supported='yes'>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:       <enum name='driverType'>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:         <value>path</value>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:         <value>handle</value>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:         <value>virtiofs</value>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:     </filesystem>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:     <tpm supported='no'/>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:     <redirdev supported='yes'>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:     </redirdev>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:     <channel supported='yes'>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:         <value>pty</value>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:         <value>unix</value>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:         <value>spicevmc</value>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:     </channel>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:     <crypto supported='yes'>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:         <value>qemu</value>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:     </crypto>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:   </devices>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:   <features>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:     <gic supported='no'/>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:     <vmcoreinfo supported='no'/>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:     <genid supported='no'/>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:     <backingStoreInput supported='yes'/>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:     <backup supported='yes'/>
May 28 09:54:56.286953 np0000001613 nova-compute[98321]:     <async-teardown supported='yes'/>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:     <sev supported='no'/>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:     <sgx supported='no'/>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:   </features>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]: </domainCapabilities>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 09:54:56.288389 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=98321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 09:54:56.288389 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Libvirt host hypervisor capabilities for arch=ppc and machine_type=None:
May 28 09:54:56.288389 np0000001613 nova-compute[98321]: <domainCapabilities>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:   <path>/usr/bin/qemu-system-ppc</path>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:   <domain>qemu</domain>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:   <machine>g3beige</machine>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:   <arch>ppc</arch>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:   <vcpu max='1'/>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:   <iothreads supported='yes'/>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:   <os supported='yes'>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:     <enum name='firmware'/>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:     <loader supported='yes'>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:         <value>rom</value>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:         <value>pflash</value>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:       <enum name='readonly'>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:         <value>yes</value>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:       <enum name='secure'>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:     </loader>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:   </os>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:   <cpu>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:     <mode name='host-passthrough' supported='no'/>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:     <mode name='maximum' supported='no'/>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:     <mode name='host-model' supported='no'/>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:     <mode name='custom' supported='no'/>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:   <memoryBacking supported='yes'>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:     <enum name='sourceType'>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:       <value>file</value>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:       <value>anonymous</value>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:       <value>memfd</value>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:   </memoryBacking>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:   <devices>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:     <disk supported='yes'>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:       <enum name='diskDevice'>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:         <value>disk</value>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:         <value>cdrom</value>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:         <value>floppy</value>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:         <value>lun</value>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:         <value>ide</value>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:         <value>fdc</value>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.288389 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:         <value>sata</value>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:     </disk>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:     <graphics supported='yes'>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:         <value>sdl</value>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:         <value>vnc</value>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:         <value>spice</value>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:         <value>egl-headless</value>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:         <value>dbus</value>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:     </graphics>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:     <video supported='yes'>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:       <enum name='modelType'>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:         <value>vga</value>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:         <value>cirrus</value>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:         <value>none</value>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:         <value>bochs</value>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:     </video>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:     <hostdev supported='yes'>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:       <enum name='mode'>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:         <value>subsystem</value>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:       <enum name='startupPolicy'>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:         <value>default</value>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:         <value>mandatory</value>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:         <value>requisite</value>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:         <value>optional</value>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:       <enum name='subsysType'>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:         <value>pci</value>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:       <enum name='capsType'/>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:       <enum name='pciBackend'/>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:     </hostdev>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:     <rng supported='yes'>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:         <value>random</value>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:         <value>egd</value>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:     </rng>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:     <filesystem supported='yes'>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:       <enum name='driverType'>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:         <value>path</value>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:         <value>handle</value>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:         <value>virtiofs</value>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:     </filesystem>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:     <tpm supported='no'/>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:     <redirdev supported='yes'>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:     </redirdev>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:     <channel supported='yes'>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:         <value>pty</value>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:         <value>unix</value>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:         <value>spicevmc</value>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:     </channel>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:     <crypto supported='yes'>
May 28 09:54:56.289612 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:         <value>qemu</value>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:     </crypto>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:   </devices>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:   <features>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:     <gic supported='no'/>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:     <vmcoreinfo supported='no'/>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:     <genid supported='no'/>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:     <backingStoreInput supported='yes'/>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:     <backup supported='yes'/>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:     <async-teardown supported='yes'/>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:     <sev supported='no'/>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:     <sgx supported='no'/>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:   </features>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]: </domainCapabilities>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 09:54:56.291068 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Getting domain capabilities for ppc64 via machine types: {None, 'powernv', 'pseries'} {{(pid=98321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 09:54:56.291068 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=None:
May 28 09:54:56.291068 np0000001613 nova-compute[98321]: <domainCapabilities>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:   <path>/usr/bin/qemu-system-ppc64</path>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:   <domain>qemu</domain>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:   <machine>pseries-noble</machine>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:   <arch>ppc64</arch>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:   <vcpu max='4096'/>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:   <iothreads supported='yes'/>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:   <os supported='yes'>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:     <enum name='firmware'/>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:     <loader supported='yes'>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:         <value>rom</value>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:         <value>pflash</value>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:       <enum name='readonly'>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:         <value>yes</value>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:       <enum name='secure'>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:     </loader>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:   </os>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:   <cpu>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:     <mode name='host-passthrough' supported='no'/>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:     <mode name='maximum' supported='no'/>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:     <mode name='host-model' supported='no'/>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:     <mode name='custom' supported='yes'>
May 28 09:54:56.291068 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:   <memoryBacking supported='yes'>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:     <enum name='sourceType'>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:       <value>file</value>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:       <value>anonymous</value>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:       <value>memfd</value>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:   </memoryBacking>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:   <devices>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:     <disk supported='yes'>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:       <enum name='diskDevice'>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:         <value>disk</value>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:         <value>cdrom</value>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:         <value>lun</value>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:         <value>sata</value>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:     </disk>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:     <graphics supported='yes'>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:         <value>sdl</value>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:         <value>vnc</value>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:         <value>spice</value>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:         <value>egl-headless</value>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:         <value>dbus</value>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:     </graphics>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:     <video supported='yes'>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:       <enum name='modelType'>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:         <value>vga</value>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:         <value>cirrus</value>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:         <value>none</value>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:         <value>bochs</value>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:     </video>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:     <hostdev supported='yes'>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:       <enum name='mode'>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:         <value>subsystem</value>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:       <enum name='startupPolicy'>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:         <value>default</value>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:         <value>mandatory</value>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:         <value>requisite</value>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:         <value>optional</value>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:       <enum name='subsysType'>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:         <value>pci</value>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:       <enum name='capsType'/>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:       <enum name='pciBackend'/>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:     </hostdev>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:     <rng supported='yes'>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.292205 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:         <value>random</value>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:         <value>egd</value>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:     </rng>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:     <filesystem supported='yes'>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:       <enum name='driverType'>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:         <value>path</value>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:         <value>handle</value>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:         <value>virtiofs</value>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:     </filesystem>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:     <tpm supported='yes'>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:         <value>tpm-spapr</value>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:         <value>spapr-tpm-proxy</value>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:         <value>passthrough</value>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:         <value>emulator</value>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:         <value>external</value>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:       <enum name='backendVersion'>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:         <value>1.2</value>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:         <value>2.0</value>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:     </tpm>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:     <redirdev supported='yes'>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:     </redirdev>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:     <channel supported='yes'>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:         <value>pty</value>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:         <value>unix</value>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:         <value>spicevmc</value>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:     </channel>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:     <crypto supported='yes'>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:         <value>qemu</value>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:     </crypto>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:   </devices>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:   <features>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:     <gic supported='no'/>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:     <vmcoreinfo supported='no'/>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:     <genid supported='no'/>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:     <backingStoreInput supported='yes'/>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:     <backup supported='yes'/>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:     <async-teardown supported='yes'/>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:     <sev supported='no'/>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:     <sgx supported='no'/>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:   </features>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]: </domainCapabilities>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 09:54:56.293451 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=powernv:
May 28 09:54:56.293451 np0000001613 nova-compute[98321]: <domainCapabilities>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:   <path>/usr/bin/qemu-system-ppc64</path>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:   <domain>qemu</domain>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:   <machine>powernv9</machine>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:   <arch>ppc64</arch>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:   <vcpu max='2048'/>
May 28 09:54:56.293451 np0000001613 nova-compute[98321]:   <iothreads supported='yes'/>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:   <os supported='yes'>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:     <enum name='firmware'/>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:     <loader supported='yes'>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:         <value>rom</value>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:         <value>pflash</value>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:       <enum name='readonly'>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:         <value>yes</value>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:       <enum name='secure'>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:     </loader>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:   </os>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:   <cpu>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:     <mode name='host-passthrough' supported='no'/>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:     <mode name='maximum' supported='no'/>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:     <mode name='host-model' supported='no'/>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:     <mode name='custom' supported='yes'>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:   <memoryBacking supported='yes'>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:     <enum name='sourceType'>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:       <value>file</value>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:       <value>anonymous</value>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:       <value>memfd</value>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:   </memoryBacking>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:   <devices>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:     <disk supported='yes'>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:       <enum name='diskDevice'>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:         <value>disk</value>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:         <value>cdrom</value>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:         <value>floppy</value>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:         <value>lun</value>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:         <value>fdc</value>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:         <value>sata</value>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:     </disk>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:     <graphics supported='yes'>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:         <value>sdl</value>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:         <value>vnc</value>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:         <value>spice</value>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:         <value>egl-headless</value>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:         <value>dbus</value>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:     </graphics>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:     <video supported='yes'>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:       <enum name='modelType'>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:         <value>vga</value>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:         <value>cirrus</value>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.294814 np0000001613 nova-compute[98321]:         <value>none</value>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:         <value>bochs</value>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:     </video>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:     <hostdev supported='yes'>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:       <enum name='mode'>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:         <value>subsystem</value>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:       <enum name='startupPolicy'>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:         <value>default</value>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:         <value>mandatory</value>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:         <value>requisite</value>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:         <value>optional</value>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:       <enum name='subsysType'>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:         <value>pci</value>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:       <enum name='capsType'/>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:       <enum name='pciBackend'/>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:     </hostdev>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:     <rng supported='yes'>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:         <value>random</value>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:         <value>egd</value>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:     </rng>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:     <filesystem supported='yes'>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:       <enum name='driverType'>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:         <value>path</value>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:         <value>handle</value>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:         <value>virtiofs</value>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:     </filesystem>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:     <tpm supported='yes'>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:         <value>tpm-spapr</value>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:         <value>spapr-tpm-proxy</value>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:         <value>passthrough</value>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:         <value>emulator</value>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:         <value>external</value>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:       <enum name='backendVersion'>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:         <value>1.2</value>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:         <value>2.0</value>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:     </tpm>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:     <redirdev supported='yes'>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:     </redirdev>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:     <channel supported='yes'>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:         <value>pty</value>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:         <value>unix</value>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:         <value>spicevmc</value>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:     </channel>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:     <crypto supported='yes'>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:         <value>qemu</value>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:     </crypto>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:   </devices>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:   <features>
May 28 09:54:56.296088 np0000001613 nova-compute[98321]:     <gic supported='no'/>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:     <vmcoreinfo supported='no'/>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:     <genid supported='no'/>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:     <backingStoreInput supported='yes'/>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:     <backup supported='yes'/>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:     <async-teardown supported='yes'/>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:     <sev supported='no'/>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:     <sgx supported='no'/>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:   </features>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]: </domainCapabilities>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 09:54:56.297520 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=pseries:
May 28 09:54:56.297520 np0000001613 nova-compute[98321]: <domainCapabilities>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:   <path>/usr/bin/qemu-system-ppc64</path>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:   <domain>qemu</domain>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:   <machine>pseries-noble</machine>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:   <arch>ppc64</arch>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:   <vcpu max='4096'/>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:   <iothreads supported='yes'/>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:   <os supported='yes'>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:     <enum name='firmware'/>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:     <loader supported='yes'>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:         <value>rom</value>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:         <value>pflash</value>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:       <enum name='readonly'>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:         <value>yes</value>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:       <enum name='secure'>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:     </loader>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:   </os>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:   <cpu>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:     <mode name='host-passthrough' supported='no'/>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:     <mode name='maximum' supported='no'/>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:     <mode name='host-model' supported='no'/>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:     <mode name='custom' supported='yes'>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:   <memoryBacking supported='yes'>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:     <enum name='sourceType'>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:       <value>file</value>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:       <value>anonymous</value>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:       <value>memfd</value>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:   </memoryBacking>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:   <devices>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:     <disk supported='yes'>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:       <enum name='diskDevice'>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:         <value>disk</value>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:         <value>cdrom</value>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:         <value>lun</value>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.297520 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:         <value>sata</value>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:     </disk>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:     <graphics supported='yes'>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:         <value>sdl</value>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:         <value>vnc</value>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:         <value>spice</value>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:         <value>egl-headless</value>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:         <value>dbus</value>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:     </graphics>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:     <video supported='yes'>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:       <enum name='modelType'>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:         <value>vga</value>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:         <value>cirrus</value>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:         <value>none</value>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:         <value>bochs</value>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:     </video>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:     <hostdev supported='yes'>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:       <enum name='mode'>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:         <value>subsystem</value>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:       <enum name='startupPolicy'>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:         <value>default</value>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:         <value>mandatory</value>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:         <value>requisite</value>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:         <value>optional</value>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:       <enum name='subsysType'>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:         <value>pci</value>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:       <enum name='capsType'/>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:       <enum name='pciBackend'/>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:     </hostdev>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:     <rng supported='yes'>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:         <value>random</value>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:         <value>egd</value>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:     </rng>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:     <filesystem supported='yes'>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:       <enum name='driverType'>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:         <value>path</value>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:         <value>handle</value>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:         <value>virtiofs</value>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:     </filesystem>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:     <tpm supported='yes'>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:         <value>tpm-spapr</value>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:         <value>spapr-tpm-proxy</value>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:         <value>passthrough</value>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:         <value>emulator</value>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:         <value>external</value>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.298583 np0000001613 nova-compute[98321]:       <enum name='backendVersion'>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:         <value>1.2</value>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:         <value>2.0</value>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:     </tpm>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:     <redirdev supported='yes'>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:     </redirdev>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:     <channel supported='yes'>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:         <value>pty</value>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:         <value>unix</value>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:         <value>spicevmc</value>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:     </channel>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:     <crypto supported='yes'>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:         <value>qemu</value>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:     </crypto>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:   </devices>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:   <features>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:     <gic supported='no'/>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:     <vmcoreinfo supported='no'/>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:     <genid supported='no'/>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:     <backingStoreInput supported='yes'/>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:     <backup supported='yes'/>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:     <async-teardown supported='yes'/>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:     <sev supported='no'/>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:     <sgx supported='no'/>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:   </features>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]: </domainCapabilities>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 09:54:56.299846 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=98321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 09:54:56.299846 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=powernv:
May 28 09:54:56.299846 np0000001613 nova-compute[98321]: <domainCapabilities>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:   <path>/usr/bin/qemu-system-ppc64le</path>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:   <domain>qemu</domain>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:   <machine>powernv9</machine>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:   <arch>ppc64le</arch>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:   <vcpu max='2048'/>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:   <iothreads supported='yes'/>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:   <os supported='yes'>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:     <enum name='firmware'/>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:     <loader supported='yes'>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:         <value>rom</value>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:         <value>pflash</value>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:       <enum name='readonly'>
May 28 09:54:56.299846 np0000001613 nova-compute[98321]:         <value>yes</value>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:       <enum name='secure'>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:     </loader>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:   </os>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:   <cpu>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:     <mode name='host-passthrough' supported='no'/>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:     <mode name='maximum' supported='no'/>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:     <mode name='host-model' supported='no'/>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:     <mode name='custom' supported='yes'>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:   <memoryBacking supported='yes'>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:     <enum name='sourceType'>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:       <value>file</value>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:       <value>anonymous</value>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:       <value>memfd</value>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:   </memoryBacking>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:   <devices>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:     <disk supported='yes'>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:       <enum name='diskDevice'>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:         <value>disk</value>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:         <value>cdrom</value>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:         <value>floppy</value>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:         <value>lun</value>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:         <value>fdc</value>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:         <value>sata</value>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:     </disk>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:     <graphics supported='yes'>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:         <value>sdl</value>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:         <value>vnc</value>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:         <value>spice</value>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:         <value>egl-headless</value>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:         <value>dbus</value>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:     </graphics>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:     <video supported='yes'>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:       <enum name='modelType'>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:         <value>vga</value>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:         <value>cirrus</value>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:         <value>none</value>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:         <value>bochs</value>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:     </video>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:     <hostdev supported='yes'>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:       <enum name='mode'>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:         <value>subsystem</value>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:       <enum name='startupPolicy'>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:         <value>default</value>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:         <value>mandatory</value>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:         <value>requisite</value>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:         <value>optional</value>
May 28 09:54:56.300854 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:       <enum name='subsysType'>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:         <value>pci</value>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:       <enum name='capsType'/>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:       <enum name='pciBackend'/>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:     </hostdev>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:     <rng supported='yes'>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:         <value>random</value>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:         <value>egd</value>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:     </rng>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:     <filesystem supported='yes'>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:       <enum name='driverType'>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:         <value>path</value>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:         <value>handle</value>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:         <value>virtiofs</value>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:     </filesystem>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:     <tpm supported='yes'>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:         <value>tpm-spapr</value>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:         <value>spapr-tpm-proxy</value>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:         <value>passthrough</value>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:         <value>emulator</value>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:         <value>external</value>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:       <enum name='backendVersion'>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:         <value>1.2</value>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:         <value>2.0</value>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:     </tpm>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:     <redirdev supported='yes'>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:     </redirdev>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:     <channel supported='yes'>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:         <value>pty</value>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:         <value>unix</value>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:         <value>spicevmc</value>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:     </channel>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:     <crypto supported='yes'>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:         <value>qemu</value>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:     </crypto>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:   </devices>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:   <features>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:     <gic supported='no'/>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:     <vmcoreinfo supported='no'/>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:     <genid supported='no'/>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:     <backingStoreInput supported='yes'/>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:     <backup supported='yes'/>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:     <async-teardown supported='yes'/>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:     <sev supported='no'/>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:     <sgx supported='no'/>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]:   </features>
May 28 09:54:56.302114 np0000001613 nova-compute[98321]: </domainCapabilities>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 09:54:56.303381 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=pseries:
May 28 09:54:56.303381 np0000001613 nova-compute[98321]: <domainCapabilities>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:   <path>/usr/bin/qemu-system-ppc64le</path>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:   <domain>qemu</domain>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:   <machine>pseries-noble</machine>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:   <arch>ppc64le</arch>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:   <vcpu max='4096'/>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:   <iothreads supported='yes'/>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:   <os supported='yes'>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:     <enum name='firmware'/>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:     <loader supported='yes'>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:         <value>rom</value>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:         <value>pflash</value>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:       <enum name='readonly'>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:         <value>yes</value>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:       <enum name='secure'>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:     </loader>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:   </os>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:   <cpu>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:     <mode name='host-passthrough' supported='no'/>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:     <mode name='maximum' supported='no'/>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:     <mode name='host-model' supported='no'/>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:     <mode name='custom' supported='yes'>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:   <memoryBacking supported='yes'>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:     <enum name='sourceType'>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:       <value>file</value>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:       <value>anonymous</value>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:       <value>memfd</value>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:   </memoryBacking>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:   <devices>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:     <disk supported='yes'>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:       <enum name='diskDevice'>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:         <value>disk</value>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:         <value>cdrom</value>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:         <value>lun</value>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:         <value>sata</value>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.303381 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:     </disk>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:     <graphics supported='yes'>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:         <value>sdl</value>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:         <value>vnc</value>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:         <value>spice</value>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:         <value>egl-headless</value>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:         <value>dbus</value>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:     </graphics>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:     <video supported='yes'>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:       <enum name='modelType'>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:         <value>vga</value>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:         <value>cirrus</value>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:         <value>none</value>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:         <value>bochs</value>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:     </video>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:     <hostdev supported='yes'>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:       <enum name='mode'>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:         <value>subsystem</value>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:       <enum name='startupPolicy'>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:         <value>default</value>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:         <value>mandatory</value>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:         <value>requisite</value>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:         <value>optional</value>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:       <enum name='subsysType'>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:         <value>pci</value>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:       <enum name='capsType'/>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:       <enum name='pciBackend'/>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:     </hostdev>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:     <rng supported='yes'>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:         <value>random</value>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:         <value>egd</value>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:     </rng>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:     <filesystem supported='yes'>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:       <enum name='driverType'>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:         <value>path</value>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:         <value>handle</value>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:         <value>virtiofs</value>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:     </filesystem>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:     <tpm supported='yes'>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:         <value>tpm-spapr</value>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:         <value>spapr-tpm-proxy</value>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:         <value>passthrough</value>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:         <value>emulator</value>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:         <value>external</value>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:       <enum name='backendVersion'>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:         <value>1.2</value>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:         <value>2.0</value>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:     </tpm>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:     <redirdev supported='yes'>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:     </redirdev>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:     <channel supported='yes'>
May 28 09:54:56.304371 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:         <value>pty</value>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:         <value>unix</value>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:         <value>spicevmc</value>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:     </channel>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:     <crypto supported='yes'>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:         <value>qemu</value>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:     </crypto>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:   </devices>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:   <features>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:     <gic supported='no'/>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:     <vmcoreinfo supported='no'/>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:     <genid supported='no'/>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:     <backingStoreInput supported='yes'/>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:     <backup supported='yes'/>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:     <async-teardown supported='yes'/>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:     <sev supported='no'/>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:     <sgx supported='no'/>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:   </features>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]: </domainCapabilities>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 09:54:56.305781 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=98321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 09:54:56.305781 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Libvirt host hypervisor capabilities for arch=riscv32 and machine_type=None:
May 28 09:54:56.305781 np0000001613 nova-compute[98321]: <domainCapabilities>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:   <path>/usr/bin/qemu-system-riscv32</path>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:   <domain>qemu</domain>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:   <machine>virt</machine>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:   <arch>riscv32</arch>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:   <vcpu max='512'/>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:   <iothreads supported='yes'/>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:   <os supported='yes'>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:     <enum name='firmware'/>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:     <loader supported='yes'>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:         <value>rom</value>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:         <value>pflash</value>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:       <enum name='readonly'>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:         <value>yes</value>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:       <enum name='secure'>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:     </loader>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:   </os>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:   <cpu>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:     <mode name='host-passthrough' supported='no'/>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:     <mode name='maximum' supported='yes'>
May 28 09:54:56.305781 np0000001613 nova-compute[98321]:       <enum name='maximumMigratable'>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:         <value>on</value>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:         <value>off</value>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:     <mode name='host-model' supported='no'/>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:     <mode name='custom' supported='no'/>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:   <memoryBacking supported='yes'>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:     <enum name='sourceType'>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:       <value>file</value>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:       <value>anonymous</value>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:       <value>memfd</value>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:   </memoryBacking>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:   <devices>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:     <disk supported='yes'>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:       <enum name='diskDevice'>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:         <value>disk</value>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:         <value>cdrom</value>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:         <value>floppy</value>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:         <value>lun</value>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:         <value>fdc</value>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:         <value>sata</value>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:     </disk>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:     <graphics supported='yes'>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:         <value>sdl</value>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:         <value>vnc</value>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:         <value>spice</value>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:         <value>egl-headless</value>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:         <value>dbus</value>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:     </graphics>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:     <video supported='yes'>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:       <enum name='modelType'>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:         <value>vga</value>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:         <value>cirrus</value>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:         <value>none</value>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:         <value>bochs</value>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:         <value>ramfb</value>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:     </video>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:     <hostdev supported='yes'>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:       <enum name='mode'>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:         <value>subsystem</value>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:       <enum name='startupPolicy'>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:         <value>default</value>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:         <value>mandatory</value>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:         <value>requisite</value>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:         <value>optional</value>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:       <enum name='subsysType'>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:         <value>pci</value>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:       <enum name='capsType'/>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:       <enum name='pciBackend'/>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:     </hostdev>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:     <rng supported='yes'>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.306916 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:         <value>random</value>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:         <value>egd</value>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:     </rng>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:     <filesystem supported='yes'>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:       <enum name='driverType'>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:         <value>path</value>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:         <value>handle</value>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:         <value>virtiofs</value>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:     </filesystem>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:     <tpm supported='yes'>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:         <value>tpm-tis</value>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:         <value>passthrough</value>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:         <value>emulator</value>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:         <value>external</value>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:       <enum name='backendVersion'>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:         <value>1.2</value>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:         <value>2.0</value>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:     </tpm>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:     <redirdev supported='yes'>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:     </redirdev>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:     <channel supported='yes'>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:         <value>pty</value>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:         <value>unix</value>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:         <value>spicevmc</value>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:     </channel>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:     <crypto supported='yes'>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:         <value>qemu</value>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:     </crypto>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:   </devices>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:   <features>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:     <gic supported='no'/>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:     <vmcoreinfo supported='yes'/>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:     <genid supported='no'/>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:     <backingStoreInput supported='yes'/>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:     <backup supported='yes'/>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:     <async-teardown supported='yes'/>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:     <sev supported='no'/>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:     <sgx supported='no'/>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:   </features>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]: </domainCapabilities>
May 28 09:54:56.308137 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 09:54:56.308137 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=98321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 09:54:56.309330 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Libvirt host hypervisor capabilities for arch=riscv64 and machine_type=None:
May 28 09:54:56.309330 np0000001613 nova-compute[98321]: <domainCapabilities>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:   <path>/usr/bin/qemu-system-riscv64</path>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:   <domain>qemu</domain>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:   <machine>virt</machine>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:   <arch>riscv64</arch>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:   <vcpu max='512'/>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:   <iothreads supported='yes'/>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:   <os supported='yes'>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:     <enum name='firmware'/>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:     <loader supported='yes'>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:         <value>rom</value>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:         <value>pflash</value>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:       <enum name='readonly'>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:         <value>yes</value>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:       <enum name='secure'>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:     </loader>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:   </os>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:   <cpu>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:     <mode name='host-passthrough' supported='no'/>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:     <mode name='maximum' supported='yes'>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:       <enum name='maximumMigratable'>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:         <value>on</value>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:         <value>off</value>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:     <mode name='host-model' supported='no'/>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:     <mode name='custom' supported='yes'>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>rv64</model>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>sifive-e51</model>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>any</model>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>x-rv128</model>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>shakti-c</model>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>max</model>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>thead-c906</model>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>sifive-u54</model>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:       <model usable='unknown' vendor='unknown'>veyron-v1</model>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:   <memoryBacking supported='yes'>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:     <enum name='sourceType'>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:       <value>file</value>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:       <value>anonymous</value>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:       <value>memfd</value>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:   </memoryBacking>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:   <devices>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:     <disk supported='yes'>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:       <enum name='diskDevice'>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:         <value>disk</value>
May 28 09:54:56.309330 np0000001613 nova-compute[98321]:         <value>cdrom</value>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:         <value>floppy</value>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:         <value>lun</value>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:         <value>fdc</value>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:         <value>sata</value>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:     </disk>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:     <graphics supported='yes'>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:         <value>sdl</value>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:         <value>vnc</value>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:         <value>spice</value>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:         <value>egl-headless</value>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:         <value>dbus</value>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:     </graphics>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:     <video supported='yes'>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:       <enum name='modelType'>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:         <value>vga</value>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:         <value>cirrus</value>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:         <value>none</value>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:         <value>bochs</value>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:         <value>ramfb</value>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:     </video>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:     <hostdev supported='yes'>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:       <enum name='mode'>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:         <value>subsystem</value>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:       <enum name='startupPolicy'>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:         <value>default</value>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:         <value>mandatory</value>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:         <value>requisite</value>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:         <value>optional</value>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:       <enum name='subsysType'>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:         <value>pci</value>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:       <enum name='capsType'/>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:       <enum name='pciBackend'/>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:     </hostdev>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:     <rng supported='yes'>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:         <value>random</value>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:         <value>egd</value>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:     </rng>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:     <filesystem supported='yes'>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:       <enum name='driverType'>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:         <value>path</value>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:         <value>handle</value>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:         <value>virtiofs</value>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:     </filesystem>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:     <tpm supported='yes'>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:         <value>tpm-tis</value>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.310366 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:         <value>passthrough</value>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:         <value>emulator</value>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:         <value>external</value>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:       <enum name='backendVersion'>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:         <value>1.2</value>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:         <value>2.0</value>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:     </tpm>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:     <redirdev supported='yes'>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:     </redirdev>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:     <channel supported='yes'>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:         <value>pty</value>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:         <value>unix</value>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:         <value>spicevmc</value>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:     </channel>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:     <crypto supported='yes'>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:         <value>qemu</value>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:     </crypto>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:   </devices>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:   <features>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:     <gic supported='no'/>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:     <vmcoreinfo supported='yes'/>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:     <genid supported='no'/>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:     <backingStoreInput supported='yes'/>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:     <backup supported='yes'/>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:     <async-teardown supported='yes'/>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:     <sev supported='no'/>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:     <sgx supported='no'/>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:   </features>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]: </domainCapabilities>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 09:54:56.311698 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=98321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 09:54:56.311698 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Libvirt host hypervisor capabilities for arch=s390x and machine_type=s390-ccw-virtio:
May 28 09:54:56.311698 np0000001613 nova-compute[98321]: <domainCapabilities>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:   <path>/usr/bin/qemu-system-s390x</path>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:   <domain>qemu</domain>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:   <machine>s390-ccw-virtio-noble</machine>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:   <arch>s390x</arch>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:   <vcpu max='248'/>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:   <iothreads supported='yes'/>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:   <os supported='yes'>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:     <enum name='firmware'/>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:     <loader supported='yes'>
May 28 09:54:56.311698 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:         <value>rom</value>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:         <value>pflash</value>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:       <enum name='readonly'>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:         <value>yes</value>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:       <enum name='secure'>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:     </loader>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:   </os>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:   <cpu>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:     <mode name='host-passthrough' supported='no'/>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:     <mode name='maximum' supported='yes'>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:       <enum name='maximumMigratable'>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:         <value>on</value>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:         <value>off</value>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:     <mode name='host-model' supported='no'/>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:     <mode name='custom' supported='yes'>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z13</model>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z990.3</model>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z13-base</model>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z990.2</model>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z196.2-base</model>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z14</model>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z14.2-base</model>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z990.4</model>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z196</model>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z10BC.2-base</model>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z114-base</model>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>gen16b</model>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z890.3-base</model>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>gen16a</model>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z990.5</model>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z196.2</model>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>zEC12</model>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>zEC12.2</model>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z9EC.2</model>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z9BC</model>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z9EC.3-base</model>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='IBM'>z800-base</model>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z14ZR1-base</model>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z890</model>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z990.4-base</model>
May 28 09:54:56.312690 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z9EC.3</model>
May 28 09:54:56.313571 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z13.2</model>
May 28 09:54:56.313571 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z10BC.2</model>
May 28 09:54:56.313571 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>gen15a-base</model>
May 28 09:54:56.313571 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z14.2</model>
May 28 09:54:56.313571 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>zBC12-base</model>
May 28 09:54:56.313571 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>gen16a-base</model>
May 28 09:54:56.313571 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='IBM'>z900.3</model>
May 28 09:54:56.313571 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z196-base</model>
May 28 09:54:56.313571 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z990</model>
May 28 09:54:56.313571 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z14-base</model>
May 28 09:54:56.313571 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='IBM'>z900.2</model>
May 28 09:54:56.313571 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='IBM'>z800</model>
May 28 09:54:56.313571 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z10EC</model>
May 28 09:54:56.313571 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z14ZR1</model>
May 28 09:54:56.313571 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='IBM'>z900</model>
May 28 09:54:56.313571 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z10EC.2</model>
May 28 09:54:56.313571 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z10EC.2-base</model>
May 28 09:54:56.313571 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='IBM'>z900.2-base</model>
May 28 09:54:56.313571 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='IBM'>z900-base</model>
May 28 09:54:56.313571 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z10EC.3</model>
May 28 09:54:56.313571 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z990.5-base</model>
May 28 09:54:56.313571 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>max</model>
May 28 09:54:56.313571 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>gen15b</model>
May 28 09:54:56.313571 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z9BC.2-base</model>
May 28 09:54:56.313571 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>gen15a</model>
May 28 09:54:56.313571 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z990.2-base</model>
May 28 09:54:56.313571 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z10EC-base</model>
May 28 09:54:56.313571 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>gen16b-base</model>
May 28 09:54:56.313571 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z114</model>
May 28 09:54:56.313571 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z9EC-base</model>
May 28 09:54:56.313571 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z13s</model>
May 28 09:54:56.313571 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>qemu</model>
May 28 09:54:56.313571 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>gen15b-base</model>
May 28 09:54:56.313571 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>zEC12-base</model>
May 28 09:54:56.313571 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z890.3</model>
May 28 09:54:56.313571 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z10EC.3-base</model>
May 28 09:54:56.313571 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z890.2-base</model>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z890.2</model>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z10BC-base</model>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>zEC12.2-base</model>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z890-base</model>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z9BC-base</model>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z10BC</model>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z9EC</model>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z9EC.2-base</model>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z13.2-base</model>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='IBM'>z900.3-base</model>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z990.3-base</model>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z13s-base</model>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>zBC12</model>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z990-base</model>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:       <model usable='no' vendor='IBM'>z9BC.2</model>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:   <memoryBacking supported='yes'>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:     <enum name='sourceType'>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:       <value>file</value>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:       <value>anonymous</value>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:       <value>memfd</value>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:   </memoryBacking>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:   <devices>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:     <disk supported='yes'>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:       <enum name='diskDevice'>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:         <value>disk</value>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:         <value>cdrom</value>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:         <value>floppy</value>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:         <value>lun</value>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:         <value>fdc</value>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:     </disk>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:     <graphics supported='yes'>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:         <value>sdl</value>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:         <value>vnc</value>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:         <value>spice</value>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:         <value>egl-headless</value>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:         <value>dbus</value>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:     </graphics>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:     <video supported='yes'>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:       <enum name='modelType'>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:         <value>none</value>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:     </video>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:     <hostdev supported='yes'>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:       <enum name='mode'>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:         <value>subsystem</value>
May 28 09:54:56.314273 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:       <enum name='startupPolicy'>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:         <value>default</value>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:         <value>mandatory</value>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:         <value>requisite</value>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:         <value>optional</value>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:       <enum name='subsysType'>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:         <value>pci</value>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:       <enum name='capsType'/>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:       <enum name='pciBackend'/>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:     </hostdev>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:     <rng supported='yes'>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:         <value>random</value>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:         <value>egd</value>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:     </rng>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:     <filesystem supported='yes'>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:       <enum name='driverType'>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:         <value>path</value>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:         <value>handle</value>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:         <value>virtiofs</value>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:     </filesystem>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:     <tpm supported='no'/>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:     <redirdev supported='yes'>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:     </redirdev>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:     <channel supported='yes'>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:         <value>pty</value>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:         <value>unix</value>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:         <value>spicevmc</value>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:     </channel>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:     <crypto supported='yes'>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:         <value>qemu</value>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:     </crypto>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:   </devices>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:   <features>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:     <gic supported='no'/>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:     <vmcoreinfo supported='no'/>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:     <genid supported='no'/>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:     <backingStoreInput supported='yes'/>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:     <backup supported='yes'/>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:     <async-teardown supported='yes'/>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:     <s390-pv supported='no'/>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:     <sev supported='no'/>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:     <sgx supported='no'/>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:   </features>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]: </domainCapabilities>
May 28 09:54:56.315380 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 09:54:56.316724 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=98321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 09:54:56.316724 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Libvirt host hypervisor capabilities for arch=sh4 and machine_type=None:
May 28 09:54:56.316724 np0000001613 nova-compute[98321]: <domainCapabilities>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:   <path>/usr/bin/qemu-system-sh4</path>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:   <domain>qemu</domain>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:   <machine>shix</machine>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:   <arch>sh4</arch>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:   <vcpu max='1'/>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:   <iothreads supported='yes'/>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:   <os supported='yes'>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:     <enum name='firmware'/>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:     <loader supported='yes'>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:         <value>rom</value>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:         <value>pflash</value>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:       <enum name='readonly'>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:         <value>yes</value>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:       <enum name='secure'>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:     </loader>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:   </os>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:   <cpu>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:     <mode name='host-passthrough' supported='no'/>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:     <mode name='maximum' supported='no'/>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:     <mode name='host-model' supported='no'/>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:     <mode name='custom' supported='no'/>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:   <memoryBacking supported='yes'>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:     <enum name='sourceType'>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:       <value>file</value>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:       <value>anonymous</value>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:       <value>memfd</value>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:   </memoryBacking>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:   <devices>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:     <disk supported='yes'>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:       <enum name='diskDevice'>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:         <value>disk</value>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:         <value>cdrom</value>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:         <value>floppy</value>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:         <value>lun</value>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:         <value>fdc</value>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:         <value>sata</value>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.316724 np0000001613 nova-compute[98321]:     </disk>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:     <graphics supported='yes'>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:         <value>sdl</value>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:         <value>vnc</value>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:         <value>spice</value>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:         <value>egl-headless</value>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:         <value>dbus</value>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:     </graphics>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:     <video supported='yes'>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:       <enum name='modelType'>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:         <value>vga</value>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:         <value>cirrus</value>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:         <value>none</value>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:         <value>bochs</value>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:     </video>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:     <hostdev supported='yes'>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:       <enum name='mode'>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:         <value>subsystem</value>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:       <enum name='startupPolicy'>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:         <value>default</value>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:         <value>mandatory</value>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:         <value>requisite</value>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:         <value>optional</value>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:       <enum name='subsysType'>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:         <value>pci</value>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:       <enum name='capsType'/>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:       <enum name='pciBackend'/>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:     </hostdev>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:     <rng supported='yes'>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:         <value>random</value>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:         <value>egd</value>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:     </rng>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:     <filesystem supported='yes'>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:       <enum name='driverType'>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:         <value>path</value>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:         <value>handle</value>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:         <value>virtiofs</value>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:     </filesystem>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:     <tpm supported='no'/>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:     <redirdev supported='yes'>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:     </redirdev>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:     <channel supported='yes'>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:         <value>pty</value>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:         <value>unix</value>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:         <value>spicevmc</value>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:     </channel>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:     <crypto supported='yes'>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:         <value>qemu</value>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:     </crypto>
May 28 09:54:56.317743 np0000001613 nova-compute[98321]:   </devices>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:   <features>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:     <gic supported='no'/>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:     <vmcoreinfo supported='no'/>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:     <genid supported='no'/>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:     <backingStoreInput supported='yes'/>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:     <backup supported='yes'/>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:     <async-teardown supported='yes'/>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:     <sev supported='no'/>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:     <sgx supported='no'/>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:   </features>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]: </domainCapabilities>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 09:54:56.319335 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=98321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 09:54:56.319335 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Libvirt host hypervisor capabilities for arch=sh4eb and machine_type=None:
May 28 09:54:56.319335 np0000001613 nova-compute[98321]: <domainCapabilities>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:   <path>/usr/bin/qemu-system-sh4eb</path>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:   <domain>qemu</domain>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:   <machine>shix</machine>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:   <arch>sh4eb</arch>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:   <vcpu max='1'/>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:   <iothreads supported='yes'/>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:   <os supported='yes'>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:     <enum name='firmware'/>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:     <loader supported='yes'>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:         <value>rom</value>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:         <value>pflash</value>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:       <enum name='readonly'>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:         <value>yes</value>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:       <enum name='secure'>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:     </loader>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:   </os>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:   <cpu>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:     <mode name='host-passthrough' supported='no'/>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:     <mode name='maximum' supported='no'/>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:     <mode name='host-model' supported='no'/>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:     <mode name='custom' supported='no'/>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:   <memoryBacking supported='yes'>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:     <enum name='sourceType'>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:       <value>file</value>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:       <value>anonymous</value>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:       <value>memfd</value>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:   </memoryBacking>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:   <devices>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:     <disk supported='yes'>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:       <enum name='diskDevice'>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:         <value>disk</value>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:         <value>cdrom</value>
May 28 09:54:56.319335 np0000001613 nova-compute[98321]:         <value>floppy</value>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:         <value>lun</value>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:         <value>fdc</value>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:         <value>sata</value>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:     </disk>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:     <graphics supported='yes'>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:         <value>sdl</value>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:         <value>vnc</value>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:         <value>spice</value>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:         <value>egl-headless</value>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:         <value>dbus</value>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:     </graphics>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:     <video supported='yes'>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:       <enum name='modelType'>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:         <value>vga</value>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:         <value>cirrus</value>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:         <value>none</value>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:         <value>bochs</value>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:     </video>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:     <hostdev supported='yes'>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:       <enum name='mode'>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:         <value>subsystem</value>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:       <enum name='startupPolicy'>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:         <value>default</value>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:         <value>mandatory</value>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:         <value>requisite</value>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:         <value>optional</value>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:       <enum name='subsysType'>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:         <value>pci</value>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:       <enum name='capsType'/>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:       <enum name='pciBackend'/>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:     </hostdev>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:     <rng supported='yes'>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:         <value>random</value>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:         <value>egd</value>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:     </rng>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:     <filesystem supported='yes'>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:       <enum name='driverType'>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:         <value>path</value>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:         <value>handle</value>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:         <value>virtiofs</value>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:     </filesystem>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:     <tpm supported='no'/>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:     <redirdev supported='yes'>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:     </redirdev>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:     <channel supported='yes'>
May 28 09:54:56.320362 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:         <value>pty</value>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:         <value>unix</value>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:         <value>spicevmc</value>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:     </channel>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:     <crypto supported='yes'>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:         <value>qemu</value>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:     </crypto>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:   </devices>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:   <features>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:     <gic supported='no'/>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:     <vmcoreinfo supported='no'/>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:     <genid supported='no'/>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:     <backingStoreInput supported='yes'/>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:     <backup supported='yes'/>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:     <async-teardown supported='yes'/>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:     <sev supported='no'/>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:     <sgx supported='no'/>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:   </features>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]: </domainCapabilities>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 09:54:56.321659 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=98321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 09:54:56.321659 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Libvirt host hypervisor capabilities for arch=sparc and machine_type=None:
May 28 09:54:56.321659 np0000001613 nova-compute[98321]: <domainCapabilities>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:   <path>/usr/bin/qemu-system-sparc</path>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:   <domain>qemu</domain>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:   <machine>SS-5</machine>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:   <arch>sparc</arch>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:   <vcpu max='1'/>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:   <iothreads supported='yes'/>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:   <os supported='yes'>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:     <enum name='firmware'/>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:     <loader supported='yes'>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:         <value>rom</value>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:         <value>pflash</value>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:       <enum name='readonly'>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:         <value>yes</value>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:       <enum name='secure'>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:     </loader>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:   </os>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:   <cpu>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:     <mode name='host-passthrough' supported='no'/>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:     <mode name='maximum' supported='no'/>
May 28 09:54:56.321659 np0000001613 nova-compute[98321]:     <mode name='host-model' supported='no'/>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:     <mode name='custom' supported='no'/>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:   <memoryBacking supported='yes'>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:     <enum name='sourceType'>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:       <value>file</value>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:       <value>anonymous</value>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:       <value>memfd</value>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:   </memoryBacking>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:   <devices>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:     <disk supported='yes'>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:       <enum name='diskDevice'>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:         <value>disk</value>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:         <value>cdrom</value>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:         <value>floppy</value>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:         <value>lun</value>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:         <value>fdc</value>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:     </disk>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:     <graphics supported='yes'>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:         <value>sdl</value>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:         <value>vnc</value>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:         <value>spice</value>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:         <value>egl-headless</value>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:         <value>dbus</value>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:     </graphics>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:     <video supported='yes'>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:       <enum name='modelType'>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:         <value>none</value>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:     </video>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:     <hostdev supported='yes'>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:       <enum name='mode'>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:         <value>subsystem</value>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:       <enum name='startupPolicy'>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:         <value>default</value>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:         <value>mandatory</value>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:         <value>requisite</value>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:         <value>optional</value>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:       <enum name='subsysType'>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:         <value>pci</value>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:       <enum name='capsType'/>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:       <enum name='pciBackend'/>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:     </hostdev>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:     <rng supported='yes'>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:       <enum name='model'/>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:         <value>random</value>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:         <value>egd</value>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:     </rng>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:     <filesystem supported='yes'>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:       <enum name='driverType'>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:         <value>path</value>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:         <value>handle</value>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:     </filesystem>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:     <tpm supported='no'/>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:     <redirdev supported='no'/>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:     <channel supported='yes'>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:         <value>pty</value>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:         <value>unix</value>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:         <value>spicevmc</value>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:     </channel>
May 28 09:54:56.322701 np0000001613 nova-compute[98321]:     <crypto supported='yes'>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:       <enum name='model'/>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:         <value>qemu</value>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:     </crypto>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:   </devices>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:   <features>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:     <gic supported='no'/>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:     <vmcoreinfo supported='no'/>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:     <genid supported='no'/>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:     <backingStoreInput supported='yes'/>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:     <backup supported='yes'/>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:     <async-teardown supported='yes'/>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:     <sev supported='no'/>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:     <sgx supported='no'/>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:   </features>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]: </domainCapabilities>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 09:54:56.324216 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=98321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 09:54:56.324216 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Libvirt host hypervisor capabilities for arch=sparc64 and machine_type=None:
May 28 09:54:56.324216 np0000001613 nova-compute[98321]: <domainCapabilities>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:   <path>/usr/bin/qemu-system-sparc64</path>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:   <domain>qemu</domain>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:   <machine>sun4u</machine>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:   <arch>sparc64</arch>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:   <vcpu max='1'/>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:   <iothreads supported='yes'/>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:   <os supported='yes'>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:     <enum name='firmware'/>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:     <loader supported='yes'>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:         <value>rom</value>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:         <value>pflash</value>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:       <enum name='readonly'>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:         <value>yes</value>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:       <enum name='secure'>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:     </loader>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:   </os>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:   <cpu>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:     <mode name='host-passthrough' supported='no'/>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:     <mode name='maximum' supported='no'/>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:     <mode name='host-model' supported='no'/>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:     <mode name='custom' supported='no'/>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:   <memoryBacking supported='yes'>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:     <enum name='sourceType'>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:       <value>file</value>
May 28 09:54:56.324216 np0000001613 nova-compute[98321]:       <value>anonymous</value>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:       <value>memfd</value>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:   </memoryBacking>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:   <devices>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:     <disk supported='yes'>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:       <enum name='diskDevice'>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:         <value>disk</value>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:         <value>cdrom</value>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:         <value>floppy</value>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:         <value>lun</value>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:         <value>ide</value>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:         <value>fdc</value>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:         <value>sata</value>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:     </disk>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:     <graphics supported='yes'>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:         <value>sdl</value>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:         <value>vnc</value>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:         <value>spice</value>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:         <value>egl-headless</value>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:         <value>dbus</value>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:     </graphics>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:     <video supported='yes'>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:       <enum name='modelType'>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:         <value>vga</value>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:         <value>cirrus</value>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:         <value>none</value>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:         <value>bochs</value>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:     </video>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:     <hostdev supported='yes'>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:       <enum name='mode'>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:         <value>subsystem</value>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:       <enum name='startupPolicy'>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:         <value>default</value>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:         <value>mandatory</value>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:         <value>requisite</value>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:         <value>optional</value>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:       <enum name='subsysType'>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:         <value>pci</value>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:       <enum name='capsType'/>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:       <enum name='pciBackend'/>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:     </hostdev>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:     <rng supported='yes'>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:         <value>random</value>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:         <value>egd</value>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:     </rng>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:     <filesystem supported='yes'>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:       <enum name='driverType'>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:         <value>path</value>
May 28 09:54:56.325314 np0000001613 nova-compute[98321]:         <value>handle</value>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:         <value>virtiofs</value>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:     </filesystem>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:     <tpm supported='no'/>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:     <redirdev supported='yes'>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:     </redirdev>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:     <channel supported='yes'>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:         <value>pty</value>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:         <value>unix</value>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:         <value>spicevmc</value>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:     </channel>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:     <crypto supported='yes'>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:         <value>qemu</value>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:     </crypto>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:   </devices>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:   <features>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:     <gic supported='no'/>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:     <vmcoreinfo supported='no'/>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:     <genid supported='no'/>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:     <backingStoreInput supported='yes'/>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:     <backup supported='yes'/>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:     <async-teardown supported='yes'/>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:     <sev supported='no'/>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:     <sgx supported='no'/>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:   </features>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]: </domainCapabilities>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 09:54:56.326689 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu-q35', 'ubuntu', 'pc'} {{(pid=98321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 09:54:56.326689 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
May 28 09:54:56.326689 np0000001613 nova-compute[98321]: <domainCapabilities>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:   <path>/usr/bin/qemu-system-x86_64</path>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:   <domain>qemu</domain>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:   <machine>pc-q35-noble</machine>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:   <arch>x86_64</arch>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:   <vcpu max='1024'/>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:   <iothreads supported='yes'/>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:   <os supported='yes'>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:     <enum name='firmware'>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:       <value>efi</value>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:     <loader supported='yes'>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
May 28 09:54:56.326689 np0000001613 nova-compute[98321]:       <value>/usr/share/ovmf/OVMF.amdsev.fd</value>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:         <value>rom</value>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:         <value>pflash</value>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:       <enum name='readonly'>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:         <value>yes</value>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:       <enum name='secure'>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:         <value>yes</value>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:     </loader>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:   </os>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:   <cpu>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:     <mode name='host-passthrough' supported='no'/>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:     <mode name='maximum' supported='yes'>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:       <enum name='maximumMigratable'>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:         <value>on</value>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:         <value>off</value>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:     <mode name='host-model' supported='yes'>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:       <model fallback='forbid'>EPYC</model>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:       <vendor>AMD</vendor>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:       <feature policy='require' name='acpi'/>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:       <feature policy='require' name='ss'/>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:       <feature policy='require' name='monitor'/>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:       <feature policy='require' name='hypervisor'/>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:       <feature policy='require' name='erms'/>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:       <feature policy='require' name='mpx'/>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:       <feature policy='require' name='pcommit'/>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:       <feature policy='require' name='clwb'/>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:       <feature policy='require' name='umip'/>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:       <feature policy='require' name='pku'/>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:       <feature policy='require' name='vaes'/>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:       <feature policy='require' name='la57'/>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:       <feature policy='require' name='rdpid'/>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:       <feature policy='require' name='pks'/>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:       <feature policy='require' name='fsrm'/>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:       <feature policy='require' name='fzrm'/>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:       <feature policy='require' name='fsrs'/>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:       <feature policy='require' name='fsrc'/>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:       <feature policy='require' name='3dnowext'/>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:       <feature policy='require' name='3dnow'/>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:       <feature policy='require' name='xsaveerptr'/>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:       <feature policy='require' name='wbnoinvd'/>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:       <feature policy='require' name='npt'/>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:       <feature policy='require' name='vgif'/>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:       <feature policy='require' name='svme-addr-chk'/>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:       <feature policy='disable' name='vme'/>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:       <feature policy='disable' name='xsavec'/>
May 28 09:54:56.327634 np0000001613 nova-compute[98321]:       <feature policy='disable' name='fxsr_opt'/>
May 28 09:54:56.328585 np0000001613 nova-compute[98321]:       <feature policy='disable' name='misalignsse'/>
May 28 09:54:56.328585 np0000001613 nova-compute[98321]:       <feature policy='disable' name='osvw'/>
May 28 09:54:56.328585 np0000001613 nova-compute[98321]:       <feature policy='disable' name='topoext'/>
May 28 09:54:56.328585 np0000001613 nova-compute[98321]:       <feature policy='disable' name='nrip-save'/>
May 28 09:54:56.328585 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.328585 np0000001613 nova-compute[98321]:     <mode name='custom' supported='yes'>
May 28 09:54:56.328585 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 28 09:54:56.328585 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 28 09:54:56.328585 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>phenom</model>
May 28 09:54:56.328585 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 28 09:54:56.328585 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 28 09:54:56.328585 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>pentium</model>
May 28 09:54:56.328585 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='Intel'>n270</model>
May 28 09:54:56.328585 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 28 09:54:56.328585 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 28 09:54:56.328585 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 28 09:54:56.328585 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 28 09:54:56.328585 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='AMD'>athlon</model>
May 28 09:54:56.328585 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 28 09:54:56.328585 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 28 09:54:56.328585 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 28 09:54:56.328585 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 28 09:54:56.328585 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 28 09:54:56.328585 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 28 09:54:56.328585 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 28 09:54:56.328585 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 28 09:54:56.328585 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 28 09:54:56.328585 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 28 09:54:56.328585 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 28 09:54:56.328585 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 28 09:54:56.328585 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 28 09:54:56.328585 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 28 09:54:56.328585 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 28 09:54:56.328585 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 28 09:54:56.328585 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Haswell</model>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>EPYC</model>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>486</model>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:   <memoryBacking supported='yes'>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:     <enum name='sourceType'>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:       <value>file</value>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:       <value>anonymous</value>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:       <value>memfd</value>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:   </memoryBacking>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:   <devices>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:     <disk supported='yes'>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:       <enum name='diskDevice'>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:         <value>disk</value>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:         <value>cdrom</value>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:         <value>floppy</value>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:         <value>lun</value>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:         <value>fdc</value>
May 28 09:54:56.329158 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:         <value>sata</value>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:     </disk>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:     <graphics supported='yes'>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:         <value>sdl</value>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:         <value>vnc</value>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:         <value>spice</value>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:         <value>egl-headless</value>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:         <value>dbus</value>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:     </graphics>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:     <video supported='yes'>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:       <enum name='modelType'>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:         <value>vga</value>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:         <value>cirrus</value>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:         <value>vmvga</value>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:         <value>qxl</value>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:         <value>none</value>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:         <value>bochs</value>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:         <value>ramfb</value>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:     </video>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:     <hostdev supported='yes'>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:       <enum name='mode'>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:         <value>subsystem</value>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:       <enum name='startupPolicy'>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:         <value>default</value>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:         <value>mandatory</value>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:         <value>requisite</value>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:         <value>optional</value>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:       <enum name='subsysType'>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:         <value>pci</value>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:       <enum name='capsType'/>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:       <enum name='pciBackend'/>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:     </hostdev>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:     <rng supported='yes'>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:         <value>random</value>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:         <value>egd</value>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:     </rng>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:     <filesystem supported='yes'>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:       <enum name='driverType'>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:         <value>path</value>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:         <value>handle</value>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:         <value>virtiofs</value>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:     </filesystem>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:     <tpm supported='yes'>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:         <value>tpm-tis</value>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:         <value>tpm-crb</value>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:         <value>passthrough</value>
May 28 09:54:56.329908 np0000001613 nova-compute[98321]:         <value>emulator</value>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:         <value>external</value>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:       <enum name='backendVersion'>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:         <value>1.2</value>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:         <value>2.0</value>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:     </tpm>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:     <redirdev supported='yes'>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:     </redirdev>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:     <channel supported='yes'>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:         <value>pty</value>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:         <value>unix</value>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:         <value>spicevmc</value>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:     </channel>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:     <crypto supported='yes'>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:         <value>qemu</value>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:     </crypto>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:   </devices>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:   <features>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:     <gic supported='no'/>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:     <vmcoreinfo supported='yes'/>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:     <genid supported='yes'/>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:     <backingStoreInput supported='yes'/>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:     <backup supported='yes'/>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:     <async-teardown supported='yes'/>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:     <sev supported='no'/>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:     <sgx supported='no'/>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:     <hyperv supported='yes'>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:       <enum name='features'>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:         <value>relaxed</value>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:         <value>vapic</value>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:         <value>spinlocks</value>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:         <value>vpindex</value>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:         <value>runtime</value>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:         <value>synic</value>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:         <value>stimer</value>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:         <value>reset</value>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:         <value>vendor_id</value>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:         <value>frequencies</value>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:         <value>reenlightenment</value>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:         <value>tlbflush</value>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:         <value>ipi</value>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:         <value>avic</value>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:     </hyperv>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:   </features>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]: </domainCapabilities>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 09:54:56.332358 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
May 28 09:54:56.332358 np0000001613 nova-compute[98321]: <domainCapabilities>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:   <path>/usr/bin/qemu-system-x86_64</path>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:   <domain>qemu</domain>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:   <machine>pc-q35-noble-v2</machine>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:   <arch>x86_64</arch>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:   <vcpu max='1024'/>
May 28 09:54:56.332358 np0000001613 nova-compute[98321]:   <iothreads supported='yes'/>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:   <os supported='yes'>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:     <enum name='firmware'>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:       <value>efi</value>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:     <loader supported='yes'>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:       <value>/usr/share/ovmf/OVMF.amdsev.fd</value>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:         <value>rom</value>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:         <value>pflash</value>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:       <enum name='readonly'>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:         <value>yes</value>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:       <enum name='secure'>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:         <value>yes</value>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:     </loader>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:   </os>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:   <cpu>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:     <mode name='host-passthrough' supported='no'/>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:     <mode name='maximum' supported='yes'>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:       <enum name='maximumMigratable'>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:         <value>on</value>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:         <value>off</value>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:     <mode name='host-model' supported='yes'>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:       <model fallback='forbid'>EPYC</model>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:       <vendor>AMD</vendor>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:       <feature policy='require' name='acpi'/>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:       <feature policy='require' name='ss'/>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:       <feature policy='require' name='monitor'/>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:       <feature policy='require' name='hypervisor'/>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:       <feature policy='require' name='erms'/>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:       <feature policy='require' name='mpx'/>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:       <feature policy='require' name='pcommit'/>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:       <feature policy='require' name='clwb'/>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:       <feature policy='require' name='umip'/>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:       <feature policy='require' name='pku'/>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:       <feature policy='require' name='vaes'/>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:       <feature policy='require' name='la57'/>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:       <feature policy='require' name='rdpid'/>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:       <feature policy='require' name='pks'/>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:       <feature policy='require' name='fsrm'/>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:       <feature policy='require' name='fzrm'/>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:       <feature policy='require' name='fsrs'/>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:       <feature policy='require' name='fsrc'/>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:       <feature policy='require' name='3dnowext'/>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:       <feature policy='require' name='3dnow'/>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:       <feature policy='require' name='xsaveerptr'/>
May 28 09:54:56.334353 np0000001613 nova-compute[98321]:       <feature policy='require' name='wbnoinvd'/>
May 28 09:54:56.335404 np0000001613 nova-compute[98321]:       <feature policy='require' name='npt'/>
May 28 09:54:56.335404 np0000001613 nova-compute[98321]:       <feature policy='require' name='vgif'/>
May 28 09:54:56.335404 np0000001613 nova-compute[98321]:       <feature policy='require' name='svme-addr-chk'/>
May 28 09:54:56.335404 np0000001613 nova-compute[98321]:       <feature policy='disable' name='vme'/>
May 28 09:54:56.335404 np0000001613 nova-compute[98321]:       <feature policy='disable' name='xsavec'/>
May 28 09:54:56.335404 np0000001613 nova-compute[98321]:       <feature policy='disable' name='fxsr_opt'/>
May 28 09:54:56.335404 np0000001613 nova-compute[98321]:       <feature policy='disable' name='misalignsse'/>
May 28 09:54:56.335404 np0000001613 nova-compute[98321]:       <feature policy='disable' name='osvw'/>
May 28 09:54:56.335404 np0000001613 nova-compute[98321]:       <feature policy='disable' name='topoext'/>
May 28 09:54:56.335404 np0000001613 nova-compute[98321]:       <feature policy='disable' name='nrip-save'/>
May 28 09:54:56.335404 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.335404 np0000001613 nova-compute[98321]:     <mode name='custom' supported='yes'>
May 28 09:54:56.335404 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 28 09:54:56.335404 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 28 09:54:56.335404 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>phenom</model>
May 28 09:54:56.335404 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 28 09:54:56.335404 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 28 09:54:56.335404 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>pentium</model>
May 28 09:54:56.335404 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='Intel'>n270</model>
May 28 09:54:56.335404 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 28 09:54:56.335404 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 28 09:54:56.335404 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 28 09:54:56.335404 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 28 09:54:56.335404 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='AMD'>athlon</model>
May 28 09:54:56.335404 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 28 09:54:56.335404 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 28 09:54:56.335404 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 28 09:54:56.335404 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 28 09:54:56.335404 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 28 09:54:56.335404 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 28 09:54:56.335404 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 28 09:54:56.335404 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 28 09:54:56.335404 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 28 09:54:56.335404 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 28 09:54:56.335404 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 28 09:54:56.335404 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 28 09:54:56.336020 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 28 09:54:56.336020 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 28 09:54:56.336020 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 28 09:54:56.336020 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 28 09:54:56.336020 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 28 09:54:56.336020 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 28 09:54:56.336020 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 28 09:54:56.336020 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 28 09:54:56.336020 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 28 09:54:56.336020 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 28 09:54:56.336020 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 28 09:54:56.336020 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 28 09:54:56.336020 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 28 09:54:56.336020 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 28 09:54:56.336020 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 28 09:54:56.336020 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Haswell</model>
May 28 09:54:56.336020 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 28 09:54:56.336020 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 28 09:54:56.336020 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 28 09:54:56.336020 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 28 09:54:56.336020 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>EPYC</model>
May 28 09:54:56.336020 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 28 09:54:56.336020 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 28 09:54:56.336020 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 28 09:54:56.336020 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 28 09:54:56.336020 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 28 09:54:56.336020 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 28 09:54:56.336020 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 28 09:54:56.336020 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 28 09:54:56.336020 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 28 09:54:56.336020 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>486</model>
May 28 09:54:56.336020 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.336020 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:54:56.336020 np0000001613 nova-compute[98321]:   <memoryBacking supported='yes'>
May 28 09:54:56.336020 np0000001613 nova-compute[98321]:     <enum name='sourceType'>
May 28 09:54:56.336020 np0000001613 nova-compute[98321]:       <value>file</value>
May 28 09:54:56.336020 np0000001613 nova-compute[98321]:       <value>anonymous</value>
May 28 09:54:56.336020 np0000001613 nova-compute[98321]:       <value>memfd</value>
May 28 09:54:56.336020 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.336020 np0000001613 nova-compute[98321]:   </memoryBacking>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:   <devices>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:     <disk supported='yes'>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:       <enum name='diskDevice'>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:         <value>disk</value>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:         <value>cdrom</value>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:         <value>floppy</value>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:         <value>lun</value>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:         <value>fdc</value>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:         <value>sata</value>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:     </disk>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:     <graphics supported='yes'>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:         <value>sdl</value>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:         <value>vnc</value>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:         <value>spice</value>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:         <value>egl-headless</value>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:         <value>dbus</value>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:     </graphics>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:     <video supported='yes'>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:       <enum name='modelType'>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:         <value>vga</value>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:         <value>cirrus</value>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:         <value>vmvga</value>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:         <value>qxl</value>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:         <value>none</value>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:         <value>bochs</value>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:         <value>ramfb</value>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:     </video>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:     <hostdev supported='yes'>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:       <enum name='mode'>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:         <value>subsystem</value>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:       <enum name='startupPolicy'>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:         <value>default</value>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:         <value>mandatory</value>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:         <value>requisite</value>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:         <value>optional</value>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:       <enum name='subsysType'>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:         <value>pci</value>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:       <enum name='capsType'/>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:       <enum name='pciBackend'/>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:     </hostdev>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:     <rng supported='yes'>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:         <value>random</value>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:         <value>egd</value>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:     </rng>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:     <filesystem supported='yes'>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:       <enum name='driverType'>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:         <value>path</value>
May 28 09:54:56.336698 np0000001613 nova-compute[98321]:         <value>handle</value>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:         <value>virtiofs</value>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:     </filesystem>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:     <tpm supported='yes'>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:         <value>tpm-tis</value>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:         <value>tpm-crb</value>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:         <value>passthrough</value>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:         <value>emulator</value>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:         <value>external</value>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:       <enum name='backendVersion'>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:         <value>1.2</value>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:         <value>2.0</value>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:     </tpm>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:     <redirdev supported='yes'>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:     </redirdev>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:     <channel supported='yes'>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:         <value>pty</value>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:         <value>unix</value>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:         <value>spicevmc</value>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:     </channel>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:     <crypto supported='yes'>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:         <value>qemu</value>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:     </crypto>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:   </devices>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:   <features>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:     <gic supported='no'/>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:     <vmcoreinfo supported='yes'/>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:     <genid supported='yes'/>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:     <backingStoreInput supported='yes'/>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:     <backup supported='yes'/>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:     <async-teardown supported='yes'/>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:     <sev supported='no'/>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:     <sgx supported='no'/>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:     <hyperv supported='yes'>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:       <enum name='features'>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:         <value>relaxed</value>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:         <value>vapic</value>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:         <value>spinlocks</value>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:         <value>vpindex</value>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:         <value>runtime</value>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:         <value>synic</value>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:         <value>stimer</value>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:         <value>reset</value>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:         <value>vendor_id</value>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:         <value>frequencies</value>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:         <value>reenlightenment</value>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:         <value>tlbflush</value>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:         <value>ipi</value>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:         <value>avic</value>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:     </hyperv>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:   </features>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]: </domainCapabilities>
May 28 09:54:56.338174 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 09:54:56.339429 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
May 28 09:54:56.339429 np0000001613 nova-compute[98321]: <domainCapabilities>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:   <path>/usr/bin/qemu-system-x86_64</path>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:   <domain>qemu</domain>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:   <machine>pc-i440fx-noble-v2</machine>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:   <arch>x86_64</arch>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:   <vcpu max='255'/>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:   <iothreads supported='yes'/>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:   <os supported='yes'>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:     <enum name='firmware'>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:       <value>efi</value>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:     <loader supported='yes'>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:         <value>rom</value>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:         <value>pflash</value>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:       <enum name='readonly'>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:         <value>yes</value>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:       <enum name='secure'>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:     </loader>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:   </os>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:   <cpu>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:     <mode name='host-passthrough' supported='no'/>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:     <mode name='maximum' supported='yes'>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:       <enum name='maximumMigratable'>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:         <value>on</value>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:         <value>off</value>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:     <mode name='host-model' supported='yes'>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:       <model fallback='forbid'>EPYC</model>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:       <vendor>AMD</vendor>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:       <feature policy='require' name='acpi'/>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:       <feature policy='require' name='ss'/>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:       <feature policy='require' name='monitor'/>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:       <feature policy='require' name='hypervisor'/>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:       <feature policy='require' name='erms'/>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:       <feature policy='require' name='mpx'/>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:       <feature policy='require' name='pcommit'/>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:       <feature policy='require' name='clwb'/>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:       <feature policy='require' name='umip'/>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:       <feature policy='require' name='pku'/>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:       <feature policy='require' name='vaes'/>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:       <feature policy='require' name='la57'/>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:       <feature policy='require' name='rdpid'/>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:       <feature policy='require' name='pks'/>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:       <feature policy='require' name='fsrm'/>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:       <feature policy='require' name='fzrm'/>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:       <feature policy='require' name='fsrs'/>
May 28 09:54:56.339429 np0000001613 nova-compute[98321]:       <feature policy='require' name='fsrc'/>
May 28 09:54:56.340430 np0000001613 nova-compute[98321]:       <feature policy='require' name='3dnowext'/>
May 28 09:54:56.340430 np0000001613 nova-compute[98321]:       <feature policy='require' name='3dnow'/>
May 28 09:54:56.340430 np0000001613 nova-compute[98321]:       <feature policy='require' name='xsaveerptr'/>
May 28 09:54:56.340430 np0000001613 nova-compute[98321]:       <feature policy='require' name='wbnoinvd'/>
May 28 09:54:56.340430 np0000001613 nova-compute[98321]:       <feature policy='require' name='npt'/>
May 28 09:54:56.340430 np0000001613 nova-compute[98321]:       <feature policy='require' name='vgif'/>
May 28 09:54:56.340430 np0000001613 nova-compute[98321]:       <feature policy='require' name='svme-addr-chk'/>
May 28 09:54:56.340430 np0000001613 nova-compute[98321]:       <feature policy='disable' name='vme'/>
May 28 09:54:56.340430 np0000001613 nova-compute[98321]:       <feature policy='disable' name='xsavec'/>
May 28 09:54:56.340430 np0000001613 nova-compute[98321]:       <feature policy='disable' name='fxsr_opt'/>
May 28 09:54:56.340430 np0000001613 nova-compute[98321]:       <feature policy='disable' name='misalignsse'/>
May 28 09:54:56.340430 np0000001613 nova-compute[98321]:       <feature policy='disable' name='osvw'/>
May 28 09:54:56.340430 np0000001613 nova-compute[98321]:       <feature policy='disable' name='topoext'/>
May 28 09:54:56.340430 np0000001613 nova-compute[98321]:       <feature policy='disable' name='nrip-save'/>
May 28 09:54:56.340430 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.340430 np0000001613 nova-compute[98321]:     <mode name='custom' supported='yes'>
May 28 09:54:56.340430 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 28 09:54:56.340430 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 28 09:54:56.340430 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>phenom</model>
May 28 09:54:56.340430 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 28 09:54:56.340430 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 28 09:54:56.340430 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>pentium</model>
May 28 09:54:56.340430 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='Intel'>n270</model>
May 28 09:54:56.340430 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 28 09:54:56.340430 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 28 09:54:56.340430 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 28 09:54:56.340430 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 28 09:54:56.340430 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='AMD'>athlon</model>
May 28 09:54:56.340430 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 28 09:54:56.340430 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 28 09:54:56.340430 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 28 09:54:56.340430 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 28 09:54:56.340430 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 28 09:54:56.340430 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 28 09:54:56.340430 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 28 09:54:56.340430 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 28 09:54:56.340430 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 28 09:54:56.341070 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 28 09:54:56.341070 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 28 09:54:56.341070 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 28 09:54:56.341070 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 28 09:54:56.341070 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 28 09:54:56.341070 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 28 09:54:56.341070 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 28 09:54:56.341070 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 28 09:54:56.341070 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 28 09:54:56.341070 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 28 09:54:56.341070 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 28 09:54:56.341070 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 28 09:54:56.341070 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 28 09:54:56.341070 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 28 09:54:56.341070 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 28 09:54:56.341070 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 28 09:54:56.341070 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 28 09:54:56.341070 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 28 09:54:56.341070 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Haswell</model>
May 28 09:54:56.341070 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 28 09:54:56.341070 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 28 09:54:56.341070 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 28 09:54:56.341070 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 28 09:54:56.341070 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>EPYC</model>
May 28 09:54:56.341070 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 28 09:54:56.341070 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 28 09:54:56.341070 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 28 09:54:56.341070 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 28 09:54:56.341070 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 28 09:54:56.341070 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 28 09:54:56.341070 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 28 09:54:56.341070 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 28 09:54:56.341070 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 28 09:54:56.341070 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>486</model>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:   <memoryBacking supported='yes'>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:     <enum name='sourceType'>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:       <value>file</value>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:       <value>anonymous</value>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:       <value>memfd</value>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:   </memoryBacking>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:   <devices>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:     <disk supported='yes'>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:       <enum name='diskDevice'>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:         <value>disk</value>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:         <value>cdrom</value>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:         <value>floppy</value>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:         <value>lun</value>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:         <value>ide</value>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:         <value>fdc</value>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:         <value>sata</value>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:     </disk>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:     <graphics supported='yes'>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:         <value>sdl</value>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:         <value>vnc</value>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:         <value>spice</value>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:         <value>egl-headless</value>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:         <value>dbus</value>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:     </graphics>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:     <video supported='yes'>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:       <enum name='modelType'>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:         <value>vga</value>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:         <value>cirrus</value>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:         <value>vmvga</value>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:         <value>qxl</value>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:         <value>none</value>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:         <value>bochs</value>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:         <value>ramfb</value>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:     </video>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:     <hostdev supported='yes'>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:       <enum name='mode'>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:         <value>subsystem</value>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:       <enum name='startupPolicy'>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:         <value>default</value>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:         <value>mandatory</value>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:         <value>requisite</value>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:         <value>optional</value>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:       <enum name='subsysType'>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:         <value>pci</value>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:       <enum name='capsType'/>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:       <enum name='pciBackend'/>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:     </hostdev>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:     <rng supported='yes'>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.341627 np0000001613 nova-compute[98321]:         <value>random</value>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:         <value>egd</value>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:     </rng>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:     <filesystem supported='yes'>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:       <enum name='driverType'>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:         <value>path</value>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:         <value>handle</value>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:         <value>virtiofs</value>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:     </filesystem>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:     <tpm supported='yes'>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:         <value>tpm-tis</value>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:         <value>tpm-crb</value>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:         <value>passthrough</value>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:         <value>emulator</value>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:         <value>external</value>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:       <enum name='backendVersion'>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:         <value>1.2</value>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:         <value>2.0</value>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:     </tpm>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:     <redirdev supported='yes'>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:     </redirdev>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:     <channel supported='yes'>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:         <value>pty</value>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:         <value>unix</value>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:         <value>spicevmc</value>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:     </channel>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:     <crypto supported='yes'>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:         <value>qemu</value>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:     </crypto>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:   </devices>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:   <features>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:     <gic supported='no'/>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:     <vmcoreinfo supported='yes'/>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:     <genid supported='yes'/>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:     <backingStoreInput supported='yes'/>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:     <backup supported='yes'/>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:     <async-teardown supported='yes'/>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:     <sev supported='no'/>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:     <sgx supported='no'/>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:     <hyperv supported='yes'>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:       <enum name='features'>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:         <value>relaxed</value>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:         <value>vapic</value>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:         <value>spinlocks</value>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:         <value>vpindex</value>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:         <value>runtime</value>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:         <value>synic</value>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:         <value>stimer</value>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:         <value>reset</value>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:         <value>vendor_id</value>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:         <value>frequencies</value>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:         <value>reenlightenment</value>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:         <value>tlbflush</value>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:         <value>ipi</value>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:         <value>avic</value>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:     </hyperv>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]:   </features>
May 28 09:54:56.342930 np0000001613 nova-compute[98321]: </domainCapabilities>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 09:54:56.344386 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
May 28 09:54:56.344386 np0000001613 nova-compute[98321]: <domainCapabilities>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:   <path>/usr/bin/qemu-system-x86_64</path>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:   <domain>qemu</domain>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:   <machine>pc-i440fx-noble</machine>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:   <arch>x86_64</arch>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:   <vcpu max='255'/>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:   <iothreads supported='yes'/>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:   <os supported='yes'>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:     <enum name='firmware'>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:       <value>efi</value>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:     <loader supported='yes'>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:         <value>rom</value>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:         <value>pflash</value>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:       <enum name='readonly'>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:         <value>yes</value>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:       <enum name='secure'>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:     </loader>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:   </os>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:   <cpu>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:     <mode name='host-passthrough' supported='no'/>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:     <mode name='maximum' supported='yes'>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:       <enum name='maximumMigratable'>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:         <value>on</value>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:         <value>off</value>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:     <mode name='host-model' supported='yes'>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:       <model fallback='forbid'>EPYC</model>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:       <vendor>AMD</vendor>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:       <feature policy='require' name='acpi'/>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:       <feature policy='require' name='ss'/>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:       <feature policy='require' name='monitor'/>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:       <feature policy='require' name='hypervisor'/>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:       <feature policy='require' name='erms'/>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:       <feature policy='require' name='mpx'/>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:       <feature policy='require' name='pcommit'/>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:       <feature policy='require' name='clwb'/>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:       <feature policy='require' name='umip'/>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:       <feature policy='require' name='pku'/>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:       <feature policy='require' name='vaes'/>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:       <feature policy='require' name='la57'/>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:       <feature policy='require' name='rdpid'/>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:       <feature policy='require' name='pks'/>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:       <feature policy='require' name='fsrm'/>
May 28 09:54:56.344386 np0000001613 nova-compute[98321]:       <feature policy='require' name='fzrm'/>
May 28 09:54:56.345345 np0000001613 nova-compute[98321]:       <feature policy='require' name='fsrs'/>
May 28 09:54:56.345345 np0000001613 nova-compute[98321]:       <feature policy='require' name='fsrc'/>
May 28 09:54:56.345345 np0000001613 nova-compute[98321]:       <feature policy='require' name='3dnowext'/>
May 28 09:54:56.345345 np0000001613 nova-compute[98321]:       <feature policy='require' name='3dnow'/>
May 28 09:54:56.345345 np0000001613 nova-compute[98321]:       <feature policy='require' name='xsaveerptr'/>
May 28 09:54:56.345345 np0000001613 nova-compute[98321]:       <feature policy='require' name='wbnoinvd'/>
May 28 09:54:56.345345 np0000001613 nova-compute[98321]:       <feature policy='require' name='npt'/>
May 28 09:54:56.345345 np0000001613 nova-compute[98321]:       <feature policy='require' name='vgif'/>
May 28 09:54:56.345345 np0000001613 nova-compute[98321]:       <feature policy='require' name='svme-addr-chk'/>
May 28 09:54:56.345345 np0000001613 nova-compute[98321]:       <feature policy='disable' name='vme'/>
May 28 09:54:56.345345 np0000001613 nova-compute[98321]:       <feature policy='disable' name='xsavec'/>
May 28 09:54:56.345345 np0000001613 nova-compute[98321]:       <feature policy='disable' name='fxsr_opt'/>
May 28 09:54:56.345345 np0000001613 nova-compute[98321]:       <feature policy='disable' name='misalignsse'/>
May 28 09:54:56.345345 np0000001613 nova-compute[98321]:       <feature policy='disable' name='osvw'/>
May 28 09:54:56.345345 np0000001613 nova-compute[98321]:       <feature policy='disable' name='topoext'/>
May 28 09:54:56.345345 np0000001613 nova-compute[98321]:       <feature policy='disable' name='nrip-save'/>
May 28 09:54:56.345345 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.345345 np0000001613 nova-compute[98321]:     <mode name='custom' supported='yes'>
May 28 09:54:56.345345 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 28 09:54:56.345345 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 28 09:54:56.345345 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>phenom</model>
May 28 09:54:56.345345 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 28 09:54:56.345345 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 28 09:54:56.345345 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>pentium</model>
May 28 09:54:56.345345 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='Intel'>n270</model>
May 28 09:54:56.345345 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 28 09:54:56.345345 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 28 09:54:56.345345 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 28 09:54:56.345345 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 28 09:54:56.345345 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='AMD'>athlon</model>
May 28 09:54:56.345345 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 28 09:54:56.345345 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 28 09:54:56.345345 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 28 09:54:56.345345 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 28 09:54:56.345345 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 28 09:54:56.345345 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 28 09:54:56.345345 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 28 09:54:56.345345 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 28 09:54:56.346008 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 28 09:54:56.346008 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 28 09:54:56.346008 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 28 09:54:56.346008 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 28 09:54:56.346008 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 28 09:54:56.346008 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 28 09:54:56.346008 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 28 09:54:56.346008 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 28 09:54:56.346008 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 28 09:54:56.346008 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 28 09:54:56.346008 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 28 09:54:56.346008 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 28 09:54:56.346008 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 28 09:54:56.346008 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 28 09:54:56.346008 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 28 09:54:56.346008 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 28 09:54:56.346008 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 28 09:54:56.346008 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 28 09:54:56.346008 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 28 09:54:56.346008 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Haswell</model>
May 28 09:54:56.346008 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 28 09:54:56.346008 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 28 09:54:56.346008 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 28 09:54:56.346008 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 28 09:54:56.346008 np0000001613 nova-compute[98321]:       <model usable='no' vendor='AMD'>EPYC</model>
May 28 09:54:56.346008 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 28 09:54:56.346008 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 28 09:54:56.346008 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 28 09:54:56.346008 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 28 09:54:56.346008 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 28 09:54:56.346008 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 28 09:54:56.346008 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 28 09:54:56.346008 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 28 09:54:56.346008 np0000001613 nova-compute[98321]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:       <model usable='yes' vendor='unknown'>486</model>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:     </mode>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:   <memoryBacking supported='yes'>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:     <enum name='sourceType'>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:       <value>file</value>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:       <value>anonymous</value>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:       <value>memfd</value>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:   </memoryBacking>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:   <devices>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:     <disk supported='yes'>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:       <enum name='diskDevice'>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:         <value>disk</value>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:         <value>cdrom</value>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:         <value>floppy</value>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:         <value>lun</value>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:         <value>ide</value>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:         <value>fdc</value>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:         <value>sata</value>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:     </disk>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:     <graphics supported='yes'>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:         <value>sdl</value>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:         <value>vnc</value>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:         <value>spice</value>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:         <value>egl-headless</value>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:         <value>dbus</value>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:     </graphics>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:     <video supported='yes'>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:       <enum name='modelType'>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:         <value>vga</value>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:         <value>cirrus</value>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:         <value>vmvga</value>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:         <value>qxl</value>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:         <value>none</value>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:         <value>bochs</value>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:         <value>ramfb</value>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:     </video>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:     <hostdev supported='yes'>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:       <enum name='mode'>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:         <value>subsystem</value>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:       <enum name='startupPolicy'>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:         <value>default</value>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:         <value>mandatory</value>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:         <value>requisite</value>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:         <value>optional</value>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:       <enum name='subsysType'>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:         <value>pci</value>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:       <enum name='capsType'/>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:       <enum name='pciBackend'/>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:     </hostdev>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:     <rng supported='yes'>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.346561 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:         <value>random</value>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:         <value>egd</value>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:     </rng>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:     <filesystem supported='yes'>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:       <enum name='driverType'>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:         <value>path</value>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:         <value>handle</value>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:         <value>virtiofs</value>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:     </filesystem>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:     <tpm supported='yes'>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:         <value>tpm-tis</value>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:         <value>tpm-crb</value>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:         <value>passthrough</value>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:         <value>emulator</value>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:         <value>external</value>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:       <enum name='backendVersion'>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:         <value>1.2</value>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:         <value>2.0</value>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:     </tpm>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:     <redirdev supported='yes'>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:     </redirdev>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:     <channel supported='yes'>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:         <value>pty</value>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:         <value>unix</value>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:         <value>spicevmc</value>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:     </channel>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:     <crypto supported='yes'>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:         <value>qemu</value>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:     </crypto>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:   </devices>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:   <features>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:     <gic supported='no'/>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:     <vmcoreinfo supported='yes'/>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:     <genid supported='yes'/>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:     <backingStoreInput supported='yes'/>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:     <backup supported='yes'/>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:     <async-teardown supported='yes'/>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:     <sev supported='no'/>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:     <sgx supported='no'/>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:     <hyperv supported='yes'>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:       <enum name='features'>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:         <value>relaxed</value>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:         <value>vapic</value>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:         <value>spinlocks</value>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:         <value>vpindex</value>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:         <value>runtime</value>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:         <value>synic</value>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:         <value>stimer</value>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:         <value>reset</value>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:         <value>vendor_id</value>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:         <value>frequencies</value>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:         <value>reenlightenment</value>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:         <value>tlbflush</value>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:         <value>ipi</value>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:         <value>avic</value>
May 28 09:54:56.347969 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:     </hyperv>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:   </features>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]: </domainCapabilities>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 09:54:56.349319 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=98321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 09:54:56.349319 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Libvirt host hypervisor capabilities for arch=xtensa and machine_type=None:
May 28 09:54:56.349319 np0000001613 nova-compute[98321]: <domainCapabilities>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:   <path>/usr/bin/qemu-system-xtensa</path>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:   <domain>qemu</domain>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:   <machine>sim</machine>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:   <arch>xtensa</arch>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:   <vcpu max='4'/>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:   <iothreads supported='yes'/>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:   <os supported='yes'>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:     <enum name='firmware'/>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:     <loader supported='yes'>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:         <value>rom</value>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:         <value>pflash</value>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:       <enum name='readonly'>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:         <value>yes</value>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:       <enum name='secure'>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:     </loader>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:   </os>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:   <cpu>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:     <mode name='host-passthrough' supported='no'/>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:     <mode name='maximum' supported='no'/>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:     <mode name='host-model' supported='no'/>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:     <mode name='custom' supported='no'/>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:   <memoryBacking supported='yes'>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:     <enum name='sourceType'>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:       <value>file</value>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:       <value>anonymous</value>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:       <value>memfd</value>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:   </memoryBacking>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:   <devices>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:     <disk supported='yes'>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:       <enum name='diskDevice'>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:         <value>disk</value>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:         <value>cdrom</value>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:         <value>floppy</value>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:         <value>lun</value>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:         <value>fdc</value>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:         <value>sata</value>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.349319 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:     </disk>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:     <graphics supported='yes'>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:         <value>sdl</value>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:         <value>vnc</value>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:         <value>spice</value>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:         <value>egl-headless</value>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:         <value>dbus</value>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:     </graphics>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:     <video supported='yes'>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:       <enum name='modelType'>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:         <value>vga</value>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:         <value>cirrus</value>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:         <value>none</value>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:         <value>bochs</value>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:     </video>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:     <hostdev supported='yes'>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:       <enum name='mode'>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:         <value>subsystem</value>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:       <enum name='startupPolicy'>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:         <value>default</value>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:         <value>mandatory</value>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:         <value>requisite</value>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:         <value>optional</value>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:       <enum name='subsysType'>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:         <value>pci</value>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:       <enum name='capsType'/>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:       <enum name='pciBackend'/>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:     </hostdev>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:     <rng supported='yes'>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:         <value>random</value>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:         <value>egd</value>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:     </rng>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:     <filesystem supported='yes'>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:       <enum name='driverType'>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:         <value>path</value>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:         <value>handle</value>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:         <value>virtiofs</value>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:     </filesystem>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:     <tpm supported='no'/>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:     <redirdev supported='yes'>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:     </redirdev>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:     <channel supported='yes'>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:         <value>pty</value>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:         <value>unix</value>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:         <value>spicevmc</value>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:     </channel>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:     <crypto supported='yes'>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.350361 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:         <value>qemu</value>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:     </crypto>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:   </devices>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:   <features>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:     <gic supported='no'/>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:     <vmcoreinfo supported='no'/>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:     <genid supported='no'/>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:     <backingStoreInput supported='yes'/>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:     <backup supported='yes'/>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:     <async-teardown supported='yes'/>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:     <sev supported='no'/>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:     <sgx supported='no'/>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:   </features>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]: </domainCapabilities>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 09:54:56.351667 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=98321) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 09:54:56.351667 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Libvirt host hypervisor capabilities for arch=xtensaeb and machine_type=None:
May 28 09:54:56.351667 np0000001613 nova-compute[98321]: <domainCapabilities>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:   <path>/usr/bin/qemu-system-xtensaeb</path>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:   <domain>qemu</domain>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:   <machine>sim</machine>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:   <arch>xtensaeb</arch>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:   <vcpu max='4'/>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:   <iothreads supported='yes'/>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:   <os supported='yes'>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:     <enum name='firmware'/>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:     <loader supported='yes'>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:         <value>rom</value>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:         <value>pflash</value>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:       <enum name='readonly'>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:         <value>yes</value>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:       <enum name='secure'>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:         <value>no</value>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:     </loader>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:   </os>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:   <cpu>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:     <mode name='host-passthrough' supported='no'/>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:     <mode name='maximum' supported='no'/>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:     <mode name='host-model' supported='no'/>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:     <mode name='custom' supported='no'/>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:   <memoryBacking supported='yes'>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:     <enum name='sourceType'>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:       <value>file</value>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:       <value>anonymous</value>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:       <value>memfd</value>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:     </enum>
May 28 09:54:56.351667 np0000001613 nova-compute[98321]:   </memoryBacking>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:   <devices>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:     <disk supported='yes'>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:       <enum name='diskDevice'>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:         <value>disk</value>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:         <value>cdrom</value>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:         <value>floppy</value>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:         <value>lun</value>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:         <value>fdc</value>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:         <value>sata</value>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:     </disk>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:     <graphics supported='yes'>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:         <value>sdl</value>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:         <value>vnc</value>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:         <value>spice</value>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:         <value>egl-headless</value>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:         <value>dbus</value>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:     </graphics>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:     <video supported='yes'>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:       <enum name='modelType'>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:         <value>vga</value>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:         <value>cirrus</value>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:         <value>none</value>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:         <value>bochs</value>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:     </video>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:     <hostdev supported='yes'>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:       <enum name='mode'>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:         <value>subsystem</value>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:       <enum name='startupPolicy'>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:         <value>default</value>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:         <value>mandatory</value>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:         <value>requisite</value>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:         <value>optional</value>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:       <enum name='subsysType'>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:         <value>pci</value>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:         <value>scsi</value>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:       <enum name='capsType'/>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:       <enum name='pciBackend'/>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:     </hostdev>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:     <rng supported='yes'>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:         <value>virtio-transitional</value>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:         <value>virtio-non-transitional</value>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:         <value>random</value>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:         <value>egd</value>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:     </rng>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:     <filesystem supported='yes'>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:       <enum name='driverType'>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:         <value>path</value>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:         <value>handle</value>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:         <value>virtiofs</value>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:     </filesystem>
May 28 09:54:56.352657 np0000001613 nova-compute[98321]:     <tpm supported='no'/>
May 28 09:54:56.354062 np0000001613 nova-compute[98321]:     <redirdev supported='yes'>
May 28 09:54:56.354062 np0000001613 nova-compute[98321]:       <enum name='bus'>
May 28 09:54:56.354062 np0000001613 nova-compute[98321]:         <value>usb</value>
May 28 09:54:56.354062 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.354062 np0000001613 nova-compute[98321]:     </redirdev>
May 28 09:54:56.354062 np0000001613 nova-compute[98321]:     <channel supported='yes'>
May 28 09:54:56.354062 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.354062 np0000001613 nova-compute[98321]:         <value>pty</value>
May 28 09:54:56.354062 np0000001613 nova-compute[98321]:         <value>unix</value>
May 28 09:54:56.354062 np0000001613 nova-compute[98321]:         <value>spicevmc</value>
May 28 09:54:56.354062 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.354062 np0000001613 nova-compute[98321]:     </channel>
May 28 09:54:56.354062 np0000001613 nova-compute[98321]:     <crypto supported='yes'>
May 28 09:54:56.354062 np0000001613 nova-compute[98321]:       <enum name='model'>
May 28 09:54:56.354062 np0000001613 nova-compute[98321]:         <value>virtio</value>
May 28 09:54:56.354062 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.354062 np0000001613 nova-compute[98321]:       <enum name='type'>
May 28 09:54:56.354062 np0000001613 nova-compute[98321]:         <value>qemu</value>
May 28 09:54:56.354062 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.354062 np0000001613 nova-compute[98321]:       <enum name='backendModel'>
May 28 09:54:56.354062 np0000001613 nova-compute[98321]:         <value>builtin</value>
May 28 09:54:56.354062 np0000001613 nova-compute[98321]:       </enum>
May 28 09:54:56.354062 np0000001613 nova-compute[98321]:     </crypto>
May 28 09:54:56.354062 np0000001613 nova-compute[98321]:   </devices>
May 28 09:54:56.354062 np0000001613 nova-compute[98321]:   <features>
May 28 09:54:56.354062 np0000001613 nova-compute[98321]:     <gic supported='no'/>
May 28 09:54:56.354062 np0000001613 nova-compute[98321]:     <vmcoreinfo supported='no'/>
May 28 09:54:56.354062 np0000001613 nova-compute[98321]:     <genid supported='no'/>
May 28 09:54:56.354062 np0000001613 nova-compute[98321]:     <backingStoreInput supported='yes'/>
May 28 09:54:56.354062 np0000001613 nova-compute[98321]:     <backup supported='yes'/>
May 28 09:54:56.354062 np0000001613 nova-compute[98321]:     <async-teardown supported='yes'/>
May 28 09:54:56.354062 np0000001613 nova-compute[98321]:     <sev supported='no'/>
May 28 09:54:56.354062 np0000001613 nova-compute[98321]:     <sgx supported='no'/>
May 28 09:54:56.354062 np0000001613 nova-compute[98321]:   </features>
May 28 09:54:56.354062 np0000001613 nova-compute[98321]: </domainCapabilities>
May 28 09:54:56.354062 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 09:54:56.354062 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Checking secure boot support for host arch (x86_64) {{(pid=98321) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1962}}
May 28 09:54:56.354062 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Secure Boot support detected
May 28 09:54:56.812494 np0000001613 nova-compute[98321]: INFO nova.virt.node [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Generated node identity ad4de091-3626-4008-ac9a-3e83de44a510
May 28 09:54:56.812621 np0000001613 nova-compute[98321]: INFO nova.virt.node [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Wrote node identity ad4de091-3626-4008-ac9a-3e83de44a510 to /opt/stack/data/nova/compute_id
May 28 09:54:57.315093 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Compute nodes ['ad4de091-3626-4008-ac9a-3e83de44a510'] for host np0000001613 were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
May 28 09:54:58.319231 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
May 28 09:54:59.323558 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [None req-92870608-b483-42b4-9a19-b22bba316aad None None] No compute node record found for host np0000001613. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000001613 could not be found.
May 28 09:54:59.323898 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:54:59.323898 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:54:59.323968 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:54:59.324077 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Auditing locally available compute resources for np0000001613 (node: np0000001613) {{(pid=98321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 09:54:59.383094 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-92870608-b483-42b4-9a19-b22bba316aad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 09:54:59.384138 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:54:59.398906 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-92870608-b483-42b4-9a19-b22bba316aad None None] CMD "env LANG=C uptime" returned: 0 in 0.014s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:54:59.399343 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Hypervisor/Node resource view: name=np0000001613 free_ram=16502MB free_disk=75.17697525024414GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 09:54:59.399530 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:54:59.399859 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:54:59.904031 np0000001613 nova-compute[98321]: WARNING nova.compute.resource_tracker [None req-92870608-b483-42b4-9a19-b22bba316aad None None] No compute node record for np0000001613:ad4de091-3626-4008-ac9a-3e83de44a510: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host ad4de091-3626-4008-ac9a-3e83de44a510 could not be found.
May 28 09:55:00.408284 np0000001613 nova-compute[98321]: INFO nova.compute.resource_tracker [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Compute node record created for np0000001613:np0000001613 with uuid: ad4de091-3626-4008-ac9a-3e83de44a510
May 28 09:55:01.915930 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 09:55:01.916247 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Final resource view: name=np0000001613 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 09:54:59 up 27 min,  2 users,  load average: 2.33, 1.34, 0.68\n'} {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 09:55:02.411092 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-92870608-b483-42b4-9a19-b22bba316aad None None] [req-9d4b9f51-2c73-4db1-88fe-01869dfe0662] Created resource provider record via placement API for resource provider with UUID ad4de091-3626-4008-ac9a-3e83de44a510 and name np0000001613.
May 28 09:55:02.468770 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] /sys/module/kvm_amd/parameters/sev contains [N
May 28 09:55:02.468770 np0000001613 nova-compute[98321]: ] {{(pid=98321) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:2038}}
May 28 09:55:02.468953 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.host [None req-92870608-b483-42b4-9a19-b22bba316aad None None] kernel doesn't support AMD SEV
May 28 09:55:02.469050 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 09:55:02.469221 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Updating inventory in ProviderTree for provider ad4de091-3626-4008-ac9a-3e83de44a510 with inventory: {'MEMORY_MB': {'total': 24030, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 28 09:55:02.469457 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-92870608-b483-42b4-9a19-b22bba316aad None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 09:55:02.472962 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Libvirt baseline CPU <cpu>
May 28 09:55:02.472962 np0000001613 nova-compute[98321]:   <arch>x86_64</arch>
May 28 09:55:02.472962 np0000001613 nova-compute[98321]:   <model>Nehalem</model>
May 28 09:55:02.472962 np0000001613 nova-compute[98321]:   <vendor>AMD</vendor>
May 28 09:55:02.472962 np0000001613 nova-compute[98321]:   <topology sockets="12" cores="1" threads="1"/>
May 28 09:55:02.472962 np0000001613 nova-compute[98321]:   <maxphysaddr mode="emulate" bits="40"/>
May 28 09:55:02.472962 np0000001613 nova-compute[98321]: </cpu>
May 28 09:55:02.472962 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:13740}}
May 28 09:55:03.036710 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Updated inventory for provider ad4de091-3626-4008-ac9a-3e83de44a510 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 24030, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:975}}
May 28 09:55:03.037203 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Updating resource provider ad4de091-3626-4008-ac9a-3e83de44a510 generation from 0 to 1 during operation: update_inventory {{(pid=98321) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
May 28 09:55:03.037203 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Updating inventory in ProviderTree for provider ad4de091-3626-4008-ac9a-3e83de44a510 with inventory: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 28 09:55:03.169632 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Updating resource provider ad4de091-3626-4008-ac9a-3e83de44a510 generation from 1 to 2 during operation: update_traits {{(pid=98321) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
May 28 09:55:03.676250 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Compute_service record updated for np0000001613:np0000001613 {{(pid=98321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 09:55:03.676433 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 4.277s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:55:03.676609 np0000001613 nova-compute[98321]: DEBUG nova.service [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Creating RPC server for service: nova-compute on topic: compute {{(pid=98321) start /opt/stack/nova/nova/service.py:195}}
May 28 09:55:03.692298 np0000001613 nova-compute[98321]: DEBUG nova.service [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Creating 2nd RPC server for service: nova-compute on topic: compute-alt {{(pid=98321) start /opt/stack/nova/nova/service.py:211}}
May 28 09:55:03.709017 np0000001613 nova-compute[98321]: DEBUG nova.service [None req-92870608-b483-42b4-9a19-b22bba316aad None None] Join ServiceGroup membership for this service compute {{(pid=98321) start /opt/stack/nova/nova/service.py:221}}
May 28 09:55:03.709355 np0000001613 nova-compute[98321]: DEBUG nova.servicegroup.drivers.db [None req-92870608-b483-42b4-9a19-b22bba316aad None None] DB_Driver: join new ServiceGroup member np0000001613 to the compute group, service = <Service: host=np0000001613, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=98321) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
May 28 09:55:09.212725 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 09:55:36.711111 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._sync_power_states {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:55:37.213984 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:55:37.214825 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.58 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 09:55:42.792399 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:55:42.792880 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:55:42.793012 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:55:42.793250 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:55:42.793466 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:55:42.793656 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:55:42.793860 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:55:42.793992 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 09:55:42.794194 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:55:43.297397 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:55:43.297548 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:55:43.297586 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:55:43.297722 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Auditing locally available compute resources for np0000001613 (node: np0000001613) {{(pid=98321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 09:55:43.305462 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 09:55:43.306160 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:55:43.320004 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "env LANG=C uptime" returned: 0 in 0.014s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:55:43.320457 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Hypervisor/Node resource view: name=np0000001613 free_ram=16276MB free_disk=75.05690383911133GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 09:55:43.320611 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:55:43.320795 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:55:44.370303 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 09:55:44.370855 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Final resource view: name=np0000001613 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 09:55:43 up 27 min,  2 users,  load average: 1.82, 1.34, 0.71\n'} {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 09:55:44.415054 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 09:55:44.415257 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 09:55:44.917940 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 09:55:45.424254 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Compute_service record updated for np0000001613:np0000001613 {{(pid=98321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 09:55:45.425296 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.104s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:55:45.425296 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 59.99 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 09:56:45.420148 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:56:45.420803 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:56:45.420803 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:56:45.421001 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:56:45.421259 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:56:45.421497 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:56:45.421743 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:56:45.422002 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:56:45.422235 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 09:56:45.422672 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:56:45.927062 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:56:45.927062 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:56:45.927062 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:56:45.927062 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Auditing locally available compute resources for np0000001613 (node: np0000001613) {{(pid=98321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 09:56:45.935928 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 09:56:45.935928 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:56:45.954093 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "env LANG=C uptime" returned: 0 in 0.018s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:56:45.956392 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Hypervisor/Node resource view: name=np0000001613 free_ram=16383MB free_disk=74.86238479614258GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 09:56:45.956392 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:56:45.956616 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:56:47.021376 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 09:56:47.021773 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Final resource view: name=np0000001613 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 09:56:45 up 28 min,  2 users,  load average: 1.10, 1.24, 0.72\n'} {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 09:56:47.072413 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 09:56:47.072624 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 09:56:47.575251 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 09:56:48.080600 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Compute_service record updated for np0000001613:np0000001613 {{(pid=98321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 09:56:48.081123 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.126s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:56:48.081236 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 09:57:09.215298 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 09:57:29.148317 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "289e2914-2be4-4f46-92e0-fa623f8db861" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:29.149081 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "289e2914-2be4-4f46-92e0-fa623f8db861" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:29.651418 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 09:57:30.259636 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:30.260151 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:30.263553 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 09:57:30.264060 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Claim successful on node np0000001613
May 28 09:57:30.523548 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:30.523832 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:30.799935 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "53ad56cc-eb5b-4e2e-a421-e93deee27fe7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:30.800094 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "53ad56cc-eb5b-4e2e-a421-e93deee27fe7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:31.025870 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 09:57:31.305783 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 09:57:31.515357 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 09:57:31.516419 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 09:57:31.599225 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:31.867035 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:32.019049 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 09:57:32.069111 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Acquiring lock "e2856743-3a60-4be1-b29c-b4de06f14783" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:32.069433 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lock "e2856743-3a60-4be1-b29c-b4de06f14783" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:32.528067 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.268s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:32.528895 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 09:57:32.533836 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.935s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:32.539639 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 09:57:32.539852 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Claim successful on node np0000001613
May 28 09:57:32.570991 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 09:57:33.038143 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 09:57:33.038345 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 09:57:33.039291 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:33.040682 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:33.149129 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:33.546937 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 09:57:33.654674 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '51981c995f2246588f2d58f35be5848a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d04b105229456d9ab53df1886fdb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 09:57:33.835436 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 09:57:33.836067 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 09:57:34.054214 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 09:57:34.340731 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 09:57:34.663367 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Successfully created port: 1aadd54c-ea47-43c1-86e2-da7dc2eb0a49 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 09:57:34.847324 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.314s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:34.848056 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 09:57:34.850951 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.984s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:34.856848 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 09:57:34.856848 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Claim successful on node np0000001613
May 28 09:57:35.064184 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 09:57:35.064184 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 09:57:35.064184 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Creating image(s)
May 28 09:57:35.064184 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "/opt/stack/data/nova/instances/289e2914-2be4-4f46-92e0-fa623f8db861/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:35.064636 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "/opt/stack/data/nova/instances/289e2914-2be4-4f46-92e0-fa623f8db861/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:35.065341 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "/opt/stack/data/nova/instances/289e2914-2be4-4f46-92e0-fa623f8db861/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:35.065873 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:35.066695 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:35.355029 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 09:57:35.355157 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 09:57:35.355779 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:35.355970 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:35.417489 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:57:35.420429 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:57:35.420765 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9.part --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:35.480649 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9.part --force-share --output=json" returned: 0 in 0.060s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:35.481259 np0000001613 nova-compute[98321]: DEBUG nova.virt.images [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] a913bae7-5d99-49fe-9222-68cf52a5f9bb was qcow2, converting to raw {{(pid=98321) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 09:57:35.481910 np0000001613 nova-compute[98321]: DEBUG nova.privsep.utils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98321) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 09:57:35.482225 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9.part /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9.converted {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:35.593581 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '62efa57da85f458790f3ceeebcc777a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3a501b4f4041ef875ef4d2b4167044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 09:57:35.644600 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9.part /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9.converted" returned: 0 in 0.162s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:35.650298 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9.converted --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:35.722005 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9.converted --force-share --output=json" returned: 0 in 0.072s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:35.722889 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.656s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:35.723470 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:57:35.727934 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:57:35.728979 np0000001613 nova-compute[98321]: INFO oslo.privsep.daemon [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpwceiodb4/privsep.sock']
May 28 09:57:35.736884 np0000001613 sudo[109840]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpwceiodb4/privsep.sock
May 28 09:57:35.738064 np0000001613 sudo[109840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 28 09:57:35.753641 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Successfully updated port: 1aadd54c-ea47-43c1-86e2-da7dc2eb0a49 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 09:57:35.859700 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 09:57:36.052324 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 28 09:57:36.052506 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 28 09:57:36.052506 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 28 09:57:36.052660 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 09:57:36.052660 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 28 09:57:36.052744 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 28 09:57:36.052785 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 28 09:57:36.052830 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 09:57:36.052885 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 28 09:57:36.206529 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 09:57:36.206827 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 09:57:36.257562 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "refresh_cache-289e2914-2be4-4f46-92e0-fa623f8db861" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:57:36.257689 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquired lock "refresh_cache-289e2914-2be4-4f46-92e0-fa623f8db861" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:57:36.258045 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 09:57:36.362412 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 09:57:36.435325 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 28 09:57:36.435508 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 28 09:57:36.435508 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 28 09:57:36.435508 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 09:57:36.435638 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 28 09:57:36.435638 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 28 09:57:36.435849 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 28 09:57:36.435849 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 09:57:36.435927 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 28 09:57:36.710808 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 09:57:36.738482 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Acquiring lock "92fbf243-1c5b-47f6-9317-3fb2655651db" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:36.738942 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Lock "92fbf243-1c5b-47f6-9317-3fb2655651db" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:36.760798 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Successfully created port: 0ed2dfa0-2fb5-4493-91e8-597b70a39c6b {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 09:57:36.758496 np0000001613 sudo[109840]: pam_unix(sudo:session): session closed for user root
May 28 09:57:36.764259 np0000001613 nova-compute[98321]: INFO oslo.privsep.daemon [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Spawned new privsep daemon via rootwrap
May 28 09:57:36.778337 np0000001613 nova-compute[98321]: INFO oslo.privsep.daemon [-] privsep daemon starting
May 28 09:57:36.778438 np0000001613 nova-compute[98321]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
May 28 09:57:36.778570 np0000001613 nova-compute[98321]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
May 28 09:57:36.783301 np0000001613 nova-compute[98321]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 109873
May 28 09:57:36.840853 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:36.896386 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 09:57:36.904348 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f5aff88a-7e3a-469c-ac59-0aeb87182e08 req-9b78f736-c295-4802-8a72-35103f612ec8 service nova] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Received event network-changed-1aadd54c-ea47-43c1-86e2-da7dc2eb0a49 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:57:36.904512 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f5aff88a-7e3a-469c-ac59-0aeb87182e08 req-9b78f736-c295-4802-8a72-35103f612ec8 service nova] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Refreshing instance network info cache due to event network-changed-1aadd54c-ea47-43c1-86e2-da7dc2eb0a49. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 09:57:36.904720 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f5aff88a-7e3a-469c-ac59-0aeb87182e08 req-9b78f736-c295-4802-8a72-35103f612ec8 service nova] Acquiring lock "refresh_cache-289e2914-2be4-4f46-92e0-fa623f8db861" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:57:36.934622 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.092s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:36.934622 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:36.934622 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:36.934622 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:57:36.936878 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:57:36.937173 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:37.008129 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.071s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:37.011884 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/289e2914-2be4-4f46-92e0-fa623f8db861/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:37.060889 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/289e2914-2be4-4f46-92e0-fa623f8db861/disk 1073741824" returned: 0 in 0.052s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:37.061425 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.128s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:37.061853 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:37.127930 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.066s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:37.128331 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Checking if we can resize image /opt/stack/data/nova/instances/289e2914-2be4-4f46-92e0-fa623f8db861/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 09:57:37.128542 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/289e2914-2be4-4f46-92e0-fa623f8db861/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:37.197432 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:37.199029 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/289e2914-2be4-4f46-92e0-fa623f8db861/disk --force-share --output=json" returned: 0 in 0.070s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:37.199544 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Cannot resize image /opt/stack/data/nova/instances/289e2914-2be4-4f46-92e0-fa623f8db861/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 09:57:37.200222 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 09:57:37.201140 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Ensure instance console log exists: /opt/stack/data/nova/instances/289e2914-2be4-4f46-92e0-fa623f8db861/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 09:57:37.201140 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:37.201140 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:37.201362 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:37.218458 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.367s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:37.218458 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 09:57:37.221492 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 4.073s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:37.227020 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 09:57:37.227808 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Claim successful on node np0000001613
May 28 09:57:37.240938 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 09:57:37.377844 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 09:57:37.379822 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 09:57:37.382507 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Updating instance_info_cache with network_info: [{"id": "1aadd54c-ea47-43c1-86e2-da7dc2eb0a49", "address": "fa:16:3e:95:8b:d3", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aadd54c-ea", "ovs_interfaceid": "1aadd54c-ea47-43c1-86e2-da7dc2eb0a49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:57:37.385896 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Creating image(s)
May 28 09:57:37.385896 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "/opt/stack/data/nova/instances/e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:37.385896 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "/opt/stack/data/nova/instances/e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:37.386732 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "/opt/stack/data/nova/instances/e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:37.387259 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:57:37.390639 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:57:37.394745 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:37.465697 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.071s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:37.466223 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:37.466792 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:37.468111 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:57:37.471039 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:57:37.471424 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:37.492773 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Acquiring lock "49ff17d1-cad9-463e-b5c1-3315c52412e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:37.493028 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Lock "49ff17d1-cad9-463e-b5c1-3315c52412e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:37.546963 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.075s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:37.547907 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:37.602992 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047/disk 1073741824" returned: 0 in 0.055s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:37.603399 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.137s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:37.603809 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:37.674643 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.070s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:37.675040 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 09:57:37.675331 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:37.728209 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 09:57:37.735971 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Successfully updated port: 0ed2dfa0-2fb5-4493-91e8-597b70a39c6b {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 09:57:37.742056 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 09:57:37.742566 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:37.743460 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:37.750763 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047/disk --force-share --output=json" returned: 0 in 0.075s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:37.754861 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Cannot resize image /opt/stack/data/nova/instances/e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 09:57:37.760656 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 09:57:37.760656 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Ensure instance console log exists: /opt/stack/data/nova/instances/e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 09:57:37.760656 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:37.760656 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:37.760656 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:37.820314 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:37.853815 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9297977bbf334232a4a74bd6808b863b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a85ba31f98b45b6974118c6560bbc53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 09:57:37.886422 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Releasing lock "refresh_cache-289e2914-2be4-4f46-92e0-fa623f8db861" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:57:37.886832 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Instance network_info: |[{"id": "1aadd54c-ea47-43c1-86e2-da7dc2eb0a49", "address": "fa:16:3e:95:8b:d3", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aadd54c-ea", "ovs_interfaceid": "1aadd54c-ea47-43c1-86e2-da7dc2eb0a49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 09:57:37.889386 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f5aff88a-7e3a-469c-ac59-0aeb87182e08 req-9b78f736-c295-4802-8a72-35103f612ec8 service nova] Acquired lock "refresh_cache-289e2914-2be4-4f46-92e0-fa623f8db861" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:57:37.889939 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Start _get_guest_xml network_info=[{"id": "1aadd54c-ea47-43c1-86e2-da7dc2eb0a49", "address": "fa:16:3e:95:8b:d3", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aadd54c-ea", "ovs_interfaceid": "1aadd54c-ea47-43c1-86e2-da7dc2eb0a49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 09:57:37.891914 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-f5aff88a-7e3a-469c-ac59-0aeb87182e08 req-9b78f736-c295-4802-8a72-35103f612ec8 service nova] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Refreshing network info cache for port 1aadd54c-ea47-43c1-86e2-da7dc2eb0a49 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 09:57:37.894068 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 09:57:37.901998 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1280721083', uuid='289e2914-2be4-4f46-92e0-fa623f8db861'), owner=OwnerMeta(userid='51981c995f2246588f2d58f35be5848a', username='tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member', projectid='a9d04b105229456d9ab53df1886fdb37', projectname='tempest-ServerBootFromVolumeStableRescueTest-283762505'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1aadd54c-ea47-43c1-86e2-da7dc2eb0a49", "address": "fa:16:3e:95:8b:d3", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aadd54c-ea", "ovs_interfaceid": "1aadd54c-ea47-43c1-86e2-da7dc2eb0a49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962257.8954995) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 09:57:37.902814 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 09:57:37.903215 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 09:57:37.903943 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 09:57:37.904042 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 09:57:37.905335 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 09:57:37.905655 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 09:57:37.905828 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 09:57:37.905881 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 09:57:37.905997 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 09:57:37.906079 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 09:57:37.906438 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 09:57:37.906438 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 09:57:37.906438 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 09:57:37.906732 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 09:57:37.906975 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 09:57:37.907021 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 09:57:37.922782 np0000001613 nova-compute[98321]: DEBUG nova.privsep.utils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98321) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 09:57:37.923670 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T09:57:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1280721083',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serverbootfromvolumestablerescuetest-server-1280721083',id=1,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9d04b105229456d9ab53df1886fdb37',ramdisk_id='',reservation_id='r-3a0ld0bo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-283762505',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:57:34Z,user_data=None,user_id='51981c995f2246588f2d58f35be5848a',uuid=289e2914-2be4-4f46-92e0-fa623f8db861,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1aadd54c-ea47-43c1-86e2-da7dc2eb0a49", "address": "fa:16:3e:95:8b:d3", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aadd54c-ea", "ovs_interfaceid": "1aadd54c-ea47-43c1-86e2-da7dc2eb0a49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 09:57:37.923880 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Converting VIF {"id": "1aadd54c-ea47-43c1-86e2-da7dc2eb0a49", "address": "fa:16:3e:95:8b:d3", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aadd54c-ea", "ovs_interfaceid": "1aadd54c-ea47-43c1-86e2-da7dc2eb0a49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:57:37.924794 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:8b:d3,bridge_name='br-int',has_traffic_filtering=True,id=1aadd54c-ea47-43c1-86e2-da7dc2eb0a49,network=Network(e5543f88-c716-4e02-82e9-2cb7570bf25e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aadd54c-ea') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:57:37.925603 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lazy-loading 'pci_devices' on Instance uuid 289e2914-2be4-4f46-92e0-fa623f8db861 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:57:37.995759 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 09:57:38.233379 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 09:57:38.266047 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "refresh_cache-e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:57:38.266262 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquired lock "refresh_cache-e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:57:38.266262 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 09:57:38.323082 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f50ffed6-386e-4f58-9f3c-12bdfaa84173 req-ba1a8e5f-ba08-48be-a245-f076a1640942 service nova] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Received event network-changed-0ed2dfa0-2fb5-4493-91e8-597b70a39c6b {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:57:38.323653 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f50ffed6-386e-4f58-9f3c-12bdfaa84173 req-ba1a8e5f-ba08-48be-a245-f076a1640942 service nova] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Refreshing instance network info cache due to event network-changed-0ed2dfa0-2fb5-4493-91e8-597b70a39c6b. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 09:57:38.323653 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f50ffed6-386e-4f58-9f3c-12bdfaa84173 req-ba1a8e5f-ba08-48be-a245-f076a1640942 service nova] Acquiring lock "refresh_cache-e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:57:38.395002 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-f5aff88a-7e3a-469c-ac59-0aeb87182e08 req-9b78f736-c295-4802-8a72-35103f612ec8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:38.428819 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] End _get_guest_xml xml=<domain type="qemu">
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:   <uuid>289e2914-2be4-4f46-92e0-fa623f8db861</uuid>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:   <name>instance-00000001</name>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:   <metadata>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1280721083</nova:name>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 09:57:37</nova:creationTime>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:       </nova:image>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:         <nova:user uuid="51981c995f2246588f2d58f35be5848a">tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member</nova:user>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:         <nova:project uuid="a9d04b105229456d9ab53df1886fdb37">tempest-ServerBootFromVolumeStableRescueTest-283762505</nova:project>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:         <nova:port uuid="1aadd54c-ea47-43c1-86e2-da7dc2eb0a49">
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:         </nova:port>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:   </metadata>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:     <system>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:       <entry name="serial">289e2914-2be4-4f46-92e0-fa623f8db861</entry>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:       <entry name="uuid">289e2914-2be4-4f46-92e0-fa623f8db861</entry>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:     </system>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:   <os>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:   </os>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:   <features>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:     <acpi/>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:     <tcg>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:     </tcg>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:   </features>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:   <devices>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/289e2914-2be4-4f46-92e0-fa623f8db861/disk"/>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:     </disk>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/289e2914-2be4-4f46-92e0-fa623f8db861/disk.config"/>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:     </disk>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:95:8b:d3"/>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:       <target dev="tap1aadd54c-ea"/>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:     </interface>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/289e2914-2be4-4f46-92e0-fa623f8db861/console.log" append="off"/>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:     </serial>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:     <video>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:     </video>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:     </rng>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:     </memballoon>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:   </devices>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]: </domain>
May 28 09:57:38.428819 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 09:57:38.444654 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Preparing to wait for external event network-vif-plugged-1aadd54c-ea47-43c1-86e2-da7dc2eb0a49 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 09:57:38.444654 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "289e2914-2be4-4f46-92e0-fa623f8db861-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:38.444654 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "289e2914-2be4-4f46-92e0-fa623f8db861-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:38.444654 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "289e2914-2be4-4f46-92e0-fa623f8db861-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:38.444654 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T09:57:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1280721083',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serverbootfromvolumestablerescuetest-server-1280721083',id=1,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9d04b105229456d9ab53df1886fdb37',ramdisk_id='',reservation_id='r-3a0ld0bo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-283762505',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:57:34Z,user_data=None,user_id='51981c995f2246588f2d58f35be5848a',uuid=289e2914-2be4-4f46-92e0-fa623f8db861,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1aadd54c-ea47-43c1-86e2-da7dc2eb0a49", "address": "fa:16:3e:95:8b:d3", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aadd54c-ea", "ovs_interfaceid": "1aadd54c-ea47-43c1-86e2-da7dc2eb0a49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 09:57:38.445489 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Converting VIF {"id": "1aadd54c-ea47-43c1-86e2-da7dc2eb0a49", "address": "fa:16:3e:95:8b:d3", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aadd54c-ea", "ovs_interfaceid": "1aadd54c-ea47-43c1-86e2-da7dc2eb0a49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:57:38.445489 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:8b:d3,bridge_name='br-int',has_traffic_filtering=True,id=1aadd54c-ea47-43c1-86e2-da7dc2eb0a49,network=Network(e5543f88-c716-4e02-82e9-2cb7570bf25e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aadd54c-ea') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:57:38.445489 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:8b:d3,bridge_name='br-int',has_traffic_filtering=True,id=1aadd54c-ea47-43c1-86e2-da7dc2eb0a49,network=Network(e5543f88-c716-4e02-82e9-2cb7570bf25e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aadd54c-ea') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 09:57:38.496289 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Created schema index Interface.name {{(pid=98321) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 28 09:57:38.496289 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Created schema index Port.name {{(pid=98321) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 28 09:57:38.496289 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Created schema index Bridge.name {{(pid=98321) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 28 09:57:38.496289 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=98321) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 09:57:38.496289 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [POLLOUT] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:38.496289 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98321) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 09:57:38.496289 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:38.497371 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:38.520560 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:38.551097 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:38.551518 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:57:38.551950 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 09:57:38.552637 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:38.552824 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '319cd548-9bca-50b4-9795-8d43d56fef93', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:57:38.554203 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:38.555094 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:57:38.556116 np0000001613 nova-compute[98321]: INFO oslo.privsep.daemon [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpc88fsl09/privsep.sock']
May 28 09:57:38.567263 np0000001613 sudo[110044]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpc88fsl09/privsep.sock
May 28 09:57:38.569678 np0000001613 sudo[110044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 28 09:57:38.604890 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Successfully created port: 7be666db-db21-439b-958d-3721cb9c4fdd {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 09:57:38.612067 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:38.657934 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 09:57:38.658208 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 09:57:38.734789 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 09:57:38.846060 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 28 09:57:38.846060 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 28 09:57:38.846781 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 28 09:57:38.846781 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 09:57:38.846781 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 28 09:57:38.846781 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 28 09:57:38.846781 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 28 09:57:38.846781 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 09:57:38.846781 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 28 09:57:38.867604 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-f5aff88a-7e3a-469c-ac59-0aeb87182e08 req-9b78f736-c295-4802-8a72-35103f612ec8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:38.882851 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 09:57:39.104570 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:39.116784 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:39.120391 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-f5aff88a-7e3a-469c-ac59-0aeb87182e08 req-9b78f736-c295-4802-8a72-35103f612ec8 service nova] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Updated VIF entry in instance network info cache for port 1aadd54c-ea47-43c1-86e2-da7dc2eb0a49. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 09:57:39.120641 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-f5aff88a-7e3a-469c-ac59-0aeb87182e08 req-9b78f736-c295-4802-8a72-35103f612ec8 service nova] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Updating instance_info_cache with network_info: [{"id": "1aadd54c-ea47-43c1-86e2-da7dc2eb0a49", "address": "fa:16:3e:95:8b:d3", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aadd54c-ea", "ovs_interfaceid": "1aadd54c-ea47-43c1-86e2-da7dc2eb0a49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:57:39.161263 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 09:57:39.199978 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 28 09:57:39.199978 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 28 09:57:39.199978 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 28 09:57:39.199978 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 09:57:39.199978 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 28 09:57:39.199978 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 28 09:57:39.199978 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 28 09:57:39.199978 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 09:57:39.199978 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 28 09:57:39.339879 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Updating instance_info_cache with network_info: [{"id": "0ed2dfa0-2fb5-4493-91e8-597b70a39c6b", "address": "fa:16:3e:2d:94:a4", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed2dfa0-2f", "ovs_interfaceid": "0ed2dfa0-2fb5-4493-91e8-597b70a39c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:57:39.461944 np0000001613 sudo[110044]: pam_unix(sudo:session): session closed for user root
May 28 09:57:39.463533 np0000001613 nova-compute[98321]: INFO oslo.privsep.daemon [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Spawned new privsep daemon via rootwrap
May 28 09:57:39.464382 np0000001613 nova-compute[98321]: INFO oslo.privsep.daemon [-] privsep daemon starting
May 28 09:57:39.464471 np0000001613 nova-compute[98321]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
May 28 09:57:39.464516 np0000001613 nova-compute[98321]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
May 28 09:57:39.464557 np0000001613 nova-compute[98321]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 110052
May 28 09:57:39.521784 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Successfully updated port: 7be666db-db21-439b-958d-3721cb9c4fdd {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 09:57:39.622964 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f5aff88a-7e3a-469c-ac59-0aeb87182e08 req-9b78f736-c295-4802-8a72-35103f612ec8 service nova] Releasing lock "refresh_cache-289e2914-2be4-4f46-92e0-fa623f8db861" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:57:39.670177 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.449s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:39.670767 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.852s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:39.671111 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 09:57:39.676707 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 09:57:39.676982 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Claim successful on node np0000001613
May 28 09:57:39.717289 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:39.717431 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1aadd54c-ea, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:57:39.717834 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1aadd54c-ea, col_values=(('qos', UUID('c522fe46-d8cd-4e93-bd66-9a9852741ba8')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:57:39.718650 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1aadd54c-ea, col_values=(('external_ids', {'iface-id': '1aadd54c-ea47-43c1-86e2-da7dc2eb0a49', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:8b:d3', 'vm-uuid': '289e2914-2be4-4f46-92e0-fa623f8db861'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:57:39.719579 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:39.721403 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:57:39.726309 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:39.727386 np0000001613 nova-compute[98321]: INFO os_vif [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:8b:d3,bridge_name='br-int',has_traffic_filtering=True,id=1aadd54c-ea47-43c1-86e2-da7dc2eb0a49,network=Network(e5543f88-c716-4e02-82e9-2cb7570bf25e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aadd54c-ea')
May 28 09:57:39.745262 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 09:57:39.746480 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 09:57:39.746869 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Creating image(s)
May 28 09:57:39.747340 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "/opt/stack/data/nova/instances/53ad56cc-eb5b-4e2e-a421-e93deee27fe7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:39.747534 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "/opt/stack/data/nova/instances/53ad56cc-eb5b-4e2e-a421-e93deee27fe7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:39.747993 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "/opt/stack/data/nova/instances/53ad56cc-eb5b-4e2e-a421-e93deee27fe7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:39.748579 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:57:39.752304 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:57:39.759900 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:39.827697 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.073s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:39.828236 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:39.828858 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:39.829364 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:57:39.833471 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:57:39.834476 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:39.844786 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Releasing lock "refresh_cache-e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:57:39.845825 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Instance network_info: |[{"id": "0ed2dfa0-2fb5-4493-91e8-597b70a39c6b", "address": "fa:16:3e:2d:94:a4", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed2dfa0-2f", "ovs_interfaceid": "0ed2dfa0-2fb5-4493-91e8-597b70a39c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 09:57:39.846552 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f50ffed6-386e-4f58-9f3c-12bdfaa84173 req-ba1a8e5f-ba08-48be-a245-f076a1640942 service nova] Acquired lock "refresh_cache-e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:57:39.846973 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-f50ffed6-386e-4f58-9f3c-12bdfaa84173 req-ba1a8e5f-ba08-48be-a245-f076a1640942 service nova] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Refreshing network info cache for port 0ed2dfa0-2fb5-4493-91e8-597b70a39c6b {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 09:57:39.850324 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Start _get_guest_xml network_info=[{"id": "0ed2dfa0-2fb5-4493-91e8-597b70a39c6b", "address": "fa:16:3e:2d:94:a4", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed2dfa0-2f", "ovs_interfaceid": "0ed2dfa0-2fb5-4493-91e8-597b70a39c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 09:57:39.861263 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 09:57:39.862758 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-2141670412', uuid='e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047'), owner=OwnerMeta(userid='62efa57da85f458790f3ceeebcc777a7', username='tempest-ServerActionsTestOtherA-1557455944-project-member', projectid='cb3a501b4f4041ef875ef4d2b4167044', projectname='tempest-ServerActionsTestOtherA-1557455944'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0ed2dfa0-2fb5-4493-91e8-597b70a39c6b", "address": "fa:16:3e:2d:94:a4", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed2dfa0-2f", "ovs_interfaceid": "0ed2dfa0-2fb5-4493-91e8-597b70a39c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962259.8623722) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 09:57:39.863732 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 09:57:39.864252 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 09:57:39.867986 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 09:57:39.868295 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 09:57:39.869661 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 09:57:39.870097 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 09:57:39.870346 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 09:57:39.874837 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 09:57:39.874837 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 09:57:39.874837 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 09:57:39.874837 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 09:57:39.874837 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 09:57:39.874837 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 09:57:39.874837 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 09:57:39.874837 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 09:57:39.874837 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 09:57:39.890766 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T09:57:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2141670412',display_name='tempest-ServerActionsTestOtherA-server-2141670412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serveractionstestothera-server-2141670412',id=2,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLNPaTs6CM9Wbie8XPRW8vQPbkYzxhmauw/kdujNoZe8MNOaDeh6K3tCu7L1IAoOGDytj5meJ0gvP/71uSisLwWlqhLyhBtEZHSZo7u74E1cepcGRGEWdNqJct6TYM6oQ==',key_name='tempest-keypair-320562480',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb3a501b4f4041ef875ef4d2b4167044',ramdisk_id='',reservation_id='r-ryp05ser',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1557455944',owner_user_name='tempest-ServerActionsTestOtherA-1557455944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:57:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62efa57da85f458790f3ceeebcc777a7',uuid=e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ed2dfa0-2fb5-4493-91e8-597b70a39c6b", "address": "fa:16:3e:2d:94:a4", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed2dfa0-2f", "ovs_interfaceid": "0ed2dfa0-2fb5-4493-91e8-597b70a39c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 09:57:39.890766 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Converting VIF {"id": "0ed2dfa0-2fb5-4493-91e8-597b70a39c6b", "address": "fa:16:3e:2d:94:a4", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed2dfa0-2f", "ovs_interfaceid": "0ed2dfa0-2fb5-4493-91e8-597b70a39c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:57:39.890766 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:94:a4,bridge_name='br-int',has_traffic_filtering=True,id=0ed2dfa0-2fb5-4493-91e8-597b70a39c6b,network=Network(2ae47a43-582b-442f-922d-fe7138b431a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed2dfa0-2f') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:57:39.891136 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lazy-loading 'pci_devices' on Instance uuid e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:57:39.901760 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.068s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:39.902753 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/53ad56cc-eb5b-4e2e-a421-e93deee27fe7/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:39.959012 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/53ad56cc-eb5b-4e2e-a421-e93deee27fe7/disk 1073741824" returned: 0 in 0.056s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:39.959505 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.131s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:39.959879 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:40.025124 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "refresh_cache-53ad56cc-eb5b-4e2e-a421-e93deee27fe7" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:57:40.025318 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquired lock "refresh_cache-53ad56cc-eb5b-4e2e-a421-e93deee27fe7" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:57:40.025566 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 09:57:40.027596 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.068s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:40.029924 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Checking if we can resize image /opt/stack/data/nova/instances/53ad56cc-eb5b-4e2e-a421-e93deee27fe7/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 09:57:40.029924 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ad56cc-eb5b-4e2e-a421-e93deee27fe7/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:40.110851 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ad56cc-eb5b-4e2e-a421-e93deee27fe7/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:40.111750 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Cannot resize image /opt/stack/data/nova/instances/53ad56cc-eb5b-4e2e-a421-e93deee27fe7/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 09:57:40.111750 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 09:57:40.111899 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Ensure instance console log exists: /opt/stack/data/nova/instances/53ad56cc-eb5b-4e2e-a421-e93deee27fe7/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 09:57:40.112192 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:40.112449 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:40.112542 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:40.161787 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4c08b11a-46dd-408d-b8cb-d2ce67d78de6 req-558a74ee-e08d-495a-9886-ef977f1d4427 service nova] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Received event network-changed-7be666db-db21-439b-958d-3721cb9c4fdd {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:57:40.161924 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4c08b11a-46dd-408d-b8cb-d2ce67d78de6 req-558a74ee-e08d-495a-9886-ef977f1d4427 service nova] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Refreshing instance network info cache due to event network-changed-7be666db-db21-439b-958d-3721cb9c4fdd. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 09:57:40.162061 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4c08b11a-46dd-408d-b8cb-d2ce67d78de6 req-558a74ee-e08d-495a-9886-ef977f1d4427 service nova] Acquiring lock "refresh_cache-53ad56cc-eb5b-4e2e-a421-e93deee27fe7" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:57:40.181061 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 09:57:40.183907 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 09:57:40.184400 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:40.184737 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:40.283142 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '74620a0064844d8f922e02c653142fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a0adc32dd74f039cc231cceb9131a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 09:57:40.352265 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-f50ffed6-386e-4f58-9f3c-12bdfaa84173 req-ba1a8e5f-ba08-48be-a245-f076a1640942 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:40.395504 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] End _get_guest_xml xml=<domain type="qemu">
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:   <uuid>e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047</uuid>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:   <name>instance-00000002</name>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:   <metadata>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:       <nova:name>tempest-ServerActionsTestOtherA-server-2141670412</nova:name>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 09:57:39</nova:creationTime>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:       </nova:image>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:         <nova:user uuid="62efa57da85f458790f3ceeebcc777a7">tempest-ServerActionsTestOtherA-1557455944-project-member</nova:user>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:         <nova:project uuid="cb3a501b4f4041ef875ef4d2b4167044">tempest-ServerActionsTestOtherA-1557455944</nova:project>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:         <nova:port uuid="0ed2dfa0-2fb5-4493-91e8-597b70a39c6b">
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:         </nova:port>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:   </metadata>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:     <system>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:       <entry name="serial">e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047</entry>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:       <entry name="uuid">e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047</entry>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:     </system>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:   <os>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:   </os>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:   <features>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:     <acpi/>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:     <tcg>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:     </tcg>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:   </features>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:   <devices>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047/disk"/>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:     </disk>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047/disk.config"/>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:     </disk>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:2d:94:a4"/>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:       <target dev="tap0ed2dfa0-2f"/>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:     </interface>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047/console.log" append="off"/>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:     </serial>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:     <video>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:     </video>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:     </rng>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:     </memballoon>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:   </devices>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]: </domain>
May 28 09:57:40.395504 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 09:57:40.398477 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Preparing to wait for external event network-vif-plugged-0ed2dfa0-2fb5-4493-91e8-597b70a39c6b {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 09:57:40.398477 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:40.398477 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:40.398477 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:40.398477 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T09:57:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2141670412',display_name='tempest-ServerActionsTestOtherA-server-2141670412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serveractionstestothera-server-2141670412',id=2,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLNPaTs6CM9Wbie8XPRW8vQPbkYzxhmauw/kdujNoZe8MNOaDeh6K3tCu7L1IAoOGDytj5meJ0gvP/71uSisLwWlqhLyhBtEZHSZo7u74E1cepcGRGEWdNqJct6TYM6oQ==',key_name='tempest-keypair-320562480',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb3a501b4f4041ef875ef4d2b4167044',ramdisk_id='',reservation_id='r-ryp05ser',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1557455944',owner_user_name='tempest-ServerActionsTestOtherA-1557455944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:57:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62efa57da85f458790f3ceeebcc777a7',uuid=e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ed2dfa0-2fb5-4493-91e8-597b70a39c6b", "address": "fa:16:3e:2d:94:a4", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed2dfa0-2f", "ovs_interfaceid": "0ed2dfa0-2fb5-4493-91e8-597b70a39c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 09:57:40.398972 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Converting VIF {"id": "0ed2dfa0-2fb5-4493-91e8-597b70a39c6b", "address": "fa:16:3e:2d:94:a4", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed2dfa0-2f", "ovs_interfaceid": "0ed2dfa0-2fb5-4493-91e8-597b70a39c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:57:40.399205 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:94:a4,bridge_name='br-int',has_traffic_filtering=True,id=0ed2dfa0-2fb5-4493-91e8-597b70a39c6b,network=Network(2ae47a43-582b-442f-922d-fe7138b431a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed2dfa0-2f') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:57:40.399852 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:94:a4,bridge_name='br-int',has_traffic_filtering=True,id=0ed2dfa0-2fb5-4493-91e8-597b70a39c6b,network=Network(2ae47a43-582b-442f-922d-fe7138b431a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed2dfa0-2f') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 09:57:40.400414 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:40.400773 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:57:40.401054 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 09:57:40.401830 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:40.401980 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '550d10ff-77cb-5461-ab85-c6590a64b71b', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:57:40.402719 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:40.403505 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:57:40.408259 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:40.410835 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:40.411033 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ed2dfa0-2f, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:57:40.411396 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ed2dfa0-2f, col_values=(('qos', UUID('89cfd634-75a0-4ff6-8c12-b2d977c65cbc')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:57:40.412057 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ed2dfa0-2f, col_values=(('external_ids', {'iface-id': '0ed2dfa0-2fb5-4493-91e8-597b70a39c6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:94:a4', 'vm-uuid': 'e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:57:40.412831 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:40.413974 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:57:40.423193 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:40.424277 np0000001613 nova-compute[98321]: INFO os_vif [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:94:a4,bridge_name='br-int',has_traffic_filtering=True,id=0ed2dfa0-2fb5-4493-91e8-597b70a39c6b,network=Network(2ae47a43-582b-442f-922d-fe7138b431a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed2dfa0-2f')
May 28 09:57:40.610352 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 09:57:40.684231 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 09:57:40.793539 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-f50ffed6-386e-4f58-9f3c-12bdfaa84173 req-ba1a8e5f-ba08-48be-a245-f076a1640942 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:40.797202 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:40.878504 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Successfully created port: 2fad8030-7c30-438c-8dcd-b9a8ba1849d1 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 09:57:41.042798 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Updating instance_info_cache with network_info: [{"id": "7be666db-db21-439b-958d-3721cb9c4fdd", "address": "fa:16:3e:31:51:06", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be666db-db", "ovs_interfaceid": "7be666db-db21-439b-958d-3721cb9c4fdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:57:41.075996 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-f50ffed6-386e-4f58-9f3c-12bdfaa84173 req-ba1a8e5f-ba08-48be-a245-f076a1640942 service nova] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Updated VIF entry in instance network info cache for port 0ed2dfa0-2fb5-4493-91e8-597b70a39c6b. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 09:57:41.076178 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-f50ffed6-386e-4f58-9f3c-12bdfaa84173 req-ba1a8e5f-ba08-48be-a245-f076a1640942 service nova] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Updating instance_info_cache with network_info: [{"id": "0ed2dfa0-2fb5-4493-91e8-597b70a39c6b", "address": "fa:16:3e:2d:94:a4", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed2dfa0-2f", "ovs_interfaceid": "0ed2dfa0-2fb5-4493-91e8-597b70a39c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:57:41.124957 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 09:57:41.125859 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 09:57:41.190050 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 09:57:41.253791 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:57:41.253948 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:57:41.254013 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] No VIF found with MAC fa:16:3e:95:8b:d3, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 09:57:41.254432 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Using config drive
May 28 09:57:41.544846 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Releasing lock "refresh_cache-53ad56cc-eb5b-4e2e-a421-e93deee27fe7" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:57:41.545168 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Instance network_info: |[{"id": "7be666db-db21-439b-958d-3721cb9c4fdd", "address": "fa:16:3e:31:51:06", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be666db-db", "ovs_interfaceid": "7be666db-db21-439b-958d-3721cb9c4fdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 09:57:41.545594 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4c08b11a-46dd-408d-b8cb-d2ce67d78de6 req-558a74ee-e08d-495a-9886-ef977f1d4427 service nova] Acquired lock "refresh_cache-53ad56cc-eb5b-4e2e-a421-e93deee27fe7" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:57:41.547449 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Start _get_guest_xml network_info=[{"id": "7be666db-db21-439b-958d-3721cb9c4fdd", "address": "fa:16:3e:31:51:06", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be666db-db", "ovs_interfaceid": "7be666db-db21-439b-958d-3721cb9c4fdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 09:57:41.547810 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-4c08b11a-46dd-408d-b8cb-d2ce67d78de6 req-558a74ee-e08d-495a-9886-ef977f1d4427 service nova] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Refreshing network info cache for port 7be666db-db21-439b-958d-3721cb9c4fdd {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 09:57:41.549619 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 09:57:41.550769 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-1127018178', uuid='53ad56cc-eb5b-4e2e-a421-e93deee27fe7'), owner=OwnerMeta(userid='9297977bbf334232a4a74bd6808b863b', username='tempest-AttachVolumeNegativeTest-775348461-project-member', projectid='9a85ba31f98b45b6974118c6560bbc53', projectname='tempest-AttachVolumeNegativeTest-775348461'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7be666db-db21-439b-958d-3721cb9c4fdd", "address": "fa:16:3e:31:51:06", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be666db-db", "ovs_interfaceid": "7be666db-db21-439b-958d-3721cb9c4fdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962261.5504444) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 09:57:41.554978 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 09:57:41.555508 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 09:57:41.556128 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 09:57:41.557145 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 09:57:41.557505 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 09:57:41.557836 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 09:57:41.559277 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 09:57:41.559277 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 09:57:41.559277 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 09:57:41.559277 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 09:57:41.559277 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 09:57:41.559277 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 09:57:41.559277 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 09:57:41.559277 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 09:57:41.559277 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 09:57:41.559277 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 09:57:41.572358 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T09:57:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1127018178',display_name='tempest-AttachVolumeNegativeTest-server-1127018178',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumenegativetest-server-1127018178',id=3,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfEzrDpvX+Cb2A6iydtPeqQcs6tszqFfpe/AtRnOqrfv3UKFlvb/KatCH68AhguXf+mQ6BwGWMYvWwY1uYAw+uDeebadCiScBpQV03iDWD+z1toHUEYkgrxcdsvJhm01w==',key_name='tempest-keypair-618860882',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a85ba31f98b45b6974118c6560bbc53',ramdisk_id='',reservation_id='r-suklovqv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-775348461',owner_user_name='tempest-AttachVolumeNegativeTest-775348461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:57:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9297977bbf334232a4a74bd6808b863b',uuid=53ad56cc-eb5b-4e2e-a421-e93deee27fe7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7be666db-db21-439b-958d-3721cb9c4fdd", "address": "fa:16:3e:31:51:06", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be666db-db", "ovs_interfaceid": "7be666db-db21-439b-958d-3721cb9c4fdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 09:57:41.572358 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Converting VIF {"id": "7be666db-db21-439b-958d-3721cb9c4fdd", "address": "fa:16:3e:31:51:06", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be666db-db", "ovs_interfaceid": "7be666db-db21-439b-958d-3721cb9c4fdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:57:41.572687 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:51:06,bridge_name='br-int',has_traffic_filtering=True,id=7be666db-db21-439b-958d-3721cb9c4fdd,network=Network(bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be666db-db') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:57:41.573236 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lazy-loading 'pci_devices' on Instance uuid 53ad56cc-eb5b-4e2e-a421-e93deee27fe7 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:57:41.578896 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f50ffed6-386e-4f58-9f3c-12bdfaa84173 req-ba1a8e5f-ba08-48be-a245-f076a1640942 service nova] Releasing lock "refresh_cache-e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:57:41.630567 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 09:57:41.759783 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:41.900200 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Successfully updated port: 2fad8030-7c30-438c-8dcd-b9a8ba1849d1 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 09:57:41.963746 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:57:41.963890 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:57:41.963890 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] No VIF found with MAC fa:16:3e:2d:94:a4, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 09:57:41.964303 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Using config drive
May 28 09:57:42.050070 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-4c08b11a-46dd-408d-b8cb-d2ce67d78de6 req-558a74ee-e08d-495a-9886-ef977f1d4427 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:42.075675 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] End _get_guest_xml xml=<domain type="qemu">
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:   <uuid>53ad56cc-eb5b-4e2e-a421-e93deee27fe7</uuid>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:   <name>instance-00000003</name>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:   <metadata>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1127018178</nova:name>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 09:57:41</nova:creationTime>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:       </nova:image>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:         <nova:user uuid="9297977bbf334232a4a74bd6808b863b">tempest-AttachVolumeNegativeTest-775348461-project-member</nova:user>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:         <nova:project uuid="9a85ba31f98b45b6974118c6560bbc53">tempest-AttachVolumeNegativeTest-775348461</nova:project>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:         <nova:port uuid="7be666db-db21-439b-958d-3721cb9c4fdd">
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:         </nova:port>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:   </metadata>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:     <system>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:       <entry name="serial">53ad56cc-eb5b-4e2e-a421-e93deee27fe7</entry>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:       <entry name="uuid">53ad56cc-eb5b-4e2e-a421-e93deee27fe7</entry>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:     </system>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:   <os>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:   </os>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:   <features>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:     <acpi/>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:     <tcg>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:     </tcg>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:   </features>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:   <devices>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/53ad56cc-eb5b-4e2e-a421-e93deee27fe7/disk"/>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:     </disk>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/53ad56cc-eb5b-4e2e-a421-e93deee27fe7/disk.config"/>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:     </disk>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:31:51:06"/>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:       <target dev="tap7be666db-db"/>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:     </interface>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/53ad56cc-eb5b-4e2e-a421-e93deee27fe7/console.log" append="off"/>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:     </serial>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:     <video>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:     </video>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:     </rng>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:     </memballoon>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:   </devices>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]: </domain>
May 28 09:57:42.075675 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 09:57:42.078289 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Preparing to wait for external event network-vif-plugged-7be666db-db21-439b-958d-3721cb9c4fdd {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 09:57:42.078289 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "53ad56cc-eb5b-4e2e-a421-e93deee27fe7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:42.078289 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "53ad56cc-eb5b-4e2e-a421-e93deee27fe7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:42.078289 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "53ad56cc-eb5b-4e2e-a421-e93deee27fe7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:42.078289 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T09:57:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1127018178',display_name='tempest-AttachVolumeNegativeTest-server-1127018178',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumenegativetest-server-1127018178',id=3,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfEzrDpvX+Cb2A6iydtPeqQcs6tszqFfpe/AtRnOqrfv3UKFlvb/KatCH68AhguXf+mQ6BwGWMYvWwY1uYAw+uDeebadCiScBpQV03iDWD+z1toHUEYkgrxcdsvJhm01w==',key_name='tempest-keypair-618860882',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a85ba31f98b45b6974118c6560bbc53',ramdisk_id='',reservation_id='r-suklovqv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-775348461',owner_user_name='tempest-AttachVolumeNegativeTest-775348461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:57:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9297977bbf334232a4a74bd6808b863b',uuid=53ad56cc-eb5b-4e2e-a421-e93deee27fe7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7be666db-db21-439b-958d-3721cb9c4fdd", "address": "fa:16:3e:31:51:06", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be666db-db", "ovs_interfaceid": "7be666db-db21-439b-958d-3721cb9c4fdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 09:57:42.078552 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Converting VIF {"id": "7be666db-db21-439b-958d-3721cb9c4fdd", "address": "fa:16:3e:31:51:06", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be666db-db", "ovs_interfaceid": "7be666db-db21-439b-958d-3721cb9c4fdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:57:42.078552 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:51:06,bridge_name='br-int',has_traffic_filtering=True,id=7be666db-db21-439b-958d-3721cb9c4fdd,network=Network(bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be666db-db') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:57:42.078552 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:51:06,bridge_name='br-int',has_traffic_filtering=True,id=7be666db-db21-439b-958d-3721cb9c4fdd,network=Network(bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be666db-db') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 09:57:42.078552 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:42.078767 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:57:42.079034 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 09:57:42.079660 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:42.079896 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '248b8be2-1c53-52ad-baee-7fa186124165', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:57:42.080580 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:42.081441 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:57:42.092427 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:42.094535 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:42.094700 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7be666db-db, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:57:42.095064 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7be666db-db, col_values=(('qos', UUID('34841b20-6ce4-48d5-82d8-7d330f7e0a4d')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:57:42.095249 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7be666db-db, col_values=(('external_ids', {'iface-id': '7be666db-db21-439b-958d-3721cb9c4fdd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:51:06', 'vm-uuid': '53ad56cc-eb5b-4e2e-a421-e93deee27fe7'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:57:42.099242 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:42.100331 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:57:42.115267 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:42.116176 np0000001613 nova-compute[98321]: INFO os_vif [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:51:06,bridge_name='br-int',has_traffic_filtering=True,id=7be666db-db21-439b-958d-3721cb9c4fdd,network=Network(bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be666db-db')
May 28 09:57:42.137803 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.467s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:42.138364 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 09:57:42.141813 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.530s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:42.149500 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 09:57:42.150593 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Claim successful on node np0000001613
May 28 09:57:42.200542 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 09:57:42.201627 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 09:57:42.201867 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Creating image(s)
May 28 09:57:42.202324 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Acquiring lock "/opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:42.202516 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lock "/opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:42.202987 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lock "/opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:42.204366 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:57:42.209133 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:57:42.210419 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:42.241285 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-328dd5e4-98dc-41cf-bfd7-a9de29abd17e req-635cc073-7e0b-43e4-bdba-282d137dd8c0 service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Received event network-changed-2fad8030-7c30-438c-8dcd-b9a8ba1849d1 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:57:42.241485 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-328dd5e4-98dc-41cf-bfd7-a9de29abd17e req-635cc073-7e0b-43e4-bdba-282d137dd8c0 service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Refreshing instance network info cache due to event network-changed-2fad8030-7c30-438c-8dcd-b9a8ba1849d1. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 09:57:42.243289 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-328dd5e4-98dc-41cf-bfd7-a9de29abd17e req-635cc073-7e0b-43e4-bdba-282d137dd8c0 service nova] Acquiring lock "refresh_cache-e2856743-3a60-4be1-b29c-b4de06f14783" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:57:42.243289 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-328dd5e4-98dc-41cf-bfd7-a9de29abd17e req-635cc073-7e0b-43e4-bdba-282d137dd8c0 service nova] Acquired lock "refresh_cache-e2856743-3a60-4be1-b29c-b4de06f14783" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:57:42.243289 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-328dd5e4-98dc-41cf-bfd7-a9de29abd17e req-635cc073-7e0b-43e4-bdba-282d137dd8c0 service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Refreshing network info cache for port 2fad8030-7c30-438c-8dcd-b9a8ba1849d1 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 09:57:42.262058 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Creating config drive at /opt/stack/data/nova/instances/289e2914-2be4-4f46-92e0-fa623f8db861/disk.config
May 28 09:57:42.267487 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/289e2914-2be4-4f46-92e0-fa623f8db861/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpujgy530u {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:42.281334 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.070s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:42.281542 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:42.282226 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:42.282768 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:57:42.285643 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:57:42.285729 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:42.306998 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/289e2914-2be4-4f46-92e0-fa623f8db861/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpujgy530u" returned: 0 in 0.039s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:42.364977 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.079s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:42.365340 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:42.402783 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Acquiring lock "refresh_cache-e2856743-3a60-4be1-b29c-b4de06f14783" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:57:42.415491 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783/disk 1073741824" returned: 0 in 0.050s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:42.415954 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.134s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:42.416403 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:42.471600 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:42.492878 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.076s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:42.493374 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 09:57:42.493688 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:42.572544 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783/disk --force-share --output=json" returned: 0 in 0.078s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:42.572942 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Cannot resize image /opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 09:57:42.573467 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 09:57:42.573642 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Ensure instance console log exists: /opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 09:57:42.573952 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:42.574225 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:42.574386 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:42.649970 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 09:57:42.652221 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 09:57:42.652221 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:42.652221 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:42.745612 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-328dd5e4-98dc-41cf-bfd7-a9de29abd17e req-635cc073-7e0b-43e4-bdba-282d137dd8c0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:42.776194 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Creating config drive at /opt/stack/data/nova/instances/e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047/disk.config
May 28 09:57:42.783207 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpx5zxg4wb {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:42.801601 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:42.834471 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpx5zxg4wb" returned: 0 in 0.046s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:42.834471 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:42.851675 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:42.861996 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73c6a47f86bc47e4a7cd7260dc5edae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baa985120ab84c2a93a64fdab8e0d4e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 09:57:42.886622 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-328dd5e4-98dc-41cf-bfd7-a9de29abd17e req-635cc073-7e0b-43e4-bdba-282d137dd8c0 service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 09:57:42.925242 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-4c08b11a-46dd-408d-b8cb-d2ce67d78de6 req-558a74ee-e08d-495a-9886-ef977f1d4427 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:42.966560 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:42.995509 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:43.158201 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
May 28 09:57:43.184998 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-328dd5e4-98dc-41cf-bfd7-a9de29abd17e req-635cc073-7e0b-43e4-bdba-282d137dd8c0 service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:57:43.262681 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-4c08b11a-46dd-408d-b8cb-d2ce67d78de6 req-558a74ee-e08d-495a-9886-ef977f1d4427 service nova] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Updated VIF entry in instance network info cache for port 7be666db-db21-439b-958d-3721cb9c4fdd. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 09:57:43.262981 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-4c08b11a-46dd-408d-b8cb-d2ce67d78de6 req-558a74ee-e08d-495a-9886-ef977f1d4427 service nova] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Updating instance_info_cache with network_info: [{"id": "7be666db-db21-439b-958d-3721cb9c4fdd", "address": "fa:16:3e:31:51:06", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be666db-db", "ovs_interfaceid": "7be666db-db21-439b-958d-3721cb9c4fdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:57:43.415262 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:43.437547 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:43.577441 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:43.623368 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 09:57:43.623669 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 09:57:43.665366 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 09:57:43.669318 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:57:43.670000 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:57:43.670000 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] No VIF found with MAC fa:16:3e:31:51:06, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 09:57:43.670153 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Using config drive
May 28 09:57:43.688595 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-328dd5e4-98dc-41cf-bfd7-a9de29abd17e req-635cc073-7e0b-43e4-bdba-282d137dd8c0 service nova] Releasing lock "refresh_cache-e2856743-3a60-4be1-b29c-b4de06f14783" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:57:43.689147 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Acquired lock "refresh_cache-e2856743-3a60-4be1-b29c-b4de06f14783" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:57:43.689380 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 09:57:43.721127 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Successfully created port: 89ae21a1-1d94-4446-8c5a-4aac2a148584 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 09:57:43.765098 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4c08b11a-46dd-408d-b8cb-d2ce67d78de6 req-558a74ee-e08d-495a-9886-ef977f1d4427 service nova] Releasing lock "refresh_cache-53ad56cc-eb5b-4e2e-a421-e93deee27fe7" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:57:44.121538 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:44.129265 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 09:57:44.180959 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:44.354280 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1779962264.3537867, 289e2914-2be4-4f46-92e0-fa623f8db861 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:57:44.354581 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] VM Started (Lifecycle Event)
May 28 09:57:44.360608 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 09:57:44.441360 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Creating config drive at /opt/stack/data/nova/instances/53ad56cc-eb5b-4e2e-a421-e93deee27fe7/disk.config
May 28 09:57:44.447021 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/53ad56cc-eb5b-4e2e-a421-e93deee27fe7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbyr7svv3 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:44.491187 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/53ad56cc-eb5b-4e2e-a421-e93deee27fe7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbyr7svv3" returned: 0 in 0.044s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:44.638538 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.497s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:44.644211 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 09:57:44.684268 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 09:57:44.685491 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 09:57:44.685749 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Creating image(s)
May 28 09:57:44.686747 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Acquiring lock "/opt/stack/data/nova/instances/92fbf243-1c5b-47f6-9317-3fb2655651db/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:44.686747 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Lock "/opt/stack/data/nova/instances/92fbf243-1c5b-47f6-9317-3fb2655651db/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:44.687206 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Lock "/opt/stack/data/nova/instances/92fbf243-1c5b-47f6-9317-3fb2655651db/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:44.687433 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Acquiring lock "5ce91137960695b182b989484841104eb4740f90" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:44.687997 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Lock "5ce91137960695b182b989484841104eb4740f90" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:44.698777 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:44.858346 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:57:44.861563 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962264.8612528, 289e2914-2be4-4f46-92e0-fa623f8db861 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:57:44.861722 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] VM Paused (Lifecycle Event)
May 28 09:57:44.906337 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Updating instance_info_cache with network_info: [{"id": "2fad8030-7c30-438c-8dcd-b9a8ba1849d1", "address": "fa:16:3e:9a:42:b3", "network": {"id": "48f4f13e-9b4c-4776-a2bd-47a4984571ae", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-337905894-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "25a0adc32dd74f039cc231cceb9131a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fad8030-7c", "ovs_interfaceid": "2fad8030-7c30-438c-8dcd-b9a8ba1849d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:57:44.963745 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Successfully updated port: 89ae21a1-1d94-4446-8c5a-4aac2a148584 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 09:57:45.015066 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:45.026144 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ffe66549-74f0-44a9-85b2-5471a3406453 req-2e7f5377-7e48-4f78-a246-756334a5db88 service nova] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Received event network-changed-89ae21a1-1d94-4446-8c5a-4aac2a148584 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:57:45.026144 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ffe66549-74f0-44a9-85b2-5471a3406453 req-2e7f5377-7e48-4f78-a246-756334a5db88 service nova] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Refreshing instance network info cache due to event network-changed-89ae21a1-1d94-4446-8c5a-4aac2a148584. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 09:57:45.036009 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ffe66549-74f0-44a9-85b2-5471a3406453 req-2e7f5377-7e48-4f78-a246-756334a5db88 service nova] Acquiring lock "refresh_cache-92fbf243-1c5b-47f6-9317-3fb2655651db" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:57:45.036009 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ffe66549-74f0-44a9-85b2-5471a3406453 req-2e7f5377-7e48-4f78-a246-756334a5db88 service nova] Acquired lock "refresh_cache-92fbf243-1c5b-47f6-9317-3fb2655651db" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:57:45.036009 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-ffe66549-74f0-44a9-85b2-5471a3406453 req-2e7f5377-7e48-4f78-a246-756334a5db88 service nova] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Refreshing network info cache for port 89ae21a1-1d94-4446-8c5a-4aac2a148584 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 09:57:45.043110 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:45.148660 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:45.152184 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 09:57:45.152613 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 09:57:45.153614 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:45.153614 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:45.275146 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '45e753a39564489a9afff10dd05c3ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af05aeb984e64ba8989f3db86750c648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 09:57:45.365120 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:57:45.379189 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 09:57:45.408835 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Releasing lock "refresh_cache-e2856743-3a60-4be1-b29c-b4de06f14783" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:57:45.409267 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Instance network_info: |[{"id": "2fad8030-7c30-438c-8dcd-b9a8ba1849d1", "address": "fa:16:3e:9a:42:b3", "network": {"id": "48f4f13e-9b4c-4776-a2bd-47a4984571ae", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-337905894-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "25a0adc32dd74f039cc231cceb9131a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fad8030-7c", "ovs_interfaceid": "2fad8030-7c30-438c-8dcd-b9a8ba1849d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 09:57:45.411512 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Start _get_guest_xml network_info=[{"id": "2fad8030-7c30-438c-8dcd-b9a8ba1849d1", "address": "fa:16:3e:9a:42:b3", "network": {"id": "48f4f13e-9b4c-4776-a2bd-47a4984571ae", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-337905894-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "25a0adc32dd74f039cc231cceb9131a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fad8030-7c", "ovs_interfaceid": "2fad8030-7c30-438c-8dcd-b9a8ba1849d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 09:57:45.415567 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 09:57:45.417115 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-501736735', uuid='e2856743-3a60-4be1-b29c-b4de06f14783'), owner=OwnerMeta(userid='74620a0064844d8f922e02c653142fd6', username='tempest-TaggedAttachmentsTest-936828907-project-member', projectid='25a0adc32dd74f039cc231cceb9131a0', projectname='tempest-TaggedAttachmentsTest-936828907'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2fad8030-7c30-438c-8dcd-b9a8ba1849d1", "address": "fa:16:3e:9a:42:b3", "network": {"id": "48f4f13e-9b4c-4776-a2bd-47a4984571ae", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-337905894-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "25a0adc32dd74f039cc231cceb9131a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fad8030-7c", "ovs_interfaceid": "2fad8030-7c30-438c-8dcd-b9a8ba1849d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962265.416696) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 09:57:45.422906 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 09:57:45.423555 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 09:57:45.425518 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 09:57:45.425799 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 09:57:45.427098 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 09:57:45.427685 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 09:57:45.427861 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 09:57:45.427959 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 09:57:45.429009 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 09:57:45.429009 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 09:57:45.429009 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 09:57:45.429009 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 09:57:45.429009 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 09:57:45.429009 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 09:57:45.429009 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 09:57:45.429009 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 09:57:45.444830 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:57:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-501736735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-501736735',id=4,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPS8xG4KsWj7jd6eI8Ha8DW2V89ViHDMSJ32qPM+zEUw0jbx/lKgP6h0tE0l56+jki8nKEwFAor6rHbbQIYZjf8FhqUVxl6GRIyxLYKd7whepyq3n5RjNWjJHm94fY8qvQ==',key_name='tempest-keypair-1033085564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25a0adc32dd74f039cc231cceb9131a0',ramdisk_id='',reservation_id='r-0bm2bepy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-936828907',owner_user_name='tempest-TaggedAttachmentsTest-936828907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:57:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74620a0064844d8f922e02c653142fd6',uuid=e2856743-3a60-4be1-b29c-b4de06f14783,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2fad8030-7c30-438c-8dcd-b9a8ba1849d1", "address": "fa:16:3e:9a:42:b3", "network": {"id": "48f4f13e-9b4c-4776-a2bd-47a4984571ae", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-337905894-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "25a0adc32dd74f039cc231cceb9131a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fad8030-7c", "ovs_interfaceid": "2fad8030-7c30-438c-8dcd-b9a8ba1849d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 09:57:45.445138 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Converting VIF {"id": "2fad8030-7c30-438c-8dcd-b9a8ba1849d1", "address": "fa:16:3e:9a:42:b3", "network": {"id": "48f4f13e-9b4c-4776-a2bd-47a4984571ae", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-337905894-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "25a0adc32dd74f039cc231cceb9131a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fad8030-7c", "ovs_interfaceid": "2fad8030-7c30-438c-8dcd-b9a8ba1849d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:57:45.447181 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:42:b3,bridge_name='br-int',has_traffic_filtering=True,id=2fad8030-7c30-438c-8dcd-b9a8ba1849d1,network=Network(48f4f13e-9b4c-4776-a2bd-47a4984571ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fad8030-7c') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:57:45.447181 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lazy-loading 'pci_devices' on Instance uuid e2856743-3a60-4be1-b29c-b4de06f14783 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:57:45.467448 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Acquiring lock "refresh_cache-92fbf243-1c5b-47f6-9317-3fb2655651db" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:57:45.536473 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-ffe66549-74f0-44a9-85b2-5471a3406453 req-2e7f5377-7e48-4f78-a246-756334a5db88 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:45.658950 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 09:57:45.721939 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Acquiring lock "4a28d569-1ca9-4657-840c-7bb31d4644c8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:45.722511 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "4a28d569-1ca9-4657-840c-7bb31d4644c8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:45.733308 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:57:45.735454 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:57:45.735849 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5ce91137960695b182b989484841104eb4740f90.part --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:45.802940 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-ffe66549-74f0-44a9-85b2-5471a3406453 req-2e7f5377-7e48-4f78-a246-756334a5db88 service nova] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 09:57:45.837286 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5ce91137960695b182b989484841104eb4740f90.part --force-share --output=json" returned: 0 in 0.100s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:45.837286 np0000001613 nova-compute[98321]: DEBUG nova.virt.images [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] a1c252d6-491c-463d-87b2-a292a48083c5 was qcow2, converting to raw {{(pid=98321) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 09:57:45.837584 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Acquiring lock "0dca786c-46bb-48dc-a01a-e282daa84a89" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:45.837935 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "0dca786c-46bb-48dc-a01a-e282daa84a89" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:45.841316 np0000001613 nova-compute[98321]: DEBUG nova.privsep.utils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98321) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 09:57:45.841656 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5ce91137960695b182b989484841104eb4740f90.part /opt/stack/data/nova/instances/_base/5ce91137960695b182b989484841104eb4740f90.converted {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:45.855789 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:45.869868 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:45.872517 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:45.882288 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 09:57:45.882632 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962265.8824558, e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:57:45.882749 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] VM Started (Lifecycle Event)
May 28 09:57:45.953819 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] End _get_guest_xml xml=<domain type="qemu">
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:   <uuid>e2856743-3a60-4be1-b29c-b4de06f14783</uuid>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:   <name>instance-00000004</name>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:   <metadata>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:       <nova:name>tempest-device-tagging-server-501736735</nova:name>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 09:57:45</nova:creationTime>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:       </nova:image>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:         <nova:user uuid="74620a0064844d8f922e02c653142fd6">tempest-TaggedAttachmentsTest-936828907-project-member</nova:user>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:         <nova:project uuid="25a0adc32dd74f039cc231cceb9131a0">tempest-TaggedAttachmentsTest-936828907</nova:project>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:         <nova:port uuid="2fad8030-7c30-438c-8dcd-b9a8ba1849d1">
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:         </nova:port>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:   </metadata>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:     <system>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:       <entry name="serial">e2856743-3a60-4be1-b29c-b4de06f14783</entry>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:       <entry name="uuid">e2856743-3a60-4be1-b29c-b4de06f14783</entry>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:     </system>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:   <os>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:   </os>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:   <features>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:     <acpi/>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:     <tcg>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:     </tcg>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:   </features>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:   <devices>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783/disk"/>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:     </disk>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783/disk.config"/>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:     </disk>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:9a:42:b3"/>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:       <target dev="tap2fad8030-7c"/>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:     </interface>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783/console.log" append="off"/>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:     </serial>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:     <video>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:     </video>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:     </rng>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:     </memballoon>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:   </devices>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]: </domain>
May 28 09:57:45.953819 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 09:57:46.642205 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Preparing to wait for external event network-vif-plugged-2fad8030-7c30-438c-8dcd-b9a8ba1849d1 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 09:57:46.642205 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Acquiring lock "e2856743-3a60-4be1-b29c-b4de06f14783-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:46.642205 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lock "e2856743-3a60-4be1-b29c-b4de06f14783-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:46.642205 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lock "e2856743-3a60-4be1-b29c-b4de06f14783-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:46.642205 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:57:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-501736735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-501736735',id=4,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPS8xG4KsWj7jd6eI8Ha8DW2V89ViHDMSJ32qPM+zEUw0jbx/lKgP6h0tE0l56+jki8nKEwFAor6rHbbQIYZjf8FhqUVxl6GRIyxLYKd7whepyq3n5RjNWjJHm94fY8qvQ==',key_name='tempest-keypair-1033085564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25a0adc32dd74f039cc231cceb9131a0',ramdisk_id='',reservation_id='r-0bm2bepy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-936828907',owner_user_name='tempest-TaggedAttachmentsTest-936828907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:57:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74620a0064844d8f922e02c653142fd6',uuid=e2856743-3a60-4be1-b29c-b4de06f14783,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2fad8030-7c30-438c-8dcd-b9a8ba1849d1", "address": "fa:16:3e:9a:42:b3", "network": {"id": "48f4f13e-9b4c-4776-a2bd-47a4984571ae", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-337905894-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "25a0adc32dd74f039cc231cceb9131a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fad8030-7c", "ovs_interfaceid": "2fad8030-7c30-438c-8dcd-b9a8ba1849d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 09:57:46.644995 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Converting VIF {"id": "2fad8030-7c30-438c-8dcd-b9a8ba1849d1", "address": "fa:16:3e:9a:42:b3", "network": {"id": "48f4f13e-9b4c-4776-a2bd-47a4984571ae", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-337905894-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "25a0adc32dd74f039cc231cceb9131a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fad8030-7c", "ovs_interfaceid": "2fad8030-7c30-438c-8dcd-b9a8ba1849d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:57:46.644995 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:42:b3,bridge_name='br-int',has_traffic_filtering=True,id=2fad8030-7c30-438c-8dcd-b9a8ba1849d1,network=Network(48f4f13e-9b4c-4776-a2bd-47a4984571ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fad8030-7c') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:57:46.644995 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:42:b3,bridge_name='br-int',has_traffic_filtering=True,id=2fad8030-7c30-438c-8dcd-b9a8ba1849d1,network=Network(48f4f13e-9b4c-4776-a2bd-47a4984571ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fad8030-7c') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 09:57:46.644995 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:46.644995 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:57:46.644995 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 09:57:46.644995 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:46.644995 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fa510580-0b20-5b65-8f3a-3722f33d83fb', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:57:46.644995 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:46.644995 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:57:46.644995 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:46.644995 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Successfully created port: 3e64d22f-6078-49f1-9576-b70571e7f6e6 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 09:57:46.644995 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:46.644995 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2fad8030-7c, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:57:46.644995 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2fad8030-7c, col_values=(('qos', UUID('dd2a16d4-b956-4452-b287-ece2bd36bc75')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:57:46.646402 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2fad8030-7c, col_values=(('external_ids', {'iface-id': '2fad8030-7c30-438c-8dcd-b9a8ba1849d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:42:b3', 'vm-uuid': 'e2856743-3a60-4be1-b29c-b4de06f14783'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:57:46.646402 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:46.646402 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:57:46.646402 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:46.646402 np0000001613 nova-compute[98321]: INFO os_vif [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:42:b3,bridge_name='br-int',has_traffic_filtering=True,id=2fad8030-7c30-438c-8dcd-b9a8ba1849d1,network=Network(48f4f13e-9b4c-4776-a2bd-47a4984571ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fad8030-7c')
May 28 09:57:46.646402 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 09:57:46.646402 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 09:57:46.646402 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-ffe66549-74f0-44a9-85b2-5471a3406453 req-2e7f5377-7e48-4f78-a246-756334a5db88 service nova] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:57:46.646402 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 09:57:46.646402 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7396abbb-8f01-4448-878b-23d03de66e24 req-fd9fb535-50dd-43f1-b67f-1bc8db11b212 service nova] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Received event network-vif-unplugged-1aadd54c-ea47-43c1-86e2-da7dc2eb0a49 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:57:46.646402 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7396abbb-8f01-4448-878b-23d03de66e24 req-fd9fb535-50dd-43f1-b67f-1bc8db11b212 service nova] Acquiring lock "289e2914-2be4-4f46-92e0-fa623f8db861-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:46.646402 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7396abbb-8f01-4448-878b-23d03de66e24 req-fd9fb535-50dd-43f1-b67f-1bc8db11b212 service nova] Lock "289e2914-2be4-4f46-92e0-fa623f8db861-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:46.646402 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7396abbb-8f01-4448-878b-23d03de66e24 req-fd9fb535-50dd-43f1-b67f-1bc8db11b212 service nova] Lock "289e2914-2be4-4f46-92e0-fa623f8db861-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:46.646402 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7396abbb-8f01-4448-878b-23d03de66e24 req-fd9fb535-50dd-43f1-b67f-1bc8db11b212 service nova] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] No event matching network-vif-unplugged-1aadd54c-ea47-43c1-86e2-da7dc2eb0a49 in dict_keys([('network-vif-plugged', '1aadd54c-ea47-43c1-86e2-da7dc2eb0a49')]) {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 09:57:46.646402 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-7396abbb-8f01-4448-878b-23d03de66e24 req-fd9fb535-50dd-43f1-b67f-1bc8db11b212 service nova] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Received unexpected event network-vif-unplugged-1aadd54c-ea47-43c1-86e2-da7dc2eb0a49 for instance with vm_state building and task_state spawning.
May 28 09:57:46.646402 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:57:46.646402 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962266.3907309, e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:57:46.648787 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] VM Paused (Lifecycle Event)
May 28 09:57:46.648787 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5ce91137960695b182b989484841104eb4740f90.part /opt/stack/data/nova/instances/_base/5ce91137960695b182b989484841104eb4740f90.converted" returned: 0 in 0.674s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:46.648787 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5ce91137960695b182b989484841104eb4740f90.converted --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:46.648787 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5ce91137960695b182b989484841104eb4740f90.converted --force-share --output=json" returned: 0 in 0.087s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:46.648787 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Lock "5ce91137960695b182b989484841104eb4740f90" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.923s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:46.648787 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:57:46.648787 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:57:46.648787 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5ce91137960695b182b989484841104eb4740f90 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:46.684891 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5ce91137960695b182b989484841104eb4740f90 --force-share --output=json" returned: 0 in 0.066s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:46.687004 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Acquiring lock "5ce91137960695b182b989484841104eb4740f90" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:46.689348 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Lock "5ce91137960695b182b989484841104eb4740f90" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:46.689348 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:57:46.691927 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:57:46.691927 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5ce91137960695b182b989484841104eb4740f90 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:46.734368 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:46.743215 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:46.748025 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:46.768727 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:46.775142 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:46.776740 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5ce91137960695b182b989484841104eb4740f90 --force-share --output=json" returned: 0 in 0.083s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:46.777873 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5ce91137960695b182b989484841104eb4740f90,backing_fmt=raw /opt/stack/data/nova/instances/92fbf243-1c5b-47f6-9317-3fb2655651db/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:46.789510 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ffe66549-74f0-44a9-85b2-5471a3406453 req-2e7f5377-7e48-4f78-a246-756334a5db88 service nova] Releasing lock "refresh_cache-92fbf243-1c5b-47f6-9317-3fb2655651db" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:57:46.793545 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Acquired lock "refresh_cache-92fbf243-1c5b-47f6-9317-3fb2655651db" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:57:46.793777 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 09:57:46.824229 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:46.824436 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:46.829443 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 09:57:46.829850 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Claim successful on node np0000001613
May 28 09:57:46.832481 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5ce91137960695b182b989484841104eb4740f90,backing_fmt=raw /opt/stack/data/nova/instances/92fbf243-1c5b-47f6-9317-3fb2655651db/disk 1073741824" returned: 0 in 0.055s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:46.833060 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Lock "5ce91137960695b182b989484841104eb4740f90" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.145s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:46.833490 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5ce91137960695b182b989484841104eb4740f90 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:46.894770 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:57:46.902057 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 09:57:46.908693 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:46.911094 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5ce91137960695b182b989484841104eb4740f90 --force-share --output=json" returned: 0 in 0.077s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:46.911094 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Checking if we can resize image /opt/stack/data/nova/instances/92fbf243-1c5b-47f6-9317-3fb2655651db/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 09:57:46.911094 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92fbf243-1c5b-47f6-9317-3fb2655651db/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:46.997841 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92fbf243-1c5b-47f6-9317-3fb2655651db/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:46.998487 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Cannot resize image /opt/stack/data/nova/instances/92fbf243-1c5b-47f6-9317-3fb2655651db/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 09:57:46.999015 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 09:57:46.999283 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Ensure instance console log exists: /opt/stack/data/nova/instances/92fbf243-1c5b-47f6-9317-3fb2655651db/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 09:57:46.999660 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:47.000007 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:47.000146 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:47.176514 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 09:57:47.177843 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 09:57:47.178107 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Creating image(s)
May 28 09:57:47.178712 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Acquiring lock "/opt/stack/data/nova/instances/49ff17d1-cad9-463e-b5c1-3315c52412e6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:47.178916 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Lock "/opt/stack/data/nova/instances/49ff17d1-cad9-463e-b5c1-3315c52412e6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:47.179478 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Lock "/opt/stack/data/nova/instances/49ff17d1-cad9-463e-b5c1-3315c52412e6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:47.180073 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:57:47.182913 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:57:47.184250 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:47.197010 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:47.203379 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:47.206099 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:47.227214 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:47.237635 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:47.261018 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.077s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:47.261491 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:47.261957 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:47.262430 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:57:47.264848 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:57:47.265339 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:47.339682 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Successfully updated port: 3e64d22f-6078-49f1-9576-b70571e7f6e6 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 09:57:47.344480 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.079s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:47.346180 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/49ff17d1-cad9-463e-b5c1-3315c52412e6/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:47.398124 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/49ff17d1-cad9-463e-b5c1-3315c52412e6/disk 1073741824" returned: 0 in 0.053s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:47.398803 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.137s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:47.398950 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:47.413189 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 09:57:47.413189 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962267.4126034, 53ad56cc-eb5b-4e2e-a421-e93deee27fe7 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:57:47.413371 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] VM Started (Lifecycle Event)
May 28 09:57:47.422931 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 09:57:47.480002 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.081s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:47.480810 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Checking if we can resize image /opt/stack/data/nova/instances/49ff17d1-cad9-463e-b5c1-3315c52412e6/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 09:57:47.481225 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ff17d1-cad9-463e-b5c1-3315c52412e6/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:47.528589 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:57:47.528750 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:57:47.528904 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] No VIF found with MAC fa:16:3e:9a:42:b3, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 09:57:47.530564 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Using config drive
May 28 09:57:47.548383 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ff17d1-cad9-463e-b5c1-3315c52412e6/disk --force-share --output=json" returned: 0 in 0.067s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:47.548857 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Cannot resize image /opt/stack/data/nova/instances/49ff17d1-cad9-463e-b5c1-3315c52412e6/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 09:57:47.549218 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 09:57:47.549464 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Ensure instance console log exists: /opt/stack/data/nova/instances/49ff17d1-cad9-463e-b5c1-3315c52412e6/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 09:57:47.549742 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:47.550000 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:47.550260 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:47.675664 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:47.833845 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Updating instance_info_cache with network_info: [{"id": "89ae21a1-1d94-4446-8c5a-4aac2a148584", "address": "fa:16:3e:fb:01:60", "network": {"id": "ef2b39d2-3b8b-4ce9-87ad-a8930410e6ef", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1224875930-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "baa985120ab84c2a93a64fdab8e0d4e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ae21a1-1d", "ovs_interfaceid": "89ae21a1-1d94-4446-8c5a-4aac2a148584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:57:47.841863 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Acquiring lock "refresh_cache-49ff17d1-cad9-463e-b5c1-3315c52412e6" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:57:47.842018 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Acquired lock "refresh_cache-49ff17d1-cad9-463e-b5c1-3315c52412e6" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:57:47.842189 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 09:57:47.918258 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:57:47.920176 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962267.9197233, 53ad56cc-eb5b-4e2e-a421-e93deee27fe7 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:57:47.920419 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] VM Paused (Lifecycle Event)
May 28 09:57:48.037085 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:48.081961 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:57:48.082387 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:57:48.082639 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:57:48.082889 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:57:48.083119 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:57:48.083317 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:57:48.083543 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:57:48.083701 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 09:57:48.084043 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:57:48.187479 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Creating config drive at /opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783/disk.config
May 28 09:57:48.193922 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqzvwkcsn {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:48.224363 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqzvwkcsn" returned: 0 in 0.030s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:48.295321 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 09:57:48.295576 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 09:57:48.336146 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Releasing lock "refresh_cache-92fbf243-1c5b-47f6-9317-3fb2655651db" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:57:48.336656 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Instance network_info: |[{"id": "89ae21a1-1d94-4446-8c5a-4aac2a148584", "address": "fa:16:3e:fb:01:60", "network": {"id": "ef2b39d2-3b8b-4ce9-87ad-a8930410e6ef", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1224875930-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "baa985120ab84c2a93a64fdab8e0d4e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ae21a1-1d", "ovs_interfaceid": "89ae21a1-1d94-4446-8c5a-4aac2a148584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 09:57:48.338993 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Start _get_guest_xml network_info=[{"id": "89ae21a1-1d94-4446-8c5a-4aac2a148584", "address": "fa:16:3e:fb:01:60", "network": {"id": "ef2b39d2-3b8b-4ce9-87ad-a8930410e6ef", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1224875930-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "baa985120ab84c2a93a64fdab8e0d4e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ae21a1-1d", "ovs_interfaceid": "89ae21a1-1d94-4446-8c5a-4aac2a148584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:57:30Z,direct_url=<?>,disk_format='qcow2',id=a1c252d6-491c-463d-87b2-a292a48083c5,min_disk=0,min_ram=0,name='',owner='a33f4e58080d4dfdbc9f4b47f5328f96',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:57:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'disk_bus': 'scsi', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/sda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a1c252d6-491c-463d-87b2-a292a48083c5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 09:57:48.341784 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 09:57:48.343070 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a1c252d6-491c-463d-87b2-a292a48083c5', instance_meta=NovaInstanceMeta(name='tempest-AttachSCSIVolumeTestJSON-server-1949896838', uuid='92fbf243-1c5b-47f6-9317-3fb2655651db'), owner=OwnerMeta(userid='73c6a47f86bc47e4a7cd7260dc5edae1', username='tempest-AttachSCSIVolumeTestJSON-418965369-project-member', projectid='baa985120ab84c2a93a64fdab8e0d4e8', projectname='tempest-AttachSCSIVolumeTestJSON-418965369'), image=ImageMeta(id='a1c252d6-491c-463d-87b2-a292a48083c5', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'scsi', 'hw_disk_bus': 'scsi', 'hw_scsi_model': 'virtio-scsi'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "89ae21a1-1d94-4446-8c5a-4aac2a148584", "address": "fa:16:3e:fb:01:60", "network": {"id": "ef2b39d2-3b8b-4ce9-87ad-a8930410e6ef", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1224875930-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "baa985120ab84c2a93a64fdab8e0d4e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ae21a1-1d", "ovs_interfaceid": "89ae21a1-1d94-4446-8c5a-4aac2a148584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962268.3426905) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 09:57:48.345919 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 09:57:48.346598 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 09:57:48.347464 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 09:57:48.347647 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 09:57:48.348592 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 09:57:48.348931 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:57:30Z,direct_url=<?>,disk_format='qcow2',id=a1c252d6-491c-463d-87b2-a292a48083c5,min_disk=0,min_ram=0,name='',owner='a33f4e58080d4dfdbc9f4b47f5328f96',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:57:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 09:57:48.349069 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 09:57:48.349177 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 09:57:48.349327 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 09:57:48.349388 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 09:57:48.349485 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 09:57:48.349669 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 09:57:48.349829 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 09:57:48.349908 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 09:57:48.349998 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 09:57:48.350110 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 09:57:48.360106 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:57:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1949896838',display_name='tempest-AttachSCSIVolumeTestJSON-server-1949896838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachscsivolumetestjson-server-1949896838',id=5,image_ref='a1c252d6-491c-463d-87b2-a292a48083c5',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGM9TdR/OPIO9MiysANrzVBSzEbB0EmX/M3wNHB8gm6xBT8dBwF+rGmlDcy4bckPDS+I1+HdzKtgADMsraC6PVmcxPgE8+RQEgAVM5fmqviSdhcjEtE0UhcjZmysAX109Q==',key_name='tempest-keypair-1629740098',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='baa985120ab84c2a93a64fdab8e0d4e8',ramdisk_id='',reservation_id='r-9c63yvho',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a1c252d6-491c-463d-87b2-a292a48083c5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-418965369',owner_user_name='tempest-AttachSCSIVolumeTestJSON-418965369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:57:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73c6a47f86bc47e4a7cd7260dc5edae1',uuid=92fbf243-1c5b-47f6-9317-3fb2655651db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89ae21a1-1d94-4446-8c5a-4aac2a148584", "address": "fa:16:3e:fb:01:60", "network": {"id": "ef2b39d2-3b8b-4ce9-87ad-a8930410e6ef", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1224875930-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "baa985120ab84c2a93a64fdab8e0d4e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ae21a1-1d", "ovs_interfaceid": "89ae21a1-1d94-4446-8c5a-4aac2a148584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 09:57:48.360307 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Converting VIF {"id": "89ae21a1-1d94-4446-8c5a-4aac2a148584", "address": "fa:16:3e:fb:01:60", "network": {"id": "ef2b39d2-3b8b-4ce9-87ad-a8930410e6ef", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1224875930-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "baa985120ab84c2a93a64fdab8e0d4e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ae21a1-1d", "ovs_interfaceid": "89ae21a1-1d94-4446-8c5a-4aac2a148584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:57:48.360899 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:01:60,bridge_name='br-int',has_traffic_filtering=True,id=89ae21a1-1d94-4446-8c5a-4aac2a148584,network=Network(ef2b39d2-3b8b-4ce9-87ad-a8930410e6ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89ae21a1-1d') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:57:48.361422 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Lazy-loading 'pci_devices' on Instance uuid 92fbf243-1c5b-47f6-9317-3fb2655651db {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:57:48.414315 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 09:57:48.423269 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:57:48.425262 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 09:57:48.442807 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d1101f30-0088-43b4-befa-dbb53cde94e6 req-db964ded-b784-448f-8844-da47ab83ef4e service nova] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Received event network-changed-3e64d22f-6078-49f1-9576-b70571e7f6e6 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:57:48.443334 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d1101f30-0088-43b4-befa-dbb53cde94e6 req-db964ded-b784-448f-8844-da47ab83ef4e service nova] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Refreshing instance network info cache due to event network-changed-3e64d22f-6078-49f1-9576-b70571e7f6e6. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 09:57:48.443521 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d1101f30-0088-43b4-befa-dbb53cde94e6 req-db964ded-b784-448f-8844-da47ab83ef4e service nova] Acquiring lock "refresh_cache-49ff17d1-cad9-463e-b5c1-3315c52412e6" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:57:48.587765 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:48.595282 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:48.692991 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:48.717926 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:48.720553 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:48.800773 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Updating instance_info_cache with network_info: [{"id": "3e64d22f-6078-49f1-9576-b70571e7f6e6", "address": "fa:16:3e:2a:71:9a", "network": {"id": "e91751cc-c82c-4197-9ce7-ff2b4d8440a8", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-702597350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "af05aeb984e64ba8989f3db86750c648", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e64d22f-60", "ovs_interfaceid": "3e64d22f-6078-49f1-9576-b70571e7f6e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:57:48.802386 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 09:57:48.827394 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:48.865053 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] End _get_guest_xml xml=<domain type="qemu">
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:   <uuid>92fbf243-1c5b-47f6-9317-3fb2655651db</uuid>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:   <name>instance-00000005</name>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:   <metadata>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1949896838</nova:name>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 09:57:48</nova:creationTime>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:       <nova:image uuid="a1c252d6-491c-463d-87b2-a292a48083c5">
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:           <nova:property name="hw_cdrom_bus">scsi</nova:property>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:           <nova:property name="hw_disk_bus">scsi</nova:property>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:           <nova:property name="hw_scsi_model">virtio-scsi</nova:property>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:       </nova:image>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:         <nova:user uuid="73c6a47f86bc47e4a7cd7260dc5edae1">tempest-AttachSCSIVolumeTestJSON-418965369-project-member</nova:user>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:         <nova:project uuid="baa985120ab84c2a93a64fdab8e0d4e8">tempest-AttachSCSIVolumeTestJSON-418965369</nova:project>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a1c252d6-491c-463d-87b2-a292a48083c5"/>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:         <nova:port uuid="89ae21a1-1d94-4446-8c5a-4aac2a148584">
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:         </nova:port>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:   </metadata>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:     <system>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:       <entry name="serial">92fbf243-1c5b-47f6-9317-3fb2655651db</entry>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:       <entry name="uuid">92fbf243-1c5b-47f6-9317-3fb2655651db</entry>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:     </system>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:   <os>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:   </os>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:   <features>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:     <acpi/>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:     <tcg>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:     </tcg>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:   </features>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:   <devices>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/92fbf243-1c5b-47f6-9317-3fb2655651db/disk"/>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:       <target dev="sda" bus="scsi"/>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:       <address type="drive" controller="0" unit="0"/>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:     </disk>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/92fbf243-1c5b-47f6-9317-3fb2655651db/disk.config"/>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:       <target dev="sdb" bus="scsi"/>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:       <address type="drive" controller="0" unit="1"/>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:     </disk>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:     <controller type="scsi" index="0" model="virtio-scsi"/>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:fb:01:60"/>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:       <target dev="tap89ae21a1-1d"/>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:     </interface>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/92fbf243-1c5b-47f6-9317-3fb2655651db/console.log" append="off"/>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:     </serial>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:     <video>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:     </video>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:     </rng>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:     </memballoon>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:   </devices>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]: </domain>
May 28 09:57:48.865053 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 09:57:48.866846 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Preparing to wait for external event network-vif-plugged-89ae21a1-1d94-4446-8c5a-4aac2a148584 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 09:57:48.866846 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Acquiring lock "92fbf243-1c5b-47f6-9317-3fb2655651db-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:48.866846 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Lock "92fbf243-1c5b-47f6-9317-3fb2655651db-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:48.866846 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Lock "92fbf243-1c5b-47f6-9317-3fb2655651db-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:48.866846 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:57:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1949896838',display_name='tempest-AttachSCSIVolumeTestJSON-server-1949896838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachscsivolumetestjson-server-1949896838',id=5,image_ref='a1c252d6-491c-463d-87b2-a292a48083c5',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGM9TdR/OPIO9MiysANrzVBSzEbB0EmX/M3wNHB8gm6xBT8dBwF+rGmlDcy4bckPDS+I1+HdzKtgADMsraC6PVmcxPgE8+RQEgAVM5fmqviSdhcjEtE0UhcjZmysAX109Q==',key_name='tempest-keypair-1629740098',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='baa985120ab84c2a93a64fdab8e0d4e8',ramdisk_id='',reservation_id='r-9c63yvho',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a1c252d6-491c-463d-87b2-a292a48083c5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-418965369',owner_user_name='tempest-AttachSCSIVolumeTestJSON-418965369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:57:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73c6a47f86bc47e4a7cd7260dc5edae1',uuid=92fbf243-1c5b-47f6-9317-3fb2655651db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89ae21a1-1d94-4446-8c5a-4aac2a148584", "address": "fa:16:3e:fb:01:60", "network": {"id": "ef2b39d2-3b8b-4ce9-87ad-a8930410e6ef", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1224875930-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "baa985120ab84c2a93a64fdab8e0d4e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ae21a1-1d", "ovs_interfaceid": "89ae21a1-1d94-4446-8c5a-4aac2a148584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 09:57:48.867045 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Converting VIF {"id": "89ae21a1-1d94-4446-8c5a-4aac2a148584", "address": "fa:16:3e:fb:01:60", "network": {"id": "ef2b39d2-3b8b-4ce9-87ad-a8930410e6ef", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1224875930-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "baa985120ab84c2a93a64fdab8e0d4e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ae21a1-1d", "ovs_interfaceid": "89ae21a1-1d94-4446-8c5a-4aac2a148584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:57:48.867268 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:01:60,bridge_name='br-int',has_traffic_filtering=True,id=89ae21a1-1d94-4446-8c5a-4aac2a148584,network=Network(ef2b39d2-3b8b-4ce9-87ad-a8930410e6ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89ae21a1-1d') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:57:48.868044 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:01:60,bridge_name='br-int',has_traffic_filtering=True,id=89ae21a1-1d94-4446-8c5a-4aac2a148584,network=Network(ef2b39d2-3b8b-4ce9-87ad-a8930410e6ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89ae21a1-1d') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 09:57:48.868044 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:48.868044 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:57:48.868242 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 09:57:48.868848 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:48.868990 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0ded8f38-d7a6-574f-a8f1-0296578e0aa8', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:57:48.870862 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:57:48.872629 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:48.872780 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89ae21a1-1d, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:57:48.873066 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap89ae21a1-1d, col_values=(('qos', UUID('fd6621a9-2207-420f-a0ce-312603c08eeb')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:57:48.873231 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap89ae21a1-1d, col_values=(('external_ids', {'iface-id': '89ae21a1-1d94-4446-8c5a-4aac2a148584', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:01:60', 'vm-uuid': '92fbf243-1c5b-47f6-9317-3fb2655651db'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:57:48.875228 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:57:48.880840 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:48.882058 np0000001613 nova-compute[98321]: INFO os_vif [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:01:60,bridge_name='br-int',has_traffic_filtering=True,id=89ae21a1-1d94-4446-8c5a-4aac2a148584,network=Network(ef2b39d2-3b8b-4ce9-87ad-a8930410e6ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89ae21a1-1d')
May 28 09:57:48.928147 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 09:57:49.016113 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:49.023757 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:49.026267 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:49.045654 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:49.053204 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:49.123970 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:49.309689 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Releasing lock "refresh_cache-49ff17d1-cad9-463e-b5c1-3315c52412e6" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:57:49.310022 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Instance network_info: |[{"id": "3e64d22f-6078-49f1-9576-b70571e7f6e6", "address": "fa:16:3e:2a:71:9a", "network": {"id": "e91751cc-c82c-4197-9ce7-ff2b4d8440a8", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-702597350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "af05aeb984e64ba8989f3db86750c648", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e64d22f-60", "ovs_interfaceid": "3e64d22f-6078-49f1-9576-b70571e7f6e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 09:57:49.311693 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Start _get_guest_xml network_info=[{"id": "3e64d22f-6078-49f1-9576-b70571e7f6e6", "address": "fa:16:3e:2a:71:9a", "network": {"id": "e91751cc-c82c-4197-9ce7-ff2b4d8440a8", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-702597350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "af05aeb984e64ba8989f3db86750c648", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e64d22f-60", "ovs_interfaceid": "3e64d22f-6078-49f1-9576-b70571e7f6e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 09:57:49.313243 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.489s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:49.314532 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d1101f30-0088-43b4-befa-dbb53cde94e6 req-db964ded-b784-448f-8844-da47ab83ef4e service nova] Acquired lock "refresh_cache-49ff17d1-cad9-463e-b5c1-3315c52412e6" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:57:49.316285 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.406s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:49.316521 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 09:57:49.319395 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-d1101f30-0088-43b4-befa-dbb53cde94e6 req-db964ded-b784-448f-8844-da47ab83ef4e service nova] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Refreshing network info cache for port 3e64d22f-6078-49f1-9576-b70571e7f6e6 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 09:57:49.322644 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 09:57:49.322797 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Claim successful on node np0000001613
May 28 09:57:49.326233 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 09:57:49.327619 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-VolumesAssistedSnapshotsTest-server-1733345190', uuid='49ff17d1-cad9-463e-b5c1-3315c52412e6'), owner=OwnerMeta(userid='45e753a39564489a9afff10dd05c3ced', username='tempest-VolumesAssistedSnapshotsTest-1941135530-project-member', projectid='af05aeb984e64ba8989f3db86750c648', projectname='tempest-VolumesAssistedSnapshotsTest-1941135530'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3e64d22f-6078-49f1-9576-b70571e7f6e6", "address": "fa:16:3e:2a:71:9a", "network": {"id": "e91751cc-c82c-4197-9ce7-ff2b4d8440a8", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-702597350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "af05aeb984e64ba8989f3db86750c648", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e64d22f-60", "ovs_interfaceid": "3e64d22f-6078-49f1-9576-b70571e7f6e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962269.3272698) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 09:57:49.332616 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 09:57:49.333049 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 09:57:49.335006 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 09:57:49.335223 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 09:57:49.335995 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 09:57:49.336304 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 09:57:49.336432 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 09:57:49.336514 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 09:57:49.336626 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 09:57:49.336701 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 09:57:49.336795 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 09:57:49.336927 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 09:57:49.337011 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 09:57:49.337107 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 09:57:49.337269 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 09:57:49.337445 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 09:57:49.347937 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T09:57:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1733345190',display_name='tempest-VolumesAssistedSnapshotsTest-server-1733345190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumesassistedsnapshotstest-server-1733345190',id=6,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmJjhEiTSAuvC4mG+VG6tUVtNygtcV8o8Y4a+0I2OHI0tw+q06AbmSEJsRWkbhmxN5GXIwxf1+dwdIc5mNkx3nu7Ie10Hr4C9clRJIgKVVGkPKK7IAdtQFEm/OWOy+4MQ==',key_name='tempest-keypair-1416310460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af05aeb984e64ba8989f3db86750c648',ramdisk_id='',reservation_id='r-i9kugpnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1941135530',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1941135530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:57:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45e753a39564489a9afff10dd05c3ced',uuid=49ff17d1-cad9-463e-b5c1-3315c52412e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e64d22f-6078-49f1-9576-b70571e7f6e6", "address": "fa:16:3e:2a:71:9a", "network": {"id": "e91751cc-c82c-4197-9ce7-ff2b4d8440a8", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-702597350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "af05aeb984e64ba8989f3db86750c648", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e64d22f-60", "ovs_interfaceid": "3e64d22f-6078-49f1-9576-b70571e7f6e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 09:57:49.348211 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Converting VIF {"id": "3e64d22f-6078-49f1-9576-b70571e7f6e6", "address": "fa:16:3e:2a:71:9a", "network": {"id": "e91751cc-c82c-4197-9ce7-ff2b4d8440a8", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-702597350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "af05aeb984e64ba8989f3db86750c648", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e64d22f-60", "ovs_interfaceid": "3e64d22f-6078-49f1-9576-b70571e7f6e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:57:49.348531 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:71:9a,bridge_name='br-int',has_traffic_filtering=True,id=3e64d22f-6078-49f1-9576-b70571e7f6e6,network=Network(e91751cc-c82c-4197-9ce7-ff2b4d8440a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e64d22f-60') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:57:49.348919 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Lazy-loading 'pci_devices' on Instance uuid 49ff17d1-cad9-463e-b5c1-3315c52412e6 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:57:49.512016 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962269.5116568, e2856743-3a60-4be1-b29c-b4de06f14783 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:57:49.512198 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] VM Started (Lifecycle Event)
May 28 09:57:49.827288 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-d1101f30-0088-43b4-befa-dbb53cde94e6 req-db964ded-b784-448f-8844-da47ab83ef4e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:49.837614 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 09:57:49.837614 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 09:57:49.837614 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:49.837614 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:49.851678 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] End _get_guest_xml xml=<domain type="qemu">
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:   <uuid>49ff17d1-cad9-463e-b5c1-3315c52412e6</uuid>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:   <name>instance-00000006</name>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:   <metadata>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1733345190</nova:name>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 09:57:49</nova:creationTime>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:       </nova:image>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:         <nova:user uuid="45e753a39564489a9afff10dd05c3ced">tempest-VolumesAssistedSnapshotsTest-1941135530-project-member</nova:user>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:         <nova:project uuid="af05aeb984e64ba8989f3db86750c648">tempest-VolumesAssistedSnapshotsTest-1941135530</nova:project>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:         <nova:port uuid="3e64d22f-6078-49f1-9576-b70571e7f6e6">
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:         </nova:port>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:   </metadata>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:     <system>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:       <entry name="serial">49ff17d1-cad9-463e-b5c1-3315c52412e6</entry>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:       <entry name="uuid">49ff17d1-cad9-463e-b5c1-3315c52412e6</entry>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:     </system>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:   <os>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:   </os>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:   <features>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:     <acpi/>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:     <tcg>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:     </tcg>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:   </features>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:   <devices>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/49ff17d1-cad9-463e-b5c1-3315c52412e6/disk"/>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:     </disk>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/49ff17d1-cad9-463e-b5c1-3315c52412e6/disk.config"/>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:     </disk>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:2a:71:9a"/>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:       <target dev="tap3e64d22f-60"/>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:     </interface>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/49ff17d1-cad9-463e-b5c1-3315c52412e6/console.log" append="off"/>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:     </serial>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:     <video>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:     </video>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:     </rng>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:     </memballoon>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:   </devices>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]: </domain>
May 28 09:57:49.851678 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 09:57:49.854950 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Preparing to wait for external event network-vif-plugged-3e64d22f-6078-49f1-9576-b70571e7f6e6 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 09:57:49.854950 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Acquiring lock "49ff17d1-cad9-463e-b5c1-3315c52412e6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:49.854950 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Lock "49ff17d1-cad9-463e-b5c1-3315c52412e6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:49.854950 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Lock "49ff17d1-cad9-463e-b5c1-3315c52412e6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:49.854950 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T09:57:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1733345190',display_name='tempest-VolumesAssistedSnapshotsTest-server-1733345190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumesassistedsnapshotstest-server-1733345190',id=6,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmJjhEiTSAuvC4mG+VG6tUVtNygtcV8o8Y4a+0I2OHI0tw+q06AbmSEJsRWkbhmxN5GXIwxf1+dwdIc5mNkx3nu7Ie10Hr4C9clRJIgKVVGkPKK7IAdtQFEm/OWOy+4MQ==',key_name='tempest-keypair-1416310460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af05aeb984e64ba8989f3db86750c648',ramdisk_id='',reservation_id='r-i9kugpnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1941135530',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1941135530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:57:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45e753a39564489a9afff10dd05c3ced',uuid=49ff17d1-cad9-463e-b5c1-3315c52412e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e64d22f-6078-49f1-9576-b70571e7f6e6", "address": "fa:16:3e:2a:71:9a", "network": {"id": "e91751cc-c82c-4197-9ce7-ff2b4d8440a8", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-702597350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "af05aeb984e64ba8989f3db86750c648", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e64d22f-60", "ovs_interfaceid": "3e64d22f-6078-49f1-9576-b70571e7f6e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 09:57:49.855300 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Converting VIF {"id": "3e64d22f-6078-49f1-9576-b70571e7f6e6", "address": "fa:16:3e:2a:71:9a", "network": {"id": "e91751cc-c82c-4197-9ce7-ff2b4d8440a8", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-702597350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "af05aeb984e64ba8989f3db86750c648", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e64d22f-60", "ovs_interfaceid": "3e64d22f-6078-49f1-9576-b70571e7f6e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:57:49.855300 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:71:9a,bridge_name='br-int',has_traffic_filtering=True,id=3e64d22f-6078-49f1-9576-b70571e7f6e6,network=Network(e91751cc-c82c-4197-9ce7-ff2b4d8440a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e64d22f-60') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:57:49.855300 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:71:9a,bridge_name='br-int',has_traffic_filtering=True,id=3e64d22f-6078-49f1-9576-b70571e7f6e6,network=Network(e91751cc-c82c-4197-9ce7-ff2b4d8440a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e64d22f-60') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 09:57:49.855300 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:49.855438 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:57:49.856538 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 09:57:49.859005 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:49.859005 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3e6cb357-0f46-5bba-bc3c-60df3e1899e4', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:57:49.859984 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:49.860415 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:57:49.866339 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:49.869237 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:49.869417 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e64d22f-60, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:57:49.869713 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3e64d22f-60, col_values=(('qos', UUID('625e9aa7-5490-4be1-94fb-9dfaf1e5df6d')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:57:49.869923 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3e64d22f-60, col_values=(('external_ids', {'iface-id': '3e64d22f-6078-49f1-9576-b70571e7f6e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:71:9a', 'vm-uuid': '49ff17d1-cad9-463e-b5c1-3315c52412e6'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:57:49.871979 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:49.873670 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:57:49.884371 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:49.885794 np0000001613 nova-compute[98321]: INFO os_vif [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:71:9a,bridge_name='br-int',has_traffic_filtering=True,id=3e64d22f-6078-49f1-9576-b70571e7f6e6,network=Network(e91751cc-c82c-4197-9ce7-ff2b4d8440a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e64d22f-60')
May 28 09:57:50.006633 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '010fbd8229d546b5aa445ca570266726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4466c6404538446eb4c8bd45bb2a95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 09:57:50.014340 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:57:50.016904 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962270.0166104, e2856743-3a60-4be1-b29c-b4de06f14783 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:57:50.017065 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] VM Paused (Lifecycle Event)
May 28 09:57:50.218098 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-d1101f30-0088-43b4-befa-dbb53cde94e6 req-db964ded-b784-448f-8844-da47ab83ef4e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:50.337894 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 09:57:50.424026 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] No BDM found with device name sda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:57:50.424222 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] No BDM found with device name sdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:57:50.424352 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] No VIF found with MAC fa:16:3e:fb:01:60, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 09:57:50.425130 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Using config drive
May 28 09:57:50.519807 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:57:50.522307 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-d1101f30-0088-43b4-befa-dbb53cde94e6 req-db964ded-b784-448f-8844-da47ab83ef4e service nova] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Updated VIF entry in instance network info cache for port 3e64d22f-6078-49f1-9576-b70571e7f6e6. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 09:57:50.522515 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-d1101f30-0088-43b4-befa-dbb53cde94e6 req-db964ded-b784-448f-8844-da47ab83ef4e service nova] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Updating instance_info_cache with network_info: [{"id": "3e64d22f-6078-49f1-9576-b70571e7f6e6", "address": "fa:16:3e:2a:71:9a", "network": {"id": "e91751cc-c82c-4197-9ce7-ff2b4d8440a8", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-702597350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "af05aeb984e64ba8989f3db86750c648", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e64d22f-60", "ovs_interfaceid": "3e64d22f-6078-49f1-9576-b70571e7f6e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:57:50.531220 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 09:57:50.695813 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Successfully created port: f6d7e225-75f0-45c5-a7b7-7ff36e772079 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 09:57:50.847671 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 09:57:50.859460 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 09:57:50.859672 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 09:57:50.933046 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:51.029391 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d1101f30-0088-43b4-befa-dbb53cde94e6 req-db964ded-b784-448f-8844-da47ab83ef4e service nova] Releasing lock "refresh_cache-49ff17d1-cad9-463e-b5c1-3315c52412e6" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:57:51.031954 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 09:57:51.362341 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 09:57:51.412910 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:57:51.413120 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:57:51.413314 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] No VIF found with MAC fa:16:3e:2a:71:9a, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 09:57:51.413856 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Using config drive
May 28 09:57:51.442451 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Successfully updated port: f6d7e225-75f0-45c5-a7b7-7ff36e772079 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 09:57:51.502481 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Creating config drive at /opt/stack/data/nova/instances/92fbf243-1c5b-47f6-9317-3fb2655651db/disk.config
May 28 09:57:51.506463 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/92fbf243-1c5b-47f6-9317-3fb2655651db/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpijdm_1d7 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:51.540225 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/92fbf243-1c5b-47f6-9317-3fb2655651db/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpijdm_1d7" returned: 0 in 0.033s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:51.696574 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-18658727-95e0-4831-ac4c-25b47b36b871 req-048df3e8-acd0-4fe4-9b40-60eed3334336 service nova] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Received event network-changed-f6d7e225-75f0-45c5-a7b7-7ff36e772079 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:57:51.696847 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-18658727-95e0-4831-ac4c-25b47b36b871 req-048df3e8-acd0-4fe4-9b40-60eed3334336 service nova] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Refreshing instance network info cache due to event network-changed-f6d7e225-75f0-45c5-a7b7-7ff36e772079. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 09:57:51.697211 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-18658727-95e0-4831-ac4c-25b47b36b871 req-048df3e8-acd0-4fe4-9b40-60eed3334336 service nova] Acquiring lock "refresh_cache-4a28d569-1ca9-4657-840c-7bb31d4644c8" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:57:51.697384 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-18658727-95e0-4831-ac4c-25b47b36b871 req-048df3e8-acd0-4fe4-9b40-60eed3334336 service nova] Acquired lock "refresh_cache-4a28d569-1ca9-4657-840c-7bb31d4644c8" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:57:51.697956 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-18658727-95e0-4831-ac4c-25b47b36b871 req-048df3e8-acd0-4fe4-9b40-60eed3334336 service nova] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Refreshing network info cache for port f6d7e225-75f0-45c5-a7b7-7ff36e772079 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 09:57:51.856208 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 09:57:51.858205 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 09:57:51.858300 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Creating image(s)
May 28 09:57:51.858877 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a28d569-1ca9-4657-840c-7bb31d4644c8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:51.859354 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "/opt/stack/data/nova/instances/4a28d569-1ca9-4657-840c-7bb31d4644c8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:51.859576 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "/opt/stack/data/nova/instances/4a28d569-1ca9-4657-840c-7bb31d4644c8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:51.860772 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:57:51.862664 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:57:51.863951 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:51.876220 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.562s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:51.877684 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 3.289s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:51.878251 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 09:57:51.882546 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:51.882898 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Auditing locally available compute resources for np0000001613 (node: np0000001613) {{(pid=98321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 09:57:51.921064 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:51.944443 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Acquiring lock "refresh_cache-4a28d569-1ca9-4657-840c-7bb31d4644c8" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:57:51.951984 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.088s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:51.952659 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:51.953152 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:51.954521 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:57:51.958882 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:57:51.959598 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:51.974062 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:52.004676 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:52.009013 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:52.033309 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.074s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:52.033990 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/4a28d569-1ca9-4657-840c-7bb31d4644c8/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:52.096672 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/4a28d569-1ca9-4657-840c-7bb31d4644c8/disk 1073741824" returned: 0 in 0.063s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:52.097275 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.144s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:52.097588 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:52.107209 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:52.111303 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Creating config drive at /opt/stack/data/nova/instances/49ff17d1-cad9-463e-b5c1-3315c52412e6/disk.config
May 28 09:57:52.119477 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/49ff17d1-cad9-463e-b5c1-3315c52412e6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpw25g9mak {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:52.164401 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/49ff17d1-cad9-463e-b5c1-3315c52412e6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpw25g9mak" returned: 0 in 0.042s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:52.184649 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.087s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:52.187010 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4a28d569-1ca9-4657-840c-7bb31d4644c8/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 09:57:52.187010 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a28d569-1ca9-4657-840c-7bb31d4644c8/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:52.203017 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-18658727-95e0-4831-ac4c-25b47b36b871 req-048df3e8-acd0-4fe4-9b40-60eed3334336 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:52.269462 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a28d569-1ca9-4657-840c-7bb31d4644c8/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:52.269968 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Cannot resize image /opt/stack/data/nova/instances/4a28d569-1ca9-4657-840c-7bb31d4644c8/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 09:57:52.270457 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 09:57:52.270799 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Ensure instance console log exists: /opt/stack/data/nova/instances/4a28d569-1ca9-4657-840c-7bb31d4644c8/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 09:57:52.271151 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:52.271566 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:52.271821 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:52.292992 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-18658727-95e0-4831-ac4c-25b47b36b871 req-048df3e8-acd0-4fe4-9b40-60eed3334336 service nova] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 09:57:52.339504 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:52.349360 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:52.352299 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:52.378064 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:52.390031 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 09:57:52.391583 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 09:57:52.392701 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:52.393020 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:52.395291 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:52.509274 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-18658727-95e0-4831-ac4c-25b47b36b871 req-048df3e8-acd0-4fe4-9b40-60eed3334336 service nova] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:57:52.524631 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '010fbd8229d546b5aa445ca570266726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4466c6404538446eb4c8bd45bb2a95f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 09:57:52.698580 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:52.722988 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:52.725253 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:52.749823 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ce550ee1-80e7-45fd-b443-e7a85a7b702f req-f83d4a5c-909f-47b8-8114-96cdcfd517e1 service nova] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Received event network-vif-unplugged-0ed2dfa0-2fb5-4493-91e8-597b70a39c6b {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:57:52.750067 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ce550ee1-80e7-45fd-b443-e7a85a7b702f req-f83d4a5c-909f-47b8-8114-96cdcfd517e1 service nova] Acquiring lock "e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:52.751124 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ce550ee1-80e7-45fd-b443-e7a85a7b702f req-f83d4a5c-909f-47b8-8114-96cdcfd517e1 service nova] Lock "e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:52.751124 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ce550ee1-80e7-45fd-b443-e7a85a7b702f req-f83d4a5c-909f-47b8-8114-96cdcfd517e1 service nova] Lock "e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:52.751124 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ce550ee1-80e7-45fd-b443-e7a85a7b702f req-f83d4a5c-909f-47b8-8114-96cdcfd517e1 service nova] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] No event matching network-vif-unplugged-0ed2dfa0-2fb5-4493-91e8-597b70a39c6b in dict_keys([('network-vif-plugged', '0ed2dfa0-2fb5-4493-91e8-597b70a39c6b')]) {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 09:57:52.751124 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-ce550ee1-80e7-45fd-b443-e7a85a7b702f req-f83d4a5c-909f-47b8-8114-96cdcfd517e1 service nova] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Received unexpected event network-vif-unplugged-0ed2dfa0-2fb5-4493-91e8-597b70a39c6b for instance with vm_state building and task_state spawning.
May 28 09:57:52.835899 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:52.893644 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 09:57:53.013748 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-18658727-95e0-4831-ac4c-25b47b36b871 req-048df3e8-acd0-4fe4-9b40-60eed3334336 service nova] Releasing lock "refresh_cache-4a28d569-1ca9-4657-840c-7bb31d4644c8" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:57:53.014513 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Acquired lock "refresh_cache-4a28d569-1ca9-4657-840c-7bb31d4644c8" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:57:53.014699 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 09:57:53.072384 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962273.071875, 92fbf243-1c5b-47f6-9317-3fb2655651db => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:57:53.072445 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] VM Started (Lifecycle Event)
May 28 09:57:53.079605 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:53.081232 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:53.089421 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:53.090613 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:53.106295 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:53.211321 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Successfully created port: 5169a8fe-f36b-4d06-8497-4407070563c7 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 09:57:53.398152 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 09:57:53.575130 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:57:53.577671 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962273.5772836, 92fbf243-1c5b-47f6-9317-3fb2655651db => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:57:53.577924 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] VM Paused (Lifecycle Event)
May 28 09:57:53.679390 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 09:57:53.855984 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Successfully updated port: 5169a8fe-f36b-4d06-8497-4407070563c7 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 09:57:53.896003 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:53.910866 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-da1b7f32-7e9d-4338-a5c5-ab410a82ab12 req-7770fb30-d977-4b22-a7f7-15b13270ac60 service nova] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Received event network-changed-5169a8fe-f36b-4d06-8497-4407070563c7 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:57:53.912179 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-da1b7f32-7e9d-4338-a5c5-ab410a82ab12 req-7770fb30-d977-4b22-a7f7-15b13270ac60 service nova] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Refreshing instance network info cache due to event network-changed-5169a8fe-f36b-4d06-8497-4407070563c7. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 09:57:53.912467 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-da1b7f32-7e9d-4338-a5c5-ab410a82ab12 req-7770fb30-d977-4b22-a7f7-15b13270ac60 service nova] Acquiring lock "refresh_cache-0dca786c-46bb-48dc-a01a-e282daa84a89" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:57:53.912602 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-da1b7f32-7e9d-4338-a5c5-ab410a82ab12 req-7770fb30-d977-4b22-a7f7-15b13270ac60 service nova] Acquired lock "refresh_cache-0dca786c-46bb-48dc-a01a-e282daa84a89" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:57:53.912765 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-da1b7f32-7e9d-4338-a5c5-ab410a82ab12 req-7770fb30-d977-4b22-a7f7-15b13270ac60 service nova] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Refreshing network info cache for port 5169a8fe-f36b-4d06-8497-4407070563c7 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 09:57:53.924587 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:54.000500 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783/disk --force-share --output=json" returned: 0 in 0.076s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:54.001148 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:54.081579 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:57:54.085418 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 09:57:54.089667 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:54.092659 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92fbf243-1c5b-47f6-9317-3fb2655651db/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:54.126003 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:54.161817 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Updating instance_info_cache with network_info: [{"id": "f6d7e225-75f0-45c5-a7b7-7ff36e772079", "address": "fa:16:3e:9c:2e:17", "network": {"id": "d4fe3269-1c90-4590-b389-2d9e64a1874b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-397043690-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4466c6404538446eb4c8bd45bb2a95f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6d7e225-75", "ovs_interfaceid": "f6d7e225-75f0-45c5-a7b7-7ff36e772079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:57:54.163596 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92fbf243-1c5b-47f6-9317-3fb2655651db/disk --force-share --output=json" returned: 0 in 0.071s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:54.164124 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92fbf243-1c5b-47f6-9317-3fb2655651db/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:54.252559 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92fbf243-1c5b-47f6-9317-3fb2655651db/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:54.258381 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/289e2914-2be4-4f46-92e0-fa623f8db861/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:54.340205 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/289e2914-2be4-4f46-92e0-fa623f8db861/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:54.340721 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/289e2914-2be4-4f46-92e0-fa623f8db861/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:54.359618 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Acquiring lock "refresh_cache-0dca786c-46bb-48dc-a01a-e282daa84a89" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:57:54.404930 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/289e2914-2be4-4f46-92e0-fa623f8db861/disk --force-share --output=json" returned: 0 in 0.064s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:54.407904 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 09:57:54.410102 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ff17d1-cad9-463e-b5c1-3315c52412e6/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:54.410582 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 09:57:54.419369 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Creating image(s)
May 28 09:57:54.421255 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Acquiring lock "/opt/stack/data/nova/instances/0dca786c-46bb-48dc-a01a-e282daa84a89/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:54.421673 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "/opt/stack/data/nova/instances/0dca786c-46bb-48dc-a01a-e282daa84a89/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:54.423324 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-da1b7f32-7e9d-4338-a5c5-ab410a82ab12 req-7770fb30-d977-4b22-a7f7-15b13270ac60 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:54.427695 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "/opt/stack/data/nova/instances/0dca786c-46bb-48dc-a01a-e282daa84a89/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:54.428517 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:57:54.431107 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:57:54.432270 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:54.484237 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ff17d1-cad9-463e-b5c1-3315c52412e6/disk --force-share --output=json" returned: 0 in 0.074s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:54.484678 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ff17d1-cad9-463e-b5c1-3315c52412e6/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:54.504362 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.071s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:54.505618 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:54.505618 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:54.507245 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:57:54.510126 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:57:54.510451 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:54.529932 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-da1b7f32-7e9d-4338-a5c5-ab410a82ab12 req-7770fb30-d977-4b22-a7f7-15b13270ac60 service nova] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 09:57:54.551140 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ff17d1-cad9-463e-b5c1-3315c52412e6/disk --force-share --output=json" returned: 0 in 0.066s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:54.553540 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:54.583563 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.073s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:54.584470 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/0dca786c-46bb-48dc-a01a-e282daa84a89/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:54.592669 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 09:57:54.593474 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962274.5930998, 49ff17d1-cad9-463e-b5c1-3315c52412e6 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:57:54.593722 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] VM Started (Lifecycle Event)
May 28 09:57:54.638132 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:54.639025 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:54.651726 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/0dca786c-46bb-48dc-a01a-e282daa84a89/disk 1073741824" returned: 0 in 0.066s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:54.653269 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.147s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:54.654007 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:54.669828 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Releasing lock "refresh_cache-4a28d569-1ca9-4657-840c-7bb31d4644c8" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:57:54.672982 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Instance network_info: |[{"id": "f6d7e225-75f0-45c5-a7b7-7ff36e772079", "address": "fa:16:3e:9c:2e:17", "network": {"id": "d4fe3269-1c90-4590-b389-2d9e64a1874b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-397043690-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4466c6404538446eb4c8bd45bb2a95f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6d7e225-75", "ovs_interfaceid": "f6d7e225-75f0-45c5-a7b7-7ff36e772079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 09:57:54.677929 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Start _get_guest_xml network_info=[{"id": "f6d7e225-75f0-45c5-a7b7-7ff36e772079", "address": "fa:16:3e:9c:2e:17", "network": {"id": "d4fe3269-1c90-4590-b389-2d9e64a1874b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-397043690-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4466c6404538446eb4c8bd45bb2a95f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6d7e225-75", "ovs_interfaceid": "f6d7e225-75f0-45c5-a7b7-7ff36e772079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 09:57:54.685346 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Acquiring lock "7514b113-ec17-468b-a647-de099d90e787" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:54.685638 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "7514b113-ec17-468b-a647-de099d90e787" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:54.687560 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 09:57:54.689334 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-475302226-1', uuid='4a28d569-1ca9-4657-840c-7bb31d4644c8'), owner=OwnerMeta(userid='010fbd8229d546b5aa445ca570266726', username='tempest-TestMultiAttachVolumeSwap-193507140-project-member', projectid='4466c6404538446eb4c8bd45bb2a95f5', projectname='tempest-TestMultiAttachVolumeSwap-193507140'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f6d7e225-75f0-45c5-a7b7-7ff36e772079", "address": "fa:16:3e:9c:2e:17", "network": {"id": "d4fe3269-1c90-4590-b389-2d9e64a1874b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-397043690-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4466c6404538446eb4c8bd45bb2a95f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6d7e225-75", "ovs_interfaceid": "f6d7e225-75f0-45c5-a7b7-7ff36e772079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962274.6887014) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 09:57:54.693691 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 09:57:54.693691 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 09:57:54.696122 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 09:57:54.697262 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 09:57:54.697262 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 09:57:54.697584 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 09:57:54.697735 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 09:57:54.697829 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 09:57:54.697961 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 09:57:54.698075 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 09:57:54.698229 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 09:57:54.698443 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 09:57:54.698580 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 09:57:54.698755 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 09:57:54.699145 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 09:57:54.699376 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 09:57:54.714740 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T09:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-475302226-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testmultiattachvolumeswap-server-475302226-1',id=7,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWRDb+JW1Be+ChqOdLgE+udxPv2v3DeUrJgypnEajndjYYcDaHo+NtanG+1BYJDpNCgg9kFom2FLFEzJurAdWdjS/GSAW+eI4KVgHBVbu/AD11ONu4I8b+6V3i4fofL7Q==',key_name='tempest-keypair-1521286164',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4466c6404538446eb4c8bd45bb2a95f5',ramdisk_id='',reservation_id='r-x282s4nw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-193507140',owner_user_name='tempest-TestMultiAttachVolumeSwap-193507140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:57:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='010fbd8229d546b5aa445ca570266726',uuid=4a28d569-1ca9-4657-840c-7bb31d4644c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6d7e225-75f0-45c5-a7b7-7ff36e772079", "address": "fa:16:3e:9c:2e:17", "network": {"id": "d4fe3269-1c90-4590-b389-2d9e64a1874b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-397043690-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4466c6404538446eb4c8bd45bb2a95f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6d7e225-75", "ovs_interfaceid": "f6d7e225-75f0-45c5-a7b7-7ff36e772079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 09:57:54.715416 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Converting VIF {"id": "f6d7e225-75f0-45c5-a7b7-7ff36e772079", "address": "fa:16:3e:9c:2e:17", "network": {"id": "d4fe3269-1c90-4590-b389-2d9e64a1874b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-397043690-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4466c6404538446eb4c8bd45bb2a95f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6d7e225-75", "ovs_interfaceid": "f6d7e225-75f0-45c5-a7b7-7ff36e772079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:57:54.716377 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:2e:17,bridge_name='br-int',has_traffic_filtering=True,id=f6d7e225-75f0-45c5-a7b7-7ff36e772079,network=Network(d4fe3269-1c90-4590-b389-2d9e64a1874b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6d7e225-75') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:57:54.717273 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a28d569-1ca9-4657-840c-7bb31d4644c8 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:57:54.730309 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:54.733957 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ad56cc-eb5b-4e2e-a421-e93deee27fe7/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:54.746301 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.091s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:54.748245 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0dca786c-46bb-48dc-a01a-e282daa84a89/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 09:57:54.750359 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dca786c-46bb-48dc-a01a-e282daa84a89/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:54.809889 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-da1b7f32-7e9d-4338-a5c5-ab410a82ab12 req-7770fb30-d977-4b22-a7f7-15b13270ac60 service nova] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:57:54.811585 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ad56cc-eb5b-4e2e-a421-e93deee27fe7/disk --force-share --output=json" returned: 0 in 0.078s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:54.813749 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ad56cc-eb5b-4e2e-a421-e93deee27fe7/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:54.827272 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dca786c-46bb-48dc-a01a-e282daa84a89/disk --force-share --output=json" returned: 0 in 0.077s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:54.828665 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Cannot resize image /opt/stack/data/nova/instances/0dca786c-46bb-48dc-a01a-e282daa84a89/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 09:57:54.829274 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 09:57:54.829504 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Ensure instance console log exists: /opt/stack/data/nova/instances/0dca786c-46bb-48dc-a01a-e282daa84a89/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 09:57:54.829902 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:54.830341 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:54.830529 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:54.848673 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Received event network-vif-unplugged-7be666db-db21-439b-958d-3721cb9c4fdd {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:57:54.849381 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] Acquiring lock "53ad56cc-eb5b-4e2e-a421-e93deee27fe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:54.849641 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] Lock "53ad56cc-eb5b-4e2e-a421-e93deee27fe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:54.849780 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] Lock "53ad56cc-eb5b-4e2e-a421-e93deee27fe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:54.849911 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] No event matching network-vif-unplugged-7be666db-db21-439b-958d-3721cb9c4fdd in dict_keys([('network-vif-plugged', '7be666db-db21-439b-958d-3721cb9c4fdd')]) {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 09:57:54.850023 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Received unexpected event network-vif-unplugged-7be666db-db21-439b-958d-3721cb9c4fdd for instance with vm_state building and task_state spawning.
May 28 09:57:54.850129 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Received event network-vif-plugged-1aadd54c-ea47-43c1-86e2-da7dc2eb0a49 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:57:54.850346 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] Acquiring lock "289e2914-2be4-4f46-92e0-fa623f8db861-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:54.850477 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] Lock "289e2914-2be4-4f46-92e0-fa623f8db861-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:54.850596 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] Lock "289e2914-2be4-4f46-92e0-fa623f8db861-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:54.850695 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Processing event network-vif-plugged-1aadd54c-ea47-43c1-86e2-da7dc2eb0a49 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 09:57:54.850865 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Received event network-vif-plugged-1aadd54c-ea47-43c1-86e2-da7dc2eb0a49 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:57:54.850990 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] Acquiring lock "289e2914-2be4-4f46-92e0-fa623f8db861-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:54.851112 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] Lock "289e2914-2be4-4f46-92e0-fa623f8db861-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:54.851252 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] Lock "289e2914-2be4-4f46-92e0-fa623f8db861-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:54.852067 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Instance event wait completed in 10 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 09:57:54.852371 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] No waiting events found dispatching network-vif-plugged-1aadd54c-ea47-43c1-86e2-da7dc2eb0a49 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:57:54.852487 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Received unexpected event network-vif-plugged-1aadd54c-ea47-43c1-86e2-da7dc2eb0a49 for instance with vm_state building and task_state spawning.
May 28 09:57:54.852668 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Received event network-vif-plugged-0ed2dfa0-2fb5-4493-91e8-597b70a39c6b {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:57:54.852694 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] Acquiring lock "e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:54.852905 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] Lock "e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:54.852969 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] Lock "e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:54.853134 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Processing event network-vif-plugged-0ed2dfa0-2fb5-4493-91e8-597b70a39c6b {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 09:57:54.853199 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Received event network-vif-plugged-0ed2dfa0-2fb5-4493-91e8-597b70a39c6b {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:57:54.853331 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] Acquiring lock "e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:54.853465 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] Lock "e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:54.853564 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] Lock "e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:54.853671 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] No waiting events found dispatching network-vif-plugged-0ed2dfa0-2fb5-4493-91e8-597b70a39c6b {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:57:54.853778 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Received unexpected event network-vif-plugged-0ed2dfa0-2fb5-4493-91e8-597b70a39c6b for instance with vm_state building and task_state spawning.
May 28 09:57:54.853879 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Received event network-vif-unplugged-89ae21a1-1d94-4446-8c5a-4aac2a148584 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:57:54.853996 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] Acquiring lock "92fbf243-1c5b-47f6-9317-3fb2655651db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:54.854095 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] Lock "92fbf243-1c5b-47f6-9317-3fb2655651db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:54.854237 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] Lock "92fbf243-1c5b-47f6-9317-3fb2655651db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:54.854380 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] No event matching network-vif-unplugged-89ae21a1-1d94-4446-8c5a-4aac2a148584 in dict_keys([('network-vif-plugged', '89ae21a1-1d94-4446-8c5a-4aac2a148584')]) {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 09:57:54.854960 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Instance event wait completed in 10 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 09:57:54.855119 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Received unexpected event network-vif-unplugged-89ae21a1-1d94-4446-8c5a-4aac2a148584 for instance with vm_state building and task_state spawning.
May 28 09:57:54.855267 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Received event network-vif-plugged-7be666db-db21-439b-958d-3721cb9c4fdd {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:57:54.855404 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] Acquiring lock "53ad56cc-eb5b-4e2e-a421-e93deee27fe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:54.855566 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] Lock "53ad56cc-eb5b-4e2e-a421-e93deee27fe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:54.855727 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] Lock "53ad56cc-eb5b-4e2e-a421-e93deee27fe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:54.855890 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Processing event network-vif-plugged-7be666db-db21-439b-958d-3721cb9c4fdd {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 09:57:54.856522 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Received event network-vif-plugged-7be666db-db21-439b-958d-3721cb9c4fdd {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:57:54.856818 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] Acquiring lock "53ad56cc-eb5b-4e2e-a421-e93deee27fe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:54.856818 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] Lock "53ad56cc-eb5b-4e2e-a421-e93deee27fe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:54.856969 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] Lock "53ad56cc-eb5b-4e2e-a421-e93deee27fe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:54.857127 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] No waiting events found dispatching network-vif-plugged-7be666db-db21-439b-958d-3721cb9c4fdd {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:57:54.857127 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Received unexpected event network-vif-plugged-7be666db-db21-439b-958d-3721cb9c4fdd for instance with vm_state building and task_state spawning.
May 28 09:57:54.857304 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Received event network-vif-unplugged-3e64d22f-6078-49f1-9576-b70571e7f6e6 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:57:54.857396 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] Acquiring lock "49ff17d1-cad9-463e-b5c1-3315c52412e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:54.857622 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] Lock "49ff17d1-cad9-463e-b5c1-3315c52412e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:54.857763 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] Lock "49ff17d1-cad9-463e-b5c1-3315c52412e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:54.857862 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] No event matching network-vif-unplugged-3e64d22f-6078-49f1-9576-b70571e7f6e6 in dict_keys([('network-vif-plugged', '3e64d22f-6078-49f1-9576-b70571e7f6e6')]) {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 09:57:54.857996 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Received unexpected event network-vif-unplugged-3e64d22f-6078-49f1-9576-b70571e7f6e6 for instance with vm_state building and task_state spawning.
May 28 09:57:54.858091 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Received event network-vif-plugged-89ae21a1-1d94-4446-8c5a-4aac2a148584 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:57:54.858248 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] Acquiring lock "92fbf243-1c5b-47f6-9317-3fb2655651db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:54.858350 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] Lock "92fbf243-1c5b-47f6-9317-3fb2655651db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:54.858445 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] Lock "92fbf243-1c5b-47f6-9317-3fb2655651db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:54.858539 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-523ab483-932d-47ef-86b8-a8220e161871 req-cc3d86b9-5002-40f2-b1a1-bad925122a3e service nova] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Processing event network-vif-plugged-89ae21a1-1d94-4446-8c5a-4aac2a148584 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 09:57:54.859003 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 09:57:54.860156 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 09:57:54.860920 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Instance event wait completed in 8 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 09:57:54.861688 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 09:57:54.863603 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 09:57:54.867092 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Instance spawned successfully.
May 28 09:57:54.867403 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Instance spawned successfully.
May 28 09:57:54.867745 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 09:57:54.870197 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 09:57:54.870882 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Instance spawned successfully.
May 28 09:57:54.871377 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 09:57:54.871972 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:54.873752 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 09:57:54.876547 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Instance spawned successfully.
May 28 09:57:54.877757 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 09:57:54.879950 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:57:54.880236 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:57:54.880562 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:57:54.881785 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:57:54.905638 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ad56cc-eb5b-4e2e-a421-e93deee27fe7/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:54.908006 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 09:57:54.909206 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:54.933755 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "env LANG=C uptime" returned: 0 in 0.024s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:54.934488 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Hypervisor/Node resource view: name=np0000001613 free_ram=14691MB free_disk=74.74261474609375GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 09:57:54.934732 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:54.934962 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:55.098024 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:57:55.107645 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962275.1071267, 49ff17d1-cad9-463e-b5c1-3315c52412e6 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:57:55.107920 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] VM Paused (Lifecycle Event)
May 28 09:57:55.191232 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 09:57:55.221297 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] End _get_guest_xml xml=<domain type="qemu">
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:   <uuid>4a28d569-1ca9-4657-840c-7bb31d4644c8</uuid>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:   <name>instance-00000007</name>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:   <metadata>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:       <nova:name>tempest-TestMultiAttachVolumeSwap-server-475302226-1</nova:name>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 09:57:54</nova:creationTime>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:       </nova:image>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:         <nova:user uuid="010fbd8229d546b5aa445ca570266726">tempest-TestMultiAttachVolumeSwap-193507140-project-member</nova:user>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:         <nova:project uuid="4466c6404538446eb4c8bd45bb2a95f5">tempest-TestMultiAttachVolumeSwap-193507140</nova:project>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:         <nova:port uuid="f6d7e225-75f0-45c5-a7b7-7ff36e772079">
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:         </nova:port>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:   </metadata>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:     <system>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:       <entry name="serial">4a28d569-1ca9-4657-840c-7bb31d4644c8</entry>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:       <entry name="uuid">4a28d569-1ca9-4657-840c-7bb31d4644c8</entry>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:     </system>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:   <os>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:   </os>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:   <features>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:     <acpi/>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:     <tcg>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:     </tcg>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:   </features>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:   <devices>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/4a28d569-1ca9-4657-840c-7bb31d4644c8/disk"/>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:     </disk>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/4a28d569-1ca9-4657-840c-7bb31d4644c8/disk.config"/>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:     </disk>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:9c:2e:17"/>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:       <target dev="tapf6d7e225-75"/>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:     </interface>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/4a28d569-1ca9-4657-840c-7bb31d4644c8/console.log" append="off"/>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:     </serial>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:     <video>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:     </video>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:     </rng>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:     </memballoon>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:   </devices>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]: </domain>
May 28 09:57:55.221297 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 09:57:55.226772 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Preparing to wait for external event network-vif-plugged-f6d7e225-75f0-45c5-a7b7-7ff36e772079 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 09:57:55.226772 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Acquiring lock "4a28d569-1ca9-4657-840c-7bb31d4644c8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:55.226772 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "4a28d569-1ca9-4657-840c-7bb31d4644c8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:55.226772 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "4a28d569-1ca9-4657-840c-7bb31d4644c8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:55.228088 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T09:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-475302226-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testmultiattachvolumeswap-server-475302226-1',id=7,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWRDb+JW1Be+ChqOdLgE+udxPv2v3DeUrJgypnEajndjYYcDaHo+NtanG+1BYJDpNCgg9kFom2FLFEzJurAdWdjS/GSAW+eI4KVgHBVbu/AD11ONu4I8b+6V3i4fofL7Q==',key_name='tempest-keypair-1521286164',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4466c6404538446eb4c8bd45bb2a95f5',ramdisk_id='',reservation_id='r-x282s4nw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-193507140',owner_user_name='tempest-TestMultiAttachVolumeSwap-193507140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:57:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='010fbd8229d546b5aa445ca570266726',uuid=4a28d569-1ca9-4657-840c-7bb31d4644c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6d7e225-75f0-45c5-a7b7-7ff36e772079", "address": "fa:16:3e:9c:2e:17", "network": {"id": "d4fe3269-1c90-4590-b389-2d9e64a1874b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-397043690-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4466c6404538446eb4c8bd45bb2a95f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6d7e225-75", "ovs_interfaceid": "f6d7e225-75f0-45c5-a7b7-7ff36e772079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 09:57:55.228088 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Converting VIF {"id": "f6d7e225-75f0-45c5-a7b7-7ff36e772079", "address": "fa:16:3e:9c:2e:17", "network": {"id": "d4fe3269-1c90-4590-b389-2d9e64a1874b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-397043690-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4466c6404538446eb4c8bd45bb2a95f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6d7e225-75", "ovs_interfaceid": "f6d7e225-75f0-45c5-a7b7-7ff36e772079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:57:55.231860 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:2e:17,bridge_name='br-int',has_traffic_filtering=True,id=f6d7e225-75f0-45c5-a7b7-7ff36e772079,network=Network(d4fe3269-1c90-4590-b389-2d9e64a1874b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6d7e225-75') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:57:55.231860 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:2e:17,bridge_name='br-int',has_traffic_filtering=True,id=f6d7e225-75f0-45c5-a7b7-7ff36e772079,network=Network(d4fe3269-1c90-4590-b389-2d9e64a1874b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6d7e225-75') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 09:57:55.231860 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:55.231860 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:57:55.231860 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 09:57:55.232119 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:55.232266 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '34559598-119b-594b-a1b9-c2d7467424fb', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:57:55.233342 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:55.234410 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:57:55.235697 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:55.239129 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:55.239129 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf6d7e225-75, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:57:55.239429 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf6d7e225-75, col_values=(('qos', UUID('4b8c351c-ee05-48d5-a007-06404379fa65')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:57:55.239680 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf6d7e225-75, col_values=(('external_ids', {'iface-id': 'f6d7e225-75f0-45c5-a7b7-7ff36e772079', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:2e:17', 'vm-uuid': '4a28d569-1ca9-4657-840c-7bb31d4644c8'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:57:55.241478 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:55.242781 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:57:55.250395 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:55.251735 np0000001613 nova-compute[98321]: INFO os_vif [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:2e:17,bridge_name='br-int',has_traffic_filtering=True,id=f6d7e225-75f0-45c5-a7b7-7ff36e772079,network=Network(d4fe3269-1c90-4590-b389-2d9e64a1874b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6d7e225-75')
May 28 09:57:55.313098 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-da1b7f32-7e9d-4338-a5c5-ab410a82ab12 req-7770fb30-d977-4b22-a7f7-15b13270ac60 service nova] Releasing lock "refresh_cache-0dca786c-46bb-48dc-a01a-e282daa84a89" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:57:55.313863 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Acquired lock "refresh_cache-0dca786c-46bb-48dc-a01a-e282daa84a89" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:57:55.314138 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 09:57:55.381657 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:57:55.382452 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:57:55.383457 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:57:55.384074 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:57:55.384299 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:57:55.384814 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:57:55.385229 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:57:55.385775 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:57:55.389186 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:57:55.389186 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:57:55.389186 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:57:55.396565 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:57:55.399866 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Took 10.71 seconds to spawn the instance on the hypervisor.
May 28 09:57:55.400976 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:57:55.402614 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:57:55.410192 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:57:55.410192 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:57:55.410192 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:57:55.410192 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:57:55.410192 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:57:55.613033 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:57:55.615576 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 09:57:55.763514 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:55.887728 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 09:57:55.902905 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Took 20.84 seconds to spawn the instance on the hypervisor.
May 28 09:57:55.902905 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:57:55.905269 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Took 18.53 seconds to spawn the instance on the hypervisor.
May 28 09:57:55.905269 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:57:55.922356 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Took 18.17 seconds to build instance.
May 28 09:57:55.926633 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Took 16.18 seconds to spawn the instance on the hypervisor.
May 28 09:57:55.927485 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:57:56.020872 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance e2856743-3a60-4be1-b29c-b4de06f14783 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 09:57:56.120588 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 09:57:56.120588 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962276.1188676, 289e2914-2be4-4f46-92e0-fa623f8db861 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:57:56.120588 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] VM Resumed (Lifecycle Event)
May 28 09:57:56.157548 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:56.315192 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Updating instance_info_cache with network_info: [{"id": "5169a8fe-f36b-4d06-8497-4407070563c7", "address": "fa:16:3e:14:ef:87", "network": {"id": "d4fe3269-1c90-4590-b389-2d9e64a1874b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-397043690-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4466c6404538446eb4c8bd45bb2a95f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5169a8fe-f3", "ovs_interfaceid": "5169a8fe-f36b-4d06-8497-4407070563c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:57:56.423220 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Took 26.27 seconds to build instance.
May 28 09:57:56.429992 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Lock "92fbf243-1c5b-47f6-9317-3fb2655651db" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.691s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:56.445186 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Took 24.64 seconds to build instance.
May 28 09:57:56.445186 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Took 24.91 seconds to build instance.
May 28 09:57:56.524572 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 7514b113-ec17-468b-a647-de099d90e787 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 28 09:57:56.524735 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 0dca786c-46bb-48dc-a01a-e282daa84a89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 09:57:56.524801 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 4a28d569-1ca9-4657-840c-7bb31d4644c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 09:57:56.524896 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 53ad56cc-eb5b-4e2e-a421-e93deee27fe7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 09:57:56.525020 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 289e2914-2be4-4f46-92e0-fa623f8db861 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 09:57:56.525112 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 49ff17d1-cad9-463e-b5c1-3315c52412e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 09:57:56.525240 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 92fbf243-1c5b-47f6-9317-3fb2655651db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 09:57:56.525336 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 09:57:56.525513 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 09:57:56.525638 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Final resource view: name=np0000001613 phys_ram=24030MB used_ram=2048MB phys_disk=95GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 09:57:54 up 30 min,  2 users,  load average: 5.25, 2.35, 1.14\n', 'num_instances': '8', 'num_vm_building': '8', 'num_task_spawning': '8', 'num_os_type_None': '8', 'num_proj_a9d04b105229456d9ab53df1886fdb37': '1', 'io_workload': '8', 'num_proj_cb3a501b4f4041ef875ef4d2b4167044': '1', 'num_proj_9a85ba31f98b45b6974118c6560bbc53': '1', 'num_proj_25a0adc32dd74f039cc231cceb9131a0': '1', 'num_proj_baa985120ab84c2a93a64fdab8e0d4e8': '1', 'num_proj_af05aeb984e64ba8989f3db86750c648': '1', 'num_proj_4466c6404538446eb4c8bd45bb2a95f5': '2'} {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 09:57:56.571594 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ebf395a7-d083-4abb-a546-fe9f6bb81445 req-36c9e09d-ee82-473b-8ec2-6cc7e09e6cd3 service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Received event network-vif-unplugged-2fad8030-7c30-438c-8dcd-b9a8ba1849d1 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:57:56.572539 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ebf395a7-d083-4abb-a546-fe9f6bb81445 req-36c9e09d-ee82-473b-8ec2-6cc7e09e6cd3 service nova] Acquiring lock "e2856743-3a60-4be1-b29c-b4de06f14783-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:56.572539 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ebf395a7-d083-4abb-a546-fe9f6bb81445 req-36c9e09d-ee82-473b-8ec2-6cc7e09e6cd3 service nova] Lock "e2856743-3a60-4be1-b29c-b4de06f14783-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:56.572539 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ebf395a7-d083-4abb-a546-fe9f6bb81445 req-36c9e09d-ee82-473b-8ec2-6cc7e09e6cd3 service nova] Lock "e2856743-3a60-4be1-b29c-b4de06f14783-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:56.572539 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ebf395a7-d083-4abb-a546-fe9f6bb81445 req-36c9e09d-ee82-473b-8ec2-6cc7e09e6cd3 service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] No event matching network-vif-unplugged-2fad8030-7c30-438c-8dcd-b9a8ba1849d1 in dict_keys([('network-vif-plugged', '2fad8030-7c30-438c-8dcd-b9a8ba1849d1')]) {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 09:57:56.572539 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-ebf395a7-d083-4abb-a546-fe9f6bb81445 req-36c9e09d-ee82-473b-8ec2-6cc7e09e6cd3 service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Received unexpected event network-vif-unplugged-2fad8030-7c30-438c-8dcd-b9a8ba1849d1 for instance with vm_state building and task_state spawning.
May 28 09:57:56.627195 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:57:56.631576 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 09:57:56.775786 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:57:56.776052 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:57:56.776052 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] No VIF found with MAC fa:16:3e:9c:2e:17, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 09:57:56.777665 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Using config drive
May 28 09:57:56.815631 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Releasing lock "refresh_cache-0dca786c-46bb-48dc-a01a-e282daa84a89" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:57:56.815979 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Instance network_info: |[{"id": "5169a8fe-f36b-4d06-8497-4407070563c7", "address": "fa:16:3e:14:ef:87", "network": {"id": "d4fe3269-1c90-4590-b389-2d9e64a1874b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-397043690-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4466c6404538446eb4c8bd45bb2a95f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5169a8fe-f3", "ovs_interfaceid": "5169a8fe-f36b-4d06-8497-4407070563c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 09:57:56.818535 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Start _get_guest_xml network_info=[{"id": "5169a8fe-f36b-4d06-8497-4407070563c7", "address": "fa:16:3e:14:ef:87", "network": {"id": "d4fe3269-1c90-4590-b389-2d9e64a1874b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-397043690-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4466c6404538446eb4c8bd45bb2a95f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5169a8fe-f3", "ovs_interfaceid": "5169a8fe-f36b-4d06-8497-4407070563c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 09:57:56.822948 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 09:57:56.822948 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-475302226-2', uuid='0dca786c-46bb-48dc-a01a-e282daa84a89'), owner=OwnerMeta(userid='010fbd8229d546b5aa445ca570266726', username='tempest-TestMultiAttachVolumeSwap-193507140-project-member', projectid='4466c6404538446eb4c8bd45bb2a95f5', projectname='tempest-TestMultiAttachVolumeSwap-193507140'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5169a8fe-f36b-4d06-8497-4407070563c7", "address": "fa:16:3e:14:ef:87", "network": {"id": "d4fe3269-1c90-4590-b389-2d9e64a1874b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-397043690-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4466c6404538446eb4c8bd45bb2a95f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5169a8fe-f3", "ovs_interfaceid": "5169a8fe-f36b-4d06-8497-4407070563c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962276.8224797) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 09:57:56.823802 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 09:57:56.824261 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 09:57:56.824986 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 09:57:56.825263 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 09:57:56.826330 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 09:57:56.826702 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 09:57:56.826937 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 09:57:56.827089 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 09:57:56.827302 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 09:57:56.827508 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 09:57:56.827730 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 09:57:56.827963 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 09:57:56.828131 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 09:57:56.828314 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 09:57:56.828497 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 09:57:56.828679 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 09:57:56.848619 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T09:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-475302226-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testmultiattachvolumeswap-server-475302226-2',id=8,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWRDb+JW1Be+ChqOdLgE+udxPv2v3DeUrJgypnEajndjYYcDaHo+NtanG+1BYJDpNCgg9kFom2FLFEzJurAdWdjS/GSAW+eI4KVgHBVbu/AD11ONu4I8b+6V3i4fofL7Q==',key_name='tempest-keypair-1521286164',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4466c6404538446eb4c8bd45bb2a95f5',ramdisk_id='',reservation_id='r-x282s4nw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-193507140',owner_user_name='tempest-TestMultiAttachVolumeSwap-193507140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:57:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='010fbd8229d546b5aa445ca570266726',uuid=0dca786c-46bb-48dc-a01a-e282daa84a89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5169a8fe-f36b-4d06-8497-4407070563c7", "address": "fa:16:3e:14:ef:87", "network": {"id": "d4fe3269-1c90-4590-b389-2d9e64a1874b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-397043690-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4466c6404538446eb4c8bd45bb2a95f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5169a8fe-f3", "ovs_interfaceid": "5169a8fe-f36b-4d06-8497-4407070563c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 09:57:56.849200 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Converting VIF {"id": "5169a8fe-f36b-4d06-8497-4407070563c7", "address": "fa:16:3e:14:ef:87", "network": {"id": "d4fe3269-1c90-4590-b389-2d9e64a1874b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-397043690-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4466c6404538446eb4c8bd45bb2a95f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5169a8fe-f3", "ovs_interfaceid": "5169a8fe-f36b-4d06-8497-4407070563c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:57:56.849975 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:ef:87,bridge_name='br-int',has_traffic_filtering=True,id=5169a8fe-f36b-4d06-8497-4407070563c7,network=Network(d4fe3269-1c90-4590-b389-2d9e64a1874b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5169a8fe-f3') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:57:56.851538 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lazy-loading 'pci_devices' on Instance uuid 0dca786c-46bb-48dc-a01a-e282daa84a89 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:57:56.926672 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f776d672-6e1f-4aac-9d46-d61ffb0f25ab tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "289e2914-2be4-4f46-92e0-fa623f8db861" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.778s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:56.946638 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "53ad56cc-eb5b-4e2e-a421-e93deee27fe7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.146s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:56.949108 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87f8b6eb-9f5d-4074-99bb-8d276eabe84f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.423s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:56.962728 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c2f7367c-b949-4461-b8f7-9af23109140e req-2b11372f-aae2-4d32-9f21-566996387f29 service nova] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Received event network-vif-plugged-89ae21a1-1d94-4446-8c5a-4aac2a148584 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:57:56.962970 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c2f7367c-b949-4461-b8f7-9af23109140e req-2b11372f-aae2-4d32-9f21-566996387f29 service nova] Acquiring lock "92fbf243-1c5b-47f6-9317-3fb2655651db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:56.963917 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c2f7367c-b949-4461-b8f7-9af23109140e req-2b11372f-aae2-4d32-9f21-566996387f29 service nova] Lock "92fbf243-1c5b-47f6-9317-3fb2655651db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:56.966070 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c2f7367c-b949-4461-b8f7-9af23109140e req-2b11372f-aae2-4d32-9f21-566996387f29 service nova] Lock "92fbf243-1c5b-47f6-9317-3fb2655651db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:56.966815 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c2f7367c-b949-4461-b8f7-9af23109140e req-2b11372f-aae2-4d32-9f21-566996387f29 service nova] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] No waiting events found dispatching network-vif-plugged-89ae21a1-1d94-4446-8c5a-4aac2a148584 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:57:56.967731 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-c2f7367c-b949-4461-b8f7-9af23109140e req-2b11372f-aae2-4d32-9f21-566996387f29 service nova] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Received unexpected event network-vif-plugged-89ae21a1-1d94-4446-8c5a-4aac2a148584 for instance with vm_state active and task_state None.
May 28 09:57:56.967731 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c2f7367c-b949-4461-b8f7-9af23109140e req-2b11372f-aae2-4d32-9f21-566996387f29 service nova] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Received event network-vif-plugged-3e64d22f-6078-49f1-9576-b70571e7f6e6 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:57:56.967731 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c2f7367c-b949-4461-b8f7-9af23109140e req-2b11372f-aae2-4d32-9f21-566996387f29 service nova] Acquiring lock "49ff17d1-cad9-463e-b5c1-3315c52412e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:56.967850 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c2f7367c-b949-4461-b8f7-9af23109140e req-2b11372f-aae2-4d32-9f21-566996387f29 service nova] Lock "49ff17d1-cad9-463e-b5c1-3315c52412e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:56.968029 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c2f7367c-b949-4461-b8f7-9af23109140e req-2b11372f-aae2-4d32-9f21-566996387f29 service nova] Lock "49ff17d1-cad9-463e-b5c1-3315c52412e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:56.971199 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c2f7367c-b949-4461-b8f7-9af23109140e req-2b11372f-aae2-4d32-9f21-566996387f29 service nova] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Processing event network-vif-plugged-3e64d22f-6078-49f1-9576-b70571e7f6e6 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 09:57:56.971199 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c2f7367c-b949-4461-b8f7-9af23109140e req-2b11372f-aae2-4d32-9f21-566996387f29 service nova] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Received event network-vif-plugged-3e64d22f-6078-49f1-9576-b70571e7f6e6 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:57:56.971199 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c2f7367c-b949-4461-b8f7-9af23109140e req-2b11372f-aae2-4d32-9f21-566996387f29 service nova] Acquiring lock "49ff17d1-cad9-463e-b5c1-3315c52412e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:56.971199 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c2f7367c-b949-4461-b8f7-9af23109140e req-2b11372f-aae2-4d32-9f21-566996387f29 service nova] Lock "49ff17d1-cad9-463e-b5c1-3315c52412e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:56.971199 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c2f7367c-b949-4461-b8f7-9af23109140e req-2b11372f-aae2-4d32-9f21-566996387f29 service nova] Lock "49ff17d1-cad9-463e-b5c1-3315c52412e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:56.971199 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c2f7367c-b949-4461-b8f7-9af23109140e req-2b11372f-aae2-4d32-9f21-566996387f29 service nova] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] No waiting events found dispatching network-vif-plugged-3e64d22f-6078-49f1-9576-b70571e7f6e6 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:57:56.971199 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-c2f7367c-b949-4461-b8f7-9af23109140e req-2b11372f-aae2-4d32-9f21-566996387f29 service nova] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Received unexpected event network-vif-plugged-3e64d22f-6078-49f1-9576-b70571e7f6e6 for instance with vm_state building and task_state spawning.
May 28 09:57:56.971199 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Instance event wait completed in 3 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 09:57:56.982153 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 09:57:56.987885 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Instance spawned successfully.
May 28 09:57:56.988303 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 09:57:57.135053 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962277.1345873, e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:57:57.135053 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] VM Resumed (Lifecycle Event)
May 28 09:57:57.176812 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 09:57:57.177388 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 09:57:57.284247 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:57.356344 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] End _get_guest_xml xml=<domain type="qemu">
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:   <uuid>0dca786c-46bb-48dc-a01a-e282daa84a89</uuid>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:   <name>instance-00000008</name>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:   <metadata>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:       <nova:name>tempest-TestMultiAttachVolumeSwap-server-475302226-2</nova:name>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 09:57:56</nova:creationTime>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:       </nova:image>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:         <nova:user uuid="010fbd8229d546b5aa445ca570266726">tempest-TestMultiAttachVolumeSwap-193507140-project-member</nova:user>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:         <nova:project uuid="4466c6404538446eb4c8bd45bb2a95f5">tempest-TestMultiAttachVolumeSwap-193507140</nova:project>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:         <nova:port uuid="5169a8fe-f36b-4d06-8497-4407070563c7">
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:         </nova:port>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:   </metadata>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:     <system>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:       <entry name="serial">0dca786c-46bb-48dc-a01a-e282daa84a89</entry>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:       <entry name="uuid">0dca786c-46bb-48dc-a01a-e282daa84a89</entry>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:     </system>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:   <os>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:   </os>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:   <features>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:     <acpi/>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:     <tcg>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:     </tcg>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:   </features>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:   <devices>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/0dca786c-46bb-48dc-a01a-e282daa84a89/disk"/>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:     </disk>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/0dca786c-46bb-48dc-a01a-e282daa84a89/disk.config"/>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:     </disk>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:14:ef:87"/>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:       <target dev="tap5169a8fe-f3"/>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:     </interface>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/0dca786c-46bb-48dc-a01a-e282daa84a89/console.log" append="off"/>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:     </serial>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:     <video>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:     </video>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:     </rng>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:     </memballoon>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:   </devices>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]: </domain>
May 28 09:57:57.356344 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 09:57:57.356344 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Preparing to wait for external event network-vif-plugged-5169a8fe-f36b-4d06-8497-4407070563c7 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 09:57:57.356344 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Acquiring lock "0dca786c-46bb-48dc-a01a-e282daa84a89-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:57.356344 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "0dca786c-46bb-48dc-a01a-e282daa84a89-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:57.359526 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "0dca786c-46bb-48dc-a01a-e282daa84a89-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:57.359526 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T09:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-475302226-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testmultiattachvolumeswap-server-475302226-2',id=8,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWRDb+JW1Be+ChqOdLgE+udxPv2v3DeUrJgypnEajndjYYcDaHo+NtanG+1BYJDpNCgg9kFom2FLFEzJurAdWdjS/GSAW+eI4KVgHBVbu/AD11ONu4I8b+6V3i4fofL7Q==',key_name='tempest-keypair-1521286164',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4466c6404538446eb4c8bd45bb2a95f5',ramdisk_id='',reservation_id='r-x282s4nw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-193507140',owner_user_name='tempest-TestMultiAttachVolumeSwap-193507140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:57:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='010fbd8229d546b5aa445ca570266726',uuid=0dca786c-46bb-48dc-a01a-e282daa84a89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5169a8fe-f36b-4d06-8497-4407070563c7", "address": "fa:16:3e:14:ef:87", "network": {"id": "d4fe3269-1c90-4590-b389-2d9e64a1874b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-397043690-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4466c6404538446eb4c8bd45bb2a95f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5169a8fe-f3", "ovs_interfaceid": "5169a8fe-f36b-4d06-8497-4407070563c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 09:57:57.360843 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Converting VIF {"id": "5169a8fe-f36b-4d06-8497-4407070563c7", "address": "fa:16:3e:14:ef:87", "network": {"id": "d4fe3269-1c90-4590-b389-2d9e64a1874b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-397043690-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4466c6404538446eb4c8bd45bb2a95f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5169a8fe-f3", "ovs_interfaceid": "5169a8fe-f36b-4d06-8497-4407070563c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:57:57.360843 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:ef:87,bridge_name='br-int',has_traffic_filtering=True,id=5169a8fe-f36b-4d06-8497-4407070563c7,network=Network(d4fe3269-1c90-4590-b389-2d9e64a1874b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5169a8fe-f3') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:57:57.361375 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:ef:87,bridge_name='br-int',has_traffic_filtering=True,id=5169a8fe-f36b-4d06-8497-4407070563c7,network=Network(d4fe3269-1c90-4590-b389-2d9e64a1874b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5169a8fe-f3') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 09:57:57.361504 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:57.361738 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:57:57.361929 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 09:57:57.362661 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:57.362850 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '17e2a9c0-f5de-50aa-9dd7-c73ba382c5f5', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:57:57.367157 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:57.368258 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:57:57.375257 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:57.378810 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:57.378967 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5169a8fe-f3, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:57:57.379374 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5169a8fe-f3, col_values=(('qos', UUID('0e05153f-504d-45e9-b96b-d9377a39965f')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:57:57.379497 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5169a8fe-f3, col_values=(('external_ids', {'iface-id': '5169a8fe-f36b-4d06-8497-4407070563c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:ef:87', 'vm-uuid': '0dca786c-46bb-48dc-a01a-e282daa84a89'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:57:57.381266 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:57.384269 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:57:57.400072 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:57.401414 np0000001613 nova-compute[98321]: INFO os_vif [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:ef:87,bridge_name='br-int',has_traffic_filtering=True,id=5169a8fe-f36b-4d06-8497-4407070563c7,network=Network(d4fe3269-1c90-4590-b389-2d9e64a1874b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5169a8fe-f3')
May 28 09:57:57.499763 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:57:57.499960 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:57:57.500316 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:57:57.500633 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:57:57.500950 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:57:57.502062 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:57:57.637854 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:57:57.642918 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 09:57:57.681113 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 09:57:58.009061 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Took 10.83 seconds to spawn the instance on the hypervisor.
May 28 09:57:58.010311 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:57:58.147465 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962278.147067, 53ad56cc-eb5b-4e2e-a421-e93deee27fe7 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:57:58.147686 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] VM Resumed (Lifecycle Event)
May 28 09:57:58.193187 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Creating config drive at /opt/stack/data/nova/instances/4a28d569-1ca9-4657-840c-7bb31d4644c8/disk.config
May 28 09:57:58.194401 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Compute_service record updated for np0000001613:np0000001613 {{(pid=98321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 09:57:58.194565 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.260s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:58.196835 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.434s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:58.196941 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 55.70 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 09:57:58.199554 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 09:57:58.199670 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Claim successful on node np0000001613
May 28 09:57:58.205185 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4a28d569-1ca9-4657-840c-7bb31d4644c8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptxme7a_o {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:58.239630 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b0db2fbb-a6ae-4ea1-afce-a471118bade8 req-12093c05-852e-422c-a36f-7d76a0600e51 service nova] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Received event network-changed-7be666db-db21-439b-958d-3721cb9c4fdd {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:57:58.239780 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b0db2fbb-a6ae-4ea1-afce-a471118bade8 req-12093c05-852e-422c-a36f-7d76a0600e51 service nova] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Refreshing instance network info cache due to event network-changed-7be666db-db21-439b-958d-3721cb9c4fdd. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 09:57:58.239938 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b0db2fbb-a6ae-4ea1-afce-a471118bade8 req-12093c05-852e-422c-a36f-7d76a0600e51 service nova] Acquiring lock "refresh_cache-53ad56cc-eb5b-4e2e-a421-e93deee27fe7" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:57:58.240037 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b0db2fbb-a6ae-4ea1-afce-a471118bade8 req-12093c05-852e-422c-a36f-7d76a0600e51 service nova] Acquired lock "refresh_cache-53ad56cc-eb5b-4e2e-a421-e93deee27fe7" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:57:58.240175 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-b0db2fbb-a6ae-4ea1-afce-a471118bade8 req-12093c05-852e-422c-a36f-7d76a0600e51 service nova] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Refreshing network info cache for port 7be666db-db21-439b-958d-3721cb9c4fdd {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 09:57:58.246337 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4a28d569-1ca9-4657-840c-7bb31d4644c8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptxme7a_o" returned: 0 in 0.040s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:57:58.530438 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Took 20.02 seconds to build instance.
May 28 09:57:58.655187 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:57:58.660282 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 09:57:58.671882 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-70a7c5cb-6a66-4af6-b792-9e510769bf23 req-346649af-3f9a-4cb3-8798-17066ff6a6bc service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Received event network-vif-plugged-2fad8030-7c30-438c-8dcd-b9a8ba1849d1 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:57:58.672140 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-70a7c5cb-6a66-4af6-b792-9e510769bf23 req-346649af-3f9a-4cb3-8798-17066ff6a6bc service nova] Acquiring lock "e2856743-3a60-4be1-b29c-b4de06f14783-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:58.673129 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-70a7c5cb-6a66-4af6-b792-9e510769bf23 req-346649af-3f9a-4cb3-8798-17066ff6a6bc service nova] Lock "e2856743-3a60-4be1-b29c-b4de06f14783-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:58.673360 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-70a7c5cb-6a66-4af6-b792-9e510769bf23 req-346649af-3f9a-4cb3-8798-17066ff6a6bc service nova] Lock "e2856743-3a60-4be1-b29c-b4de06f14783-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:58.675011 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-70a7c5cb-6a66-4af6-b792-9e510769bf23 req-346649af-3f9a-4cb3-8798-17066ff6a6bc service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Processing event network-vif-plugged-2fad8030-7c30-438c-8dcd-b9a8ba1849d1 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 09:57:58.675258 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-70a7c5cb-6a66-4af6-b792-9e510769bf23 req-346649af-3f9a-4cb3-8798-17066ff6a6bc service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Received event network-vif-plugged-2fad8030-7c30-438c-8dcd-b9a8ba1849d1 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:57:58.676775 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Instance event wait completed in 9 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 09:57:58.677101 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-70a7c5cb-6a66-4af6-b792-9e510769bf23 req-346649af-3f9a-4cb3-8798-17066ff6a6bc service nova] Acquiring lock "e2856743-3a60-4be1-b29c-b4de06f14783-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:58.677328 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-70a7c5cb-6a66-4af6-b792-9e510769bf23 req-346649af-3f9a-4cb3-8798-17066ff6a6bc service nova] Lock "e2856743-3a60-4be1-b29c-b4de06f14783-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:58.677499 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-70a7c5cb-6a66-4af6-b792-9e510769bf23 req-346649af-3f9a-4cb3-8798-17066ff6a6bc service nova] Lock "e2856743-3a60-4be1-b29c-b4de06f14783-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:58.677662 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-70a7c5cb-6a66-4af6-b792-9e510769bf23 req-346649af-3f9a-4cb3-8798-17066ff6a6bc service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] No waiting events found dispatching network-vif-plugged-2fad8030-7c30-438c-8dcd-b9a8ba1849d1 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:57:58.677845 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-70a7c5cb-6a66-4af6-b792-9e510769bf23 req-346649af-3f9a-4cb3-8798-17066ff6a6bc service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Received unexpected event network-vif-plugged-2fad8030-7c30-438c-8dcd-b9a8ba1849d1 for instance with vm_state building and task_state spawning.
May 28 09:57:58.677998 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-70a7c5cb-6a66-4af6-b792-9e510769bf23 req-346649af-3f9a-4cb3-8798-17066ff6a6bc service nova] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Received event network-vif-unplugged-f6d7e225-75f0-45c5-a7b7-7ff36e772079 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:57:58.678177 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-70a7c5cb-6a66-4af6-b792-9e510769bf23 req-346649af-3f9a-4cb3-8798-17066ff6a6bc service nova] Acquiring lock "4a28d569-1ca9-4657-840c-7bb31d4644c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:58.678360 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-70a7c5cb-6a66-4af6-b792-9e510769bf23 req-346649af-3f9a-4cb3-8798-17066ff6a6bc service nova] Lock "4a28d569-1ca9-4657-840c-7bb31d4644c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:58.678509 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-70a7c5cb-6a66-4af6-b792-9e510769bf23 req-346649af-3f9a-4cb3-8798-17066ff6a6bc service nova] Lock "4a28d569-1ca9-4657-840c-7bb31d4644c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:58.678673 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-70a7c5cb-6a66-4af6-b792-9e510769bf23 req-346649af-3f9a-4cb3-8798-17066ff6a6bc service nova] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] No event matching network-vif-unplugged-f6d7e225-75f0-45c5-a7b7-7ff36e772079 in dict_keys([('network-vif-plugged', 'f6d7e225-75f0-45c5-a7b7-7ff36e772079')]) {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 09:57:58.679380 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-70a7c5cb-6a66-4af6-b792-9e510769bf23 req-346649af-3f9a-4cb3-8798-17066ff6a6bc service nova] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Received unexpected event network-vif-unplugged-f6d7e225-75f0-45c5-a7b7-7ff36e772079 for instance with vm_state building and task_state spawning.
May 28 09:57:58.679545 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-70a7c5cb-6a66-4af6-b792-9e510769bf23 req-346649af-3f9a-4cb3-8798-17066ff6a6bc service nova] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Received event network-vif-unplugged-5169a8fe-f36b-4d06-8497-4407070563c7 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:57:58.679761 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-70a7c5cb-6a66-4af6-b792-9e510769bf23 req-346649af-3f9a-4cb3-8798-17066ff6a6bc service nova] Acquiring lock "0dca786c-46bb-48dc-a01a-e282daa84a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:57:58.680844 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-70a7c5cb-6a66-4af6-b792-9e510769bf23 req-346649af-3f9a-4cb3-8798-17066ff6a6bc service nova] Lock "0dca786c-46bb-48dc-a01a-e282daa84a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:57:58.680844 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-70a7c5cb-6a66-4af6-b792-9e510769bf23 req-346649af-3f9a-4cb3-8798-17066ff6a6bc service nova] Lock "0dca786c-46bb-48dc-a01a-e282daa84a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:58.681656 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-70a7c5cb-6a66-4af6-b792-9e510769bf23 req-346649af-3f9a-4cb3-8798-17066ff6a6bc service nova] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] No event matching network-vif-unplugged-5169a8fe-f36b-4d06-8497-4407070563c7 in dict_keys([('network-vif-plugged', '5169a8fe-f36b-4d06-8497-4407070563c7')]) {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 09:57:58.681656 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-70a7c5cb-6a66-4af6-b792-9e510769bf23 req-346649af-3f9a-4cb3-8798-17066ff6a6bc service nova] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Received unexpected event network-vif-unplugged-5169a8fe-f36b-4d06-8497-4407070563c7 for instance with vm_state building and task_state spawning.
May 28 09:57:58.684629 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 09:57:58.689785 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Instance spawned successfully.
May 28 09:57:58.691338 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 09:57:58.742841 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-b0db2fbb-a6ae-4ea1-afce-a471118bade8 req-12093c05-852e-422c-a36f-7d76a0600e51 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:58.777932 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:58.797280 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:58.910415 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:58.941539 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:57:58.941539 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:57:58.941539 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] No VIF found with MAC fa:16:3e:14:ef:87, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 09:57:58.941760 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Using config drive
May 28 09:57:59.034875 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f2aefe04-ac97-4801-8f6d-b2c94eb1a2fe tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Lock "49ff17d1-cad9-463e-b5c1-3315c52412e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.542s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:57:59.095008 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6a347525-3e22-4e66-b7f7-fc7be2d4fe37 req-61c48f90-0ae0-4172-846c-b3625f17f6aa service nova] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Received event network-changed-89ae21a1-1d94-4446-8c5a-4aac2a148584 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:57:59.095194 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6a347525-3e22-4e66-b7f7-fc7be2d4fe37 req-61c48f90-0ae0-4172-846c-b3625f17f6aa service nova] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Refreshing instance network info cache due to event network-changed-89ae21a1-1d94-4446-8c5a-4aac2a148584. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 09:57:59.095398 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6a347525-3e22-4e66-b7f7-fc7be2d4fe37 req-61c48f90-0ae0-4172-846c-b3625f17f6aa service nova] Acquiring lock "refresh_cache-92fbf243-1c5b-47f6-9317-3fb2655651db" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:57:59.095398 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6a347525-3e22-4e66-b7f7-fc7be2d4fe37 req-61c48f90-0ae0-4172-846c-b3625f17f6aa service nova] Acquired lock "refresh_cache-92fbf243-1c5b-47f6-9317-3fb2655651db" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:57:59.095524 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-6a347525-3e22-4e66-b7f7-fc7be2d4fe37 req-61c48f90-0ae0-4172-846c-b3625f17f6aa service nova] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Refreshing network info cache for port 89ae21a1-1d94-4446-8c5a-4aac2a148584 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 09:57:59.130659 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:59.180508 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962279.1786046, 92fbf243-1c5b-47f6-9317-3fb2655651db => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:57:59.180508 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] VM Resumed (Lifecycle Event)
May 28 09:57:59.219409 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:57:59.219409 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:57:59.219685 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:57:59.220592 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:57:59.220658 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:57:59.221029 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:57:59.259538 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:59.267647 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:59.278638 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:59.304050 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:59.305933 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:57:59.420011 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-b0db2fbb-a6ae-4ea1-afce-a471118bade8 req-12093c05-852e-422c-a36f-7d76a0600e51 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:59.452458 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:59.602900 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-6a347525-3e22-4e66-b7f7-fc7be2d4fe37 req-61c48f90-0ae0-4172-846c-b3625f17f6aa service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:57:59.687402 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:57:59.698719 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 09:57:59.720456 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-b0db2fbb-a6ae-4ea1-afce-a471118bade8 req-12093c05-852e-422c-a36f-7d76a0600e51 service nova] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Updated VIF entry in instance network info cache for port 7be666db-db21-439b-958d-3721cb9c4fdd. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 09:57:59.720456 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-b0db2fbb-a6ae-4ea1-afce-a471118bade8 req-12093c05-852e-422c-a36f-7d76a0600e51 service nova] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Updating instance_info_cache with network_info: [{"id": "7be666db-db21-439b-958d-3721cb9c4fdd", "address": "fa:16:3e:31:51:06", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be666db-db", "ovs_interfaceid": "7be666db-db21-439b-958d-3721cb9c4fdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:57:59.730307 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Took 17.53 seconds to spawn the instance on the hypervisor.
May 28 09:57:59.730597 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:57:59.746002 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Creating config drive at /opt/stack/data/nova/instances/0dca786c-46bb-48dc-a01a-e282daa84a89/disk.config
May 28 09:57:59.772259 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0dca786c-46bb-48dc-a01a-e282daa84a89/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdhog9tm8 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:57:59.822212 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0dca786c-46bb-48dc-a01a-e282daa84a89/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdhog9tm8" returned: 0 in 0.050s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:00.141633 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 09:58:00.142049 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 09:58:00.203549 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962280.20311, 49ff17d1-cad9-463e-b5c1-3315c52412e6 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:58:00.203799 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] VM Resumed (Lifecycle Event)
May 28 09:58:00.223179 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b0db2fbb-a6ae-4ea1-afce-a471118bade8 req-12093c05-852e-422c-a36f-7d76a0600e51 service nova] Releasing lock "refresh_cache-53ad56cc-eb5b-4e2e-a421-e93deee27fe7" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:58:00.226256 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-6a347525-3e22-4e66-b7f7-fc7be2d4fe37 req-61c48f90-0ae0-4172-846c-b3625f17f6aa service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:00.261305 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Took 27.18 seconds to build instance.
May 28 09:58:00.367816 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:00.401475 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:00.436292 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-6a347525-3e22-4e66-b7f7-fc7be2d4fe37 req-61c48f90-0ae0-4172-846c-b3625f17f6aa service nova] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Updated VIF entry in instance network info cache for port 89ae21a1-1d94-4446-8c5a-4aac2a148584. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 09:58:00.436676 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-6a347525-3e22-4e66-b7f7-fc7be2d4fe37 req-61c48f90-0ae0-4172-846c-b3625f17f6aa service nova] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Updating instance_info_cache with network_info: [{"id": "89ae21a1-1d94-4446-8c5a-4aac2a148584", "address": "fa:16:3e:fb:01:60", "network": {"id": "ef2b39d2-3b8b-4ce9-87ad-a8930410e6ef", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1224875930-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "baa985120ab84c2a93a64fdab8e0d4e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ae21a1-1d", "ovs_interfaceid": "89ae21a1-1d94-4446-8c5a-4aac2a148584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:58:00.495541 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-9ac54381-a85e-40ad-ad0c-f3b65165d971 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:58:00.507376 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:00.545646 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2fdf8af7-d29d-43d1-951e-8ce83b7d829c req-f1d1dbd9-3727-4ab9-bc59-b34982b3ac01 service nova] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Received event network-changed-3e64d22f-6078-49f1-9576-b70571e7f6e6 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:00.546217 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2fdf8af7-d29d-43d1-951e-8ce83b7d829c req-f1d1dbd9-3727-4ab9-bc59-b34982b3ac01 service nova] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Refreshing instance network info cache due to event network-changed-3e64d22f-6078-49f1-9576-b70571e7f6e6. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 09:58:00.547674 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2fdf8af7-d29d-43d1-951e-8ce83b7d829c req-f1d1dbd9-3727-4ab9-bc59-b34982b3ac01 service nova] Acquiring lock "refresh_cache-49ff17d1-cad9-463e-b5c1-3315c52412e6" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:58:00.547674 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2fdf8af7-d29d-43d1-951e-8ce83b7d829c req-f1d1dbd9-3727-4ab9-bc59-b34982b3ac01 service nova] Acquired lock "refresh_cache-49ff17d1-cad9-463e-b5c1-3315c52412e6" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:58:00.547674 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-2fdf8af7-d29d-43d1-951e-8ce83b7d829c req-f1d1dbd9-3727-4ab9-bc59-b34982b3ac01 service nova] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Refreshing network info cache for port 3e64d22f-6078-49f1-9576-b70571e7f6e6 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 09:58:00.599956 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:00.647016 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 09:58:00.708914 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:58:00.711486 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 09:58:00.757290 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3c9d92a9-9dbb-4a70-8541-8cdc8ace91eb req-c4787aba-b24e-498d-8a96-d64ef6d5e27d service nova] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Received event network-changed-0ed2dfa0-2fb5-4493-91e8-597b70a39c6b {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:00.757540 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3c9d92a9-9dbb-4a70-8541-8cdc8ace91eb req-c4787aba-b24e-498d-8a96-d64ef6d5e27d service nova] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Refreshing instance network info cache due to event network-changed-0ed2dfa0-2fb5-4493-91e8-597b70a39c6b. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 09:58:00.757757 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3c9d92a9-9dbb-4a70-8541-8cdc8ace91eb req-c4787aba-b24e-498d-8a96-d64ef6d5e27d service nova] Acquiring lock "refresh_cache-e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:58:00.757881 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3c9d92a9-9dbb-4a70-8541-8cdc8ace91eb req-c4787aba-b24e-498d-8a96-d64ef6d5e27d service nova] Acquired lock "refresh_cache-e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:58:00.758892 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-3c9d92a9-9dbb-4a70-8541-8cdc8ace91eb req-c4787aba-b24e-498d-8a96-d64ef6d5e27d service nova] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Refreshing network info cache for port 0ed2dfa0-2fb5-4493-91e8-597b70a39c6b {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 09:58:00.764029 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-43d5234b-5c2d-4045-bd67-408bd24f2d6a tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lock "e2856743-3a60-4be1-b29c-b4de06f14783" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.695s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:00.789719 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:00.939022 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6a347525-3e22-4e66-b7f7-fc7be2d4fe37 req-61c48f90-0ae0-4172-846c-b3625f17f6aa service nova] Releasing lock "refresh_cache-92fbf243-1c5b-47f6-9317-3fb2655651db" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:58:01.011079 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-9ac54381-a85e-40ad-ad0c-f3b65165d971 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] instance snapshotting
May 28 09:58:01.050286 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-2fdf8af7-d29d-43d1-951e-8ce83b7d829c req-f1d1dbd9-3727-4ab9-bc59-b34982b3ac01 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:01.155661 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-9ac54381-a85e-40ad-ad0c-f3b65165d971 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Beginning live snapshot process
May 28 09:58:01.160202 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.963s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:01.163677 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 09:58:01.216978 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962281.216642, e2856743-3a60-4be1-b29c-b4de06f14783 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:58:01.217113 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] VM Resumed (Lifecycle Event)
May 28 09:58:01.263552 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-3c9d92a9-9dbb-4a70-8541-8cdc8ace91eb req-c4787aba-b24e-498d-8a96-d64ef6d5e27d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:01.529820 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-2fdf8af7-d29d-43d1-951e-8ce83b7d829c req-f1d1dbd9-3727-4ab9-bc59-b34982b3ac01 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:01.675583 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 09:58:01.675583 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 09:58:01.675583 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:01.675583 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:01.701885 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-2fdf8af7-d29d-43d1-951e-8ce83b7d829c req-f1d1dbd9-3727-4ab9-bc59-b34982b3ac01 service nova] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Updated VIF entry in instance network info cache for port 3e64d22f-6078-49f1-9576-b70571e7f6e6. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 09:58:01.706510 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-2fdf8af7-d29d-43d1-951e-8ce83b7d829c req-f1d1dbd9-3727-4ab9-bc59-b34982b3ac01 service nova] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Updating instance_info_cache with network_info: [{"id": "3e64d22f-6078-49f1-9576-b70571e7f6e6", "address": "fa:16:3e:2a:71:9a", "network": {"id": "e91751cc-c82c-4197-9ce7-ff2b4d8440a8", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-702597350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "af05aeb984e64ba8989f3db86750c648", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e64d22f-60", "ovs_interfaceid": "3e64d22f-6078-49f1-9576-b70571e7f6e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:58:01.720967 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:58:01.725609 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 09:58:01.741932 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-3c9d92a9-9dbb-4a70-8541-8cdc8ace91eb req-c4787aba-b24e-498d-8a96-d64ef6d5e27d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:01.949097 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-3c9d92a9-9dbb-4a70-8541-8cdc8ace91eb req-c4787aba-b24e-498d-8a96-d64ef6d5e27d service nova] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Updated VIF entry in instance network info cache for port 0ed2dfa0-2fb5-4493-91e8-597b70a39c6b. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 09:58:01.949429 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-3c9d92a9-9dbb-4a70-8541-8cdc8ace91eb req-c4787aba-b24e-498d-8a96-d64ef6d5e27d service nova] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Updating instance_info_cache with network_info: [{"id": "0ed2dfa0-2fb5-4493-91e8-597b70a39c6b", "address": "fa:16:3e:2d:94:a4", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed2dfa0-2f", "ovs_interfaceid": "0ed2dfa0-2fb5-4493-91e8-597b70a39c6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:58:02.011184 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bf15add17bc44e64af4c05b1dbf40dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab3ecfe4d75434cbf3cb49d37042d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 09:58:02.181645 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 09:58:02.206779 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2fdf8af7-d29d-43d1-951e-8ce83b7d829c req-f1d1dbd9-3727-4ab9-bc59-b34982b3ac01 service nova] Releasing lock "refresh_cache-49ff17d1-cad9-463e-b5c1-3315c52412e6" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:58:02.230086 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962282.2296655, 4a28d569-1ca9-4657-840c-7bb31d4644c8 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:58:02.230817 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] VM Started (Lifecycle Event)
May 28 09:58:02.381328 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:02.452730 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3c9d92a9-9dbb-4a70-8541-8cdc8ace91eb req-c4787aba-b24e-498d-8a96-d64ef6d5e27d service nova] Releasing lock "refresh_cache-e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:58:02.453008 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3c9d92a9-9dbb-4a70-8541-8cdc8ace91eb req-c4787aba-b24e-498d-8a96-d64ef6d5e27d service nova] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Received event network-vif-plugged-f6d7e225-75f0-45c5-a7b7-7ff36e772079 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:02.453256 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3c9d92a9-9dbb-4a70-8541-8cdc8ace91eb req-c4787aba-b24e-498d-8a96-d64ef6d5e27d service nova] Acquiring lock "4a28d569-1ca9-4657-840c-7bb31d4644c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:02.453700 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3c9d92a9-9dbb-4a70-8541-8cdc8ace91eb req-c4787aba-b24e-498d-8a96-d64ef6d5e27d service nova] Lock "4a28d569-1ca9-4657-840c-7bb31d4644c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:02.453883 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3c9d92a9-9dbb-4a70-8541-8cdc8ace91eb req-c4787aba-b24e-498d-8a96-d64ef6d5e27d service nova] Lock "4a28d569-1ca9-4657-840c-7bb31d4644c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:02.454036 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3c9d92a9-9dbb-4a70-8541-8cdc8ace91eb req-c4787aba-b24e-498d-8a96-d64ef6d5e27d service nova] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Processing event network-vif-plugged-f6d7e225-75f0-45c5-a7b7-7ff36e772079 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 09:58:02.454236 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3c9d92a9-9dbb-4a70-8541-8cdc8ace91eb req-c4787aba-b24e-498d-8a96-d64ef6d5e27d service nova] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Received event network-vif-plugged-f6d7e225-75f0-45c5-a7b7-7ff36e772079 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:02.454400 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3c9d92a9-9dbb-4a70-8541-8cdc8ace91eb req-c4787aba-b24e-498d-8a96-d64ef6d5e27d service nova] Acquiring lock "4a28d569-1ca9-4657-840c-7bb31d4644c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:02.454559 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3c9d92a9-9dbb-4a70-8541-8cdc8ace91eb req-c4787aba-b24e-498d-8a96-d64ef6d5e27d service nova] Lock "4a28d569-1ca9-4657-840c-7bb31d4644c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:02.454733 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3c9d92a9-9dbb-4a70-8541-8cdc8ace91eb req-c4787aba-b24e-498d-8a96-d64ef6d5e27d service nova] Lock "4a28d569-1ca9-4657-840c-7bb31d4644c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:02.454870 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3c9d92a9-9dbb-4a70-8541-8cdc8ace91eb req-c4787aba-b24e-498d-8a96-d64ef6d5e27d service nova] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] No waiting events found dispatching network-vif-plugged-f6d7e225-75f0-45c5-a7b7-7ff36e772079 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:58:02.455017 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-3c9d92a9-9dbb-4a70-8541-8cdc8ace91eb req-c4787aba-b24e-498d-8a96-d64ef6d5e27d service nova] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Received unexpected event network-vif-plugged-f6d7e225-75f0-45c5-a7b7-7ff36e772079 for instance with vm_state building and task_state spawning.
May 28 09:58:02.455147 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3c9d92a9-9dbb-4a70-8541-8cdc8ace91eb req-c4787aba-b24e-498d-8a96-d64ef6d5e27d service nova] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Received event network-vif-plugged-5169a8fe-f36b-4d06-8497-4407070563c7 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:02.455445 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3c9d92a9-9dbb-4a70-8541-8cdc8ace91eb req-c4787aba-b24e-498d-8a96-d64ef6d5e27d service nova] Acquiring lock "0dca786c-46bb-48dc-a01a-e282daa84a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:02.455597 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3c9d92a9-9dbb-4a70-8541-8cdc8ace91eb req-c4787aba-b24e-498d-8a96-d64ef6d5e27d service nova] Lock "0dca786c-46bb-48dc-a01a-e282daa84a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:02.455935 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3c9d92a9-9dbb-4a70-8541-8cdc8ace91eb req-c4787aba-b24e-498d-8a96-d64ef6d5e27d service nova] Lock "0dca786c-46bb-48dc-a01a-e282daa84a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:02.456074 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3c9d92a9-9dbb-4a70-8541-8cdc8ace91eb req-c4787aba-b24e-498d-8a96-d64ef6d5e27d service nova] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Processing event network-vif-plugged-5169a8fe-f36b-4d06-8497-4407070563c7 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 09:58:02.456679 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 09:58:02.457785 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 09:58:02.464516 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 09:58:02.467958 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 09:58:02.473878 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Instance spawned successfully.
May 28 09:58:02.474988 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 09:58:02.476208 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Instance spawned successfully.
May 28 09:58:02.479217 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 09:58:02.677313 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-1159b067-2d43-4332-b198-643d0c5048de req-d5fc3e60-c4f1-482e-aa4d-864f0951c055 service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Received event network-changed-2fad8030-7c30-438c-8dcd-b9a8ba1849d1 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:02.677765 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-1159b067-2d43-4332-b198-643d0c5048de req-d5fc3e60-c4f1-482e-aa4d-864f0951c055 service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Refreshing instance network info cache due to event network-changed-2fad8030-7c30-438c-8dcd-b9a8ba1849d1. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 09:58:02.677765 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1159b067-2d43-4332-b198-643d0c5048de req-d5fc3e60-c4f1-482e-aa4d-864f0951c055 service nova] Acquiring lock "refresh_cache-e2856743-3a60-4be1-b29c-b4de06f14783" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:58:02.677765 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1159b067-2d43-4332-b198-643d0c5048de req-d5fc3e60-c4f1-482e-aa4d-864f0951c055 service nova] Acquired lock "refresh_cache-e2856743-3a60-4be1-b29c-b4de06f14783" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:58:02.677959 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-1159b067-2d43-4332-b198-643d0c5048de req-d5fc3e60-c4f1-482e-aa4d-864f0951c055 service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Refreshing network info cache for port 2fad8030-7c30-438c-8dcd-b9a8ba1849d1 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 09:58:02.687207 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Successfully created port: 6a88c703-7b82-44ce-b5f5-a98718ae6833 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 09:58:02.698127 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-9ac54381-a85e-40ad-ad0c-f3b65165d971 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/289e2914-2be4-4f46-92e0-fa623f8db861/disk --force-share --output=json -f qcow2 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:02.733963 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:58:02.736732 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 09:58:02.794738 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-9ac54381-a85e-40ad-ad0c-f3b65165d971 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/289e2914-2be4-4f46-92e0-fa623f8db861/disk --force-share --output=json -f qcow2" returned: 0 in 0.096s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:02.795728 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-9ac54381-a85e-40ad-ad0c-f3b65165d971 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/289e2914-2be4-4f46-92e0-fa623f8db861/disk --force-share --output=json -f qcow2 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:02.861056 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-584ceed6-4129-440c-a224-9a2fa0f21abf req-8c53bd41-0906-4ca9-b844-ae353f632e47 service nova] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Received event network-vif-plugged-5169a8fe-f36b-4d06-8497-4407070563c7 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:02.863945 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-584ceed6-4129-440c-a224-9a2fa0f21abf req-8c53bd41-0906-4ca9-b844-ae353f632e47 service nova] Acquiring lock "0dca786c-46bb-48dc-a01a-e282daa84a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:02.864905 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-584ceed6-4129-440c-a224-9a2fa0f21abf req-8c53bd41-0906-4ca9-b844-ae353f632e47 service nova] Lock "0dca786c-46bb-48dc-a01a-e282daa84a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:02.864905 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-584ceed6-4129-440c-a224-9a2fa0f21abf req-8c53bd41-0906-4ca9-b844-ae353f632e47 service nova] Lock "0dca786c-46bb-48dc-a01a-e282daa84a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:02.864905 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-584ceed6-4129-440c-a224-9a2fa0f21abf req-8c53bd41-0906-4ca9-b844-ae353f632e47 service nova] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] No waiting events found dispatching network-vif-plugged-5169a8fe-f36b-4d06-8497-4407070563c7 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:58:02.865259 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-584ceed6-4129-440c-a224-9a2fa0f21abf req-8c53bd41-0906-4ca9-b844-ae353f632e47 service nova] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Received unexpected event network-vif-plugged-5169a8fe-f36b-4d06-8497-4407070563c7 for instance with vm_state building and task_state spawning.
May 28 09:58:02.898368 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-9ac54381-a85e-40ad-ad0c-f3b65165d971 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/289e2914-2be4-4f46-92e0-fa623f8db861/disk --force-share --output=json -f qcow2" returned: 0 in 0.102s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:02.899934 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-9ac54381-a85e-40ad-ad0c-f3b65165d971 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:58:02.903914 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-9ac54381-a85e-40ad-ad0c-f3b65165d971 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:58:02.904464 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-9ac54381-a85e-40ad-ad0c-f3b65165d971 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:02.994786 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:58:02.995698 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:58:02.995698 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:58:02.996094 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:58:02.996735 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:58:02.998067 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:58:02.998067 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:58:02.998067 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:58:02.998229 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:58:02.998892 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:58:02.999363 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:58:03.002791 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:58:03.007950 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-9ac54381-a85e-40ad-ad0c-f3b65165d971 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.104s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:03.010415 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-9ac54381-a85e-40ad-ad0c-f3b65165d971 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfpw3kkpp/828cfee9e44449bab3c9304e6b2c190c.delta 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:03.064846 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-9ac54381-a85e-40ad-ad0c-f3b65165d971 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfpw3kkpp/828cfee9e44449bab3c9304e6b2c190c.delta 1073741824" returned: 0 in 0.054s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:03.065541 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-9ac54381-a85e-40ad-ad0c-f3b65165d971 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Quiescing instance not available: QEMU guest agent is not enabled.
May 28 09:58:03.182100 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-1159b067-2d43-4332-b198-643d0c5048de req-d5fc3e60-c4f1-482e-aa4d-864f0951c055 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:03.241113 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 09:58:03.243150 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962283.2412803, 4a28d569-1ca9-4657-840c-7bb31d4644c8 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:58:03.243150 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] VM Paused (Lifecycle Event)
May 28 09:58:03.365950 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Successfully created port: edca6f4e-7f57-4351-8525-4446771d6376 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 09:58:03.368773 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-9ac54381-a85e-40ad-ad0c-f3b65165d971 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=98321) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 28 09:58:03.374152 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-9ac54381-a85e-40ad-ad0c-f3b65165d971 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Skipping quiescing instance: QEMU guest agent is not enabled.
May 28 09:58:03.437345 np0000001613 nova-compute[98321]: DEBUG nova.privsep.utils [None req-9ac54381-a85e-40ad-ad0c-f3b65165d971 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98321) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 09:58:03.437704 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-9ac54381-a85e-40ad-ad0c-f3b65165d971 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfpw3kkpp/828cfee9e44449bab3c9304e6b2c190c.delta /opt/stack/data/nova/instances/snapshots/tmpfpw3kkpp/828cfee9e44449bab3c9304e6b2c190c {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:03.511402 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Took 11.65 seconds to spawn the instance on the hypervisor.
May 28 09:58:03.511583 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:58:03.514649 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Took 9.11 seconds to spawn the instance on the hypervisor.
May 28 09:58:03.514906 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:58:03.675356 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-9ac54381-a85e-40ad-ad0c-f3b65165d971 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfpw3kkpp/828cfee9e44449bab3c9304e6b2c190c.delta /opt/stack/data/nova/instances/snapshots/tmpfpw3kkpp/828cfee9e44449bab3c9304e6b2c190c" returned: 0 in 0.238s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:03.676191 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-9ac54381-a85e-40ad-ad0c-f3b65165d971 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Snapshot extracted, beginning image upload
May 28 09:58:03.700227 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 09:58:03.730546 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-1159b067-2d43-4332-b198-643d0c5048de req-d5fc3e60-c4f1-482e-aa4d-864f0951c055 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:03.745488 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:58:03.749943 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962283.749554, 0dca786c-46bb-48dc-a01a-e282daa84a89 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:58:03.750116 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] VM Started (Lifecycle Event)
May 28 09:58:03.913844 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-1159b067-2d43-4332-b198-643d0c5048de req-d5fc3e60-c4f1-482e-aa4d-864f0951c055 service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Updated VIF entry in instance network info cache for port 2fad8030-7c30-438c-8dcd-b9a8ba1849d1. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 09:58:03.914619 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-1159b067-2d43-4332-b198-643d0c5048de req-d5fc3e60-c4f1-482e-aa4d-864f0951c055 service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Updating instance_info_cache with network_info: [{"id": "2fad8030-7c30-438c-8dcd-b9a8ba1849d1", "address": "fa:16:3e:9a:42:b3", "network": {"id": "48f4f13e-9b4c-4776-a2bd-47a4984571ae", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-337905894-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "25a0adc32dd74f039cc231cceb9131a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fad8030-7c", "ovs_interfaceid": "2fad8030-7c30-438c-8dcd-b9a8ba1849d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:58:04.028092 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Successfully created port: d3b48415-3d34-4753-a72f-6f48536174ed {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 09:58:04.032923 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Took 17.29 seconds to build instance.
May 28 09:58:04.043818 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Took 17.19 seconds to build instance.
May 28 09:58:04.131374 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:04.209823 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Booting with volume 78480fee-64ba-4d69-b21d-c54483406ae0 at /dev/vda
May 28 09:58:04.255964 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:58:04.263917 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 09:58:04.299839 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 09:58:04.300565 np0000001613 nova-compute[98321]: INFO oslo.privsep.daemon [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpludwtqdy/privsep.sock']
May 28 09:58:04.318784 np0000001613 sudo[111327]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpludwtqdy/privsep.sock
May 28 09:58:04.324385 np0000001613 sudo[111327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 28 09:58:04.417281 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1159b067-2d43-4332-b198-643d0c5048de req-d5fc3e60-c4f1-482e-aa4d-864f0951c055 service nova] Releasing lock "refresh_cache-e2856743-3a60-4be1-b29c-b4de06f14783" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:58:04.535823 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "4a28d569-1ca9-4657-840c-7bb31d4644c8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.814s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:04.547048 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "0dca786c-46bb-48dc-a01a-e282daa84a89" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.708s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:04.642094 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Successfully created port: e08f0477-e673-4559-884f-1dcbc2a9fd0e {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 09:58:04.676245 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 28 09:58:04.676245 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 28 09:58:04.676245 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 28 09:58:04.676245 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 09:58:04.676245 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 28 09:58:04.676245 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 28 09:58:04.676514 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 28 09:58:04.676514 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 09:58:04.676514 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 28 09:58:04.770556 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962284.7674334, 0dca786c-46bb-48dc-a01a-e282daa84a89 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:58:04.770556 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] VM Paused (Lifecycle Event)
May 28 09:58:05.042914 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 28 09:58:05.043632 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 28 09:58:05.043916 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 28 09:58:05.043916 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 09:58:05.043986 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 28 09:58:05.045180 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 28 09:58:05.045180 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 28 09:58:05.045180 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 09:58:05.045180 np0000001613 nova-compute[98321]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 28 09:58:05.273192 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:58:05.277530 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962285.2772155, 4a28d569-1ca9-4657-840c-7bb31d4644c8 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:58:05.277661 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] VM Resumed (Lifecycle Event)
May 28 09:58:05.353683 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Successfully created port: 27187d46-bd01-4781-99fe-29d49015360e {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 09:58:05.390367 np0000001613 sudo[111327]: pam_unix(sudo:session): session closed for user root
May 28 09:58:05.392273 np0000001613 nova-compute[98321]: INFO oslo.privsep.daemon [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Spawned new privsep daemon via rootwrap
May 28 09:58:05.531904 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 09:58:05.532416 np0000001613 nova-compute[98321]: WARNING os_brick.initiator.connectors.nvmeof [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
May 28 09:58:05.558829 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:05.593197 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 09:58:05.595603 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 09:58:05.607040 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 09:58:05.613184 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe95:8bd3', 'fe80::fc16:3eff:fe2d:94a4', 'fe80::fc16:3eff:fe31:5106', 'fe80::fc96:34ff:fe12:e4df', 'fe80::2844:59ff:feec:5d21', 'fe80::44e2:31ff:fe81:8771', 'fe80::fc16:3eff:fe9a:42b3', 'fe80::b04e:afff:fe71:41fc', 'fe80::fc16:3eff:fefb:160', 'fe80::5c68:7cff:fe27:e759', 'fe80::fc16:3eff:fe2a:719a', 'fe80::9038:13ff:fe5b:5aad', 'fe80::fc16:3eff:fe9c:2e17', 'fe80::8064:4aff:fe56:ba53', 'fe80::fc16:3eff:fe14:ef87'] 
May 28 09:58:05.613421 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 09:58:05.613613 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 09:58:05.613918 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] <== get_connector_properties: return (1314ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 09:58:05.614276 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Updating existing volume attachment record: fda86385-46f7-44cd-a800-909683ec0775 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 09:58:05.780698 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:58:05.786060 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 09:58:06.219106 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Successfully updated port: 6a88c703-7b82-44ce-b5f5-a98718ae6833 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 09:58:06.289506 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962286.2890828, 0dca786c-46bb-48dc-a01a-e282daa84a89 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:58:06.289978 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] VM Resumed (Lifecycle Event)
May 28 09:58:06.312883 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-02a9e922-6282-4ed9-92f6-9795c21b7455 req-90fccfb3-bcb7-41f6-89e2-0c7cb5597904 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-changed-6a88c703-7b82-44ce-b5f5-a98718ae6833 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:06.312883 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-02a9e922-6282-4ed9-92f6-9795c21b7455 req-90fccfb3-bcb7-41f6-89e2-0c7cb5597904 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Refreshing instance network info cache due to event network-changed-6a88c703-7b82-44ce-b5f5-a98718ae6833. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 09:58:06.312883 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-02a9e922-6282-4ed9-92f6-9795c21b7455 req-90fccfb3-bcb7-41f6-89e2-0c7cb5597904 service nova] Acquiring lock "refresh_cache-7514b113-ec17-468b-a647-de099d90e787" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:58:06.312989 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-02a9e922-6282-4ed9-92f6-9795c21b7455 req-90fccfb3-bcb7-41f6-89e2-0c7cb5597904 service nova] Acquired lock "refresh_cache-7514b113-ec17-468b-a647-de099d90e787" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:58:06.313150 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-02a9e922-6282-4ed9-92f6-9795c21b7455 req-90fccfb3-bcb7-41f6-89e2-0c7cb5597904 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Refreshing network info cache for port 6a88c703-7b82-44ce-b5f5-a98718ae6833 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 09:58:06.510782 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-964058e9-167b-4d5c-9947-dc4ab6a6cd2b req-bca48b95-4e73-4dac-9712-69db36d7e26b service nova] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Received event network-changed-5169a8fe-f36b-4d06-8497-4407070563c7 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:06.510939 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-964058e9-167b-4d5c-9947-dc4ab6a6cd2b req-bca48b95-4e73-4dac-9712-69db36d7e26b service nova] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Refreshing instance network info cache due to event network-changed-5169a8fe-f36b-4d06-8497-4407070563c7. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 09:58:06.511139 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-964058e9-167b-4d5c-9947-dc4ab6a6cd2b req-bca48b95-4e73-4dac-9712-69db36d7e26b service nova] Acquiring lock "refresh_cache-0dca786c-46bb-48dc-a01a-e282daa84a89" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:58:06.511284 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-964058e9-167b-4d5c-9947-dc4ab6a6cd2b req-bca48b95-4e73-4dac-9712-69db36d7e26b service nova] Acquired lock "refresh_cache-0dca786c-46bb-48dc-a01a-e282daa84a89" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:58:06.511413 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-964058e9-167b-4d5c-9947-dc4ab6a6cd2b req-bca48b95-4e73-4dac-9712-69db36d7e26b service nova] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Refreshing network info cache for port 5169a8fe-f36b-4d06-8497-4407070563c7 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 09:58:06.795441 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:58:06.800323 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 09:58:06.818192 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-02a9e922-6282-4ed9-92f6-9795c21b7455 req-90fccfb3-bcb7-41f6-89e2-0c7cb5597904 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:06.921352 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-02a9e922-6282-4ed9-92f6-9795c21b7455 req-90fccfb3-bcb7-41f6-89e2-0c7cb5597904 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 09:58:07.016455 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-964058e9-167b-4d5c-9947-dc4ab6a6cd2b req-bca48b95-4e73-4dac-9712-69db36d7e26b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:07.165846 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-02a9e922-6282-4ed9-92f6-9795c21b7455 req-90fccfb3-bcb7-41f6-89e2-0c7cb5597904 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:58:07.353552 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Booting with volume 837d0fb8-c967-40a4-9f26-6c610571e2a5 at /dev/vdb
May 28 09:58:07.383908 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:07.427038 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 09:58:07.453790 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 09:58:07.487750 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:07.516180 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-964058e9-167b-4d5c-9947-dc4ab6a6cd2b req-bca48b95-4e73-4dac-9712-69db36d7e26b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:07.524030 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 09:58:07.524409 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 09:58:07.531726 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Successfully updated port: 4e1903f1-9c64-411e-be18-e5775f055e13 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 09:58:07.537590 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 09:58:07.539070 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe95:8bd3', 'fe80::fc16:3eff:fe2d:94a4', 'fe80::fc16:3eff:fe31:5106', 'fe80::fc96:34ff:fe12:e4df', 'fe80::2844:59ff:feec:5d21', 'fe80::44e2:31ff:fe81:8771', 'fe80::fc16:3eff:fe9a:42b3', 'fe80::b04e:afff:fe71:41fc', 'fe80::fc16:3eff:fefb:160', 'fe80::5c68:7cff:fe27:e759', 'fe80::fc16:3eff:fe2a:719a', 'fe80::9038:13ff:fe5b:5aad', 'fe80::fc16:3eff:fe9c:2e17', 'fe80::8064:4aff:fe56:ba53', 'fe80::fc16:3eff:fe14:ef87'] 
May 28 09:58:07.539218 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 09:58:07.539985 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 09:58:07.540250 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 09:58:07.540565 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Updating existing volume attachment record: e0e62bc1-b56e-4055-97d3-0d0197345bec {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 09:58:07.622536 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-fe141594-de6c-47f4-8726-074b8980e921 req-b6861d35-17a3-4828-881b-db73a557dda7 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-changed-4e1903f1-9c64-411e-be18-e5775f055e13 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:07.622675 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-fe141594-de6c-47f4-8726-074b8980e921 req-b6861d35-17a3-4828-881b-db73a557dda7 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Refreshing instance network info cache due to event network-changed-4e1903f1-9c64-411e-be18-e5775f055e13. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 09:58:07.622878 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-fe141594-de6c-47f4-8726-074b8980e921 req-b6861d35-17a3-4828-881b-db73a557dda7 service nova] Acquiring lock "refresh_cache-7514b113-ec17-468b-a647-de099d90e787" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:58:07.670284 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-02a9e922-6282-4ed9-92f6-9795c21b7455 req-90fccfb3-bcb7-41f6-89e2-0c7cb5597904 service nova] Releasing lock "refresh_cache-7514b113-ec17-468b-a647-de099d90e787" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:58:07.670771 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-fe141594-de6c-47f4-8726-074b8980e921 req-b6861d35-17a3-4828-881b-db73a557dda7 service nova] Acquired lock "refresh_cache-7514b113-ec17-468b-a647-de099d90e787" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:58:07.670833 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-fe141594-de6c-47f4-8726-074b8980e921 req-b6861d35-17a3-4828-881b-db73a557dda7 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Refreshing network info cache for port 4e1903f1-9c64-411e-be18-e5775f055e13 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 09:58:07.752228 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-964058e9-167b-4d5c-9947-dc4ab6a6cd2b req-bca48b95-4e73-4dac-9712-69db36d7e26b service nova] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Updated VIF entry in instance network info cache for port 5169a8fe-f36b-4d06-8497-4407070563c7. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 09:58:07.752548 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-964058e9-167b-4d5c-9947-dc4ab6a6cd2b req-bca48b95-4e73-4dac-9712-69db36d7e26b service nova] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Updating instance_info_cache with network_info: [{"id": "5169a8fe-f36b-4d06-8497-4407070563c7", "address": "fa:16:3e:14:ef:87", "network": {"id": "d4fe3269-1c90-4590-b389-2d9e64a1874b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-397043690-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4466c6404538446eb4c8bd45bb2a95f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5169a8fe-f3", "ovs_interfaceid": "5169a8fe-f36b-4d06-8497-4407070563c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:58:07.790517 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-9ac54381-a85e-40ad-ad0c-f3b65165d971 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Snapshot image upload complete
May 28 09:58:07.790793 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-9ac54381-a85e-40ad-ad0c-f3b65165d971 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Took 6.78 seconds to snapshot the instance on the hypervisor.
May 28 09:58:08.175791 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-fe141594-de6c-47f4-8726-074b8980e921 req-b6861d35-17a3-4828-881b-db73a557dda7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:08.256092 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-964058e9-167b-4d5c-9947-dc4ab6a6cd2b req-bca48b95-4e73-4dac-9712-69db36d7e26b service nova] Releasing lock "refresh_cache-0dca786c-46bb-48dc-a01a-e282daa84a89" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:58:08.288634 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-fe141594-de6c-47f4-8726-074b8980e921 req-b6861d35-17a3-4828-881b-db73a557dda7 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 09:58:08.490111 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-fe141594-de6c-47f4-8726-074b8980e921 req-b6861d35-17a3-4828-881b-db73a557dda7 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:58:08.750030 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Successfully updated port: 4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 09:58:08.805308 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5bff58eb-2955-4fd7-9085-181b9f6b9dd5 req-e160c07e-5eb5-4165-aab3-2c698ea8d81d service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-changed-4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:08.805695 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5bff58eb-2955-4fd7-9085-181b9f6b9dd5 req-e160c07e-5eb5-4165-aab3-2c698ea8d81d service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Refreshing instance network info cache due to event network-changed-4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 09:58:08.806633 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5bff58eb-2955-4fd7-9085-181b9f6b9dd5 req-e160c07e-5eb5-4165-aab3-2c698ea8d81d service nova] Acquiring lock "refresh_cache-7514b113-ec17-468b-a647-de099d90e787" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:58:08.992424 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-fe141594-de6c-47f4-8726-074b8980e921 req-b6861d35-17a3-4828-881b-db73a557dda7 service nova] Releasing lock "refresh_cache-7514b113-ec17-468b-a647-de099d90e787" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:58:08.994221 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5bff58eb-2955-4fd7-9085-181b9f6b9dd5 req-e160c07e-5eb5-4165-aab3-2c698ea8d81d service nova] Acquired lock "refresh_cache-7514b113-ec17-468b-a647-de099d90e787" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:58:08.994221 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-5bff58eb-2955-4fd7-9085-181b9f6b9dd5 req-e160c07e-5eb5-4165-aab3-2c698ea8d81d service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Refreshing network info cache for port 4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 09:58:09.132740 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:09.230518 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Booting with volume a7492b29-87c5-41d8-a3c7-669eb8c75480 at /dev/vdc
May 28 09:58:09.291738 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 09:58:09.309001 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 09:58:09.335044 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:09.364793 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 09:58:09.367821 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 09:58:09.379281 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 09:58:09.381873 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe95:8bd3', 'fe80::fc16:3eff:fe2d:94a4', 'fe80::fc16:3eff:fe31:5106', 'fe80::fc96:34ff:fe12:e4df', 'fe80::2844:59ff:feec:5d21', 'fe80::44e2:31ff:fe81:8771', 'fe80::fc16:3eff:fe9a:42b3', 'fe80::b04e:afff:fe71:41fc', 'fe80::fc16:3eff:fefb:160', 'fe80::5c68:7cff:fe27:e759', 'fe80::fc16:3eff:fe2a:719a', 'fe80::9038:13ff:fe5b:5aad', 'fe80::fc16:3eff:fe9c:2e17', 'fe80::8064:4aff:fe56:ba53', 'fe80::fc16:3eff:fe14:ef87'] 
May 28 09:58:09.382411 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 09:58:09.383095 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 09:58:09.383095 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] <== get_connector_properties: return (87ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 09:58:09.383237 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Updating existing volume attachment record: 506032be-ccfa-4d85-9f42-e8dbfd76567d {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 09:58:09.495996 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-5bff58eb-2955-4fd7-9085-181b9f6b9dd5 req-e160c07e-5eb5-4165-aab3-2c698ea8d81d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:09.631534 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-5bff58eb-2955-4fd7-9085-181b9f6b9dd5 req-e160c07e-5eb5-4165-aab3-2c698ea8d81d service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 09:58:09.896214 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-5bff58eb-2955-4fd7-9085-181b9f6b9dd5 req-e160c07e-5eb5-4165-aab3-2c698ea8d81d service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:58:09.981367 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Successfully updated port: edca6f4e-7f57-4351-8525-4446771d6376 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 09:58:10.049623 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-fee4b5c6-ed9f-46e6-80a0-455d7ce5fe91 req-2c30ab78-ab4f-403c-97f0-7438dd6465ef service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-changed-edca6f4e-7f57-4351-8525-4446771d6376 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:10.050830 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-fee4b5c6-ed9f-46e6-80a0-455d7ce5fe91 req-2c30ab78-ab4f-403c-97f0-7438dd6465ef service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Refreshing instance network info cache due to event network-changed-edca6f4e-7f57-4351-8525-4446771d6376. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 09:58:10.051076 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-fee4b5c6-ed9f-46e6-80a0-455d7ce5fe91 req-2c30ab78-ab4f-403c-97f0-7438dd6465ef service nova] Acquiring lock "refresh_cache-7514b113-ec17-468b-a647-de099d90e787" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:58:10.399378 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5bff58eb-2955-4fd7-9085-181b9f6b9dd5 req-e160c07e-5eb5-4165-aab3-2c698ea8d81d service nova] Releasing lock "refresh_cache-7514b113-ec17-468b-a647-de099d90e787" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:58:10.399378 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-fee4b5c6-ed9f-46e6-80a0-455d7ce5fe91 req-2c30ab78-ab4f-403c-97f0-7438dd6465ef service nova] Acquired lock "refresh_cache-7514b113-ec17-468b-a647-de099d90e787" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:58:10.399378 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-fee4b5c6-ed9f-46e6-80a0-455d7ce5fe91 req-2c30ab78-ab4f-403c-97f0-7438dd6465ef service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Refreshing network info cache for port edca6f4e-7f57-4351-8525-4446771d6376 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 09:58:10.901677 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-fee4b5c6-ed9f-46e6-80a0-455d7ce5fe91 req-2c30ab78-ab4f-403c-97f0-7438dd6465ef service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:11.019685 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-fee4b5c6-ed9f-46e6-80a0-455d7ce5fe91 req-2c30ab78-ab4f-403c-97f0-7438dd6465ef service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 09:58:11.120003 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "57d353b6-133e-4354-a4f4-7bcec543d586" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:11.121673 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "57d353b6-133e-4354-a4f4-7bcec543d586" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:11.169220 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Successfully updated port: d3b48415-3d34-4753-a72f-6f48536174ed {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 09:58:11.226386 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-9bf9ac30-3adc-46f2-b0c0-99f9fe4115a3 req-96c860e5-18c9-486c-9981-a5d64ad9fca6 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-changed-d3b48415-3d34-4753-a72f-6f48536174ed {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:11.226652 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-9bf9ac30-3adc-46f2-b0c0-99f9fe4115a3 req-96c860e5-18c9-486c-9981-a5d64ad9fca6 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Refreshing instance network info cache due to event network-changed-d3b48415-3d34-4753-a72f-6f48536174ed. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 09:58:11.226879 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9bf9ac30-3adc-46f2-b0c0-99f9fe4115a3 req-96c860e5-18c9-486c-9981-a5d64ad9fca6 service nova] Acquiring lock "refresh_cache-7514b113-ec17-468b-a647-de099d90e787" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:58:11.276759 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-fee4b5c6-ed9f-46e6-80a0-455d7ce5fe91 req-2c30ab78-ab4f-403c-97f0-7438dd6465ef service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:58:11.545298 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 09:58:11.546922 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 09:58:11.547141 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Creating image(s)
May 28 09:58:11.547451 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Did not create local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 09:58:11.547571 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Ensure instance console log exists: /opt/stack/data/nova/instances/7514b113-ec17-468b-a647-de099d90e787/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 09:58:11.547784 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:11.547961 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:11.548086 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:11.623850 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 09:58:11.779059 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-fee4b5c6-ed9f-46e6-80a0-455d7ce5fe91 req-2c30ab78-ab4f-403c-97f0-7438dd6465ef service nova] Releasing lock "refresh_cache-7514b113-ec17-468b-a647-de099d90e787" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:58:11.779438 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9bf9ac30-3adc-46f2-b0c0-99f9fe4115a3 req-96c860e5-18c9-486c-9981-a5d64ad9fca6 service nova] Acquired lock "refresh_cache-7514b113-ec17-468b-a647-de099d90e787" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:58:11.779759 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-9bf9ac30-3adc-46f2-b0c0-99f9fe4115a3 req-96c860e5-18c9-486c-9981-a5d64ad9fca6 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Refreshing network info cache for port d3b48415-3d34-4753-a72f-6f48536174ed {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 09:58:12.206841 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:12.207281 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:12.213744 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 09:58:12.213876 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Claim successful on node np0000001613
May 28 09:58:12.282714 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Successfully updated port: e08f0477-e673-4559-884f-1dcbc2a9fd0e {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 09:58:12.284270 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-9bf9ac30-3adc-46f2-b0c0-99f9fe4115a3 req-96c860e5-18c9-486c-9981-a5d64ad9fca6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:12.358055 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b812cc9c-33c1-47d8-a570-852a3dbe63c2 req-33c1424f-abfb-40b6-95e8-d622248eaeb3 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-changed-e08f0477-e673-4559-884f-1dcbc2a9fd0e {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:12.358796 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b812cc9c-33c1-47d8-a570-852a3dbe63c2 req-33c1424f-abfb-40b6-95e8-d622248eaeb3 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Refreshing instance network info cache due to event network-changed-e08f0477-e673-4559-884f-1dcbc2a9fd0e. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 09:58:12.358796 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b812cc9c-33c1-47d8-a570-852a3dbe63c2 req-33c1424f-abfb-40b6-95e8-d622248eaeb3 service nova] Acquiring lock "refresh_cache-7514b113-ec17-468b-a647-de099d90e787" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:58:12.386697 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:12.390383 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-9bf9ac30-3adc-46f2-b0c0-99f9fe4115a3 req-96c860e5-18c9-486c-9981-a5d64ad9fca6 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 09:58:12.596805 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-9bf9ac30-3adc-46f2-b0c0-99f9fe4115a3 req-96c860e5-18c9-486c-9981-a5d64ad9fca6 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:58:13.098709 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9bf9ac30-3adc-46f2-b0c0-99f9fe4115a3 req-96c860e5-18c9-486c-9981-a5d64ad9fca6 service nova] Releasing lock "refresh_cache-7514b113-ec17-468b-a647-de099d90e787" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:58:13.099180 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b812cc9c-33c1-47d8-a570-852a3dbe63c2 req-33c1424f-abfb-40b6-95e8-d622248eaeb3 service nova] Acquired lock "refresh_cache-7514b113-ec17-468b-a647-de099d90e787" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:58:13.099322 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-b812cc9c-33c1-47d8-a570-852a3dbe63c2 req-33c1424f-abfb-40b6-95e8-d622248eaeb3 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Refreshing network info cache for port e08f0477-e673-4559-884f-1dcbc2a9fd0e {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 09:58:13.386525 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Successfully updated port: 27187d46-bd01-4781-99fe-29d49015360e {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 09:58:13.607858 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-b812cc9c-33c1-47d8-a570-852a3dbe63c2 req-33c1424f-abfb-40b6-95e8-d622248eaeb3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:13.743906 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-b812cc9c-33c1-47d8-a570-852a3dbe63c2 req-33c1424f-abfb-40b6-95e8-d622248eaeb3 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 09:58:13.878212 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 09:58:13.878487 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 09:58:13.891260 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Acquiring lock "refresh_cache-7514b113-ec17-468b-a647-de099d90e787" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:58:13.971259 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-b812cc9c-33c1-47d8-a570-852a3dbe63c2 req-33c1424f-abfb-40b6-95e8-d622248eaeb3 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:58:14.135482 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:14.382350 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 09:58:14.443216 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e7f3e878-68a8-4330-8993-035e35e604ab req-50232b72-bb13-4c11-bc40-1a0ef708d2f5 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-changed-27187d46-bd01-4781-99fe-29d49015360e {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:14.444287 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e7f3e878-68a8-4330-8993-035e35e604ab req-50232b72-bb13-4c11-bc40-1a0ef708d2f5 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Refreshing instance network info cache due to event network-changed-27187d46-bd01-4781-99fe-29d49015360e. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 09:58:14.444287 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e7f3e878-68a8-4330-8993-035e35e604ab req-50232b72-bb13-4c11-bc40-1a0ef708d2f5 service nova] Acquiring lock "refresh_cache-7514b113-ec17-468b-a647-de099d90e787" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:58:14.472875 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b812cc9c-33c1-47d8-a570-852a3dbe63c2 req-33c1424f-abfb-40b6-95e8-d622248eaeb3 service nova] Releasing lock "refresh_cache-7514b113-ec17-468b-a647-de099d90e787" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:58:14.474200 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Acquired lock "refresh_cache-7514b113-ec17-468b-a647-de099d90e787" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:58:14.474200 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 09:58:14.890097 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.683s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:14.890551 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 09:58:15.094402 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 09:58:15.290733 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:15.397404 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 09:58:15.397404 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 09:58:15.397404 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:15.398000 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:15.508123 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '51981c995f2246588f2d58f35be5848a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d04b105229456d9ab53df1886fdb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 09:58:15.687841 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:15.902444 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 09:58:16.076098 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:16.095216 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Successfully created port: 9d6ec393-b62a-4342-a355-3cf8291ec2fe {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 09:58:16.409861 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 09:58:16.556304 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:16.840959 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Successfully updated port: 9d6ec393-b62a-4342-a355-3cf8291ec2fe {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 09:58:16.912891 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-1a0265a6-0b18-4de6-b9e9-e5f17fc7204b req-bc80f879-02af-4a12-8b2e-f01197d97d69 service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Received event network-changed-9d6ec393-b62a-4342-a355-3cf8291ec2fe {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:16.912891 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-1a0265a6-0b18-4de6-b9e9-e5f17fc7204b req-bc80f879-02af-4a12-8b2e-f01197d97d69 service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Refreshing instance network info cache due to event network-changed-9d6ec393-b62a-4342-a355-3cf8291ec2fe. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 09:58:16.913154 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1a0265a6-0b18-4de6-b9e9-e5f17fc7204b req-bc80f879-02af-4a12-8b2e-f01197d97d69 service nova] Acquiring lock "refresh_cache-57d353b6-133e-4354-a4f4-7bcec543d586" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:58:16.913667 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1a0265a6-0b18-4de6-b9e9-e5f17fc7204b req-bc80f879-02af-4a12-8b2e-f01197d97d69 service nova] Acquired lock "refresh_cache-57d353b6-133e-4354-a4f4-7bcec543d586" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:58:16.914068 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-1a0265a6-0b18-4de6-b9e9-e5f17fc7204b req-bc80f879-02af-4a12-8b2e-f01197d97d69 service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Refreshing network info cache for port 9d6ec393-b62a-4342-a355-3cf8291ec2fe {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 09:58:16.916887 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Booting with blank volume at /dev/vda
May 28 09:58:16.978711 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:17.346770 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "refresh_cache-57d353b6-133e-4354-a4f4-7bcec543d586" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:58:17.387825 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:17.413034 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:17.419523 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-1a0265a6-0b18-4de6-b9e9-e5f17fc7204b req-bc80f879-02af-4a12-8b2e-f01197d97d69 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:17.501699 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-1a0265a6-0b18-4de6-b9e9-e5f17fc7204b req-bc80f879-02af-4a12-8b2e-f01197d97d69 service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 09:58:17.697264 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-1a0265a6-0b18-4de6-b9e9-e5f17fc7204b req-bc80f879-02af-4a12-8b2e-f01197d97d69 service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:58:17.794343 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:17.948567 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Updating instance_info_cache with network_info: [{"id": "6a88c703-7b82-44ce-b5f5-a98718ae6833", "address": "fa:16:3e:0c:a9:71", "network": {"id": "0ef5507c-157f-4da7-9926-b55fdc2488a9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-360404380-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a88c703-7b", "ovs_interfaceid": "6a88c703-7b82-44ce-b5f5-a98718ae6833", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e1903f1-9c64-411e-be18-e5775f055e13", "address": "fa:16:3e:e8:48:00", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e1903f1-9c", "ovs_interfaceid": "4e1903f1-9c64-411e-be18-e5775f055e13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3", "address": "fa:16:3e:55:f2:21", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4490fa5a-9c", "ovs_interfaceid": "4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "edca6f4e-7f57-4351-8525-4446771d6376", "address": "fa:16:3e:31:6d:c0", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapedca6f4e-7f", "ovs_interfaceid": "edca6f4e-7f57-4351-8525-4446771d6376", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3b48415-3d34-4753-a72f-6f48536174ed", "address": "fa:16:3e:48:5c:c5", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b48415-3d", "ovs_interfaceid": "d3b48415-3d34-4753-a72f-6f48536174ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e08f0477-e673-4559-884f-1dcbc2a9fd0e", "address": "fa:16:3e:07:9b:94", "network": {"id": "57e43a7e-bde2-4d30-bf6d-7c6cc5f5d3e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935029012", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape08f0477-e6", "ovs_interfaceid": "e08f0477-e673-4559-884f-1dcbc2a9fd0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27187d46-bd01-4781-99fe-29d49015360e", "address": "fa:16:3e:38:ca:1f", "network": {"id": "57e43a7e-bde2-4d30-bf6d-7c6cc5f5d3e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935029012", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap27187d46-bd", "ovs_interfaceid": "27187d46-bd01-4781-99fe-29d49015360e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:58:18.199498 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1a0265a6-0b18-4de6-b9e9-e5f17fc7204b req-bc80f879-02af-4a12-8b2e-f01197d97d69 service nova] Releasing lock "refresh_cache-57d353b6-133e-4354-a4f4-7bcec543d586" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:58:18.200680 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquired lock "refresh_cache-57d353b6-133e-4354-a4f4-7bcec543d586" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:58:18.200902 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 09:58:18.452142 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Releasing lock "refresh_cache-7514b113-ec17-468b-a647-de099d90e787" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:58:18.452857 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Instance network_info: |[{"id": "6a88c703-7b82-44ce-b5f5-a98718ae6833", "address": "fa:16:3e:0c:a9:71", "network": {"id": "0ef5507c-157f-4da7-9926-b55fdc2488a9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-360404380-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a88c703-7b", "ovs_interfaceid": "6a88c703-7b82-44ce-b5f5-a98718ae6833", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e1903f1-9c64-411e-be18-e5775f055e13", "address": "fa:16:3e:e8:48:00", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e1903f1-9c", "ovs_interfaceid": "4e1903f1-9c64-411e-be18-e5775f055e13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3", "address": "fa:16:3e:55:f2:21", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4490fa5a-9c", "ovs_interfaceid": "4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "edca6f4e-7f57-4351-8525-4446771d6376", "address": "fa:16:3e:31:6d:c0", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapedca6f4e-7f", "ovs_interfaceid": "edca6f4e-7f57-4351-8525-4446771d6376", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3b48415-3d34-4753-a72f-6f48536174ed", "address": "fa:16:3e:48:5c:c5", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b48415-3d", "ovs_interfaceid": "d3b48415-3d34-4753-a72f-6f48536174ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e08f0477-e673-4559-884f-1dcbc2a9fd0e", "address": "fa:16:3e:07:9b:94", "network": {"id": "57e43a7e-bde2-4d30-bf6d-7c6cc5f5d3e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935029012", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape08f0477-e6", "ovs_interfaceid": "e08f0477-e673-4559-884f-1dcbc2a9fd0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27187d46-bd01-4781-99fe-29d49015360e", "address": "fa:16:3e:38:ca:1f", "network": {"id": "57e43a7e-bde2-4d30-bf6d-7c6cc5f5d3e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935029012", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap27187d46-bd", "ovs_interfaceid": "27187d46-bd01-4781-99fe-29d49015360e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 09:58:18.454151 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Start _get_guest_xml network_info=[{"id": "6a88c703-7b82-44ce-b5f5-a98718ae6833", "address": "fa:16:3e:0c:a9:71", "network": {"id": "0ef5507c-157f-4da7-9926-b55fdc2488a9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-360404380-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a88c703-7b", "ovs_interfaceid": "6a88c703-7b82-44ce-b5f5-a98718ae6833", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e1903f1-9c64-411e-be18-e5775f055e13", "address": "fa:16:3e:e8:48:00", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e1903f1-9c", "ovs_interfaceid": "4e1903f1-9c64-411e-be18-e5775f055e13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3", "address": "fa:16:3e:55:f2:21", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4490fa5a-9c", "ovs_interfaceid": "4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "edca6f4e-7f57-4351-8525-4446771d6376", "address": "fa:16:3e:31:6d:c0", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapedca6f4e-7f", "ovs_interfaceid": "edca6f4e-7f57-4351-8525-4446771d6376", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3b48415-3d34-4753-a72f-6f48536174ed", "address": "fa:16:3e:48:5c:c5", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b48415-3d", "ovs_interfaceid": "d3b48415-3d34-4753-a72f-6f48536174ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e08f0477-e673-4559-884f-1dcbc2a9fd0e", "address": "fa:16:3e:07:9b:94", "network": {"id": "57e43a7e-bde2-4d30-bf6d-7c6cc5f5d3e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935029012", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape08f0477-e6", "ovs_interfaceid": "e08f0477-e673-4559-884f-1dcbc2a9fd0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27187d46-bd01-4781-99fe-29d49015360e", "address": "fa:16:3e:38:ca:1f", "network": {"id": "57e43a7e-bde2-4d30-bf6d-7c6cc5f5d3e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935029012", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap27187d46-bd", "ovs_interfaceid": "27187d46-bd01-4781-99fe-29d49015360e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0', 'iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '78480fee-64ba-4d69-b21d-c54483406ae0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '7514b113-ec17-468b-a647-de099d90e787', 'attached_at': '', 'detached_at': '', 'volume_id': '78480fee-64ba-4d69-b21d-c54483406ae0', 'serial': '78480fee-64ba-4d69-b21d-c54483406ae0'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'fda86385-46f7-44cd-a800-909683ec0775', 'guest_format': None, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5', 'iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '837d0fb8-c967-40a4-9f26-6c610571e2a5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '7514b113-ec17-468b-a647-de099d90e787', 'attached_at': '', 'detached_at': '', 'volume_id': '837d0fb8-c967-40a4-9f26-6c610571e2a5', 'serial': '837d0fb8-c967-40a4-9f26-6c610571e2a5'}, 'boot_index': 1, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': 'e0e62bc1-b56e-4055-97d3-0d0197345bec', 'guest_format': None, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480', 'iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7492b29-87c5-41d8-a3c7-669eb8c75480', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '7514b113-ec17-468b-a647-de099d90e787', 'attached_at': '', 'detached_at': '', 'volume_id': 'a7492b29-87c5-41d8-a3c7-669eb8c75480', 'serial': 'a7492b29-87c5-41d8-a3c7-669eb8c75480'}, 'boot_index': 2, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'attachment_id': '506032be-ccfa-4d85-9f42-e8dbfd76567d', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 09:58:18.454552 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e7f3e878-68a8-4330-8993-035e35e604ab req-50232b72-bb13-4c11-bc40-1a0ef708d2f5 service nova] Acquired lock "refresh_cache-7514b113-ec17-468b-a647-de099d90e787" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:58:18.454746 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-e7f3e878-68a8-4330-8993-035e35e604ab req-50232b72-bb13-4c11-bc40-1a0ef708d2f5 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Refreshing network info cache for port 27187d46-bd01-4781-99fe-29d49015360e {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 09:58:18.457844 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 09:58:18.459601 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-97653989', uuid='7514b113-ec17-468b-a647-de099d90e787'), owner=OwnerMeta(userid='bf15add17bc44e64af4c05b1dbf40dd2', username='tempest-TaggedBootDevicesTest_v242-845922542-project-member', projectid='2ab3ecfe4d75434cbf3cb49d37042d15', projectname='tempest-TaggedBootDevicesTest_v242-845922542'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6a88c703-7b82-44ce-b5f5-a98718ae6833", "address": "fa:16:3e:0c:a9:71", "network": {"id": "0ef5507c-157f-4da7-9926-b55fdc2488a9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-360404380-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a88c703-7b", "ovs_interfaceid": "6a88c703-7b82-44ce-b5f5-a98718ae6833", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e1903f1-9c64-411e-be18-e5775f055e13", "address": "fa:16:3e:e8:48:00", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e1903f1-9c", "ovs_interfaceid": "4e1903f1-9c64-411e-be18-e5775f055e13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3", "address": "fa:16:3e:55:f2:21", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4490fa5a-9c", "ovs_interfaceid": "4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "edca6f4e-7f57-4351-8525-4446771d6376", "address": "fa:16:3e:31:6d:c0", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapedca6f4e-7f", "ovs_interfaceid": "edca6f4e-7f57-4351-8525-4446771d6376", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3b48415-3d34-4753-a72f-6f48536174ed", "address": "fa:16:3e:48:5c:c5", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b48415-3d", "ovs_interfaceid": "d3b48415-3d34-4753-a72f-6f48536174ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e08f0477-e673-4559-884f-1dcbc2a9fd0e", "address": "fa:16:3e:07:9b:94", "network": {"id": "57e43a7e-bde2-4d30-bf6d-7c6cc5f5d3e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935029012", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape08f0477-e6", "ovs_interfaceid": "e08f0477-e673-4559-884f-1dcbc2a9fd0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27187d46-bd01-4781-99fe-29d49015360e", "address": "fa:16:3e:38:ca:1f", "network": {"id": "57e43a7e-bde2-4d30-bf6d-7c6cc5f5d3e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935029012", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap27187d46-bd", "ovs_interfaceid": "27187d46-bd01-4781-99fe-29d49015360e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962298.458929) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 09:58:18.463985 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 09:58:18.464407 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 09:58:18.466577 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 09:58:18.466960 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 09:58:18.468792 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 09:58:18.469235 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 09:58:18.469477 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 09:58:18.469630 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 09:58:18.469872 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 09:58:18.470001 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 09:58:18.470330 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 09:58:18.470571 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 09:58:18.471096 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 09:58:18.471611 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 09:58:18.471794 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 09:58:18.471984 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 09:58:18.481919 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:18.482095 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:18.483769 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connector [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Factory for ISCSI on None {{(pid=98321) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}}
May 28 09:58:18.483984 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:18.484105 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 09:58:18.484425 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0', 'iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '78480fee-64ba-4d69-b21d-c54483406ae0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 09:58:18.484644 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:58:18.485110 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:58:18.485454 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0', 'iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '78480fee-64ba-4d69-b21d-c54483406ae0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 09:58:18.497310 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:58:18.497945 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:58:18.498198 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 09:58:18.498547 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:58:18.500321 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:58:18.500321 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 09:58:18.508957 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 09:58:18.508957 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:18.515050 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 09:58:18.515050 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:18.522567 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0] added
May 28 09:58:18.522567 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 09:58:18.522567 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:58:18.522567 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:58:18.522567 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:58:18.522567 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:58:18.522567 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:18.522938 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 09:58:18.522997 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0248(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 09:58:18.523146 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 09:58:18.528554 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0] added
May 28 09:58:18.528554 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 09:58:18.528554 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:58:18.528554 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:58:18.528554 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:58:18.528554 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:58:18.528554 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:18.528821 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 09:58:18.529047 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0296(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 09:58:18.529260 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 09:58:18.775829 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 09:58:18.955145 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:18.959315 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-e7f3e878-68a8-4330-8993-035e35e604ab req-50232b72-bb13-4c11-bc40-1a0ef708d2f5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:19.144925 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:19.166804 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Updating instance_info_cache with network_info: [{"id": "9d6ec393-b62a-4342-a355-3cf8291ec2fe", "address": "fa:16:3e:7a:26:b6", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d6ec393-b6", "ovs_interfaceid": "9d6ec393-b62a-4342-a355-3cf8291ec2fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:58:19.391722 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-e7f3e878-68a8-4330-8993-035e35e604ab req-50232b72-bb13-4c11-bc40-1a0ef708d2f5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:19.523666 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 09:58:19.529637 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.startup = manual
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.port = 0
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 09:58:19.539889 np0000001613 nova-compute[98321]: # END RECORD
May 28 09:58:19.539889 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.startup = manual
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.port = 0
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 09:58:19.543408 np0000001613 nova-compute[98321]: # END RECORD
May 28 09:58:19.543408 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:19.546748 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-e7f3e878-68a8-4330-8993-035e35e604ab req-50232b72-bb13-4c11-bc40-1a0ef708d2f5 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Updated VIF entry in instance network info cache for port 27187d46-bd01-4781-99fe-29d49015360e. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 09:58:19.546748 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-e7f3e878-68a8-4330-8993-035e35e604ab req-50232b72-bb13-4c11-bc40-1a0ef708d2f5 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Updating instance_info_cache with network_info: [{"id": "6a88c703-7b82-44ce-b5f5-a98718ae6833", "address": "fa:16:3e:0c:a9:71", "network": {"id": "0ef5507c-157f-4da7-9926-b55fdc2488a9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-360404380-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a88c703-7b", "ovs_interfaceid": "6a88c703-7b82-44ce-b5f5-a98718ae6833", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e1903f1-9c64-411e-be18-e5775f055e13", "address": "fa:16:3e:e8:48:00", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e1903f1-9c", "ovs_interfaceid": "4e1903f1-9c64-411e-be18-e5775f055e13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3", "address": "fa:16:3e:55:f2:21", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4490fa5a-9c", "ovs_interfaceid": "4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "edca6f4e-7f57-4351-8525-4446771d6376", "address": "fa:16:3e:31:6d:c0", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapedca6f4e-7f", "ovs_interfaceid": "edca6f4e-7f57-4351-8525-4446771d6376", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3b48415-3d34-4753-a72f-6f48536174ed", "address": "fa:16:3e:48:5c:c5", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b48415-3d", "ovs_interfaceid": "d3b48415-3d34-4753-a72f-6f48536174ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e08f0477-e673-4559-884f-1dcbc2a9fd0e", "address": "fa:16:3e:07:9b:94", "network": {"id": "57e43a7e-bde2-4d30-bf6d-7c6cc5f5d3e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935029012", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape08f0477-e6", "ovs_interfaceid": "e08f0477-e673-4559-884f-1dcbc2a9fd0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27187d46-bd01-4781-99fe-29d49015360e", "address": "fa:16:3e:38:ca:1f", "network": {"id": "57e43a7e-bde2-4d30-bf6d-7c6cc5f5d3e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935029012", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap27187d46-bd", "ovs_interfaceid": "27187d46-bd01-4781-99fe-29d49015360e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:58:19.556344 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:19.565093 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:19.573306 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 09:58:19.573306 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:58:19.573306 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 09:58:19.573306 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:58:19.573306 np0000001613 nova-compute[98321]: WARNING os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 09:58:19.573306 np0000001613 nova-compute[98321]: 
May 28 09:58:19.578142 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 09:58:19.578142 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:58:19.578343 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 09:58:19.578343 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:58:19.578492 np0000001613 nova-compute[98321]: WARNING os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 09:58:19.578492 np0000001613 nova-compute[98321]: 
May 28 09:58:19.672827 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Releasing lock "refresh_cache-57d353b6-133e-4354-a4f4-7bcec543d586" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:58:19.673113 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Instance network_info: |[{"id": "9d6ec393-b62a-4342-a355-3cf8291ec2fe", "address": "fa:16:3e:7a:26:b6", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d6ec393-b6", "ovs_interfaceid": "9d6ec393-b62a-4342-a355-3cf8291ec2fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 09:58:20.049617 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e7f3e878-68a8-4330-8993-035e35e604ab req-50232b72-bb13-4c11-bc40-1a0ef708d2f5 service nova] Releasing lock "refresh_cache-7514b113-ec17-468b-a647-de099d90e787" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:58:20.548867 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 09:58:20.561545 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 09:58:20.587319 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:20.607389 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0, portal: 192.168.50.100,3260]
May 28 09:58:20.607389 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0, portal: 192.168.50.100,3260] successful.
May 28 09:58:20.607389 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:20.608355 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0, portal: 192.168.40.100,3260]
May 28 09:58:20.608355 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0, portal: 192.168.40.100,3260] successful.
May 28 09:58:20.608355 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:20.619715 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 09:58:20.620343 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 09:58:20.620982 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:20.627554 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:20.639371 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 09:58:20.641191 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe95:8bd3', 'fe80::fc16:3eff:fe2d:94a4', 'fe80::fc16:3eff:fe31:5106', 'fe80::fc96:34ff:fe12:e4df', 'fe80::2844:59ff:feec:5d21', 'fe80::44e2:31ff:fe81:8771', 'fe80::fc16:3eff:fe9a:42b3', 'fe80::b04e:afff:fe71:41fc', 'fe80::fc16:3eff:fefb:160', 'fe80::5c68:7cff:fe27:e759', 'fe80::fc16:3eff:fe2a:719a', 'fe80::9038:13ff:fe5b:5aad', 'fe80::fc16:3eff:fe9c:2e17', 'fe80::8064:4aff:fe56:ba53', 'fe80::fc16:3eff:fe14:ef87'] 
May 28 09:58:20.641340 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 09:58:20.641492 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 09:58:20.641793 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] <== get_connector_properties: return (93ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 09:58:20.642072 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Updating existing volume attachment record: 3edd9888-7ee7-4a33-aeed-ec2d31e46943 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 09:58:20.646987 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:20.646987 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:20.646987 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:58:20.647225 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:20.647225 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:20.647225 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:58:20.647757 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.149s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:58:20.649188 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 09:58:20.649188 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:20.649188 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:20.649188 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:58:20.649188 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:20.649188 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:20.649188 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:58:20.649188 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.151s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:58:20.649531 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 09:58:20.650815 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] HCTL ('8', '-', '-', 0) found on session 4 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 09:58:20.651062 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 09:58:20.651911 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] HCTL ('7', '-', '-', 0) found on session 3 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 09:58:20.652281 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 09:58:20.676797 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Searching for a device in session 4 and hctl ['8', '*', '*', 0] yield: sdb {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 09:58:20.677963 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '78480fee-64ba-4d69-b21d-c54483406ae0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 09:58:20.698604 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Searching for a device in session 3 and hctl ['7', '*', '*', 0] yield: sdc {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 09:58:20.698604 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '78480fee-64ba-4d69-b21d-c54483406ae0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 09:58:21.500946 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 09:58:22.388415 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:22.519556 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Found WWN 33000000084905064 for multipath device dm-0 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 09:58:22.520047 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.035s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:58:22.520047 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] <== connect_volume: return (4035ms) {'type': 'block', 'scsi_wwn': '33000000084905064', 'path': '/dev/dm-0', 'multipath_id': '33000000084905064'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 09:58:22.520144 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000084905064', 'path': '/dev/dm-0', 'multipath_id': '33000000084905064'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 09:58:22.795686 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 09:58:22.795686 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 09:58:22.795686 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Creating image(s)
May 28 09:58:22.795686 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Did not create local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 09:58:22.795686 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Ensure instance console log exists: /opt/stack/data/nova/instances/57d353b6-133e-4354-a4f4-7bcec543d586/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 09:58:22.795686 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:22.795686 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:22.796225 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:22.796355 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Start _get_guest_xml network_info=[{"id": "9d6ec393-b62a-4342-a355-3cf8291ec2fe", "address": "fa:16:3e:7a:26:b6", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d6ec393-b6", "ovs_interfaceid": "9d6ec393-b62a-4342-a355-3cf8291ec2fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd1dfc5cc-6703-445f-9daa-05afb78f89f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '57d353b6-133e-4354-a4f4-7bcec543d586', 'attached_at': '', 'detached_at': '', 'volume_id': 'd1dfc5cc-6703-445f-9daa-05afb78f89f0', 'serial': 'd1dfc5cc-6703-445f-9daa-05afb78f89f0'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '3edd9888-7ee7-4a33-aeed-ec2d31e46943', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 09:58:22.798157 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 09:58:22.799259 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-665492048', uuid='57d353b6-133e-4354-a4f4-7bcec543d586'), owner=OwnerMeta(userid='51981c995f2246588f2d58f35be5848a', username='tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member', projectid='a9d04b105229456d9ab53df1886fdb37', projectname='tempest-ServerBootFromVolumeStableRescueTest-283762505'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9d6ec393-b62a-4342-a355-3cf8291ec2fe", "address": "fa:16:3e:7a:26:b6", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d6ec393-b6", "ovs_interfaceid": "9d6ec393-b62a-4342-a355-3cf8291ec2fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962302.79894) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 09:58:22.800239 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 09:58:22.800583 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 09:58:22.801212 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 09:58:22.801381 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 09:58:22.802281 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 09:58:22.802591 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 09:58:22.802733 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 09:58:22.802824 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 09:58:22.802930 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 09:58:22.803025 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 09:58:22.803114 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 09:58:22.803267 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 09:58:22.803460 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 09:58:22.803460 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 09:58:22.803546 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 09:58:22.803667 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 09:58:22.816201 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 09:58:22.816201 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd1dfc5cc-6703-445f-9daa-05afb78f89f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 09:58:22.816201 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:58:22.816201 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:58:22.816201 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd1dfc5cc-6703-445f-9daa-05afb78f89f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 09:58:22.830073 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:58:22.830477 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:58:22.831023 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:58:22.831242 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 09:58:22.831575 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:58:22.831964 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 09:58:22.844492 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 09:58:22.844492 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:22.845054 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 09:58:22.845054 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:22.857887 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0] added
May 28 09:58:22.857887 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 09:58:22.857887 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:58:22.857887 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:58:22.857887 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:58:22.857887 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:58:22.857887 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:22.858263 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 09:58:22.858426 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0266(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 09:58:22.858719 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 09:58:22.860283 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0] added
May 28 09:58:22.860283 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 09:58:22.860283 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:58:22.860283 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:58:22.860283 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:58:22.860283 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:58:22.860283 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:22.860579 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 09:58:22.860579 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0293(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 09:58:22.860768 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 09:58:23.025697 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 09:58:23.026010 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5', 'iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '837d0fb8-c967-40a4-9f26-6c610571e2a5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 09:58:23.026147 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:58:23.859133 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 09:58:23.861121 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.startup = manual
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.port = 0
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 09:58:23.871806 np0000001613 nova-compute[98321]: # END RECORD
May 28 09:58:23.871806 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.startup = manual
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.port = 0
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 09:58:23.878775 np0000001613 nova-compute[98321]: # END RECORD
May 28 09:58:23.878775 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:23.887511 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:23.893207 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:23.901337 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:23.901337 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:23.901337 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:58:23.901991 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:23.901991 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:23.901991 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:58:23.907810 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:23.907810 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:23.907810 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:58:23.907971 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:23.907971 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:23.907971 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:58:23.934917 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0, portal: 192.168.50.100,3260]
May 28 09:58:23.934917 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0, portal: 192.168.50.100,3260] successful.
May 28 09:58:23.934917 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:23.947459 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:23.953788 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0, portal: 192.168.40.100,3260]
May 28 09:58:23.953788 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0, portal: 192.168.40.100,3260] successful.
May 28 09:58:23.953788 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:23.964072 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:23.965636 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:23.965636 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:23.965636 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:23.965636 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:23.965636 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:58:23.965791 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:23.965791 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:23.965791 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:23.965791 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:23.965791 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:58:23.966064 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.135s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:58:23.966600 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 09:58:23.967399 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] HCTL ('9', '-', '-', 0) found on session 5 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 09:58:23.967765 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 09:58:23.983091 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:23.983091 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:23.983091 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:23.983091 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:23.983091 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:58:23.983091 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:23.983091 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:23.983091 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:23.983091 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:23.983091 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:58:23.983360 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.152s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:58:23.983360 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 09:58:23.985781 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Searching for a device in session 5 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 09:58:23.985998 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd1dfc5cc-6703-445f-9daa-05afb78f89f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 09:58:23.986708 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] HCTL ('10', '-', '-', 0) found on session 6 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 09:58:23.986846 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 09:58:24.004489 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Searching for a device in session 6 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 09:58:24.004994 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd1dfc5cc-6703-445f-9daa-05afb78f89f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 09:58:24.153422 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:24.831947 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 09:58:25.848359 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Found WWN 330000000605f379a for multipath device dm-3 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 09:58:25.848904 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:58:25.848904 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '330000000605f379a', 'path': '/dev/dm-3', 'multipath_id': '330000000605f379a'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 09:58:25.848904 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000605f379a', 'path': '/dev/dm-3', 'multipath_id': '330000000605f379a'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 09:58:25.849460 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.823s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:58:25.854676 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5', 'iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '837d0fb8-c967-40a4-9f26-6c610571e2a5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 09:58:25.869021 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:58:25.870104 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:58:25.870306 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:58:25.870469 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 09:58:25.870957 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:58:25.871276 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 09:58:25.884321 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 09:58:25.884321 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:25.890251 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 09:58:25.890251 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:25.901363 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5] added
May 28 09:58:25.901363 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 09:58:25.901363 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:58:25.901363 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:58:25.901363 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:58:25.901363 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:58:25.901363 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:25.901617 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 09:58:25.901617 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0311(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 09:58:25.901808 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 09:58:25.903134 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5] added
May 28 09:58:25.903134 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 09:58:25.903134 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:58:25.903134 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:58:25.903134 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:58:25.903134 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:58:25.903134 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:25.903381 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 09:58:25.903647 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0324(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 09:58:25.903877 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 09:58:26.356414 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T09:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-665492048',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serverbootfromvolumestablerescuetest-server-665492048',id=10,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9d04b105229456d9ab53df1886fdb37',ramdisk_id='',reservation_id='r-7cgj5of9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-283762505',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:58:16Z,user_data=None,user_id='51981c995f2246588f2d58f35be5848a',uuid=57d353b6-133e-4354-a4f4-7bcec543d586,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d6ec393-b62a-4342-a355-3cf8291ec2fe", "address": "fa:16:3e:7a:26:b6", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d6ec393-b6", "ovs_interfaceid": "9d6ec393-b62a-4342-a355-3cf8291ec2fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 09:58:26.356630 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Converting VIF {"id": "9d6ec393-b62a-4342-a355-3cf8291ec2fe", "address": "fa:16:3e:7a:26:b6", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d6ec393-b6", "ovs_interfaceid": "9d6ec393-b62a-4342-a355-3cf8291ec2fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:58:26.357386 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:26:b6,bridge_name='br-int',has_traffic_filtering=True,id=9d6ec393-b62a-4342-a355-3cf8291ec2fe,network=Network(e5543f88-c716-4e02-82e9-2cb7570bf25e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d6ec393-b6') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:58:26.358116 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lazy-loading 'pci_devices' on Instance uuid 57d353b6-133e-4354-a4f4-7bcec543d586 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:58:26.861475 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] End _get_guest_xml xml=<domain type="qemu">
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:   <uuid>57d353b6-133e-4354-a4f4-7bcec543d586</uuid>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:   <name>instance-0000000a</name>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:   <metadata>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-665492048</nova:name>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 09:58:22</nova:creationTime>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:       </nova:image>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:         <nova:user uuid="51981c995f2246588f2d58f35be5848a">tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member</nova:user>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:         <nova:project uuid="a9d04b105229456d9ab53df1886fdb37">tempest-ServerBootFromVolumeStableRescueTest-283762505</nova:project>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:         <nova:port uuid="9d6ec393-b62a-4342-a355-3cf8291ec2fe">
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:         </nova:port>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:   </metadata>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:     <system>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:       <entry name="serial">57d353b6-133e-4354-a4f4-7bcec543d586</entry>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:       <entry name="uuid">57d353b6-133e-4354-a4f4-7bcec543d586</entry>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:     </system>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:   <os>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:   </os>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:   <features>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:     <acpi/>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:     <tcg>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:     </tcg>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:   </features>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:   <devices>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/57d353b6-133e-4354-a4f4-7bcec543d586/disk.config"/>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:     </disk>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:       <alias name="ua-d1dfc5cc-6703-445f-9daa-05afb78f89f0"/>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-3"/>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:       <serial>d1dfc5cc-6703-445f-9daa-05afb78f89f0</serial>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:     </disk>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:7a:26:b6"/>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:       <target dev="tap9d6ec393-b6"/>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:     </interface>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/57d353b6-133e-4354-a4f4-7bcec543d586/console.log" append="off"/>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:     </serial>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:     <video>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:     </video>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:     </rng>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:     </memballoon>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:   </devices>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]: </domain>
May 28 09:58:26.861475 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 09:58:26.864213 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Preparing to wait for external event network-vif-plugged-9d6ec393-b62a-4342-a355-3cf8291ec2fe {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 09:58:26.864213 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:26.864213 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:26.864213 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:26.864213 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T09:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-665492048',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serverbootfromvolumestablerescuetest-server-665492048',id=10,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9d04b105229456d9ab53df1886fdb37',ramdisk_id='',reservation_id='r-7cgj5of9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-283762505',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:58:16Z,user_data=None,user_id='51981c995f2246588f2d58f35be5848a',uuid=57d353b6-133e-4354-a4f4-7bcec543d586,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d6ec393-b62a-4342-a355-3cf8291ec2fe", "address": "fa:16:3e:7a:26:b6", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d6ec393-b6", "ovs_interfaceid": "9d6ec393-b62a-4342-a355-3cf8291ec2fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 09:58:26.864213 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Converting VIF {"id": "9d6ec393-b62a-4342-a355-3cf8291ec2fe", "address": "fa:16:3e:7a:26:b6", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d6ec393-b6", "ovs_interfaceid": "9d6ec393-b62a-4342-a355-3cf8291ec2fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:58:26.864213 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:26:b6,bridge_name='br-int',has_traffic_filtering=True,id=9d6ec393-b62a-4342-a355-3cf8291ec2fe,network=Network(e5543f88-c716-4e02-82e9-2cb7570bf25e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d6ec393-b6') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:58:26.864213 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:26:b6,bridge_name='br-int',has_traffic_filtering=True,id=9d6ec393-b62a-4342-a355-3cf8291ec2fe,network=Network(e5543f88-c716-4e02-82e9-2cb7570bf25e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d6ec393-b6') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 09:58:26.864607 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:26.864607 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:26.866005 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 09:58:26.866005 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:26.866261 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b112dc87-ea8b-5229-916b-9da4bd20e3a0', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:26.867114 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:26.867765 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:58:26.868367 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:26.870537 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:26.870755 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d6ec393-b6, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:26.871066 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9d6ec393-b6, col_values=(('qos', UUID('601a1555-ee15-4c9e-a0af-8250ead7feb4')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:26.871280 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9d6ec393-b6, col_values=(('external_ids', {'iface-id': '9d6ec393-b62a-4342-a355-3cf8291ec2fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:26:b6', 'vm-uuid': '57d353b6-133e-4354-a4f4-7bcec543d586'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:26.872467 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:26.874232 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:58:26.881802 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:26.882983 np0000001613 nova-compute[98321]: INFO os_vif [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:26:b6,bridge_name='br-int',has_traffic_filtering=True,id=9d6ec393-b62a-4342-a355-3cf8291ec2fe,network=Network(e5543f88-c716-4e02-82e9-2cb7570bf25e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d6ec393-b6')
May 28 09:58:26.902252 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 09:58:26.904726 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.startup = manual
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.port = 0
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 09:58:26.917285 np0000001613 nova-compute[98321]: # END RECORD
May 28 09:58:26.917285 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.startup = manual
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.port = 0
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 09:58:26.922574 np0000001613 nova-compute[98321]: # END RECORD
May 28 09:58:26.922574 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:26.936364 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:26.945241 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:26.957620 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:26.957620 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:26.957620 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:26.957620 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:26.957620 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:58:26.957898 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:26.957898 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:26.957898 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:26.957898 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:26.957898 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:58:26.962877 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:26.962877 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:26.962877 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:26.962877 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:26.962877 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:58:26.963354 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:26.963354 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:26.963354 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:26.963354 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:26.963354 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:58:26.998887 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5, portal: 192.168.40.100,3260]
May 28 09:58:26.998887 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5, portal: 192.168.40.100,3260] successful.
May 28 09:58:26.998887 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:27.010459 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5, portal: 192.168.50.100,3260]
May 28 09:58:27.010459 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5, portal: 192.168.50.100,3260] successful.
May 28 09:58:27.010459 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:27.011406 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:27.025406 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:27.031746 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:27.031746 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:27.031746 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:27.031746 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:27.031746 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:27.031746 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:27.031746 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:58:27.032433 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:27.032433 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:27.032433 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:27.032433 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:27.032433 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:27.032433 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:27.032433 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:58:27.032618 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:58:27.032618 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 09:58:27.033452 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] HCTL ('11', '-', '-', 0) found on session 7 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 09:58:27.033619 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 09:58:27.042696 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:27.042696 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:27.042696 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:27.042696 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:27.042696 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:27.042696 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:27.042696 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:58:27.043030 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:27.043030 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:27.043030 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:27.043030 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:27.043030 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:27.043030 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:27.043030 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:58:27.043237 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.172s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:58:27.043531 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 09:58:27.044285 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] HCTL ('12', '-', '-', 0) found on session 8 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 09:58:27.044373 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 09:58:27.055600 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Searching for a device in session 7 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 09:58:27.055765 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '837d0fb8-c967-40a4-9f26-6c610571e2a5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 09:58:27.063606 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Searching for a device in session 8 and hctl ['12', '*', '*', 0] yield: None {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 09:58:28.063026 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Searching for a device in session 8 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 09:58:28.063565 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '837d0fb8-c967-40a4-9f26-6c610571e2a5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 09:58:28.397215 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:58:28.397418 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:58:28.397556 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] No VIF found with MAC fa:16:3e:7a:26:b6, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 09:58:28.398131 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Using config drive
May 28 09:58:28.887196 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Found WWN 33000000086c23192 for multipath device dm-4 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 09:58:28.887498 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:58:28.887686 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] <== connect_volume: return (5861ms) {'type': 'block', 'scsi_wwn': '33000000086c23192', 'path': '/dev/dm-4', 'multipath_id': '33000000086c23192'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 09:58:28.887950 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000086c23192', 'path': '/dev/dm-4', 'multipath_id': '33000000086c23192'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 09:58:28.904139 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:29.073495 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Creating config drive at /opt/stack/data/nova/instances/57d353b6-133e-4354-a4f4-7bcec543d586/disk.config
May 28 09:58:29.076642 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/57d353b6-133e-4354-a4f4-7bcec543d586/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpo4tscs8s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:29.120340 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/57d353b6-133e-4354-a4f4-7bcec543d586/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpo4tscs8s" returned: 0 in 0.043s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:29.156932 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:29.394994 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 09:58:29.394994 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480', 'iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7492b29-87c5-41d8-a3c7-669eb8c75480', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 09:58:29.394994 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:58:29.394994 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:58:29.394994 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480', 'iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7492b29-87c5-41d8-a3c7-669eb8c75480', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 09:58:29.410494 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:58:29.411229 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:58:29.411807 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:58:29.412110 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 09:58:29.412637 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:58:29.412962 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 09:58:29.427567 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 09:58:29.427567 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:29.432047 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 09:58:29.432047 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:29.441903 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480] added
May 28 09:58:29.441903 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 09:58:29.441903 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:58:29.441903 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:58:29.441903 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:58:29.441903 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:58:29.441903 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:29.441903 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 09:58:29.442217 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.029(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 09:58:29.442254 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 09:58:29.446539 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480] added
May 28 09:58:29.446539 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 09:58:29.446539 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:58:29.446539 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:58:29.446539 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:58:29.446539 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:58:29.446539 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:29.446868 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 09:58:29.447017 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0349(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 09:58:29.447340 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 09:58:29.601093 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:29.625558 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:29.630407 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:29.753535 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:29.823815 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:29.844773 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8642bf26-e4d7-4eb7-b1f6-7f7cb13b23cf req-ac05f5aa-f8d8-4f04-bd77-73e28cc599ae service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Received event network-vif-plugged-9d6ec393-b62a-4342-a355-3cf8291ec2fe {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:29.847828 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8642bf26-e4d7-4eb7-b1f6-7f7cb13b23cf req-ac05f5aa-f8d8-4f04-bd77-73e28cc599ae service nova] Acquiring lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:29.847828 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8642bf26-e4d7-4eb7-b1f6-7f7cb13b23cf req-ac05f5aa-f8d8-4f04-bd77-73e28cc599ae service nova] Lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:29.847828 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8642bf26-e4d7-4eb7-b1f6-7f7cb13b23cf req-ac05f5aa-f8d8-4f04-bd77-73e28cc599ae service nova] Lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:29.847828 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8642bf26-e4d7-4eb7-b1f6-7f7cb13b23cf req-ac05f5aa-f8d8-4f04-bd77-73e28cc599ae service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Processing event network-vif-plugged-9d6ec393-b62a-4342-a355-3cf8291ec2fe {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 09:58:30.442795 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 09:58:30.448765 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.startup = manual
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.port = 0
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 09:58:30.456995 np0000001613 nova-compute[98321]: # END RECORD
May 28 09:58:30.456995 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.startup = manual
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.port = 0
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 09:58:30.466765 np0000001613 nova-compute[98321]: # END RECORD
May 28 09:58:30.466765 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:30.474556 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:30.485219 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:30.492722 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 09:58:30.494507 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962310.4929235, 57d353b6-133e-4354-a4f4-7bcec543d586 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:58:30.496310 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:30.496310 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:30.496310 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:30.496310 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:30.496310 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:30.496310 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:30.496310 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:58:30.496594 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] VM Started (Lifecycle Event)
May 28 09:58:30.500780 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:30.500780 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:30.500780 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:30.500780 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:30.500780 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:30.500780 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:30.500780 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:58:30.503829 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 09:58:30.503829 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:30.503829 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:30.503829 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:30.503829 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:30.503829 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:30.503829 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:30.503829 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:58:30.503829 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:30.503829 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:30.503829 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:30.503829 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:30.503829 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:30.503829 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:30.503829 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:58:30.511502 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Instance spawned successfully.
May 28 09:58:30.512025 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 09:58:30.551340 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480, portal: 192.168.40.100,3260]
May 28 09:58:30.551340 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480, portal: 192.168.40.100,3260] successful.
May 28 09:58:30.551340 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:30.562564 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:30.567594 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480, portal: 192.168.50.100,3260]
May 28 09:58:30.567594 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480, portal: 192.168.50.100,3260] successful.
May 28 09:58:30.567594 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:30.580637 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:30.583107 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:30.583107 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:30.583107 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:30.583107 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:30.583107 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:30.583107 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:30.583107 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:30.583107 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:30.583107 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:58:30.583562 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:30.583562 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:30.583562 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:30.583562 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:30.583562 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:30.583562 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:30.583562 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:30.583562 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:30.583562 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:58:30.583845 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.172s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:58:30.583845 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 09:58:30.584708 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] HCTL ('13', '-', '-', 0) found on session 9 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 09:58:30.584814 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 09:58:30.607151 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:30.607151 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:30.607151 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:30.607151 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:30.607151 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:30.607151 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:30.607151 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:30.607151 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:30.607151 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:58:30.612542 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:30.612542 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:30.612542 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:30.612542 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:30.612542 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:30.612542 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:30.612542 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:30.612542 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:30.612542 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:58:30.612542 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.197s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:58:30.612542 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 09:58:30.612542 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Searching for a device in session 9 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 09:58:30.612542 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7492b29-87c5-41d8-a3c7-669eb8c75480', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 09:58:30.614359 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] HCTL ('14', '-', '-', 0) found on session 10 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 09:58:30.614359 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 09:58:30.632408 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Searching for a device in session 10 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 09:58:30.632408 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a7492b29-87c5-41d8-a3c7-669eb8c75480', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 09:58:31.003466 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:58:31.005570 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 09:58:31.025374 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:58:31.029383 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:58:31.029383 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:58:31.029383 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:58:31.029383 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:58:31.029383 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:58:31.412427 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 09:58:31.509182 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 09:58:31.509819 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962311.5092714, 57d353b6-133e-4354-a4f4-7bcec543d586 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:58:31.509819 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] VM Paused (Lifecycle Event)
May 28 09:58:31.708619 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Took 8.91 seconds to spawn the instance on the hypervisor.
May 28 09:58:31.709206 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:58:31.873500 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:31.928315 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-fb40c192-7925-4d29-824e-0a82d34e68be req-8662cfcd-6970-4ffd-bff1-4b21fbd34459 service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Received event network-vif-plugged-9d6ec393-b62a-4342-a355-3cf8291ec2fe {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:31.930001 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-fb40c192-7925-4d29-824e-0a82d34e68be req-8662cfcd-6970-4ffd-bff1-4b21fbd34459 service nova] Acquiring lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:31.930001 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-fb40c192-7925-4d29-824e-0a82d34e68be req-8662cfcd-6970-4ffd-bff1-4b21fbd34459 service nova] Lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:31.930001 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-fb40c192-7925-4d29-824e-0a82d34e68be req-8662cfcd-6970-4ffd-bff1-4b21fbd34459 service nova] Lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:31.930001 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-fb40c192-7925-4d29-824e-0a82d34e68be req-8662cfcd-6970-4ffd-bff1-4b21fbd34459 service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] No waiting events found dispatching network-vif-plugged-9d6ec393-b62a-4342-a355-3cf8291ec2fe {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:58:31.930001 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-fb40c192-7925-4d29-824e-0a82d34e68be req-8662cfcd-6970-4ffd-bff1-4b21fbd34459 service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Received unexpected event network-vif-plugged-9d6ec393-b62a-4342-a355-3cf8291ec2fe for instance with vm_state active and task_state None.
May 28 09:58:32.015056 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:58:32.017352 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962312.0168188, 57d353b6-133e-4354-a4f4-7bcec543d586 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:58:32.017582 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] VM Resumed (Lifecycle Event)
May 28 09:58:32.218900 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Took 20.09 seconds to build instance.
May 28 09:58:32.433269 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Found WWN 33000000057a63d22 for multipath device dm-5 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 09:58:32.433269 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:58:32.433269 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '33000000057a63d22', 'path': '/dev/dm-5', 'multipath_id': '33000000057a63d22'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 09:58:32.433269 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000057a63d22', 'path': '/dev/dm-5', 'multipath_id': '33000000057a63d22'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 09:58:32.520668 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:58:32.526364 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 09:58:32.721040 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "57d353b6-133e-4354-a4f4-7bcec543d586" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.600s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:32.938914 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:57:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-97653989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-97653989',id=9,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLV2OCrcYa+6PPeqUulLq0R6pd2tI+MIMcHbBKM4XEVap2duuGQ9lDGHJUCRWzq3BO8do0Y0OErSFRcIkE3jwEjkE6O/8JgjSAtuevekOA+mpG+G1h8Qz2EmHfDgR1uBtw==',key_name='tempest-keypair-1185435215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ab3ecfe4d75434cbf3cb49d37042d15',ramdisk_id='',reservation_id='r-7czmh1vi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-845922542',owner_user_name='tempest-TaggedBootDevicesTest_v242-845922542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:58:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf15add17bc44e64af4c05b1dbf40dd2',uuid=7514b113-ec17-468b-a647-de099d90e787,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a88c703-7b82-44ce-b5f5-a98718ae6833", "address": "fa:16:3e:0c:a9:71", "network": {"id": "0ef5507c-157f-4da7-9926-b55fdc2488a9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-360404380-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a88c703-7b", "ovs_interfaceid": "6a88c703-7b82-44ce-b5f5-a98718ae6833", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 09:58:32.939312 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converting VIF {"id": "6a88c703-7b82-44ce-b5f5-a98718ae6833", "address": "fa:16:3e:0c:a9:71", "network": {"id": "0ef5507c-157f-4da7-9926-b55fdc2488a9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-360404380-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a88c703-7b", "ovs_interfaceid": "6a88c703-7b82-44ce-b5f5-a98718ae6833", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:58:32.939988 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:a9:71,bridge_name='br-int',has_traffic_filtering=True,id=6a88c703-7b82-44ce-b5f5-a98718ae6833,network=Network(0ef5507c-157f-4da7-9926-b55fdc2488a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a88c703-7b') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:58:32.942263 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:57:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-97653989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-97653989',id=9,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLV2OCrcYa+6PPeqUulLq0R6pd2tI+MIMcHbBKM4XEVap2duuGQ9lDGHJUCRWzq3BO8do0Y0OErSFRcIkE3jwEjkE6O/8JgjSAtuevekOA+mpG+G1h8Qz2EmHfDgR1uBtw==',key_name='tempest-keypair-1185435215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ab3ecfe4d75434cbf3cb49d37042d15',ramdisk_id='',reservation_id='r-7czmh1vi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-845922542',owner_user_name='tempest-TaggedBootDevicesTest_v242-845922542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:58:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf15add17bc44e64af4c05b1dbf40dd2',uuid=7514b113-ec17-468b-a647-de099d90e787,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e1903f1-9c64-411e-be18-e5775f055e13", "address": "fa:16:3e:e8:48:00", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e1903f1-9c", "ovs_interfaceid": "4e1903f1-9c64-411e-be18-e5775f055e13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 09:58:32.942479 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converting VIF {"id": "4e1903f1-9c64-411e-be18-e5775f055e13", "address": "fa:16:3e:e8:48:00", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e1903f1-9c", "ovs_interfaceid": "4e1903f1-9c64-411e-be18-e5775f055e13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:58:32.943028 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:48:00,bridge_name='br-int',has_traffic_filtering=True,id=4e1903f1-9c64-411e-be18-e5775f055e13,network=Network(c6b29800-229c-48b1-b251-70b7d65f6b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4e1903f1-9c') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:58:32.943999 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:57:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-97653989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-97653989',id=9,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLV2OCrcYa+6PPeqUulLq0R6pd2tI+MIMcHbBKM4XEVap2duuGQ9lDGHJUCRWzq3BO8do0Y0OErSFRcIkE3jwEjkE6O/8JgjSAtuevekOA+mpG+G1h8Qz2EmHfDgR1uBtw==',key_name='tempest-keypair-1185435215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ab3ecfe4d75434cbf3cb49d37042d15',ramdisk_id='',reservation_id='r-7czmh1vi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-845922542',owner_user_name='tempest-TaggedBootDevicesTest_v242-845922542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:58:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf15add17bc44e64af4c05b1dbf40dd2',uuid=7514b113-ec17-468b-a647-de099d90e787,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3", "address": "fa:16:3e:55:f2:21", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4490fa5a-9c", "ovs_interfaceid": "4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 09:58:32.944273 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converting VIF {"id": "4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3", "address": "fa:16:3e:55:f2:21", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4490fa5a-9c", "ovs_interfaceid": "4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:58:32.945841 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:f2:21,bridge_name='br-int',has_traffic_filtering=True,id=4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3,network=Network(c6b29800-229c-48b1-b251-70b7d65f6b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4490fa5a-9c') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:58:32.946780 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:57:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-97653989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-97653989',id=9,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLV2OCrcYa+6PPeqUulLq0R6pd2tI+MIMcHbBKM4XEVap2duuGQ9lDGHJUCRWzq3BO8do0Y0OErSFRcIkE3jwEjkE6O/8JgjSAtuevekOA+mpG+G1h8Qz2EmHfDgR1uBtw==',key_name='tempest-keypair-1185435215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ab3ecfe4d75434cbf3cb49d37042d15',ramdisk_id='',reservation_id='r-7czmh1vi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-845922542',owner_user_name='tempest-TaggedBootDevicesTest_v242-845922542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:58:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf15add17bc44e64af4c05b1dbf40dd2',uuid=7514b113-ec17-468b-a647-de099d90e787,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edca6f4e-7f57-4351-8525-4446771d6376", "address": "fa:16:3e:31:6d:c0", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapedca6f4e-7f", "ovs_interfaceid": "edca6f4e-7f57-4351-8525-4446771d6376", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 09:58:32.946979 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converting VIF {"id": "edca6f4e-7f57-4351-8525-4446771d6376", "address": "fa:16:3e:31:6d:c0", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapedca6f4e-7f", "ovs_interfaceid": "edca6f4e-7f57-4351-8525-4446771d6376", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:58:32.947495 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:6d:c0,bridge_name='br-int',has_traffic_filtering=True,id=edca6f4e-7f57-4351-8525-4446771d6376,network=Network(c6b29800-229c-48b1-b251-70b7d65f6b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedca6f4e-7f') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:58:32.950902 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:57:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-97653989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-97653989',id=9,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLV2OCrcYa+6PPeqUulLq0R6pd2tI+MIMcHbBKM4XEVap2duuGQ9lDGHJUCRWzq3BO8do0Y0OErSFRcIkE3jwEjkE6O/8JgjSAtuevekOA+mpG+G1h8Qz2EmHfDgR1uBtw==',key_name='tempest-keypair-1185435215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ab3ecfe4d75434cbf3cb49d37042d15',ramdisk_id='',reservation_id='r-7czmh1vi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-845922542',owner_user_name='tempest-TaggedBootDevicesTest_v242-845922542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:58:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf15add17bc44e64af4c05b1dbf40dd2',uuid=7514b113-ec17-468b-a647-de099d90e787,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3b48415-3d34-4753-a72f-6f48536174ed", "address": "fa:16:3e:48:5c:c5", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b48415-3d", "ovs_interfaceid": "d3b48415-3d34-4753-a72f-6f48536174ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 09:58:32.950902 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converting VIF {"id": "d3b48415-3d34-4753-a72f-6f48536174ed", "address": "fa:16:3e:48:5c:c5", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b48415-3d", "ovs_interfaceid": "d3b48415-3d34-4753-a72f-6f48536174ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:58:32.951665 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:5c:c5,bridge_name='br-int',has_traffic_filtering=True,id=d3b48415-3d34-4753-a72f-6f48536174ed,network=Network(c6b29800-229c-48b1-b251-70b7d65f6b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3b48415-3d') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:58:32.952375 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:57:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-97653989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-97653989',id=9,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLV2OCrcYa+6PPeqUulLq0R6pd2tI+MIMcHbBKM4XEVap2duuGQ9lDGHJUCRWzq3BO8do0Y0OErSFRcIkE3jwEjkE6O/8JgjSAtuevekOA+mpG+G1h8Qz2EmHfDgR1uBtw==',key_name='tempest-keypair-1185435215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ab3ecfe4d75434cbf3cb49d37042d15',ramdisk_id='',reservation_id='r-7czmh1vi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-845922542',owner_user_name='tempest-TaggedBootDevicesTest_v242-845922542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:58:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf15add17bc44e64af4c05b1dbf40dd2',uuid=7514b113-ec17-468b-a647-de099d90e787,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e08f0477-e673-4559-884f-1dcbc2a9fd0e", "address": "fa:16:3e:07:9b:94", "network": {"id": "57e43a7e-bde2-4d30-bf6d-7c6cc5f5d3e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935029012", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape08f0477-e6", "ovs_interfaceid": "e08f0477-e673-4559-884f-1dcbc2a9fd0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 09:58:32.952534 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converting VIF {"id": "e08f0477-e673-4559-884f-1dcbc2a9fd0e", "address": "fa:16:3e:07:9b:94", "network": {"id": "57e43a7e-bde2-4d30-bf6d-7c6cc5f5d3e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935029012", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape08f0477-e6", "ovs_interfaceid": "e08f0477-e673-4559-884f-1dcbc2a9fd0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:58:32.952895 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:9b:94,bridge_name='br-int',has_traffic_filtering=True,id=e08f0477-e673-4559-884f-1dcbc2a9fd0e,network=Network(57e43a7e-bde2-4d30-bf6d-7c6cc5f5d3e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape08f0477-e6') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:58:32.954684 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:57:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-97653989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-97653989',id=9,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLV2OCrcYa+6PPeqUulLq0R6pd2tI+MIMcHbBKM4XEVap2duuGQ9lDGHJUCRWzq3BO8do0Y0OErSFRcIkE3jwEjkE6O/8JgjSAtuevekOA+mpG+G1h8Qz2EmHfDgR1uBtw==',key_name='tempest-keypair-1185435215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ab3ecfe4d75434cbf3cb49d37042d15',ramdisk_id='',reservation_id='r-7czmh1vi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-845922542',owner_user_name='tempest-TaggedBootDevicesTest_v242-845922542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:58:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf15add17bc44e64af4c05b1dbf40dd2',uuid=7514b113-ec17-468b-a647-de099d90e787,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27187d46-bd01-4781-99fe-29d49015360e", "address": "fa:16:3e:38:ca:1f", "network": {"id": "57e43a7e-bde2-4d30-bf6d-7c6cc5f5d3e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935029012", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap27187d46-bd", "ovs_interfaceid": "27187d46-bd01-4781-99fe-29d49015360e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 09:58:32.954910 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converting VIF {"id": "27187d46-bd01-4781-99fe-29d49015360e", "address": "fa:16:3e:38:ca:1f", "network": {"id": "57e43a7e-bde2-4d30-bf6d-7c6cc5f5d3e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935029012", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap27187d46-bd", "ovs_interfaceid": "27187d46-bd01-4781-99fe-29d49015360e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:58:32.955259 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:ca:1f,bridge_name='br-int',has_traffic_filtering=True,id=27187d46-bd01-4781-99fe-29d49015360e,network=Network(57e43a7e-bde2-4d30-bf6d-7c6cc5f5d3e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27187d46-bd') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:58:32.955787 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lazy-loading 'pci_devices' on Instance uuid 7514b113-ec17-468b-a647-de099d90e787 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:58:33.460075 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] End _get_guest_xml xml=<domain type="qemu">
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:   <uuid>7514b113-ec17-468b-a647-de099d90e787</uuid>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:   <name>instance-00000009</name>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:   <metadata>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <nova:name>tempest-device-tagging-server-97653989</nova:name>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 09:58:18</nova:creationTime>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       </nova:image>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:         <nova:user uuid="bf15add17bc44e64af4c05b1dbf40dd2">tempest-TaggedBootDevicesTest_v242-845922542-project-member</nova:user>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:         <nova:project uuid="2ab3ecfe4d75434cbf3cb49d37042d15">tempest-TaggedBootDevicesTest_v242-845922542</nova:project>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:         <nova:port uuid="6a88c703-7b82-44ce-b5f5-a98718ae6833">
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:         </nova:port>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:         <nova:port uuid="4e1903f1-9c64-411e-be18-e5775f055e13">
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.1.132" ipVersion="4"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:         </nova:port>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:         <nova:port uuid="4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3">
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.1.53" ipVersion="4"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:         </nova:port>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:         <nova:port uuid="edca6f4e-7f57-4351-8525-4446771d6376">
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.1.237" ipVersion="4"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:         </nova:port>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:         <nova:port uuid="d3b48415-3d34-4753-a72f-6f48536174ed">
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.1.146" ipVersion="4"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:         </nova:port>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:         <nova:port uuid="e08f0477-e673-4559-884f-1dcbc2a9fd0e">
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:         </nova:port>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:         <nova:port uuid="27187d46-bd01-4781-99fe-29d49015360e">
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:         </nova:port>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:   </metadata>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     <system>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <entry name="serial">7514b113-ec17-468b-a647-de099d90e787</entry>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <entry name="uuid">7514b113-ec17-468b-a647-de099d90e787</entry>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     </system>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:   <os>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:   </os>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:   <features>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     <acpi/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     <tcg>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     </tcg>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:   </features>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:   <devices>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/7514b113-ec17-468b-a647-de099d90e787/disk.config"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     </disk>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <alias name="ua-78480fee-64ba-4d69-b21d-c54483406ae0"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-0"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <serial>78480fee-64ba-4d69-b21d-c54483406ae0</serial>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     </disk>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <alias name="ua-837d0fb8-c967-40a4-9f26-6c610571e2a5"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-4"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <target dev="vdb" bus="virtio"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <serial>837d0fb8-c967-40a4-9f26-6c610571e2a5</serial>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     </disk>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <alias name="ua-a7492b29-87c5-41d8-a3c7-669eb8c75480"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-5"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <target dev="vdc" bus="virtio"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <serial>a7492b29-87c5-41d8-a3c7-669eb8c75480</serial>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     </disk>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:0c:a9:71"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <target dev="tap6a88c703-7b"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     </interface>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:e8:48:00"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <target dev="tap4e1903f1-9c"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     </interface>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:55:f2:21"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <target dev="tap4490fa5a-9c"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     </interface>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:31:6d:c0"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <target dev="tapedca6f4e-7f"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     </interface>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:48:5c:c5"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <target dev="tapd3b48415-3d"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     </interface>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:07:9b:94"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <target dev="tape08f0477-e6"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     </interface>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:38:ca:1f"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <target dev="tap27187d46-bd"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     </interface>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/7514b113-ec17-468b-a647-de099d90e787/console.log" append="off"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     </serial>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     <video>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     </video>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     </rng>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:     </memballoon>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:   </devices>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]: </domain>
May 28 09:58:33.460075 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 09:58:33.468535 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Preparing to wait for external event network-vif-plugged-6a88c703-7b82-44ce-b5f5-a98718ae6833 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 09:58:33.468535 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Acquiring lock "7514b113-ec17-468b-a647-de099d90e787-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:33.468535 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "7514b113-ec17-468b-a647-de099d90e787-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:33.468535 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "7514b113-ec17-468b-a647-de099d90e787-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:33.468535 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Preparing to wait for external event network-vif-plugged-4e1903f1-9c64-411e-be18-e5775f055e13 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 09:58:33.468535 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Acquiring lock "7514b113-ec17-468b-a647-de099d90e787-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:33.468535 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "7514b113-ec17-468b-a647-de099d90e787-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:33.468535 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "7514b113-ec17-468b-a647-de099d90e787-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:33.468535 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Preparing to wait for external event network-vif-plugged-4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 09:58:33.468535 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Acquiring lock "7514b113-ec17-468b-a647-de099d90e787-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:33.468535 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "7514b113-ec17-468b-a647-de099d90e787-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:33.468535 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "7514b113-ec17-468b-a647-de099d90e787-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:33.468535 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Preparing to wait for external event network-vif-plugged-edca6f4e-7f57-4351-8525-4446771d6376 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 09:58:33.468535 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Acquiring lock "7514b113-ec17-468b-a647-de099d90e787-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:33.468535 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "7514b113-ec17-468b-a647-de099d90e787-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:33.468535 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "7514b113-ec17-468b-a647-de099d90e787-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:33.468535 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Preparing to wait for external event network-vif-plugged-d3b48415-3d34-4753-a72f-6f48536174ed {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 09:58:33.468535 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Acquiring lock "7514b113-ec17-468b-a647-de099d90e787-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:33.468535 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "7514b113-ec17-468b-a647-de099d90e787-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:33.468535 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "7514b113-ec17-468b-a647-de099d90e787-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:33.468535 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Preparing to wait for external event network-vif-plugged-e08f0477-e673-4559-884f-1dcbc2a9fd0e {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 09:58:33.468535 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Acquiring lock "7514b113-ec17-468b-a647-de099d90e787-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:33.468535 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "7514b113-ec17-468b-a647-de099d90e787-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:33.468535 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "7514b113-ec17-468b-a647-de099d90e787-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:33.468535 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Preparing to wait for external event network-vif-plugged-27187d46-bd01-4781-99fe-29d49015360e {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 09:58:33.468535 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Acquiring lock "7514b113-ec17-468b-a647-de099d90e787-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:33.468535 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "7514b113-ec17-468b-a647-de099d90e787-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:33.468535 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "7514b113-ec17-468b-a647-de099d90e787-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:33.469304 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:57:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-97653989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-97653989',id=9,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLV2OCrcYa+6PPeqUulLq0R6pd2tI+MIMcHbBKM4XEVap2duuGQ9lDGHJUCRWzq3BO8do0Y0OErSFRcIkE3jwEjkE6O/8JgjSAtuevekOA+mpG+G1h8Qz2EmHfDgR1uBtw==',key_name='tempest-keypair-1185435215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ab3ecfe4d75434cbf3cb49d37042d15',ramdisk_id='',reservation_id='r-7czmh1vi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-845922542',owner_user_name='tempest-TaggedBootDevicesTest_v242-845922542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:58:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf15add17bc44e64af4c05b1dbf40dd2',uuid=7514b113-ec17-468b-a647-de099d90e787,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a88c703-7b82-44ce-b5f5-a98718ae6833", "address": "fa:16:3e:0c:a9:71", "network": {"id": "0ef5507c-157f-4da7-9926-b55fdc2488a9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-360404380-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a88c703-7b", "ovs_interfaceid": "6a88c703-7b82-44ce-b5f5-a98718ae6833", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 09:58:33.469304 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converting VIF {"id": "6a88c703-7b82-44ce-b5f5-a98718ae6833", "address": "fa:16:3e:0c:a9:71", "network": {"id": "0ef5507c-157f-4da7-9926-b55fdc2488a9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-360404380-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a88c703-7b", "ovs_interfaceid": "6a88c703-7b82-44ce-b5f5-a98718ae6833", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:58:33.469304 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:a9:71,bridge_name='br-int',has_traffic_filtering=True,id=6a88c703-7b82-44ce-b5f5-a98718ae6833,network=Network(0ef5507c-157f-4da7-9926-b55fdc2488a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a88c703-7b') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:58:33.469772 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:a9:71,bridge_name='br-int',has_traffic_filtering=True,id=6a88c703-7b82-44ce-b5f5-a98718ae6833,network=Network(0ef5507c-157f-4da7-9926-b55fdc2488a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a88c703-7b') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 09:58:33.470298 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.470591 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:33.470848 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 09:58:33.471831 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.472038 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '61b82b5c-01fa-5b1e-a40b-94fb26aacd3d', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:33.472814 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.473533 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:58:33.475406 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.477609 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.477769 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a88c703-7b, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:33.478102 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6a88c703-7b, col_values=(('qos', UUID('ddf82b6c-c20b-4c16-964d-ab199e6cccc4')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:33.478262 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6a88c703-7b, col_values=(('external_ids', {'iface-id': '6a88c703-7b82-44ce-b5f5-a98718ae6833', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:a9:71', 'vm-uuid': '7514b113-ec17-468b-a647-de099d90e787'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:33.479953 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.480804 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:58:33.487481 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.490232 np0000001613 nova-compute[98321]: INFO os_vif [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:a9:71,bridge_name='br-int',has_traffic_filtering=True,id=6a88c703-7b82-44ce-b5f5-a98718ae6833,network=Network(0ef5507c-157f-4da7-9926-b55fdc2488a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a88c703-7b')
May 28 09:58:33.490232 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:57:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-97653989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-97653989',id=9,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLV2OCrcYa+6PPeqUulLq0R6pd2tI+MIMcHbBKM4XEVap2duuGQ9lDGHJUCRWzq3BO8do0Y0OErSFRcIkE3jwEjkE6O/8JgjSAtuevekOA+mpG+G1h8Qz2EmHfDgR1uBtw==',key_name='tempest-keypair-1185435215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ab3ecfe4d75434cbf3cb49d37042d15',ramdisk_id='',reservation_id='r-7czmh1vi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-845922542',owner_user_name='tempest-TaggedBootDevicesTest_v242-845922542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:58:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf15add17bc44e64af4c05b1dbf40dd2',uuid=7514b113-ec17-468b-a647-de099d90e787,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e1903f1-9c64-411e-be18-e5775f055e13", "address": "fa:16:3e:e8:48:00", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e1903f1-9c", "ovs_interfaceid": "4e1903f1-9c64-411e-be18-e5775f055e13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 09:58:33.490232 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converting VIF {"id": "4e1903f1-9c64-411e-be18-e5775f055e13", "address": "fa:16:3e:e8:48:00", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e1903f1-9c", "ovs_interfaceid": "4e1903f1-9c64-411e-be18-e5775f055e13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:58:33.490232 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:48:00,bridge_name='br-int',has_traffic_filtering=True,id=4e1903f1-9c64-411e-be18-e5775f055e13,network=Network(c6b29800-229c-48b1-b251-70b7d65f6b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4e1903f1-9c') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:58:33.490232 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:48:00,bridge_name='br-int',has_traffic_filtering=True,id=4e1903f1-9c64-411e-be18-e5775f055e13,network=Network(c6b29800-229c-48b1-b251-70b7d65f6b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4e1903f1-9c') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 09:58:33.490579 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.490609 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:33.490772 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 09:58:33.491686 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.491883 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '00980f96-e962-5c5b-b7e1-a55c265687f4', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:33.492700 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.493411 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:58:33.500047 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.502195 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.502410 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e1903f1-9c, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:33.502688 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4e1903f1-9c, col_values=(('qos', UUID('ec297ebc-06f6-4293-9d3f-e77bd3c3f40c')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:33.502852 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4e1903f1-9c, col_values=(('external_ids', {'iface-id': '4e1903f1-9c64-411e-be18-e5775f055e13', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:48:00', 'vm-uuid': '7514b113-ec17-468b-a647-de099d90e787'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:33.503941 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.506384 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:58:33.517377 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.520262 np0000001613 nova-compute[98321]: INFO os_vif [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:48:00,bridge_name='br-int',has_traffic_filtering=True,id=4e1903f1-9c64-411e-be18-e5775f055e13,network=Network(c6b29800-229c-48b1-b251-70b7d65f6b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4e1903f1-9c')
May 28 09:58:33.520262 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:57:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-97653989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-97653989',id=9,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLV2OCrcYa+6PPeqUulLq0R6pd2tI+MIMcHbBKM4XEVap2duuGQ9lDGHJUCRWzq3BO8do0Y0OErSFRcIkE3jwEjkE6O/8JgjSAtuevekOA+mpG+G1h8Qz2EmHfDgR1uBtw==',key_name='tempest-keypair-1185435215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ab3ecfe4d75434cbf3cb49d37042d15',ramdisk_id='',reservation_id='r-7czmh1vi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-845922542',owner_user_name='tempest-TaggedBootDevicesTest_v242-845922542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:58:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf15add17bc44e64af4c05b1dbf40dd2',uuid=7514b113-ec17-468b-a647-de099d90e787,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3", "address": "fa:16:3e:55:f2:21", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4490fa5a-9c", "ovs_interfaceid": "4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 09:58:33.520262 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converting VIF {"id": "4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3", "address": "fa:16:3e:55:f2:21", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4490fa5a-9c", "ovs_interfaceid": "4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:58:33.520262 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:f2:21,bridge_name='br-int',has_traffic_filtering=True,id=4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3,network=Network(c6b29800-229c-48b1-b251-70b7d65f6b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4490fa5a-9c') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:58:33.520262 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:f2:21,bridge_name='br-int',has_traffic_filtering=True,id=4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3,network=Network(c6b29800-229c-48b1-b251-70b7d65f6b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4490fa5a-9c') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 09:58:33.520884 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.521319 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:33.521319 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 09:58:33.522385 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.522540 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '68bbeb6a-8578-51bd-b7ea-26be6ebb66fe', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:33.523494 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.524586 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:58:33.538459 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.541113 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.541324 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4490fa5a-9c, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:33.541600 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4490fa5a-9c, col_values=(('qos', UUID('ab11c9a8-0d0c-49d0-b73a-4727a4858664')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:33.541744 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4490fa5a-9c, col_values=(('external_ids', {'iface-id': '4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:f2:21', 'vm-uuid': '7514b113-ec17-468b-a647-de099d90e787'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:33.544985 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.547236 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:58:33.565499 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.566581 np0000001613 nova-compute[98321]: INFO os_vif [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:f2:21,bridge_name='br-int',has_traffic_filtering=True,id=4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3,network=Network(c6b29800-229c-48b1-b251-70b7d65f6b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4490fa5a-9c')
May 28 09:58:33.568992 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:57:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-97653989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-97653989',id=9,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLV2OCrcYa+6PPeqUulLq0R6pd2tI+MIMcHbBKM4XEVap2duuGQ9lDGHJUCRWzq3BO8do0Y0OErSFRcIkE3jwEjkE6O/8JgjSAtuevekOA+mpG+G1h8Qz2EmHfDgR1uBtw==',key_name='tempest-keypair-1185435215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ab3ecfe4d75434cbf3cb49d37042d15',ramdisk_id='',reservation_id='r-7czmh1vi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-845922542',owner_user_name='tempest-TaggedBootDevicesTest_v242-845922542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:58:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf15add17bc44e64af4c05b1dbf40dd2',uuid=7514b113-ec17-468b-a647-de099d90e787,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edca6f4e-7f57-4351-8525-4446771d6376", "address": "fa:16:3e:31:6d:c0", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapedca6f4e-7f", "ovs_interfaceid": "edca6f4e-7f57-4351-8525-4446771d6376", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 09:58:33.568992 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converting VIF {"id": "edca6f4e-7f57-4351-8525-4446771d6376", "address": "fa:16:3e:31:6d:c0", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapedca6f4e-7f", "ovs_interfaceid": "edca6f4e-7f57-4351-8525-4446771d6376", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:58:33.568992 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:6d:c0,bridge_name='br-int',has_traffic_filtering=True,id=edca6f4e-7f57-4351-8525-4446771d6376,network=Network(c6b29800-229c-48b1-b251-70b7d65f6b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedca6f4e-7f') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:58:33.568992 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:6d:c0,bridge_name='br-int',has_traffic_filtering=True,id=edca6f4e-7f57-4351-8525-4446771d6376,network=Network(c6b29800-229c-48b1-b251-70b7d65f6b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedca6f4e-7f') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 09:58:33.569562 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.569562 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:33.569562 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 09:58:33.570629 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.570899 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8aa53710-f76c-54a6-9a2a-bbafe49f6a68', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:33.571546 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.572262 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:58:33.591812 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.594827 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.595055 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapedca6f4e-7f, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:33.595483 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapedca6f4e-7f, col_values=(('qos', UUID('9271798e-6dbf-4fa4-b69d-0cb29f5d6d72')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:33.595670 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapedca6f4e-7f, col_values=(('external_ids', {'iface-id': 'edca6f4e-7f57-4351-8525-4446771d6376', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:6d:c0', 'vm-uuid': '7514b113-ec17-468b-a647-de099d90e787'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:33.596739 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.598816 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:58:33.622745 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.626073 np0000001613 nova-compute[98321]: INFO os_vif [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:6d:c0,bridge_name='br-int',has_traffic_filtering=True,id=edca6f4e-7f57-4351-8525-4446771d6376,network=Network(c6b29800-229c-48b1-b251-70b7d65f6b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedca6f4e-7f')
May 28 09:58:33.626073 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:57:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-97653989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-97653989',id=9,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLV2OCrcYa+6PPeqUulLq0R6pd2tI+MIMcHbBKM4XEVap2duuGQ9lDGHJUCRWzq3BO8do0Y0OErSFRcIkE3jwEjkE6O/8JgjSAtuevekOA+mpG+G1h8Qz2EmHfDgR1uBtw==',key_name='tempest-keypair-1185435215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ab3ecfe4d75434cbf3cb49d37042d15',ramdisk_id='',reservation_id='r-7czmh1vi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-845922542',owner_user_name='tempest-TaggedBootDevicesTest_v242-845922542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:58:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf15add17bc44e64af4c05b1dbf40dd2',uuid=7514b113-ec17-468b-a647-de099d90e787,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3b48415-3d34-4753-a72f-6f48536174ed", "address": "fa:16:3e:48:5c:c5", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b48415-3d", "ovs_interfaceid": "d3b48415-3d34-4753-a72f-6f48536174ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 09:58:33.626073 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converting VIF {"id": "d3b48415-3d34-4753-a72f-6f48536174ed", "address": "fa:16:3e:48:5c:c5", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b48415-3d", "ovs_interfaceid": "d3b48415-3d34-4753-a72f-6f48536174ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:58:33.626073 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:5c:c5,bridge_name='br-int',has_traffic_filtering=True,id=d3b48415-3d34-4753-a72f-6f48536174ed,network=Network(c6b29800-229c-48b1-b251-70b7d65f6b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3b48415-3d') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:58:33.626073 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:5c:c5,bridge_name='br-int',has_traffic_filtering=True,id=d3b48415-3d34-4753-a72f-6f48536174ed,network=Network(c6b29800-229c-48b1-b251-70b7d65f6b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3b48415-3d') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 09:58:33.627051 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.627051 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:33.627051 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 09:58:33.628139 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.628365 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aa2e8c3c-5bcd-50c3-a46a-12a45c6349de', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:33.629306 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.629888 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:58:33.653310 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.655783 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.655981 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3b48415-3d, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:33.656397 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd3b48415-3d, col_values=(('qos', UUID('043372ce-4770-4616-aa30-12fa484db61d')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:33.656572 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd3b48415-3d, col_values=(('external_ids', {'iface-id': 'd3b48415-3d34-4753-a72f-6f48536174ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:5c:c5', 'vm-uuid': '7514b113-ec17-468b-a647-de099d90e787'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:33.657792 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.659843 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:58:33.686061 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.688912 np0000001613 nova-compute[98321]: INFO os_vif [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:5c:c5,bridge_name='br-int',has_traffic_filtering=True,id=d3b48415-3d34-4753-a72f-6f48536174ed,network=Network(c6b29800-229c-48b1-b251-70b7d65f6b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3b48415-3d')
May 28 09:58:33.688912 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:57:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-97653989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-97653989',id=9,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLV2OCrcYa+6PPeqUulLq0R6pd2tI+MIMcHbBKM4XEVap2duuGQ9lDGHJUCRWzq3BO8do0Y0OErSFRcIkE3jwEjkE6O/8JgjSAtuevekOA+mpG+G1h8Qz2EmHfDgR1uBtw==',key_name='tempest-keypair-1185435215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ab3ecfe4d75434cbf3cb49d37042d15',ramdisk_id='',reservation_id='r-7czmh1vi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-845922542',owner_user_name='tempest-TaggedBootDevicesTest_v242-845922542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:58:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf15add17bc44e64af4c05b1dbf40dd2',uuid=7514b113-ec17-468b-a647-de099d90e787,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e08f0477-e673-4559-884f-1dcbc2a9fd0e", "address": "fa:16:3e:07:9b:94", "network": {"id": "57e43a7e-bde2-4d30-bf6d-7c6cc5f5d3e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935029012", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape08f0477-e6", "ovs_interfaceid": "e08f0477-e673-4559-884f-1dcbc2a9fd0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 09:58:33.688912 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converting VIF {"id": "e08f0477-e673-4559-884f-1dcbc2a9fd0e", "address": "fa:16:3e:07:9b:94", "network": {"id": "57e43a7e-bde2-4d30-bf6d-7c6cc5f5d3e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935029012", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape08f0477-e6", "ovs_interfaceid": "e08f0477-e673-4559-884f-1dcbc2a9fd0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:58:33.688912 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:9b:94,bridge_name='br-int',has_traffic_filtering=True,id=e08f0477-e673-4559-884f-1dcbc2a9fd0e,network=Network(57e43a7e-bde2-4d30-bf6d-7c6cc5f5d3e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape08f0477-e6') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:58:33.688912 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:9b:94,bridge_name='br-int',has_traffic_filtering=True,id=e08f0477-e673-4559-884f-1dcbc2a9fd0e,network=Network(57e43a7e-bde2-4d30-bf6d-7c6cc5f5d3e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape08f0477-e6') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 09:58:33.689295 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.689412 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:33.689568 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 09:58:33.690777 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.691102 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6375cfe9-997e-5d94-bec3-7a02bde7c1a5', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:33.691929 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.692897 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:58:33.720246 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.722369 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.722564 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape08f0477-e6, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:33.722938 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape08f0477-e6, col_values=(('qos', UUID('0bf286bb-549c-4b3d-83ea-d7a68df2dcbc')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:33.723084 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape08f0477-e6, col_values=(('external_ids', {'iface-id': 'e08f0477-e673-4559-884f-1dcbc2a9fd0e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:9b:94', 'vm-uuid': '7514b113-ec17-468b-a647-de099d90e787'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:33.723988 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.725758 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:58:33.757918 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.759050 np0000001613 nova-compute[98321]: INFO os_vif [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:9b:94,bridge_name='br-int',has_traffic_filtering=True,id=e08f0477-e673-4559-884f-1dcbc2a9fd0e,network=Network(57e43a7e-bde2-4d30-bf6d-7c6cc5f5d3e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape08f0477-e6')
May 28 09:58:33.761912 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:57:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-97653989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-97653989',id=9,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLV2OCrcYa+6PPeqUulLq0R6pd2tI+MIMcHbBKM4XEVap2duuGQ9lDGHJUCRWzq3BO8do0Y0OErSFRcIkE3jwEjkE6O/8JgjSAtuevekOA+mpG+G1h8Qz2EmHfDgR1uBtw==',key_name='tempest-keypair-1185435215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ab3ecfe4d75434cbf3cb49d37042d15',ramdisk_id='',reservation_id='r-7czmh1vi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-845922542',owner_user_name='tempest-TaggedBootDevicesTest_v242-845922542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:58:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf15add17bc44e64af4c05b1dbf40dd2',uuid=7514b113-ec17-468b-a647-de099d90e787,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27187d46-bd01-4781-99fe-29d49015360e", "address": "fa:16:3e:38:ca:1f", "network": {"id": "57e43a7e-bde2-4d30-bf6d-7c6cc5f5d3e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935029012", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap27187d46-bd", "ovs_interfaceid": "27187d46-bd01-4781-99fe-29d49015360e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 09:58:33.761912 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converting VIF {"id": "27187d46-bd01-4781-99fe-29d49015360e", "address": "fa:16:3e:38:ca:1f", "network": {"id": "57e43a7e-bde2-4d30-bf6d-7c6cc5f5d3e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935029012", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap27187d46-bd", "ovs_interfaceid": "27187d46-bd01-4781-99fe-29d49015360e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:58:33.761912 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:ca:1f,bridge_name='br-int',has_traffic_filtering=True,id=27187d46-bd01-4781-99fe-29d49015360e,network=Network(57e43a7e-bde2-4d30-bf6d-7c6cc5f5d3e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27187d46-bd') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:58:33.761912 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:ca:1f,bridge_name='br-int',has_traffic_filtering=True,id=27187d46-bd01-4781-99fe-29d49015360e,network=Network(57e43a7e-bde2-4d30-bf6d-7c6cc5f5d3e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27187d46-bd') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 09:58:33.763352 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.763462 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:33.763630 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 09:58:33.764777 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.765026 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6bf882c1-6b60-5908-ad41-ea16637b494c', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:33.766690 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.767384 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:58:33.799905 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.802293 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.802469 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27187d46-bd, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:33.802728 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap27187d46-bd, col_values=(('qos', UUID('cd8dbd36-bc00-415c-bd2e-754e9bd2f9dd')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:33.802859 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap27187d46-bd, col_values=(('external_ids', {'iface-id': '27187d46-bd01-4781-99fe-29d49015360e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:ca:1f', 'vm-uuid': '7514b113-ec17-468b-a647-de099d90e787'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:33.806343 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.807520 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:58:33.845561 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:33.846953 np0000001613 nova-compute[98321]: INFO os_vif [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:ca:1f,bridge_name='br-int',has_traffic_filtering=True,id=27187d46-bd01-4781-99fe-29d49015360e,network=Network(57e43a7e-bde2-4d30-bf6d-7c6cc5f5d3e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27187d46-bd')
May 28 09:58:34.160824 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:34.526470 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Rescuing
May 28 09:58:34.526864 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "refresh_cache-57d353b6-133e-4354-a4f4-7bcec543d586" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:58:34.526864 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquired lock "refresh_cache-57d353b6-133e-4354-a4f4-7bcec543d586" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:58:34.526967 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 09:58:35.032482 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:35.373312 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:58:35.373633 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:58:35.373778 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] No VIF found with MAC fa:16:3e:0c:a9:71, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 09:58:35.374058 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] No VIF found with MAC fa:16:3e:48:5c:c5, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 09:58:35.374698 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Using config drive
May 28 09:58:35.398426 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:35.427021 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Acquiring lock "92fbf243-1c5b-47f6-9317-3fb2655651db" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:35.427283 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Lock "92fbf243-1c5b-47f6-9317-3fb2655651db" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:35.587751 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Updating instance_info_cache with network_info: [{"id": "9d6ec393-b62a-4342-a355-3cf8291ec2fe", "address": "fa:16:3e:7a:26:b6", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d6ec393-b6", "ovs_interfaceid": "9d6ec393-b62a-4342-a355-3cf8291ec2fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:58:35.857536 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "53ad56cc-eb5b-4e2e-a421-e93deee27fe7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:35.858291 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "53ad56cc-eb5b-4e2e-a421-e93deee27fe7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:35.882881 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:35.931200 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Lazy-loading 'flavor' on Instance uuid 92fbf243-1c5b-47f6-9317-3fb2655651db {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:58:36.083928 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Creating config drive at /opt/stack/data/nova/instances/7514b113-ec17-468b-a647-de099d90e787/disk.config
May 28 09:58:36.088822 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7514b113-ec17-468b-a647-de099d90e787/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgyuymltv {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:36.102220 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Releasing lock "refresh_cache-57d353b6-133e-4354-a4f4-7bcec543d586" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:58:36.124506 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7514b113-ec17-468b-a647-de099d90e787/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgyuymltv" returned: 0 in 0.036s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:36.192986 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Acquiring lock "49ff17d1-cad9-463e-b5c1-3315c52412e6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:36.192986 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Lock "49ff17d1-cad9-463e-b5c1-3315c52412e6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:36.363567 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lazy-loading 'flavor' on Instance uuid 53ad56cc-eb5b-4e2e-a421-e93deee27fe7 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:58:36.591889 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:36.638782 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:36.642111 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:36.696440 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Lazy-loading 'flavor' on Instance uuid 49ff17d1-cad9-463e-b5c1-3315c52412e6 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:58:36.709631 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:36.821508 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:36.825481 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:36.845720 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:36.850569 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:36.895073 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:36.941535 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Lock "92fbf243-1c5b-47f6-9317-3fb2655651db" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.514s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:36.941856 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:36.978995 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:36.980981 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:36.986209 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:37.006900 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:37.011687 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:37.050968 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:37.073652 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:37.090651 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:37.126823 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:37.215643 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:37.282924 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:37.284907 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:37.286328 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:37.346606 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:37.370984 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "53ad56cc-eb5b-4e2e-a421-e93deee27fe7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:37.378546 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:37.475072 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:37.603340 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:37.605952 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:37.608656 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:37.638760 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:37.712184 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Lock "49ff17d1-cad9-463e-b5c1-3315c52412e6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.519s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:37.744757 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:37.747543 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:37.765954 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:37.974117 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:37.983200 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:38.069058 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:38.082361 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:38.097644 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.998996261999991 future=<Future at 0x73c1fc1af0b0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:58:38.099366 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.997251133999953 future=<Future at 0x73c1fc1af0b0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:58:38.100699 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.99705264499994 future=<Future at 0x73c1fc1af0b0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:58:38.102805 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Instance destroyed successfully.
May 28 09:58:38.104220 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lazy-loading 'numa_topology' on Instance uuid 57d353b6-133e-4354-a4f4-7bcec543d586 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:58:38.175209 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:38.181437 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:38.341322 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:38.347935 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:38.373501 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962318.3731544, 7514b113-ec17-468b-a647-de099d90e787 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:58:38.373641 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 7514b113-ec17-468b-a647-de099d90e787] VM Started (Lifecycle Event)
May 28 09:58:38.608963 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Attempting a stable device rescue
May 28 09:58:38.642382 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Acquiring lock "92fbf243-1c5b-47f6-9317-3fb2655651db" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:38.642921 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Lock "92fbf243-1c5b-47f6-9317-3fb2655651db" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:38.642921 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Attaching volume 7c9b1127-3469-4dc1-96b7-9f736ca2309b to /dev/sdc
May 28 09:58:38.681280 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:38.689928 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:38.692068 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:38.700636 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=98321) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 28 09:58:38.700803 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 09:58:38.704571 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Instance directory exists: not creating {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 09:58:38.704571 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Creating image(s)
May 28 09:58:38.704783 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "/opt/stack/data/nova/instances/57d353b6-133e-4354-a4f4-7bcec543d586/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:38.704976 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "/opt/stack/data/nova/instances/57d353b6-133e-4354-a4f4-7bcec543d586/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:38.705493 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "/opt/stack/data/nova/instances/57d353b6-133e-4354-a4f4-7bcec543d586/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:38.705668 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lazy-loading 'trusted_certs' on Instance uuid 57d353b6-133e-4354-a4f4-7bcec543d586 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:58:38.713190 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 09:58:38.716725 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:38.720842 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:38.738194 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:38.762977 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 09:58:38.764414 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 09:58:38.771067 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 09:58:38.772706 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe95:8bd3', 'fe80::fc16:3eff:fe2d:94a4', 'fe80::fc16:3eff:fe31:5106', 'fe80::fc96:34ff:fe12:e4df', 'fe80::2844:59ff:feec:5d21', 'fe80::44e2:31ff:fe81:8771', 'fe80::fc16:3eff:fe9a:42b3', 'fe80::b04e:afff:fe71:41fc', 'fe80::fc16:3eff:fefb:160', 'fe80::5c68:7cff:fe27:e759', 'fe80::fc16:3eff:fe2a:719a', 'fe80::9038:13ff:fe5b:5aad', 'fe80::fc16:3eff:fe9c:2e17', 'fe80::8064:4aff:fe56:ba53', 'fe80::fc16:3eff:fe14:ef87', 'fe80::fc16:3eff:fe0c:a971', 'fe80::ac03:e9ff:fe37:b50a', 'fe80::fc16:3eff:fee8:4800', 'fe80::fc16:3eff:fe55:f221', 'fe80::fc16:3eff:fe31:6dc0', 'fe80::fc16:3eff:fe48:5cc5', 'fe80::fc16:3eff:fe07:9b94', 'fe80::3061:30ff:fee7:aa25', 'fe80::fc16:3eff:fe38:ca1f', 'fe80::888d:9dff:fe20:5f03'] 
May 28 09:58:38.772845 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 09:58:38.772973 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 09:58:38.773237 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] <== get_connector_properties: return (72ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 09:58:38.773479 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Updating existing volume attachment record: b09e8aa7-dc8a-46db-9eed-941cf6978aac {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 09:58:38.805076 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:38.879298 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 7514b113-ec17-468b-a647-de099d90e787] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:58:38.881382 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962318.8806906, 7514b113-ec17-468b-a647-de099d90e787 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:58:38.881543 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 7514b113-ec17-468b-a647-de099d90e787] VM Paused (Lifecycle Event)
May 28 09:58:38.964383 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:38.969540 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:39.018261 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "53ad56cc-eb5b-4e2e-a421-e93deee27fe7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:39.018502 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "53ad56cc-eb5b-4e2e-a421-e93deee27fe7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:39.018801 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Attaching volume 08d8c7ce-386e-488e-a0f2-c61fdb5a686b to /dev/vdb
May 28 09:58:39.070866 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 09:58:39.082980 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 09:58:39.101955 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:39.103151 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:39.115658 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:39.124357 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6cd86b07-5a29-471a-9c64-0f892a38f4a8 req-9f9f8fee-c843-4777-8bb5-2f6658117c65 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-plugged-6a88c703-7b82-44ce-b5f5-a98718ae6833 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:39.125494 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6cd86b07-5a29-471a-9c64-0f892a38f4a8 req-9f9f8fee-c843-4777-8bb5-2f6658117c65 service nova] Acquiring lock "7514b113-ec17-468b-a647-de099d90e787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:39.125832 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6cd86b07-5a29-471a-9c64-0f892a38f4a8 req-9f9f8fee-c843-4777-8bb5-2f6658117c65 service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:39.126069 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6cd86b07-5a29-471a-9c64-0f892a38f4a8 req-9f9f8fee-c843-4777-8bb5-2f6658117c65 service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:39.126281 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6cd86b07-5a29-471a-9c64-0f892a38f4a8 req-9f9f8fee-c843-4777-8bb5-2f6658117c65 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Processing event network-vif-plugged-6a88c703-7b82-44ce-b5f5-a98718ae6833 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 09:58:39.127245 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 09:58:39.127440 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 09:58:39.135330 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 09:58:39.137205 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe95:8bd3', 'fe80::fc16:3eff:fe2d:94a4', 'fe80::fc16:3eff:fe31:5106', 'fe80::fc96:34ff:fe12:e4df', 'fe80::2844:59ff:feec:5d21', 'fe80::44e2:31ff:fe81:8771', 'fe80::fc16:3eff:fe9a:42b3', 'fe80::b04e:afff:fe71:41fc', 'fe80::fc16:3eff:fefb:160', 'fe80::5c68:7cff:fe27:e759', 'fe80::fc16:3eff:fe2a:719a', 'fe80::9038:13ff:fe5b:5aad', 'fe80::fc16:3eff:fe9c:2e17', 'fe80::8064:4aff:fe56:ba53', 'fe80::fc16:3eff:fe14:ef87', 'fe80::fc16:3eff:fe0c:a971', 'fe80::ac03:e9ff:fe37:b50a', 'fe80::fc16:3eff:fee8:4800', 'fe80::fc16:3eff:fe55:f221', 'fe80::fc16:3eff:fe31:6dc0', 'fe80::fc16:3eff:fe48:5cc5', 'fe80::fc16:3eff:fe07:9b94', 'fe80::3061:30ff:fee7:aa25', 'fe80::fc16:3eff:fe38:ca1f', 'fe80::888d:9dff:fe20:5f03'] 
May 28 09:58:39.137307 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 09:58:39.137665 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 09:58:39.137665 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] <== get_connector_properties: return (66ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 09:58:39.137863 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Updating existing volume attachment record: a00f1c05-187b-432c-ae44-5067c672efcd {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 09:58:39.145127 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-68c7f37d-3c0a-4c61-9c67-93e496886d11 req-d34660c3-7da5-4287-aebb-9a6ba07d5061 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-plugged-4e1903f1-9c64-411e-be18-e5775f055e13 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:39.145796 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-68c7f37d-3c0a-4c61-9c67-93e496886d11 req-d34660c3-7da5-4287-aebb-9a6ba07d5061 service nova] Acquiring lock "7514b113-ec17-468b-a647-de099d90e787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:39.146190 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-68c7f37d-3c0a-4c61-9c67-93e496886d11 req-d34660c3-7da5-4287-aebb-9a6ba07d5061 service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:39.146745 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-68c7f37d-3c0a-4c61-9c67-93e496886d11 req-d34660c3-7da5-4287-aebb-9a6ba07d5061 service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:39.146745 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-68c7f37d-3c0a-4c61-9c67-93e496886d11 req-d34660c3-7da5-4287-aebb-9a6ba07d5061 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Processing event network-vif-plugged-4e1903f1-9c64-411e-be18-e5775f055e13 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 09:58:39.161442 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8bc4c524-24a5-464e-9463-99fdbd896a45 req-ca17b236-0dc7-46af-9a62-be0ca099e40d service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-plugged-4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:39.164223 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8bc4c524-24a5-464e-9463-99fdbd896a45 req-ca17b236-0dc7-46af-9a62-be0ca099e40d service nova] Acquiring lock "7514b113-ec17-468b-a647-de099d90e787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:39.164684 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8bc4c524-24a5-464e-9463-99fdbd896a45 req-ca17b236-0dc7-46af-9a62-be0ca099e40d service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:39.164835 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8bc4c524-24a5-464e-9463-99fdbd896a45 req-ca17b236-0dc7-46af-9a62-be0ca099e40d service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:39.164967 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8bc4c524-24a5-464e-9463-99fdbd896a45 req-ca17b236-0dc7-46af-9a62-be0ca099e40d service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Processing event network-vif-plugged-4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 09:58:39.167807 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:39.209340 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Object Instance<57d353b6-133e-4354-a4f4-7bcec543d586> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 09:58:39.209690 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "5b2a8a49b6807f62341af0f2e6c7029914b3c4d7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:39.210255 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "5b2a8a49b6807f62341af0f2e6c7029914b3c4d7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:39.331839 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 09:58:39.332149 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b', 'iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7c9b1127-3469-4dc1-96b7-9f736ca2309b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 09:58:39.332321 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:58:39.332618 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:58:39.332803 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b', 'iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7c9b1127-3469-4dc1-96b7-9f736ca2309b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 09:58:39.345933 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:58:39.346589 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:58:39.347185 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:58:39.347455 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 09:58:39.347872 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:58:39.348059 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 09:58:39.359864 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 09:58:39.359864 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:39.364691 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 09:58:39.364691 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:39.374225 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b] added
May 28 09:58:39.374225 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 09:58:39.374225 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:58:39.374225 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:58:39.374225 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:58:39.374225 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:58:39.374225 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:39.374545 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 09:58:39.375199 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0273(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 09:58:39.375199 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 09:58:39.378299 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b] added
May 28 09:58:39.378299 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 09:58:39.378299 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:58:39.378299 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:58:39.378299 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:58:39.378299 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:58:39.378299 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:39.378876 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 09:58:39.379073 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0309(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 09:58:39.380004 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 09:58:39.391082 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 7514b113-ec17-468b-a647-de099d90e787] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:58:39.391912 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 7514b113-ec17-468b-a647-de099d90e787] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 09:58:39.419922 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Acquiring lock "49ff17d1-cad9-463e-b5c1-3315c52412e6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:39.420059 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Lock "49ff17d1-cad9-463e-b5c1-3315c52412e6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:39.424895 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Attaching volume efda049f-2154-4df6-8c7b-026a19b94dd4 to /dev/vdb
May 28 09:58:39.473697 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 09:58:39.484570 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 09:58:39.510204 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:39.540356 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 09:58:39.540740 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 09:58:39.549689 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 09:58:39.551416 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe95:8bd3', 'fe80::fc16:3eff:fe2d:94a4', 'fe80::fc16:3eff:fe31:5106', 'fe80::fc96:34ff:fe12:e4df', 'fe80::2844:59ff:feec:5d21', 'fe80::44e2:31ff:fe81:8771', 'fe80::fc16:3eff:fe9a:42b3', 'fe80::b04e:afff:fe71:41fc', 'fe80::fc16:3eff:fefb:160', 'fe80::5c68:7cff:fe27:e759', 'fe80::fc16:3eff:fe2a:719a', 'fe80::9038:13ff:fe5b:5aad', 'fe80::fc16:3eff:fe9c:2e17', 'fe80::8064:4aff:fe56:ba53', 'fe80::fc16:3eff:fe14:ef87', 'fe80::fc16:3eff:fe0c:a971', 'fe80::ac03:e9ff:fe37:b50a', 'fe80::fc16:3eff:fee8:4800', 'fe80::fc16:3eff:fe55:f221', 'fe80::fc16:3eff:fe31:6dc0', 'fe80::fc16:3eff:fe48:5cc5', 'fe80::fc16:3eff:fe07:9b94', 'fe80::3061:30ff:fee7:aa25', 'fe80::fc16:3eff:fe38:ca1f', 'fe80::888d:9dff:fe20:5f03'] 
May 28 09:58:39.552275 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 09:58:39.552468 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 09:58:39.552823 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] <== get_connector_properties: return (79ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 09:58:39.553136 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Updating existing volume attachment record: 57e737b4-ca40-4dad-8a5f-bfd5b2a9bef1 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 09:58:39.704569 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 09:58:39.704967 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b', 'iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '08d8c7ce-386e-488e-a0f2-c61fdb5a686b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 09:58:39.705344 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:58:39.726004 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "c9416092-d229-4f59-aaf3-3b0b692e7924" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:39.726253 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "c9416092-d229-4f59-aaf3-3b0b692e7924" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:39.895274 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 7514b113-ec17-468b-a647-de099d90e787] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 09:58:39.995286 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e137232e-ead4-4bbe-8e04-57d3c9f6a068 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Acquiring lock "interface-e2856743-3a60-4be1-b29c-b4de06f14783-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:39.995428 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e137232e-ead4-4bbe-8e04-57d3c9f6a068 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lock "interface-e2856743-3a60-4be1-b29c-b4de06f14783-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:39.995678 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-e137232e-ead4-4bbe-8e04-57d3c9f6a068 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lazy-loading 'flavor' on Instance uuid e2856743-3a60-4be1-b29c-b4de06f14783 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:58:40.067692 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:58:40.070380 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:58:40.070736 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b2a8a49b6807f62341af0f2e6c7029914b3c4d7.part --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:40.116582 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 09:58:40.116582 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4', 'iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'efda049f-2154-4df6-8c7b-026a19b94dd4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 09:58:40.116582 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:58:40.137579 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b2a8a49b6807f62341af0f2e6c7029914b3c4d7.part --force-share --output=json" returned: 0 in 0.067s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:40.137974 np0000001613 nova-compute[98321]: DEBUG nova.virt.images [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] ae0b0986-602d-4ddf-a79e-61bdcfd14d80 was qcow2, converting to raw {{(pid=98321) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 09:58:40.138517 np0000001613 nova-compute[98321]: DEBUG nova.privsep.utils [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98321) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 09:58:40.138805 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5b2a8a49b6807f62341af0f2e6c7029914b3c4d7.part /opt/stack/data/nova/instances/_base/5b2a8a49b6807f62341af0f2e6c7029914b3c4d7.converted {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:40.198504 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5b2a8a49b6807f62341af0f2e6c7029914b3c4d7.part /opt/stack/data/nova/instances/_base/5b2a8a49b6807f62341af0f2e6c7029914b3c4d7.converted" returned: 0 in 0.059s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:40.204304 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b2a8a49b6807f62341af0f2e6c7029914b3c4d7.converted --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:40.230194 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 09:58:40.281518 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b2a8a49b6807f62341af0f2e6c7029914b3c4d7.converted --force-share --output=json" returned: 0 in 0.077s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:40.282179 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "5b2a8a49b6807f62341af0f2e6c7029914b3c4d7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.072s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:40.282621 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:58:40.285107 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:58:40.286026 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "5b2a8a49b6807f62341af0f2e6c7029914b3c4d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:40.287032 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "5b2a8a49b6807f62341af0f2e6c7029914b3c4d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:40.287032 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:58:40.289749 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:58:40.291015 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b2a8a49b6807f62341af0f2e6c7029914b3c4d7 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:40.364071 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b2a8a49b6807f62341af0f2e6c7029914b3c4d7 --force-share --output=json" returned: 0 in 0.073s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:40.364995 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b2a8a49b6807f62341af0f2e6c7029914b3c4d7,backing_fmt=raw /opt/stack/data/nova/instances/57d353b6-133e-4354-a4f4-7bcec543d586/disk.rescue {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:40.376254 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 09:58:40.380614 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.startup = manual
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.port = 0
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 09:58:40.388054 np0000001613 nova-compute[98321]: # END RECORD
May 28 09:58:40.388054 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.startup = manual
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.port = 0
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 09:58:40.397613 np0000001613 nova-compute[98321]: # END RECORD
May 28 09:58:40.397613 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:40.401636 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b2a8a49b6807f62341af0f2e6c7029914b3c4d7,backing_fmt=raw /opt/stack/data/nova/instances/57d353b6-133e-4354-a4f4-7bcec543d586/disk.rescue" returned: 0 in 0.036s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:40.402327 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "5b2a8a49b6807f62341af0f2e6c7029914b3c4d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.116s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:40.402619 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lazy-loading 'migration_context' on Instance uuid 57d353b6-133e-4354-a4f4-7bcec543d586 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:58:40.404457 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:40.411028 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:40.418921 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:40.418921 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:40.418921 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:40.418921 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:40.418921 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:40.418921 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:40.418921 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:40.418921 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:40.418921 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:58:40.419202 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:40.419202 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:40.419202 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:40.419202 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:40.419202 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:40.419202 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:40.419202 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:40.419202 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:40.419202 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:58:40.426011 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:40.426011 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:40.426011 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:40.426011 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:40.426011 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:40.426011 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:40.426011 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:40.426011 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:40.426011 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:58:40.426274 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:40.426274 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:40.426274 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:40.426274 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:40.426274 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:40.426274 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:40.426274 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:40.426274 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:40.426274 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:58:40.459311 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b, portal: 192.168.40.100,3260]
May 28 09:58:40.459311 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b, portal: 192.168.40.100,3260] successful.
May 28 09:58:40.459311 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:40.469515 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:40.478034 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b, portal: 192.168.50.100,3260]
May 28 09:58:40.478034 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b, portal: 192.168.50.100,3260] successful.
May 28 09:58:40.478034 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:40.485978 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:40.485978 np0000001613 nova-compute[98321]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:40.485978 np0000001613 nova-compute[98321]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:40.485978 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:40.485978 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:40.485978 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:40.485978 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:40.485978 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:40.485978 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:40.485978 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:40.485978 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:58:40.486318 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:40.486318 np0000001613 nova-compute[98321]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:40.486318 np0000001613 nova-compute[98321]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:40.486318 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:40.486318 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:40.486318 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:40.486318 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:40.486318 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:40.486318 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:40.486318 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:40.486318 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:58:40.486632 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.140s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:58:40.486834 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 09:58:40.488408 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:40.488826 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] HCTL ('15', '-', '-', 0) found on session 11 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 09:58:40.488998 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 09:58:40.499110 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-e137232e-ead4-4bbe-8e04-57d3c9f6a068 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:40.505134 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Searching for a device in session 11 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 09:58:40.505134 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7c9b1127-3469-4dc1-96b7-9f736ca2309b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 09:58:40.508563 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:40.508563 np0000001613 nova-compute[98321]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:40.508563 np0000001613 nova-compute[98321]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:40.508563 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:40.508563 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:40.508563 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:40.508563 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:40.508563 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:40.508563 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:40.508563 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:40.508563 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:58:40.508563 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:40.508563 np0000001613 nova-compute[98321]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:40.508563 np0000001613 nova-compute[98321]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:40.508563 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:40.508563 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:40.508563 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:40.508563 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:40.508563 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:40.508563 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:40.508563 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:40.508563 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:58:40.509211 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.161s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:58:40.509211 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 09:58:40.510115 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] HCTL ('16', '-', '-', 0) found on session 12 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 09:58:40.510281 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 09:58:40.526580 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Searching for a device in session 12 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 09:58:40.526580 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7c9b1127-3469-4dc1-96b7-9f736ca2309b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 09:58:40.672571 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-e137232e-ead4-4bbe-8e04-57d3c9f6a068 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lazy-loading 'pci_requests' on Instance uuid e2856743-3a60-4be1-b29c-b4de06f14783 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:58:40.777673 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:40.778034 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:40.780866 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 09:58:40.780982 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Claim successful on node np0000001613
May 28 09:58:40.905823 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Object Instance<57d353b6-133e-4354-a4f4-7bcec543d586> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 09:58:40.906156 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 09:58:40.906991 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Start _get_guest_xml network_info=[{"id": "9d6ec393-b62a-4342-a355-3cf8291ec2fe", "address": "fa:16:3e:7a:26:b6", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "vif_mac": "fa:16:3e:7a:26:b6"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d6ec393-b6", "ovs_interfaceid": "9d6ec393-b62a-4342-a355-3cf8291ec2fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ae0b0986-602d-4ddf-a79e-61bdcfd14d80', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd1dfc5cc-6703-445f-9daa-05afb78f89f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, 'status': 'reserved', 'instance': '57d353b6-133e-4354-a4f4-7bcec543d586', 'attached_at': '', 'detached_at': '', 'volume_id': 'd1dfc5cc-6703-445f-9daa-05afb78f89f0', 'serial': 'd1dfc5cc-6703-445f-9daa-05afb78f89f0'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '3edd9888-7ee7-4a33-aeed-ec2d31e46943', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 09:58:40.907251 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lazy-loading 'resources' on Instance uuid 57d353b6-133e-4354-a4f4-7bcec543d586 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:58:41.175713 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-e137232e-ead4-4bbe-8e04-57d3c9f6a068 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Object Instance<e2856743-3a60-4be1-b29c-b4de06f14783> lazy-loaded attributes: flavor,pci_requests {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 09:58:41.175945 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-e137232e-ead4-4bbe-8e04-57d3c9f6a068 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 09:58:41.176209 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-e137232e-ead4-4bbe-8e04-57d3c9f6a068 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:41.176449 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-e137232e-ead4-4bbe-8e04-57d3c9f6a068 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:41.196064 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8c2ac0d2-7444-4eae-a12a-db5529721026 req-5ee4c798-36bb-4199-bfda-28ba93b1679f service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-plugged-4e1903f1-9c64-411e-be18-e5775f055e13 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:41.197151 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8c2ac0d2-7444-4eae-a12a-db5529721026 req-5ee4c798-36bb-4199-bfda-28ba93b1679f service nova] Acquiring lock "7514b113-ec17-468b-a647-de099d90e787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:41.197151 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8c2ac0d2-7444-4eae-a12a-db5529721026 req-5ee4c798-36bb-4199-bfda-28ba93b1679f service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:41.197151 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8c2ac0d2-7444-4eae-a12a-db5529721026 req-5ee4c798-36bb-4199-bfda-28ba93b1679f service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:41.197151 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8c2ac0d2-7444-4eae-a12a-db5529721026 req-5ee4c798-36bb-4199-bfda-28ba93b1679f service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] No event matching network-vif-plugged-4e1903f1-9c64-411e-be18-e5775f055e13 in dict_keys([('network-vif-plugged', 'edca6f4e-7f57-4351-8525-4446771d6376'), ('network-vif-plugged', 'd3b48415-3d34-4753-a72f-6f48536174ed'), ('network-vif-plugged', 'e08f0477-e673-4559-884f-1dcbc2a9fd0e'), ('network-vif-plugged', '27187d46-bd01-4781-99fe-29d49015360e')]) {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 09:58:41.197151 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-8c2ac0d2-7444-4eae-a12a-db5529721026 req-5ee4c798-36bb-4199-bfda-28ba93b1679f service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received unexpected event network-vif-plugged-4e1903f1-9c64-411e-be18-e5775f055e13 for instance with vm_state building and task_state spawning.
May 28 09:58:41.197458 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8c2ac0d2-7444-4eae-a12a-db5529721026 req-5ee4c798-36bb-4199-bfda-28ba93b1679f service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-plugged-edca6f4e-7f57-4351-8525-4446771d6376 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:41.197458 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8c2ac0d2-7444-4eae-a12a-db5529721026 req-5ee4c798-36bb-4199-bfda-28ba93b1679f service nova] Acquiring lock "7514b113-ec17-468b-a647-de099d90e787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:41.197557 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8c2ac0d2-7444-4eae-a12a-db5529721026 req-5ee4c798-36bb-4199-bfda-28ba93b1679f service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:41.197716 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8c2ac0d2-7444-4eae-a12a-db5529721026 req-5ee4c798-36bb-4199-bfda-28ba93b1679f service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:41.197783 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8c2ac0d2-7444-4eae-a12a-db5529721026 req-5ee4c798-36bb-4199-bfda-28ba93b1679f service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Processing event network-vif-plugged-edca6f4e-7f57-4351-8525-4446771d6376 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 09:58:41.197914 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8c2ac0d2-7444-4eae-a12a-db5529721026 req-5ee4c798-36bb-4199-bfda-28ba93b1679f service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-plugged-edca6f4e-7f57-4351-8525-4446771d6376 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:41.198114 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8c2ac0d2-7444-4eae-a12a-db5529721026 req-5ee4c798-36bb-4199-bfda-28ba93b1679f service nova] Acquiring lock "7514b113-ec17-468b-a647-de099d90e787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:41.198191 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8c2ac0d2-7444-4eae-a12a-db5529721026 req-5ee4c798-36bb-4199-bfda-28ba93b1679f service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:41.198282 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8c2ac0d2-7444-4eae-a12a-db5529721026 req-5ee4c798-36bb-4199-bfda-28ba93b1679f service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:41.198750 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8c2ac0d2-7444-4eae-a12a-db5529721026 req-5ee4c798-36bb-4199-bfda-28ba93b1679f service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] No event matching network-vif-plugged-edca6f4e-7f57-4351-8525-4446771d6376 in dict_keys([('network-vif-plugged', 'd3b48415-3d34-4753-a72f-6f48536174ed'), ('network-vif-plugged', 'e08f0477-e673-4559-884f-1dcbc2a9fd0e'), ('network-vif-plugged', '27187d46-bd01-4781-99fe-29d49015360e')]) {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 09:58:41.198934 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-8c2ac0d2-7444-4eae-a12a-db5529721026 req-5ee4c798-36bb-4199-bfda-28ba93b1679f service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received unexpected event network-vif-plugged-edca6f4e-7f57-4351-8525-4446771d6376 for instance with vm_state building and task_state spawning.
May 28 09:58:41.202607 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c1a1e731-55e3-446d-813f-ccbc4f77873a req-6c8780fb-d309-4bed-a2c7-30c962c29c2e service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-plugged-6a88c703-7b82-44ce-b5f5-a98718ae6833 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:41.202883 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c1a1e731-55e3-446d-813f-ccbc4f77873a req-6c8780fb-d309-4bed-a2c7-30c962c29c2e service nova] Acquiring lock "7514b113-ec17-468b-a647-de099d90e787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:41.203097 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c1a1e731-55e3-446d-813f-ccbc4f77873a req-6c8780fb-d309-4bed-a2c7-30c962c29c2e service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:41.203791 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c1a1e731-55e3-446d-813f-ccbc4f77873a req-6c8780fb-d309-4bed-a2c7-30c962c29c2e service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:41.203974 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c1a1e731-55e3-446d-813f-ccbc4f77873a req-6c8780fb-d309-4bed-a2c7-30c962c29c2e service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] No event matching network-vif-plugged-6a88c703-7b82-44ce-b5f5-a98718ae6833 in dict_keys([('network-vif-plugged', 'd3b48415-3d34-4753-a72f-6f48536174ed'), ('network-vif-plugged', 'e08f0477-e673-4559-884f-1dcbc2a9fd0e'), ('network-vif-plugged', '27187d46-bd01-4781-99fe-29d49015360e')]) {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 09:58:41.204189 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-c1a1e731-55e3-446d-813f-ccbc4f77873a req-6c8780fb-d309-4bed-a2c7-30c962c29c2e service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received unexpected event network-vif-plugged-6a88c703-7b82-44ce-b5f5-a98718ae6833 for instance with vm_state building and task_state spawning.
May 28 09:58:41.204234 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c1a1e731-55e3-446d-813f-ccbc4f77873a req-6c8780fb-d309-4bed-a2c7-30c962c29c2e service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-plugged-27187d46-bd01-4781-99fe-29d49015360e {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:41.204391 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c1a1e731-55e3-446d-813f-ccbc4f77873a req-6c8780fb-d309-4bed-a2c7-30c962c29c2e service nova] Acquiring lock "7514b113-ec17-468b-a647-de099d90e787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:41.204521 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c1a1e731-55e3-446d-813f-ccbc4f77873a req-6c8780fb-d309-4bed-a2c7-30c962c29c2e service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:41.204660 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c1a1e731-55e3-446d-813f-ccbc4f77873a req-6c8780fb-d309-4bed-a2c7-30c962c29c2e service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:41.204796 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c1a1e731-55e3-446d-813f-ccbc4f77873a req-6c8780fb-d309-4bed-a2c7-30c962c29c2e service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Processing event network-vif-plugged-27187d46-bd01-4781-99fe-29d49015360e {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 09:58:41.204945 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c1a1e731-55e3-446d-813f-ccbc4f77873a req-6c8780fb-d309-4bed-a2c7-30c962c29c2e service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-plugged-27187d46-bd01-4781-99fe-29d49015360e {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:41.205083 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c1a1e731-55e3-446d-813f-ccbc4f77873a req-6c8780fb-d309-4bed-a2c7-30c962c29c2e service nova] Acquiring lock "7514b113-ec17-468b-a647-de099d90e787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:41.205262 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c1a1e731-55e3-446d-813f-ccbc4f77873a req-6c8780fb-d309-4bed-a2c7-30c962c29c2e service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:41.205415 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c1a1e731-55e3-446d-813f-ccbc4f77873a req-6c8780fb-d309-4bed-a2c7-30c962c29c2e service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:41.205569 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c1a1e731-55e3-446d-813f-ccbc4f77873a req-6c8780fb-d309-4bed-a2c7-30c962c29c2e service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] No event matching network-vif-plugged-27187d46-bd01-4781-99fe-29d49015360e in dict_keys([('network-vif-plugged', 'd3b48415-3d34-4753-a72f-6f48536174ed'), ('network-vif-plugged', 'e08f0477-e673-4559-884f-1dcbc2a9fd0e')]) {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 09:58:41.205783 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-c1a1e731-55e3-446d-813f-ccbc4f77873a req-6c8780fb-d309-4bed-a2c7-30c962c29c2e service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received unexpected event network-vif-plugged-27187d46-bd01-4781-99fe-29d49015360e for instance with vm_state building and task_state spawning.
May 28 09:58:41.205917 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c1a1e731-55e3-446d-813f-ccbc4f77873a req-6c8780fb-d309-4bed-a2c7-30c962c29c2e service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Received event network-vif-unplugged-9d6ec393-b62a-4342-a355-3cf8291ec2fe {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:41.206111 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c1a1e731-55e3-446d-813f-ccbc4f77873a req-6c8780fb-d309-4bed-a2c7-30c962c29c2e service nova] Acquiring lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:41.206304 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c1a1e731-55e3-446d-813f-ccbc4f77873a req-6c8780fb-d309-4bed-a2c7-30c962c29c2e service nova] Lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:41.206431 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c1a1e731-55e3-446d-813f-ccbc4f77873a req-6c8780fb-d309-4bed-a2c7-30c962c29c2e service nova] Lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:41.206538 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c1a1e731-55e3-446d-813f-ccbc4f77873a req-6c8780fb-d309-4bed-a2c7-30c962c29c2e service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] No waiting events found dispatching network-vif-unplugged-9d6ec393-b62a-4342-a355-3cf8291ec2fe {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:58:41.206642 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-c1a1e731-55e3-446d-813f-ccbc4f77873a req-6c8780fb-d309-4bed-a2c7-30c962c29c2e service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Received unexpected event network-vif-unplugged-9d6ec393-b62a-4342-a355-3cf8291ec2fe for instance with vm_state active and task_state rescuing.
May 28 09:58:41.206757 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c1a1e731-55e3-446d-813f-ccbc4f77873a req-6c8780fb-d309-4bed-a2c7-30c962c29c2e service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Received event network-vif-unplugged-9d6ec393-b62a-4342-a355-3cf8291ec2fe {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:41.207023 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c1a1e731-55e3-446d-813f-ccbc4f77873a req-6c8780fb-d309-4bed-a2c7-30c962c29c2e service nova] Acquiring lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:41.207023 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c1a1e731-55e3-446d-813f-ccbc4f77873a req-6c8780fb-d309-4bed-a2c7-30c962c29c2e service nova] Lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:41.207137 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c1a1e731-55e3-446d-813f-ccbc4f77873a req-6c8780fb-d309-4bed-a2c7-30c962c29c2e service nova] Lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:41.207273 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c1a1e731-55e3-446d-813f-ccbc4f77873a req-6c8780fb-d309-4bed-a2c7-30c962c29c2e service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] No waiting events found dispatching network-vif-unplugged-9d6ec393-b62a-4342-a355-3cf8291ec2fe {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:58:41.207372 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-c1a1e731-55e3-446d-813f-ccbc4f77873a req-6c8780fb-d309-4bed-a2c7-30c962c29c2e service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Received unexpected event network-vif-unplugged-9d6ec393-b62a-4342-a355-3cf8291ec2fe for instance with vm_state active and task_state rescuing.
May 28 09:58:41.218016 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a23a05de-792f-44e5-a65f-48fbf40def57 req-42e31bad-5aef-4e61-a236-804a3adedc75 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-plugged-4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:41.219021 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a23a05de-792f-44e5-a65f-48fbf40def57 req-42e31bad-5aef-4e61-a236-804a3adedc75 service nova] Acquiring lock "7514b113-ec17-468b-a647-de099d90e787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:41.219021 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a23a05de-792f-44e5-a65f-48fbf40def57 req-42e31bad-5aef-4e61-a236-804a3adedc75 service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:41.219021 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a23a05de-792f-44e5-a65f-48fbf40def57 req-42e31bad-5aef-4e61-a236-804a3adedc75 service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:41.219021 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a23a05de-792f-44e5-a65f-48fbf40def57 req-42e31bad-5aef-4e61-a236-804a3adedc75 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] No event matching network-vif-plugged-4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3 in dict_keys([('network-vif-plugged', 'd3b48415-3d34-4753-a72f-6f48536174ed'), ('network-vif-plugged', 'e08f0477-e673-4559-884f-1dcbc2a9fd0e')]) {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 09:58:41.219021 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-a23a05de-792f-44e5-a65f-48fbf40def57 req-42e31bad-5aef-4e61-a236-804a3adedc75 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received unexpected event network-vif-plugged-4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3 for instance with vm_state building and task_state spawning.
May 28 09:58:41.219021 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a23a05de-792f-44e5-a65f-48fbf40def57 req-42e31bad-5aef-4e61-a236-804a3adedc75 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-plugged-d3b48415-3d34-4753-a72f-6f48536174ed {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:41.219482 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a23a05de-792f-44e5-a65f-48fbf40def57 req-42e31bad-5aef-4e61-a236-804a3adedc75 service nova] Acquiring lock "7514b113-ec17-468b-a647-de099d90e787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:41.219482 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a23a05de-792f-44e5-a65f-48fbf40def57 req-42e31bad-5aef-4e61-a236-804a3adedc75 service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:41.219482 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a23a05de-792f-44e5-a65f-48fbf40def57 req-42e31bad-5aef-4e61-a236-804a3adedc75 service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:41.219482 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a23a05de-792f-44e5-a65f-48fbf40def57 req-42e31bad-5aef-4e61-a236-804a3adedc75 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Processing event network-vif-plugged-d3b48415-3d34-4753-a72f-6f48536174ed {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 09:58:41.219876 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a23a05de-792f-44e5-a65f-48fbf40def57 req-42e31bad-5aef-4e61-a236-804a3adedc75 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-plugged-d3b48415-3d34-4753-a72f-6f48536174ed {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:41.219876 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a23a05de-792f-44e5-a65f-48fbf40def57 req-42e31bad-5aef-4e61-a236-804a3adedc75 service nova] Acquiring lock "7514b113-ec17-468b-a647-de099d90e787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:41.219876 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a23a05de-792f-44e5-a65f-48fbf40def57 req-42e31bad-5aef-4e61-a236-804a3adedc75 service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:41.219876 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a23a05de-792f-44e5-a65f-48fbf40def57 req-42e31bad-5aef-4e61-a236-804a3adedc75 service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:41.220033 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a23a05de-792f-44e5-a65f-48fbf40def57 req-42e31bad-5aef-4e61-a236-804a3adedc75 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] No event matching network-vif-plugged-d3b48415-3d34-4753-a72f-6f48536174ed in dict_keys([('network-vif-plugged', 'e08f0477-e673-4559-884f-1dcbc2a9fd0e')]) {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 09:58:41.220144 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-a23a05de-792f-44e5-a65f-48fbf40def57 req-42e31bad-5aef-4e61-a236-804a3adedc75 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received unexpected event network-vif-plugged-d3b48415-3d34-4753-a72f-6f48536174ed for instance with vm_state building and task_state spawning.
May 28 09:58:41.220289 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a23a05de-792f-44e5-a65f-48fbf40def57 req-42e31bad-5aef-4e61-a236-804a3adedc75 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-plugged-e08f0477-e673-4559-884f-1dcbc2a9fd0e {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:41.220422 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a23a05de-792f-44e5-a65f-48fbf40def57 req-42e31bad-5aef-4e61-a236-804a3adedc75 service nova] Acquiring lock "7514b113-ec17-468b-a647-de099d90e787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:41.220557 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a23a05de-792f-44e5-a65f-48fbf40def57 req-42e31bad-5aef-4e61-a236-804a3adedc75 service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:41.221087 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a23a05de-792f-44e5-a65f-48fbf40def57 req-42e31bad-5aef-4e61-a236-804a3adedc75 service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:41.221155 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a23a05de-792f-44e5-a65f-48fbf40def57 req-42e31bad-5aef-4e61-a236-804a3adedc75 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Processing event network-vif-plugged-e08f0477-e673-4559-884f-1dcbc2a9fd0e {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 09:58:41.221319 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a23a05de-792f-44e5-a65f-48fbf40def57 req-42e31bad-5aef-4e61-a236-804a3adedc75 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-plugged-e08f0477-e673-4559-884f-1dcbc2a9fd0e {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:41.221439 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a23a05de-792f-44e5-a65f-48fbf40def57 req-42e31bad-5aef-4e61-a236-804a3adedc75 service nova] Acquiring lock "7514b113-ec17-468b-a647-de099d90e787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:41.221571 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a23a05de-792f-44e5-a65f-48fbf40def57 req-42e31bad-5aef-4e61-a236-804a3adedc75 service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:41.221691 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a23a05de-792f-44e5-a65f-48fbf40def57 req-42e31bad-5aef-4e61-a236-804a3adedc75 service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:41.221833 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a23a05de-792f-44e5-a65f-48fbf40def57 req-42e31bad-5aef-4e61-a236-804a3adedc75 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] No waiting events found dispatching network-vif-plugged-e08f0477-e673-4559-884f-1dcbc2a9fd0e {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:58:41.221964 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-a23a05de-792f-44e5-a65f-48fbf40def57 req-42e31bad-5aef-4e61-a236-804a3adedc75 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received unexpected event network-vif-plugged-e08f0477-e673-4559-884f-1dcbc2a9fd0e for instance with vm_state building and task_state spawning.
May 28 09:58:41.222409 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Instance event wait completed in 2 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 09:58:41.225048 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962321.2246583, 7514b113-ec17-468b-a647-de099d90e787 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:58:41.225778 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 09:58:41.226156 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 7514b113-ec17-468b-a647-de099d90e787] VM Resumed (Lifecycle Event)
May 28 09:58:41.229499 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 7514b113-ec17-468b-a647-de099d90e787] Instance spawned successfully.
May 28 09:58:41.230064 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 09:58:41.255677 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-e137232e-ead4-4bbe-8e04-57d3c9f6a068 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '74620a0064844d8f922e02c653142fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a0adc32dd74f039cc231cceb9131a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 09:58:41.347698 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 09:58:41.409581 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Object Instance<57d353b6-133e-4354-a4f4-7bcec543d586> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 09:58:41.412130 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 09:58:41.413472 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-665492048', uuid='57d353b6-133e-4354-a4f4-7bcec543d586'), owner=OwnerMeta(userid='51981c995f2246588f2d58f35be5848a', username='tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member', projectid='a9d04b105229456d9ab53df1886fdb37', projectname='tempest-ServerBootFromVolumeStableRescueTest-283762505'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9d6ec393-b62a-4342-a355-3cf8291ec2fe", "address": "fa:16:3e:7a:26:b6", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "vif_mac": "fa:16:3e:7a:26:b6"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d6ec393-b6", "ovs_interfaceid": "9d6ec393-b62a-4342-a355-3cf8291ec2fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962321.41305) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 09:58:41.414342 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 09:58:41.414740 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 09:58:41.415508 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 09:58:41.415695 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 09:58:41.416864 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 09:58:41.417313 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 09:58:41.417512 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 09:58:41.417640 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 09:58:41.417817 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 09:58:41.417955 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 09:58:41.418099 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 09:58:41.418325 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 09:58:41.418453 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 09:58:41.418565 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 09:58:41.418663 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 09:58:41.418794 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 09:58:41.418987 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lazy-loading 'vcpu_model' on Instance uuid 57d353b6-133e-4354-a4f4-7bcec543d586 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:58:41.679125 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-e137232e-ead4-4bbe-8e04-57d3c9f6a068 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Successfully created port: 7759aa9a-fe3a-4902-88ae-2f679e5d2a68 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 09:58:41.729009 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 7514b113-ec17-468b-a647-de099d90e787] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:58:41.738687 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 7514b113-ec17-468b-a647-de099d90e787] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 09:58:41.742153 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:58:41.742380 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:58:41.743179 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:58:41.743878 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:58:41.744501 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:58:41.744914 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:58:41.921366 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Object Instance<57d353b6-133e-4354-a4f4-7bcec543d586> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 09:58:41.941885 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57d353b6-133e-4354-a4f4-7bcec543d586/disk.config --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:42.025122 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57d353b6-133e-4354-a4f4-7bcec543d586/disk.config --force-share --output=json" returned: 0 in 0.083s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:42.025823 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "/opt/stack/data/nova/instances/57d353b6-133e-4354-a4f4-7bcec543d586/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:42.026075 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "/opt/stack/data/nova/instances/57d353b6-133e-4354-a4f4-7bcec543d586/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:42.026992 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "/opt/stack/data/nova/instances/57d353b6-133e-4354-a4f4-7bcec543d586/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:42.027407 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 09:58:42.028029 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd1dfc5cc-6703-445f-9daa-05afb78f89f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 09:58:42.028224 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:58:42.241998 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 7514b113-ec17-468b-a647-de099d90e787] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 09:58:42.255609 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Took 30.71 seconds to spawn the instance on the hypervisor.
May 28 09:58:42.255834 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:58:42.264875 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-e137232e-ead4-4bbe-8e04-57d3c9f6a068 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Successfully updated port: 7759aa9a-fe3a-4902-88ae-2f679e5d2a68 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 09:58:42.365759 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Found WWN 3300000000e5813d1 for multipath device dm-6 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 09:58:42.366289 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:58:42.366524 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '3300000000e5813d1', 'path': '/dev/dm-6', 'multipath_id': '3300000000e5813d1'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 09:58:42.366671 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000e5813d1', 'path': '/dev/dm-6', 'multipath_id': '3300000000e5813d1'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 09:58:42.367362 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.662s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:58:42.369695 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b', 'iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '08d8c7ce-386e-488e-a0f2-c61fdb5a686b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 09:58:42.370462 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Lazy-loading 'flavor' on Instance uuid 92fbf243-1c5b-47f6-9317-3fb2655651db {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:58:42.382790 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:58:42.385555 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:58:42.385555 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:58:42.385555 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 09:58:42.386066 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:58:42.386327 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 09:58:42.398696 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 09:58:42.398696 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:42.404824 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 09:58:42.404824 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:42.412523 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b] added
May 28 09:58:42.412523 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 09:58:42.412523 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:58:42.412523 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:58:42.412523 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:58:42.412523 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:58:42.412523 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:42.412823 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 09:58:42.413082 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.028(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 09:58:42.413288 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 09:58:42.415024 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b] added
May 28 09:58:42.415024 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 09:58:42.415024 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:58:42.415024 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:58:42.415024 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:58:42.415024 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:58:42.415024 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:42.415291 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 09:58:42.415291 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.029(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 09:58:42.415779 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 09:58:42.499976 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 09:58:42.500177 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 09:58:42.767056 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e137232e-ead4-4bbe-8e04-57d3c9f6a068 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Acquiring lock "refresh_cache-e2856743-3a60-4be1-b29c-b4de06f14783" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:58:42.767211 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e137232e-ead4-4bbe-8e04-57d3c9f6a068 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Acquired lock "refresh_cache-e2856743-3a60-4be1-b29c-b4de06f14783" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:58:42.767337 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-e137232e-ead4-4bbe-8e04-57d3c9f6a068 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 09:58:42.768716 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Took 47.07 seconds to build instance.
May 28 09:58:42.874563 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] attach device xml: <disk type="block" device="disk">
May 28 09:58:42.874563 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 09:58:42.874563 np0000001613 nova-compute[98321]:   <alias name="ua-7c9b1127-3469-4dc1-96b7-9f736ca2309b"/>
May 28 09:58:42.874563 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-6"/>
May 28 09:58:42.874563 np0000001613 nova-compute[98321]:   <target dev="sdc" bus="scsi"/>
May 28 09:58:42.874563 np0000001613 nova-compute[98321]:   <serial>7c9b1127-3469-4dc1-96b7-9f736ca2309b</serial>
May 28 09:58:42.874563 np0000001613 nova-compute[98321]:   <address type="drive" controller="0" unit="2"/>
May 28 09:58:42.874563 np0000001613 nova-compute[98321]: </disk>
May 28 09:58:42.874563 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 09:58:43.002663 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 09:58:43.271534 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "7514b113-ec17-468b-a647-de099d90e787" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 48.586s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:43.276425 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-aa494239-ee80-4b07-a51f-19c437b69bf1 req-ead368d1-bd23-4f1c-9252-cf18c3cc37f6 service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Received event network-changed-7759aa9a-fe3a-4902-88ae-2f679e5d2a68 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:43.276425 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-aa494239-ee80-4b07-a51f-19c437b69bf1 req-ead368d1-bd23-4f1c-9252-cf18c3cc37f6 service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Refreshing instance network info cache due to event network-changed-7759aa9a-fe3a-4902-88ae-2f679e5d2a68. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 09:58:43.276425 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-aa494239-ee80-4b07-a51f-19c437b69bf1 req-ead368d1-bd23-4f1c-9252-cf18c3cc37f6 service nova] Acquiring lock "refresh_cache-e2856743-3a60-4be1-b29c-b4de06f14783" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:58:43.372553 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a42836e0-0f21-41ae-b5d9-e1ec66553b7a req-fdc7d0b2-1ad7-4b8f-a058-1d4ad1cbc16e service nova] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Received event network-changed-5169a8fe-f36b-4d06-8497-4407070563c7 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:43.372876 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a42836e0-0f21-41ae-b5d9-e1ec66553b7a req-fdc7d0b2-1ad7-4b8f-a058-1d4ad1cbc16e service nova] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Refreshing instance network info cache due to event network-changed-5169a8fe-f36b-4d06-8497-4407070563c7. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 09:58:43.373067 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a42836e0-0f21-41ae-b5d9-e1ec66553b7a req-fdc7d0b2-1ad7-4b8f-a058-1d4ad1cbc16e service nova] Acquiring lock "refresh_cache-0dca786c-46bb-48dc-a01a-e282daa84a89" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:58:43.374385 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a42836e0-0f21-41ae-b5d9-e1ec66553b7a req-fdc7d0b2-1ad7-4b8f-a058-1d4ad1cbc16e service nova] Acquired lock "refresh_cache-0dca786c-46bb-48dc-a01a-e282daa84a89" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:58:43.374385 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-a42836e0-0f21-41ae-b5d9-e1ec66553b7a req-fdc7d0b2-1ad7-4b8f-a058-1d4ad1cbc16e service nova] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Refreshing network info cache for port 5169a8fe-f36b-4d06-8497-4407070563c7 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 09:58:43.413770 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 09:58:43.417554 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.startup = manual
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.port = 0
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 09:58:43.433949 np0000001613 nova-compute[98321]: # END RECORD
May 28 09:58:43.433949 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.startup = manual
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.port = 0
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 09:58:43.440381 np0000001613 nova-compute[98321]: # END RECORD
May 28 09:58:43.440381 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:43.447852 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:43.454074 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:43.467954 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:43.467954 np0000001613 nova-compute[98321]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:43.467954 np0000001613 nova-compute[98321]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:43.467954 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:43.467954 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:43.467954 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:43.467954 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:43.467954 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:43.467954 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:43.467954 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:43.467954 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:58:43.468339 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:43.468339 np0000001613 nova-compute[98321]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:43.468339 np0000001613 nova-compute[98321]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:43.468339 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:43.468339 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:43.468339 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:43.468339 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:43.468339 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:43.468339 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:43.468339 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:43.468339 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:58:43.479564 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:43.479564 np0000001613 nova-compute[98321]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:43.479564 np0000001613 nova-compute[98321]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:43.479564 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:43.479564 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:43.479564 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:43.479564 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:43.479564 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:43.479564 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:43.479564 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:43.479564 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:58:43.479872 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:43.479872 np0000001613 nova-compute[98321]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:43.479872 np0000001613 nova-compute[98321]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:43.479872 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:43.479872 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:43.479872 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:43.479872 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:43.479872 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:43.479872 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:43.479872 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:43.479872 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:58:43.510471 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.732s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:43.510907 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 09:58:43.525799 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b, portal: 192.168.40.100,3260]
May 28 09:58:43.525799 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b, portal: 192.168.40.100,3260] successful.
May 28 09:58:43.525799 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:43.538756 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:43.543392 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b, portal: 192.168.50.100,3260]
May 28 09:58:43.543392 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b, portal: 192.168.50.100,3260] successful.
May 28 09:58:43.543392 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:43.558349 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:43.559245 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:43.559245 np0000001613 nova-compute[98321]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:43.559245 np0000001613 nova-compute[98321]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:43.559245 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:43.559245 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:43.559245 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:43.559245 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:43.559245 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:43.559245 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:43.559245 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:43.559245 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:43.559245 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:43.559245 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:58:43.559525 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:43.559525 np0000001613 nova-compute[98321]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:43.559525 np0000001613 nova-compute[98321]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:43.559525 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:43.559525 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:43.559525 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:43.559525 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:43.559525 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:43.559525 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:43.559525 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:43.559525 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:43.559525 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:43.559525 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:58:43.559835 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.175s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:58:43.559890 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 09:58:43.562362 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] HCTL ('17', '-', '-', 0) found on session 13 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 09:58:43.562362 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 09:58:43.578669 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:43.578669 np0000001613 nova-compute[98321]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:43.578669 np0000001613 nova-compute[98321]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:43.578669 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:43.578669 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:43.578669 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:43.578669 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:43.578669 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:43.578669 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:43.578669 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:43.578669 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:43.578669 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:43.578669 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:58:43.578669 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:43.578669 np0000001613 nova-compute[98321]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:43.578669 np0000001613 nova-compute[98321]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:43.578669 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:43.578669 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:43.578669 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:43.578669 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:43.578669 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:43.578669 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:43.578669 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:43.578669 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:43.578669 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:43.578669 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:58:43.578669 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.193s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:58:43.582407 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 09:58:43.582407 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Searching for a device in session 13 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 09:58:43.582407 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '08d8c7ce-386e-488e-a0f2-c61fdb5a686b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 09:58:43.582407 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] HCTL ('18', '-', '-', 0) found on session 14 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 09:58:43.582407 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 09:58:43.604016 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Searching for a device in session 14 and hctl ['18', '*', '*', 0] yield: None {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 09:58:43.606299 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-e137232e-ead4-4bbe-8e04-57d3c9f6a068 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:43.816510 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:43.881915 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-a42836e0-0f21-41ae-b5d9-e1ec66553b7a req-fdc7d0b2-1ad7-4b8f-a058-1d4ad1cbc16e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:44.020265 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-e137232e-ead4-4bbe-8e04-57d3c9f6a068 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:44.024019 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 09:58:44.025565 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 09:58:44.026113 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:44.026407 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:44.090382 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Acquiring lock "0dca786c-46bb-48dc-a01a-e282daa84a89" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:44.090748 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "0dca786c-46bb-48dc-a01a-e282daa84a89" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:44.115611 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '62efa57da85f458790f3ceeebcc777a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3a501b4f4041ef875ef4d2b4167044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 09:58:44.167717 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:44.220697 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-e137232e-ead4-4bbe-8e04-57d3c9f6a068 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Updating instance_info_cache with network_info: [{"id": "2fad8030-7c30-438c-8dcd-b9a8ba1849d1", "address": "fa:16:3e:9a:42:b3", "network": {"id": "48f4f13e-9b4c-4776-a2bd-47a4984571ae", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-337905894-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "25a0adc32dd74f039cc231cceb9131a0", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fad8030-7c", "ovs_interfaceid": "2fad8030-7c30-438c-8dcd-b9a8ba1849d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7759aa9a-fe3a-4902-88ae-2f679e5d2a68", "address": "fa:16:3e:c3:78:fb", "network": {"id": "ebbec6c6-b741-42fd-b1a3-9127b6da8c88", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1016727797", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "25a0adc32dd74f039cc231cceb9131a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7759aa9a-fe", "ovs_interfaceid": "7759aa9a-fe3a-4902-88ae-2f679e5d2a68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:58:44.300548 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-a42836e0-0f21-41ae-b5d9-e1ec66553b7a req-fdc7d0b2-1ad7-4b8f-a058-1d4ad1cbc16e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:44.455634 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-a42836e0-0f21-41ae-b5d9-e1ec66553b7a req-fdc7d0b2-1ad7-4b8f-a058-1d4ad1cbc16e service nova] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Updated VIF entry in instance network info cache for port 5169a8fe-f36b-4d06-8497-4407070563c7. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 09:58:44.456025 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-a42836e0-0f21-41ae-b5d9-e1ec66553b7a req-fdc7d0b2-1ad7-4b8f-a058-1d4ad1cbc16e service nova] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Updating instance_info_cache with network_info: [{"id": "5169a8fe-f36b-4d06-8497-4407070563c7", "address": "fa:16:3e:14:ef:87", "network": {"id": "d4fe3269-1c90-4590-b389-2d9e64a1874b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-397043690-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4466c6404538446eb4c8bd45bb2a95f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5169a8fe-f3", "ovs_interfaceid": "5169a8fe-f36b-4d06-8497-4407070563c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:58:44.526550 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 09:58:44.589118 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] No BDM found with device name sda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:58:44.589279 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] No BDM found with device name sdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:58:44.589316 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] No BDM found with device name sdc, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:58:44.589408 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] No VIF found with MAC fa:16:3e:fb:01:60, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 09:58:44.594846 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lazy-loading 'flavor' on Instance uuid 0dca786c-46bb-48dc-a01a-e282daa84a89 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:58:44.600084 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Searching for a device in session 14 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 09:58:44.600367 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '08d8c7ce-386e-488e-a0f2-c61fdb5a686b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 09:58:44.679527 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Successfully created port: fec718e7-b773-4907-abf5-60f374bd420a {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 09:58:44.723499 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e137232e-ead4-4bbe-8e04-57d3c9f6a068 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Releasing lock "refresh_cache-e2856743-3a60-4be1-b29c-b4de06f14783" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:58:44.725755 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-e137232e-ead4-4bbe-8e04-57d3c9f6a068 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:57:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-501736735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-501736735',id=4,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPS8xG4KsWj7jd6eI8Ha8DW2V89ViHDMSJ32qPM+zEUw0jbx/lKgP6h0tE0l56+jki8nKEwFAor6rHbbQIYZjf8FhqUVxl6GRIyxLYKd7whepyq3n5RjNWjJHm94fY8qvQ==',key_name='tempest-keypair-1033085564',keypairs=<?>,launch_index=0,launched_at=2026-05-28T09:57:59Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='25a0adc32dd74f039cc231cceb9131a0',ramdisk_id='',reservation_id='r-0bm2bepy',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-936828907',owner_user_name='tempest-TaggedAttachmentsTest-936828907-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T09:58:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74620a0064844d8f922e02c653142fd6',uuid=e2856743-3a60-4be1-b29c-b4de06f14783,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7759aa9a-fe3a-4902-88ae-2f679e5d2a68", "address": "fa:16:3e:c3:78:fb", "network": {"id": "ebbec6c6-b741-42fd-b1a3-9127b6da8c88", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1016727797", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "25a0adc32dd74f039cc231cceb9131a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7759aa9a-fe", "ovs_interfaceid": "7759aa9a-fe3a-4902-88ae-2f679e5d2a68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 09:58:44.725957 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-e137232e-ead4-4bbe-8e04-57d3c9f6a068 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Converting VIF {"id": "7759aa9a-fe3a-4902-88ae-2f679e5d2a68", "address": "fa:16:3e:c3:78:fb", "network": {"id": "ebbec6c6-b741-42fd-b1a3-9127b6da8c88", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1016727797", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "25a0adc32dd74f039cc231cceb9131a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7759aa9a-fe", "ovs_interfaceid": "7759aa9a-fe3a-4902-88ae-2f679e5d2a68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:58:44.727228 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-e137232e-ead4-4bbe-8e04-57d3c9f6a068 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:78:fb,bridge_name='br-int',has_traffic_filtering=True,id=7759aa9a-fe3a-4902-88ae-2f679e5d2a68,network=Network(ebbec6c6-b741-42fd-b1a3-9127b6da8c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7759aa9a-fe') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:58:44.727306 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-aa494239-ee80-4b07-a51f-19c437b69bf1 req-ead368d1-bd23-4f1c-9252-cf18c3cc37f6 service nova] Acquired lock "refresh_cache-e2856743-3a60-4be1-b29c-b4de06f14783" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:58:44.727525 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-e137232e-ead4-4bbe-8e04-57d3c9f6a068 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:78:fb,bridge_name='br-int',has_traffic_filtering=True,id=7759aa9a-fe3a-4902-88ae-2f679e5d2a68,network=Network(ebbec6c6-b741-42fd-b1a3-9127b6da8c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7759aa9a-fe') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 09:58:44.727860 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-aa494239-ee80-4b07-a51f-19c437b69bf1 req-ead368d1-bd23-4f1c-9252-cf18c3cc37f6 service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Refreshing network info cache for port 7759aa9a-fe3a-4902-88ae-2f679e5d2a68 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 09:58:44.729318 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:44.729318 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:44.729318 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 09:58:44.733546 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:44.734669 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd8f5d9c2-6416-5483-9f4f-145a81ee8c48', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:44.736249 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:44.736249 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:58:44.741842 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:44.749328 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:44.749328 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7759aa9a-fe, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:44.749328 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7759aa9a-fe, col_values=(('qos', UUID('86938b55-1198-4e13-94e7-01f533e9c1e7')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:44.749328 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7759aa9a-fe, col_values=(('external_ids', {'iface-id': '7759aa9a-fe3a-4902-88ae-2f679e5d2a68', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:78:fb', 'vm-uuid': 'e2856743-3a60-4be1-b29c-b4de06f14783'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:44.749770 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:44.751411 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:58:44.761325 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:44.761663 np0000001613 nova-compute[98321]: INFO os_vif [None req-e137232e-ead4-4bbe-8e04-57d3c9f6a068 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:78:fb,bridge_name='br-int',has_traffic_filtering=True,id=7759aa9a-fe3a-4902-88ae-2f679e5d2a68,network=Network(ebbec6c6-b741-42fd-b1a3-9127b6da8c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7759aa9a-fe')
May 28 09:58:44.762407 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-e137232e-ead4-4bbe-8e04-57d3c9f6a068 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:57:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-501736735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-501736735',id=4,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPS8xG4KsWj7jd6eI8Ha8DW2V89ViHDMSJ32qPM+zEUw0jbx/lKgP6h0tE0l56+jki8nKEwFAor6rHbbQIYZjf8FhqUVxl6GRIyxLYKd7whepyq3n5RjNWjJHm94fY8qvQ==',key_name='tempest-keypair-1033085564',keypairs=<?>,launch_index=0,launched_at=2026-05-28T09:57:59Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='25a0adc32dd74f039cc231cceb9131a0',ramdisk_id='',reservation_id='r-0bm2bepy',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-936828907',owner_user_name='tempest-TaggedAttachmentsTest-936828907-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T09:58:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74620a0064844d8f922e02c653142fd6',uuid=e2856743-3a60-4be1-b29c-b4de06f14783,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7759aa9a-fe3a-4902-88ae-2f679e5d2a68", "address": "fa:16:3e:c3:78:fb", "network": {"id": "ebbec6c6-b741-42fd-b1a3-9127b6da8c88", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1016727797", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "25a0adc32dd74f039cc231cceb9131a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7759aa9a-fe", "ovs_interfaceid": "7759aa9a-fe3a-4902-88ae-2f679e5d2a68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 09:58:44.762588 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-e137232e-ead4-4bbe-8e04-57d3c9f6a068 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Converting VIF {"id": "7759aa9a-fe3a-4902-88ae-2f679e5d2a68", "address": "fa:16:3e:c3:78:fb", "network": {"id": "ebbec6c6-b741-42fd-b1a3-9127b6da8c88", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1016727797", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "25a0adc32dd74f039cc231cceb9131a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7759aa9a-fe", "ovs_interfaceid": "7759aa9a-fe3a-4902-88ae-2f679e5d2a68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:58:44.763124 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-e137232e-ead4-4bbe-8e04-57d3c9f6a068 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:78:fb,bridge_name='br-int',has_traffic_filtering=True,id=7759aa9a-fe3a-4902-88ae-2f679e5d2a68,network=Network(ebbec6c6-b741-42fd-b1a3-9127b6da8c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7759aa9a-fe') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:58:44.764269 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-e137232e-ead4-4bbe-8e04-57d3c9f6a068 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] attach device xml: <interface type="ethernet">
May 28 09:58:44.764269 np0000001613 nova-compute[98321]:   <mac address="fa:16:3e:c3:78:fb"/>
May 28 09:58:44.764269 np0000001613 nova-compute[98321]:   <model type="virtio"/>
May 28 09:58:44.764269 np0000001613 nova-compute[98321]:   <driver name="qemu"/>
May 28 09:58:44.764269 np0000001613 nova-compute[98321]:   <mtu size="1372"/>
May 28 09:58:44.764269 np0000001613 nova-compute[98321]:   <target dev="tap7759aa9a-fe"/>
May 28 09:58:44.764269 np0000001613 nova-compute[98321]: </interface>
May 28 09:58:44.764269 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 09:58:44.780118 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:44.849408 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:44.852321 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:44.908435 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:44.957951 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a42836e0-0f21-41ae-b5d9-e1ec66553b7a req-fdc7d0b2-1ad7-4b8f-a058-1d4ad1cbc16e service nova] Releasing lock "refresh_cache-0dca786c-46bb-48dc-a01a-e282daa84a89" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:58:45.036732 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 09:58:45.150011 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:45.157879 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:45.164372 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:45.186786 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:45.196291 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:45.234810 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-aa494239-ee80-4b07-a51f-19c437b69bf1 req-ead368d1-bd23-4f1c-9252-cf18c3cc37f6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:45.340108 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Successfully updated port: fec718e7-b773-4907-abf5-60f374bd420a {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 09:58:45.358680 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cf58c4dc-b10f-4592-b5ca-46751bbeb919 req-a23bce06-fdfb-42c2-9ac6-df1bb7731cca service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Received event network-vif-plugged-7759aa9a-fe3a-4902-88ae-2f679e5d2a68 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:45.359140 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cf58c4dc-b10f-4592-b5ca-46751bbeb919 req-a23bce06-fdfb-42c2-9ac6-df1bb7731cca service nova] Acquiring lock "e2856743-3a60-4be1-b29c-b4de06f14783-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:45.359618 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cf58c4dc-b10f-4592-b5ca-46751bbeb919 req-a23bce06-fdfb-42c2-9ac6-df1bb7731cca service nova] Lock "e2856743-3a60-4be1-b29c-b4de06f14783-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:45.359900 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cf58c4dc-b10f-4592-b5ca-46751bbeb919 req-a23bce06-fdfb-42c2-9ac6-df1bb7731cca service nova] Lock "e2856743-3a60-4be1-b29c-b4de06f14783-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:45.360101 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cf58c4dc-b10f-4592-b5ca-46751bbeb919 req-a23bce06-fdfb-42c2-9ac6-df1bb7731cca service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] No waiting events found dispatching network-vif-plugged-7759aa9a-fe3a-4902-88ae-2f679e5d2a68 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:58:45.360439 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-cf58c4dc-b10f-4592-b5ca-46751bbeb919 req-a23bce06-fdfb-42c2-9ac6-df1bb7731cca service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Received unexpected event network-vif-plugged-7759aa9a-fe3a-4902-88ae-2f679e5d2a68 for instance with vm_state active and task_state None.
May 28 09:58:45.361402 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cf58c4dc-b10f-4592-b5ca-46751bbeb919 req-a23bce06-fdfb-42c2-9ac6-df1bb7731cca service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Received event network-vif-plugged-7759aa9a-fe3a-4902-88ae-2f679e5d2a68 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:45.361402 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cf58c4dc-b10f-4592-b5ca-46751bbeb919 req-a23bce06-fdfb-42c2-9ac6-df1bb7731cca service nova] Acquiring lock "e2856743-3a60-4be1-b29c-b4de06f14783-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:45.361402 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cf58c4dc-b10f-4592-b5ca-46751bbeb919 req-a23bce06-fdfb-42c2-9ac6-df1bb7731cca service nova] Lock "e2856743-3a60-4be1-b29c-b4de06f14783-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:45.361402 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cf58c4dc-b10f-4592-b5ca-46751bbeb919 req-a23bce06-fdfb-42c2-9ac6-df1bb7731cca service nova] Lock "e2856743-3a60-4be1-b29c-b4de06f14783-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:45.361402 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cf58c4dc-b10f-4592-b5ca-46751bbeb919 req-a23bce06-fdfb-42c2-9ac6-df1bb7731cca service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] No waiting events found dispatching network-vif-plugged-7759aa9a-fe3a-4902-88ae-2f679e5d2a68 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:58:45.361402 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-cf58c4dc-b10f-4592-b5ca-46751bbeb919 req-a23bce06-fdfb-42c2-9ac6-df1bb7731cca service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Received unexpected event network-vif-plugged-7759aa9a-fe3a-4902-88ae-2f679e5d2a68 for instance with vm_state active and task_state None.
May 28 09:58:45.407279 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Found WWN 3300000006f9c6bd4 for multipath device dm-7 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 09:58:45.407883 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:58:45.408067 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] <== connect_volume: return (5703ms) {'type': 'block', 'scsi_wwn': '3300000006f9c6bd4', 'path': '/dev/dm-7', 'multipath_id': '3300000006f9c6bd4'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 09:58:45.408235 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006f9c6bd4', 'path': '/dev/dm-7', 'multipath_id': '3300000006f9c6bd4'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 09:58:45.408969 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 5.292s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:58:45.408969 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4', 'iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'efda049f-2154-4df6-8c7b-026a19b94dd4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 09:58:45.413382 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lazy-loading 'flavor' on Instance uuid 53ad56cc-eb5b-4e2e-a421-e93deee27fe7 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:58:45.422921 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:58:45.423432 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:58:45.424070 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:58:45.424275 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 09:58:45.425001 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:58:45.425338 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 09:58:45.439258 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 09:58:45.439258 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:45.444070 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 09:58:45.444070 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:45.448933 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8099b406-0df6-497a-a2b7-4ff91d1ac736 req-44189457-f31d-4998-a1d0-3dc18f1b8df4 service nova] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Received event network-changed-f6d7e225-75f0-45c5-a7b7-7ff36e772079 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:45.449083 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8099b406-0df6-497a-a2b7-4ff91d1ac736 req-44189457-f31d-4998-a1d0-3dc18f1b8df4 service nova] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Refreshing instance network info cache due to event network-changed-f6d7e225-75f0-45c5-a7b7-7ff36e772079. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 09:58:45.449514 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8099b406-0df6-497a-a2b7-4ff91d1ac736 req-44189457-f31d-4998-a1d0-3dc18f1b8df4 service nova] Acquiring lock "refresh_cache-4a28d569-1ca9-4657-840c-7bb31d4644c8" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:58:45.449514 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8099b406-0df6-497a-a2b7-4ff91d1ac736 req-44189457-f31d-4998-a1d0-3dc18f1b8df4 service nova] Acquired lock "refresh_cache-4a28d569-1ca9-4657-840c-7bb31d4644c8" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:58:45.449514 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-8099b406-0df6-497a-a2b7-4ff91d1ac736 req-44189457-f31d-4998-a1d0-3dc18f1b8df4 service nova] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Refreshing network info cache for port f6d7e225-75f0-45c5-a7b7-7ff36e772079 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 09:58:45.454578 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4] added
May 28 09:58:45.454578 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 09:58:45.454578 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:58:45.454578 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:58:45.454578 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:58:45.454578 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:58:45.454578 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:45.454862 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 09:58:45.455521 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.031(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 09:58:45.457356 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 09:58:45.458210 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4] added
May 28 09:58:45.458210 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 09:58:45.458210 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:58:45.458210 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:58:45.458210 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:58:45.458210 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:58:45.458210 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:45.458408 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 09:58:45.458643 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0333(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 09:58:45.458861 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 09:58:45.602453 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "0dca786c-46bb-48dc-a01a-e282daa84a89" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:45.618030 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-aa494239-ee80-4b07-a51f-19c437b69bf1 req-ead368d1-bd23-4f1c-9252-cf18c3cc37f6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:45.744534 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-aa494239-ee80-4b07-a51f-19c437b69bf1 req-ead368d1-bd23-4f1c-9252-cf18c3cc37f6 service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Updated VIF entry in instance network info cache for port 7759aa9a-fe3a-4902-88ae-2f679e5d2a68. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 09:58:45.744888 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-aa494239-ee80-4b07-a51f-19c437b69bf1 req-ead368d1-bd23-4f1c-9252-cf18c3cc37f6 service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Updating instance_info_cache with network_info: [{"id": "2fad8030-7c30-438c-8dcd-b9a8ba1849d1", "address": "fa:16:3e:9a:42:b3", "network": {"id": "48f4f13e-9b4c-4776-a2bd-47a4984571ae", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-337905894-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "25a0adc32dd74f039cc231cceb9131a0", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fad8030-7c", "ovs_interfaceid": "2fad8030-7c30-438c-8dcd-b9a8ba1849d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7759aa9a-fe3a-4902-88ae-2f679e5d2a68", "address": "fa:16:3e:c3:78:fb", "network": {"id": "ebbec6c6-b741-42fd-b1a3-9127b6da8c88", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1016727797", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "25a0adc32dd74f039cc231cceb9131a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7759aa9a-fe", "ovs_interfaceid": "7759aa9a-fe3a-4902-88ae-2f679e5d2a68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:58:45.843297 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "refresh_cache-c9416092-d229-4f59-aaf3-3b0b692e7924" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:58:45.843297 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquired lock "refresh_cache-c9416092-d229-4f59-aaf3-3b0b692e7924" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:58:45.843297 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 09:58:45.917285 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Attempting to attach volume 08d8c7ce-386e-488e-a0f2-c61fdb5a686b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 09:58:45.919598 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] attach device xml: <disk type="block" device="disk">
May 28 09:58:45.919598 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 09:58:45.919598 np0000001613 nova-compute[98321]:   <alias name="ua-08d8c7ce-386e-488e-a0f2-c61fdb5a686b"/>
May 28 09:58:45.919598 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-7"/>
May 28 09:58:45.919598 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 09:58:45.919598 np0000001613 nova-compute[98321]:   <serial>08d8c7ce-386e-488e-a0f2-c61fdb5a686b</serial>
May 28 09:58:45.919598 np0000001613 nova-compute[98321]: </disk>
May 28 09:58:45.919598 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 09:58:45.955575 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-8099b406-0df6-497a-a2b7-4ff91d1ac736 req-44189457-f31d-4998-a1d0-3dc18f1b8df4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:46.044837 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 09:58:46.046141 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 09:58:46.047183 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Creating image(s)
May 28 09:58:46.048079 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "/opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:46.048313 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "/opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:46.048884 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "/opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:46.052726 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:58:46.058086 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:58:46.059307 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:46.142293 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.083s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:46.142730 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:46.143286 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:46.143877 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:58:46.156073 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:58:46.157389 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:46.158289 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9d2ab5c4-ef6c-4ca9-ab15-76947b0c166f tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Lock "92fbf243-1c5b-47f6-9317-3fb2655651db" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.516s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:46.245440 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.088s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:46.246427 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:46.258363 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-aa494239-ee80-4b07-a51f-19c437b69bf1 req-ead368d1-bd23-4f1c-9252-cf18c3cc37f6 service nova] Releasing lock "refresh_cache-e2856743-3a60-4be1-b29c-b4de06f14783" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:58:46.288369 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924/disk 1073741824" returned: 0 in 0.042s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:46.288970 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.146s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:46.289293 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:46.368628 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.079s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:46.369090 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 09:58:46.369383 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:46.425063 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e137232e-ead4-4bbe-8e04-57d3c9f6a068 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:58:46.425429 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e137232e-ead4-4bbe-8e04-57d3c9f6a068 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:58:46.425515 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e137232e-ead4-4bbe-8e04-57d3c9f6a068 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] No VIF found with MAC fa:16:3e:9a:42:b3, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 09:58:46.435071 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-8099b406-0df6-497a-a2b7-4ff91d1ac736 req-44189457-f31d-4998-a1d0-3dc18f1b8df4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:46.446058 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 09:58:46.459071 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 09:58:46.459553 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 09:58:46.474629 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:46.475114 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Cannot resize image /opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 09:58:46.479301 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 09:58:46.479559 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Ensure instance console log exists: /opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.startup = manual
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.port = 0
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 09:58:46.479737 np0000001613 nova-compute[98321]: # END RECORD
May 28 09:58:46.479737 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:46.482365 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:46.482365 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:46.482365 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.startup = manual
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.port = 0
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 09:58:46.487849 np0000001613 nova-compute[98321]: # END RECORD
May 28 09:58:46.487849 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:46.504982 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:46.504982 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:46.534027 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:58:46.595497 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4, portal: 192.168.40.100,3260]
May 28 09:58:46.595497 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4, portal: 192.168.40.100,3260] successful.
May 28 09:58:46.595497 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:46.602216 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4, portal: 192.168.50.100,3260]
May 28 09:58:46.602216 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4, portal: 192.168.50.100,3260] successful.
May 28 09:58:46.602216 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:46.610126 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:46.617405 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:46.639531 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:46.639531 np0000001613 nova-compute[98321]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:46.639531 np0000001613 nova-compute[98321]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:46.639531 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:46.639531 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:46.639531 np0000001613 nova-compute[98321]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:46.639531 np0000001613 nova-compute[98321]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:46.639531 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:46.639531 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:46.639531 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:46.639531 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:46.639531 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:46.639531 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:46.639531 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:46.639531 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:58:46.639888 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:46.639888 np0000001613 nova-compute[98321]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:46.639888 np0000001613 nova-compute[98321]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:46.639888 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:46.639888 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:46.639888 np0000001613 nova-compute[98321]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:46.639888 np0000001613 nova-compute[98321]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:46.639888 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:46.639888 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:46.639888 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:46.639888 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:46.639888 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:46.639888 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:46.639888 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:46.639888 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:58:46.640294 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.216s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:58:46.642773 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-8099b406-0df6-497a-a2b7-4ff91d1ac736 req-44189457-f31d-4998-a1d0-3dc18f1b8df4 service nova] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Updated VIF entry in instance network info cache for port f6d7e225-75f0-45c5-a7b7-7ff36e772079. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 09:58:46.643111 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:46.643111 np0000001613 nova-compute[98321]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:46.643111 np0000001613 nova-compute[98321]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:46.643111 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:46.643111 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:46.643111 np0000001613 nova-compute[98321]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:46.643111 np0000001613 nova-compute[98321]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:46.643111 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:46.643111 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:46.643111 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:46.643111 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:46.643111 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:46.643111 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:46.643111 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:46.643111 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:58:46.643367 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 09:58:46.644738 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] HCTL ('19', '-', '-', 0) found on session 15 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 09:58:46.644927 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Scanning host 19 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 09:58:46.645363 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-8099b406-0df6-497a-a2b7-4ff91d1ac736 req-44189457-f31d-4998-a1d0-3dc18f1b8df4 service nova] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Updating instance_info_cache with network_info: [{"id": "f6d7e225-75f0-45c5-a7b7-7ff36e772079", "address": "fa:16:3e:9c:2e:17", "network": {"id": "d4fe3269-1c90-4590-b389-2d9e64a1874b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-397043690-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4466c6404538446eb4c8bd45bb2a95f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6d7e225-75", "ovs_interfaceid": "f6d7e225-75f0-45c5-a7b7-7ff36e772079", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:58:46.646567 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:46.646567 np0000001613 nova-compute[98321]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:46.646567 np0000001613 nova-compute[98321]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:46.646567 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:46.646567 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:46.646567 np0000001613 nova-compute[98321]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:46.646567 np0000001613 nova-compute[98321]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:46.646567 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:46.646567 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:46.646567 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:46.646567 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:46.646567 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:46.646567 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:46.646567 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:46.646567 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:58:46.646927 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.222s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:58:46.647060 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 09:58:46.649761 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] HCTL ('20', '-', '-', 0) found on session 16 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 09:58:46.649761 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Scanning host 20 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 09:58:46.664524 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Searching for a device in session 16 and hctl ['20', '*', '*', 0] yield: sdn {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 09:58:46.664746 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'efda049f-2154-4df6-8c7b-026a19b94dd4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 09:58:46.673436 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Searching for a device in session 15 and hctl ['19', '*', '*', 0] yield: sdo {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 09:58:46.673890 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'efda049f-2154-4df6-8c7b-026a19b94dd4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 09:58:46.690969 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Acquiring lock "0dca786c-46bb-48dc-a01a-e282daa84a89" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:46.691085 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "0dca786c-46bb-48dc-a01a-e282daa84a89" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:46.691411 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Attaching volume 07c39f6e-3598-45d7-bec8-99175bbf3453 to /dev/vdb
May 28 09:58:46.696917 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:46.759456 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 09:58:46.773836 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 09:58:46.782549 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Acquiring lock "92fbf243-1c5b-47f6-9317-3fb2655651db" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:46.782832 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Lock "92fbf243-1c5b-47f6-9317-3fb2655651db" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:46.798391 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:46.826435 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 09:58:46.827401 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 09:58:46.839322 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 09:58:46.844201 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe95:8bd3', 'fe80::fc16:3eff:fe2d:94a4', 'fe80::fc16:3eff:fe31:5106', 'fe80::fc96:34ff:fe12:e4df', 'fe80::2844:59ff:feec:5d21', 'fe80::44e2:31ff:fe81:8771', 'fe80::fc16:3eff:fe9a:42b3', 'fe80::b04e:afff:fe71:41fc', 'fe80::fc16:3eff:fefb:160', 'fe80::5c68:7cff:fe27:e759', 'fe80::fc16:3eff:fe2a:719a', 'fe80::9038:13ff:fe5b:5aad', 'fe80::fc16:3eff:fe9c:2e17', 'fe80::8064:4aff:fe56:ba53', 'fe80::fc16:3eff:fe14:ef87', 'fe80::fc16:3eff:fe0c:a971', 'fe80::ac03:e9ff:fe37:b50a', 'fe80::fc16:3eff:fee8:4800', 'fe80::fc16:3eff:fe55:f221', 'fe80::fc16:3eff:fe31:6dc0', 'fe80::fc16:3eff:fe48:5cc5', 'fe80::fc16:3eff:fe07:9b94', 'fe80::3061:30ff:fee7:aa25', 'fe80::fc16:3eff:fe38:ca1f', 'fe80::888d:9dff:fe20:5f03', 'fe80::fc16:3eff:fec3:78fb', 'fe80::3428:4dff:fe09:805a'] 
May 28 09:58:46.844384 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 09:58:46.844474 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 09:58:46.844660 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 09:58:46.844927 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Updating existing volume attachment record: 646b4761-1814-4c7f-ba3c-5620501f5d36 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 09:58:46.885489 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Updating instance_info_cache with network_info: [{"id": "fec718e7-b773-4907-abf5-60f374bd420a", "address": "fa:16:3e:ae:54:17", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec718e7-b7", "ovs_interfaceid": "fec718e7-b773-4907-abf5-60f374bd420a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:58:46.935190 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-e137232e-ead4-4bbe-8e04-57d3c9f6a068 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-501736735', uuid='e2856743-3a60-4be1-b29c-b4de06f14783'), owner=OwnerMeta(userid='74620a0064844d8f922e02c653142fd6', username='tempest-TaggedAttachmentsTest-936828907-project-member', projectid='25a0adc32dd74f039cc231cceb9131a0', projectname='tempest-TaggedAttachmentsTest-936828907'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2fad8030-7c30-438c-8dcd-b9a8ba1849d1", "address": "fa:16:3e:9a:42:b3", "network": {"id": "48f4f13e-9b4c-4776-a2bd-47a4984571ae", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-337905894-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "25a0adc32dd74f039cc231cceb9131a0", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fad8030-7c", "ovs_interfaceid": "2fad8030-7c30-438c-8dcd-b9a8ba1849d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7759aa9a-fe3a-4902-88ae-2f679e5d2a68", "address": "fa:16:3e:c3:78:fb", "network": {"id": "ebbec6c6-b741-42fd-b1a3-9127b6da8c88", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1016727797", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "25a0adc32dd74f039cc231cceb9131a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7759aa9a-fe", "ovs_interfaceid": "7759aa9a-fe3a-4902-88ae-2f679e5d2a68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962326.9345272) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 09:58:46.936104 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-e137232e-ead4-4bbe-8e04-57d3c9f6a068 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 09:58:46.936104 np0000001613 nova-compute[98321]:   <nova:package version="33.1.0"/>
May 28 09:58:46.936104 np0000001613 nova-compute[98321]:   <nova:name>tempest-device-tagging-server-501736735</nova:name>
May 28 09:58:46.936104 np0000001613 nova-compute[98321]:   <nova:creationTime>2026-05-28 09:58:46</nova:creationTime>
May 28 09:58:46.936104 np0000001613 nova-compute[98321]:   <nova:flavor name="m1.nano" id="42">
May 28 09:58:46.936104 np0000001613 nova-compute[98321]:     <nova:memory>192</nova:memory>
May 28 09:58:46.936104 np0000001613 nova-compute[98321]:     <nova:disk>1</nova:disk>
May 28 09:58:46.936104 np0000001613 nova-compute[98321]:     <nova:swap>0</nova:swap>
May 28 09:58:46.936104 np0000001613 nova-compute[98321]:     <nova:ephemeral>0</nova:ephemeral>
May 28 09:58:46.936104 np0000001613 nova-compute[98321]:     <nova:vcpus>1</nova:vcpus>
May 28 09:58:46.936104 np0000001613 nova-compute[98321]:     <nova:extraSpecs>
May 28 09:58:46.936104 np0000001613 nova-compute[98321]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 09:58:46.936104 np0000001613 nova-compute[98321]:     </nova:extraSpecs>
May 28 09:58:46.936104 np0000001613 nova-compute[98321]:   </nova:flavor>
May 28 09:58:46.936104 np0000001613 nova-compute[98321]:   <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 09:58:46.936104 np0000001613 nova-compute[98321]:     <nova:containerFormat>bare</nova:containerFormat>
May 28 09:58:46.936104 np0000001613 nova-compute[98321]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 28 09:58:46.936104 np0000001613 nova-compute[98321]:     <nova:minDisk>1</nova:minDisk>
May 28 09:58:46.936104 np0000001613 nova-compute[98321]:     <nova:minRam>0</nova:minRam>
May 28 09:58:46.936104 np0000001613 nova-compute[98321]:     <nova:properties>
May 28 09:58:46.936104 np0000001613 nova-compute[98321]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 09:58:46.936104 np0000001613 nova-compute[98321]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 09:58:46.936104 np0000001613 nova-compute[98321]:       <nova:property name="hw_machine_type">pc</nova:property>
May 28 09:58:46.936104 np0000001613 nova-compute[98321]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 28 09:58:46.936104 np0000001613 nova-compute[98321]:       <nova:property name="hw_video_model">virtio</nova:property>
May 28 09:58:46.936104 np0000001613 nova-compute[98321]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 28 09:58:46.936104 np0000001613 nova-compute[98321]:     </nova:properties>
May 28 09:58:46.936104 np0000001613 nova-compute[98321]:   </nova:image>
May 28 09:58:46.936104 np0000001613 nova-compute[98321]:   <nova:owner>
May 28 09:58:46.936104 np0000001613 nova-compute[98321]:     <nova:user uuid="74620a0064844d8f922e02c653142fd6">tempest-TaggedAttachmentsTest-936828907-project-member</nova:user>
May 28 09:58:46.936104 np0000001613 nova-compute[98321]:     <nova:project uuid="25a0adc32dd74f039cc231cceb9131a0">tempest-TaggedAttachmentsTest-936828907</nova:project>
May 28 09:58:46.936104 np0000001613 nova-compute[98321]:   </nova:owner>
May 28 09:58:46.936104 np0000001613 nova-compute[98321]:   <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 09:58:46.936104 np0000001613 nova-compute[98321]:   <nova:ports>
May 28 09:58:46.936104 np0000001613 nova-compute[98321]:     <nova:port uuid="2fad8030-7c30-438c-8dcd-b9a8ba1849d1">
May 28 09:58:46.936104 np0000001613 nova-compute[98321]:       <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 09:58:46.936104 np0000001613 nova-compute[98321]:     </nova:port>
May 28 09:58:46.936104 np0000001613 nova-compute[98321]:     <nova:port uuid="7759aa9a-fe3a-4902-88ae-2f679e5d2a68">
May 28 09:58:46.936104 np0000001613 nova-compute[98321]:       <nova:ip type="fixed" address="10.10.10.99" ipVersion="4"/>
May 28 09:58:46.936104 np0000001613 nova-compute[98321]:     </nova:port>
May 28 09:58:46.936104 np0000001613 nova-compute[98321]:   </nova:ports>
May 28 09:58:46.936104 np0000001613 nova-compute[98321]: </nova:instance>
May 28 09:58:46.936104 np0000001613 nova-compute[98321]:  {{(pid=98321) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 28 09:58:47.147997 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8099b406-0df6-497a-a2b7-4ff91d1ac736 req-44189457-f31d-4998-a1d0-3dc18f1b8df4 service nova] Releasing lock "refresh_cache-4a28d569-1ca9-4657-840c-7bb31d4644c8" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:58:47.148556 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8099b406-0df6-497a-a2b7-4ff91d1ac736 req-44189457-f31d-4998-a1d0-3dc18f1b8df4 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-changed-6a88c703-7b82-44ce-b5f5-a98718ae6833 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:47.148556 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8099b406-0df6-497a-a2b7-4ff91d1ac736 req-44189457-f31d-4998-a1d0-3dc18f1b8df4 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Refreshing instance network info cache due to event network-changed-6a88c703-7b82-44ce-b5f5-a98718ae6833. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 09:58:47.148556 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8099b406-0df6-497a-a2b7-4ff91d1ac736 req-44189457-f31d-4998-a1d0-3dc18f1b8df4 service nova] Acquiring lock "refresh_cache-7514b113-ec17-468b-a647-de099d90e787" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:58:47.148714 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8099b406-0df6-497a-a2b7-4ff91d1ac736 req-44189457-f31d-4998-a1d0-3dc18f1b8df4 service nova] Acquired lock "refresh_cache-7514b113-ec17-468b-a647-de099d90e787" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:58:47.148714 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-8099b406-0df6-497a-a2b7-4ff91d1ac736 req-44189457-f31d-4998-a1d0-3dc18f1b8df4 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Refreshing network info cache for port 6a88c703-7b82-44ce-b5f5-a98718ae6833 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 09:58:47.285572 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Detaching volume 7c9b1127-3469-4dc1-96b7-9f736ca2309b
May 28 09:58:47.347858 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Attempting to driver detach volume 7c9b1127-3469-4dc1-96b7-9f736ca2309b from mountpoint /dev/sdc
May 28 09:58:47.350942 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Found disk sdc by alias ua-7c9b1127-3469-4dc1-96b7-9f736ca2309b {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 09:58:47.352016 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Found disk sdc by alias ua-7c9b1127-3469-4dc1-96b7-9f736ca2309b {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 09:58:47.352106 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Attempting to detach device sdc from instance 92fbf243-1c5b-47f6-9317-3fb2655651db from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 09:58:47.354290 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] detach device xml: <disk type="block" device="disk">
May 28 09:58:47.354290 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 09:58:47.354290 np0000001613 nova-compute[98321]:   <alias name="ua-7c9b1127-3469-4dc1-96b7-9f736ca2309b"/>
May 28 09:58:47.354290 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-6"/>
May 28 09:58:47.354290 np0000001613 nova-compute[98321]:   <target dev="sdc" bus="scsi"/>
May 28 09:58:47.354290 np0000001613 nova-compute[98321]:   <serial>7c9b1127-3469-4dc1-96b7-9f736ca2309b</serial>
May 28 09:58:47.354290 np0000001613 nova-compute[98321]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
May 28 09:58:47.354290 np0000001613 nova-compute[98321]: </disk>
May 28 09:58:47.354290 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 09:58:47.356968 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Successfully detached device sdc from instance 92fbf243-1c5b-47f6-9317-3fb2655651db from the persistent domain config.
May 28 09:58:47.357257 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] (1/8): Attempting to detach device sdc with device alias ua-7c9b1127-3469-4dc1-96b7-9f736ca2309b from instance 92fbf243-1c5b-47f6-9317-3fb2655651db from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 09:58:47.357556 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] detach device xml: <disk type="block" device="disk">
May 28 09:58:47.357556 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 09:58:47.357556 np0000001613 nova-compute[98321]:   <alias name="ua-7c9b1127-3469-4dc1-96b7-9f736ca2309b"/>
May 28 09:58:47.357556 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-6"/>
May 28 09:58:47.357556 np0000001613 nova-compute[98321]:   <target dev="sdc" bus="scsi"/>
May 28 09:58:47.357556 np0000001613 nova-compute[98321]:   <serial>7c9b1127-3469-4dc1-96b7-9f736ca2309b</serial>
May 28 09:58:47.357556 np0000001613 nova-compute[98321]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
May 28 09:58:47.357556 np0000001613 nova-compute[98321]: </disk>
May 28 09:58:47.357556 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 09:58:47.387950 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Releasing lock "refresh_cache-c9416092-d229-4f59-aaf3-3b0b692e7924" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:58:47.388503 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Instance network_info: |[{"id": "fec718e7-b773-4907-abf5-60f374bd420a", "address": "fa:16:3e:ae:54:17", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec718e7-b7", "ovs_interfaceid": "fec718e7-b773-4907-abf5-60f374bd420a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 09:58:47.390300 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Start _get_guest_xml network_info=[{"id": "fec718e7-b773-4907-abf5-60f374bd420a", "address": "fa:16:3e:ae:54:17", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec718e7-b7", "ovs_interfaceid": "fec718e7-b773-4907-abf5-60f374bd420a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 09:58:47.394272 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 09:58:47.395567 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-tempest.common.compute-instance-108220691', uuid='c9416092-d229-4f59-aaf3-3b0b692e7924'), owner=OwnerMeta(userid='62efa57da85f458790f3ceeebcc777a7', username='tempest-ServerActionsTestOtherA-1557455944-project-member', projectid='cb3a501b4f4041ef875ef4d2b4167044', projectname='tempest-ServerActionsTestOtherA-1557455944'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fec718e7-b773-4907-abf5-60f374bd420a", "address": "fa:16:3e:ae:54:17", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec718e7-b7", "ovs_interfaceid": "fec718e7-b773-4907-abf5-60f374bd420a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962327.395083) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 09:58:47.397182 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 09:58:47.397182 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 09:58:47.397917 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 09:58:47.398185 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 09:58:47.398992 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 09:58:47.399398 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 09:58:47.399591 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 09:58:47.399797 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 09:58:47.399847 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 09:58:47.399927 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 09:58:47.400589 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 09:58:47.400589 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 09:58:47.400589 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 09:58:47.400589 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 09:58:47.400589 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 09:58:47.400589 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 09:58:47.410481 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 09:58:47.411487 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453', 'iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '07c39f6e-3598-45d7-bec8-99175bbf3453', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 09:58:47.411487 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:58:47.413878 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T09:58:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-108220691',display_name='tempest-tempest.common.compute-instance-108220691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-tempest-common-compute-instance-108220691',id=11,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdAbUj53uPVh2c6JmC0f4KuNc7XzB7W4qhLekRIZb4uQ1puOTl+iHN7nlIYOIwGJpx2OcUD9FRst/gQF9pX2F6kz8VeUkdxZMdxvvnrPL706aUB6jSV93natJMiSLTBtQ==',key_name='tempest-keypair-1688806139',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb3a501b4f4041ef875ef4d2b4167044',ramdisk_id='',reservation_id='r-v17yjkz1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1557455944',owner_user_name='tempest-ServerActionsTestOtherA-1557455944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:58:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62efa57da85f458790f3ceeebcc777a7',uuid=c9416092-d229-4f59-aaf3-3b0b692e7924,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fec718e7-b773-4907-abf5-60f374bd420a", "address": "fa:16:3e:ae:54:17", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec718e7-b7", "ovs_interfaceid": "fec718e7-b773-4907-abf5-60f374bd420a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 09:58:47.414062 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Converting VIF {"id": "fec718e7-b773-4907-abf5-60f374bd420a", "address": "fa:16:3e:ae:54:17", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec718e7-b7", "ovs_interfaceid": "fec718e7-b773-4907-abf5-60f374bd420a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:58:47.414674 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:54:17,bridge_name='br-int',has_traffic_filtering=True,id=fec718e7-b773-4907-abf5-60f374bd420a,network=Network(2ae47a43-582b-442f-922d-fe7138b431a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec718e7-b7') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:58:47.415219 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lazy-loading 'pci_devices' on Instance uuid c9416092-d229-4f59-aaf3-3b0b692e7924 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:58:47.426940 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 09:58:47.443628 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e137232e-ead4-4bbe-8e04-57d3c9f6a068 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lock "interface-e2856743-3a60-4be1-b29c-b4de06f14783-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 7.447s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:47.546357 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779962327.5446577, 92fbf243-1c5b-47f6-9317-3fb2655651db => ua-7c9b1127-3469-4dc1-96b7-9f736ca2309b> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 09:58:47.547602 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Start waiting for the detach event from libvirt for device sdc with device alias ua-7c9b1127-3469-4dc1-96b7-9f736ca2309b for instance 92fbf243-1c5b-47f6-9317-3fb2655651db {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 09:58:47.549731 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Successfully detached device sdc from instance 92fbf243-1c5b-47f6-9317-3fb2655651db from the live domain config.
May 28 09:58:47.550424 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 09:58:47.550667 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b', 'iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7c9b1127-3469-4dc1-96b7-9f736ca2309b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 09:58:47.550797 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:58:47.596936 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:58:47.597072 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:58:47.597227 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:58:47.597372 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] No VIF found with MAC fa:16:3e:31:51:06, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 09:58:47.651299 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-8099b406-0df6-497a-a2b7-4ff91d1ac736 req-44189457-f31d-4998-a1d0-3dc18f1b8df4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:47.918012 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] End _get_guest_xml xml=<domain type="qemu">
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:   <uuid>c9416092-d229-4f59-aaf3-3b0b692e7924</uuid>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:   <name>instance-0000000b</name>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:   <metadata>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:       <nova:name>tempest-tempest.common.compute-instance-108220691</nova:name>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 09:58:47</nova:creationTime>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:       </nova:image>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:         <nova:user uuid="62efa57da85f458790f3ceeebcc777a7">tempest-ServerActionsTestOtherA-1557455944-project-member</nova:user>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:         <nova:project uuid="cb3a501b4f4041ef875ef4d2b4167044">tempest-ServerActionsTestOtherA-1557455944</nova:project>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:         <nova:port uuid="fec718e7-b773-4907-abf5-60f374bd420a">
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:         </nova:port>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:   </metadata>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:     <system>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:       <entry name="serial">c9416092-d229-4f59-aaf3-3b0b692e7924</entry>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:       <entry name="uuid">c9416092-d229-4f59-aaf3-3b0b692e7924</entry>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:     </system>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:   <os>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:   </os>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:   <features>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:     <acpi/>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:     <tcg>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:     </tcg>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:   </features>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:   <devices>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924/disk"/>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:     </disk>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924/disk.config"/>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:     </disk>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:ae:54:17"/>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:       <target dev="tapfec718e7-b7"/>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:     </interface>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924/console.log" append="off"/>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:     </serial>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:     <video>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:     </video>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:     </rng>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:     </memballoon>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:   </devices>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]: </domain>
May 28 09:58:47.918012 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 09:58:47.919845 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Preparing to wait for external event network-vif-plugged-fec718e7-b773-4907-abf5-60f374bd420a {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 09:58:47.919845 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "c9416092-d229-4f59-aaf3-3b0b692e7924-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:47.919845 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "c9416092-d229-4f59-aaf3-3b0b692e7924-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:47.919845 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "c9416092-d229-4f59-aaf3-3b0b692e7924-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:47.919845 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T09:58:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-108220691',display_name='tempest-tempest.common.compute-instance-108220691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-tempest-common-compute-instance-108220691',id=11,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdAbUj53uPVh2c6JmC0f4KuNc7XzB7W4qhLekRIZb4uQ1puOTl+iHN7nlIYOIwGJpx2OcUD9FRst/gQF9pX2F6kz8VeUkdxZMdxvvnrPL706aUB6jSV93natJMiSLTBtQ==',key_name='tempest-keypair-1688806139',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb3a501b4f4041ef875ef4d2b4167044',ramdisk_id='',reservation_id='r-v17yjkz1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1557455944',owner_user_name='tempest-ServerActionsTestOtherA-1557455944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:58:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62efa57da85f458790f3ceeebcc777a7',uuid=c9416092-d229-4f59-aaf3-3b0b692e7924,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fec718e7-b773-4907-abf5-60f374bd420a", "address": "fa:16:3e:ae:54:17", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec718e7-b7", "ovs_interfaceid": "fec718e7-b773-4907-abf5-60f374bd420a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 09:58:47.919845 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Converting VIF {"id": "fec718e7-b773-4907-abf5-60f374bd420a", "address": "fa:16:3e:ae:54:17", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec718e7-b7", "ovs_interfaceid": "fec718e7-b773-4907-abf5-60f374bd420a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:58:47.920194 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:54:17,bridge_name='br-int',has_traffic_filtering=True,id=fec718e7-b773-4907-abf5-60f374bd420a,network=Network(2ae47a43-582b-442f-922d-fe7138b431a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec718e7-b7') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:58:47.920495 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:54:17,bridge_name='br-int',has_traffic_filtering=True,id=fec718e7-b773-4907-abf5-60f374bd420a,network=Network(2ae47a43-582b-442f-922d-fe7138b431a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec718e7-b7') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 09:58:47.921262 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:47.922774 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:47.923105 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 09:58:47.925397 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:47.926088 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0840deca-8296-5f8d-8d0a-755ff9bf12b1', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:47.928854 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:47.929526 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:58:47.936237 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:47.944143 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:47.944379 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfec718e7-b7, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:47.945913 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfec718e7-b7, col_values=(('qos', UUID('30bc7c18-893b-4b21-b8a7-9a0093949c50')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:47.946094 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfec718e7-b7, col_values=(('external_ids', {'iface-id': 'fec718e7-b773-4907-abf5-60f374bd420a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:54:17', 'vm-uuid': 'c9416092-d229-4f59-aaf3-3b0b692e7924'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:47.947590 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:47.948656 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:58:47.960432 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:47.960556 np0000001613 nova-compute[98321]: INFO os_vif [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:54:17,bridge_name='br-int',has_traffic_filtering=True,id=fec718e7-b773-4907-abf5-60f374bd420a,network=Network(2ae47a43-582b-442f-922d-fe7138b431a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec718e7-b7')
May 28 09:58:47.982583 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-8099b406-0df6-497a-a2b7-4ff91d1ac736 req-44189457-f31d-4998-a1d0-3dc18f1b8df4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:48.125922 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-8099b406-0df6-497a-a2b7-4ff91d1ac736 req-44189457-f31d-4998-a1d0-3dc18f1b8df4 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Updated VIF entry in instance network info cache for port 6a88c703-7b82-44ce-b5f5-a98718ae6833. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 09:58:48.125922 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-8099b406-0df6-497a-a2b7-4ff91d1ac736 req-44189457-f31d-4998-a1d0-3dc18f1b8df4 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Updating instance_info_cache with network_info: [{"id": "6a88c703-7b82-44ce-b5f5-a98718ae6833", "address": "fa:16:3e:0c:a9:71", "network": {"id": "0ef5507c-157f-4da7-9926-b55fdc2488a9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-360404380-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a88c703-7b", "ovs_interfaceid": "6a88c703-7b82-44ce-b5f5-a98718ae6833", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e1903f1-9c64-411e-be18-e5775f055e13", "address": "fa:16:3e:e8:48:00", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e1903f1-9c", "ovs_interfaceid": "4e1903f1-9c64-411e-be18-e5775f055e13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3", "address": "fa:16:3e:55:f2:21", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4490fa5a-9c", "ovs_interfaceid": "4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "edca6f4e-7f57-4351-8525-4446771d6376", "address": "fa:16:3e:31:6d:c0", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapedca6f4e-7f", "ovs_interfaceid": "edca6f4e-7f57-4351-8525-4446771d6376", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3b48415-3d34-4753-a72f-6f48536174ed", "address": "fa:16:3e:48:5c:c5", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b48415-3d", "ovs_interfaceid": "d3b48415-3d34-4753-a72f-6f48536174ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e08f0477-e673-4559-884f-1dcbc2a9fd0e", "address": "fa:16:3e:07:9b:94", "network": {"id": "57e43a7e-bde2-4d30-bf6d-7c6cc5f5d3e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935029012", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape08f0477-e6", "ovs_interfaceid": "e08f0477-e673-4559-884f-1dcbc2a9fd0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27187d46-bd01-4781-99fe-29d49015360e", "address": "fa:16:3e:38:ca:1f", "network": {"id": "57e43a7e-bde2-4d30-bf6d-7c6cc5f5d3e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935029012", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap27187d46-bd", "ovs_interfaceid": "27187d46-bd01-4781-99fe-29d49015360e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:58:48.197891 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Acquiring lock "e2856743-3a60-4be1-b29c-b4de06f14783" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:48.198293 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lock "e2856743-3a60-4be1-b29c-b4de06f14783" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:48.442808 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Found WWN 330000000a150f8d4 for multipath device dm-8 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 09:58:48.443047 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:58:48.443512 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] <== connect_volume: return (8326ms) {'type': 'block', 'scsi_wwn': '330000000a150f8d4', 'path': '/dev/dm-8', 'multipath_id': '330000000a150f8d4'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 09:58:48.443657 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a150f8d4', 'path': '/dev/dm-8', 'multipath_id': '330000000a150f8d4'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 09:58:48.444270 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 6.416s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:58:48.444747 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd1dfc5cc-6703-445f-9daa-05afb78f89f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 09:58:48.446860 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Lazy-loading 'flavor' on Instance uuid 49ff17d1-cad9-463e-b5c1-3315c52412e6 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:58:48.457612 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:58:48.458348 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:58:48.458894 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:58:48.459197 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 09:58:48.459591 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:58:48.459830 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.startup = automatic
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.port = 0
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.session.scan = manual
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 09:58:48.473288 np0000001613 nova-compute[98321]: # END RECORD
May 28 09:58:48.473288 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.startup = automatic
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.port = 0
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.session.scan = manual
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 09:58:48.475739 np0000001613 nova-compute[98321]: # END RECORD
May 28 09:58:48.475739 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:48.487794 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:48.492637 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:48.520798 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:48.520798 np0000001613 nova-compute[98321]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:48.520798 np0000001613 nova-compute[98321]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:48.520798 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:48.520798 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:48.520798 np0000001613 nova-compute[98321]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:48.520798 np0000001613 nova-compute[98321]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:48.520798 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:48.520798 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:48.520798 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:48.520798 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:48.520798 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:48.520798 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:48.520798 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:48.520798 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:58:48.520798 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:48.520798 np0000001613 nova-compute[98321]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:48.520798 np0000001613 nova-compute[98321]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:48.520798 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:48.520798 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:48.520798 np0000001613 nova-compute[98321]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:48.520798 np0000001613 nova-compute[98321]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:48.520798 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:48.520798 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:48.520798 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:48.520798 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:48.520798 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:48.520798 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:48.520798 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:48.520798 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:58:48.521857 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.062s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:58:48.521857 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 09:58:48.522841 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:48.522841 np0000001613 nova-compute[98321]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:48.522841 np0000001613 nova-compute[98321]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:48.522841 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:48.522841 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:48.522841 np0000001613 nova-compute[98321]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:48.522841 np0000001613 nova-compute[98321]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:48.522841 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:48.522841 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:48.522841 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:48.522841 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:48.522841 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:48.522841 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:48.522841 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:48.522841 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:58:48.523290 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:48.523290 np0000001613 nova-compute[98321]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:48.523290 np0000001613 nova-compute[98321]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:48.523290 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:48.523290 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:48.523290 np0000001613 nova-compute[98321]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:48.523290 np0000001613 nova-compute[98321]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:48.523290 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:48.523290 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:48.523290 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:48.523290 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:48.523290 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:48.523290 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:48.523290 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:48.523290 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:58:48.523640 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.064s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:58:48.523640 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 09:58:48.525485 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] HCTL ('10', '0', '0', 0) found on session 6 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 09:58:48.525485 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Scanning host 10 c: 0, t: 0, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 09:58:48.525485 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] HCTL ('9', '0', '0', 0) found on session 5 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 09:58:48.525485 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Scanning host 9 c: 0, t: 0, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 09:58:48.534970 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Searching for a device in session 6 and hctl ('10', '0', '0', 0) yield: sde {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 09:58:48.535114 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd1dfc5cc-6703-445f-9daa-05afb78f89f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 09:58:48.537005 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Searching for a device in session 5 and hctl ('9', '0', '0', 0) yield: sdd {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 09:58:48.538075 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd1dfc5cc-6703-445f-9daa-05afb78f89f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 09:58:48.626642 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8099b406-0df6-497a-a2b7-4ff91d1ac736 req-44189457-f31d-4998-a1d0-3dc18f1b8df4 service nova] Releasing lock "refresh_cache-7514b113-ec17-468b-a647-de099d90e787" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:58:48.626851 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8099b406-0df6-497a-a2b7-4ff91d1ac736 req-44189457-f31d-4998-a1d0-3dc18f1b8df4 service nova] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Received event network-changed-fec718e7-b773-4907-abf5-60f374bd420a {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:48.626993 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8099b406-0df6-497a-a2b7-4ff91d1ac736 req-44189457-f31d-4998-a1d0-3dc18f1b8df4 service nova] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Refreshing instance network info cache due to event network-changed-fec718e7-b773-4907-abf5-60f374bd420a. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 09:58:48.627181 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8099b406-0df6-497a-a2b7-4ff91d1ac736 req-44189457-f31d-4998-a1d0-3dc18f1b8df4 service nova] Acquiring lock "refresh_cache-c9416092-d229-4f59-aaf3-3b0b692e7924" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:58:48.627284 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8099b406-0df6-497a-a2b7-4ff91d1ac736 req-44189457-f31d-4998-a1d0-3dc18f1b8df4 service nova] Acquired lock "refresh_cache-c9416092-d229-4f59-aaf3-3b0b692e7924" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:58:48.627426 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-8099b406-0df6-497a-a2b7-4ff91d1ac736 req-44189457-f31d-4998-a1d0-3dc18f1b8df4 service nova] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Refreshing network info cache for port fec718e7-b773-4907-abf5-60f374bd420a {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 09:58:48.702867 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lazy-loading 'flavor' on Instance uuid e2856743-3a60-4be1-b29c-b4de06f14783 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:58:48.949579 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Attempting to attach volume efda049f-2154-4df6-8c7b-026a19b94dd4 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 09:58:48.950429 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] attach device xml: <disk type="block" device="disk">
May 28 09:58:48.950429 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 09:58:48.950429 np0000001613 nova-compute[98321]:   <alias name="ua-efda049f-2154-4df6-8c7b-026a19b94dd4"/>
May 28 09:58:48.950429 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-8"/>
May 28 09:58:48.950429 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 09:58:48.950429 np0000001613 nova-compute[98321]:   <serial>efda049f-2154-4df6-8c7b-026a19b94dd4</serial>
May 28 09:58:48.950429 np0000001613 nova-compute[98321]: </disk>
May 28 09:58:48.950429 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 09:58:49.129783 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-8099b406-0df6-497a-a2b7-4ff91d1ac736 req-44189457-f31d-4998-a1d0-3dc18f1b8df4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:49.149373 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-007acbca-e42e-4f45-9a3b-3bf3b1343585 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "53ad56cc-eb5b-4e2e-a421-e93deee27fe7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.131s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:49.172605 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:49.436750 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-8099b406-0df6-497a-a2b7-4ff91d1ac736 req-44189457-f31d-4998-a1d0-3dc18f1b8df4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:49.460081 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 09:58:49.475482 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:58:49.475612 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:58:49.475703 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] No VIF found with MAC fa:16:3e:ae:54:17, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 09:58:49.476127 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Using config drive
May 28 09:58:49.570567 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-8099b406-0df6-497a-a2b7-4ff91d1ac736 req-44189457-f31d-4998-a1d0-3dc18f1b8df4 service nova] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Updated VIF entry in instance network info cache for port fec718e7-b773-4907-abf5-60f374bd420a. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 09:58:49.570880 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-8099b406-0df6-497a-a2b7-4ff91d1ac736 req-44189457-f31d-4998-a1d0-3dc18f1b8df4 service nova] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Updating instance_info_cache with network_info: [{"id": "fec718e7-b773-4907-abf5-60f374bd420a", "address": "fa:16:3e:ae:54:17", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec718e7-b7", "ovs_interfaceid": "fec718e7-b773-4907-abf5-60f374bd420a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:58:49.711614 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lock "e2856743-3a60-4be1-b29c-b4de06f14783" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:49.983445 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:50.073341 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8099b406-0df6-497a-a2b7-4ff91d1ac736 req-44189457-f31d-4998-a1d0-3dc18f1b8df4 service nova] Releasing lock "refresh_cache-c9416092-d229-4f59-aaf3-3b0b692e7924" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:58:50.194777 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Creating config drive at /opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924/disk.config
May 28 09:58:50.200066 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp00mp_my2 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:50.252583 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp00mp_my2" returned: 0 in 0.052s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:50.474740 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Found WWN 330000000605f379a for multipath device dm-3 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 09:58:50.475366 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.031s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:58:50.475448 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] <== connect_volume: return (8446ms) {'type': 'block', 'scsi_wwn': '330000000605f379a', 'path': '/dev/dm-3', 'multipath_id': '330000000605f379a'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 09:58:50.475583 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000605f379a', 'path': '/dev/dm-3', 'multipath_id': '330000000605f379a'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 09:58:50.476177 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.065s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:58:50.476478 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453', 'iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '07c39f6e-3598-45d7-bec8-99175bbf3453', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 09:58:50.490280 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:58:50.490901 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:58:50.493127 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 09:58:50.494362 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:58:50.495718 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:58:50.495718 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 09:58:50.506559 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 09:58:50.506559 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:50.512473 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 09:58:50.512473 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:50.522034 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453] added
May 28 09:58:50.522034 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 09:58:50.522034 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:58:50.522034 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:58:50.522034 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:58:50.522034 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:58:50.522034 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:50.522446 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 09:58:50.522446 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0312(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 09:58:50.522446 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 09:58:50.526123 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453] added
May 28 09:58:50.526123 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 09:58:50.526123 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:58:50.526123 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:58:50.526123 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:58:50.526123 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:58:50.526123 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:50.526123 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 09:58:50.526123 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0303(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 09:58:50.526123 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 09:58:50.602824 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:58:50.602966 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:58:50.603086 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:58:50.603224 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] No VIF found with MAC fa:16:3e:2a:71:9a, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 09:58:50.728626 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:50.766138 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:50.768098 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:50.804972 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Acquiring lock "e2856743-3a60-4be1-b29c-b4de06f14783" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:50.805156 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lock "e2856743-3a60-4be1-b29c-b4de06f14783" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:50.805434 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Attaching volume 40a97e39-f123-40c3-8fd8-3d6ff5cda98f to /dev/vdb
May 28 09:58:50.851915 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:50.871486 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 09:58:50.886803 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 09:58:50.915517 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:50.944111 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2e678214-e431-42e7-9eae-2c3644543324 req-bfb21d7f-f160-481f-bcf3-8f0bde4444f6 service nova] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Received event network-vif-plugged-fec718e7-b773-4907-abf5-60f374bd420a {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:50.947784 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2e678214-e431-42e7-9eae-2c3644543324 req-bfb21d7f-f160-481f-bcf3-8f0bde4444f6 service nova] Acquiring lock "c9416092-d229-4f59-aaf3-3b0b692e7924-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:50.947784 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2e678214-e431-42e7-9eae-2c3644543324 req-bfb21d7f-f160-481f-bcf3-8f0bde4444f6 service nova] Lock "c9416092-d229-4f59-aaf3-3b0b692e7924-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:50.950217 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:50.951999 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2e678214-e431-42e7-9eae-2c3644543324 req-bfb21d7f-f160-481f-bcf3-8f0bde4444f6 service nova] Lock "c9416092-d229-4f59-aaf3-3b0b692e7924-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:50.951999 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 09:58:50.951999 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2e678214-e431-42e7-9eae-2c3644543324 req-bfb21d7f-f160-481f-bcf3-8f0bde4444f6 service nova] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Processing event network-vif-plugged-fec718e7-b773-4907-abf5-60f374bd420a {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 09:58:50.952801 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 09:58:50.954843 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:50.963007 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 09:58:50.965051 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe95:8bd3', 'fe80::fc16:3eff:fe2d:94a4', 'fe80::fc16:3eff:fe31:5106', 'fe80::fc96:34ff:fe12:e4df', 'fe80::2844:59ff:feec:5d21', 'fe80::44e2:31ff:fe81:8771', 'fe80::fc16:3eff:fe9a:42b3', 'fe80::b04e:afff:fe71:41fc', 'fe80::fc16:3eff:fefb:160', 'fe80::5c68:7cff:fe27:e759', 'fe80::fc16:3eff:fe2a:719a', 'fe80::9038:13ff:fe5b:5aad', 'fe80::fc16:3eff:fe9c:2e17', 'fe80::8064:4aff:fe56:ba53', 'fe80::fc16:3eff:fe14:ef87', 'fe80::fc16:3eff:fe0c:a971', 'fe80::ac03:e9ff:fe37:b50a', 'fe80::fc16:3eff:fee8:4800', 'fe80::fc16:3eff:fe55:f221', 'fe80::fc16:3eff:fe31:6dc0', 'fe80::fc16:3eff:fe48:5cc5', 'fe80::fc16:3eff:fe07:9b94', 'fe80::3061:30ff:fee7:aa25', 'fe80::fc16:3eff:fe38:ca1f', 'fe80::888d:9dff:fe20:5f03', 'fe80::fc16:3eff:fec3:78fb', 'fe80::3428:4dff:fe09:805a', 'fe80::fc16:3eff:feae:5417'] 
May 28 09:58:50.967311 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 09:58:50.967311 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 09:58:50.967311 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] <== get_connector_properties: return (93ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 09:58:50.967311 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Updating existing volume attachment record: 1a7d2556-441d-4437-b47b-a7ca21901e95 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 09:58:50.982835 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-665492048',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serverbootfromvolumestablerescuetest-server-665492048',id=10,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T09:58:31Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9d04b105229456d9ab53df1886fdb37',ramdisk_id='',reservation_id='r-7cgj5of9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-283762505',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:58:32Z,user_data=None,user_id='51981c995f2246588f2d58f35be5848a',uuid=57d353b6-133e-4354-a4f4-7bcec543d586,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d6ec393-b62a-4342-a355-3cf8291ec2fe", "address": "fa:16:3e:7a:26:b6", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "vif_mac": "fa:16:3e:7a:26:b6"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d6ec393-b6", "ovs_interfaceid": "9d6ec393-b62a-4342-a355-3cf8291ec2fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 09:58:50.983056 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Converting VIF {"id": "9d6ec393-b62a-4342-a355-3cf8291ec2fe", "address": "fa:16:3e:7a:26:b6", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "vif_mac": "fa:16:3e:7a:26:b6"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d6ec393-b6", "ovs_interfaceid": "9d6ec393-b62a-4342-a355-3cf8291ec2fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:58:50.984402 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:26:b6,bridge_name='br-int',has_traffic_filtering=True,id=9d6ec393-b62a-4342-a355-3cf8291ec2fe,network=Network(e5543f88-c716-4e02-82e9-2cb7570bf25e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d6ec393-b6') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:58:50.986206 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lazy-loading 'pci_devices' on Instance uuid 57d353b6-133e-4354-a4f4-7bcec543d586 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:58:51.489854 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Object Instance<57d353b6-133e-4354-a4f4-7bcec543d586> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 09:58:51.491566 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] End _get_guest_xml xml=<domain type="qemu">
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:   <uuid>57d353b6-133e-4354-a4f4-7bcec543d586</uuid>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:   <name>instance-0000000a</name>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:   <metadata>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-665492048</nova:name>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 09:58:41</nova:creationTime>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:       </nova:image>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:         <nova:user uuid="51981c995f2246588f2d58f35be5848a">tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member</nova:user>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:         <nova:project uuid="a9d04b105229456d9ab53df1886fdb37">tempest-ServerBootFromVolumeStableRescueTest-283762505</nova:project>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:         <nova:port uuid="9d6ec393-b62a-4342-a355-3cf8291ec2fe">
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:         </nova:port>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:   </metadata>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:     <system>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:       <entry name="serial">57d353b6-133e-4354-a4f4-7bcec543d586</entry>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:       <entry name="uuid">57d353b6-133e-4354-a4f4-7bcec543d586</entry>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:     </system>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:   <os>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:   </os>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:   <features>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:     <acpi/>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:     <tcg>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:     </tcg>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:   </features>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:   <devices>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/57d353b6-133e-4354-a4f4-7bcec543d586/disk.config"/>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:     </disk>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:       <alias name="ua-d1dfc5cc-6703-445f-9daa-05afb78f89f0"/>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-3"/>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:       <serial>d1dfc5cc-6703-445f-9daa-05afb78f89f0</serial>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:     </disk>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/57d353b6-133e-4354-a4f4-7bcec543d586/disk.rescue"/>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:       <target dev="vdb" bus="virtio"/>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:       <boot order="1"/>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:     </disk>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:7a:26:b6"/>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:       <target dev="tap9d6ec393-b6"/>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:     </interface>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/57d353b6-133e-4354-a4f4-7bcec543d586/console.log" append="off"/>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:     </serial>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:     <video>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:     </video>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:     </rng>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:     </memballoon>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:   </devices>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]: </domain>
May 28 09:58:51.491566 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 09:58:51.497853 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Instance destroyed successfully.
May 28 09:58:51.523369 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 09:58:51.528790 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.startup = manual
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.port = 0
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 09:58:51.538088 np0000001613 nova-compute[98321]: # END RECORD
May 28 09:58:51.538088 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:51.543512 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 09:58:51.543512 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f', 'iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '40a97e39-f123-40c3-8fd8-3d6ff5cda98f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 09:58:51.543512 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.startup = manual
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.port = 0
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 09:58:51.552300 np0000001613 nova-compute[98321]: # END RECORD
May 28 09:58:51.552300 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:51.557248 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:51.566517 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:51.579829 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:51.579829 np0000001613 nova-compute[98321]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:51.579829 np0000001613 nova-compute[98321]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:51.579829 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:51.579829 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:51.579829 np0000001613 nova-compute[98321]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:51.579829 np0000001613 nova-compute[98321]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:51.579829 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:51.579829 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:51.579829 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:51.579829 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:51.579829 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:51.579829 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:51.579829 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:51.579829 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:58:51.580332 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:51.580332 np0000001613 nova-compute[98321]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:51.580332 np0000001613 nova-compute[98321]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:51.580332 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:51.580332 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:51.580332 np0000001613 nova-compute[98321]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:51.580332 np0000001613 nova-compute[98321]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:51.580332 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:51.580332 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:51.580332 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:51.580332 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:51.580332 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:51.580332 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:51.580332 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:51.580332 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:58:51.595352 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:51.595352 np0000001613 nova-compute[98321]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:51.595352 np0000001613 nova-compute[98321]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:51.595352 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:51.595352 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:51.595352 np0000001613 nova-compute[98321]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:51.595352 np0000001613 nova-compute[98321]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:51.595352 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:51.595352 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:51.595352 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:51.595352 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:51.595352 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:51.595352 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:51.595352 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:51.595352 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:58:51.595997 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:51.595997 np0000001613 nova-compute[98321]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:51.595997 np0000001613 nova-compute[98321]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:51.595997 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:51.595997 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:51.595997 np0000001613 nova-compute[98321]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:51.595997 np0000001613 nova-compute[98321]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:51.595997 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:51.595997 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:51.595997 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:51.595997 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:51.595997 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:51.595997 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:51.595997 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:51.595997 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:58:51.641546 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453, portal: 192.168.40.100,3260]
May 28 09:58:51.641546 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453, portal: 192.168.40.100,3260] successful.
May 28 09:58:51.641546 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:51.648680 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 09:58:51.649918 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962331.6494937, c9416092-d229-4f59-aaf3-3b0b692e7924 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:58:51.652901 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] VM Started (Lifecycle Event)
May 28 09:58:51.656100 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 09:58:51.657055 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:51.658815 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Instance spawned successfully.
May 28 09:58:51.660938 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 09:58:51.678906 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453, portal: 192.168.50.100,3260]
May 28 09:58:51.678906 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453, portal: 192.168.50.100,3260] successful.
May 28 09:58:51.678906 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:51.687959 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:51.687959 np0000001613 nova-compute[98321]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:51.687959 np0000001613 nova-compute[98321]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:51.687959 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:51.687959 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:51.687959 np0000001613 nova-compute[98321]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:51.687959 np0000001613 nova-compute[98321]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:51.687959 np0000001613 nova-compute[98321]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:58:51.687959 np0000001613 nova-compute[98321]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:58:51.687959 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:51.687959 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:51.687959 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:51.687959 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:51.687959 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:51.687959 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:51.687959 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:51.687959 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:58:51.687959 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:51.687959 np0000001613 nova-compute[98321]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:51.687959 np0000001613 nova-compute[98321]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:51.687959 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:51.687959 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:51.687959 np0000001613 nova-compute[98321]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:51.687959 np0000001613 nova-compute[98321]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:51.687959 np0000001613 nova-compute[98321]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:58:51.687959 np0000001613 nova-compute[98321]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:58:51.687959 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:51.687959 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:51.687959 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:51.687959 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:51.687959 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:51.687959 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:51.687959 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:51.687959 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:58:51.689020 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.197s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:58:51.689020 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 09:58:51.691635 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] HCTL ('21', '-', '-', 0) found on session 17 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 09:58:51.691786 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Scanning host 21 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 09:58:51.692353 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:51.711382 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Searching for a device in session 17 and hctl ['21', '*', '*', 0] yield: sdp {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 09:58:51.711382 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '07c39f6e-3598-45d7-bec8-99175bbf3453', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 09:58:51.723465 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:51.723465 np0000001613 nova-compute[98321]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:51.723465 np0000001613 nova-compute[98321]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:51.723465 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:51.723465 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:51.723465 np0000001613 nova-compute[98321]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:51.723465 np0000001613 nova-compute[98321]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:51.723465 np0000001613 nova-compute[98321]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:58:51.723465 np0000001613 nova-compute[98321]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:58:51.723465 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:51.723465 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:51.723465 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:51.723465 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:51.723465 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:51.723465 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:51.723465 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:51.723465 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:58:51.723915 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:51.723915 np0000001613 nova-compute[98321]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:51.723915 np0000001613 nova-compute[98321]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:51.723915 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:51.723915 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:51.723915 np0000001613 nova-compute[98321]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:51.723915 np0000001613 nova-compute[98321]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:51.723915 np0000001613 nova-compute[98321]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:58:51.723915 np0000001613 nova-compute[98321]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:58:51.723915 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:51.723915 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:51.723915 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:51.723915 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:51.723915 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:51.723915 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:51.723915 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:51.723915 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:58:51.724241 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.229s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:58:51.724241 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 09:58:51.725928 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] HCTL ('22', '-', '-', 0) found on session 18 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 09:58:51.726064 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Scanning host 22 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 09:58:51.747983 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Searching for a device in session 18 and hctl ['22', '*', '*', 0] yield: sdq {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 09:58:51.747983 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Connected to sdq using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '07c39f6e-3598-45d7-bec8-99175bbf3453', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 09:58:52.147292 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-572a90c2-7083-4adf-9b51-485f2f45e716 tempest-VolumesAssistedSnapshotsTest-633712333 tempest-VolumesAssistedSnapshotsTest-633712333-project] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] volume_snapshot_create: create_info: {'snapshot_id': '5f2bd86b-849c-416e-884d-7bfdb274189f', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=98321) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3769}}
May 28 09:58:52.151343 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-572a90c2-7083-4adf-9b51-485f2f45e716 tempest-VolumesAssistedSnapshotsTest-633712333 tempest-VolumesAssistedSnapshotsTest-633712333-project] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] snap xml: <domainsnapshot>
May 28 09:58:52.151343 np0000001613 nova-compute[98321]:   <disks>
May 28 09:58:52.151343 np0000001613 nova-compute[98321]:     <disk name="/dev/dm-8" snapshot="external" type="file">
May 28 09:58:52.151343 np0000001613 nova-compute[98321]:       <source file="/dev/new_file"/>
May 28 09:58:52.151343 np0000001613 nova-compute[98321]:     </disk>
May 28 09:58:52.151343 np0000001613 nova-compute[98321]:     <disk name="vda" snapshot="no"/>
May 28 09:58:52.151343 np0000001613 nova-compute[98321]:     <disk name="hda" snapshot="no"/>
May 28 09:58:52.151343 np0000001613 nova-compute[98321]:   </disks>
May 28 09:58:52.151343 np0000001613 nova-compute[98321]: </domainsnapshot>
May 28 09:58:52.151343 np0000001613 nova-compute[98321]:  {{(pid=98321) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3710}}
May 28 09:58:52.151633 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-572a90c2-7083-4adf-9b51-485f2f45e716 tempest-VolumesAssistedSnapshotsTest-633712333 tempest-VolumesAssistedSnapshotsTest-633712333-project] Lazy-loading 'system_metadata' on Instance uuid 49ff17d1-cad9-463e-b5c1-3315c52412e6 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:58:52.163279 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:58:52.167227 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 09:58:52.174379 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "83f9ce5f-44cb-40c6-be1a-8d5134ee8902" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:52.174596 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "83f9ce5f-44cb-40c6-be1a-8d5134ee8902" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:52.178204 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:58:52.178382 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:58:52.178812 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:58:52.179121 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:58:52.180421 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:58:52.180421 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:58:52.195954 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bf74d91e-6005-4c82-9ce0-cccec3bb54c4 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Lock "49ff17d1-cad9-463e-b5c1-3315c52412e6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.776s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:52.225770 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-cbfe33d6-f327-40a7-875e-6fcd74748fa4 tempest-VolumesAssistedSnapshotsTest-633712333 tempest-VolumesAssistedSnapshotsTest-633712333-project] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] volume_snapshot_delete: delete_info: {'volume_id': 'efda049f-2154-4df6-8c7b-026a19b94dd4'} {{(pid=98321) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3877}}
May 28 09:58:52.230656 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver [None req-cbfe33d6-f327-40a7-875e-6fcd74748fa4 tempest-VolumesAssistedSnapshotsTest-633712333 tempest-VolumesAssistedSnapshotsTest-633712333-project] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
May 28 09:58:52.230656 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Traceback (most recent call last):
May 28 09:58:52.230656 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 28 09:58:52.230656 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6]     self._volume_snapshot_delete(context, instance, volume_id,
May 28 09:58:52.230656 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 28 09:58:52.230656 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6]     if delete_info['type'] != 'qcow2':
May 28 09:58:52.230656 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6]        ~~~~~~~~~~~^^^^^^^^
May 28 09:58:52.230656 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] KeyError: 'type'
May 28 09:58:52.230656 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] 
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver [None req-cbfe33d6-f327-40a7-875e-6fcd74748fa4 tempest-VolumesAssistedSnapshotsTest-633712333 tempest-VolumesAssistedSnapshotsTest-633712333-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver        ~~~~~~~~~~~^^^^^^^^
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver KeyError: 'type'
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver 
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver 
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-6428d232-c3ff-4842-9fdf-fd3589984ad9)
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver 
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver 
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3609, in _volume_snapshot_update_status
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
May 28 09:58:52.280027 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver 
May 28 09:58:52.290997 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server [None req-cbfe33d6-f327-40a7-875e-6fcd74748fa4 tempest-VolumesAssistedSnapshotsTest-633712333 tempest-VolumesAssistedSnapshotsTest-633712333-project] Exception during message handling: KeyError: 'type'
May 28 09:58:52.290997 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
May 28 09:58:52.290997 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
May 28 09:58:52.290997 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
May 28 09:58:52.290997 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 09:58:52.290997 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
May 28 09:58:52.290997 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
May 28 09:58:52.290997 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 09:58:52.290997 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
May 28 09:58:52.290997 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
May 28 09:58:52.290997 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
May 28 09:58:52.290997 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner
May 28 09:58:52.290997 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
May 28 09:58:52.290997 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^
May 28 09:58:52.290997 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
May 28 09:58:52.290997 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 28 09:58:52.290997 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 28 09:58:52.290997 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 28 09:58:52.290997 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 28 09:58:52.290997 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server     raise self.value
May 28 09:58:52.290997 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
May 28 09:58:52.290997 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
May 28 09:58:52.290997 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 09:58:52.290997 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4829, in volume_snapshot_delete
May 28 09:58:52.290997 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
May 28 09:58:52.290997 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4053, in volume_snapshot_delete
May 28 09:58:52.290997 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 28 09:58:52.290997 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 28 09:58:52.290997 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 28 09:58:52.290997 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 28 09:58:52.290997 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server     raise self.value
May 28 09:58:52.290997 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 28 09:58:52.290997 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
May 28 09:58:52.290997 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 28 09:58:52.290997 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
May 28 09:58:52.290997 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server        ~~~~~~~~~~~^^^^^^^^
May 28 09:58:52.290997 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server KeyError: 'type'
May 28 09:58:52.290997 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server 
May 28 09:58:52.496398 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 09:58:52.654675 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-572a90c2-7083-4adf-9b51-485f2f45e716 tempest-VolumesAssistedSnapshotsTest-633712333 tempest-VolumesAssistedSnapshotsTest-633712333-project] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Skipping quiescing instance: QEMU guest agent is not enabled.
May 28 09:58:52.663189 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver [None req-572a90c2-7083-4adf-9b51-485f2f45e716 tempest-VolumesAssistedSnapshotsTest-633712333 tempest-VolumesAssistedSnapshotsTest-633712333-project] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 28 09:58:52.663189 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Traceback (most recent call last):
May 28 09:58:52.663189 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 28 09:58:52.663189 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 28 09:58:52.663189 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 28 09:58:52.663189 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6]     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 28 09:58:52.663189 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 28 09:58:52.663189 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6]     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 28 09:58:52.663189 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 28 09:58:52.663189 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] 
May 28 09:58:52.664625 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver [None req-572a90c2-7083-4adf-9b51-485f2f45e716 tempest-VolumesAssistedSnapshotsTest-633712333 tempest-VolumesAssistedSnapshotsTest-633712333-project] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 28 09:58:52.664625 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Traceback (most recent call last):
May 28 09:58:52.664625 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 28 09:58:52.664625 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6]     self._volume_snapshot_create(context, instance, guest,
May 28 09:58:52.664625 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 28 09:58:52.664625 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 28 09:58:52.664625 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 28 09:58:52.664625 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6]     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 28 09:58:52.664625 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 28 09:58:52.664625 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6]     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 28 09:58:52.664625 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 28 09:58:52.664625 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] 
May 28 09:58:52.677218 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 09:58:52.677577 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962332.6773794, c9416092-d229-4f59-aaf3-3b0b692e7924 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:58:52.677766 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] VM Paused (Lifecycle Event)
May 28 09:58:52.680410 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 09:58:52.699255 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Took 6.65 seconds to spawn the instance on the hypervisor.
May 28 09:58:52.699767 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver [None req-572a90c2-7083-4adf-9b51-485f2f45e716 tempest-VolumesAssistedSnapshotsTest-633712333 tempest-VolumesAssistedSnapshotsTest-633712333-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 5f2bd86b-849c-416e-884d-7bfdb274189f could not be found.
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver 
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver 
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 5f2bd86b-849c-416e-884d-7bfdb274189f could not be found. (HTTP 404) (Request-ID: req-2643cc15-87fc-4e10-9226-16584a3afba1)
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver 
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver 
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3609, in _volume_snapshot_update_status
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 5f2bd86b-849c-416e-884d-7bfdb274189f could not be found.
May 28 09:58:52.722395 np0000001613 nova-compute[98321]: ERROR nova.virt.libvirt.driver 
May 28 09:58:52.729834 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server [None req-572a90c2-7083-4adf-9b51-485f2f45e716 tempest-VolumesAssistedSnapshotsTest-633712333 tempest-VolumesAssistedSnapshotsTest-633712333-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 28 09:58:52.729834 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
May 28 09:58:52.729834 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
May 28 09:58:52.729834 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
May 28 09:58:52.729834 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 09:58:52.729834 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
May 28 09:58:52.729834 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
May 28 09:58:52.729834 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 09:58:52.729834 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
May 28 09:58:52.729834 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
May 28 09:58:52.729834 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
May 28 09:58:52.729834 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner
May 28 09:58:52.729834 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
May 28 09:58:52.729834 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^
May 28 09:58:52.729834 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
May 28 09:58:52.729834 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 28 09:58:52.729834 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 28 09:58:52.729834 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 28 09:58:52.729834 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 28 09:58:52.729834 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server     raise self.value
May 28 09:58:52.729834 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
May 28 09:58:52.729834 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
May 28 09:58:52.729834 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 09:58:52.729834 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4817, in volume_snapshot_create
May 28 09:58:52.729834 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
May 28 09:58:52.729834 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3790, in volume_snapshot_create
May 28 09:58:52.729834 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 28 09:58:52.729834 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 28 09:58:52.729834 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 28 09:58:52.729834 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 28 09:58:52.729834 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server     raise self.value
May 28 09:58:52.729834 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 28 09:58:52.729834 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
May 28 09:58:52.729834 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 28 09:58:52.729834 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 28 09:58:52.729834 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 28 09:58:52.729834 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 28 09:58:52.729834 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 28 09:58:52.729834 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 28 09:58:52.729834 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 28 09:58:52.729834 np0000001613 nova-compute[98321]: ERROR oslo_messaging.rpc.server 
May 28 09:58:52.946394 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Acquiring lock "49ff17d1-cad9-463e-b5c1-3315c52412e6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:52.946394 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Lock "49ff17d1-cad9-463e-b5c1-3315c52412e6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:52.950537 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:52.995181 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-de3c03f4-27bd-4039-8668-cb22cfc836e9 req-fba2327f-a796-40b6-b433-0b05f98dae66 service nova] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Received event network-vif-plugged-fec718e7-b773-4907-abf5-60f374bd420a {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:52.995181 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-de3c03f4-27bd-4039-8668-cb22cfc836e9 req-fba2327f-a796-40b6-b433-0b05f98dae66 service nova] Acquiring lock "c9416092-d229-4f59-aaf3-3b0b692e7924-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:52.995181 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-de3c03f4-27bd-4039-8668-cb22cfc836e9 req-fba2327f-a796-40b6-b433-0b05f98dae66 service nova] Lock "c9416092-d229-4f59-aaf3-3b0b692e7924-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:52.995181 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-de3c03f4-27bd-4039-8668-cb22cfc836e9 req-fba2327f-a796-40b6-b433-0b05f98dae66 service nova] Lock "c9416092-d229-4f59-aaf3-3b0b692e7924-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:52.995181 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-de3c03f4-27bd-4039-8668-cb22cfc836e9 req-fba2327f-a796-40b6-b433-0b05f98dae66 service nova] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] No waiting events found dispatching network-vif-plugged-fec718e7-b773-4907-abf5-60f374bd420a {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:58:52.995181 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-de3c03f4-27bd-4039-8668-cb22cfc836e9 req-fba2327f-a796-40b6-b433-0b05f98dae66 service nova] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Received unexpected event network-vif-plugged-fec718e7-b773-4907-abf5-60f374bd420a for instance with vm_state active and task_state None.
May 28 09:58:53.023757 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:58:53.023892 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:58:53.023892 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:58:53.024032 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] No VIF found with MAC fa:16:3e:7a:26:b6, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 09:58:53.024717 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Using config drive
May 28 09:58:53.097100 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.00045985000019754807 future=<Future at 0x73c1fc1af0b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:58:53.097603 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Emitting event <LifecycleEvent: 1779962318.0965042, 57d353b6-133e-4354-a4f4-7bcec543d586 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:58:53.097828 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:58:53.097986 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] VM Stopped (Lifecycle Event)
May 28 09:58:53.180001 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:58:53.181128 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962333.1809163, c9416092-d229-4f59-aaf3-3b0b692e7924 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:58:53.181291 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] VM Resumed (Lifecycle Event)
May 28 09:58:53.213876 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Took 12.48 seconds to build instance.
May 28 09:58:53.233462 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:53.233836 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:53.236984 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 09:58:53.237445 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Claim successful on node np0000001613
May 28 09:58:53.448374 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Detaching volume efda049f-2154-4df6-8c7b-026a19b94dd4
May 28 09:58:53.490380 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Attempting to driver detach volume efda049f-2154-4df6-8c7b-026a19b94dd4 from mountpoint /dev/vdb
May 28 09:58:53.492790 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Found disk vdb by alias ua-efda049f-2154-4df6-8c7b-026a19b94dd4 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 09:58:53.493712 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Found disk vdb by alias ua-efda049f-2154-4df6-8c7b-026a19b94dd4 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 09:58:53.493858 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Attempting to detach device vdb from instance 49ff17d1-cad9-463e-b5c1-3315c52412e6 from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 09:58:53.494111 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] detach device xml: <disk type="block" device="disk">
May 28 09:58:53.494111 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 09:58:53.494111 np0000001613 nova-compute[98321]:   <alias name="ua-efda049f-2154-4df6-8c7b-026a19b94dd4"/>
May 28 09:58:53.494111 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-8"/>
May 28 09:58:53.494111 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 09:58:53.494111 np0000001613 nova-compute[98321]:   <serial>efda049f-2154-4df6-8c7b-026a19b94dd4</serial>
May 28 09:58:53.494111 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 09:58:53.494111 np0000001613 nova-compute[98321]: </disk>
May 28 09:58:53.494111 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 09:58:53.498427 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Successfully detached device vdb from instance 49ff17d1-cad9-463e-b5c1-3315c52412e6 from the persistent domain config.
May 28 09:58:53.498912 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] (1/8): Attempting to detach device vdb with device alias ua-efda049f-2154-4df6-8c7b-026a19b94dd4 from instance 49ff17d1-cad9-463e-b5c1-3315c52412e6 from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 09:58:53.498912 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] detach device xml: <disk type="block" device="disk">
May 28 09:58:53.498912 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 09:58:53.498912 np0000001613 nova-compute[98321]:   <alias name="ua-efda049f-2154-4df6-8c7b-026a19b94dd4"/>
May 28 09:58:53.498912 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-8"/>
May 28 09:58:53.498912 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 09:58:53.498912 np0000001613 nova-compute[98321]:   <serial>efda049f-2154-4df6-8c7b-026a19b94dd4</serial>
May 28 09:58:53.498912 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 09:58:53.498912 np0000001613 nova-compute[98321]: </disk>
May 28 09:58:53.498912 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 09:58:53.518273 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Found WWN 3300000000a84ca57 for multipath device dm-9 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 09:58:53.518584 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.043s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:58:53.518815 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] <== connect_volume: return (6108ms) {'type': 'block', 'scsi_wwn': '3300000000a84ca57', 'path': '/dev/dm-9', 'multipath_id': '3300000000a84ca57'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 09:58:53.518943 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000a84ca57', 'path': '/dev/dm-9', 'multipath_id': '3300000000a84ca57'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 09:58:53.519470 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 5.969s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:58:53.519835 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b', 'iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7c9b1127-3469-4dc1-96b7-9f736ca2309b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 09:58:53.519994 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 09:58:53.522012 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lazy-loading 'flavor' on Instance uuid 0dca786c-46bb-48dc-a01a-e282daa84a89 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:58:53.527523 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lazy-loading 'ec2_ids' on Instance uuid 57d353b6-133e-4354-a4f4-7bcec543d586 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:58:53.552932 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:53.552932 np0000001613 nova-compute[98321]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:53.552932 np0000001613 nova-compute[98321]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:53.552932 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:53.552932 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:53.552932 np0000001613 nova-compute[98321]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:53.552932 np0000001613 nova-compute[98321]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:53.552932 np0000001613 nova-compute[98321]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:58:53.552932 np0000001613 nova-compute[98321]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:58:53.552932 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:53.552932 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:53.552932 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:53.552932 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:53.552932 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:53.552932 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:53.552932 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:53.552932 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:58:53.553329 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:53.553329 np0000001613 nova-compute[98321]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:53.553329 np0000001613 nova-compute[98321]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b (non-flash)
May 28 09:58:53.553329 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:53.553329 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:53.553329 np0000001613 nova-compute[98321]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:53.553329 np0000001613 nova-compute[98321]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:53.553329 np0000001613 nova-compute[98321]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:58:53.553329 np0000001613 nova-compute[98321]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:58:53.553329 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:53.553329 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:53.553329 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:53.553329 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:53.553329 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:53.553329 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:53.553329 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:53.553329 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:58:53.553624 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0', '4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5', '8'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480', '9')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 09:58:53.553624 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b', '11')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 09:58:53.559442 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b', '12')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 09:58:53.560965 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1f4751c60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b'): ({'sdk'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 09:58:53.564115 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Removing multipathed devices sdj, sdk {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 09:58:53.565387 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Flush multipath device 3300000000e5813d1 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 09:58:53.599688 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 09:58:53.602704 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:58:53.602704 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 4 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 09:58:53.639773 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 09:58:53.683910 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:58:53.686652 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 09:58:53.693863 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 09:58:53.693969 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 09:58:53.695774 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 09:58:53.712659 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 09:58:53.713058 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 09:58:53.718042 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "c9416092-d229-4f59-aaf3-3b0b692e7924" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.990s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:53.726359 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:53.771486 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b, portal: 192.168.40.100,3260]
May 28 09:58:53.771486 np0000001613 nova-compute[98321]: Logout of [sid: 11, target: iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b, portal: 192.168.40.100,3260] successful.
May 28 09:58:53.771486 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:53.801328 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:53.816975 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:53.862131 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b, portal: 192.168.50.100,3260]
May 28 09:58:53.862131 np0000001613 nova-compute[98321]: Logout of [sid: 12, target: iqn.2023-03.storpool.com:os--volume-7c9b1127-3469-4dc1-96b7-9f736ca2309b, portal: 192.168.50.100,3260] successful.
May 28 09:58:53.862131 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:53.893773 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:53.897706 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:58:53.897899 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] <== disconnect_volume: return (6347ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 09:58:53.898061 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 09:58:53.900480 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.358s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:58:53.900982 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f', 'iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '40a97e39-f123-40c3-8fd8-3d6ff5cda98f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 09:58:53.902121 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:58:53.902410 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:58:53.902620 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:58:53.902872 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:58:53.903075 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:58:53.903378 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:58:53.903569 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:58:53.903820 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:58:53.903963 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 09:58:53.904128 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:58:53.914676 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:58:53.916793 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:58:53.917462 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:58:53.918062 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 09:58:53.919842 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:58:53.919842 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 09:58:53.932142 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 09:58:53.932142 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:53.942098 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 09:58:53.942098 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:53.952955 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f] added
May 28 09:58:53.952955 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 09:58:53.952955 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:58:53.952955 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:58:53.952955 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:58:53.952955 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:58:53.952955 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:53.954180 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 09:58:53.954180 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f] added
May 28 09:58:53.954180 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 09:58:53.954180 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:58:53.954180 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:58:53.954180 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:58:53.954180 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:58:53.954180 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:53.954180 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 09:58:53.954180 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0352(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 09:58:53.954180 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 09:58:53.954583 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0358(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 09:58:53.954916 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 09:58:54.026255 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Attempting to attach volume 07c39f6e-3598-45d7-bec8-99175bbf3453 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 09:58:54.029913 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] attach device xml: <disk type="block" device="disk">
May 28 09:58:54.029913 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 09:58:54.029913 np0000001613 nova-compute[98321]:   <alias name="ua-07c39f6e-3598-45d7-bec8-99175bbf3453"/>
May 28 09:58:54.029913 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-9"/>
May 28 09:58:54.029913 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 09:58:54.029913 np0000001613 nova-compute[98321]:   <serial>07c39f6e-3598-45d7-bec8-99175bbf3453</serial>
May 28 09:58:54.029913 np0000001613 nova-compute[98321]:   <shareable/>
May 28 09:58:54.029913 np0000001613 nova-compute[98321]: </disk>
May 28 09:58:54.029913 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 09:58:54.033714 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Object Instance<57d353b6-133e-4354-a4f4-7bcec543d586> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 09:58:54.033873 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lazy-loading 'keypairs' on Instance uuid 57d353b6-133e-4354-a4f4-7bcec543d586 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:58:54.103373 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias ua-efda049f-2154-4df6-8c7b-026a19b94dd4 for instance 49ff17d1-cad9-463e-b5c1-3315c52412e6 {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 09:58:54.105514 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-0b081745-e8b4-4d34-b677-5610c324b564 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] During sync_power_state the instance has a pending task (rescuing). Skip.
May 28 09:58:54.174627 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:54.192297 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779962334.191992, 49ff17d1-cad9-463e-b5c1-3315c52412e6 => ua-efda049f-2154-4df6-8c7b-026a19b94dd4> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 09:58:54.193938 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Successfully detached device vdb from instance 49ff17d1-cad9-463e-b5c1-3315c52412e6 from the live domain config.
May 28 09:58:54.195156 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 09:58:54.195447 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4', 'iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'efda049f-2154-4df6-8c7b-026a19b94dd4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 09:58:54.195588 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:58:54.412953 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:54.484565 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Lazy-loading 'flavor' on Instance uuid 92fbf243-1c5b-47f6-9317-3fb2655651db {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:58:54.537054 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Object Instance<57d353b6-133e-4354-a4f4-7bcec543d586> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 09:58:54.540512 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:54.598257 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e6a6a5af-1cef-4f88-b348-5ead81bc7ee5 req-66d3f884-5f5c-4246-9282-dc2ea6c3a6de service nova] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Received event network-changed-fec718e7-b773-4907-abf5-60f374bd420a {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:54.599872 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e6a6a5af-1cef-4f88-b348-5ead81bc7ee5 req-66d3f884-5f5c-4246-9282-dc2ea6c3a6de service nova] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Refreshing instance network info cache due to event network-changed-fec718e7-b773-4907-abf5-60f374bd420a. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 09:58:54.599872 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e6a6a5af-1cef-4f88-b348-5ead81bc7ee5 req-66d3f884-5f5c-4246-9282-dc2ea6c3a6de service nova] Acquiring lock "refresh_cache-c9416092-d229-4f59-aaf3-3b0b692e7924" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:58:54.599872 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e6a6a5af-1cef-4f88-b348-5ead81bc7ee5 req-66d3f884-5f5c-4246-9282-dc2ea6c3a6de service nova] Acquired lock "refresh_cache-c9416092-d229-4f59-aaf3-3b0b692e7924" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:58:54.599872 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-e6a6a5af-1cef-4f88-b348-5ead81bc7ee5 req-66d3f884-5f5c-4246-9282-dc2ea6c3a6de service nova] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Refreshing network info cache for port fec718e7-b773-4907-abf5-60f374bd420a {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 09:58:54.721418 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Creating config drive at /opt/stack/data/nova/instances/57d353b6-133e-4354-a4f4-7bcec543d586/disk.config.rescue
May 28 09:58:54.729200 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/57d353b6-133e-4354-a4f4-7bcec543d586/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpanxzdlou {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:54.785358 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/57d353b6-133e-4354-a4f4-7bcec543d586/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpanxzdlou" returned: 0 in 0.056s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:54.954674 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 09:58:54.957286 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.startup = manual
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.port = 0
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 09:58:54.969096 np0000001613 nova-compute[98321]: # END RECORD
May 28 09:58:54.969096 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.startup = manual
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.port = 0
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 09:58:54.979316 np0000001613 nova-compute[98321]: # END RECORD
May 28 09:58:54.979316 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:54.986900 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:54.997424 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:55.014004 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:55.014004 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:55.014004 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:55.014004 np0000001613 nova-compute[98321]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:55.014004 np0000001613 nova-compute[98321]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:55.014004 np0000001613 nova-compute[98321]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:58:55.014004 np0000001613 nova-compute[98321]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:58:55.014004 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:55.014004 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:55.014004 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:55.014004 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:55.014004 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:55.014004 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:55.014004 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:55.014004 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:58:55.014388 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:55.014388 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:55.014388 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:55.014388 np0000001613 nova-compute[98321]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:55.014388 np0000001613 nova-compute[98321]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:55.014388 np0000001613 nova-compute[98321]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:58:55.014388 np0000001613 nova-compute[98321]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:58:55.014388 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:55.014388 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:55.014388 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:55.014388 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:55.014388 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:55.014388 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:55.014388 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:55.014388 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:58:55.026191 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:55.026191 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:55.026191 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:55.026191 np0000001613 nova-compute[98321]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:55.026191 np0000001613 nova-compute[98321]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:55.026191 np0000001613 nova-compute[98321]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:58:55.026191 np0000001613 nova-compute[98321]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:58:55.026191 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:55.026191 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:55.026191 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:55.026191 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:55.026191 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:55.026191 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:55.026191 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:55.026191 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:58:55.026191 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:55.026191 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:55.026191 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:55.026191 np0000001613 nova-compute[98321]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:55.026191 np0000001613 nova-compute[98321]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:55.026191 np0000001613 nova-compute[98321]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:58:55.026191 np0000001613 nova-compute[98321]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:58:55.026191 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:55.026191 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:55.026191 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:55.026191 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:55.026191 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:55.026191 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:55.026191 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:55.026191 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:58:55.079397 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f, portal: 192.168.40.100,3260]
May 28 09:58:55.079397 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f, portal: 192.168.40.100,3260] successful.
May 28 09:58:55.079397 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:55.092849 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f, portal: 192.168.50.100,3260]
May 28 09:58:55.092849 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f, portal: 192.168.50.100,3260] successful.
May 28 09:58:55.092849 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:55.093296 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:55.105900 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-e6a6a5af-1cef-4f88-b348-5ead81bc7ee5 req-66d3f884-5f5c-4246-9282-dc2ea6c3a6de service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:55.109292 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:55.117046 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:55.117046 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:55.117046 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:55.117046 np0000001613 nova-compute[98321]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:55.117046 np0000001613 nova-compute[98321]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:55.117046 np0000001613 nova-compute[98321]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:58:55.117046 np0000001613 nova-compute[98321]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:58:55.117046 np0000001613 nova-compute[98321]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f (non-flash)
May 28 09:58:55.117046 np0000001613 nova-compute[98321]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f (non-flash)
May 28 09:58:55.117046 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:55.117046 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:55.117046 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:55.117046 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:55.117046 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:55.117046 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:55.117046 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:55.117046 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:58:55.117665 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:55.117665 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:55.117665 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:55.117665 np0000001613 nova-compute[98321]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:55.117665 np0000001613 nova-compute[98321]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:55.117665 np0000001613 nova-compute[98321]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:58:55.117665 np0000001613 nova-compute[98321]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:58:55.117665 np0000001613 nova-compute[98321]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f (non-flash)
May 28 09:58:55.117665 np0000001613 nova-compute[98321]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f (non-flash)
May 28 09:58:55.117665 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:55.117665 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:55.117665 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:55.117665 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:55.117665 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:55.117665 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:55.117665 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:55.117665 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:58:55.117665 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.199s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:58:55.118152 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 09:58:55.119632 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] HCTL ('15', '-', '-', 0) found on session 19 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 09:58:55.119798 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 09:58:55.127685 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 09:58:55.127898 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 09:58:55.134345 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Searching for a device in session 19 and hctl ['15', '*', '*', 0] yield: None {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 09:58:55.140773 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:55.140773 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:55.140773 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:55.140773 np0000001613 nova-compute[98321]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:55.140773 np0000001613 nova-compute[98321]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:55.140773 np0000001613 nova-compute[98321]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:58:55.140773 np0000001613 nova-compute[98321]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:58:55.140773 np0000001613 nova-compute[98321]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f (non-flash)
May 28 09:58:55.140773 np0000001613 nova-compute[98321]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f (non-flash)
May 28 09:58:55.140773 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:55.140773 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:55.140773 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:55.140773 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:55.140773 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:55.140773 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:55.140773 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:55.140773 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:58:55.140773 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:55.140773 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:55.140773 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:55.140773 np0000001613 nova-compute[98321]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:55.140773 np0000001613 nova-compute[98321]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:55.140773 np0000001613 nova-compute[98321]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:58:55.140773 np0000001613 nova-compute[98321]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:58:55.140773 np0000001613 nova-compute[98321]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f (non-flash)
May 28 09:58:55.140773 np0000001613 nova-compute[98321]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f (non-flash)
May 28 09:58:55.140773 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:55.140773 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:55.140773 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:55.140773 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:55.140773 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:55.140773 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:55.140773 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:55.140773 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:58:55.140773 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.219s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:58:55.140773 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 09:58:55.143624 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] HCTL ('16', '-', '-', 0) found on session 20 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 09:58:55.143759 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 09:58:55.159559 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Searching for a device in session 20 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 09:58:55.159559 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '40a97e39-f123-40c3-8fd8-3d6ff5cda98f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 09:58:55.286801 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:55.319112 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:55.323681 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:55.435630 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:55.494538 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e3367d8a-d5cd-43a4-9934-953489a3e493 tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Lock "92fbf243-1c5b-47f6-9317-3fb2655651db" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 8.712s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:55.503608 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:55.504990 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:55.539445 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f1b4ab01-a8da-4668-85b0-643184cbc32a req-ef5a23c1-daa4-4ff8-b57a-13b22ba35ca7 service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Received event network-vif-plugged-9d6ec393-b62a-4342-a355-3cf8291ec2fe {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:55.539445 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f1b4ab01-a8da-4668-85b0-643184cbc32a req-ef5a23c1-daa4-4ff8-b57a-13b22ba35ca7 service nova] Acquiring lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:55.539445 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f1b4ab01-a8da-4668-85b0-643184cbc32a req-ef5a23c1-daa4-4ff8-b57a-13b22ba35ca7 service nova] Lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:55.539445 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f1b4ab01-a8da-4668-85b0-643184cbc32a req-ef5a23c1-daa4-4ff8-b57a-13b22ba35ca7 service nova] Lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:55.539445 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f1b4ab01-a8da-4668-85b0-643184cbc32a req-ef5a23c1-daa4-4ff8-b57a-13b22ba35ca7 service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] No waiting events found dispatching network-vif-plugged-9d6ec393-b62a-4342-a355-3cf8291ec2fe {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:58:55.540494 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-f1b4ab01-a8da-4668-85b0-643184cbc32a req-ef5a23c1-daa4-4ff8-b57a-13b22ba35ca7 service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Received unexpected event network-vif-plugged-9d6ec393-b62a-4342-a355-3cf8291ec2fe for instance with vm_state active and task_state rescuing.
May 28 09:58:55.576939 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-e6a6a5af-1cef-4f88-b348-5ead81bc7ee5 req-66d3f884-5f5c-4246-9282-dc2ea6c3a6de service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:55.632307 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 09:58:55.770524 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:58:55.770524 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:58:55.770524 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:58:55.770524 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] No VIF found with MAC fa:16:3e:14:ef:87, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 09:58:55.815993 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-e6a6a5af-1cef-4f88-b348-5ead81bc7ee5 req-66d3f884-5f5c-4246-9282-dc2ea6c3a6de service nova] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Updated VIF entry in instance network info cache for port fec718e7-b773-4907-abf5-60f374bd420a. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 09:58:55.816369 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-e6a6a5af-1cef-4f88-b348-5ead81bc7ee5 req-66d3f884-5f5c-4246-9282-dc2ea6c3a6de service nova] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Updating instance_info_cache with network_info: [{"id": "fec718e7-b773-4907-abf5-60f374bd420a", "address": "fa:16:3e:ae:54:17", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec718e7-b7", "ovs_interfaceid": "fec718e7-b773-4907-abf5-60f374bd420a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:58:56.135243 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Searching for a device in session 19 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 09:58:56.135478 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '40a97e39-f123-40c3-8fd8-3d6ff5cda98f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 09:58:56.142612 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.908s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:56.143297 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 09:58:56.146001 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.731s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:56.146263 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:56.146477 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Auditing locally available compute resources for np0000001613 (node: np0000001613) {{(pid=98321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 09:58:56.206137 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962336.2057016, 57d353b6-133e-4354-a4f4-7bcec543d586 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:58:56.206382 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] VM Resumed (Lifecycle Event)
May 28 09:58:56.211330 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fcd8c94-abac-4212-9248-894abb142499 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:58:56.318804 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e6a6a5af-1cef-4f88-b348-5ead81bc7ee5 req-66d3f884-5f5c-4246-9282-dc2ea6c3a6de service nova] Releasing lock "refresh_cache-c9416092-d229-4f59-aaf3-3b0b692e7924" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:58:56.576037 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-55d71829-747f-4567-b2ff-7764e8d1f14d tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Acquiring lock "92fbf243-1c5b-47f6-9317-3fb2655651db" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:56.576532 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-55d71829-747f-4567-b2ff-7764e8d1f14d tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Lock "92fbf243-1c5b-47f6-9317-3fb2655651db" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:56.576532 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-55d71829-747f-4567-b2ff-7764e8d1f14d tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Acquiring lock "92fbf243-1c5b-47f6-9317-3fb2655651db-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:56.576532 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-55d71829-747f-4567-b2ff-7764e8d1f14d tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Lock "92fbf243-1c5b-47f6-9317-3fb2655651db-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:56.576738 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-55d71829-747f-4567-b2ff-7764e8d1f14d tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Lock "92fbf243-1c5b-47f6-9317-3fb2655651db-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:56.581407 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-55d71829-747f-4567-b2ff-7764e8d1f14d tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Terminating instance
May 28 09:58:56.649514 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 09:58:56.650521 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 09:58:56.650802 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:56.651089 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:56.710709 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:58:56.713712 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 09:58:56.768621 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9297977bbf334232a4a74bd6808b863b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a85ba31f98b45b6974118c6560bbc53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 09:58:56.936406 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Found WWN 33000000077562fe3 for multipath device dm-6 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 09:58:56.936774 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:58:56.937146 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] <== connect_volume: return (5394ms) {'type': 'block', 'scsi_wwn': '33000000077562fe3', 'path': '/dev/dm-6', 'multipath_id': '33000000077562fe3'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 09:58:56.937146 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000077562fe3', 'path': '/dev/dm-6', 'multipath_id': '33000000077562fe3'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 09:58:56.939442 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.744s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:58:56.939953 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4', 'iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'efda049f-2154-4df6-8c7b-026a19b94dd4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 09:58:56.940088 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 09:58:56.940669 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lazy-loading 'flavor' on Instance uuid e2856743-3a60-4be1-b29c-b4de06f14783 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:58:56.980048 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:56.980048 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:56.980048 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:56.980048 np0000001613 nova-compute[98321]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:56.980048 np0000001613 nova-compute[98321]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:56.980048 np0000001613 nova-compute[98321]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:58:56.980048 np0000001613 nova-compute[98321]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:58:56.980048 np0000001613 nova-compute[98321]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f (non-flash)
May 28 09:58:56.980048 np0000001613 nova-compute[98321]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f (non-flash)
May 28 09:58:56.980048 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:56.980048 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:56.980048 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:56.980048 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:56.980048 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:56.980048 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:56.980048 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:56.980048 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:58:56.980814 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:56.980814 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:56.980814 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:58:56.980814 np0000001613 nova-compute[98321]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:56.980814 np0000001613 nova-compute[98321]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4 (non-flash)
May 28 09:58:56.980814 np0000001613 nova-compute[98321]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:58:56.980814 np0000001613 nova-compute[98321]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:58:56.980814 np0000001613 nova-compute[98321]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f (non-flash)
May 28 09:58:56.980814 np0000001613 nova-compute[98321]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f (non-flash)
May 28 09:58:56.980814 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:56.980814 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:58:56.980814 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:56.980814 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:58:56.980814 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:56.980814 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:58:56.980814 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:58:56.980814 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:58:56.980814 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0', '4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5', '8'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480', '9')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 09:58:56.980814 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4', '15')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 09:58:56.981984 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4', '16')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 09:58:56.983338 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1f47142c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4'): ({'sdo'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4'): ({'sdn'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 09:58:56.983600 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Removing multipathed devices sdn, sdo {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 09:58:56.983809 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Flush multipath device 330000000a150f8d4 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 09:58:57.026701 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 09:58:57.077050 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 09:58:57.085083 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-55d71829-747f-4567-b2ff-7764e8d1f14d tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 09:58:57.118581 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:57.124134 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:57.125517 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Checking to see if SCSI volumes sdn, sdo have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 09:58:57.125517 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] SCSI volumes sdn, sdo have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 09:58:57.128290 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Checking to see if device paths {'sdn', 'sdo'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 09:58:57.144004 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Device paths {'sdn', 'sdo'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 09:58:57.145318 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 09:58:57.149458 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:57.153318 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 09:58:57.161922 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Acquiring lock "4a28d569-1ca9-4657-840c-7bb31d4644c8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:57.162222 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "4a28d569-1ca9-4657-840c-7bb31d4644c8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:57.168931 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:57.184250 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:57.195233 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a28d569-1ca9-4657-840c-7bb31d4644c8/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:57.223145 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962337.2218893, 57d353b6-133e-4354-a4f4-7bcec543d586 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:58:57.223145 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] VM Started (Lifecycle Event)
May 28 09:58:57.230087 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4, portal: 192.168.40.100,3260]
May 28 09:58:57.230087 np0000001613 nova-compute[98321]: Logout of [sid: 15, target: iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4, portal: 192.168.40.100,3260] successful.
May 28 09:58:57.230087 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:57.263680 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:57.274329 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-4e1b0e0b-4f53-4d41-9290-827dce2d08e6 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Unrescuing
May 28 09:58:57.275232 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4e1b0e0b-4f53-4d41-9290-827dce2d08e6 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "refresh_cache-57d353b6-133e-4354-a4f4-7bcec543d586" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:58:57.275232 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4e1b0e0b-4f53-4d41-9290-827dce2d08e6 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquired lock "refresh_cache-57d353b6-133e-4354-a4f4-7bcec543d586" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:58:57.275232 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-4e1b0e0b-4f53-4d41-9290-827dce2d08e6 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 09:58:57.278550 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:57.298557 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a28d569-1ca9-4657-840c-7bb31d4644c8/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:57.298557 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a28d569-1ca9-4657-840c-7bb31d4644c8/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:57.341589 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-772bf6d8-6ac1-40ff-8c4e-d1255de6affb tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "0dca786c-46bb-48dc-a01a-e282daa84a89" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.650s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:57.347575 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4, portal: 192.168.50.100,3260]
May 28 09:58:57.347575 np0000001613 nova-compute[98321]: Logout of [sid: 16, target: iqn.2023-03.storpool.com:os--volume-efda049f-2154-4df6-8c7b-026a19b94dd4, portal: 192.168.50.100,3260] successful.
May 28 09:58:57.347575 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:57.379737 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:58:57.380188 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.441s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:58:57.380415 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] <== disconnect_volume: return (3184ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 09:58:57.380619 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 09:58:57.388526 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a28d569-1ca9-4657-840c-7bb31d4644c8/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:57.397220 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ad56cc-eb5b-4e2e-a421-e93deee27fe7/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:57.448200 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Attempting to attach volume 40a97e39-f123-40c3-8fd8-3d6ff5cda98f with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 09:58:57.451932 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] attach device xml: <disk type="block" device="disk">
May 28 09:58:57.451932 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 09:58:57.451932 np0000001613 nova-compute[98321]:   <alias name="ua-40a97e39-f123-40c3-8fd8-3d6ff5cda98f"/>
May 28 09:58:57.451932 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-6"/>
May 28 09:58:57.451932 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 09:58:57.451932 np0000001613 nova-compute[98321]:   <serial>40a97e39-f123-40c3-8fd8-3d6ff5cda98f</serial>
May 28 09:58:57.451932 np0000001613 nova-compute[98321]: </disk>
May 28 09:58:57.451932 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 09:58:57.472734 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Instance destroyed successfully.
May 28 09:58:57.475951 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-55d71829-747f-4567-b2ff-7764e8d1f14d tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Lazy-loading 'resources' on Instance uuid 92fbf243-1c5b-47f6-9317-3fb2655651db {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:58:57.491187 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ad56cc-eb5b-4e2e-a421-e93deee27fe7/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:57.491295 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ad56cc-eb5b-4e2e-a421-e93deee27fe7/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:57.576279 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Successfully created port: ef420b58-5bcf-43e2-8866-408b9c731893 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 09:58:57.581831 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ad56cc-eb5b-4e2e-a421-e93deee27fe7/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:57.582616 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-7 (vdb) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 09:58:57.588817 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 09:58:57.588817 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-4 (vdb) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 09:58:57.588817 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-5 (vdc) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 09:58:57.591828 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92fbf243-1c5b-47f6-9317-3fb2655651db/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:57.619629 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e149c191-9281-4f74-88ff-9b679e814543 req-cb6a0404-13f1-46cb-99e9-204586c686a3 service nova] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Received event network-vif-unplugged-89ae21a1-1d94-4446-8c5a-4aac2a148584 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:57.620362 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e149c191-9281-4f74-88ff-9b679e814543 req-cb6a0404-13f1-46cb-99e9-204586c686a3 service nova] Acquiring lock "92fbf243-1c5b-47f6-9317-3fb2655651db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:57.621428 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e149c191-9281-4f74-88ff-9b679e814543 req-cb6a0404-13f1-46cb-99e9-204586c686a3 service nova] Lock "92fbf243-1c5b-47f6-9317-3fb2655651db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:57.621428 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e149c191-9281-4f74-88ff-9b679e814543 req-cb6a0404-13f1-46cb-99e9-204586c686a3 service nova] Lock "92fbf243-1c5b-47f6-9317-3fb2655651db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:57.621428 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e149c191-9281-4f74-88ff-9b679e814543 req-cb6a0404-13f1-46cb-99e9-204586c686a3 service nova] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] No waiting events found dispatching network-vif-unplugged-89ae21a1-1d94-4446-8c5a-4aac2a148584 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:58:57.621605 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e149c191-9281-4f74-88ff-9b679e814543 req-cb6a0404-13f1-46cb-99e9-204586c686a3 service nova] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Received event network-vif-unplugged-89ae21a1-1d94-4446-8c5a-4aac2a148584 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 09:58:57.637191 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-55b86665-99f1-401d-b008-d63f7173c034 req-86915e63-7c2a-4c80-a0b5-5b65318e39f4 service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Received event network-vif-plugged-9d6ec393-b62a-4342-a355-3cf8291ec2fe {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:57.637191 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-55b86665-99f1-401d-b008-d63f7173c034 req-86915e63-7c2a-4c80-a0b5-5b65318e39f4 service nova] Acquiring lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:57.637191 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-55b86665-99f1-401d-b008-d63f7173c034 req-86915e63-7c2a-4c80-a0b5-5b65318e39f4 service nova] Lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:57.637191 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-55b86665-99f1-401d-b008-d63f7173c034 req-86915e63-7c2a-4c80-a0b5-5b65318e39f4 service nova] Lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:57.637191 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-55b86665-99f1-401d-b008-d63f7173c034 req-86915e63-7c2a-4c80-a0b5-5b65318e39f4 service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] No waiting events found dispatching network-vif-plugged-9d6ec393-b62a-4342-a355-3cf8291ec2fe {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:58:57.637191 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-55b86665-99f1-401d-b008-d63f7173c034 req-86915e63-7c2a-4c80-a0b5-5b65318e39f4 service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Received unexpected event network-vif-plugged-9d6ec393-b62a-4342-a355-3cf8291ec2fe for instance with vm_state rescued and task_state unrescuing.
May 28 09:58:57.662084 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 09:58:57.674202 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lazy-loading 'flavor' on Instance uuid 4a28d569-1ca9-4657-840c-7bb31d4644c8 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:58:57.698959 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92fbf243-1c5b-47f6-9317-3fb2655651db/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:57.698959 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92fbf243-1c5b-47f6-9317-3fb2655651db/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:57.733450 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:58:57.735760 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 09:58:57.780618 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-4e1b0e0b-4f53-4d41-9290-827dce2d08e6 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:57.794245 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92fbf243-1c5b-47f6-9317-3fb2655651db/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:57.797210 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/289e2914-2be4-4f46-92e0-fa623f8db861/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:57.887753 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/289e2914-2be4-4f46-92e0-fa623f8db861/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:57.893500 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/289e2914-2be4-4f46-92e0-fa623f8db861/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:57.954660 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:57.978452 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Lazy-loading 'flavor' on Instance uuid 49ff17d1-cad9-463e-b5c1-3315c52412e6 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:58:57.981581 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-55d71829-747f-4567-b2ff-7764e8d1f14d tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:57:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1949896838',display_name='tempest-AttachSCSIVolumeTestJSON-server-1949896838',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachscsivolumetestjson-server-1949896838',id=5,image_ref='a1c252d6-491c-463d-87b2-a292a48083c5',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGM9TdR/OPIO9MiysANrzVBSzEbB0EmX/M3wNHB8gm6xBT8dBwF+rGmlDcy4bckPDS+I1+HdzKtgADMsraC6PVmcxPgE8+RQEgAVM5fmqviSdhcjEtE0UhcjZmysAX109Q==',key_name='tempest-keypair-1629740098',keypairs=<?>,launch_index=0,launched_at=2026-05-28T09:57:55Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='baa985120ab84c2a93a64fdab8e0d4e8',ramdisk_id='',reservation_id='r-9c63yvho',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a1c252d6-491c-463d-87b2-a292a48083c5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-418965369',owner_user_name='tempest-AttachSCSIVolumeTestJSON-418965369-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T09:57:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73c6a47f86bc47e4a7cd7260dc5edae1',uuid=92fbf243-1c5b-47f6-9317-3fb2655651db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89ae21a1-1d94-4446-8c5a-4aac2a148584", "address": "fa:16:3e:fb:01:60", "network": {"id": "ef2b39d2-3b8b-4ce9-87ad-a8930410e6ef", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1224875930-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "baa985120ab84c2a93a64fdab8e0d4e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ae21a1-1d", "ovs_interfaceid": "89ae21a1-1d94-4446-8c5a-4aac2a148584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 09:58:57.981801 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-55d71829-747f-4567-b2ff-7764e8d1f14d tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Converting VIF {"id": "89ae21a1-1d94-4446-8c5a-4aac2a148584", "address": "fa:16:3e:fb:01:60", "network": {"id": "ef2b39d2-3b8b-4ce9-87ad-a8930410e6ef", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1224875930-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "baa985120ab84c2a93a64fdab8e0d4e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ae21a1-1d", "ovs_interfaceid": "89ae21a1-1d94-4446-8c5a-4aac2a148584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:58:57.982788 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-55d71829-747f-4567-b2ff-7764e8d1f14d tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:01:60,bridge_name='br-int',has_traffic_filtering=True,id=89ae21a1-1d94-4446-8c5a-4aac2a148584,network=Network(ef2b39d2-3b8b-4ce9-87ad-a8930410e6ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89ae21a1-1d') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:58:57.983089 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-55d71829-747f-4567-b2ff-7764e8d1f14d tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:01:60,bridge_name='br-int',has_traffic_filtering=True,id=89ae21a1-1d94-4446-8c5a-4aac2a148584,network=Network(ef2b39d2-3b8b-4ce9-87ad-a8930410e6ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89ae21a1-1d') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 09:58:57.986633 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:57.987069 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89ae21a1-1d, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:57.991593 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:57.997228 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:58:57.998647 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:57.998957 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fd6621a9-2207-420f-a0ce-312603c08eeb) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:58:58.002217 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/289e2914-2be4-4f46-92e0-fa623f8db861/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:58.002217 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:58:58.002908 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:58.004893 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 09:58:58.005177 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57d353b6-133e-4354-a4f4-7bcec543d586/disk.rescue --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:58.021432 np0000001613 nova-compute[98321]: INFO os_vif [None req-55d71829-747f-4567-b2ff-7764e8d1f14d tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:01:60,bridge_name='br-int',has_traffic_filtering=True,id=89ae21a1-1d94-4446-8c5a-4aac2a148584,network=Network(ef2b39d2-3b8b-4ce9-87ad-a8930410e6ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89ae21a1-1d')
May 28 09:58:58.023716 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-55d71829-747f-4567-b2ff-7764e8d1f14d tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Deleting instance files /opt/stack/data/nova/instances/92fbf243-1c5b-47f6-9317-3fb2655651db_del
May 28 09:58:58.025367 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-55d71829-747f-4567-b2ff-7764e8d1f14d tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Deletion of /opt/stack/data/nova/instances/92fbf243-1c5b-47f6-9317-3fb2655651db_del complete
May 28 09:58:58.105945 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57d353b6-133e-4354-a4f4-7bcec543d586/disk.rescue --force-share --output=json" returned: 0 in 0.101s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:58.106399 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57d353b6-133e-4354-a4f4-7bcec543d586/disk.rescue --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:58.193735 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57d353b6-133e-4354-a4f4-7bcec543d586/disk.rescue --force-share --output=json" returned: 0 in 0.087s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:58.198456 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dca786c-46bb-48dc-a01a-e282daa84a89/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:58.242088 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 28 09:58:58.242667 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999751758000002 future=<Future at 0x73c1f473e600 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:58:58.243299 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999296681000033 future=<Future at 0x73c1f473e600 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:58:58.243299 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999130913000045 future=<Future at 0x73c1f473e600 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:58:58.253681 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-4e1b0e0b-4f53-4d41-9290-827dce2d08e6 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:58.284951 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dca786c-46bb-48dc-a01a-e282daa84a89/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:58.285426 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dca786c-46bb-48dc-a01a-e282daa84a89/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:58.372793 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dca786c-46bb-48dc-a01a-e282daa84a89/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:58.373190 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-9 (vdb) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 09:58:58.376055 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ff17d1-cad9-463e-b5c1-3315c52412e6/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:58.415236 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-4e1b0e0b-4f53-4d41-9290-827dce2d08e6 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Updating instance_info_cache with network_info: [{"id": "9d6ec393-b62a-4342-a355-3cf8291ec2fe", "address": "fa:16:3e:7a:26:b6", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d6ec393-b6", "ovs_interfaceid": "9d6ec393-b62a-4342-a355-3cf8291ec2fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:58:58.466966 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ff17d1-cad9-463e-b5c1-3315c52412e6/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:58.467396 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ff17d1-cad9-463e-b5c1-3315c52412e6/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:58.538970 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-55d71829-747f-4567-b2ff-7764e8d1f14d tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Took 1.45 seconds to destroy the instance on the hypervisor.
May 28 09:58:58.539824 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-55d71829-747f-4567-b2ff-7764e8d1f14d tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 09:58:58.540024 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 09:58:58.540227 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 09:58:58.540521 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:58.558960 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ff17d1-cad9-463e-b5c1-3315c52412e6/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:58.561786 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:58.639320 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783/disk --force-share --output=json" returned: 0 in 0.077s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:58.639972 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:58.656155 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:58:58.691006 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 09:58:58.694668 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "4a28d569-1ca9-4657-840c-7bb31d4644c8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.532s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:58.695914 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 09:58:58.696439 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Creating image(s)
May 28 09:58:58.697478 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "/opt/stack/data/nova/instances/83f9ce5f-44cb-40c6-be1a-8d5134ee8902/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:58.700545 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "/opt/stack/data/nova/instances/83f9ce5f-44cb-40c6-be1a-8d5134ee8902/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:58.704499 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "/opt/stack/data/nova/instances/83f9ce5f-44cb-40c6-be1a-8d5134ee8902/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:58.705256 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:58:58.709585 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:58:58.710722 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:58.723989 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:58.726483 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 09:58:58.734237 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:58.780503 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Successfully updated port: ef420b58-5bcf-43e2-8866-408b9c731893 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 09:58:58.794877 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.085s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:58.795367 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:58.796034 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:58.797245 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:58:58.802336 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:58:58.804563 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:58.844294 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:58.844294 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:58.899388 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.095s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:58.899828 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/83f9ce5f-44cb-40c6-be1a-8d5134ee8902/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:58.922003 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4e1b0e0b-4f53-4d41-9290-827dce2d08e6 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Releasing lock "refresh_cache-57d353b6-133e-4354-a4f4-7bcec543d586" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:58:58.923612 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-4e1b0e0b-4f53-4d41-9290-827dce2d08e6 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lazy-loading 'flavor' on Instance uuid 57d353b6-133e-4354-a4f4-7bcec543d586 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:58:58.945221 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:58.948397 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:58.962660 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/83f9ce5f-44cb-40c6-be1a-8d5134ee8902/disk 1073741824" returned: 0 in 0.062s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:58.963708 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.168s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:58.964212 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:58.994192 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ab1281e5-e299-4a35-8075-6985ce4b8a90 tempest-VolumesAssistedSnapshotsTest-992208016 tempest-VolumesAssistedSnapshotsTest-992208016-project-admin] Lock "49ff17d1-cad9-463e-b5c1-3315c52412e6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.047s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:59.032044 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:59.034320 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:59.055187 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.090s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:59.056277 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Checking if we can resize image /opt/stack/data/nova/instances/83f9ce5f-44cb-40c6-be1a-8d5134ee8902/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 09:58:59.056579 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83f9ce5f-44cb-40c6-be1a-8d5134ee8902/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:59.129978 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:59.138808 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 09:58:59.138808 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:59.153088 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83f9ce5f-44cb-40c6-be1a-8d5134ee8902/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:59.156178 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Cannot resize image /opt/stack/data/nova/instances/83f9ce5f-44cb-40c6-be1a-8d5134ee8902/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 09:58:59.157702 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 09:58:59.158475 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Ensure instance console log exists: /opt/stack/data/nova/instances/83f9ce5f-44cb-40c6-be1a-8d5134ee8902/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 09:58:59.160009 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:59.160009 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:59.160009 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:59.177923 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:59.181458 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "env LANG=C uptime" returned: 0 in 0.043s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:58:59.181805 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Hypervisor/Node resource view: name=np0000001613 free_ram=11425MB free_disk=74.40847396850586GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 09:58:59.181938 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:59.182109 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:59.186544 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:58:59.186842 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:58:59.187006 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] No VIF found with MAC fa:16:3e:9a:42:b3, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 09:58:59.286561 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "refresh_cache-83f9ce5f-44cb-40c6-be1a-8d5134ee8902" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:58:59.286765 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquired lock "refresh_cache-83f9ce5f-44cb-40c6-be1a-8d5134ee8902" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:58:59.287022 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 09:58:59.424219 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b24aca79-5a10-4448-9491-26ced23bf554 req-7b2410a8-fbd0-4e9f-8493-5332eeb941e2 service nova] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Received event network-vif-deleted-89ae21a1-1d94-4446-8c5a-4aac2a148584 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:59.424219 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-b24aca79-5a10-4448-9491-26ced23bf554 req-7b2410a8-fbd0-4e9f-8493-5332eeb941e2 service nova] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Neutron deleted interface 89ae21a1-1d94-4446-8c5a-4aac2a148584; detaching it from the instance and deleting it from the info cache
May 28 09:58:59.426061 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b24aca79-5a10-4448-9491-26ced23bf554 req-7b2410a8-fbd0-4e9f-8493-5332eeb941e2 service nova] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Detach interface failed, port_id=89ae21a1-1d94-4446-8c5a-4aac2a148584, reason: Instance 92fbf243-1c5b-47f6-9317-3fb2655651db could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 09:58:59.454432 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:59.461399 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:59.482256 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:59.631612 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:59.637781 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:58:59.720755 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-24e6db15-9f68-471c-9e56-1d7ee862cab0 req-ee8bdcef-fbb6-4f2e-bd02-6315bdaf092e service nova] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Received event network-vif-unplugged-89ae21a1-1d94-4446-8c5a-4aac2a148584 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:59.722198 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-24e6db15-9f68-471c-9e56-1d7ee862cab0 req-ee8bdcef-fbb6-4f2e-bd02-6315bdaf092e service nova] Acquiring lock "92fbf243-1c5b-47f6-9317-3fb2655651db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:59.723092 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-24e6db15-9f68-471c-9e56-1d7ee862cab0 req-ee8bdcef-fbb6-4f2e-bd02-6315bdaf092e service nova] Lock "92fbf243-1c5b-47f6-9317-3fb2655651db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:59.723126 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-24e6db15-9f68-471c-9e56-1d7ee862cab0 req-ee8bdcef-fbb6-4f2e-bd02-6315bdaf092e service nova] Lock "92fbf243-1c5b-47f6-9317-3fb2655651db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:59.723312 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-24e6db15-9f68-471c-9e56-1d7ee862cab0 req-ee8bdcef-fbb6-4f2e-bd02-6315bdaf092e service nova] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] No waiting events found dispatching network-vif-unplugged-89ae21a1-1d94-4446-8c5a-4aac2a148584 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:58:59.724137 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-24e6db15-9f68-471c-9e56-1d7ee862cab0 req-ee8bdcef-fbb6-4f2e-bd02-6315bdaf092e service nova] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Received event network-vif-unplugged-89ae21a1-1d94-4446-8c5a-4aac2a148584 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 09:58:59.724309 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-24e6db15-9f68-471c-9e56-1d7ee862cab0 req-ee8bdcef-fbb6-4f2e-bd02-6315bdaf092e service nova] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Received event network-changed-ef420b58-5bcf-43e2-8866-408b9c731893 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:59.724426 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-24e6db15-9f68-471c-9e56-1d7ee862cab0 req-ee8bdcef-fbb6-4f2e-bd02-6315bdaf092e service nova] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Refreshing instance network info cache due to event network-changed-ef420b58-5bcf-43e2-8866-408b9c731893. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 09:58:59.724665 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-24e6db15-9f68-471c-9e56-1d7ee862cab0 req-ee8bdcef-fbb6-4f2e-bd02-6315bdaf092e service nova] Acquiring lock "refresh_cache-83f9ce5f-44cb-40c6-be1a-8d5134ee8902" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:58:59.726448 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-9b369d4e-38b2-4369-8586-c4d2f72e1bd4 req-21042190-75b9-44ba-93bc-e5f8f5a2aa02 service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Received event network-vif-unplugged-9d6ec393-b62a-4342-a355-3cf8291ec2fe {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:58:59.727142 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9b369d4e-38b2-4369-8586-c4d2f72e1bd4 req-21042190-75b9-44ba-93bc-e5f8f5a2aa02 service nova] Acquiring lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:59.727719 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9b369d4e-38b2-4369-8586-c4d2f72e1bd4 req-21042190-75b9-44ba-93bc-e5f8f5a2aa02 service nova] Lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:59.727902 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9b369d4e-38b2-4369-8586-c4d2f72e1bd4 req-21042190-75b9-44ba-93bc-e5f8f5a2aa02 service nova] Lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:58:59.728081 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-9b369d4e-38b2-4369-8586-c4d2f72e1bd4 req-21042190-75b9-44ba-93bc-e5f8f5a2aa02 service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] No waiting events found dispatching network-vif-unplugged-9d6ec393-b62a-4342-a355-3cf8291ec2fe {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:58:59.728269 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-9b369d4e-38b2-4369-8586-c4d2f72e1bd4 req-21042190-75b9-44ba-93bc-e5f8f5a2aa02 service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Received unexpected event network-vif-unplugged-9d6ec393-b62a-4342-a355-3cf8291ec2fe for instance with vm_state rescued and task_state unrescuing.
May 28 09:58:59.785446 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Acquiring lock "4a28d569-1ca9-4657-840c-7bb31d4644c8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:58:59.790716 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "4a28d569-1ca9-4657-840c-7bb31d4644c8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:58:59.790716 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Attaching volume 07c39f6e-3598-45d7-bec8-99175bbf3453 to /dev/vdb
May 28 09:58:59.796858 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999683631999915 future=<Future at 0x73c1fc5e42c0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:58:59.798731 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Instance destroyed successfully.
May 28 09:58:59.802948 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-4e1b0e0b-4f53-4d41-9290-827dce2d08e6 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lazy-loading 'numa_topology' on Instance uuid 57d353b6-133e-4354-a4f4-7bcec543d586 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:58:59.852762 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 09:58:59.863108 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 09:58:59.867955 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 09:58:59.880945 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:58:59.891800 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:58:59.922223 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 09:58:59.922524 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 09:58:59.930408 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 09:58:59.932898 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe95:8bd3', 'fe80::fc16:3eff:fe2d:94a4', 'fe80::fc16:3eff:fe31:5106', 'fe80::fc96:34ff:fe12:e4df', 'fe80::2844:59ff:feec:5d21', 'fe80::44e2:31ff:fe81:8771', 'fe80::fc16:3eff:fe9a:42b3', 'fe80::b04e:afff:fe71:41fc', 'fe80::fc16:3eff:fe2a:719a', 'fe80::9038:13ff:fe5b:5aad', 'fe80::fc16:3eff:fe9c:2e17', 'fe80::8064:4aff:fe56:ba53', 'fe80::fc16:3eff:fe14:ef87', 'fe80::fc16:3eff:fe0c:a971', 'fe80::ac03:e9ff:fe37:b50a', 'fe80::fc16:3eff:fee8:4800', 'fe80::fc16:3eff:fe55:f221', 'fe80::fc16:3eff:fe31:6dc0', 'fe80::fc16:3eff:fe48:5cc5', 'fe80::fc16:3eff:fe07:9b94', 'fe80::3061:30ff:fee7:aa25', 'fe80::fc16:3eff:fe38:ca1f', 'fe80::888d:9dff:fe20:5f03', 'fe80::fc16:3eff:fec3:78fb', 'fe80::3428:4dff:fe09:805a', 'fe80::fc16:3eff:feae:5417'] 
May 28 09:58:59.933090 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 09:58:59.933461 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 09:58:59.933846 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] <== get_connector_properties: return (80ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 09:58:59.934253 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Updating existing volume attachment record: e9e7d372-9921-4ab9-ba9e-7193a53550b5 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 09:59:00.104421 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:59:00.274859 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 289e2914-2be4-4f46-92e0-fa623f8db861 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 09:59:00.275323 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 09:59:00.275431 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 53ad56cc-eb5b-4e2e-a421-e93deee27fe7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 09:59:00.275520 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance e2856743-3a60-4be1-b29c-b4de06f14783 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 09:59:00.275604 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 92fbf243-1c5b-47f6-9317-3fb2655651db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 09:59:00.275697 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 49ff17d1-cad9-463e-b5c1-3315c52412e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 09:59:00.275791 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 4a28d569-1ca9-4657-840c-7bb31d4644c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 09:59:00.275869 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 0dca786c-46bb-48dc-a01a-e282daa84a89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 09:59:00.275945 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 7514b113-ec17-468b-a647-de099d90e787 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 09:59:00.276021 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 57d353b6-133e-4354-a4f4-7bcec543d586 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 09:59:00.279236 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance c9416092-d229-4f59-aaf3-3b0b692e7924 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 09:59:00.279236 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 83f9ce5f-44cb-40c6-be1a-8d5134ee8902 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 09:59:00.279236 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 09:59:00.279236 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Final resource view: name=np0000001613 phys_ram=24030MB used_ram=2816MB phys_disk=95GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 09:58:59 up 31 min,  2 users,  load average: 8.08, 3.79, 1.72\n', 'num_instances': '12', 'num_vm_active': '10', 'num_task_None': '9', 'num_os_type_None': '12', 'num_proj_a9d04b105229456d9ab53df1886fdb37': '2', 'io_workload': '1', 'num_proj_cb3a501b4f4041ef875ef4d2b4167044': '2', 'num_proj_9a85ba31f98b45b6974118c6560bbc53': '2', 'num_proj_25a0adc32dd74f039cc231cceb9131a0': '1', 'num_task_deleting': '1', 'num_proj_baa985120ab84c2a93a64fdab8e0d4e8': '1', 'num_proj_af05aeb984e64ba8989f3db86750c648': '1', 'num_proj_4466c6404538446eb4c8bd45bb2a95f5': '2', 'num_proj_2ab3ecfe4d75434cbf3cb49d37042d15': '1', 'num_vm_rescued': '1', 'num_task_unrescuing': '1', 'num_vm_building': '1', 'num_task_spawning': '1'} {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 09:59:00.280834 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Updating instance_info_cache with network_info: [{"id": "ef420b58-5bcf-43e2-8866-408b9c731893", "address": "fa:16:3e:eb:53:44", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef420b58-5b", "ovs_interfaceid": "ef420b58-5bcf-43e2-8866-408b9c731893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:59:00.308194 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-4e1b0e0b-4f53-4d41-9290-827dce2d08e6 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Object Instance<57d353b6-133e-4354-a4f4-7bcec543d586> lazy-loaded attributes: flavor,numa_topology {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 09:59:00.384187 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Took 1.84 seconds to deallocate network for instance.
May 28 09:59:00.519706 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 09:59:00.519878 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453', 'iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '07c39f6e-3598-45d7-bec8-99175bbf3453', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 09:59:00.520004 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:59:00.520435 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:59:00.520859 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453', 'iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '07c39f6e-3598-45d7-bec8-99175bbf3453', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 09:59:00.533730 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:59:00.534448 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:59:00.534938 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:59:00.535273 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 09:59:00.535616 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:59:00.535862 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.startup = automatic
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.port = 0
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.session.scan = manual
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 09:59:00.547944 np0000001613 nova-compute[98321]: # END RECORD
May 28 09:59:00.547944 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.startup = automatic
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.port = 0
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.session.scan = manual
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 09:59:00.558405 np0000001613 nova-compute[98321]: # END RECORD
May 28 09:59:00.558405 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:00.563617 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:00.574744 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:00.588396 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:59:00.588396 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:00.588396 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:00.588396 np0000001613 nova-compute[98321]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:59:00.588396 np0000001613 nova-compute[98321]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:59:00.588396 np0000001613 nova-compute[98321]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f (non-flash)
May 28 09:59:00.588396 np0000001613 nova-compute[98321]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f (non-flash)
May 28 09:59:00.588396 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:59:00.588396 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:59:00.588396 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:00.588396 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:00.588396 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:59:00.588396 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:59:00.588396 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:59:00.588396 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:59:00.588935 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:59:00.588935 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:00.588935 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:00.588935 np0000001613 nova-compute[98321]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:59:00.588935 np0000001613 nova-compute[98321]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:59:00.588935 np0000001613 nova-compute[98321]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f (non-flash)
May 28 09:59:00.588935 np0000001613 nova-compute[98321]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f (non-flash)
May 28 09:59:00.588935 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:59:00.588935 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:59:00.588935 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:00.588935 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:00.588935 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:59:00.588935 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:59:00.588935 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:59:00.588935 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:59:00.588935 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.054s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:59:00.588935 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 09:59:00.589657 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] HCTL ('21', '0', '0', 0) found on session 17 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 09:59:00.589776 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Scanning host 21 c: 0, t: 0, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 09:59:00.596972 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:59:00.596972 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:00.596972 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:00.596972 np0000001613 nova-compute[98321]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:59:00.596972 np0000001613 nova-compute[98321]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:59:00.596972 np0000001613 nova-compute[98321]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f (non-flash)
May 28 09:59:00.596972 np0000001613 nova-compute[98321]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f (non-flash)
May 28 09:59:00.596972 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:59:00.596972 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:59:00.596972 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:00.596972 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:00.596972 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:59:00.596972 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:59:00.596972 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:59:00.596972 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:59:00.597389 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:59:00.597389 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:00.597389 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:00.597389 np0000001613 nova-compute[98321]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:59:00.597389 np0000001613 nova-compute[98321]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:59:00.597389 np0000001613 nova-compute[98321]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f (non-flash)
May 28 09:59:00.597389 np0000001613 nova-compute[98321]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f (non-flash)
May 28 09:59:00.597389 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:59:00.597389 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:59:00.597389 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:00.597389 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:00.597389 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:59:00.597389 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:59:00.597389 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:59:00.597389 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:59:00.597678 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.062s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:59:00.597678 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 09:59:00.599087 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] HCTL ('22', '0', '0', 0) found on session 18 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 09:59:00.599277 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Scanning host 22 c: 0, t: 0, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 09:59:00.600259 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Searching for a device in session 17 and hctl ('21', '0', '0', 0) yield: sdp {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 09:59:00.600440 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '07c39f6e-3598-45d7-bec8-99175bbf3453', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 09:59:00.611322 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Searching for a device in session 18 and hctl ('22', '0', '0', 0) yield: sdq {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 09:59:00.611578 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Connected to sdq using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '07c39f6e-3598-45d7-bec8-99175bbf3453', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 09:59:00.669051 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d384a56e-52f9-49d3-9baf-88473c75b534 tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Acquiring lock "49ff17d1-cad9-463e-b5c1-3315c52412e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:00.669245 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d384a56e-52f9-49d3-9baf-88473c75b534 tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Lock "49ff17d1-cad9-463e-b5c1-3315c52412e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:00.669442 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d384a56e-52f9-49d3-9baf-88473c75b534 tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Acquiring lock "49ff17d1-cad9-463e-b5c1-3315c52412e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:00.669585 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d384a56e-52f9-49d3-9baf-88473c75b534 tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Lock "49ff17d1-cad9-463e-b5c1-3315c52412e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:00.669732 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d384a56e-52f9-49d3-9baf-88473c75b534 tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Lock "49ff17d1-cad9-463e-b5c1-3315c52412e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:00.672982 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-d384a56e-52f9-49d3-9baf-88473c75b534 tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Terminating instance
May 28 09:59:00.754109 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d1db3de7-d1e6-4718-b578-3e45d2e8505e tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lock "e2856743-3a60-4be1-b29c-b4de06f14783" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.948s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:00.782921 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Releasing lock "refresh_cache-83f9ce5f-44cb-40c6-be1a-8d5134ee8902" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:59:00.783329 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Instance network_info: |[{"id": "ef420b58-5bcf-43e2-8866-408b9c731893", "address": "fa:16:3e:eb:53:44", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef420b58-5b", "ovs_interfaceid": "ef420b58-5bcf-43e2-8866-408b9c731893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 09:59:00.786383 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-24e6db15-9f68-471c-9e56-1d7ee862cab0 req-ee8bdcef-fbb6-4f2e-bd02-6315bdaf092e service nova] Acquired lock "refresh_cache-83f9ce5f-44cb-40c6-be1a-8d5134ee8902" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:59:00.786383 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-24e6db15-9f68-471c-9e56-1d7ee862cab0 req-ee8bdcef-fbb6-4f2e-bd02-6315bdaf092e service nova] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Refreshing network info cache for port ef420b58-5bcf-43e2-8866-408b9c731893 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 09:59:00.787890 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Start _get_guest_xml network_info=[{"id": "ef420b58-5bcf-43e2-8866-408b9c731893", "address": "fa:16:3e:eb:53:44", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef420b58-5b", "ovs_interfaceid": "ef420b58-5bcf-43e2-8866-408b9c731893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 09:59:00.805142 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:00.806540 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 09:59:00.808336 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-1228794281', uuid='83f9ce5f-44cb-40c6-be1a-8d5134ee8902'), owner=OwnerMeta(userid='9297977bbf334232a4a74bd6808b863b', username='tempest-AttachVolumeNegativeTest-775348461-project-member', projectid='9a85ba31f98b45b6974118c6560bbc53', projectname='tempest-AttachVolumeNegativeTest-775348461'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ef420b58-5bcf-43e2-8866-408b9c731893", "address": "fa:16:3e:eb:53:44", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef420b58-5b", "ovs_interfaceid": "ef420b58-5bcf-43e2-8866-408b9c731893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962340.8078122) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 09:59:00.823667 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 09:59:00.826299 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 09:59:00.828073 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 09:59:00.828894 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 09:59:00.829327 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 09:59:00.829701 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 09:59:00.831828 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 09:59:00.832544 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 09:59:00.840110 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 09:59:00.840460 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:00.840667 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 09:59:00.840847 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 09:59:00.842996 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 09:59:00.843131 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 09:59:00.843298 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 09:59:00.843419 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 09:59:00.843570 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 09:59:00.859706 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T09:58:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1228794281',display_name='tempest-AttachVolumeNegativeTest-server-1228794281',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumenegativetest-server-1228794281',id=12,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2i+zX9coT9fsArGdEpPip5bZsP5t+5Wn76McZDXd0JEko601eljutvz6KUK5V4YIhsXgLAUsAqM4s1yNGDRvohGl7rIECGbcUCggnSraY6FDvJbepAgl0eQHxE0iAgEg==',key_name='tempest-keypair-735349052',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a85ba31f98b45b6974118c6560bbc53',ramdisk_id='',reservation_id='r-9uvqj34l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-775348461',owner_user_name='tempest-AttachVolumeNegativeTest-775348461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:58:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9297977bbf334232a4a74bd6808b863b',uuid=83f9ce5f-44cb-40c6-be1a-8d5134ee8902,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef420b58-5bcf-43e2-8866-408b9c731893", "address": "fa:16:3e:eb:53:44", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef420b58-5b", "ovs_interfaceid": "ef420b58-5bcf-43e2-8866-408b9c731893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 09:59:00.860004 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Converting VIF {"id": "ef420b58-5bcf-43e2-8866-408b9c731893", "address": "fa:16:3e:eb:53:44", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef420b58-5b", "ovs_interfaceid": "ef420b58-5bcf-43e2-8866-408b9c731893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:59:00.860706 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:53:44,bridge_name='br-int',has_traffic_filtering=True,id=ef420b58-5bcf-43e2-8866-408b9c731893,network=Network(bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef420b58-5b') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:59:00.861356 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lazy-loading 'pci_devices' on Instance uuid 83f9ce5f-44cb-40c6-be1a-8d5134ee8902 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:59:00.891928 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-55d71829-747f-4567-b2ff-7764e8d1f14d tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:00.944563 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:00.984051 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 09:59:00.984618 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 09:59:01.005999 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:01.009625 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:01.177586 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d384a56e-52f9-49d3-9baf-88473c75b534 tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 09:59:01.212000 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:01.218942 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:01.238209 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:01.245311 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:01.270786 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:01.289396 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-24e6db15-9f68-471c-9e56-1d7ee862cab0 req-ee8bdcef-fbb6-4f2e-bd02-6315bdaf092e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:59:01.364779 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] End _get_guest_xml xml=<domain type="qemu">
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:   <uuid>83f9ce5f-44cb-40c6-be1a-8d5134ee8902</uuid>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:   <name>instance-0000000c</name>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:   <metadata>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1228794281</nova:name>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 09:59:00</nova:creationTime>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:       </nova:image>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:         <nova:user uuid="9297977bbf334232a4a74bd6808b863b">tempest-AttachVolumeNegativeTest-775348461-project-member</nova:user>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:         <nova:project uuid="9a85ba31f98b45b6974118c6560bbc53">tempest-AttachVolumeNegativeTest-775348461</nova:project>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:         <nova:port uuid="ef420b58-5bcf-43e2-8866-408b9c731893">
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:         </nova:port>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:   </metadata>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:     <system>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:       <entry name="serial">83f9ce5f-44cb-40c6-be1a-8d5134ee8902</entry>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:       <entry name="uuid">83f9ce5f-44cb-40c6-be1a-8d5134ee8902</entry>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:     </system>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:   <os>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:   </os>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:   <features>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:     <acpi/>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:     <tcg>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:     </tcg>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:   </features>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:   <devices>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/83f9ce5f-44cb-40c6-be1a-8d5134ee8902/disk"/>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:     </disk>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/83f9ce5f-44cb-40c6-be1a-8d5134ee8902/disk.config"/>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:     </disk>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:eb:53:44"/>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:       <target dev="tapef420b58-5b"/>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:     </interface>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/83f9ce5f-44cb-40c6-be1a-8d5134ee8902/console.log" append="off"/>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:     </serial>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:     <video>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:     </video>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:     </rng>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:     </memballoon>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:   </devices>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]: </domain>
May 28 09:59:01.364779 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 09:59:01.366718 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Preparing to wait for external event network-vif-plugged-ef420b58-5bcf-43e2-8866-408b9c731893 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 09:59:01.366718 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "83f9ce5f-44cb-40c6-be1a-8d5134ee8902-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:01.366718 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "83f9ce5f-44cb-40c6-be1a-8d5134ee8902-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:01.366718 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "83f9ce5f-44cb-40c6-be1a-8d5134ee8902-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:01.366718 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T09:58:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1228794281',display_name='tempest-AttachVolumeNegativeTest-server-1228794281',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumenegativetest-server-1228794281',id=12,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2i+zX9coT9fsArGdEpPip5bZsP5t+5Wn76McZDXd0JEko601eljutvz6KUK5V4YIhsXgLAUsAqM4s1yNGDRvohGl7rIECGbcUCggnSraY6FDvJbepAgl0eQHxE0iAgEg==',key_name='tempest-keypair-735349052',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a85ba31f98b45b6974118c6560bbc53',ramdisk_id='',reservation_id='r-9uvqj34l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-775348461',owner_user_name='tempest-AttachVolumeNegativeTest-775348461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:58:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9297977bbf334232a4a74bd6808b863b',uuid=83f9ce5f-44cb-40c6-be1a-8d5134ee8902,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef420b58-5bcf-43e2-8866-408b9c731893", "address": "fa:16:3e:eb:53:44", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef420b58-5b", "ovs_interfaceid": "ef420b58-5bcf-43e2-8866-408b9c731893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 09:59:01.366718 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Converting VIF {"id": "ef420b58-5bcf-43e2-8866-408b9c731893", "address": "fa:16:3e:eb:53:44", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef420b58-5b", "ovs_interfaceid": "ef420b58-5bcf-43e2-8866-408b9c731893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:59:01.367207 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:53:44,bridge_name='br-int',has_traffic_filtering=True,id=ef420b58-5bcf-43e2-8866-408b9c731893,network=Network(bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef420b58-5b') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:59:01.367479 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:53:44,bridge_name='br-int',has_traffic_filtering=True,id=ef420b58-5bcf-43e2-8866-408b9c731893,network=Network(bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef420b58-5b') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 09:59:01.367786 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:01.368020 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:01.368288 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 09:59:01.369871 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:01.370055 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a954ad73-670f-5781-88a9-a1d8fa67d0fe', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:01.371902 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:01.373256 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:59:01.380124 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:01.383017 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:01.383284 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef420b58-5b, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:01.383753 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapef420b58-5b, col_values=(('qos', UUID('ba60cf9f-b935-4fa0-8eef-9b364ad7f4d6')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:01.383995 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapef420b58-5b, col_values=(('external_ids', {'iface-id': 'ef420b58-5bcf-43e2-8866-408b9c731893', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:53:44', 'vm-uuid': '83f9ce5f-44cb-40c6-be1a-8d5134ee8902'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:01.385066 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:01.387699 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:59:01.400806 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:01.402774 np0000001613 nova-compute[98321]: INFO os_vif [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:53:44,bridge_name='br-int',has_traffic_filtering=True,id=ef420b58-5bcf-43e2-8866-408b9c731893,network=Network(bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef420b58-5b')
May 28 09:59:01.489062 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 09:59:01.536436 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 09:59:01.546049 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.99966395399997 future=<Future at 0x73c1fc7643b0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:59:01.547760 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Instance destroyed successfully.
May 28 09:59:01.548353 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-d384a56e-52f9-49d3-9baf-88473c75b534 tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Lazy-loading 'resources' on Instance uuid 49ff17d1-cad9-463e-b5c1-3315c52412e6 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:59:01.725714 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-24e6db15-9f68-471c-9e56-1d7ee862cab0 req-ee8bdcef-fbb6-4f2e-bd02-6315bdaf092e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:59:01.784679 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-0cf311ad-c308-466b-9ea1-c72e3ce324aa req-c08eb9ec-9981-4e67-8533-a54a5dae670a service nova] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Received event network-vif-unplugged-3e64d22f-6078-49f1-9576-b70571e7f6e6 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:01.785440 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0cf311ad-c308-466b-9ea1-c72e3ce324aa req-c08eb9ec-9981-4e67-8533-a54a5dae670a service nova] Acquiring lock "49ff17d1-cad9-463e-b5c1-3315c52412e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:01.785675 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0cf311ad-c308-466b-9ea1-c72e3ce324aa req-c08eb9ec-9981-4e67-8533-a54a5dae670a service nova] Lock "49ff17d1-cad9-463e-b5c1-3315c52412e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:01.785771 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0cf311ad-c308-466b-9ea1-c72e3ce324aa req-c08eb9ec-9981-4e67-8533-a54a5dae670a service nova] Lock "49ff17d1-cad9-463e-b5c1-3315c52412e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:01.785958 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-0cf311ad-c308-466b-9ea1-c72e3ce324aa req-c08eb9ec-9981-4e67-8533-a54a5dae670a service nova] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] No waiting events found dispatching network-vif-unplugged-3e64d22f-6078-49f1-9576-b70571e7f6e6 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:59:01.786007 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-0cf311ad-c308-466b-9ea1-c72e3ce324aa req-c08eb9ec-9981-4e67-8533-a54a5dae670a service nova] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Received event network-vif-unplugged-3e64d22f-6078-49f1-9576-b70571e7f6e6 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 09:59:01.786115 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-0cf311ad-c308-466b-9ea1-c72e3ce324aa req-c08eb9ec-9981-4e67-8533-a54a5dae670a service nova] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Received event network-vif-unplugged-3e64d22f-6078-49f1-9576-b70571e7f6e6 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:01.786273 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0cf311ad-c308-466b-9ea1-c72e3ce324aa req-c08eb9ec-9981-4e67-8533-a54a5dae670a service nova] Acquiring lock "49ff17d1-cad9-463e-b5c1-3315c52412e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:01.786419 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0cf311ad-c308-466b-9ea1-c72e3ce324aa req-c08eb9ec-9981-4e67-8533-a54a5dae670a service nova] Lock "49ff17d1-cad9-463e-b5c1-3315c52412e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:01.786542 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0cf311ad-c308-466b-9ea1-c72e3ce324aa req-c08eb9ec-9981-4e67-8533-a54a5dae670a service nova] Lock "49ff17d1-cad9-463e-b5c1-3315c52412e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:01.786666 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-0cf311ad-c308-466b-9ea1-c72e3ce324aa req-c08eb9ec-9981-4e67-8533-a54a5dae670a service nova] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] No waiting events found dispatching network-vif-unplugged-3e64d22f-6078-49f1-9576-b70571e7f6e6 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:59:01.786810 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-0cf311ad-c308-466b-9ea1-c72e3ce324aa req-c08eb9ec-9981-4e67-8533-a54a5dae670a service nova] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Received event network-vif-unplugged-3e64d22f-6078-49f1-9576-b70571e7f6e6 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 09:59:01.808531 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ff7012ee-6823-489e-a6df-6dc0d1a9171f req-3301f32e-9a75-451c-846f-aed41c9f1bff service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Received event network-vif-unplugged-9d6ec393-b62a-4342-a355-3cf8291ec2fe {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:01.809734 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ff7012ee-6823-489e-a6df-6dc0d1a9171f req-3301f32e-9a75-451c-846f-aed41c9f1bff service nova] Acquiring lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:01.809734 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ff7012ee-6823-489e-a6df-6dc0d1a9171f req-3301f32e-9a75-451c-846f-aed41c9f1bff service nova] Lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:01.809734 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ff7012ee-6823-489e-a6df-6dc0d1a9171f req-3301f32e-9a75-451c-846f-aed41c9f1bff service nova] Lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:01.809734 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ff7012ee-6823-489e-a6df-6dc0d1a9171f req-3301f32e-9a75-451c-846f-aed41c9f1bff service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] No waiting events found dispatching network-vif-unplugged-9d6ec393-b62a-4342-a355-3cf8291ec2fe {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:59:01.809734 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-ff7012ee-6823-489e-a6df-6dc0d1a9171f req-3301f32e-9a75-451c-846f-aed41c9f1bff service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Received unexpected event network-vif-unplugged-9d6ec393-b62a-4342-a355-3cf8291ec2fe for instance with vm_state rescued and task_state unrescuing.
May 28 09:59:01.809734 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ff7012ee-6823-489e-a6df-6dc0d1a9171f req-3301f32e-9a75-451c-846f-aed41c9f1bff service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Received event network-vif-plugged-9d6ec393-b62a-4342-a355-3cf8291ec2fe {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:01.809734 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ff7012ee-6823-489e-a6df-6dc0d1a9171f req-3301f32e-9a75-451c-846f-aed41c9f1bff service nova] Acquiring lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:01.809734 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ff7012ee-6823-489e-a6df-6dc0d1a9171f req-3301f32e-9a75-451c-846f-aed41c9f1bff service nova] Lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:01.810244 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ff7012ee-6823-489e-a6df-6dc0d1a9171f req-3301f32e-9a75-451c-846f-aed41c9f1bff service nova] Lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:01.810244 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ff7012ee-6823-489e-a6df-6dc0d1a9171f req-3301f32e-9a75-451c-846f-aed41c9f1bff service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] No waiting events found dispatching network-vif-plugged-9d6ec393-b62a-4342-a355-3cf8291ec2fe {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:59:01.810244 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-ff7012ee-6823-489e-a6df-6dc0d1a9171f req-3301f32e-9a75-451c-846f-aed41c9f1bff service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Received unexpected event network-vif-plugged-9d6ec393-b62a-4342-a355-3cf8291ec2fe for instance with vm_state rescued and task_state unrescuing.
May 28 09:59:01.810244 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ff7012ee-6823-489e-a6df-6dc0d1a9171f req-3301f32e-9a75-451c-846f-aed41c9f1bff service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Received event network-vif-plugged-9d6ec393-b62a-4342-a355-3cf8291ec2fe {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:01.810442 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ff7012ee-6823-489e-a6df-6dc0d1a9171f req-3301f32e-9a75-451c-846f-aed41c9f1bff service nova] Acquiring lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:01.810442 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ff7012ee-6823-489e-a6df-6dc0d1a9171f req-3301f32e-9a75-451c-846f-aed41c9f1bff service nova] Lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:01.810563 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ff7012ee-6823-489e-a6df-6dc0d1a9171f req-3301f32e-9a75-451c-846f-aed41c9f1bff service nova] Lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:01.810706 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ff7012ee-6823-489e-a6df-6dc0d1a9171f req-3301f32e-9a75-451c-846f-aed41c9f1bff service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] No waiting events found dispatching network-vif-plugged-9d6ec393-b62a-4342-a355-3cf8291ec2fe {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:59:01.810841 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-ff7012ee-6823-489e-a6df-6dc0d1a9171f req-3301f32e-9a75-451c-846f-aed41c9f1bff service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Received unexpected event network-vif-plugged-9d6ec393-b62a-4342-a355-3cf8291ec2fe for instance with vm_state rescued and task_state unrescuing.
May 28 09:59:01.833097 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Removed pending STOPPED event for 57d353b6-133e-4354-a4f4-7bcec543d586 due to new event <LifecycleEvent: 1779962341.8325882, 57d353b6-133e-4354-a4f4-7bcec543d586 => Resumed> {{(pid=98321) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 09:59:01.833315 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962341.8325882, 57d353b6-133e-4354-a4f4-7bcec543d586 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:59:01.833489 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] VM Resumed (Lifecycle Event)
May 28 09:59:01.836079 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-4e1b0e0b-4f53-4d41-9290-827dce2d08e6 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:59:01.906624 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-24e6db15-9f68-471c-9e56-1d7ee862cab0 req-ee8bdcef-fbb6-4f2e-bd02-6315bdaf092e service nova] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Updated VIF entry in instance network info cache for port ef420b58-5bcf-43e2-8866-408b9c731893. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 09:59:01.906997 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-24e6db15-9f68-471c-9e56-1d7ee862cab0 req-ee8bdcef-fbb6-4f2e-bd02-6315bdaf092e service nova] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Updating instance_info_cache with network_info: [{"id": "ef420b58-5bcf-43e2-8866-408b9c731893", "address": "fa:16:3e:eb:53:44", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef420b58-5b", "ovs_interfaceid": "ef420b58-5bcf-43e2-8866-408b9c731893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:59:01.995528 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Compute_service record updated for np0000001613:np0000001613 {{(pid=98321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 09:59:01.995805 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.814s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:01.996243 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-55d71829-747f-4567-b2ff-7764e8d1f14d tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.104s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:01.996616 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 40.79 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 09:59:02.053497 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-d384a56e-52f9-49d3-9baf-88473c75b534 tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:57:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1733345190',display_name='tempest-VolumesAssistedSnapshotsTest-server-1733345190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumesassistedsnapshotstest-server-1733345190',id=6,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmJjhEiTSAuvC4mG+VG6tUVtNygtcV8o8Y4a+0I2OHI0tw+q06AbmSEJsRWkbhmxN5GXIwxf1+dwdIc5mNkx3nu7Ie10Hr4C9clRJIgKVVGkPKK7IAdtQFEm/OWOy+4MQ==',key_name='tempest-keypair-1416310460',keypairs=<?>,launch_index=0,launched_at=2026-05-28T09:57:58Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af05aeb984e64ba8989f3db86750c648',ramdisk_id='',reservation_id='r-i9kugpnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1941135530',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1941135530-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T09:57:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45e753a39564489a9afff10dd05c3ced',uuid=49ff17d1-cad9-463e-b5c1-3315c52412e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e64d22f-6078-49f1-9576-b70571e7f6e6", "address": "fa:16:3e:2a:71:9a", "network": {"id": "e91751cc-c82c-4197-9ce7-ff2b4d8440a8", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-702597350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "af05aeb984e64ba8989f3db86750c648", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e64d22f-60", "ovs_interfaceid": "3e64d22f-6078-49f1-9576-b70571e7f6e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 09:59:02.053497 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d384a56e-52f9-49d3-9baf-88473c75b534 tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Converting VIF {"id": "3e64d22f-6078-49f1-9576-b70571e7f6e6", "address": "fa:16:3e:2a:71:9a", "network": {"id": "e91751cc-c82c-4197-9ce7-ff2b4d8440a8", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-702597350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "af05aeb984e64ba8989f3db86750c648", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e64d22f-60", "ovs_interfaceid": "3e64d22f-6078-49f1-9576-b70571e7f6e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:59:02.053497 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d384a56e-52f9-49d3-9baf-88473c75b534 tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:71:9a,bridge_name='br-int',has_traffic_filtering=True,id=3e64d22f-6078-49f1-9576-b70571e7f6e6,network=Network(e91751cc-c82c-4197-9ce7-ff2b4d8440a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e64d22f-60') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:59:02.053497 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-d384a56e-52f9-49d3-9baf-88473c75b534 tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:71:9a,bridge_name='br-int',has_traffic_filtering=True,id=3e64d22f-6078-49f1-9576-b70571e7f6e6,network=Network(e91751cc-c82c-4197-9ce7-ff2b4d8440a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e64d22f-60') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 09:59:02.060364 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:02.060726 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e64d22f-60, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:02.063572 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:59:02.068939 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:02.070393 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:02.070519 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=625e9aa7-5490-4be1-94fb-9dfaf1e5df6d) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:02.071643 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:02.072114 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:59:02.079501 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:02.084518 np0000001613 nova-compute[98321]: INFO os_vif [None req-d384a56e-52f9-49d3-9baf-88473c75b534 tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:71:9a,bridge_name='br-int',has_traffic_filtering=True,id=3e64d22f-6078-49f1-9576-b70571e7f6e6,network=Network(e91751cc-c82c-4197-9ce7-ff2b4d8440a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e64d22f-60')
May 28 09:59:02.087240 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-d384a56e-52f9-49d3-9baf-88473c75b534 tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Deleting instance files /opt/stack/data/nova/instances/49ff17d1-cad9-463e-b5c1-3315c52412e6_del
May 28 09:59:02.087240 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-d384a56e-52f9-49d3-9baf-88473c75b534 tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Deletion of /opt/stack/data/nova/instances/49ff17d1-cad9-463e-b5c1-3315c52412e6_del complete
May 28 09:59:02.337244 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:59:02.338933 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 09:59:02.409588 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-24e6db15-9f68-471c-9e56-1d7ee862cab0 req-ee8bdcef-fbb6-4f2e-bd02-6315bdaf092e service nova] Releasing lock "refresh_cache-83f9ce5f-44cb-40c6-be1a-8d5134ee8902" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:59:02.551234 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Found WWN 3300000000a84ca57 for multipath device dm-9 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 09:59:02.551519 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.031s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:59:02.551622 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] <== connect_volume: return (2031ms) {'type': 'block', 'scsi_wwn': '3300000000a84ca57', 'path': '/dev/dm-9', 'multipath_id': '3300000000a84ca57'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 09:59:02.551758 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000a84ca57', 'path': '/dev/dm-9', 'multipath_id': '3300000000a84ca57'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 09:59:02.553327 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lazy-loading 'flavor' on Instance uuid 4a28d569-1ca9-4657-840c-7bb31d4644c8 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:59:02.593079 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-d384a56e-52f9-49d3-9baf-88473c75b534 tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Took 1.42 seconds to destroy the instance on the hypervisor.
May 28 09:59:02.594241 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-d384a56e-52f9-49d3-9baf-88473c75b534 tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 09:59:02.594594 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 09:59:02.594816 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 09:59:02.595105 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:59:02.678521 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:59:02.681792 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-55d71829-747f-4567-b2ff-7764e8d1f14d tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 09:59:02.681981 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-55d71829-747f-4567-b2ff-7764e8d1f14d tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 09:59:02.841583 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962342.8413167, 57d353b6-133e-4354-a4f4-7bcec543d586 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:59:02.843065 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] VM Started (Lifecycle Event)
May 28 09:59:02.924614 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:59:02.924946 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:59:02.925085 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] No VIF found with MAC fa:16:3e:eb:53:44, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 09:59:02.925625 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Using config drive
May 28 09:59:03.055930 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Attempting to attach volume 07c39f6e-3598-45d7-bec8-99175bbf3453 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 09:59:03.059049 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] attach device xml: <disk type="block" device="disk">
May 28 09:59:03.059049 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 09:59:03.059049 np0000001613 nova-compute[98321]:   <alias name="ua-07c39f6e-3598-45d7-bec8-99175bbf3453"/>
May 28 09:59:03.059049 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-9"/>
May 28 09:59:03.059049 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 09:59:03.059049 np0000001613 nova-compute[98321]:   <serial>07c39f6e-3598-45d7-bec8-99175bbf3453</serial>
May 28 09:59:03.059049 np0000001613 nova-compute[98321]:   <shareable/>
May 28 09:59:03.059049 np0000001613 nova-compute[98321]: </disk>
May 28 09:59:03.059049 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 09:59:03.185777 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-55d71829-747f-4567-b2ff-7764e8d1f14d tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 09:59:03.348242 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:59:03.349970 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 09:59:03.430993 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:59:03.546914 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Creating config drive at /opt/stack/data/nova/instances/83f9ce5f-44cb-40c6-be1a-8d5134ee8902/disk.config
May 28 09:59:03.551449 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/83f9ce5f-44cb-40c6-be1a-8d5134ee8902/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptkk8mu6o {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:59:03.603642 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/83f9ce5f-44cb-40c6-be1a-8d5134ee8902/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptkk8mu6o" returned: 0 in 0.052s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:59:03.697845 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-55d71829-747f-4567-b2ff-7764e8d1f14d tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.701s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:03.780965 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-55d71829-747f-4567-b2ff-7764e8d1f14d tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Deleted allocations for instance 92fbf243-1c5b-47f6-9317-3fb2655651db
May 28 09:59:03.817157 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:59:03.883678 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c4854873-b97b-475d-95cd-cb9e30a20ba1 req-f9e985a2-4041-4970-9b26-7ce5e96292cc service nova] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Received event network-vif-deleted-3e64d22f-6078-49f1-9576-b70571e7f6e6 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:03.917108 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Acquiring lock "e2856743-3a60-4be1-b29c-b4de06f14783" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:03.917326 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lock "e2856743-3a60-4be1-b29c-b4de06f14783" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:04.087775 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:04.117443 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:04.182179 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:04.222658 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:04.296370 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-bcdb973f-9df2-4f56-b3ba-27ccf13286a3 req-ef2357ab-d690-4fe3-9f0a-77804b7101d5 service nova] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Received event network-vif-plugged-ef420b58-5bcf-43e2-8866-408b9c731893 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:04.296770 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:04.297605 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-bcdb973f-9df2-4f56-b3ba-27ccf13286a3 req-ef2357ab-d690-4fe3-9f0a-77804b7101d5 service nova] Acquiring lock "83f9ce5f-44cb-40c6-be1a-8d5134ee8902-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:04.298301 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-bcdb973f-9df2-4f56-b3ba-27ccf13286a3 req-ef2357ab-d690-4fe3-9f0a-77804b7101d5 service nova] Lock "83f9ce5f-44cb-40c6-be1a-8d5134ee8902-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:04.298493 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-bcdb973f-9df2-4f56-b3ba-27ccf13286a3 req-ef2357ab-d690-4fe3-9f0a-77804b7101d5 service nova] Lock "83f9ce5f-44cb-40c6-be1a-8d5134ee8902-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:04.298677 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-bcdb973f-9df2-4f56-b3ba-27ccf13286a3 req-ef2357ab-d690-4fe3-9f0a-77804b7101d5 service nova] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Processing event network-vif-plugged-ef420b58-5bcf-43e2-8866-408b9c731893 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 09:59:04.320915 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Took 1.73 seconds to deallocate network for instance.
May 28 09:59:04.400297 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:04.422988 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Detaching volume 40a97e39-f123-40c3-8fd8-3d6ff5cda98f
May 28 09:59:04.472677 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Attempting to driver detach volume 40a97e39-f123-40c3-8fd8-3d6ff5cda98f from mountpoint /dev/vdb
May 28 09:59:04.477346 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Found disk vdb by alias ua-40a97e39-f123-40c3-8fd8-3d6ff5cda98f {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 09:59:04.478571 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Found disk vdb by alias ua-40a97e39-f123-40c3-8fd8-3d6ff5cda98f {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 09:59:04.478739 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Attempting to detach device vdb from instance e2856743-3a60-4be1-b29c-b4de06f14783 from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 09:59:04.478971 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] detach device xml: <disk type="block" device="disk">
May 28 09:59:04.478971 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 09:59:04.478971 np0000001613 nova-compute[98321]:   <alias name="ua-40a97e39-f123-40c3-8fd8-3d6ff5cda98f"/>
May 28 09:59:04.478971 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-6"/>
May 28 09:59:04.478971 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 09:59:04.478971 np0000001613 nova-compute[98321]:   <serial>40a97e39-f123-40c3-8fd8-3d6ff5cda98f</serial>
May 28 09:59:04.478971 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 09:59:04.478971 np0000001613 nova-compute[98321]: </disk>
May 28 09:59:04.478971 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 09:59:04.490521 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Successfully detached device vdb from instance e2856743-3a60-4be1-b29c-b4de06f14783 from the persistent domain config.
May 28 09:59:04.490670 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] (1/8): Attempting to detach device vdb with device alias ua-40a97e39-f123-40c3-8fd8-3d6ff5cda98f from instance e2856743-3a60-4be1-b29c-b4de06f14783 from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 09:59:04.491054 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] detach device xml: <disk type="block" device="disk">
May 28 09:59:04.491054 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 09:59:04.491054 np0000001613 nova-compute[98321]:   <alias name="ua-40a97e39-f123-40c3-8fd8-3d6ff5cda98f"/>
May 28 09:59:04.491054 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-6"/>
May 28 09:59:04.491054 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 09:59:04.491054 np0000001613 nova-compute[98321]:   <serial>40a97e39-f123-40c3-8fd8-3d6ff5cda98f</serial>
May 28 09:59:04.491054 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 09:59:04.491054 np0000001613 nova-compute[98321]: </disk>
May 28 09:59:04.491054 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 09:59:04.751368 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:59:04.751487 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:59:04.751563 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:59:04.751652 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] No VIF found with MAC fa:16:3e:9c:2e:17, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 09:59:04.791781 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-55d71829-747f-4567-b2ff-7764e8d1f14d tempest-AttachSCSIVolumeTestJSON-418965369 tempest-AttachSCSIVolumeTestJSON-418965369-project-member] Lock "92fbf243-1c5b-47f6-9317-3fb2655651db" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.215s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:04.833033 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d384a56e-52f9-49d3-9baf-88473c75b534 tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:04.834615 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d384a56e-52f9-49d3-9baf-88473c75b534 tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:04.897983 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "ceb9e572-ba71-4a8c-b415-44c9e7ebec51" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:04.898540 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "ceb9e572-ba71-4a8c-b415-44c9e7ebec51" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:05.045194 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779962345.0424829, e2856743-3a60-4be1-b29c-b4de06f14783 => ua-40a97e39-f123-40c3-8fd8-3d6ff5cda98f> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 09:59:05.045194 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-40a97e39-f123-40c3-8fd8-3d6ff5cda98f for instance e2856743-3a60-4be1-b29c-b4de06f14783 {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 09:59:05.046221 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Successfully detached device vdb from instance e2856743-3a60-4be1-b29c-b4de06f14783 from the live domain config.
May 28 09:59:05.047832 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 09:59:05.048211 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f', 'iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '40a97e39-f123-40c3-8fd8-3d6ff5cda98f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 09:59:05.051193 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:59:05.052831 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:59:05.053272 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f', 'iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '40a97e39-f123-40c3-8fd8-3d6ff5cda98f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 09:59:05.053569 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 09:59:05.078994 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962345.0785973, 83f9ce5f-44cb-40c6-be1a-8d5134ee8902 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:59:05.079151 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] VM Started (Lifecycle Event)
May 28 09:59:05.082018 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 09:59:05.086472 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 09:59:05.089133 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Instance spawned successfully.
May 28 09:59:05.092442 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 09:59:05.096856 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:59:05.096856 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:05.096856 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:05.096856 np0000001613 nova-compute[98321]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:59:05.096856 np0000001613 nova-compute[98321]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:59:05.096856 np0000001613 nova-compute[98321]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f (non-flash)
May 28 09:59:05.096856 np0000001613 nova-compute[98321]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f (non-flash)
May 28 09:59:05.096856 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:59:05.096856 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:59:05.096856 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:05.096856 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:05.096856 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:59:05.096856 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:59:05.096856 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:59:05.096856 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:59:05.097487 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:59:05.097487 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:05.097487 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:05.097487 np0000001613 nova-compute[98321]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:59:05.097487 np0000001613 nova-compute[98321]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:59:05.097487 np0000001613 nova-compute[98321]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f (non-flash)
May 28 09:59:05.097487 np0000001613 nova-compute[98321]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f (non-flash)
May 28 09:59:05.097487 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:59:05.097487 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:59:05.097487 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:05.097487 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:05.097487 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:59:05.097487 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:59:05.097487 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:59:05.097487 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:59:05.097487 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0', '4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5', '8'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480', '9')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 09:59:05.097928 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f', '19')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 09:59:05.101780 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f', '20')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 09:59:05.125916 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1f4752b60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f'): ({'sdk'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 09:59:05.126392 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Removing multipathed devices sdj, sdk {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 09:59:05.128754 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Flush multipath device 33000000077562fe3 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 09:59:05.158315 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 09:59:05.209884 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 09:59:05.251416 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 09:59:05.251632 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 09:59:05.253571 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 09:59:05.268300 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 09:59:05.268736 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 09:59:05.290756 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:05.332429 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f, portal: 192.168.40.100,3260]
May 28 09:59:05.332429 np0000001613 nova-compute[98321]: Logout of [sid: 19, target: iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f, portal: 192.168.40.100,3260] successful.
May 28 09:59:05.332429 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:05.363266 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:05.378019 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:05.405364 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 09:59:05.421983 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f, portal: 192.168.50.100,3260]
May 28 09:59:05.421983 np0000001613 nova-compute[98321]: Logout of [sid: 20, target: iqn.2023-03.storpool.com:os--volume-40a97e39-f123-40c3-8fd8-3d6ff5cda98f, portal: 192.168.50.100,3260] successful.
May 28 09:59:05.421983 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:05.452080 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:05.452282 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.400s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:59:05.452372 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] <== disconnect_volume: return (403ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 09:59:05.452516 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 09:59:05.584549 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:59:05.588712 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 09:59:05.602711 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:59:05.602884 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:59:05.603423 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:59:05.603811 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:59:05.604147 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:59:05.604600 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:59:05.625793 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d384a56e-52f9-49d3-9baf-88473c75b534 tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 09:59:05.626079 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-d384a56e-52f9-49d3-9baf-88473c75b534 tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 09:59:05.979455 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:06.025791 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lazy-loading 'flavor' on Instance uuid e2856743-3a60-4be1-b29c-b4de06f14783 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:59:06.089717 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 09:59:06.090011 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962346.0897768, 83f9ce5f-44cb-40c6-be1a-8d5134ee8902 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:59:06.090116 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] VM Paused (Lifecycle Event)
May 28 09:59:06.110643 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Took 7.42 seconds to spawn the instance on the hypervisor.
May 28 09:59:06.110829 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:59:06.129238 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-d384a56e-52f9-49d3-9baf-88473c75b534 tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 09:59:06.324738 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-be663cee-19dc-4ad4-9cee-72877327810f tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "4a28d569-1ca9-4657-840c-7bb31d4644c8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.538s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:06.408282 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ad4188fd-fbfd-4922-b9b6-3c1cf9905f5f req-9662c742-8ca9-4fff-9fb9-6d6235987529 service nova] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Received event network-vif-plugged-ef420b58-5bcf-43e2-8866-408b9c731893 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:06.408282 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ad4188fd-fbfd-4922-b9b6-3c1cf9905f5f req-9662c742-8ca9-4fff-9fb9-6d6235987529 service nova] Acquiring lock "83f9ce5f-44cb-40c6-be1a-8d5134ee8902-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:06.408366 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ad4188fd-fbfd-4922-b9b6-3c1cf9905f5f req-9662c742-8ca9-4fff-9fb9-6d6235987529 service nova] Lock "83f9ce5f-44cb-40c6-be1a-8d5134ee8902-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:06.408601 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ad4188fd-fbfd-4922-b9b6-3c1cf9905f5f req-9662c742-8ca9-4fff-9fb9-6d6235987529 service nova] Lock "83f9ce5f-44cb-40c6-be1a-8d5134ee8902-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:06.408601 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ad4188fd-fbfd-4922-b9b6-3c1cf9905f5f req-9662c742-8ca9-4fff-9fb9-6d6235987529 service nova] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] No waiting events found dispatching network-vif-plugged-ef420b58-5bcf-43e2-8866-408b9c731893 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:59:06.408758 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-ad4188fd-fbfd-4922-b9b6-3c1cf9905f5f req-9662c742-8ca9-4fff-9fb9-6d6235987529 service nova] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Received unexpected event network-vif-plugged-ef420b58-5bcf-43e2-8866-408b9c731893 for instance with vm_state active and task_state None.
May 28 09:59:06.596697 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:59:06.600013 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962346.5997505, 83f9ce5f-44cb-40c6-be1a-8d5134ee8902 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:59:06.600113 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] VM Resumed (Lifecycle Event)
May 28 09:59:06.619380 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Took 13.43 seconds to build instance.
May 28 09:59:06.637405 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d384a56e-52f9-49d3-9baf-88473c75b534 tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.802s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:06.638379 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.658s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:06.646805 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 09:59:06.647490 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Claim successful on node np0000001613
May 28 09:59:06.738194 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-d384a56e-52f9-49d3-9baf-88473c75b534 tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Deleted allocations for instance 49ff17d1-cad9-463e-b5c1-3315c52412e6
May 28 09:59:07.073575 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:07.102961 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:59:07.105199 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 09:59:07.121277 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a25b9ad3-c01e-4d1d-b749-99046891c495 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "83f9ce5f-44cb-40c6-be1a-8d5134ee8902" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.947s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:07.204211 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-abec9357-b6f1-4d08-8a65-fb510645cf81 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Acquiring lock "interface-e2856743-3a60-4be1-b29c-b4de06f14783-7759aa9a-fe3a-4902-88ae-2f679e5d2a68" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:07.204807 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-abec9357-b6f1-4d08-8a65-fb510645cf81 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lock "interface-e2856743-3a60-4be1-b29c-b4de06f14783-7759aa9a-fe3a-4902-88ae-2f679e5d2a68" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:07.343559 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cdc68852-7b58-4ba6-b431-37cecc8d3c61 req-1ff84d34-4f89-4ef8-af7b-b05e6aa3d987 service nova] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Received event network-changed-ef420b58-5bcf-43e2-8866-408b9c731893 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:07.343559 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cdc68852-7b58-4ba6-b431-37cecc8d3c61 req-1ff84d34-4f89-4ef8-af7b-b05e6aa3d987 service nova] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Refreshing instance network info cache due to event network-changed-ef420b58-5bcf-43e2-8866-408b9c731893. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 09:59:07.343559 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cdc68852-7b58-4ba6-b431-37cecc8d3c61 req-1ff84d34-4f89-4ef8-af7b-b05e6aa3d987 service nova] Acquiring lock "refresh_cache-83f9ce5f-44cb-40c6-be1a-8d5134ee8902" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:59:07.343559 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cdc68852-7b58-4ba6-b431-37cecc8d3c61 req-1ff84d34-4f89-4ef8-af7b-b05e6aa3d987 service nova] Acquired lock "refresh_cache-83f9ce5f-44cb-40c6-be1a-8d5134ee8902" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:59:07.343559 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-cdc68852-7b58-4ba6-b431-37cecc8d3c61 req-1ff84d34-4f89-4ef8-af7b-b05e6aa3d987 service nova] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Refreshing network info cache for port ef420b58-5bcf-43e2-8866-408b9c731893 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 09:59:07.351590 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3dfec7d6-8547-4f06-9e4a-a73b8df06627 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Acquiring lock "4a28d569-1ca9-4657-840c-7bb31d4644c8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:07.351815 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3dfec7d6-8547-4f06-9e4a-a73b8df06627 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "4a28d569-1ca9-4657-840c-7bb31d4644c8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:07.539269 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d33cbbe7-4376-4675-8538-6f2cd89fc8b2 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lock "e2856743-3a60-4be1-b29c-b4de06f14783" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.622s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:07.711554 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-abec9357-b6f1-4d08-8a65-fb510645cf81 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lazy-loading 'flavor' on Instance uuid e2856743-3a60-4be1-b29c-b4de06f14783 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:59:07.751537 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d384a56e-52f9-49d3-9baf-88473c75b534 tempest-VolumesAssistedSnapshotsTest-1941135530 tempest-VolumesAssistedSnapshotsTest-1941135530-project-member] Lock "49ff17d1-cad9-463e-b5c1-3315c52412e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.081s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:07.845945 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-cdc68852-7b58-4ba6-b431-37cecc8d3c61 req-1ff84d34-4f89-4ef8-af7b-b05e6aa3d987 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:59:07.854870 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-3dfec7d6-8547-4f06-9e4a-a73b8df06627 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Detaching volume 07c39f6e-3598-45d7-bec8-99175bbf3453
May 28 09:59:07.908615 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-3dfec7d6-8547-4f06-9e4a-a73b8df06627 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Attempting to driver detach volume 07c39f6e-3598-45d7-bec8-99175bbf3453 from mountpoint /dev/vdb
May 28 09:59:07.916099 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3dfec7d6-8547-4f06-9e4a-a73b8df06627 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Found disk vdb by alias ua-07c39f6e-3598-45d7-bec8-99175bbf3453 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 09:59:07.920626 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3dfec7d6-8547-4f06-9e4a-a73b8df06627 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Found disk vdb by alias ua-07c39f6e-3598-45d7-bec8-99175bbf3453 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 09:59:07.920836 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3dfec7d6-8547-4f06-9e4a-a73b8df06627 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Attempting to detach device vdb from instance 4a28d569-1ca9-4657-840c-7bb31d4644c8 from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 09:59:07.921137 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-3dfec7d6-8547-4f06-9e4a-a73b8df06627 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] detach device xml: <disk type="block" device="disk">
May 28 09:59:07.921137 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 09:59:07.921137 np0000001613 nova-compute[98321]:   <alias name="ua-07c39f6e-3598-45d7-bec8-99175bbf3453"/>
May 28 09:59:07.921137 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-9"/>
May 28 09:59:07.921137 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 09:59:07.921137 np0000001613 nova-compute[98321]:   <serial>07c39f6e-3598-45d7-bec8-99175bbf3453</serial>
May 28 09:59:07.921137 np0000001613 nova-compute[98321]:   <shareable/>
May 28 09:59:07.921137 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 09:59:07.921137 np0000001613 nova-compute[98321]: </disk>
May 28 09:59:07.921137 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 09:59:07.931429 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-3dfec7d6-8547-4f06-9e4a-a73b8df06627 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Successfully detached device vdb from instance 4a28d569-1ca9-4657-840c-7bb31d4644c8 from the persistent domain config.
May 28 09:59:07.931634 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3dfec7d6-8547-4f06-9e4a-a73b8df06627 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] (1/8): Attempting to detach device vdb with device alias ua-07c39f6e-3598-45d7-bec8-99175bbf3453 from instance 4a28d569-1ca9-4657-840c-7bb31d4644c8 from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 09:59:07.931853 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-3dfec7d6-8547-4f06-9e4a-a73b8df06627 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] detach device xml: <disk type="block" device="disk">
May 28 09:59:07.931853 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 09:59:07.931853 np0000001613 nova-compute[98321]:   <alias name="ua-07c39f6e-3598-45d7-bec8-99175bbf3453"/>
May 28 09:59:07.931853 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-9"/>
May 28 09:59:07.931853 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 09:59:07.931853 np0000001613 nova-compute[98321]:   <serial>07c39f6e-3598-45d7-bec8-99175bbf3453</serial>
May 28 09:59:07.931853 np0000001613 nova-compute[98321]:   <shareable/>
May 28 09:59:07.931853 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 09:59:07.931853 np0000001613 nova-compute[98321]: </disk>
May 28 09:59:07.931853 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 09:59:08.216781 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-abec9357-b6f1-4d08-8a65-fb510645cf81 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:57:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-501736735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-501736735',id=4,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPS8xG4KsWj7jd6eI8Ha8DW2V89ViHDMSJ32qPM+zEUw0jbx/lKgP6h0tE0l56+jki8nKEwFAor6rHbbQIYZjf8FhqUVxl6GRIyxLYKd7whepyq3n5RjNWjJHm94fY8qvQ==',key_name='tempest-keypair-1033085564',keypairs=<?>,launch_index=0,launched_at=2026-05-28T09:57:59Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='25a0adc32dd74f039cc231cceb9131a0',ramdisk_id='',reservation_id='r-0bm2bepy',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-936828907',owner_user_name='tempest-TaggedAttachmentsTest-936828907-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T09:58:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74620a0064844d8f922e02c653142fd6',uuid=e2856743-3a60-4be1-b29c-b4de06f14783,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7759aa9a-fe3a-4902-88ae-2f679e5d2a68", "address": "fa:16:3e:c3:78:fb", "network": {"id": "ebbec6c6-b741-42fd-b1a3-9127b6da8c88", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1016727797", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "25a0adc32dd74f039cc231cceb9131a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7759aa9a-fe", "ovs_interfaceid": "7759aa9a-fe3a-4902-88ae-2f679e5d2a68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 09:59:08.216781 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-abec9357-b6f1-4d08-8a65-fb510645cf81 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Converting VIF {"id": "7759aa9a-fe3a-4902-88ae-2f679e5d2a68", "address": "fa:16:3e:c3:78:fb", "network": {"id": "ebbec6c6-b741-42fd-b1a3-9127b6da8c88", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1016727797", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "25a0adc32dd74f039cc231cceb9131a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7759aa9a-fe", "ovs_interfaceid": "7759aa9a-fe3a-4902-88ae-2f679e5d2a68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:59:08.216781 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-abec9357-b6f1-4d08-8a65-fb510645cf81 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:78:fb,bridge_name='br-int',has_traffic_filtering=True,id=7759aa9a-fe3a-4902-88ae-2f679e5d2a68,network=Network(ebbec6c6-b741-42fd-b1a3-9127b6da8c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7759aa9a-fe') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:59:08.218832 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-abec9357-b6f1-4d08-8a65-fb510645cf81 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c3:78:fb"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap7759aa9a-fe"/></interface> {{(pid=98321) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 28 09:59:08.221011 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-abec9357-b6f1-4d08-8a65-fb510645cf81 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c3:78:fb"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap7759aa9a-fe"/></interface> {{(pid=98321) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 28 09:59:08.223742 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-abec9357-b6f1-4d08-8a65-fb510645cf81 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Attempting to detach device tap7759aa9a-fe from instance e2856743-3a60-4be1-b29c-b4de06f14783 from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 09:59:08.223742 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-abec9357-b6f1-4d08-8a65-fb510645cf81 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] detach device xml: <interface type="ethernet">
May 28 09:59:08.223742 np0000001613 nova-compute[98321]:   <mac address="fa:16:3e:c3:78:fb"/>
May 28 09:59:08.223742 np0000001613 nova-compute[98321]:   <model type="virtio"/>
May 28 09:59:08.223742 np0000001613 nova-compute[98321]:   <driver name="qemu"/>
May 28 09:59:08.223742 np0000001613 nova-compute[98321]:   <mtu size="1372"/>
May 28 09:59:08.223742 np0000001613 nova-compute[98321]:   <target dev="tap7759aa9a-fe"/>
May 28 09:59:08.223742 np0000001613 nova-compute[98321]: </interface>
May 28 09:59:08.223742 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 09:59:08.227404 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-abec9357-b6f1-4d08-8a65-fb510645cf81 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c3:78:fb"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap7759aa9a-fe"/></interface> {{(pid=98321) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 28 09:59:08.229757 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-abec9357-b6f1-4d08-8a65-fb510645cf81 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c3:78:fb"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap7759aa9a-fe"/></interface>not found in domain: <domain type='qemu' id='4'>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   <name>instance-00000004</name>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   <uuid>e2856743-3a60-4be1-b29c-b4de06f14783</uuid>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   <metadata>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   <nova:package version="33.1.0"/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   <nova:name>tempest-device-tagging-server-501736735</nova:name>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   <nova:creationTime>2026-05-28 09:58:46</nova:creationTime>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   <nova:flavor name="m1.nano" id="42">
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <nova:memory>192</nova:memory>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <nova:disk>1</nova:disk>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <nova:swap>0</nova:swap>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <nova:ephemeral>0</nova:ephemeral>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <nova:vcpus>1</nova:vcpus>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <nova:extraSpecs>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     </nova:extraSpecs>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   </nova:flavor>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <nova:containerFormat>bare</nova:containerFormat>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <nova:minDisk>1</nova:minDisk>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <nova:minRam>0</nova:minRam>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <nova:properties>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <nova:property name="hw_machine_type">pc</nova:property>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <nova:property name="hw_video_model">virtio</nova:property>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     </nova:properties>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   </nova:image>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   <nova:owner>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <nova:user uuid="74620a0064844d8f922e02c653142fd6">tempest-TaggedAttachmentsTest-936828907-project-member</nova:user>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <nova:project uuid="25a0adc32dd74f039cc231cceb9131a0">tempest-TaggedAttachmentsTest-936828907</nova:project>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   </nova:owner>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   <nova:ports>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <nova:port uuid="2fad8030-7c30-438c-8dcd-b9a8ba1849d1">
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     </nova:port>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <nova:port uuid="7759aa9a-fe3a-4902-88ae-2f679e5d2a68">
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <nova:ip type="fixed" address="10.10.10.99" ipVersion="4"/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     </nova:port>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   </nova:ports>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]: </nova:instance>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   </metadata>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   <memory unit='KiB'>196608</memory>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   <currentMemory unit='KiB'>196608</currentMemory>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   <vcpu placement='static'>1</vcpu>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   <resource>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <partition>/machine</partition>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   </resource>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   <sysinfo type='smbios'>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <system>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <entry name='product'>OpenStack Nova</entry>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <entry name='version'>33.1.0</entry>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <entry name='serial'>e2856743-3a60-4be1-b29c-b4de06f14783</entry>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <entry name='uuid'>e2856743-3a60-4be1-b29c-b4de06f14783</entry>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <entry name='family'>Virtual Machine</entry>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     </system>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   <os>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <boot dev='hd'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <smbios mode='sysinfo'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   </os>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   <features>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <acpi/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <vmcoreinfo state='on'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <tcg>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <tb-cache unit='KiB'>131072</tb-cache>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     </tcg>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   </features>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   <cpu mode='custom' match='exact' check='full'>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <model fallback='forbid'>Nehalem</model>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <feature policy='require' name='hypervisor'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   <clock offset='utc'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   <on_poweroff>destroy</on_poweroff>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   <on_reboot>restart</on_reboot>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   <on_crash>destroy</on_crash>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   <devices>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <disk type='file' device='disk'>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <driver name='qemu' type='qcow2' cache='none'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <source file='/opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783/disk' index='2'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <backingStore type='file' index='3'>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:         <format type='raw'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:         <source file='/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:         <backingStore/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       </backingStore>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <target dev='vda' bus='virtio'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <alias name='virtio-disk0'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     </disk>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <disk type='file' device='cdrom'>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <driver name='qemu' type='raw' cache='none'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <source file='/opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783/disk.config' index='1'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <backingStore/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <target dev='hda' bus='ide'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <readonly/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <alias name='ide0-0-0'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     </disk>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <controller type='usb' index='0' model='none'>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <alias name='usb'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     </controller>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <controller type='pci' index='0' model='pci-root'>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <alias name='pci.0'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     </controller>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <controller type='ide' index='0'>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <alias name='ide'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     </controller>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <interface type='ethernet'>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <mac address='fa:16:3e:9a:42:b3'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <target dev='tap2fad8030-7c'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <model type='virtio'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <driver name='qemu'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <mtu size='1372'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <alias name='net0'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     </interface>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <interface type='ethernet'>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <mac address='fa:16:3e:c3:78:fb'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <target dev='tap7759aa9a-fe'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <model type='virtio'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <driver name='qemu'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <mtu size='1372'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <alias name='net1'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     </interface>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <serial type='pty'>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <source path='/dev/pts/3'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <log file='/opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783/console.log' append='off'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <target type='isa-serial' port='0'>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:         <model name='isa-serial'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       </target>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <alias name='serial0'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     </serial>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <console type='pty' tty='/dev/pts/3'>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <source path='/dev/pts/3'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <log file='/opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783/console.log' append='off'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <target type='serial' port='0'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <alias name='serial0'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     </console>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <input type='mouse' bus='ps2'>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <alias name='input0'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     </input>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <input type='keyboard' bus='ps2'>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <alias name='input1'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     </input>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <graphics type='vnc' port='5903' autoport='yes' listen='0.0.0.0'>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <listen type='address' address='0.0.0.0'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     </graphics>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <audio id='1' type='none'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <video>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <model type='virtio' heads='1' primary='yes'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <alias name='video0'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     </video>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <stats period='10'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <alias name='balloon0'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     </memballoon>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <rng model='virtio'>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <backend model='random'>/dev/urandom</backend>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <alias name='rng0'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     </rng>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   </devices>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <label>libvirt-e2856743-3a60-4be1-b29c-b4de06f14783</label>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <imagelabel>libvirt-e2856743-3a60-4be1-b29c-b4de06f14783</imagelabel>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   </seclabel>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <label>+64055:+993</label>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:     <imagelabel>+64055:+993</imagelabel>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   </seclabel>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]: </domain>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:  {{(pid=98321) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 28 09:59:08.229757 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-abec9357-b6f1-4d08-8a65-fb510645cf81 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Successfully detached device tap7759aa9a-fe from instance e2856743-3a60-4be1-b29c-b4de06f14783 from the persistent domain config.
May 28 09:59:08.229757 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-abec9357-b6f1-4d08-8a65-fb510645cf81 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] (1/8): Attempting to detach device tap7759aa9a-fe with device alias net1 from instance e2856743-3a60-4be1-b29c-b4de06f14783 from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 09:59:08.229757 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-abec9357-b6f1-4d08-8a65-fb510645cf81 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] detach device xml: <interface type="ethernet">
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   <mac address="fa:16:3e:c3:78:fb"/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   <model type="virtio"/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   <driver name="qemu"/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   <mtu size="1372"/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:   <target dev="tap7759aa9a-fe"/>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]: </interface>
May 28 09:59:08.229757 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 09:59:08.353461 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-cdc68852-7b58-4ba6-b431-37cecc8d3c61 req-1ff84d34-4f89-4ef8-af7b-b05e6aa3d987 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:59:08.458313 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 09:59:08.458776 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 09:59:08.557385 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-cdc68852-7b58-4ba6-b431-37cecc8d3c61 req-1ff84d34-4f89-4ef8-af7b-b05e6aa3d987 service nova] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Updated VIF entry in instance network info cache for port ef420b58-5bcf-43e2-8866-408b9c731893. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 09:59:08.557755 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-cdc68852-7b58-4ba6-b431-37cecc8d3c61 req-1ff84d34-4f89-4ef8-af7b-b05e6aa3d987 service nova] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Updating instance_info_cache with network_info: [{"id": "ef420b58-5bcf-43e2-8866-408b9c731893", "address": "fa:16:3e:eb:53:44", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef420b58-5b", "ovs_interfaceid": "ef420b58-5bcf-43e2-8866-408b9c731893", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:59:08.606677 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779962348.606126, 4a28d569-1ca9-4657-840c-7bb31d4644c8 => ua-07c39f6e-3598-45d7-bec8-99175bbf3453> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 09:59:08.608359 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3dfec7d6-8547-4f06-9e4a-a73b8df06627 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-07c39f6e-3598-45d7-bec8-99175bbf3453 for instance 4a28d569-1ca9-4657-840c-7bb31d4644c8 {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 09:59:08.611036 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-3dfec7d6-8547-4f06-9e4a-a73b8df06627 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Successfully detached device vdb from instance 4a28d569-1ca9-4657-840c-7bb31d4644c8 from the live domain config.
May 28 09:59:08.964328 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 09:59:08.993522 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:09.059988 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cdc68852-7b58-4ba6-b431-37cecc8d3c61 req-1ff84d34-4f89-4ef8-af7b-b05e6aa3d987 service nova] Releasing lock "refresh_cache-83f9ce5f-44cb-40c6-be1a-8d5134ee8902" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:59:09.160854 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-3dfec7d6-8547-4f06-9e4a-a73b8df06627 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Detected multiple connections on this host for volume: 07c39f6e-3598-45d7-bec8-99175bbf3453, skipping target disconnect.
May 28 09:59:09.188543 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:09.217639 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 09:59:09.287590 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779962349.2872508, e2856743-3a60-4be1-b29c-b4de06f14783 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 09:59:09.290341 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:09.292187 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-abec9357-b6f1-4d08-8a65-fb510645cf81 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Start waiting for the detach event from libvirt for device tap7759aa9a-fe with device alias net1 for instance e2856743-3a60-4be1-b29c-b4de06f14783 {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 09:59:09.292770 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-abec9357-b6f1-4d08-8a65-fb510645cf81 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c3:78:fb"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap7759aa9a-fe"/></interface> {{(pid=98321) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 28 09:59:09.294393 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:09.305919 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-abec9357-b6f1-4d08-8a65-fb510645cf81 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c3:78:fb"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap7759aa9a-fe"/></interface>not found in domain: <domain type='qemu' id='4'>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:   <name>instance-00000004</name>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:   <uuid>e2856743-3a60-4be1-b29c-b4de06f14783</uuid>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:   <metadata>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:   <nova:package version="33.1.0"/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:   <nova:name>tempest-device-tagging-server-501736735</nova:name>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:   <nova:creationTime>2026-05-28 09:58:46</nova:creationTime>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:   <nova:flavor name="m1.nano" id="42">
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <nova:memory>192</nova:memory>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <nova:disk>1</nova:disk>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <nova:swap>0</nova:swap>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <nova:ephemeral>0</nova:ephemeral>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <nova:vcpus>1</nova:vcpus>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <nova:extraSpecs>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     </nova:extraSpecs>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:   </nova:flavor>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:   <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <nova:containerFormat>bare</nova:containerFormat>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <nova:minDisk>1</nova:minDisk>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <nova:minRam>0</nova:minRam>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <nova:properties>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <nova:property name="hw_machine_type">pc</nova:property>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <nova:property name="hw_video_model">virtio</nova:property>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     </nova:properties>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:   </nova:image>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:   <nova:owner>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <nova:user uuid="74620a0064844d8f922e02c653142fd6">tempest-TaggedAttachmentsTest-936828907-project-member</nova:user>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <nova:project uuid="25a0adc32dd74f039cc231cceb9131a0">tempest-TaggedAttachmentsTest-936828907</nova:project>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:   </nova:owner>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:   <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:   <nova:ports>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <nova:port uuid="2fad8030-7c30-438c-8dcd-b9a8ba1849d1">
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     </nova:port>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <nova:port uuid="7759aa9a-fe3a-4902-88ae-2f679e5d2a68">
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <nova:ip type="fixed" address="10.10.10.99" ipVersion="4"/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     </nova:port>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:   </nova:ports>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]: </nova:instance>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:   </metadata>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:   <memory unit='KiB'>196608</memory>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:   <currentMemory unit='KiB'>196608</currentMemory>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:   <vcpu placement='static'>1</vcpu>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:   <resource>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <partition>/machine</partition>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:   </resource>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:   <sysinfo type='smbios'>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <system>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <entry name='product'>OpenStack Nova</entry>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <entry name='version'>33.1.0</entry>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <entry name='serial'>e2856743-3a60-4be1-b29c-b4de06f14783</entry>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <entry name='uuid'>e2856743-3a60-4be1-b29c-b4de06f14783</entry>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <entry name='family'>Virtual Machine</entry>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     </system>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:   <os>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <boot dev='hd'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <smbios mode='sysinfo'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:   </os>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:   <features>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <acpi/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <vmcoreinfo state='on'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <tcg>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <tb-cache unit='KiB'>131072</tb-cache>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     </tcg>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:   </features>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:   <cpu mode='custom' match='exact' check='full'>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <model fallback='forbid'>Nehalem</model>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <feature policy='require' name='hypervisor'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:   <clock offset='utc'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:   <on_poweroff>destroy</on_poweroff>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:   <on_reboot>restart</on_reboot>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:   <on_crash>destroy</on_crash>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:   <devices>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <disk type='file' device='disk'>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <driver name='qemu' type='qcow2' cache='none'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <source file='/opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783/disk' index='2'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <backingStore type='file' index='3'>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:         <format type='raw'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:         <source file='/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:         <backingStore/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       </backingStore>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <target dev='vda' bus='virtio'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <alias name='virtio-disk0'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     </disk>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <disk type='file' device='cdrom'>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <driver name='qemu' type='raw' cache='none'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <source file='/opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783/disk.config' index='1'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <backingStore/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <target dev='hda' bus='ide'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <readonly/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <alias name='ide0-0-0'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     </disk>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <controller type='usb' index='0' model='none'>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <alias name='usb'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     </controller>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <controller type='pci' index='0' model='pci-root'>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <alias name='pci.0'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     </controller>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <controller type='ide' index='0'>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <alias name='ide'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     </controller>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <interface type='ethernet'>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <mac address='fa:16:3e:9a:42:b3'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <target dev='tap2fad8030-7c'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <model type='virtio'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <driver name='qemu'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <mtu size='1372'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <alias name='net0'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     </interface>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <serial type='pty'>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <source path='/dev/pts/3'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <log file='/opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783/console.log' append='off'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <target type='isa-serial' port='0'>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:         <model name='isa-serial'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       </target>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <alias name='serial0'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     </serial>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <console type='pty' tty='/dev/pts/3'>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <source path='/dev/pts/3'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <log file='/opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783/console.log' append='off'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <target type='serial' port='0'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <alias name='serial0'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     </console>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <input type='mouse' bus='ps2'>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <alias name='input0'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     </input>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <input type='keyboard' bus='ps2'>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <alias name='input1'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     </input>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <graphics type='vnc' port='5903' autoport='yes' listen='0.0.0.0'>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <listen type='address' address='0.0.0.0'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     </graphics>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <audio id='1' type='none'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <video>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <model type='virtio' heads='1' primary='yes'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <alias name='video0'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     </video>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <stats period='10'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <alias name='balloon0'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     </memballoon>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <rng model='virtio'>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <backend model='random'>/dev/urandom</backend>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <alias name='rng0'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     </rng>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:   </devices>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <label>libvirt-e2856743-3a60-4be1-b29c-b4de06f14783</label>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <imagelabel>libvirt-e2856743-3a60-4be1-b29c-b4de06f14783</imagelabel>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:   </seclabel>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <label>+64055:+993</label>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:     <imagelabel>+64055:+993</imagelabel>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:   </seclabel>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]: </domain>
May 28 09:59:09.305919 np0000001613 nova-compute[98321]:  {{(pid=98321) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 28 09:59:09.305919 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-abec9357-b6f1-4d08-8a65-fb510645cf81 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Successfully detached device tap7759aa9a-fe from instance e2856743-3a60-4be1-b29c-b4de06f14783 from the live domain config.
May 28 09:59:09.305919 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-abec9357-b6f1-4d08-8a65-fb510645cf81 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:57:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-501736735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-501736735',id=4,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPS8xG4KsWj7jd6eI8Ha8DW2V89ViHDMSJ32qPM+zEUw0jbx/lKgP6h0tE0l56+jki8nKEwFAor6rHbbQIYZjf8FhqUVxl6GRIyxLYKd7whepyq3n5RjNWjJHm94fY8qvQ==',key_name='tempest-keypair-1033085564',keypairs=<?>,launch_index=0,launched_at=2026-05-28T09:57:59Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='25a0adc32dd74f039cc231cceb9131a0',ramdisk_id='',reservation_id='r-0bm2bepy',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-936828907',owner_user_name='tempest-TaggedAttachmentsTest-936828907-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T09:58:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74620a0064844d8f922e02c653142fd6',uuid=e2856743-3a60-4be1-b29c-b4de06f14783,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7759aa9a-fe3a-4902-88ae-2f679e5d2a68", "address": "fa:16:3e:c3:78:fb", "network": {"id": "ebbec6c6-b741-42fd-b1a3-9127b6da8c88", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1016727797", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "25a0adc32dd74f039cc231cceb9131a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7759aa9a-fe", "ovs_interfaceid": "7759aa9a-fe3a-4902-88ae-2f679e5d2a68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 09:59:09.305919 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-abec9357-b6f1-4d08-8a65-fb510645cf81 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Converting VIF {"id": "7759aa9a-fe3a-4902-88ae-2f679e5d2a68", "address": "fa:16:3e:c3:78:fb", "network": {"id": "ebbec6c6-b741-42fd-b1a3-9127b6da8c88", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1016727797", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "25a0adc32dd74f039cc231cceb9131a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7759aa9a-fe", "ovs_interfaceid": "7759aa9a-fe3a-4902-88ae-2f679e5d2a68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:59:09.305919 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-abec9357-b6f1-4d08-8a65-fb510645cf81 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:78:fb,bridge_name='br-int',has_traffic_filtering=True,id=7759aa9a-fe3a-4902-88ae-2f679e5d2a68,network=Network(ebbec6c6-b741-42fd-b1a3-9127b6da8c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7759aa9a-fe') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:59:09.309745 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-abec9357-b6f1-4d08-8a65-fb510645cf81 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:78:fb,bridge_name='br-int',has_traffic_filtering=True,id=7759aa9a-fe3a-4902-88ae-2f679e5d2a68,network=Network(ebbec6c6-b741-42fd-b1a3-9127b6da8c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7759aa9a-fe') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 09:59:09.310635 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:09.310969 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7759aa9a-fe, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:09.312662 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:09.314099 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:59:09.316910 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:09.320187 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:09.320187 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=86938b55-1198-4e13-94e7-01f533e9c1e7) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:09.321288 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:09.322083 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:59:09.324491 np0000001613 nova-compute[98321]: INFO os_vif [None req-abec9357-b6f1-4d08-8a65-fb510645cf81 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:78:fb,bridge_name='br-int',has_traffic_filtering=True,id=7759aa9a-fe3a-4902-88ae-2f679e5d2a68,network=Network(ebbec6c6-b741-42fd-b1a3-9127b6da8c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7759aa9a-fe')
May 28 09:59:09.325489 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-abec9357-b6f1-4d08-8a65-fb510645cf81 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-501736735', uuid='e2856743-3a60-4be1-b29c-b4de06f14783'), owner=OwnerMeta(userid='74620a0064844d8f922e02c653142fd6', username='tempest-TaggedAttachmentsTest-936828907-project-member', projectid='25a0adc32dd74f039cc231cceb9131a0', projectname='tempest-TaggedAttachmentsTest-936828907'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2fad8030-7c30-438c-8dcd-b9a8ba1849d1", "address": "fa:16:3e:9a:42:b3", "network": {"id": "48f4f13e-9b4c-4776-a2bd-47a4984571ae", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-337905894-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "25a0adc32dd74f039cc231cceb9131a0", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fad8030-7c", "ovs_interfaceid": "2fad8030-7c30-438c-8dcd-b9a8ba1849d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962349.3251) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 09:59:09.326390 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-abec9357-b6f1-4d08-8a65-fb510645cf81 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 09:59:09.326390 np0000001613 nova-compute[98321]:   <nova:package version="33.1.0"/>
May 28 09:59:09.326390 np0000001613 nova-compute[98321]:   <nova:name>tempest-device-tagging-server-501736735</nova:name>
May 28 09:59:09.326390 np0000001613 nova-compute[98321]:   <nova:creationTime>2026-05-28 09:59:09</nova:creationTime>
May 28 09:59:09.326390 np0000001613 nova-compute[98321]:   <nova:flavor name="m1.nano" id="42">
May 28 09:59:09.326390 np0000001613 nova-compute[98321]:     <nova:memory>192</nova:memory>
May 28 09:59:09.326390 np0000001613 nova-compute[98321]:     <nova:disk>1</nova:disk>
May 28 09:59:09.326390 np0000001613 nova-compute[98321]:     <nova:swap>0</nova:swap>
May 28 09:59:09.326390 np0000001613 nova-compute[98321]:     <nova:ephemeral>0</nova:ephemeral>
May 28 09:59:09.326390 np0000001613 nova-compute[98321]:     <nova:vcpus>1</nova:vcpus>
May 28 09:59:09.326390 np0000001613 nova-compute[98321]:     <nova:extraSpecs>
May 28 09:59:09.326390 np0000001613 nova-compute[98321]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 09:59:09.326390 np0000001613 nova-compute[98321]:     </nova:extraSpecs>
May 28 09:59:09.326390 np0000001613 nova-compute[98321]:   </nova:flavor>
May 28 09:59:09.326390 np0000001613 nova-compute[98321]:   <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 09:59:09.326390 np0000001613 nova-compute[98321]:     <nova:containerFormat>bare</nova:containerFormat>
May 28 09:59:09.326390 np0000001613 nova-compute[98321]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 28 09:59:09.326390 np0000001613 nova-compute[98321]:     <nova:minDisk>1</nova:minDisk>
May 28 09:59:09.326390 np0000001613 nova-compute[98321]:     <nova:minRam>0</nova:minRam>
May 28 09:59:09.326390 np0000001613 nova-compute[98321]:     <nova:properties>
May 28 09:59:09.326390 np0000001613 nova-compute[98321]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 09:59:09.326390 np0000001613 nova-compute[98321]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 09:59:09.326390 np0000001613 nova-compute[98321]:       <nova:property name="hw_machine_type">pc</nova:property>
May 28 09:59:09.326390 np0000001613 nova-compute[98321]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 28 09:59:09.326390 np0000001613 nova-compute[98321]:       <nova:property name="hw_video_model">virtio</nova:property>
May 28 09:59:09.326390 np0000001613 nova-compute[98321]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 28 09:59:09.326390 np0000001613 nova-compute[98321]:     </nova:properties>
May 28 09:59:09.326390 np0000001613 nova-compute[98321]:   </nova:image>
May 28 09:59:09.326390 np0000001613 nova-compute[98321]:   <nova:owner>
May 28 09:59:09.326390 np0000001613 nova-compute[98321]:     <nova:user uuid="74620a0064844d8f922e02c653142fd6">tempest-TaggedAttachmentsTest-936828907-project-member</nova:user>
May 28 09:59:09.326390 np0000001613 nova-compute[98321]:     <nova:project uuid="25a0adc32dd74f039cc231cceb9131a0">tempest-TaggedAttachmentsTest-936828907</nova:project>
May 28 09:59:09.326390 np0000001613 nova-compute[98321]:   </nova:owner>
May 28 09:59:09.326390 np0000001613 nova-compute[98321]:   <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 09:59:09.326390 np0000001613 nova-compute[98321]:   <nova:ports>
May 28 09:59:09.326390 np0000001613 nova-compute[98321]:     <nova:port uuid="2fad8030-7c30-438c-8dcd-b9a8ba1849d1">
May 28 09:59:09.326390 np0000001613 nova-compute[98321]:       <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 09:59:09.326390 np0000001613 nova-compute[98321]:     </nova:port>
May 28 09:59:09.326390 np0000001613 nova-compute[98321]:   </nova:ports>
May 28 09:59:09.326390 np0000001613 nova-compute[98321]: </nova:instance>
May 28 09:59:09.326390 np0000001613 nova-compute[98321]:  {{(pid=98321) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 28 09:59:09.328662 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-abec9357-b6f1-4d08-8a65-fb510645cf81 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:59:09.328662 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-abec9357-b6f1-4d08-8a65-fb510645cf81 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:59:09.333815 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:09.356246 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:09.478663 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.842s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:09.480064 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 09:59:09.501000 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-1888d2cd-6a67-4110-a330-e5f4234c10fa req-6b3a462d-89ec-4088-bee2-9a6c899b0a1e service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Received event network-vif-unplugged-7759aa9a-fe3a-4902-88ae-2f679e5d2a68 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:09.501318 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1888d2cd-6a67-4110-a330-e5f4234c10fa req-6b3a462d-89ec-4088-bee2-9a6c899b0a1e service nova] Acquiring lock "e2856743-3a60-4be1-b29c-b4de06f14783-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:09.501543 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1888d2cd-6a67-4110-a330-e5f4234c10fa req-6b3a462d-89ec-4088-bee2-9a6c899b0a1e service nova] Lock "e2856743-3a60-4be1-b29c-b4de06f14783-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:09.501543 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1888d2cd-6a67-4110-a330-e5f4234c10fa req-6b3a462d-89ec-4088-bee2-9a6c899b0a1e service nova] Lock "e2856743-3a60-4be1-b29c-b4de06f14783-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:09.502278 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-1888d2cd-6a67-4110-a330-e5f4234c10fa req-6b3a462d-89ec-4088-bee2-9a6c899b0a1e service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] No waiting events found dispatching network-vif-unplugged-7759aa9a-fe3a-4902-88ae-2f679e5d2a68 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:59:09.502278 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-1888d2cd-6a67-4110-a330-e5f4234c10fa req-6b3a462d-89ec-4088-bee2-9a6c899b0a1e service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Received unexpected event network-vif-unplugged-7759aa9a-fe3a-4902-88ae-2f679e5d2a68 for instance with vm_state active and task_state None.
May 28 09:59:09.758616 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-3dfec7d6-8547-4f06-9e4a-a73b8df06627 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lazy-loading 'flavor' on Instance uuid 4a28d569-1ca9-4657-840c-7bb31d4644c8 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:59:09.994756 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 09:59:09.995142 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 09:59:09.995497 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:59:09.995765 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:59:10.097181 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '51981c995f2246588f2d58f35be5848a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d04b105229456d9ab53df1886fdb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 09:59:10.500428 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 09:59:10.569327 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:10.661928 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Successfully created port: ea7215be-0ccc-4d7a-ab01-5bb86ae75830 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 09:59:10.770655 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3dfec7d6-8547-4f06-9e4a-a73b8df06627 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "4a28d569-1ca9-4657-840c-7bb31d4644c8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.419s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:11.017686 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 09:59:11.249864 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Successfully updated port: ea7215be-0ccc-4d7a-ab01-5bb86ae75830 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 09:59:11.366476 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:11.443661 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-abec9357-b6f1-4d08-8a65-fb510645cf81 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Acquiring lock "refresh_cache-e2856743-3a60-4be1-b29c-b4de06f14783" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:59:11.444136 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-abec9357-b6f1-4d08-8a65-fb510645cf81 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Acquired lock "refresh_cache-e2856743-3a60-4be1-b29c-b4de06f14783" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:59:11.444309 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-abec9357-b6f1-4d08-8a65-fb510645cf81 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 09:59:11.577717 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f0ce2da9-ec1f-4951-918f-7cbb07832b11 req-c3f7cc4f-4bb2-4688-bd93-78a2bd889fb0 service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Received event network-vif-unplugged-7759aa9a-fe3a-4902-88ae-2f679e5d2a68 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:11.578240 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f0ce2da9-ec1f-4951-918f-7cbb07832b11 req-c3f7cc4f-4bb2-4688-bd93-78a2bd889fb0 service nova] Acquiring lock "e2856743-3a60-4be1-b29c-b4de06f14783-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:11.578240 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f0ce2da9-ec1f-4951-918f-7cbb07832b11 req-c3f7cc4f-4bb2-4688-bd93-78a2bd889fb0 service nova] Lock "e2856743-3a60-4be1-b29c-b4de06f14783-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:11.578437 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f0ce2da9-ec1f-4951-918f-7cbb07832b11 req-c3f7cc4f-4bb2-4688-bd93-78a2bd889fb0 service nova] Lock "e2856743-3a60-4be1-b29c-b4de06f14783-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:11.578437 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f0ce2da9-ec1f-4951-918f-7cbb07832b11 req-c3f7cc4f-4bb2-4688-bd93-78a2bd889fb0 service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] No waiting events found dispatching network-vif-unplugged-7759aa9a-fe3a-4902-88ae-2f679e5d2a68 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:59:11.578608 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-f0ce2da9-ec1f-4951-918f-7cbb07832b11 req-c3f7cc4f-4bb2-4688-bd93-78a2bd889fb0 service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Received unexpected event network-vif-unplugged-7759aa9a-fe3a-4902-88ae-2f679e5d2a68 for instance with vm_state active and task_state None.
May 28 09:59:11.578661 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f0ce2da9-ec1f-4951-918f-7cbb07832b11 req-c3f7cc4f-4bb2-4688-bd93-78a2bd889fb0 service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Received event network-vif-deleted-7759aa9a-fe3a-4902-88ae-2f679e5d2a68 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:11.578768 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-f0ce2da9-ec1f-4951-918f-7cbb07832b11 req-c3f7cc4f-4bb2-4688-bd93-78a2bd889fb0 service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Neutron deleted interface 7759aa9a-fe3a-4902-88ae-2f679e5d2a68; detaching it from the instance and deleting it from the info cache
May 28 09:59:11.579617 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [req-f0ce2da9-ec1f-4951-918f-7cbb07832b11 req-c3f7cc4f-4bb2-4688-bd93-78a2bd889fb0 service nova] Lazy-loading 'system_metadata' on Instance uuid e2856743-3a60-4be1-b29c-b4de06f14783 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:59:11.757463 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "refresh_cache-ceb9e572-ba71-4a8c-b415-44c9e7ebec51" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:59:11.757642 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquired lock "refresh_cache-ceb9e572-ba71-4a8c-b415-44c9e7ebec51" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:59:11.758255 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 09:59:11.817240 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Acquiring lock "0dca786c-46bb-48dc-a01a-e282daa84a89" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:11.817432 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "0dca786c-46bb-48dc-a01a-e282daa84a89" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:11.950191 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-abec9357-b6f1-4d08-8a65-fb510645cf81 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:59:12.028465 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 09:59:12.029835 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 09:59:12.030144 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Creating image(s)
May 28 09:59:12.030816 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "/opt/stack/data/nova/instances/ceb9e572-ba71-4a8c-b415-44c9e7ebec51/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:12.031087 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "/opt/stack/data/nova/instances/ceb9e572-ba71-4a8c-b415-44c9e7ebec51/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:12.031874 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "/opt/stack/data/nova/instances/ceb9e572-ba71-4a8c-b415-44c9e7ebec51/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:12.032503 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:59:12.036581 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:59:12.038724 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:59:12.082999 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [req-f0ce2da9-ec1f-4951-918f-7cbb07832b11 req-c3f7cc4f-4bb2-4688-bd93-78a2bd889fb0 service nova] Lazy-loading 'flavor' on Instance uuid e2856743-3a60-4be1-b29c-b4de06f14783 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:59:12.123980 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.085s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:59:12.124387 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:12.124926 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:12.125456 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:59:12.128579 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:59:12.128981 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:59:12.219218 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.090s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:59:12.220641 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/ceb9e572-ba71-4a8c-b415-44c9e7ebec51/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:59:12.265758 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/ceb9e572-ba71-4a8c-b415-44c9e7ebec51/disk 1073741824" returned: 0 in 0.045s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:59:12.266344 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.141s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:12.266790 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:59:12.320705 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Detaching volume 07c39f6e-3598-45d7-bec8-99175bbf3453
May 28 09:59:12.345771 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.079s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:59:12.346156 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ceb9e572-ba71-4a8c-b415-44c9e7ebec51/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 09:59:12.347098 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb9e572-ba71-4a8c-b415-44c9e7ebec51/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:59:12.374528 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 09:59:12.395609 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Attempting to driver detach volume 07c39f6e-3598-45d7-bec8-99175bbf3453 from mountpoint /dev/vdb
May 28 09:59:12.404640 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Found disk vdb by alias ua-07c39f6e-3598-45d7-bec8-99175bbf3453 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 09:59:12.411217 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Found disk vdb by alias ua-07c39f6e-3598-45d7-bec8-99175bbf3453 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 09:59:12.411217 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Attempting to detach device vdb from instance 0dca786c-46bb-48dc-a01a-e282daa84a89 from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 09:59:12.411217 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] detach device xml: <disk type="block" device="disk">
May 28 09:59:12.411217 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 09:59:12.411217 np0000001613 nova-compute[98321]:   <alias name="ua-07c39f6e-3598-45d7-bec8-99175bbf3453"/>
May 28 09:59:12.411217 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-9"/>
May 28 09:59:12.411217 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 09:59:12.411217 np0000001613 nova-compute[98321]:   <serial>07c39f6e-3598-45d7-bec8-99175bbf3453</serial>
May 28 09:59:12.411217 np0000001613 nova-compute[98321]:   <shareable/>
May 28 09:59:12.411217 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 09:59:12.411217 np0000001613 nova-compute[98321]: </disk>
May 28 09:59:12.411217 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 09:59:12.420314 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Successfully detached device vdb from instance 0dca786c-46bb-48dc-a01a-e282daa84a89 from the persistent domain config.
May 28 09:59:12.420314 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] (1/8): Attempting to detach device vdb with device alias ua-07c39f6e-3598-45d7-bec8-99175bbf3453 from instance 0dca786c-46bb-48dc-a01a-e282daa84a89 from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 09:59:12.420314 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] detach device xml: <disk type="block" device="disk">
May 28 09:59:12.420314 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 09:59:12.420314 np0000001613 nova-compute[98321]:   <alias name="ua-07c39f6e-3598-45d7-bec8-99175bbf3453"/>
May 28 09:59:12.420314 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-9"/>
May 28 09:59:12.420314 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 09:59:12.420314 np0000001613 nova-compute[98321]:   <serial>07c39f6e-3598-45d7-bec8-99175bbf3453</serial>
May 28 09:59:12.420314 np0000001613 nova-compute[98321]:   <shareable/>
May 28 09:59:12.420314 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 09:59:12.420314 np0000001613 nova-compute[98321]: </disk>
May 28 09:59:12.420314 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 09:59:12.427288 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb9e572-ba71-4a8c-b415-44c9e7ebec51/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:59:12.428531 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Cannot resize image /opt/stack/data/nova/instances/ceb9e572-ba71-4a8c-b415-44c9e7ebec51/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 09:59:12.428968 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 09:59:12.429193 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Ensure instance console log exists: /opt/stack/data/nova/instances/ceb9e572-ba71-4a8c-b415-44c9e7ebec51/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 09:59:12.430383 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:12.430617 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:12.430777 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:12.435046 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-abec9357-b6f1-4d08-8a65-fb510645cf81 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:59:12.589368 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [req-f0ce2da9-ec1f-4951-918f-7cbb07832b11 req-c3f7cc4f-4bb2-4688-bd93-78a2bd889fb0 service nova] Object Instance<e2856743-3a60-4be1-b29c-b4de06f14783> lazy-loaded attributes: system_metadata,flavor {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 09:59:12.590261 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [req-f0ce2da9-ec1f-4951-918f-7cbb07832b11 req-c3f7cc4f-4bb2-4688-bd93-78a2bd889fb0 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:57:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-501736735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-501736735',id=4,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPS8xG4KsWj7jd6eI8Ha8DW2V89ViHDMSJ32qPM+zEUw0jbx/lKgP6h0tE0l56+jki8nKEwFAor6rHbbQIYZjf8FhqUVxl6GRIyxLYKd7whepyq3n5RjNWjJHm94fY8qvQ==',key_name='tempest-keypair-1033085564',keypairs=<?>,launch_index=0,launched_at=2026-05-28T09:57:59Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata=<?>,migration_context=None,new_flavor=None,node='np0000001613',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='25a0adc32dd74f039cc231cceb9131a0',ramdisk_id='',reservation_id='r-0bm2bepy',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-936828907',owner_user_name='tempest-TaggedAttachmentsTest-936828907-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T09:58:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74620a0064844d8f922e02c653142fd6',uuid=e2856743-3a60-4be1-b29c-b4de06f14783,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7759aa9a-fe3a-4902-88ae-2f679e5d2a68", "address": "fa:16:3e:c3:78:fb", "network": {"id": "ebbec6c6-b741-42fd-b1a3-9127b6da8c88", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1016727797", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "25a0adc32dd74f039cc231cceb9131a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7759aa9a-fe", "ovs_interfaceid": "7759aa9a-fe3a-4902-88ae-2f679e5d2a68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 09:59:12.590480 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [req-f0ce2da9-ec1f-4951-918f-7cbb07832b11 req-c3f7cc4f-4bb2-4688-bd93-78a2bd889fb0 service nova] Converting VIF {"id": "7759aa9a-fe3a-4902-88ae-2f679e5d2a68", "address": "fa:16:3e:c3:78:fb", "network": {"id": "ebbec6c6-b741-42fd-b1a3-9127b6da8c88", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1016727797", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "25a0adc32dd74f039cc231cceb9131a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7759aa9a-fe", "ovs_interfaceid": "7759aa9a-fe3a-4902-88ae-2f679e5d2a68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:59:12.591175 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [req-f0ce2da9-ec1f-4951-918f-7cbb07832b11 req-c3f7cc4f-4bb2-4688-bd93-78a2bd889fb0 service nova] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:78:fb,bridge_name='br-int',has_traffic_filtering=True,id=7759aa9a-fe3a-4902-88ae-2f679e5d2a68,network=Network(ebbec6c6-b741-42fd-b1a3-9127b6da8c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7759aa9a-fe') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:59:12.594786 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [req-f0ce2da9-ec1f-4951-918f-7cbb07832b11 req-c3f7cc4f-4bb2-4688-bd93-78a2bd889fb0 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c3:78:fb"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap7759aa9a-fe"/></interface> {{(pid=98321) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 28 09:59:12.598524 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [req-f0ce2da9-ec1f-4951-918f-7cbb07832b11 req-c3f7cc4f-4bb2-4688-bd93-78a2bd889fb0 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c3:78:fb"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap7759aa9a-fe"/></interface>not found in domain: <domain type='qemu' id='4'>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:   <name>instance-00000004</name>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:   <uuid>e2856743-3a60-4be1-b29c-b4de06f14783</uuid>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:   <metadata>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:   <nova:package version="33.1.0"/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:   <nova:name>tempest-device-tagging-server-501736735</nova:name>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:   <nova:creationTime>2026-05-28 09:59:09</nova:creationTime>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:   <nova:flavor name="m1.nano" id="42">
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <nova:memory>192</nova:memory>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <nova:disk>1</nova:disk>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <nova:swap>0</nova:swap>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <nova:ephemeral>0</nova:ephemeral>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <nova:vcpus>1</nova:vcpus>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <nova:extraSpecs>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     </nova:extraSpecs>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:   </nova:flavor>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:   <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <nova:containerFormat>bare</nova:containerFormat>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <nova:minDisk>1</nova:minDisk>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <nova:minRam>0</nova:minRam>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <nova:properties>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <nova:property name="hw_machine_type">pc</nova:property>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <nova:property name="hw_video_model">virtio</nova:property>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     </nova:properties>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:   </nova:image>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:   <nova:owner>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <nova:user uuid="74620a0064844d8f922e02c653142fd6">tempest-TaggedAttachmentsTest-936828907-project-member</nova:user>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <nova:project uuid="25a0adc32dd74f039cc231cceb9131a0">tempest-TaggedAttachmentsTest-936828907</nova:project>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:   </nova:owner>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:   <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:   <nova:ports>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <nova:port uuid="2fad8030-7c30-438c-8dcd-b9a8ba1849d1">
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     </nova:port>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:   </nova:ports>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]: </nova:instance>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:   </metadata>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:   <memory unit='KiB'>196608</memory>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:   <currentMemory unit='KiB'>196608</currentMemory>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:   <vcpu placement='static'>1</vcpu>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:   <resource>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <partition>/machine</partition>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:   </resource>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:   <sysinfo type='smbios'>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <system>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <entry name='product'>OpenStack Nova</entry>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <entry name='version'>33.1.0</entry>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <entry name='serial'>e2856743-3a60-4be1-b29c-b4de06f14783</entry>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <entry name='uuid'>e2856743-3a60-4be1-b29c-b4de06f14783</entry>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <entry name='family'>Virtual Machine</entry>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     </system>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:   <os>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <boot dev='hd'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <smbios mode='sysinfo'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:   </os>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:   <features>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <acpi/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <vmcoreinfo state='on'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <tcg>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <tb-cache unit='KiB'>131072</tb-cache>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     </tcg>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:   </features>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:   <cpu mode='custom' match='exact' check='full'>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <model fallback='forbid'>Nehalem</model>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <feature policy='require' name='hypervisor'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:   <clock offset='utc'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:   <on_poweroff>destroy</on_poweroff>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:   <on_reboot>restart</on_reboot>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:   <on_crash>destroy</on_crash>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:   <devices>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <disk type='file' device='disk'>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <driver name='qemu' type='qcow2' cache='none'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <source file='/opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783/disk' index='2'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <backingStore type='file' index='3'>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:         <format type='raw'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:         <source file='/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:         <backingStore/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       </backingStore>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <target dev='vda' bus='virtio'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <alias name='virtio-disk0'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     </disk>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <disk type='file' device='cdrom'>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <driver name='qemu' type='raw' cache='none'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <source file='/opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783/disk.config' index='1'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <backingStore/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <target dev='hda' bus='ide'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <readonly/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <alias name='ide0-0-0'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     </disk>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <controller type='usb' index='0' model='none'>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <alias name='usb'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     </controller>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <controller type='pci' index='0' model='pci-root'>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <alias name='pci.0'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     </controller>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <controller type='ide' index='0'>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <alias name='ide'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     </controller>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <interface type='ethernet'>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <mac address='fa:16:3e:9a:42:b3'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <target dev='tap2fad8030-7c'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <model type='virtio'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <driver name='qemu'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <mtu size='1372'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <alias name='net0'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     </interface>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <serial type='pty'>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <source path='/dev/pts/3'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <log file='/opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783/console.log' append='off'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <target type='isa-serial' port='0'>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:         <model name='isa-serial'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       </target>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <alias name='serial0'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     </serial>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <console type='pty' tty='/dev/pts/3'>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <source path='/dev/pts/3'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <log file='/opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783/console.log' append='off'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <target type='serial' port='0'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <alias name='serial0'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     </console>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <input type='mouse' bus='ps2'>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <alias name='input0'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     </input>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <input type='keyboard' bus='ps2'>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <alias name='input1'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     </input>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <graphics type='vnc' port='5903' autoport='yes' listen='0.0.0.0'>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <listen type='address' address='0.0.0.0'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     </graphics>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <audio id='1' type='none'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <video>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <model type='virtio' heads='1' primary='yes'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <alias name='video0'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     </video>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <stats period='10'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <alias name='balloon0'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     </memballoon>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <rng model='virtio'>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <backend model='random'>/dev/urandom</backend>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <alias name='rng0'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     </rng>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:   </devices>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <label>libvirt-e2856743-3a60-4be1-b29c-b4de06f14783</label>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <imagelabel>libvirt-e2856743-3a60-4be1-b29c-b4de06f14783</imagelabel>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:   </seclabel>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <label>+64055:+993</label>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:     <imagelabel>+64055:+993</imagelabel>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:   </seclabel>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]: </domain>
May 28 09:59:12.598524 np0000001613 nova-compute[98321]:  {{(pid=98321) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 28 09:59:12.603038 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [req-f0ce2da9-ec1f-4951-918f-7cbb07832b11 req-c3f7cc4f-4bb2-4688-bd93-78a2bd889fb0 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c3:78:fb"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap7759aa9a-fe"/></interface> {{(pid=98321) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 28 09:59:12.606351 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [req-f0ce2da9-ec1f-4951-918f-7cbb07832b11 req-c3f7cc4f-4bb2-4688-bd93-78a2bd889fb0 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c3:78:fb"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap7759aa9a-fe"/></interface>not found in domain: <domain type='qemu' id='4'>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:   <name>instance-00000004</name>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:   <uuid>e2856743-3a60-4be1-b29c-b4de06f14783</uuid>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:   <metadata>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:   <nova:package version="33.1.0"/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:   <nova:name>tempest-device-tagging-server-501736735</nova:name>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:   <nova:creationTime>2026-05-28 09:59:09</nova:creationTime>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:   <nova:flavor name="m1.nano" id="42">
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <nova:memory>192</nova:memory>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <nova:disk>1</nova:disk>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <nova:swap>0</nova:swap>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <nova:ephemeral>0</nova:ephemeral>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <nova:vcpus>1</nova:vcpus>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <nova:extraSpecs>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     </nova:extraSpecs>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:   </nova:flavor>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:   <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <nova:containerFormat>bare</nova:containerFormat>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <nova:minDisk>1</nova:minDisk>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <nova:minRam>0</nova:minRam>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <nova:properties>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <nova:property name="hw_machine_type">pc</nova:property>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <nova:property name="hw_video_model">virtio</nova:property>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     </nova:properties>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:   </nova:image>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:   <nova:owner>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <nova:user uuid="74620a0064844d8f922e02c653142fd6">tempest-TaggedAttachmentsTest-936828907-project-member</nova:user>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <nova:project uuid="25a0adc32dd74f039cc231cceb9131a0">tempest-TaggedAttachmentsTest-936828907</nova:project>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:   </nova:owner>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:   <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:   <nova:ports>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <nova:port uuid="2fad8030-7c30-438c-8dcd-b9a8ba1849d1">
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     </nova:port>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:   </nova:ports>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]: </nova:instance>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:   </metadata>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:   <memory unit='KiB'>196608</memory>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:   <currentMemory unit='KiB'>196608</currentMemory>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:   <vcpu placement='static'>1</vcpu>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:   <resource>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <partition>/machine</partition>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:   </resource>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:   <sysinfo type='smbios'>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <system>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <entry name='product'>OpenStack Nova</entry>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <entry name='version'>33.1.0</entry>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <entry name='serial'>e2856743-3a60-4be1-b29c-b4de06f14783</entry>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <entry name='uuid'>e2856743-3a60-4be1-b29c-b4de06f14783</entry>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <entry name='family'>Virtual Machine</entry>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     </system>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:   <os>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <boot dev='hd'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <smbios mode='sysinfo'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:   </os>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:   <features>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <acpi/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <vmcoreinfo state='on'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <tcg>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <tb-cache unit='KiB'>131072</tb-cache>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     </tcg>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:   </features>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:   <cpu mode='custom' match='exact' check='full'>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <model fallback='forbid'>Nehalem</model>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <feature policy='require' name='hypervisor'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:   <clock offset='utc'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:   <on_poweroff>destroy</on_poweroff>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:   <on_reboot>restart</on_reboot>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:   <on_crash>destroy</on_crash>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:   <devices>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <disk type='file' device='disk'>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <driver name='qemu' type='qcow2' cache='none'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <source file='/opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783/disk' index='2'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <backingStore type='file' index='3'>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:         <format type='raw'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:         <source file='/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:         <backingStore/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       </backingStore>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <target dev='vda' bus='virtio'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <alias name='virtio-disk0'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     </disk>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <disk type='file' device='cdrom'>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <driver name='qemu' type='raw' cache='none'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <source file='/opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783/disk.config' index='1'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <backingStore/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <target dev='hda' bus='ide'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <readonly/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <alias name='ide0-0-0'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     </disk>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <controller type='usb' index='0' model='none'>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <alias name='usb'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     </controller>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <controller type='pci' index='0' model='pci-root'>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <alias name='pci.0'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     </controller>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <controller type='ide' index='0'>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <alias name='ide'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     </controller>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <interface type='ethernet'>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <mac address='fa:16:3e:9a:42:b3'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <target dev='tap2fad8030-7c'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <model type='virtio'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <driver name='qemu'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <mtu size='1372'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <alias name='net0'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     </interface>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <serial type='pty'>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <source path='/dev/pts/3'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <log file='/opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783/console.log' append='off'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <target type='isa-serial' port='0'>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:         <model name='isa-serial'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       </target>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <alias name='serial0'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     </serial>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <console type='pty' tty='/dev/pts/3'>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <source path='/dev/pts/3'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <log file='/opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783/console.log' append='off'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <target type='serial' port='0'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <alias name='serial0'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     </console>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <input type='mouse' bus='ps2'>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <alias name='input0'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     </input>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <input type='keyboard' bus='ps2'>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <alias name='input1'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     </input>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <graphics type='vnc' port='5903' autoport='yes' listen='0.0.0.0'>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <listen type='address' address='0.0.0.0'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     </graphics>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <audio id='1' type='none'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <video>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <model type='virtio' heads='1' primary='yes'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <alias name='video0'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     </video>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <stats period='10'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <alias name='balloon0'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     </memballoon>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <rng model='virtio'>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <backend model='random'>/dev/urandom</backend>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <alias name='rng0'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     </rng>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:   </devices>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <label>libvirt-e2856743-3a60-4be1-b29c-b4de06f14783</label>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <imagelabel>libvirt-e2856743-3a60-4be1-b29c-b4de06f14783</imagelabel>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:   </seclabel>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <label>+64055:+993</label>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:     <imagelabel>+64055:+993</imagelabel>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:   </seclabel>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]: </domain>
May 28 09:59:12.606351 np0000001613 nova-compute[98321]:  {{(pid=98321) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 28 09:59:12.606351 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [req-f0ce2da9-ec1f-4951-918f-7cbb07832b11 req-c3f7cc4f-4bb2-4688-bd93-78a2bd889fb0 service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Detaching interface fa:16:3e:c3:78:fb failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap7759aa9a-fe' not found.
May 28 09:59:12.611418 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [req-f0ce2da9-ec1f-4951-918f-7cbb07832b11 req-c3f7cc4f-4bb2-4688-bd93-78a2bd889fb0 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:57:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-501736735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-501736735',id=4,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPS8xG4KsWj7jd6eI8Ha8DW2V89ViHDMSJ32qPM+zEUw0jbx/lKgP6h0tE0l56+jki8nKEwFAor6rHbbQIYZjf8FhqUVxl6GRIyxLYKd7whepyq3n5RjNWjJHm94fY8qvQ==',key_name='tempest-keypair-1033085564',keypairs=<?>,launch_index=0,launched_at=2026-05-28T09:57:59Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata=<?>,migration_context=None,new_flavor=None,node='np0000001613',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='25a0adc32dd74f039cc231cceb9131a0',ramdisk_id='',reservation_id='r-0bm2bepy',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-936828907',owner_user_name='tempest-TaggedAttachmentsTest-936828907-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T09:58:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74620a0064844d8f922e02c653142fd6',uuid=e2856743-3a60-4be1-b29c-b4de06f14783,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7759aa9a-fe3a-4902-88ae-2f679e5d2a68", "address": "fa:16:3e:c3:78:fb", "network": {"id": "ebbec6c6-b741-42fd-b1a3-9127b6da8c88", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1016727797", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "25a0adc32dd74f039cc231cceb9131a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7759aa9a-fe", "ovs_interfaceid": "7759aa9a-fe3a-4902-88ae-2f679e5d2a68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 09:59:12.611418 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [req-f0ce2da9-ec1f-4951-918f-7cbb07832b11 req-c3f7cc4f-4bb2-4688-bd93-78a2bd889fb0 service nova] Converting VIF {"id": "7759aa9a-fe3a-4902-88ae-2f679e5d2a68", "address": "fa:16:3e:c3:78:fb", "network": {"id": "ebbec6c6-b741-42fd-b1a3-9127b6da8c88", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1016727797", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "25a0adc32dd74f039cc231cceb9131a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7759aa9a-fe", "ovs_interfaceid": "7759aa9a-fe3a-4902-88ae-2f679e5d2a68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:59:12.611418 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [req-f0ce2da9-ec1f-4951-918f-7cbb07832b11 req-c3f7cc4f-4bb2-4688-bd93-78a2bd889fb0 service nova] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:78:fb,bridge_name='br-int',has_traffic_filtering=True,id=7759aa9a-fe3a-4902-88ae-2f679e5d2a68,network=Network(ebbec6c6-b741-42fd-b1a3-9127b6da8c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7759aa9a-fe') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:59:12.611418 np0000001613 nova-compute[98321]: DEBUG os_vif [req-f0ce2da9-ec1f-4951-918f-7cbb07832b11 req-c3f7cc4f-4bb2-4688-bd93-78a2bd889fb0 service nova] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:78:fb,bridge_name='br-int',has_traffic_filtering=True,id=7759aa9a-fe3a-4902-88ae-2f679e5d2a68,network=Network(ebbec6c6-b741-42fd-b1a3-9127b6da8c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7759aa9a-fe') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 09:59:12.611418 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:12.611418 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7759aa9a-fe, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:12.611418 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 09:59:12.611418 np0000001613 nova-compute[98321]: INFO os_vif [req-f0ce2da9-ec1f-4951-918f-7cbb07832b11 req-c3f7cc4f-4bb2-4688-bd93-78a2bd889fb0 service nova] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:78:fb,bridge_name='br-int',has_traffic_filtering=True,id=7759aa9a-fe3a-4902-88ae-2f679e5d2a68,network=Network(ebbec6c6-b741-42fd-b1a3-9127b6da8c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7759aa9a-fe')
May 28 09:59:12.612261 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [req-f0ce2da9-ec1f-4951-918f-7cbb07832b11 req-c3f7cc4f-4bb2-4688-bd93-78a2bd889fb0 service nova] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-501736735', uuid='e2856743-3a60-4be1-b29c-b4de06f14783'), owner=OwnerMeta(userid='74620a0064844d8f922e02c653142fd6', username='tempest-TaggedAttachmentsTest-936828907-project-member', projectid='25a0adc32dd74f039cc231cceb9131a0', projectname='tempest-TaggedAttachmentsTest-936828907'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2fad8030-7c30-438c-8dcd-b9a8ba1849d1", "address": "fa:16:3e:9a:42:b3", "network": {"id": "48f4f13e-9b4c-4776-a2bd-47a4984571ae", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-337905894-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "25a0adc32dd74f039cc231cceb9131a0", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fad8030-7c", "ovs_interfaceid": "2fad8030-7c30-438c-8dcd-b9a8ba1849d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962352.611804) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 09:59:12.616543 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:59:12.621770 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [req-f0ce2da9-ec1f-4951-918f-7cbb07832b11 req-c3f7cc4f-4bb2-4688-bd93-78a2bd889fb0 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 09:59:12.621770 np0000001613 nova-compute[98321]:   <nova:package version="33.1.0"/>
May 28 09:59:12.621770 np0000001613 nova-compute[98321]:   <nova:name>tempest-device-tagging-server-501736735</nova:name>
May 28 09:59:12.621770 np0000001613 nova-compute[98321]:   <nova:creationTime>2026-05-28 09:59:12</nova:creationTime>
May 28 09:59:12.621770 np0000001613 nova-compute[98321]:   <nova:flavor name="m1.nano" id="42">
May 28 09:59:12.621770 np0000001613 nova-compute[98321]:     <nova:memory>192</nova:memory>
May 28 09:59:12.621770 np0000001613 nova-compute[98321]:     <nova:disk>1</nova:disk>
May 28 09:59:12.621770 np0000001613 nova-compute[98321]:     <nova:swap>0</nova:swap>
May 28 09:59:12.621770 np0000001613 nova-compute[98321]:     <nova:ephemeral>0</nova:ephemeral>
May 28 09:59:12.621770 np0000001613 nova-compute[98321]:     <nova:vcpus>1</nova:vcpus>
May 28 09:59:12.621770 np0000001613 nova-compute[98321]:     <nova:extraSpecs>
May 28 09:59:12.621770 np0000001613 nova-compute[98321]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 09:59:12.621770 np0000001613 nova-compute[98321]:     </nova:extraSpecs>
May 28 09:59:12.621770 np0000001613 nova-compute[98321]:   </nova:flavor>
May 28 09:59:12.621770 np0000001613 nova-compute[98321]:   <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 09:59:12.621770 np0000001613 nova-compute[98321]:     <nova:containerFormat>bare</nova:containerFormat>
May 28 09:59:12.621770 np0000001613 nova-compute[98321]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 28 09:59:12.621770 np0000001613 nova-compute[98321]:     <nova:minDisk>1</nova:minDisk>
May 28 09:59:12.621770 np0000001613 nova-compute[98321]:     <nova:minRam>0</nova:minRam>
May 28 09:59:12.621770 np0000001613 nova-compute[98321]:     <nova:properties>
May 28 09:59:12.621770 np0000001613 nova-compute[98321]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 09:59:12.621770 np0000001613 nova-compute[98321]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 09:59:12.621770 np0000001613 nova-compute[98321]:       <nova:property name="hw_machine_type">pc</nova:property>
May 28 09:59:12.621770 np0000001613 nova-compute[98321]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 28 09:59:12.621770 np0000001613 nova-compute[98321]:       <nova:property name="hw_video_model">virtio</nova:property>
May 28 09:59:12.621770 np0000001613 nova-compute[98321]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 28 09:59:12.621770 np0000001613 nova-compute[98321]:     </nova:properties>
May 28 09:59:12.621770 np0000001613 nova-compute[98321]:   </nova:image>
May 28 09:59:12.621770 np0000001613 nova-compute[98321]:   <nova:owner>
May 28 09:59:12.621770 np0000001613 nova-compute[98321]:     <nova:user uuid="74620a0064844d8f922e02c653142fd6">tempest-TaggedAttachmentsTest-936828907-project-member</nova:user>
May 28 09:59:12.621770 np0000001613 nova-compute[98321]:     <nova:project uuid="25a0adc32dd74f039cc231cceb9131a0">tempest-TaggedAttachmentsTest-936828907</nova:project>
May 28 09:59:12.621770 np0000001613 nova-compute[98321]:   </nova:owner>
May 28 09:59:12.621770 np0000001613 nova-compute[98321]:   <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 09:59:12.621770 np0000001613 nova-compute[98321]:   <nova:ports>
May 28 09:59:12.621770 np0000001613 nova-compute[98321]:     <nova:port uuid="2fad8030-7c30-438c-8dcd-b9a8ba1849d1">
May 28 09:59:12.621770 np0000001613 nova-compute[98321]:       <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 09:59:12.621770 np0000001613 nova-compute[98321]:     </nova:port>
May 28 09:59:12.621770 np0000001613 nova-compute[98321]:   </nova:ports>
May 28 09:59:12.621770 np0000001613 nova-compute[98321]: </nova:instance>
May 28 09:59:12.621770 np0000001613 nova-compute[98321]:  {{(pid=98321) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 28 09:59:12.623899 np0000001613 nova-compute[98321]: INFO nova.network.neutron [None req-abec9357-b6f1-4d08-8a65-fb510645cf81 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Port 7759aa9a-fe3a-4902-88ae-2f679e5d2a68 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
May 28 09:59:12.625800 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-abec9357-b6f1-4d08-8a65-fb510645cf81 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Updating instance_info_cache with network_info: [{"id": "2fad8030-7c30-438c-8dcd-b9a8ba1849d1", "address": "fa:16:3e:9a:42:b3", "network": {"id": "48f4f13e-9b4c-4776-a2bd-47a4984571ae", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-337905894-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "25a0adc32dd74f039cc231cceb9131a0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fad8030-7c", "ovs_interfaceid": "2fad8030-7c30-438c-8dcd-b9a8ba1849d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:59:12.627224 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-f0ce2da9-ec1f-4951-918f-7cbb07832b11 req-c3f7cc4f-4bb2-4688-bd93-78a2bd889fb0 service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Updating instance_info_cache with network_info: [{"id": "2fad8030-7c30-438c-8dcd-b9a8ba1849d1", "address": "fa:16:3e:9a:42:b3", "network": {"id": "48f4f13e-9b4c-4776-a2bd-47a4984571ae", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-337905894-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "25a0adc32dd74f039cc231cceb9131a0", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fad8030-7c", "ovs_interfaceid": "2fad8030-7c30-438c-8dcd-b9a8ba1849d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:59:12.692524 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:12.781327 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Updating instance_info_cache with network_info: [{"id": "ea7215be-0ccc-4d7a-ab01-5bb86ae75830", "address": "fa:16:3e:05:61:f2", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea7215be-0c", "ovs_interfaceid": "ea7215be-0ccc-4d7a-ab01-5bb86ae75830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:59:13.127317 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-abec9357-b6f1-4d08-8a65-fb510645cf81 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Releasing lock "refresh_cache-e2856743-3a60-4be1-b29c-b4de06f14783" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:59:13.133012 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f0ce2da9-ec1f-4951-918f-7cbb07832b11 req-c3f7cc4f-4bb2-4688-bd93-78a2bd889fb0 service nova] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Received event network-changed-ea7215be-0ccc-4d7a-ab01-5bb86ae75830 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:13.133141 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f0ce2da9-ec1f-4951-918f-7cbb07832b11 req-c3f7cc4f-4bb2-4688-bd93-78a2bd889fb0 service nova] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Refreshing instance network info cache due to event network-changed-ea7215be-0ccc-4d7a-ab01-5bb86ae75830. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 09:59:13.133315 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f0ce2da9-ec1f-4951-918f-7cbb07832b11 req-c3f7cc4f-4bb2-4688-bd93-78a2bd889fb0 service nova] Acquiring lock "refresh_cache-ceb9e572-ba71-4a8c-b415-44c9e7ebec51" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:59:13.243211 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0005300179998357635 future=<Future at 0x73c1f473e600 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:59:13.243211 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:59:13.243414 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=1.5532585860000836 future=<Future at 0x73c1fc5e42c0 state=cancelled>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:59:13.243414 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=1.5531468669998958 future=<Future at 0x73c1fc5e42c0 state=cancelled>) was cancelled while queued, skipping {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:59:13.243489 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:59:13.243810 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=3.302107562999936 future=<Future at 0x73c1fc7643b0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:59:13.243810 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=3.302006795999887 future=<Future at 0x73c1fc7643b0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:59:13.244451 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Emitting event <LifecycleEvent: 1779962338.2423232, 92fbf243-1c5b-47f6-9317-3fb2655651db => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:59:13.245523 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] VM Stopped (Lifecycle Event)
May 28 09:59:13.283983 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Releasing lock "refresh_cache-ceb9e572-ba71-4a8c-b415-44c9e7ebec51" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:59:13.284482 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Instance network_info: |[{"id": "ea7215be-0ccc-4d7a-ab01-5bb86ae75830", "address": "fa:16:3e:05:61:f2", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea7215be-0c", "ovs_interfaceid": "ea7215be-0ccc-4d7a-ab01-5bb86ae75830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 09:59:13.284911 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f0ce2da9-ec1f-4951-918f-7cbb07832b11 req-c3f7cc4f-4bb2-4688-bd93-78a2bd889fb0 service nova] Acquired lock "refresh_cache-ceb9e572-ba71-4a8c-b415-44c9e7ebec51" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:59:13.286437 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Start _get_guest_xml network_info=[{"id": "ea7215be-0ccc-4d7a-ab01-5bb86ae75830", "address": "fa:16:3e:05:61:f2", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea7215be-0c", "ovs_interfaceid": "ea7215be-0ccc-4d7a-ab01-5bb86ae75830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 09:59:13.287127 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-f0ce2da9-ec1f-4951-918f-7cbb07832b11 req-c3f7cc4f-4bb2-4688-bd93-78a2bd889fb0 service nova] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Refreshing network info cache for port ea7215be-0ccc-4d7a-ab01-5bb86ae75830 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 09:59:13.290227 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 09:59:13.290688 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-2121113509', uuid='ceb9e572-ba71-4a8c-b415-44c9e7ebec51'), owner=OwnerMeta(userid='51981c995f2246588f2d58f35be5848a', username='tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member', projectid='a9d04b105229456d9ab53df1886fdb37', projectname='tempest-ServerBootFromVolumeStableRescueTest-283762505'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ea7215be-0ccc-4d7a-ab01-5bb86ae75830", "address": "fa:16:3e:05:61:f2", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea7215be-0c", "ovs_interfaceid": "ea7215be-0ccc-4d7a-ab01-5bb86ae75830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962353.2903168) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 09:59:13.291785 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 09:59:13.292124 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 09:59:13.293050 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 09:59:13.293265 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 09:59:13.294227 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 09:59:13.294558 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 09:59:13.294715 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 09:59:13.294824 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 09:59:13.294993 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 09:59:13.295083 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 09:59:13.295246 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 09:59:13.295346 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 09:59:13.295461 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 09:59:13.295561 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 09:59:13.296585 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 09:59:13.296585 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 09:59:13.306026 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T09:59:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2121113509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serverbootfromvolumestablerescuetest-server-2121113509',id=13,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9d04b105229456d9ab53df1886fdb37',ramdisk_id='',reservation_id='r-v57ft0uc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-283762505',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:59:11Z,user_data=None,user_id='51981c995f2246588f2d58f35be5848a',uuid=ceb9e572-ba71-4a8c-b415-44c9e7ebec51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea7215be-0ccc-4d7a-ab01-5bb86ae75830", "address": "fa:16:3e:05:61:f2", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea7215be-0c", "ovs_interfaceid": "ea7215be-0ccc-4d7a-ab01-5bb86ae75830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 09:59:13.306296 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Converting VIF {"id": "ea7215be-0ccc-4d7a-ab01-5bb86ae75830", "address": "fa:16:3e:05:61:f2", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea7215be-0c", "ovs_interfaceid": "ea7215be-0ccc-4d7a-ab01-5bb86ae75830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:59:13.306837 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:61:f2,bridge_name='br-int',has_traffic_filtering=True,id=ea7215be-0ccc-4d7a-ab01-5bb86ae75830,network=Network(e5543f88-c716-4e02-82e9-2cb7570bf25e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea7215be-0c') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:59:13.307275 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lazy-loading 'pci_devices' on Instance uuid ceb9e572-ba71-4a8c-b415-44c9e7ebec51 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:59:13.631217 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-abec9357-b6f1-4d08-8a65-fb510645cf81 tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lock "interface-e2856743-3a60-4be1-b29c-b4de06f14783-7759aa9a-fe3a-4902-88ae-2f679e5d2a68" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 6.426s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:13.749513 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 92fbf243-1c5b-47f6-9317-3fb2655651db] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:59:13.789395 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-f0ce2da9-ec1f-4951-918f-7cbb07832b11 req-c3f7cc4f-4bb2-4688-bd93-78a2bd889fb0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:59:13.810194 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] End _get_guest_xml xml=<domain type="qemu">
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:   <uuid>ceb9e572-ba71-4a8c-b415-44c9e7ebec51</uuid>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:   <name>instance-0000000d</name>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:   <metadata>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2121113509</nova:name>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 09:59:13</nova:creationTime>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:       </nova:image>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:         <nova:user uuid="51981c995f2246588f2d58f35be5848a">tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member</nova:user>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:         <nova:project uuid="a9d04b105229456d9ab53df1886fdb37">tempest-ServerBootFromVolumeStableRescueTest-283762505</nova:project>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:         <nova:port uuid="ea7215be-0ccc-4d7a-ab01-5bb86ae75830">
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:         </nova:port>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:   </metadata>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:     <system>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:       <entry name="serial">ceb9e572-ba71-4a8c-b415-44c9e7ebec51</entry>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:       <entry name="uuid">ceb9e572-ba71-4a8c-b415-44c9e7ebec51</entry>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:     </system>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:   <os>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:   </os>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:   <features>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:     <acpi/>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:     <tcg>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:     </tcg>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:   </features>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:   <devices>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/ceb9e572-ba71-4a8c-b415-44c9e7ebec51/disk"/>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:     </disk>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/ceb9e572-ba71-4a8c-b415-44c9e7ebec51/disk.config"/>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:     </disk>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:05:61:f2"/>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:       <target dev="tapea7215be-0c"/>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:     </interface>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/ceb9e572-ba71-4a8c-b415-44c9e7ebec51/console.log" append="off"/>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:     </serial>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:     <video>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:     </video>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:     </rng>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:     </memballoon>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:   </devices>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]: </domain>
May 28 09:59:13.810194 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 09:59:13.816017 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Preparing to wait for external event network-vif-plugged-ea7215be-0ccc-4d7a-ab01-5bb86ae75830 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 09:59:13.816017 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "ceb9e572-ba71-4a8c-b415-44c9e7ebec51-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:13.816017 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "ceb9e572-ba71-4a8c-b415-44c9e7ebec51-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:13.816017 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "ceb9e572-ba71-4a8c-b415-44c9e7ebec51-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:13.816017 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T09:59:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2121113509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serverbootfromvolumestablerescuetest-server-2121113509',id=13,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9d04b105229456d9ab53df1886fdb37',ramdisk_id='',reservation_id='r-v57ft0uc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-283762505',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:59:11Z,user_data=None,user_id='51981c995f2246588f2d58f35be5848a',uuid=ceb9e572-ba71-4a8c-b415-44c9e7ebec51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea7215be-0ccc-4d7a-ab01-5bb86ae75830", "address": "fa:16:3e:05:61:f2", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea7215be-0c", "ovs_interfaceid": "ea7215be-0ccc-4d7a-ab01-5bb86ae75830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 09:59:13.816017 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Converting VIF {"id": "ea7215be-0ccc-4d7a-ab01-5bb86ae75830", "address": "fa:16:3e:05:61:f2", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea7215be-0c", "ovs_interfaceid": "ea7215be-0ccc-4d7a-ab01-5bb86ae75830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:59:13.816017 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:61:f2,bridge_name='br-int',has_traffic_filtering=True,id=ea7215be-0ccc-4d7a-ab01-5bb86ae75830,network=Network(e5543f88-c716-4e02-82e9-2cb7570bf25e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea7215be-0c') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:59:13.816483 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:61:f2,bridge_name='br-int',has_traffic_filtering=True,id=ea7215be-0ccc-4d7a-ab01-5bb86ae75830,network=Network(e5543f88-c716-4e02-82e9-2cb7570bf25e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea7215be-0c') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 09:59:13.817276 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:13.817623 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:13.817868 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 09:59:13.819292 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:13.819692 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '55f93e38-5d33-5631-95a6-0b767eaa5a63', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:13.824042 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:13.825433 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:59:13.831984 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:13.832282 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea7215be-0c, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:13.835833 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapea7215be-0c, col_values=(('qos', UUID('7d7273de-d29c-43ee-88d6-2940e812ec6c')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:13.836409 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapea7215be-0c, col_values=(('external_ids', {'iface-id': 'ea7215be-0ccc-4d7a-ab01-5bb86ae75830', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:61:f2', 'vm-uuid': 'ceb9e572-ba71-4a8c-b415-44c9e7ebec51'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:13.838728 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:13.842807 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:59:13.845928 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:13.847031 np0000001613 nova-compute[98321]: INFO os_vif [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:61:f2,bridge_name='br-int',has_traffic_filtering=True,id=ea7215be-0ccc-4d7a-ab01-5bb86ae75830,network=Network(e5543f88-c716-4e02-82e9-2cb7570bf25e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea7215be-0c')
May 28 09:59:14.154766 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-f0ce2da9-ec1f-4951-918f-7cbb07832b11 req-c3f7cc4f-4bb2-4688-bd93-78a2bd889fb0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:59:14.197820 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:14.291874 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-f0ce2da9-ec1f-4951-918f-7cbb07832b11 req-c3f7cc4f-4bb2-4688-bd93-78a2bd889fb0 service nova] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Updated VIF entry in instance network info cache for port ea7215be-0ccc-4d7a-ab01-5bb86ae75830. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 09:59:14.292242 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-f0ce2da9-ec1f-4951-918f-7cbb07832b11 req-c3f7cc4f-4bb2-4688-bd93-78a2bd889fb0 service nova] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Updating instance_info_cache with network_info: [{"id": "ea7215be-0ccc-4d7a-ab01-5bb86ae75830", "address": "fa:16:3e:05:61:f2", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea7215be-0c", "ovs_interfaceid": "ea7215be-0ccc-4d7a-ab01-5bb86ae75830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:59:14.699495 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:14.794174 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f0ce2da9-ec1f-4951-918f-7cbb07832b11 req-c3f7cc4f-4bb2-4688-bd93-78a2bd889fb0 service nova] Releasing lock "refresh_cache-ceb9e572-ba71-4a8c-b415-44c9e7ebec51" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:59:14.873928 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779962354.873562, 0dca786c-46bb-48dc-a01a-e282daa84a89 => ua-07c39f6e-3598-45d7-bec8-99175bbf3453> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 09:59:14.877567 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-07c39f6e-3598-45d7-bec8-99175bbf3453 for instance 0dca786c-46bb-48dc-a01a-e282daa84a89 {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 09:59:14.880523 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Successfully detached device vdb from instance 0dca786c-46bb-48dc-a01a-e282daa84a89 from the live domain config.
May 28 09:59:14.919010 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 09:59:14.919305 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453', 'iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '07c39f6e-3598-45d7-bec8-99175bbf3453', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 09:59:14.919418 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:59:14.919764 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:59:14.920016 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453', 'iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '07c39f6e-3598-45d7-bec8-99175bbf3453', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 09:59:14.920142 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 09:59:14.949983 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:59:14.949983 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:14.949983 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:14.949983 np0000001613 nova-compute[98321]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:59:14.949983 np0000001613 nova-compute[98321]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:59:14.949983 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:59:14.949983 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:59:14.949983 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:14.949983 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:14.949983 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:59:14.949983 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:59:14.949983 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:59:14.949983 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:59:14.950435 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:59:14.950435 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:14.950435 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:14.950435 np0000001613 nova-compute[98321]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:59:14.950435 np0000001613 nova-compute[98321]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453 (non-flash)
May 28 09:59:14.950435 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:59:14.950435 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:59:14.950435 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:14.950435 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:14.950435 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:59:14.950435 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:59:14.950435 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:59:14.950435 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:59:14.950435 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0', '4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5', '8'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480', '9')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 09:59:14.950435 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453', '17')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 09:59:14.951847 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453', '18')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 09:59:14.952225 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc37a7a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453'): ({'sdp'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453'): ({'sdq'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 09:59:14.952697 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Removing multipathed devices sdq, sdp {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 09:59:14.952697 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Flush multipath device 3300000000a84ca57 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 09:59:14.984135 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Remove SCSI device /dev/sdq with /sys/block/sdq/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 09:59:15.032893 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Remove SCSI device /dev/sdp with /sys/block/sdp/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 09:59:15.077725 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Checking to see if SCSI volumes sdq, sdp have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 09:59:15.077982 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] SCSI volumes sdq, sdp have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 09:59:15.079730 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Checking to see if device paths {'sdq', 'sdp'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 09:59:15.096917 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Device paths {'sdq', 'sdp'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 09:59:15.097886 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 09:59:15.113858 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:15.169061 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453, portal: 192.168.40.100,3260]
May 28 09:59:15.169061 np0000001613 nova-compute[98321]: Logout of [sid: 17, target: iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453, portal: 192.168.40.100,3260] successful.
May 28 09:59:15.169061 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:15.194944 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:15.210927 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:15.250812 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453, portal: 192.168.50.100,3260]
May 28 09:59:15.250812 np0000001613 nova-compute[98321]: Logout of [sid: 18, target: iqn.2023-03.storpool.com:os--volume-07c39f6e-3598-45d7-bec8-99175bbf3453, portal: 192.168.50.100,3260] successful.
May 28 09:59:15.250812 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:15.271824 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:15.272099 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:59:15.272214 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] <== disconnect_volume: return (352ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 09:59:15.272357 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 09:59:15.338786 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d37a84a9-9190-497e-814b-dfb0545916ea tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Acquiring lock "e2856743-3a60-4be1-b29c-b4de06f14783" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:15.338997 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d37a84a9-9190-497e-814b-dfb0545916ea tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lock "e2856743-3a60-4be1-b29c-b4de06f14783" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:15.339178 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d37a84a9-9190-497e-814b-dfb0545916ea tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Acquiring lock "e2856743-3a60-4be1-b29c-b4de06f14783-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:15.339401 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d37a84a9-9190-497e-814b-dfb0545916ea tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lock "e2856743-3a60-4be1-b29c-b4de06f14783-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:15.339536 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d37a84a9-9190-497e-814b-dfb0545916ea tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lock "e2856743-3a60-4be1-b29c-b4de06f14783-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:15.342141 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-d37a84a9-9190-497e-814b-dfb0545916ea tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Terminating instance
May 28 09:59:15.369134 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:59:15.369289 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:59:15.369407 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] No VIF found with MAC fa:16:3e:05:61:f2, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 09:59:15.369937 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Using config drive
May 28 09:59:15.836351 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lazy-loading 'flavor' on Instance uuid 0dca786c-46bb-48dc-a01a-e282daa84a89 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:59:15.846376 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d37a84a9-9190-497e-814b-dfb0545916ea tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 09:59:15.874713 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:59:15.880032 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:15.887314 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:15.904965 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:15.936374 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:15.937867 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:16.074772 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5f701ddc-2600-4547-91b1-27654ef0f12a req-0d57e404-f2fd-483f-b73f-25214296ee79 service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Received event network-vif-unplugged-2fad8030-7c30-438c-8dcd-b9a8ba1849d1 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:16.074941 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5f701ddc-2600-4547-91b1-27654ef0f12a req-0d57e404-f2fd-483f-b73f-25214296ee79 service nova] Acquiring lock "e2856743-3a60-4be1-b29c-b4de06f14783-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:16.075470 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5f701ddc-2600-4547-91b1-27654ef0f12a req-0d57e404-f2fd-483f-b73f-25214296ee79 service nova] Lock "e2856743-3a60-4be1-b29c-b4de06f14783-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:16.077108 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5f701ddc-2600-4547-91b1-27654ef0f12a req-0d57e404-f2fd-483f-b73f-25214296ee79 service nova] Lock "e2856743-3a60-4be1-b29c-b4de06f14783-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:16.077790 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5f701ddc-2600-4547-91b1-27654ef0f12a req-0d57e404-f2fd-483f-b73f-25214296ee79 service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] No waiting events found dispatching network-vif-unplugged-2fad8030-7c30-438c-8dcd-b9a8ba1849d1 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:59:16.078393 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5f701ddc-2600-4547-91b1-27654ef0f12a req-0d57e404-f2fd-483f-b73f-25214296ee79 service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Received event network-vif-unplugged-2fad8030-7c30-438c-8dcd-b9a8ba1849d1 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 09:59:16.084798 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Creating config drive at /opt/stack/data/nova/instances/ceb9e572-ba71-4a8c-b415-44c9e7ebec51/disk.config
May 28 09:59:16.089224 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ceb9e572-ba71-4a8c-b415-44c9e7ebec51/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpudm9e8za {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:59:16.145730 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ceb9e572-ba71-4a8c-b415-44c9e7ebec51/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpudm9e8za" returned: 0 in 0.056s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:59:16.403804 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999692748999905 future=<Future at 0x73c1f4310470 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:59:16.410873 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Instance destroyed successfully.
May 28 09:59:16.412149 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-d37a84a9-9190-497e-814b-dfb0545916ea tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lazy-loading 'resources' on Instance uuid e2856743-3a60-4be1-b29c-b4de06f14783 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:59:16.546348 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0004611700001078134 future=<Future at 0x73c1fc7643b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:59:16.547083 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Emitting event <LifecycleEvent: 1779962341.5456104, 49ff17d1-cad9-463e-b5c1-3315c52412e6 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:59:16.547270 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:59:16.547630 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] VM Stopped (Lifecycle Event)
May 28 09:59:16.549295 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.85419046700008 future=<Future at 0x73c1f4310470 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:59:16.549419 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.854024879000008 future=<Future at 0x73c1f4310470 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:59:16.724332 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:16.769335 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:16.843797 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:16.848339 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-029a85e8-ff54-4c59-8575-8d59cfdd97e3 tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "0dca786c-46bb-48dc-a01a-e282daa84a89" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.029s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:16.916575 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-d37a84a9-9190-497e-814b-dfb0545916ea tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:57:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-501736735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-501736735',id=4,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPS8xG4KsWj7jd6eI8Ha8DW2V89ViHDMSJ32qPM+zEUw0jbx/lKgP6h0tE0l56+jki8nKEwFAor6rHbbQIYZjf8FhqUVxl6GRIyxLYKd7whepyq3n5RjNWjJHm94fY8qvQ==',key_name='tempest-keypair-1033085564',keypairs=<?>,launch_index=0,launched_at=2026-05-28T09:57:59Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='25a0adc32dd74f039cc231cceb9131a0',ramdisk_id='',reservation_id='r-0bm2bepy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-936828907',owner_user_name='tempest-TaggedAttachmentsTest-936828907-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T09:58:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74620a0064844d8f922e02c653142fd6',uuid=e2856743-3a60-4be1-b29c-b4de06f14783,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2fad8030-7c30-438c-8dcd-b9a8ba1849d1", "address": "fa:16:3e:9a:42:b3", "network": {"id": "48f4f13e-9b4c-4776-a2bd-47a4984571ae", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-337905894-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "25a0adc32dd74f039cc231cceb9131a0", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fad8030-7c", "ovs_interfaceid": "2fad8030-7c30-438c-8dcd-b9a8ba1849d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 09:59:16.924023 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d37a84a9-9190-497e-814b-dfb0545916ea tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Converting VIF {"id": "2fad8030-7c30-438c-8dcd-b9a8ba1849d1", "address": "fa:16:3e:9a:42:b3", "network": {"id": "48f4f13e-9b4c-4776-a2bd-47a4984571ae", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-337905894-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "25a0adc32dd74f039cc231cceb9131a0", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fad8030-7c", "ovs_interfaceid": "2fad8030-7c30-438c-8dcd-b9a8ba1849d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:59:16.939318 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d37a84a9-9190-497e-814b-dfb0545916ea tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:42:b3,bridge_name='br-int',has_traffic_filtering=True,id=2fad8030-7c30-438c-8dcd-b9a8ba1849d1,network=Network(48f4f13e-9b4c-4776-a2bd-47a4984571ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fad8030-7c') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:59:16.939924 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-d37a84a9-9190-497e-814b-dfb0545916ea tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:42:b3,bridge_name='br-int',has_traffic_filtering=True,id=2fad8030-7c30-438c-8dcd-b9a8ba1849d1,network=Network(48f4f13e-9b4c-4776-a2bd-47a4984571ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fad8030-7c') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 09:59:16.946308 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:16.946428 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2fad8030-7c, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:16.948173 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:16.950616 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:59:16.955272 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:16.955461 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dd2a16d4-b956-4452-b287-ece2bd36bc75) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:16.958311 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:59:16.962999 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:16.968870 np0000001613 nova-compute[98321]: INFO os_vif [None req-d37a84a9-9190-497e-814b-dfb0545916ea tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:42:b3,bridge_name='br-int',has_traffic_filtering=True,id=2fad8030-7c30-438c-8dcd-b9a8ba1849d1,network=Network(48f4f13e-9b4c-4776-a2bd-47a4984571ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fad8030-7c')
May 28 09:59:16.971526 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-d37a84a9-9190-497e-814b-dfb0545916ea tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Deleting instance files /opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783_del
May 28 09:59:16.975154 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-d37a84a9-9190-497e-814b-dfb0545916ea tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Deletion of /opt/stack/data/nova/instances/e2856743-3a60-4be1-b29c-b4de06f14783_del complete
May 28 09:59:17.054688 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-c8d20667-3d90-46a7-8a29-c47def88c37d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 49ff17d1-cad9-463e-b5c1-3315c52412e6] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:59:17.210265 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-1902b5df-0378-4dc4-be37-55aeb8d5b68f req-110e81d8-8b4f-4271-af57-aed25bbf7eba service nova] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Received event network-vif-plugged-ea7215be-0ccc-4d7a-ab01-5bb86ae75830 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:17.210444 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1902b5df-0378-4dc4-be37-55aeb8d5b68f req-110e81d8-8b4f-4271-af57-aed25bbf7eba service nova] Acquiring lock "ceb9e572-ba71-4a8c-b415-44c9e7ebec51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:17.210612 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1902b5df-0378-4dc4-be37-55aeb8d5b68f req-110e81d8-8b4f-4271-af57-aed25bbf7eba service nova] Lock "ceb9e572-ba71-4a8c-b415-44c9e7ebec51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:17.211297 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1902b5df-0378-4dc4-be37-55aeb8d5b68f req-110e81d8-8b4f-4271-af57-aed25bbf7eba service nova] Lock "ceb9e572-ba71-4a8c-b415-44c9e7ebec51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:17.211297 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-1902b5df-0378-4dc4-be37-55aeb8d5b68f req-110e81d8-8b4f-4271-af57-aed25bbf7eba service nova] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Processing event network-vif-plugged-ea7215be-0ccc-4d7a-ab01-5bb86ae75830 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 09:59:17.272453 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-295ad827-7c52-4a14-8177-43423ed7307e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Acquiring lock "4a28d569-1ca9-4657-840c-7bb31d4644c8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:17.272659 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-295ad827-7c52-4a14-8177-43423ed7307e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "4a28d569-1ca9-4657-840c-7bb31d4644c8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:17.272861 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-295ad827-7c52-4a14-8177-43423ed7307e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Acquiring lock "4a28d569-1ca9-4657-840c-7bb31d4644c8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:17.273006 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-295ad827-7c52-4a14-8177-43423ed7307e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "4a28d569-1ca9-4657-840c-7bb31d4644c8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:17.273115 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-295ad827-7c52-4a14-8177-43423ed7307e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "4a28d569-1ca9-4657-840c-7bb31d4644c8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:17.275177 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-295ad827-7c52-4a14-8177-43423ed7307e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Terminating instance
May 28 09:59:17.439969 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-16a7af25-f70a-4a45-9e00-6829fcc4640b tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Acquiring lock "0dca786c-46bb-48dc-a01a-e282daa84a89" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:17.440338 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-16a7af25-f70a-4a45-9e00-6829fcc4640b tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "0dca786c-46bb-48dc-a01a-e282daa84a89" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:17.440338 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-16a7af25-f70a-4a45-9e00-6829fcc4640b tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Acquiring lock "0dca786c-46bb-48dc-a01a-e282daa84a89-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:17.440482 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-16a7af25-f70a-4a45-9e00-6829fcc4640b tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "0dca786c-46bb-48dc-a01a-e282daa84a89-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:17.441669 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-16a7af25-f70a-4a45-9e00-6829fcc4640b tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "0dca786c-46bb-48dc-a01a-e282daa84a89-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:17.445890 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-16a7af25-f70a-4a45-9e00-6829fcc4640b tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Terminating instance
May 28 09:59:17.486190 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-d37a84a9-9190-497e-814b-dfb0545916ea tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Took 1.64 seconds to destroy the instance on the hypervisor.
May 28 09:59:17.487386 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-d37a84a9-9190-497e-814b-dfb0545916ea tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 09:59:17.488461 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 09:59:17.488554 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 09:59:17.488840 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:59:17.565274 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:59:17.690660 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 09:59:17.693353 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962357.6928453, ceb9e572-ba71-4a8c-b415-44c9e7ebec51 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:59:17.693416 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] VM Started (Lifecycle Event)
May 28 09:59:17.695207 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 09:59:17.704470 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Instance spawned successfully.
May 28 09:59:17.705216 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 09:59:17.734067 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:17.778348 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-295ad827-7c52-4a14-8177-43423ed7307e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 09:59:17.807150 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:17.814951 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:17.831991 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:17.950415 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-16a7af25-f70a-4a45-9e00-6829fcc4640b tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 09:59:17.992374 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:17.996129 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:18.005068 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:18.018096 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:18.027181 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:18.052318 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:18.083823 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:18.150222 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Instance destroyed successfully.
May 28 09:59:18.150222 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-295ad827-7c52-4a14-8177-43423ed7307e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lazy-loading 'resources' on Instance uuid 4a28d569-1ca9-4657-840c-7bb31d4644c8 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:59:18.202303 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:59:18.209124 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c832998a-d799-4ab0-8ebd-5f259bc95597 req-e53ef9e4-b30d-4c51-87bd-a12ac5f7ce6b service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Received event network-vif-unplugged-2fad8030-7c30-438c-8dcd-b9a8ba1849d1 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:18.214507 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c832998a-d799-4ab0-8ebd-5f259bc95597 req-e53ef9e4-b30d-4c51-87bd-a12ac5f7ce6b service nova] Acquiring lock "e2856743-3a60-4be1-b29c-b4de06f14783-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:18.218718 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c832998a-d799-4ab0-8ebd-5f259bc95597 req-e53ef9e4-b30d-4c51-87bd-a12ac5f7ce6b service nova] Lock "e2856743-3a60-4be1-b29c-b4de06f14783-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:18.218960 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c832998a-d799-4ab0-8ebd-5f259bc95597 req-e53ef9e4-b30d-4c51-87bd-a12ac5f7ce6b service nova] Lock "e2856743-3a60-4be1-b29c-b4de06f14783-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:18.218960 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c832998a-d799-4ab0-8ebd-5f259bc95597 req-e53ef9e4-b30d-4c51-87bd-a12ac5f7ce6b service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] No waiting events found dispatching network-vif-unplugged-2fad8030-7c30-438c-8dcd-b9a8ba1849d1 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:59:18.219475 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c832998a-d799-4ab0-8ebd-5f259bc95597 req-e53ef9e4-b30d-4c51-87bd-a12ac5f7ce6b service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Received event network-vif-unplugged-2fad8030-7c30-438c-8dcd-b9a8ba1849d1 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 09:59:18.219475 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 09:59:18.224136 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:59:18.224323 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:59:18.224813 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:59:18.225071 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:59:18.227230 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:59:18.227230 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:59:18.329009 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Instance destroyed successfully.
May 28 09:59:18.329754 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-16a7af25-f70a-4a45-9e00-6829fcc4640b tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lazy-loading 'resources' on Instance uuid 0dca786c-46bb-48dc-a01a-e282daa84a89 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:59:18.426785 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f31ea465-3475-47f1-837f-b4a69a37cab6 req-cf693b53-3a2c-4327-aa2f-ee1a1c8a79df service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Received event network-vif-deleted-2fad8030-7c30-438c-8dcd-b9a8ba1849d1 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:18.429219 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-f31ea465-3475-47f1-837f-b4a69a37cab6 req-cf693b53-3a2c-4327-aa2f-ee1a1c8a79df service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Neutron deleted interface 2fad8030-7c30-438c-8dcd-b9a8ba1849d1; detaching it from the instance and deleting it from the info cache
May 28 09:59:18.430448 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f31ea465-3475-47f1-837f-b4a69a37cab6 req-cf693b53-3a2c-4327-aa2f-ee1a1c8a79df service nova] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Detach interface failed, port_id=2fad8030-7c30-438c-8dcd-b9a8ba1849d1, reason: Instance e2856743-3a60-4be1-b29c-b4de06f14783 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 09:59:18.656070 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-295ad827-7c52-4a14-8177-43423ed7307e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-475302226-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testmultiattachvolumeswap-server-475302226-1',id=7,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWRDb+JW1Be+ChqOdLgE+udxPv2v3DeUrJgypnEajndjYYcDaHo+NtanG+1BYJDpNCgg9kFom2FLFEzJurAdWdjS/GSAW+eI4KVgHBVbu/AD11ONu4I8b+6V3i4fofL7Q==',key_name='tempest-keypair-1521286164',keypairs=<?>,launch_index=0,launched_at=2026-05-28T09:58:03Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4466c6404538446eb4c8bd45bb2a95f5',ramdisk_id='',reservation_id='r-x282s4nw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-193507140',owner_user_name='tempest-TestMultiAttachVolumeSwap-193507140-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T09:58:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='010fbd8229d546b5aa445ca570266726',uuid=4a28d569-1ca9-4657-840c-7bb31d4644c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6d7e225-75f0-45c5-a7b7-7ff36e772079", "address": "fa:16:3e:9c:2e:17", "network": {"id": "d4fe3269-1c90-4590-b389-2d9e64a1874b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-397043690-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4466c6404538446eb4c8bd45bb2a95f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6d7e225-75", "ovs_interfaceid": "f6d7e225-75f0-45c5-a7b7-7ff36e772079", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 09:59:18.656070 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-295ad827-7c52-4a14-8177-43423ed7307e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Converting VIF {"id": "f6d7e225-75f0-45c5-a7b7-7ff36e772079", "address": "fa:16:3e:9c:2e:17", "network": {"id": "d4fe3269-1c90-4590-b389-2d9e64a1874b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-397043690-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4466c6404538446eb4c8bd45bb2a95f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6d7e225-75", "ovs_interfaceid": "f6d7e225-75f0-45c5-a7b7-7ff36e772079", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:59:18.656070 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-295ad827-7c52-4a14-8177-43423ed7307e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:2e:17,bridge_name='br-int',has_traffic_filtering=True,id=f6d7e225-75f0-45c5-a7b7-7ff36e772079,network=Network(d4fe3269-1c90-4590-b389-2d9e64a1874b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6d7e225-75') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:59:18.661605 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-295ad827-7c52-4a14-8177-43423ed7307e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:2e:17,bridge_name='br-int',has_traffic_filtering=True,id=f6d7e225-75f0-45c5-a7b7-7ff36e772079,network=Network(d4fe3269-1c90-4590-b389-2d9e64a1874b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6d7e225-75') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 09:59:18.662805 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:18.663064 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf6d7e225-75, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:18.665207 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:18.666274 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:59:18.671819 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:18.675276 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:18.675276 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4b8c351c-ee05-48d5-a007-06404379fa65) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:18.679697 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:18.680769 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:59:18.686450 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:18.694894 np0000001613 nova-compute[98321]: INFO os_vif [None req-295ad827-7c52-4a14-8177-43423ed7307e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:2e:17,bridge_name='br-int',has_traffic_filtering=True,id=f6d7e225-75f0-45c5-a7b7-7ff36e772079,network=Network(d4fe3269-1c90-4590-b389-2d9e64a1874b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6d7e225-75')
May 28 09:59:18.696401 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-295ad827-7c52-4a14-8177-43423ed7307e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Deleting instance files /opt/stack/data/nova/instances/4a28d569-1ca9-4657-840c-7bb31d4644c8_del
May 28 09:59:18.697288 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-295ad827-7c52-4a14-8177-43423ed7307e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Deletion of /opt/stack/data/nova/instances/4a28d569-1ca9-4657-840c-7bb31d4644c8_del complete
May 28 09:59:18.724695 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 09:59:18.724992 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962358.7247758, ceb9e572-ba71-4a8c-b415-44c9e7ebec51 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:59:18.725137 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] VM Paused (Lifecycle Event)
May 28 09:59:18.736258 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Took 6.71 seconds to spawn the instance on the hypervisor.
May 28 09:59:18.736566 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:59:18.833568 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-16a7af25-f70a-4a45-9e00-6829fcc4640b tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-475302226-2',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testmultiattachvolumeswap-server-475302226-2',id=8,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWRDb+JW1Be+ChqOdLgE+udxPv2v3DeUrJgypnEajndjYYcDaHo+NtanG+1BYJDpNCgg9kFom2FLFEzJurAdWdjS/GSAW+eI4KVgHBVbu/AD11ONu4I8b+6V3i4fofL7Q==',key_name='tempest-keypair-1521286164',keypairs=<?>,launch_index=1,launched_at=2026-05-28T09:58:03Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4466c6404538446eb4c8bd45bb2a95f5',ramdisk_id='',reservation_id='r-x282s4nw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-193507140',owner_user_name='tempest-TestMultiAttachVolumeSwap-193507140-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T09:58:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='010fbd8229d546b5aa445ca570266726',uuid=0dca786c-46bb-48dc-a01a-e282daa84a89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5169a8fe-f36b-4d06-8497-4407070563c7", "address": "fa:16:3e:14:ef:87", "network": {"id": "d4fe3269-1c90-4590-b389-2d9e64a1874b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-397043690-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4466c6404538446eb4c8bd45bb2a95f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5169a8fe-f3", "ovs_interfaceid": "5169a8fe-f36b-4d06-8497-4407070563c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 09:59:18.833877 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-16a7af25-f70a-4a45-9e00-6829fcc4640b tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Converting VIF {"id": "5169a8fe-f36b-4d06-8497-4407070563c7", "address": "fa:16:3e:14:ef:87", "network": {"id": "d4fe3269-1c90-4590-b389-2d9e64a1874b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-397043690-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4466c6404538446eb4c8bd45bb2a95f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5169a8fe-f3", "ovs_interfaceid": "5169a8fe-f36b-4d06-8497-4407070563c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:59:18.834352 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-16a7af25-f70a-4a45-9e00-6829fcc4640b tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:ef:87,bridge_name='br-int',has_traffic_filtering=True,id=5169a8fe-f36b-4d06-8497-4407070563c7,network=Network(d4fe3269-1c90-4590-b389-2d9e64a1874b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5169a8fe-f3') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:59:18.834554 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-16a7af25-f70a-4a45-9e00-6829fcc4640b tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:ef:87,bridge_name='br-int',has_traffic_filtering=True,id=5169a8fe-f36b-4d06-8497-4407070563c7,network=Network(d4fe3269-1c90-4590-b389-2d9e64a1874b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5169a8fe-f3') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 09:59:18.836304 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:18.836526 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5169a8fe-f3, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:18.839639 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:18.839639 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:59:18.840483 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:18.841852 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:18.842024 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0e05153f-504d-45e9-b96b-d9377a39965f) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:18.843929 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:18.843929 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:59:18.844374 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:18.848596 np0000001613 nova-compute[98321]: INFO os_vif [None req-16a7af25-f70a-4a45-9e00-6829fcc4640b tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:ef:87,bridge_name='br-int',has_traffic_filtering=True,id=5169a8fe-f36b-4d06-8497-4407070563c7,network=Network(d4fe3269-1c90-4590-b389-2d9e64a1874b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5169a8fe-f3')
May 28 09:59:18.849496 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-16a7af25-f70a-4a45-9e00-6829fcc4640b tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Deleting instance files /opt/stack/data/nova/instances/0dca786c-46bb-48dc-a01a-e282daa84a89_del
May 28 09:59:18.850819 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-16a7af25-f70a-4a45-9e00-6829fcc4640b tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Deletion of /opt/stack/data/nova/instances/0dca786c-46bb-48dc-a01a-e282daa84a89_del complete
May 28 09:59:18.854533 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:59:19.200825 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:19.208242 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-295ad827-7c52-4a14-8177-43423ed7307e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Took 1.43 seconds to destroy the instance on the hypervisor.
May 28 09:59:19.208751 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-295ad827-7c52-4a14-8177-43423ed7307e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 09:59:19.208936 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 09:59:19.209038 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 09:59:19.209288 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:59:19.229048 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:59:19.232195 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962359.2317562, ceb9e572-ba71-4a8c-b415-44c9e7ebec51 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:59:19.232195 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] VM Resumed (Lifecycle Event)
May 28 09:59:19.259078 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Took 13.34 seconds to build instance.
May 28 09:59:19.303095 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:59:19.320464 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-374b853a-bde2-42f6-84de-b6483adebd3a req-f1b45007-4420-4d60-898b-417dd60b9ffc service nova] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Received event network-vif-plugged-ea7215be-0ccc-4d7a-ab01-5bb86ae75830 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:19.320649 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-374b853a-bde2-42f6-84de-b6483adebd3a req-f1b45007-4420-4d60-898b-417dd60b9ffc service nova] Acquiring lock "ceb9e572-ba71-4a8c-b415-44c9e7ebec51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:19.320883 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-374b853a-bde2-42f6-84de-b6483adebd3a req-f1b45007-4420-4d60-898b-417dd60b9ffc service nova] Lock "ceb9e572-ba71-4a8c-b415-44c9e7ebec51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:19.320934 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-374b853a-bde2-42f6-84de-b6483adebd3a req-f1b45007-4420-4d60-898b-417dd60b9ffc service nova] Lock "ceb9e572-ba71-4a8c-b415-44c9e7ebec51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:19.322353 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-374b853a-bde2-42f6-84de-b6483adebd3a req-f1b45007-4420-4d60-898b-417dd60b9ffc service nova] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] No waiting events found dispatching network-vif-plugged-ea7215be-0ccc-4d7a-ab01-5bb86ae75830 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:59:19.324158 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-374b853a-bde2-42f6-84de-b6483adebd3a req-f1b45007-4420-4d60-898b-417dd60b9ffc service nova] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Received unexpected event network-vif-plugged-ea7215be-0ccc-4d7a-ab01-5bb86ae75830 for instance with vm_state active and task_state None.
May 28 09:59:19.357838 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Took 1.87 seconds to deallocate network for instance.
May 28 09:59:19.362087 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-16a7af25-f70a-4a45-9e00-6829fcc4640b tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Took 1.41 seconds to destroy the instance on the hypervisor.
May 28 09:59:19.362844 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-16a7af25-f70a-4a45-9e00-6829fcc4640b tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 09:59:19.368729 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 09:59:19.369002 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 09:59:19.369588 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:59:19.737302 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:59:19.741375 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 09:59:19.760869 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "ceb9e572-ba71-4a8c-b415-44c9e7ebec51" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.862s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:19.881478 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d37a84a9-9190-497e-814b-dfb0545916ea tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:19.884514 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d37a84a9-9190-497e-814b-dfb0545916ea tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:19.889911 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:59:20.246793 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999544702000094 future=<Future at 0x73c1f44e92b0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:59:20.247368 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999786352000001 future=<Future at 0x73c1fc4220c0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:59:20.349281 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:59:20.372518 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cb7758eb-15a4-4eaa-b492-f4997260912d req-5b9f1799-ea56-439b-ae8a-b7fd3b3d3225 service nova] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Received event network-vif-unplugged-f6d7e225-75f0-45c5-a7b7-7ff36e772079 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:20.376048 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cb7758eb-15a4-4eaa-b492-f4997260912d req-5b9f1799-ea56-439b-ae8a-b7fd3b3d3225 service nova] Acquiring lock "4a28d569-1ca9-4657-840c-7bb31d4644c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:20.376355 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cb7758eb-15a4-4eaa-b492-f4997260912d req-5b9f1799-ea56-439b-ae8a-b7fd3b3d3225 service nova] Lock "4a28d569-1ca9-4657-840c-7bb31d4644c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:20.377916 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cb7758eb-15a4-4eaa-b492-f4997260912d req-5b9f1799-ea56-439b-ae8a-b7fd3b3d3225 service nova] Lock "4a28d569-1ca9-4657-840c-7bb31d4644c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:20.378136 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cb7758eb-15a4-4eaa-b492-f4997260912d req-5b9f1799-ea56-439b-ae8a-b7fd3b3d3225 service nova] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] No waiting events found dispatching network-vif-unplugged-f6d7e225-75f0-45c5-a7b7-7ff36e772079 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:59:20.378329 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cb7758eb-15a4-4eaa-b492-f4997260912d req-5b9f1799-ea56-439b-ae8a-b7fd3b3d3225 service nova] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Received event network-vif-unplugged-f6d7e225-75f0-45c5-a7b7-7ff36e772079 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 09:59:20.378879 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cb7758eb-15a4-4eaa-b492-f4997260912d req-5b9f1799-ea56-439b-ae8a-b7fd3b3d3225 service nova] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Received event network-vif-unplugged-f6d7e225-75f0-45c5-a7b7-7ff36e772079 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:20.379018 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cb7758eb-15a4-4eaa-b492-f4997260912d req-5b9f1799-ea56-439b-ae8a-b7fd3b3d3225 service nova] Acquiring lock "4a28d569-1ca9-4657-840c-7bb31d4644c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:20.379220 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cb7758eb-15a4-4eaa-b492-f4997260912d req-5b9f1799-ea56-439b-ae8a-b7fd3b3d3225 service nova] Lock "4a28d569-1ca9-4657-840c-7bb31d4644c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:20.379332 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cb7758eb-15a4-4eaa-b492-f4997260912d req-5b9f1799-ea56-439b-ae8a-b7fd3b3d3225 service nova] Lock "4a28d569-1ca9-4657-840c-7bb31d4644c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:20.379482 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cb7758eb-15a4-4eaa-b492-f4997260912d req-5b9f1799-ea56-439b-ae8a-b7fd3b3d3225 service nova] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] No waiting events found dispatching network-vif-unplugged-f6d7e225-75f0-45c5-a7b7-7ff36e772079 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:59:20.379607 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cb7758eb-15a4-4eaa-b492-f4997260912d req-5b9f1799-ea56-439b-ae8a-b7fd3b3d3225 service nova] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Received event network-vif-unplugged-f6d7e225-75f0-45c5-a7b7-7ff36e772079 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 09:59:20.379757 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cb7758eb-15a4-4eaa-b492-f4997260912d req-5b9f1799-ea56-439b-ae8a-b7fd3b3d3225 service nova] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Received event network-vif-unplugged-5169a8fe-f36b-4d06-8497-4407070563c7 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:20.379905 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cb7758eb-15a4-4eaa-b492-f4997260912d req-5b9f1799-ea56-439b-ae8a-b7fd3b3d3225 service nova] Acquiring lock "0dca786c-46bb-48dc-a01a-e282daa84a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:20.380063 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cb7758eb-15a4-4eaa-b492-f4997260912d req-5b9f1799-ea56-439b-ae8a-b7fd3b3d3225 service nova] Lock "0dca786c-46bb-48dc-a01a-e282daa84a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:20.380192 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cb7758eb-15a4-4eaa-b492-f4997260912d req-5b9f1799-ea56-439b-ae8a-b7fd3b3d3225 service nova] Lock "0dca786c-46bb-48dc-a01a-e282daa84a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:20.380335 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cb7758eb-15a4-4eaa-b492-f4997260912d req-5b9f1799-ea56-439b-ae8a-b7fd3b3d3225 service nova] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] No waiting events found dispatching network-vif-unplugged-5169a8fe-f36b-4d06-8497-4407070563c7 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:59:20.381198 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cb7758eb-15a4-4eaa-b492-f4997260912d req-5b9f1799-ea56-439b-ae8a-b7fd3b3d3225 service nova] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Received event network-vif-unplugged-5169a8fe-f36b-4d06-8497-4407070563c7 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 09:59:20.671302 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d37a84a9-9190-497e-814b-dfb0545916ea tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 09:59:20.671741 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-d37a84a9-9190-497e-814b-dfb0545916ea tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 09:59:20.824757 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:59:20.856283 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Took 1.65 seconds to deallocate network for instance.
May 28 09:59:21.174929 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-d37a84a9-9190-497e-814b-dfb0545916ea tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 09:59:21.327999 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Took 1.96 seconds to deallocate network for instance.
May 28 09:59:21.336216 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:21.368278 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-295ad827-7c52-4a14-8177-43423ed7307e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:21.420857 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7c340e99-9ddf-4228-92f9-54da312b7711 req-d0f720c8-1b35-4234-8c00-eccae03bb94f service nova] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Received event network-vif-deleted-f6d7e225-75f0-45c5-a7b7-7ff36e772079 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:21.420857 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7c340e99-9ddf-4228-92f9-54da312b7711 req-d0f720c8-1b35-4234-8c00-eccae03bb94f service nova] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Received event network-vif-deleted-5169a8fe-f36b-4d06-8497-4407070563c7 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:21.683804 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d37a84a9-9190-497e-814b-dfb0545916ea tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.798s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:21.687598 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-295ad827-7c52-4a14-8177-43423ed7307e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.320s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:21.789307 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-d37a84a9-9190-497e-814b-dfb0545916ea tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Deleted allocations for instance e2856743-3a60-4be1-b29c-b4de06f14783
May 28 09:59:21.842035 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-16a7af25-f70a-4a45-9e00-6829fcc4640b tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:22.191173 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:22.415019 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-295ad827-7c52-4a14-8177-43423ed7307e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 09:59:22.415019 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-295ad827-7c52-4a14-8177-43423ed7307e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 09:59:22.448143 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-535dc8e4-c23c-4d1a-95f0-f4348859c9b1 req-ab589a50-1938-48bf-a072-1686fbe3bd23 service nova] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Received event network-vif-unplugged-5169a8fe-f36b-4d06-8497-4407070563c7 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:22.448545 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-535dc8e4-c23c-4d1a-95f0-f4348859c9b1 req-ab589a50-1938-48bf-a072-1686fbe3bd23 service nova] Acquiring lock "0dca786c-46bb-48dc-a01a-e282daa84a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:22.448758 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-535dc8e4-c23c-4d1a-95f0-f4348859c9b1 req-ab589a50-1938-48bf-a072-1686fbe3bd23 service nova] Lock "0dca786c-46bb-48dc-a01a-e282daa84a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:22.448904 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-535dc8e4-c23c-4d1a-95f0-f4348859c9b1 req-ab589a50-1938-48bf-a072-1686fbe3bd23 service nova] Lock "0dca786c-46bb-48dc-a01a-e282daa84a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:22.449048 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-535dc8e4-c23c-4d1a-95f0-f4348859c9b1 req-ab589a50-1938-48bf-a072-1686fbe3bd23 service nova] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] No waiting events found dispatching network-vif-unplugged-5169a8fe-f36b-4d06-8497-4407070563c7 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:59:22.449203 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-535dc8e4-c23c-4d1a-95f0-f4348859c9b1 req-ab589a50-1938-48bf-a072-1686fbe3bd23 service nova] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Received unexpected event network-vif-unplugged-5169a8fe-f36b-4d06-8497-4407070563c7 for instance with vm_state deleted and task_state None.
May 28 09:59:22.531371 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-69b7183e-176d-4463-941d-1262718dac73 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:59:22.809044 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d37a84a9-9190-497e-814b-dfb0545916ea tempest-TaggedAttachmentsTest-936828907 tempest-TaggedAttachmentsTest-936828907-project-member] Lock "e2856743-3a60-4be1-b29c-b4de06f14783" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.470s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:22.917565 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-295ad827-7c52-4a14-8177-43423ed7307e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 09:59:23.041106 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-69b7183e-176d-4463-941d-1262718dac73 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] instance snapshotting
May 28 09:59:23.149183 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-69b7183e-176d-4463-941d-1262718dac73 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Beginning live snapshot process
May 28 09:59:23.427681 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-295ad827-7c52-4a14-8177-43423ed7307e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.739s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:23.429867 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-16a7af25-f70a-4a45-9e00-6829fcc4640b tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.588s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:23.515180 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-295ad827-7c52-4a14-8177-43423ed7307e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Deleted allocations for instance 4a28d569-1ca9-4657-840c-7bb31d4644c8
May 28 09:59:23.854118 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:23.997439 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:24.076079 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-16a7af25-f70a-4a45-9e00-6829fcc4640b tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 09:59:24.076079 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-16a7af25-f70a-4a45-9e00-6829fcc4640b tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 09:59:24.208543 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:24.529528 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-295ad827-7c52-4a14-8177-43423ed7307e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "4a28d569-1ca9-4657-840c-7bb31d4644c8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.257s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:24.578640 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-16a7af25-f70a-4a45-9e00-6829fcc4640b tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 09:59:24.669408 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-69b7183e-176d-4463-941d-1262718dac73 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb9e572-ba71-4a8c-b415-44c9e7ebec51/disk --force-share --output=json -f qcow2 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:59:24.777522 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-69b7183e-176d-4463-941d-1262718dac73 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb9e572-ba71-4a8c-b415-44c9e7ebec51/disk --force-share --output=json -f qcow2" returned: 0 in 0.110s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:59:24.777522 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-69b7183e-176d-4463-941d-1262718dac73 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb9e572-ba71-4a8c-b415-44c9e7ebec51/disk --force-share --output=json -f qcow2 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:59:24.886635 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-69b7183e-176d-4463-941d-1262718dac73 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb9e572-ba71-4a8c-b415-44c9e7ebec51/disk --force-share --output=json -f qcow2" returned: 0 in 0.109s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:59:24.889939 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-69b7183e-176d-4463-941d-1262718dac73 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:59:24.896367 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-69b7183e-176d-4463-941d-1262718dac73 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:59:24.896992 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-69b7183e-176d-4463-941d-1262718dac73 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:59:25.017909 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-69b7183e-176d-4463-941d-1262718dac73 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.120s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:59:25.020242 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-69b7183e-176d-4463-941d-1262718dac73 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9q4hd4ik/55fc367600224073b8a03976f063840c.delta 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:59:25.088484 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-16a7af25-f70a-4a45-9e00-6829fcc4640b tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.658s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:25.095105 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-69b7183e-176d-4463-941d-1262718dac73 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9q4hd4ik/55fc367600224073b8a03976f063840c.delta 1073741824" returned: 0 in 0.076s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:59:25.095773 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-69b7183e-176d-4463-941d-1262718dac73 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Quiescing instance not available: QEMU guest agent is not enabled.
May 28 09:59:25.176118 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-16a7af25-f70a-4a45-9e00-6829fcc4640b tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Deleted allocations for instance 0dca786c-46bb-48dc-a01a-e282daa84a89
May 28 09:59:25.428515 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-69b7183e-176d-4463-941d-1262718dac73 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=98321) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 28 09:59:25.430843 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-69b7183e-176d-4463-941d-1262718dac73 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Skipping quiescing instance: QEMU guest agent is not enabled.
May 28 09:59:25.480268 np0000001613 nova-compute[98321]: DEBUG nova.privsep.utils [None req-69b7183e-176d-4463-941d-1262718dac73 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98321) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 09:59:25.480592 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-69b7183e-176d-4463-941d-1262718dac73 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9q4hd4ik/55fc367600224073b8a03976f063840c.delta /opt/stack/data/nova/instances/snapshots/tmp9q4hd4ik/55fc367600224073b8a03976f063840c {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:59:25.572030 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-69b7183e-176d-4463-941d-1262718dac73 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9q4hd4ik/55fc367600224073b8a03976f063840c.delta /opt/stack/data/nova/instances/snapshots/tmp9q4hd4ik/55fc367600224073b8a03976f063840c" returned: 0 in 0.090s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:59:25.572530 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-69b7183e-176d-4463-941d-1262718dac73 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Snapshot extracted, beginning image upload
May 28 09:59:25.989657 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:26.189368 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-16a7af25-f70a-4a45-9e00-6829fcc4640b tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Lock "0dca786c-46bb-48dc-a01a-e282daa84a89" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.749s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:27.841455 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:28.583526 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-69b7183e-176d-4463-941d-1262718dac73 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Snapshot image upload complete
May 28 09:59:28.583772 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-69b7183e-176d-4463-941d-1262718dac73 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Took 5.54 seconds to snapshot the instance on the hypervisor.
May 28 09:59:28.810605 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:28.855495 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:29.213890 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:30.164556 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:30.723792 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Acquiring lock "7514b113-ec17-468b-a647-de099d90e787" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:30.724048 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "7514b113-ec17-468b-a647-de099d90e787" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:30.724363 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Acquiring lock "7514b113-ec17-468b-a647-de099d90e787-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:30.724519 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "7514b113-ec17-468b-a647-de099d90e787-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:30.724639 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "7514b113-ec17-468b-a647-de099d90e787-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:30.727025 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Terminating instance
May 28 09:59:30.829618 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:31.243008 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 09:59:31.277988 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:31.281695 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:31.313573 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:31.339885 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:31.357499 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:31.404705 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0011215980000542913 future=<Future at 0x73c1f4310470 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:59:31.404791 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:59:31.404941 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=3.84130799400009 future=<Future at 0x73c1f44e92b0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:59:31.405057 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=3.841179133999958 future=<Future at 0x73c1f44e92b0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:59:31.405565 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Emitting event <LifecycleEvent: 1779962356.403377, e2856743-3a60-4be1-b29c-b4de06f14783 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:59:31.406184 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] VM Stopped (Lifecycle Event)
May 28 09:59:31.461989 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:31.503253 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:31.571156 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:31.608290 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:31.676979 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:31.678495 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:31.747314 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.99974682800007 future=<Future at 0x73c1fc422300 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:59:31.749995 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 7514b113-ec17-468b-a647-de099d90e787] Instance destroyed successfully.
May 28 09:59:31.751274 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lazy-loading 'resources' on Instance uuid 7514b113-ec17-468b-a647-de099d90e787 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:59:31.787605 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:31.817408 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:31.863425 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:31.910270 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-95a2ab3c-e382-4fc4-8fcf-75f7ff93cb72 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: e2856743-3a60-4be1-b29c-b4de06f14783] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:59:32.253961 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:57:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-97653989',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-97653989',id=9,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLV2OCrcYa+6PPeqUulLq0R6pd2tI+MIMcHbBKM4XEVap2duuGQ9lDGHJUCRWzq3BO8do0Y0OErSFRcIkE3jwEjkE6O/8JgjSAtuevekOA+mpG+G1h8Qz2EmHfDgR1uBtw==',key_name='tempest-keypair-1185435215',keypairs=<?>,launch_index=0,launched_at=2026-05-28T09:58:42Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ab3ecfe4d75434cbf3cb49d37042d15',ramdisk_id='',reservation_id='r-7czmh1vi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-845922542',owner_user_name='tempest-TaggedBootDevicesTest_v242-845922542-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T09:58:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf15add17bc44e64af4c05b1dbf40dd2',uuid=7514b113-ec17-468b-a647-de099d90e787,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a88c703-7b82-44ce-b5f5-a98718ae6833", "address": "fa:16:3e:0c:a9:71", "network": {"id": "0ef5507c-157f-4da7-9926-b55fdc2488a9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-360404380-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a88c703-7b", "ovs_interfaceid": "6a88c703-7b82-44ce-b5f5-a98718ae6833", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 09:59:32.254364 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converting VIF {"id": "6a88c703-7b82-44ce-b5f5-a98718ae6833", "address": "fa:16:3e:0c:a9:71", "network": {"id": "0ef5507c-157f-4da7-9926-b55fdc2488a9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-360404380-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a88c703-7b", "ovs_interfaceid": "6a88c703-7b82-44ce-b5f5-a98718ae6833", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:59:32.255180 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:a9:71,bridge_name='br-int',has_traffic_filtering=True,id=6a88c703-7b82-44ce-b5f5-a98718ae6833,network=Network(0ef5507c-157f-4da7-9926-b55fdc2488a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a88c703-7b') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:59:32.255432 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:a9:71,bridge_name='br-int',has_traffic_filtering=True,id=6a88c703-7b82-44ce-b5f5-a98718ae6833,network=Network(0ef5507c-157f-4da7-9926-b55fdc2488a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a88c703-7b') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 09:59:32.256754 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.257401 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a88c703-7b, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:32.258313 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.259272 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:59:32.264207 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e5d4a833-3185-4149-8f80-c2b6e3d7cb10 req-f8dde3e1-b9a3-4012-9f16-01b6cea91a7b service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-unplugged-4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:32.264352 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e5d4a833-3185-4149-8f80-c2b6e3d7cb10 req-f8dde3e1-b9a3-4012-9f16-01b6cea91a7b service nova] Acquiring lock "7514b113-ec17-468b-a647-de099d90e787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:32.264605 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e5d4a833-3185-4149-8f80-c2b6e3d7cb10 req-f8dde3e1-b9a3-4012-9f16-01b6cea91a7b service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:32.264959 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e5d4a833-3185-4149-8f80-c2b6e3d7cb10 req-f8dde3e1-b9a3-4012-9f16-01b6cea91a7b service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:32.265092 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e5d4a833-3185-4149-8f80-c2b6e3d7cb10 req-f8dde3e1-b9a3-4012-9f16-01b6cea91a7b service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] No waiting events found dispatching network-vif-unplugged-4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:59:32.265372 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e5d4a833-3185-4149-8f80-c2b6e3d7cb10 req-f8dde3e1-b9a3-4012-9f16-01b6cea91a7b service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-unplugged-4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 09:59:32.301005 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.303131 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.303461 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ddf82b6c-c20b-4c16-964d-ab199e6cccc4) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:32.304105 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.304811 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:59:32.337537 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.340307 np0000001613 nova-compute[98321]: INFO os_vif [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:a9:71,bridge_name='br-int',has_traffic_filtering=True,id=6a88c703-7b82-44ce-b5f5-a98718ae6833,network=Network(0ef5507c-157f-4da7-9926-b55fdc2488a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a88c703-7b')
May 28 09:59:32.341239 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:57:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-97653989',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-97653989',id=9,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLV2OCrcYa+6PPeqUulLq0R6pd2tI+MIMcHbBKM4XEVap2duuGQ9lDGHJUCRWzq3BO8do0Y0OErSFRcIkE3jwEjkE6O/8JgjSAtuevekOA+mpG+G1h8Qz2EmHfDgR1uBtw==',key_name='tempest-keypair-1185435215',keypairs=<?>,launch_index=0,launched_at=2026-05-28T09:58:42Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ab3ecfe4d75434cbf3cb49d37042d15',ramdisk_id='',reservation_id='r-7czmh1vi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-845922542',owner_user_name='tempest-TaggedBootDevicesTest_v242-845922542-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T09:58:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf15add17bc44e64af4c05b1dbf40dd2',uuid=7514b113-ec17-468b-a647-de099d90e787,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e1903f1-9c64-411e-be18-e5775f055e13", "address": "fa:16:3e:e8:48:00", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e1903f1-9c", "ovs_interfaceid": "4e1903f1-9c64-411e-be18-e5775f055e13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 09:59:32.341239 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converting VIF {"id": "4e1903f1-9c64-411e-be18-e5775f055e13", "address": "fa:16:3e:e8:48:00", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e1903f1-9c", "ovs_interfaceid": "4e1903f1-9c64-411e-be18-e5775f055e13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:59:32.341827 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:48:00,bridge_name='br-int',has_traffic_filtering=True,id=4e1903f1-9c64-411e-be18-e5775f055e13,network=Network(c6b29800-229c-48b1-b251-70b7d65f6b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4e1903f1-9c') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:59:32.342050 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:48:00,bridge_name='br-int',has_traffic_filtering=True,id=4e1903f1-9c64-411e-be18-e5775f055e13,network=Network(c6b29800-229c-48b1-b251-70b7d65f6b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4e1903f1-9c') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 09:59:32.343325 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.343325 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e1903f1-9c, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:32.345586 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.347309 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:59:32.370611 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.372305 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.374021 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ec297ebc-06f6-4293-9d3f-e77bd3c3f40c) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:32.375746 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.378496 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:59:32.403850 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.406228 np0000001613 nova-compute[98321]: INFO os_vif [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:48:00,bridge_name='br-int',has_traffic_filtering=True,id=4e1903f1-9c64-411e-be18-e5775f055e13,network=Network(c6b29800-229c-48b1-b251-70b7d65f6b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4e1903f1-9c')
May 28 09:59:32.407059 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:57:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-97653989',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-97653989',id=9,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLV2OCrcYa+6PPeqUulLq0R6pd2tI+MIMcHbBKM4XEVap2duuGQ9lDGHJUCRWzq3BO8do0Y0OErSFRcIkE3jwEjkE6O/8JgjSAtuevekOA+mpG+G1h8Qz2EmHfDgR1uBtw==',key_name='tempest-keypair-1185435215',keypairs=<?>,launch_index=0,launched_at=2026-05-28T09:58:42Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ab3ecfe4d75434cbf3cb49d37042d15',ramdisk_id='',reservation_id='r-7czmh1vi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-845922542',owner_user_name='tempest-TaggedBootDevicesTest_v242-845922542-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T09:58:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf15add17bc44e64af4c05b1dbf40dd2',uuid=7514b113-ec17-468b-a647-de099d90e787,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3", "address": "fa:16:3e:55:f2:21", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4490fa5a-9c", "ovs_interfaceid": "4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 09:59:32.407491 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converting VIF {"id": "4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3", "address": "fa:16:3e:55:f2:21", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4490fa5a-9c", "ovs_interfaceid": "4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:59:32.408226 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:f2:21,bridge_name='br-int',has_traffic_filtering=True,id=4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3,network=Network(c6b29800-229c-48b1-b251-70b7d65f6b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4490fa5a-9c') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:59:32.408507 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:f2:21,bridge_name='br-int',has_traffic_filtering=True,id=4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3,network=Network(c6b29800-229c-48b1-b251-70b7d65f6b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4490fa5a-9c') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 09:59:32.409605 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.409871 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4490fa5a-9c, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:32.412810 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.414000 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:59:32.436120 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.438144 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.438423 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ab11c9a8-0d0c-49d0-b73a-4727a4858664) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:32.439009 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.439844 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:59:32.465036 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.469063 np0000001613 nova-compute[98321]: INFO os_vif [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:f2:21,bridge_name='br-int',has_traffic_filtering=True,id=4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3,network=Network(c6b29800-229c-48b1-b251-70b7d65f6b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4490fa5a-9c')
May 28 09:59:32.469808 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:57:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-97653989',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-97653989',id=9,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLV2OCrcYa+6PPeqUulLq0R6pd2tI+MIMcHbBKM4XEVap2duuGQ9lDGHJUCRWzq3BO8do0Y0OErSFRcIkE3jwEjkE6O/8JgjSAtuevekOA+mpG+G1h8Qz2EmHfDgR1uBtw==',key_name='tempest-keypair-1185435215',keypairs=<?>,launch_index=0,launched_at=2026-05-28T09:58:42Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ab3ecfe4d75434cbf3cb49d37042d15',ramdisk_id='',reservation_id='r-7czmh1vi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-845922542',owner_user_name='tempest-TaggedBootDevicesTest_v242-845922542-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T09:58:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf15add17bc44e64af4c05b1dbf40dd2',uuid=7514b113-ec17-468b-a647-de099d90e787,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "edca6f4e-7f57-4351-8525-4446771d6376", "address": "fa:16:3e:31:6d:c0", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapedca6f4e-7f", "ovs_interfaceid": "edca6f4e-7f57-4351-8525-4446771d6376", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 09:59:32.470009 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converting VIF {"id": "edca6f4e-7f57-4351-8525-4446771d6376", "address": "fa:16:3e:31:6d:c0", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapedca6f4e-7f", "ovs_interfaceid": "edca6f4e-7f57-4351-8525-4446771d6376", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:59:32.470641 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:6d:c0,bridge_name='br-int',has_traffic_filtering=True,id=edca6f4e-7f57-4351-8525-4446771d6376,network=Network(c6b29800-229c-48b1-b251-70b7d65f6b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedca6f4e-7f') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:59:32.470912 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:6d:c0,bridge_name='br-int',has_traffic_filtering=True,id=edca6f4e-7f57-4351-8525-4446771d6376,network=Network(c6b29800-229c-48b1-b251-70b7d65f6b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedca6f4e-7f') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 09:59:32.474660 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.474960 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapedca6f4e-7f, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:32.477524 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.478574 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:59:32.491405 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.493077 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.493282 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9271798e-6dbf-4fa4-b69d-0cb29f5d6d72) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:32.494126 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.494723 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:59:32.510388 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.512439 np0000001613 nova-compute[98321]: INFO os_vif [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:6d:c0,bridge_name='br-int',has_traffic_filtering=True,id=edca6f4e-7f57-4351-8525-4446771d6376,network=Network(c6b29800-229c-48b1-b251-70b7d65f6b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedca6f4e-7f')
May 28 09:59:32.513154 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:57:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-97653989',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-97653989',id=9,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLV2OCrcYa+6PPeqUulLq0R6pd2tI+MIMcHbBKM4XEVap2duuGQ9lDGHJUCRWzq3BO8do0Y0OErSFRcIkE3jwEjkE6O/8JgjSAtuevekOA+mpG+G1h8Qz2EmHfDgR1uBtw==',key_name='tempest-keypair-1185435215',keypairs=<?>,launch_index=0,launched_at=2026-05-28T09:58:42Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ab3ecfe4d75434cbf3cb49d37042d15',ramdisk_id='',reservation_id='r-7czmh1vi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-845922542',owner_user_name='tempest-TaggedBootDevicesTest_v242-845922542-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T09:58:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf15add17bc44e64af4c05b1dbf40dd2',uuid=7514b113-ec17-468b-a647-de099d90e787,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3b48415-3d34-4753-a72f-6f48536174ed", "address": "fa:16:3e:48:5c:c5", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b48415-3d", "ovs_interfaceid": "d3b48415-3d34-4753-a72f-6f48536174ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 09:59:32.513409 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converting VIF {"id": "d3b48415-3d34-4753-a72f-6f48536174ed", "address": "fa:16:3e:48:5c:c5", "network": {"id": "c6b29800-229c-48b1-b251-70b7d65f6b5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414283103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b48415-3d", "ovs_interfaceid": "d3b48415-3d34-4753-a72f-6f48536174ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:59:32.514011 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:5c:c5,bridge_name='br-int',has_traffic_filtering=True,id=d3b48415-3d34-4753-a72f-6f48536174ed,network=Network(c6b29800-229c-48b1-b251-70b7d65f6b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3b48415-3d') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:59:32.514239 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:5c:c5,bridge_name='br-int',has_traffic_filtering=True,id=d3b48415-3d34-4753-a72f-6f48536174ed,network=Network(c6b29800-229c-48b1-b251-70b7d65f6b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3b48415-3d') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 09:59:32.515395 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.515617 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3b48415-3d, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:32.516712 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.518830 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:59:32.527642 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.528791 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.529646 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=043372ce-4770-4616-aa30-12fa484db61d) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:32.529646 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.531023 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:59:32.542822 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.548968 np0000001613 nova-compute[98321]: INFO os_vif [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:5c:c5,bridge_name='br-int',has_traffic_filtering=True,id=d3b48415-3d34-4753-a72f-6f48536174ed,network=Network(c6b29800-229c-48b1-b251-70b7d65f6b5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3b48415-3d')
May 28 09:59:32.548968 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:57:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-97653989',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-97653989',id=9,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLV2OCrcYa+6PPeqUulLq0R6pd2tI+MIMcHbBKM4XEVap2duuGQ9lDGHJUCRWzq3BO8do0Y0OErSFRcIkE3jwEjkE6O/8JgjSAtuevekOA+mpG+G1h8Qz2EmHfDgR1uBtw==',key_name='tempest-keypair-1185435215',keypairs=<?>,launch_index=0,launched_at=2026-05-28T09:58:42Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ab3ecfe4d75434cbf3cb49d37042d15',ramdisk_id='',reservation_id='r-7czmh1vi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-845922542',owner_user_name='tempest-TaggedBootDevicesTest_v242-845922542-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T09:58:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf15add17bc44e64af4c05b1dbf40dd2',uuid=7514b113-ec17-468b-a647-de099d90e787,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e08f0477-e673-4559-884f-1dcbc2a9fd0e", "address": "fa:16:3e:07:9b:94", "network": {"id": "57e43a7e-bde2-4d30-bf6d-7c6cc5f5d3e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935029012", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape08f0477-e6", "ovs_interfaceid": "e08f0477-e673-4559-884f-1dcbc2a9fd0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 09:59:32.548968 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converting VIF {"id": "e08f0477-e673-4559-884f-1dcbc2a9fd0e", "address": "fa:16:3e:07:9b:94", "network": {"id": "57e43a7e-bde2-4d30-bf6d-7c6cc5f5d3e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935029012", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape08f0477-e6", "ovs_interfaceid": "e08f0477-e673-4559-884f-1dcbc2a9fd0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:59:32.548968 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:9b:94,bridge_name='br-int',has_traffic_filtering=True,id=e08f0477-e673-4559-884f-1dcbc2a9fd0e,network=Network(57e43a7e-bde2-4d30-bf6d-7c6cc5f5d3e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape08f0477-e6') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:59:32.549482 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:9b:94,bridge_name='br-int',has_traffic_filtering=True,id=e08f0477-e673-4559-884f-1dcbc2a9fd0e,network=Network(57e43a7e-bde2-4d30-bf6d-7c6cc5f5d3e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape08f0477-e6') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 09:59:32.562679 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.562930 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape08f0477-e6, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:32.564206 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.565057 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:59:32.569800 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.570886 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.571111 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0bf286bb-549c-4b3d-83ea-d7a68df2dcbc) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:32.571659 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.572246 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:59:32.577830 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.579446 np0000001613 nova-compute[98321]: INFO os_vif [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:9b:94,bridge_name='br-int',has_traffic_filtering=True,id=e08f0477-e673-4559-884f-1dcbc2a9fd0e,network=Network(57e43a7e-bde2-4d30-bf6d-7c6cc5f5d3e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape08f0477-e6')
May 28 09:59:32.580031 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:57:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-97653989',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-97653989',id=9,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLV2OCrcYa+6PPeqUulLq0R6pd2tI+MIMcHbBKM4XEVap2duuGQ9lDGHJUCRWzq3BO8do0Y0OErSFRcIkE3jwEjkE6O/8JgjSAtuevekOA+mpG+G1h8Qz2EmHfDgR1uBtw==',key_name='tempest-keypair-1185435215',keypairs=<?>,launch_index=0,launched_at=2026-05-28T09:58:42Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ab3ecfe4d75434cbf3cb49d37042d15',ramdisk_id='',reservation_id='r-7czmh1vi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-845922542',owner_user_name='tempest-TaggedBootDevicesTest_v242-845922542-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T09:58:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf15add17bc44e64af4c05b1dbf40dd2',uuid=7514b113-ec17-468b-a647-de099d90e787,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27187d46-bd01-4781-99fe-29d49015360e", "address": "fa:16:3e:38:ca:1f", "network": {"id": "57e43a7e-bde2-4d30-bf6d-7c6cc5f5d3e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935029012", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap27187d46-bd", "ovs_interfaceid": "27187d46-bd01-4781-99fe-29d49015360e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 09:59:32.580185 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converting VIF {"id": "27187d46-bd01-4781-99fe-29d49015360e", "address": "fa:16:3e:38:ca:1f", "network": {"id": "57e43a7e-bde2-4d30-bf6d-7c6cc5f5d3e1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935029012", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ab3ecfe4d75434cbf3cb49d37042d15", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap27187d46-bd", "ovs_interfaceid": "27187d46-bd01-4781-99fe-29d49015360e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:59:32.580650 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:ca:1f,bridge_name='br-int',has_traffic_filtering=True,id=27187d46-bd01-4781-99fe-29d49015360e,network=Network(57e43a7e-bde2-4d30-bf6d-7c6cc5f5d3e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27187d46-bd') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:59:32.580953 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:ca:1f,bridge_name='br-int',has_traffic_filtering=True,id=27187d46-bd01-4781-99fe-29d49015360e,network=Network(57e43a7e-bde2-4d30-bf6d-7c6cc5f5d3e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27187d46-bd') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 09:59:32.581647 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.581857 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27187d46-bd, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:32.582766 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.583491 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:59:32.584225 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.584935 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.585039 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cd8dbd36-bc00-415c-bd2e-754e9bd2f9dd) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:32.585448 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.585908 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:59:32.586515 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:32.589946 np0000001613 nova-compute[98321]: INFO os_vif [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:ca:1f,bridge_name='br-int',has_traffic_filtering=True,id=27187d46-bd01-4781-99fe-29d49015360e,network=Network(57e43a7e-bde2-4d30-bf6d-7c6cc5f5d3e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27187d46-bd')
May 28 09:59:32.591188 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 09:59:32.591569 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0', 'iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '78480fee-64ba-4d69-b21d-c54483406ae0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 09:59:32.591771 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:59:32.592262 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:59:32.592542 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0', 'iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '78480fee-64ba-4d69-b21d-c54483406ae0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 09:59:32.593080 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 09:59:32.635426 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:59:32.635426 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:32.635426 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:32.635426 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:59:32.635426 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:59:32.635426 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:32.635426 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:32.635426 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:59:32.635426 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:59:32.635426 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:59:32.635426 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:59:32.635830 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:59:32.635830 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:32.635830 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:32.635830 np0000001613 nova-compute[98321]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:59:32.635830 np0000001613 nova-compute[98321]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0 (non-flash)
May 28 09:59:32.635830 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:32.635830 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:32.635830 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:59:32.635830 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:59:32.635830 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:59:32.635830 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:59:32.635830 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0', '4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5', '8'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480', '9')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 09:59:32.636072 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0', '3')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 09:59:32.637393 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0', '4')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 09:59:32.638714 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc14b560>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0'): ({'sdb'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 09:59:32.638935 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Removing multipathed devices sdb, sdc {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 09:59:32.639176 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Flush multipath device 33000000084905064 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 09:59:32.694298 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 09:59:32.745274 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 09:59:32.793275 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 09:59:32.793463 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 09:59:32.794850 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 09:59:32.812122 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 09:59:32.812321 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 09:59:32.825727 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:32.850024 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "c9416092-d229-4f59-aaf3-3b0b692e7924" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:32.850464 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "c9416092-d229-4f59-aaf3-3b0b692e7924" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:32.869752 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0, portal: 192.168.40.100,3260]
May 28 09:59:32.869752 np0000001613 nova-compute[98321]: Logout of [sid: 3, target: iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0, portal: 192.168.40.100,3260] successful.
May 28 09:59:32.869752 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:32.890398 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:32.902038 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:32.939075 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0, portal: 192.168.50.100,3260]
May 28 09:59:32.939075 np0000001613 nova-compute[98321]: Logout of [sid: 4, target: iqn.2023-03.storpool.com:os--volume-78480fee-64ba-4d69-b21d-c54483406ae0, portal: 192.168.50.100,3260] successful.
May 28 09:59:32.939075 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:32.962182 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:32.962444 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:59:32.962608 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] <== disconnect_volume: return (370ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 09:59:32.962778 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 09:59:32.963986 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 09:59:32.964327 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5', 'iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '837d0fb8-c967-40a4-9f26-6c610571e2a5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 09:59:32.964472 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:59:32.964945 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:59:32.965244 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5', 'iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '837d0fb8-c967-40a4-9f26-6c610571e2a5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 09:59:32.965386 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 09:59:33.001052 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:59:33.001052 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:33.001052 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:33.001052 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:33.001052 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:33.001052 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:59:33.001052 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:59:33.001052 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:59:33.001052 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:59:33.001549 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:59:33.001549 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:33.001549 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:33.001549 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:33.001549 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:33.001549 np0000001613 nova-compute[98321]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:59:33.001549 np0000001613 nova-compute[98321]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5 (non-flash)
May 28 09:59:33.001549 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:59:33.001549 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:59:33.001708 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b', '14'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5', '8'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480', '9')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 09:59:33.001859 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5', '7')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 09:59:33.003274 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5', '8')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 09:59:33.004877 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1ffeeee80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5'): ({'sdg'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 09:59:33.005284 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Removing multipathed devices sdf, sdg {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 09:59:33.005752 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Flush multipath device 33000000086c23192 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 09:59:33.042089 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 09:59:33.088916 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 09:59:33.139886 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 09:59:33.139886 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 09:59:33.141123 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 09:59:33.156793 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 09:59:33.156793 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 09:59:33.169590 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:33.207443 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5, portal: 192.168.40.100,3260]
May 28 09:59:33.207443 np0000001613 nova-compute[98321]: Logout of [sid: 7, target: iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5, portal: 192.168.40.100,3260] successful.
May 28 09:59:33.207443 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:33.230119 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:33.245073 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:33.284538 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5, portal: 192.168.50.100,3260]
May 28 09:59:33.284538 np0000001613 nova-compute[98321]: Logout of [sid: 8, target: iqn.2023-03.storpool.com:os--volume-837d0fb8-c967-40a4-9f26-6c610571e2a5, portal: 192.168.50.100,3260] successful.
May 28 09:59:33.284538 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:33.302589 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:33.302928 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:59:33.303099 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] <== disconnect_volume: return (338ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 09:59:33.303306 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 09:59:33.305012 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 09:59:33.305448 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480', 'iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7492b29-87c5-41d8-a3c7-669eb8c75480', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 09:59:33.305800 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:59:33.306233 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:59:33.307520 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480', 'iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7492b29-87c5-41d8-a3c7-669eb8c75480', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 09:59:33.307520 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 09:59:33.341248 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:59:33.341248 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:33.341248 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:33.341248 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:33.341248 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:33.341248 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:59:33.341248 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:59:33.341754 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:59:33.341754 np0000001613 nova-compute[98321]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:33.341754 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:33.341754 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:33.341754 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:33.341754 np0000001613 nova-compute[98321]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480 (non-flash)
May 28 09:59:33.341754 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:59:33.341754 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b', '14'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480', '9')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 09:59:33.342204 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480', '9')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 09:59:33.343100 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480', '10')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 09:59:33.344156 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1ffeeee80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480'): ({'sdi'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 09:59:33.344433 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Removing multipathed devices sdh, sdi {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 09:59:33.344721 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Flush multipath device 33000000057a63d22 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 09:59:33.355386 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lazy-loading 'flavor' on Instance uuid c9416092-d229-4f59-aaf3-3b0b692e7924 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:59:33.381374 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 09:59:33.426970 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 09:59:33.478142 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 09:59:33.478382 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 09:59:33.479138 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 09:59:33.488043 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:33.488281 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:33.494992 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 09:59:33.495278 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 09:59:33.508138 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:33.541695 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480, portal: 192.168.40.100,3260]
May 28 09:59:33.541695 np0000001613 nova-compute[98321]: Logout of [sid: 9, target: iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480, portal: 192.168.40.100,3260] successful.
May 28 09:59:33.541695 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:33.563062 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:33.576238 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:33.626328 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480, portal: 192.168.50.100,3260]
May 28 09:59:33.626328 np0000001613 nova-compute[98321]: Logout of [sid: 10, target: iqn.2023-03.storpool.com:os--volume-a7492b29-87c5-41d8-a3c7-669eb8c75480, portal: 192.168.50.100,3260] successful.
May 28 09:59:33.626328 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:33.642529 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:33.642818 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:59:33.643069 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] <== disconnect_volume: return (337ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 09:59:33.643249 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 09:59:33.643524 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Deleting instance files /opt/stack/data/nova/instances/7514b113-ec17-468b-a647-de099d90e787_del
May 28 09:59:33.644115 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Deletion of /opt/stack/data/nova/instances/7514b113-ec17-468b-a647-de099d90e787_del complete
May 28 09:59:33.770525 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:33.992747 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 09:59:34.067049 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:34.153312 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Took 2.91 seconds to destroy the instance on the hypervisor.
May 28 09:59:34.155058 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 09:59:34.155336 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 7514b113-ec17-468b-a647-de099d90e787] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 09:59:34.155519 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 7514b113-ec17-468b-a647-de099d90e787] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 09:59:34.155840 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:59:34.213185 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:34.361897 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "c9416092-d229-4f59-aaf3-3b0b692e7924" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:34.371010 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b6c4ea2a-d92c-4180-a092-0ec3698e5e05 req-0b629808-b141-4b14-8531-66331fff82d3 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-unplugged-4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:34.371010 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b6c4ea2a-d92c-4180-a092-0ec3698e5e05 req-0b629808-b141-4b14-8531-66331fff82d3 service nova] Acquiring lock "7514b113-ec17-468b-a647-de099d90e787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:34.372410 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b6c4ea2a-d92c-4180-a092-0ec3698e5e05 req-0b629808-b141-4b14-8531-66331fff82d3 service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:34.372963 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b6c4ea2a-d92c-4180-a092-0ec3698e5e05 req-0b629808-b141-4b14-8531-66331fff82d3 service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:34.373125 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b6c4ea2a-d92c-4180-a092-0ec3698e5e05 req-0b629808-b141-4b14-8531-66331fff82d3 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] No waiting events found dispatching network-vif-unplugged-4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:59:34.373286 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b6c4ea2a-d92c-4180-a092-0ec3698e5e05 req-0b629808-b141-4b14-8531-66331fff82d3 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-unplugged-4490fa5a-9cc9-4b7e-b151-7d5f9509c3f3 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 09:59:34.373342 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b6c4ea2a-d92c-4180-a092-0ec3698e5e05 req-0b629808-b141-4b14-8531-66331fff82d3 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-unplugged-e08f0477-e673-4559-884f-1dcbc2a9fd0e {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:34.373532 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b6c4ea2a-d92c-4180-a092-0ec3698e5e05 req-0b629808-b141-4b14-8531-66331fff82d3 service nova] Acquiring lock "7514b113-ec17-468b-a647-de099d90e787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:34.374425 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b6c4ea2a-d92c-4180-a092-0ec3698e5e05 req-0b629808-b141-4b14-8531-66331fff82d3 service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:34.374540 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b6c4ea2a-d92c-4180-a092-0ec3698e5e05 req-0b629808-b141-4b14-8531-66331fff82d3 service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:34.374680 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b6c4ea2a-d92c-4180-a092-0ec3698e5e05 req-0b629808-b141-4b14-8531-66331fff82d3 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] No waiting events found dispatching network-vif-unplugged-e08f0477-e673-4559-884f-1dcbc2a9fd0e {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:59:34.374777 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b6c4ea2a-d92c-4180-a092-0ec3698e5e05 req-0b629808-b141-4b14-8531-66331fff82d3 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-unplugged-e08f0477-e673-4559-884f-1dcbc2a9fd0e for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 09:59:34.374877 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b6c4ea2a-d92c-4180-a092-0ec3698e5e05 req-0b629808-b141-4b14-8531-66331fff82d3 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-unplugged-e08f0477-e673-4559-884f-1dcbc2a9fd0e {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:34.374988 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b6c4ea2a-d92c-4180-a092-0ec3698e5e05 req-0b629808-b141-4b14-8531-66331fff82d3 service nova] Acquiring lock "7514b113-ec17-468b-a647-de099d90e787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:34.375182 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b6c4ea2a-d92c-4180-a092-0ec3698e5e05 req-0b629808-b141-4b14-8531-66331fff82d3 service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:34.375326 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b6c4ea2a-d92c-4180-a092-0ec3698e5e05 req-0b629808-b141-4b14-8531-66331fff82d3 service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:34.375482 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b6c4ea2a-d92c-4180-a092-0ec3698e5e05 req-0b629808-b141-4b14-8531-66331fff82d3 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] No waiting events found dispatching network-vif-unplugged-e08f0477-e673-4559-884f-1dcbc2a9fd0e {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:59:34.375623 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b6c4ea2a-d92c-4180-a092-0ec3698e5e05 req-0b629808-b141-4b14-8531-66331fff82d3 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-unplugged-e08f0477-e673-4559-884f-1dcbc2a9fd0e for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 09:59:34.375784 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b6c4ea2a-d92c-4180-a092-0ec3698e5e05 req-0b629808-b141-4b14-8531-66331fff82d3 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-unplugged-d3b48415-3d34-4753-a72f-6f48536174ed {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:34.375942 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b6c4ea2a-d92c-4180-a092-0ec3698e5e05 req-0b629808-b141-4b14-8531-66331fff82d3 service nova] Acquiring lock "7514b113-ec17-468b-a647-de099d90e787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:34.376105 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b6c4ea2a-d92c-4180-a092-0ec3698e5e05 req-0b629808-b141-4b14-8531-66331fff82d3 service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:34.376284 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b6c4ea2a-d92c-4180-a092-0ec3698e5e05 req-0b629808-b141-4b14-8531-66331fff82d3 service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:34.376435 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b6c4ea2a-d92c-4180-a092-0ec3698e5e05 req-0b629808-b141-4b14-8531-66331fff82d3 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] No waiting events found dispatching network-vif-unplugged-d3b48415-3d34-4753-a72f-6f48536174ed {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:59:34.376602 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b6c4ea2a-d92c-4180-a092-0ec3698e5e05 req-0b629808-b141-4b14-8531-66331fff82d3 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-unplugged-d3b48415-3d34-4753-a72f-6f48536174ed for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 09:59:34.377445 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b6c4ea2a-d92c-4180-a092-0ec3698e5e05 req-0b629808-b141-4b14-8531-66331fff82d3 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-unplugged-d3b48415-3d34-4753-a72f-6f48536174ed {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:34.377502 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b6c4ea2a-d92c-4180-a092-0ec3698e5e05 req-0b629808-b141-4b14-8531-66331fff82d3 service nova] Acquiring lock "7514b113-ec17-468b-a647-de099d90e787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:34.377631 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b6c4ea2a-d92c-4180-a092-0ec3698e5e05 req-0b629808-b141-4b14-8531-66331fff82d3 service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:34.377728 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b6c4ea2a-d92c-4180-a092-0ec3698e5e05 req-0b629808-b141-4b14-8531-66331fff82d3 service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:34.377845 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b6c4ea2a-d92c-4180-a092-0ec3698e5e05 req-0b629808-b141-4b14-8531-66331fff82d3 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] No waiting events found dispatching network-vif-unplugged-d3b48415-3d34-4753-a72f-6f48536174ed {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:59:34.377933 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b6c4ea2a-d92c-4180-a092-0ec3698e5e05 req-0b629808-b141-4b14-8531-66331fff82d3 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-unplugged-d3b48415-3d34-4753-a72f-6f48536174ed for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 09:59:34.441928 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-0554c76b-7f3c-4ae2-a842-85358b4e91d3 req-31d1be94-fcf5-42e8-8588-c8722bd1529f service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-unplugged-edca6f4e-7f57-4351-8525-4446771d6376 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:34.442350 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0554c76b-7f3c-4ae2-a842-85358b4e91d3 req-31d1be94-fcf5-42e8-8588-c8722bd1529f service nova] Acquiring lock "7514b113-ec17-468b-a647-de099d90e787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:34.442655 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0554c76b-7f3c-4ae2-a842-85358b4e91d3 req-31d1be94-fcf5-42e8-8588-c8722bd1529f service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:34.442907 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0554c76b-7f3c-4ae2-a842-85358b4e91d3 req-31d1be94-fcf5-42e8-8588-c8722bd1529f service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:34.443177 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-0554c76b-7f3c-4ae2-a842-85358b4e91d3 req-31d1be94-fcf5-42e8-8588-c8722bd1529f service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] No waiting events found dispatching network-vif-unplugged-edca6f4e-7f57-4351-8525-4446771d6376 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:59:34.443363 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-0554c76b-7f3c-4ae2-a842-85358b4e91d3 req-31d1be94-fcf5-42e8-8588-c8722bd1529f service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-unplugged-edca6f4e-7f57-4351-8525-4446771d6376 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 09:59:34.591596 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:34.591754 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:34.596723 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 09:59:34.596945 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Claim successful on node np0000001613
May 28 09:59:34.728789 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:59:35.247651 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0012248909999925672 future=<Future at 0x73c1f44e92b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:59:35.247859 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:59:35.248068 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0011585069999000552 future=<Future at 0x73c1fc4220c0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:59:35.250219 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Emitting event <LifecycleEvent: 1779962360.246183, 4a28d569-1ca9-4657-840c-7bb31d4644c8 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:59:35.250219 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] VM Stopped (Lifecycle Event)
May 28 09:59:35.252237 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.004386021999835066 future=<Future at 0x73c1fc4220c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:59:35.252896 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Emitting event <LifecycleEvent: 1779962360.2468233, 0dca786c-46bb-48dc-a01a-e282daa84a89 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:59:35.253086 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:59:35.253315 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] VM Stopped (Lifecycle Event)
May 28 09:59:35.256337 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=11.490319767000074 future=<Future at 0x73c1fc422300 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:59:35.256488 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=11.490142226999978 future=<Future at 0x73c1fc422300 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:59:35.488145 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "c9416092-d229-4f59-aaf3-3b0b692e7924" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:35.488874 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "c9416092-d229-4f59-aaf3-3b0b692e7924" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:35.488874 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Attaching volume 3dad4779-d77b-4473-a132-d2e773ff8b9d to /dev/vdb
May 28 09:59:35.540726 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 09:59:35.557410 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 09:59:35.589016 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:59:35.630200 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 09:59:35.630801 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 09:59:35.646926 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 09:59:35.654593 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe95:8bd3', 'fe80::fc16:3eff:fe2d:94a4', 'fe80::fc16:3eff:fe31:5106', 'fe80::fc96:34ff:fe12:e4df', 'fe80::2844:59ff:feec:5d21', 'fe80::44e2:31ff:fe81:8771', 'fe80::fc16:3eff:feae:5417', 'fe80::fc16:3eff:fe7a:26b6', 'fe80::fc16:3eff:feeb:5344', 'fe80::fc16:3eff:fe05:61f2'] 
May 28 09:59:35.655552 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 09:59:35.655552 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 09:59:35.655552 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 09:59:35.655552 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Updating existing volume attachment record: 1110da71-d509-4952-a96c-f4b85ecc7c7a {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 09:59:35.757345 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 4a28d569-1ca9-4657-840c-7bb31d4644c8] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:59:35.759201 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 0dca786c-46bb-48dc-a01a-e282daa84a89] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:59:36.229981 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 09:59:36.230379 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3dad4779-d77b-4473-a132-d2e773ff8b9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 09:59:36.230964 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:59:36.231138 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:59:36.231389 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3dad4779-d77b-4473-a132-d2e773ff8b9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 09:59:36.247183 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:59:36.247907 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:59:36.248408 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:59:36.248627 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 09:59:36.249295 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:59:36.249295 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 09:59:36.262897 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 09:59:36.262897 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:36.268316 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 09:59:36.268316 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:36.269497 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 09:59:36.269976 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 09:59:36.278888 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d] added
May 28 09:59:36.278888 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 09:59:36.278888 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:59:36.278888 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:59:36.278888 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:59:36.278888 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:59:36.278888 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:36.278888 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 09:59:36.279689 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0304(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 09:59:36.279689 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 09:59:36.280631 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d] added
May 28 09:59:36.280631 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 09:59:36.280631 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:59:36.280631 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:59:36.280631 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:59:36.280631 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:59:36.280631 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:36.280905 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 09:59:36.281363 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0317(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 09:59:36.281363 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 09:59:36.551836 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2eb9733d-0fb0-4e2d-aa61-7dfe18122d50 req-67b6aa9d-e91c-4508-98cf-45742db8fbe9 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-unplugged-edca6f4e-7f57-4351-8525-4446771d6376 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:36.552286 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2eb9733d-0fb0-4e2d-aa61-7dfe18122d50 req-67b6aa9d-e91c-4508-98cf-45742db8fbe9 service nova] Acquiring lock "7514b113-ec17-468b-a647-de099d90e787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:36.553886 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2eb9733d-0fb0-4e2d-aa61-7dfe18122d50 req-67b6aa9d-e91c-4508-98cf-45742db8fbe9 service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:36.555215 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2eb9733d-0fb0-4e2d-aa61-7dfe18122d50 req-67b6aa9d-e91c-4508-98cf-45742db8fbe9 service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:36.555690 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2eb9733d-0fb0-4e2d-aa61-7dfe18122d50 req-67b6aa9d-e91c-4508-98cf-45742db8fbe9 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] No waiting events found dispatching network-vif-unplugged-edca6f4e-7f57-4351-8525-4446771d6376 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:59:36.555901 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2eb9733d-0fb0-4e2d-aa61-7dfe18122d50 req-67b6aa9d-e91c-4508-98cf-45742db8fbe9 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-unplugged-edca6f4e-7f57-4351-8525-4446771d6376 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 09:59:36.556083 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2eb9733d-0fb0-4e2d-aa61-7dfe18122d50 req-67b6aa9d-e91c-4508-98cf-45742db8fbe9 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-unplugged-4e1903f1-9c64-411e-be18-e5775f055e13 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:36.556534 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2eb9733d-0fb0-4e2d-aa61-7dfe18122d50 req-67b6aa9d-e91c-4508-98cf-45742db8fbe9 service nova] Acquiring lock "7514b113-ec17-468b-a647-de099d90e787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:36.556983 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2eb9733d-0fb0-4e2d-aa61-7dfe18122d50 req-67b6aa9d-e91c-4508-98cf-45742db8fbe9 service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:36.556983 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2eb9733d-0fb0-4e2d-aa61-7dfe18122d50 req-67b6aa9d-e91c-4508-98cf-45742db8fbe9 service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:36.556983 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2eb9733d-0fb0-4e2d-aa61-7dfe18122d50 req-67b6aa9d-e91c-4508-98cf-45742db8fbe9 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] No waiting events found dispatching network-vif-unplugged-4e1903f1-9c64-411e-be18-e5775f055e13 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:59:36.558770 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2eb9733d-0fb0-4e2d-aa61-7dfe18122d50 req-67b6aa9d-e91c-4508-98cf-45742db8fbe9 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-unplugged-4e1903f1-9c64-411e-be18-e5775f055e13 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 09:59:36.563860 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2eb9733d-0fb0-4e2d-aa61-7dfe18122d50 req-67b6aa9d-e91c-4508-98cf-45742db8fbe9 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-unplugged-4e1903f1-9c64-411e-be18-e5775f055e13 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:36.564361 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2eb9733d-0fb0-4e2d-aa61-7dfe18122d50 req-67b6aa9d-e91c-4508-98cf-45742db8fbe9 service nova] Acquiring lock "7514b113-ec17-468b-a647-de099d90e787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:36.564566 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2eb9733d-0fb0-4e2d-aa61-7dfe18122d50 req-67b6aa9d-e91c-4508-98cf-45742db8fbe9 service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:36.564735 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2eb9733d-0fb0-4e2d-aa61-7dfe18122d50 req-67b6aa9d-e91c-4508-98cf-45742db8fbe9 service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:36.564891 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2eb9733d-0fb0-4e2d-aa61-7dfe18122d50 req-67b6aa9d-e91c-4508-98cf-45742db8fbe9 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] No waiting events found dispatching network-vif-unplugged-4e1903f1-9c64-411e-be18-e5775f055e13 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:59:36.565038 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2eb9733d-0fb0-4e2d-aa61-7dfe18122d50 req-67b6aa9d-e91c-4508-98cf-45742db8fbe9 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-unplugged-4e1903f1-9c64-411e-be18-e5775f055e13 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 09:59:36.571723 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:36.704837 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:36.775598 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 09:59:37.279873 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 09:59:37.281607 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 09:59:37.290505 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.698s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:37.291181 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.startup = manual
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.port = 0
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 09:59:37.298370 np0000001613 nova-compute[98321]: # END RECORD
May 28 09:59:37.298370 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.startup = manual
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.port = 0
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 09:59:37.302908 np0000001613 nova-compute[98321]: # END RECORD
May 28 09:59:37.302908 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:37.318060 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:37.330939 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:37.338404 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:37.338404 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:37.338404 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:37.338404 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:37.338404 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:59:37.338638 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:37.338638 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:37.338638 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:37.338638 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:37.338638 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:59:37.352561 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:37.352561 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:37.352561 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:37.352561 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:37.352561 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:59:37.352561 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:37.352561 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:37.352561 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:37.352561 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:37.352561 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:59:37.378745 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d, portal: 192.168.40.100,3260]
May 28 09:59:37.378745 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d, portal: 192.168.40.100,3260] successful.
May 28 09:59:37.378745 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:37.399421 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:37.406584 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d, portal: 192.168.50.100,3260]
May 28 09:59:37.406584 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d, portal: 192.168.50.100,3260] successful.
May 28 09:59:37.406584 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:37.415913 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:37.415913 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:37.415913 np0000001613 nova-compute[98321]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 09:59:37.415913 np0000001613 nova-compute[98321]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 09:59:37.415913 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:37.415913 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:37.415913 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:59:37.418972 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:37.418972 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:37.418972 np0000001613 nova-compute[98321]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 09:59:37.418972 np0000001613 nova-compute[98321]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 09:59:37.418972 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:37.418972 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:37.418972 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:59:37.418972 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.169s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:59:37.418972 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 09:59:37.418972 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] HCTL ('7', '-', '-', 0) found on session 21 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 09:59:37.418972 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 09:59:37.424736 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:37.442994 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Searching for a device in session 21 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 09:59:37.445070 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3dad4779-d77b-4473-a132-d2e773ff8b9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 09:59:37.447044 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:37.447044 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:37.447044 np0000001613 nova-compute[98321]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 09:59:37.447044 np0000001613 nova-compute[98321]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 09:59:37.447044 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:37.447044 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:37.447044 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:59:37.447044 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:37.447044 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:37.447044 np0000001613 nova-compute[98321]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 09:59:37.447044 np0000001613 nova-compute[98321]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 09:59:37.447044 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:37.447044 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:37.447044 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:59:37.447044 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.198s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:59:37.447044 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 09:59:37.451491 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] HCTL ('8', '-', '-', 0) found on session 22 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 09:59:37.451672 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 09:59:37.477235 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Searching for a device in session 22 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 09:59:37.477235 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3dad4779-d77b-4473-a132-d2e773ff8b9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 09:59:37.587028 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:37.799832 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 09:59:37.799832 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 09:59:37.799832 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:59:37.800054 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:59:37.959859 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:38.249285 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 09:59:38.308390 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 09:59:38.618843 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '51981c995f2246588f2d58f35be5848a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d04b105229456d9ab53df1886fdb37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 09:59:38.758793 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-38b01b10-4d50-498c-ba27-d3f8fb515899 req-a1b3d530-af60-4631-80b1-f429febbdcd9 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-unplugged-6a88c703-7b82-44ce-b5f5-a98718ae6833 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:38.758992 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-38b01b10-4d50-498c-ba27-d3f8fb515899 req-a1b3d530-af60-4631-80b1-f429febbdcd9 service nova] Acquiring lock "7514b113-ec17-468b-a647-de099d90e787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:38.759210 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-38b01b10-4d50-498c-ba27-d3f8fb515899 req-a1b3d530-af60-4631-80b1-f429febbdcd9 service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:38.759397 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-38b01b10-4d50-498c-ba27-d3f8fb515899 req-a1b3d530-af60-4631-80b1-f429febbdcd9 service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:38.761581 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-38b01b10-4d50-498c-ba27-d3f8fb515899 req-a1b3d530-af60-4631-80b1-f429febbdcd9 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] No waiting events found dispatching network-vif-unplugged-6a88c703-7b82-44ce-b5f5-a98718ae6833 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:59:38.762047 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-38b01b10-4d50-498c-ba27-d3f8fb515899 req-a1b3d530-af60-4631-80b1-f429febbdcd9 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-unplugged-6a88c703-7b82-44ce-b5f5-a98718ae6833 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 09:59:38.808845 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 09:59:39.009438 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:39.215285 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:39.271230 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Found WWN 330000000b29350f3 for multipath device dm-0 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 09:59:39.271584 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:59:39.271831 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] <== connect_volume: return (3041ms) {'type': 'block', 'scsi_wwn': '330000000b29350f3', 'path': '/dev/dm-0', 'multipath_id': '330000000b29350f3'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 09:59:39.271999 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b29350f3', 'path': '/dev/dm-0', 'multipath_id': '330000000b29350f3'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 09:59:39.279906 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lazy-loading 'flavor' on Instance uuid c9416092-d229-4f59-aaf3-3b0b692e7924 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:59:39.314321 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Booting with volume-backed-image a913bae7-5d99-49fe-9222-68cf52a5f9bb at /dev/vda
May 28 09:59:39.783212 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Successfully created port: 613dad87-2df3-4db7-a38f-adda943e8770 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 09:59:39.785922 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Attempting to attach volume 3dad4779-d77b-4473-a132-d2e773ff8b9d with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 09:59:39.786886 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] attach device xml: <disk type="block" device="disk">
May 28 09:59:39.786886 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 09:59:39.786886 np0000001613 nova-compute[98321]:   <alias name="ua-3dad4779-d77b-4473-a132-d2e773ff8b9d"/>
May 28 09:59:39.786886 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-0"/>
May 28 09:59:39.786886 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 09:59:39.786886 np0000001613 nova-compute[98321]:   <serial>3dad4779-d77b-4473-a132-d2e773ff8b9d</serial>
May 28 09:59:39.786886 np0000001613 nova-compute[98321]: </disk>
May 28 09:59:39.786886 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 09:59:40.849612 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a26d125d-c765-4467-9e0e-b9b3a729a6f3 req-a8f059cd-14c5-4554-8dcb-a54497483e67 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-unplugged-6a88c703-7b82-44ce-b5f5-a98718ae6833 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:40.850104 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a26d125d-c765-4467-9e0e-b9b3a729a6f3 req-a8f059cd-14c5-4554-8dcb-a54497483e67 service nova] Acquiring lock "7514b113-ec17-468b-a647-de099d90e787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:40.850104 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a26d125d-c765-4467-9e0e-b9b3a729a6f3 req-a8f059cd-14c5-4554-8dcb-a54497483e67 service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:40.850104 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a26d125d-c765-4467-9e0e-b9b3a729a6f3 req-a8f059cd-14c5-4554-8dcb-a54497483e67 service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:40.850236 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a26d125d-c765-4467-9e0e-b9b3a729a6f3 req-a8f059cd-14c5-4554-8dcb-a54497483e67 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] No waiting events found dispatching network-vif-unplugged-6a88c703-7b82-44ce-b5f5-a98718ae6833 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:59:40.850689 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a26d125d-c765-4467-9e0e-b9b3a729a6f3 req-a8f059cd-14c5-4554-8dcb-a54497483e67 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-unplugged-6a88c703-7b82-44ce-b5f5-a98718ae6833 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 09:59:40.850689 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a26d125d-c765-4467-9e0e-b9b3a729a6f3 req-a8f059cd-14c5-4554-8dcb-a54497483e67 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-unplugged-27187d46-bd01-4781-99fe-29d49015360e {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:40.850689 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a26d125d-c765-4467-9e0e-b9b3a729a6f3 req-a8f059cd-14c5-4554-8dcb-a54497483e67 service nova] Acquiring lock "7514b113-ec17-468b-a647-de099d90e787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:40.850689 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a26d125d-c765-4467-9e0e-b9b3a729a6f3 req-a8f059cd-14c5-4554-8dcb-a54497483e67 service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:40.850883 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a26d125d-c765-4467-9e0e-b9b3a729a6f3 req-a8f059cd-14c5-4554-8dcb-a54497483e67 service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:40.850883 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a26d125d-c765-4467-9e0e-b9b3a729a6f3 req-a8f059cd-14c5-4554-8dcb-a54497483e67 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] No waiting events found dispatching network-vif-unplugged-27187d46-bd01-4781-99fe-29d49015360e {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:59:40.850971 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a26d125d-c765-4467-9e0e-b9b3a729a6f3 req-a8f059cd-14c5-4554-8dcb-a54497483e67 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-unplugged-27187d46-bd01-4781-99fe-29d49015360e for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 09:59:40.851084 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a26d125d-c765-4467-9e0e-b9b3a729a6f3 req-a8f059cd-14c5-4554-8dcb-a54497483e67 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-unplugged-27187d46-bd01-4781-99fe-29d49015360e {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:40.851522 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a26d125d-c765-4467-9e0e-b9b3a729a6f3 req-a8f059cd-14c5-4554-8dcb-a54497483e67 service nova] Acquiring lock "7514b113-ec17-468b-a647-de099d90e787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:40.855230 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a26d125d-c765-4467-9e0e-b9b3a729a6f3 req-a8f059cd-14c5-4554-8dcb-a54497483e67 service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:40.855366 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a26d125d-c765-4467-9e0e-b9b3a729a6f3 req-a8f059cd-14c5-4554-8dcb-a54497483e67 service nova] Lock "7514b113-ec17-468b-a647-de099d90e787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:40.855480 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a26d125d-c765-4467-9e0e-b9b3a729a6f3 req-a8f059cd-14c5-4554-8dcb-a54497483e67 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] No waiting events found dispatching network-vif-unplugged-27187d46-bd01-4781-99fe-29d49015360e {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:59:40.855577 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a26d125d-c765-4467-9e0e-b9b3a729a6f3 req-a8f059cd-14c5-4554-8dcb-a54497483e67 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-unplugged-27187d46-bd01-4781-99fe-29d49015360e for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 09:59:40.855668 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a26d125d-c765-4467-9e0e-b9b3a729a6f3 req-a8f059cd-14c5-4554-8dcb-a54497483e67 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-deleted-e08f0477-e673-4559-884f-1dcbc2a9fd0e {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:40.855772 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-a26d125d-c765-4467-9e0e-b9b3a729a6f3 req-a8f059cd-14c5-4554-8dcb-a54497483e67 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Neutron deleted interface e08f0477-e673-4559-884f-1dcbc2a9fd0e; detaching it from the instance and deleting it from the info cache
May 28 09:59:40.859085 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a26d125d-c765-4467-9e0e-b9b3a729a6f3 req-a8f059cd-14c5-4554-8dcb-a54497483e67 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Detach interface failed, port_id=e08f0477-e673-4559-884f-1dcbc2a9fd0e, reason: Instance 7514b113-ec17-468b-a647-de099d90e787 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 09:59:40.877540 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Successfully updated port: 613dad87-2df3-4db7-a38f-adda943e8770 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 09:59:40.938120 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-80d728f9-b4cf-4778-a27c-14c10328a444 req-ff27c1d6-be5f-4ce9-80f5-7ff2ac37885b service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Received event network-changed-613dad87-2df3-4db7-a38f-adda943e8770 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:40.938287 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-80d728f9-b4cf-4778-a27c-14c10328a444 req-ff27c1d6-be5f-4ce9-80f5-7ff2ac37885b service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Refreshing instance network info cache due to event network-changed-613dad87-2df3-4db7-a38f-adda943e8770. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 09:59:40.938719 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-80d728f9-b4cf-4778-a27c-14c10328a444 req-ff27c1d6-be5f-4ce9-80f5-7ff2ac37885b service nova] Acquiring lock "refresh_cache-ef3d846c-c539-41c5-ade2-1f93e7acc2ca" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:59:40.938719 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-80d728f9-b4cf-4778-a27c-14c10328a444 req-ff27c1d6-be5f-4ce9-80f5-7ff2ac37885b service nova] Acquired lock "refresh_cache-ef3d846c-c539-41c5-ade2-1f93e7acc2ca" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:59:40.938908 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-80d728f9-b4cf-4778-a27c-14c10328a444 req-ff27c1d6-be5f-4ce9-80f5-7ff2ac37885b service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Refreshing network info cache for port 613dad87-2df3-4db7-a38f-adda943e8770 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 09:59:41.380778 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "refresh_cache-ef3d846c-c539-41c5-ade2-1f93e7acc2ca" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:59:41.440884 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-80d728f9-b4cf-4778-a27c-14c10328a444 req-ff27c1d6-be5f-4ce9-80f5-7ff2ac37885b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:59:41.506183 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:59:41.506183 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:59:41.506183 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:59:41.506183 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] No VIF found with MAC fa:16:3e:ae:54:17, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 09:59:41.929274 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:42.050183 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-80d728f9-b4cf-4778-a27c-14c10328a444 req-ff27c1d6-be5f-4ce9-80f5-7ff2ac37885b service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 09:59:42.337986 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:42.587668 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:42.658491 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-80d728f9-b4cf-4778-a27c-14c10328a444 req-ff27c1d6-be5f-4ce9-80f5-7ff2ac37885b service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:59:42.792197 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:59:42.792380 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Cleaning up deleted instances {{(pid=98321) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
May 28 09:59:42.954246 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d7f32106-821e-43fc-88f9-c821eca739c5 req-31b1f2e3-1a19-421c-8164-70b5c4c505e5 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-deleted-edca6f4e-7f57-4351-8525-4446771d6376 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:42.955691 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-d7f32106-821e-43fc-88f9-c821eca739c5 req-31b1f2e3-1a19-421c-8164-70b5c4c505e5 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Neutron deleted interface edca6f4e-7f57-4351-8525-4446771d6376; detaching it from the instance and deleting it from the info cache
May 28 09:59:42.956869 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d7f32106-821e-43fc-88f9-c821eca739c5 req-31b1f2e3-1a19-421c-8164-70b5c4c505e5 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Detach interface failed, port_id=edca6f4e-7f57-4351-8525-4446771d6376, reason: Instance 7514b113-ec17-468b-a647-de099d90e787 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 09:59:43.037957 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2036a33b-15a4-493d-bf3a-d346b7d3d311 req-07991e5a-3008-4739-bc17-444cd71ad803 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-deleted-d3b48415-3d34-4753-a72f-6f48536174ed {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:43.038154 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-2036a33b-15a4-493d-bf3a-d346b7d3d311 req-07991e5a-3008-4739-bc17-444cd71ad803 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Neutron deleted interface d3b48415-3d34-4753-a72f-6f48536174ed; detaching it from the instance and deleting it from the info cache
May 28 09:59:43.040324 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2036a33b-15a4-493d-bf3a-d346b7d3d311 req-07991e5a-3008-4739-bc17-444cd71ad803 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Detach interface failed, port_id=d3b48415-3d34-4753-a72f-6f48536174ed, reason: Instance 7514b113-ec17-468b-a647-de099d90e787 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 09:59:43.066366 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e6255cb3-498b-4943-b302-b889b6040786 req-3b0041fa-be9a-44e9-8a33-5ec7a7cfba20 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-deleted-6a88c703-7b82-44ce-b5f5-a98718ae6833 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:43.067082 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-e6255cb3-498b-4943-b302-b889b6040786 req-3b0041fa-be9a-44e9-8a33-5ec7a7cfba20 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Neutron deleted interface 6a88c703-7b82-44ce-b5f5-a98718ae6833; detaching it from the instance and deleting it from the info cache
May 28 09:59:43.069988 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e6255cb3-498b-4943-b302-b889b6040786 req-3b0041fa-be9a-44e9-8a33-5ec7a7cfba20 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Detach interface failed, port_id=6a88c703-7b82-44ce-b5f5-a98718ae6833, reason: Instance 7514b113-ec17-468b-a647-de099d90e787 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 09:59:43.070469 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c8cab4e3-2fa3-4725-bb37-e3f17426c0e8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "c9416092-d229-4f59-aaf3-3b0b692e7924" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.582s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:43.160945 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-80d728f9-b4cf-4778-a27c-14c10328a444 req-ff27c1d6-be5f-4ce9-80f5-7ff2ac37885b service nova] Releasing lock "refresh_cache-ef3d846c-c539-41c5-ade2-1f93e7acc2ca" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:59:43.161344 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquired lock "refresh_cache-ef3d846c-c539-41c5-ade2-1f93e7acc2ca" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:59:43.161573 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 09:59:43.295799 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] There are 0 instances to clean {{(pid=98321) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
May 28 09:59:43.296633 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:59:43.296764 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98321) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
May 28 09:59:43.799259 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:59:43.841296 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 7514b113-ec17-468b-a647-de099d90e787] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:59:44.063670 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 09:59:44.100238 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:44.217414 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:44.301291 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.99 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 09:59:44.344343 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 7514b113-ec17-468b-a647-de099d90e787] Took 10.19 seconds to deallocate network for instance.
May 28 09:59:44.759719 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:59:44.844422 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Rebuilding instance
May 28 09:59:44.992834 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-063798ca-3ac7-49cb-8962-43378759f877 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "83f9ce5f-44cb-40c6-be1a-8d5134ee8902" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:44.993056 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-063798ca-3ac7-49cb-8962-43378759f877 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "83f9ce5f-44cb-40c6-be1a-8d5134ee8902" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:44.993364 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-063798ca-3ac7-49cb-8962-43378759f877 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "83f9ce5f-44cb-40c6-be1a-8d5134ee8902-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:44.994474 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-063798ca-3ac7-49cb-8962-43378759f877 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "83f9ce5f-44cb-40c6-be1a-8d5134ee8902-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:44.994474 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-063798ca-3ac7-49cb-8962-43378759f877 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "83f9ce5f-44cb-40c6-be1a-8d5134ee8902-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:45.000828 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-063798ca-3ac7-49cb-8962-43378759f877 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Terminating instance
May 28 09:59:45.012690 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Updating instance_info_cache with network_info: [{"id": "613dad87-2df3-4db7-a38f-adda943e8770", "address": "fa:16:3e:03:75:e0", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap613dad87-2d", "ovs_interfaceid": "613dad87-2df3-4db7-a38f-adda943e8770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:59:45.069737 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:59:45.086222 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-70fa2e8f-629f-46aa-ad6d-5f364624fe7e req-c31dbe28-b948-4d74-840b-cd107ae07e20 service nova] [instance: 7514b113-ec17-468b-a647-de099d90e787] Received event network-vif-deleted-27187d46-bd01-4781-99fe-29d49015360e {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:45.092565 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Acquiring lock "5214df33-d3dc-4932-b781-dc96b2d90a5a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:45.092858 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Lock "5214df33-d3dc-4932-b781-dc96b2d90a5a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:45.404075 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:45.507082 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-063798ca-3ac7-49cb-8962-43378759f877 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 09:59:45.517007 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Releasing lock "refresh_cache-ef3d846c-c539-41c5-ade2-1f93e7acc2ca" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:59:45.517136 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Instance network_info: |[{"id": "613dad87-2df3-4db7-a38f-adda943e8770", "address": "fa:16:3e:03:75:e0", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap613dad87-2d", "ovs_interfaceid": "613dad87-2df3-4db7-a38f-adda943e8770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 09:59:45.534692 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:45.559635 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:45.594768 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 09:59:45.728440 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:45.734875 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:45.835508 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:45.846929 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:45.867888 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.99967263099984 future=<Future at 0x73c1fc500710 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:59:45.871046 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Instance destroyed successfully.
May 28 09:59:45.872636 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-063798ca-3ac7-49cb-8962-43378759f877 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lazy-loading 'resources' on Instance uuid 83f9ce5f-44cb-40c6-be1a-8d5134ee8902 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:59:45.923086 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a276c8d4-1b84-4ea9-9a73-53f112c38e8d req-1935fd79-4ba6-45f6-99f9-43e543918cc7 service nova] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Received event network-vif-unplugged-ef420b58-5bcf-43e2-8866-408b9c731893 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:45.924532 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a276c8d4-1b84-4ea9-9a73-53f112c38e8d req-1935fd79-4ba6-45f6-99f9-43e543918cc7 service nova] Acquiring lock "83f9ce5f-44cb-40c6-be1a-8d5134ee8902-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:45.924731 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a276c8d4-1b84-4ea9-9a73-53f112c38e8d req-1935fd79-4ba6-45f6-99f9-43e543918cc7 service nova] Lock "83f9ce5f-44cb-40c6-be1a-8d5134ee8902-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:45.924860 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a276c8d4-1b84-4ea9-9a73-53f112c38e8d req-1935fd79-4ba6-45f6-99f9-43e543918cc7 service nova] Lock "83f9ce5f-44cb-40c6-be1a-8d5134ee8902-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:45.925180 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a276c8d4-1b84-4ea9-9a73-53f112c38e8d req-1935fd79-4ba6-45f6-99f9-43e543918cc7 service nova] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] No waiting events found dispatching network-vif-unplugged-ef420b58-5bcf-43e2-8866-408b9c731893 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:59:45.925817 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a276c8d4-1b84-4ea9-9a73-53f112c38e8d req-1935fd79-4ba6-45f6-99f9-43e543918cc7 service nova] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Received event network-vif-unplugged-ef420b58-5bcf-43e2-8866-408b9c731893 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 09:59:46.116007 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:46.119952 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:46.121277 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Took 1.77 seconds to detach 3 volumes for instance.
May 28 09:59:46.144687 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:46.204870 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:46.205091 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:46.211488 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 09:59:46.211488 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Claim successful on node np0000001613
May 28 09:59:46.361200 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:46.375093 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-063798ca-3ac7-49cb-8962-43378759f877 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:58:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1228794281',display_name='tempest-AttachVolumeNegativeTest-server-1228794281',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumenegativetest-server-1228794281',id=12,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2i+zX9coT9fsArGdEpPip5bZsP5t+5Wn76McZDXd0JEko601eljutvz6KUK5V4YIhsXgLAUsAqM4s1yNGDRvohGl7rIECGbcUCggnSraY6FDvJbepAgl0eQHxE0iAgEg==',key_name='tempest-keypair-735349052',keypairs=<?>,launch_index=0,launched_at=2026-05-28T09:59:06Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a85ba31f98b45b6974118c6560bbc53',ramdisk_id='',reservation_id='r-9uvqj34l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-775348461',owner_user_name='tempest-AttachVolumeNegativeTest-775348461-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T09:59:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9297977bbf334232a4a74bd6808b863b',uuid=83f9ce5f-44cb-40c6-be1a-8d5134ee8902,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef420b58-5bcf-43e2-8866-408b9c731893", "address": "fa:16:3e:eb:53:44", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef420b58-5b", "ovs_interfaceid": "ef420b58-5bcf-43e2-8866-408b9c731893", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 09:59:46.375503 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-063798ca-3ac7-49cb-8962-43378759f877 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Converting VIF {"id": "ef420b58-5bcf-43e2-8866-408b9c731893", "address": "fa:16:3e:eb:53:44", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef420b58-5b", "ovs_interfaceid": "ef420b58-5bcf-43e2-8866-408b9c731893", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:59:46.376142 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-063798ca-3ac7-49cb-8962-43378759f877 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:53:44,bridge_name='br-int',has_traffic_filtering=True,id=ef420b58-5bcf-43e2-8866-408b9c731893,network=Network(bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef420b58-5b') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:59:46.376449 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-063798ca-3ac7-49cb-8962-43378759f877 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:53:44,bridge_name='br-int',has_traffic_filtering=True,id=ef420b58-5bcf-43e2-8866-408b9c731893,network=Network(bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef420b58-5b') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 09:59:46.380728 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:46.380942 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:46.381439 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef420b58-5b, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:46.384049 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:46.385423 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:59:46.390610 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:46.395348 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:46.395585 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ba60cf9f-b935-4fa0-8eef-9b364ad7f4d6) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:46.396386 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:46.398574 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:59:46.405666 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:46.408524 np0000001613 nova-compute[98321]: INFO os_vif [None req-063798ca-3ac7-49cb-8962-43378759f877 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:53:44,bridge_name='br-int',has_traffic_filtering=True,id=ef420b58-5bcf-43e2-8866-408b9c731893,network=Network(bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef420b58-5b')
May 28 09:59:46.408942 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-063798ca-3ac7-49cb-8962-43378759f877 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Deleting instance files /opt/stack/data/nova/instances/83f9ce5f-44cb-40c6-be1a-8d5134ee8902_del
May 28 09:59:46.409956 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-063798ca-3ac7-49cb-8962-43378759f877 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Deletion of /opt/stack/data/nova/instances/83f9ce5f-44cb-40c6-be1a-8d5134ee8902_del complete
May 28 09:59:46.464287 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.998903238999901 future=<Future at 0x73c1fc1ce090 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:59:46.468974 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Instance destroyed successfully.
May 28 09:59:46.556882 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Detaching volume 3dad4779-d77b-4473-a132-d2e773ff8b9d
May 28 09:59:46.612303 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Attempting to driver detach volume 3dad4779-d77b-4473-a132-d2e773ff8b9d from mountpoint /dev/vdb
May 28 09:59:46.616286 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Found disk vdb by alias ua-3dad4779-d77b-4473-a132-d2e773ff8b9d {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 09:59:46.616423 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Attempting to detach device vdb from instance c9416092-d229-4f59-aaf3-3b0b692e7924 from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 09:59:46.616650 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] detach device xml: <disk type="block" device="disk">
May 28 09:59:46.616650 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 09:59:46.616650 np0000001613 nova-compute[98321]:   <alias name="ua-3dad4779-d77b-4473-a132-d2e773ff8b9d"/>
May 28 09:59:46.616650 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-0"/>
May 28 09:59:46.616650 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 09:59:46.616650 np0000001613 nova-compute[98321]:   <serial>3dad4779-d77b-4473-a132-d2e773ff8b9d</serial>
May 28 09:59:46.616650 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 09:59:46.616650 np0000001613 nova-compute[98321]: </disk>
May 28 09:59:46.616650 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 09:59:46.623494 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Successfully detached device vdb from instance c9416092-d229-4f59-aaf3-3b0b692e7924 from the persistent domain config.
May 28 09:59:46.624612 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 09:59:46.624966 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3dad4779-d77b-4473-a132-d2e773ff8b9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 09:59:46.625138 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:59:46.625540 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:59:46.625897 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3dad4779-d77b-4473-a132-d2e773ff8b9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 09:59:46.626059 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 09:59:46.635523 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:46.663863 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:46.663863 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:46.663863 np0000001613 nova-compute[98321]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 09:59:46.663863 np0000001613 nova-compute[98321]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 09:59:46.663863 np0000001613 nova-compute[98321]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 09:59:46.663863 np0000001613 nova-compute[98321]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 09:59:46.663863 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:46.663863 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:46.663863 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:59:46.664176 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:46.664176 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:46.664176 np0000001613 nova-compute[98321]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 09:59:46.664176 np0000001613 nova-compute[98321]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 09:59:46.664176 np0000001613 nova-compute[98321]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 09:59:46.664176 np0000001613 nova-compute[98321]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 09:59:46.664176 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:46.664176 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:46.664176 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:59:46.664348 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', '22'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', '6')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 09:59:46.664406 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', '21')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 09:59:46.665877 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', '22')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 09:59:46.667407 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc2bed40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d'): ({'sdc'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 09:59:46.668425 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Removing multipathed devices sdb, sdc {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 09:59:46.668425 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Flush multipath device 330000000b29350f3 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 09:59:46.704023 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 09:59:46.748008 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0013278320000154054 future=<Future at 0x73c1fc422300 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:59:46.748702 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Emitting event <LifecycleEvent: 1779962371.746557, 7514b113-ec17-468b-a647-de099d90e787 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:59:46.748873 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:59:46.749125 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] VM Stopped (Lifecycle Event)
May 28 09:59:46.750471 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.116630811999812 future=<Future at 0x73c1fc500710 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:59:46.751487 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.116387869999926 future=<Future at 0x73c1fc500710 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 09:59:46.763453 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 09:59:46.813007 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 09:59:46.813149 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 09:59:46.813996 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 09:59:46.830552 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 09:59:46.831248 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 09:59:46.847574 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:46.890077 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d, portal: 192.168.40.100,3260]
May 28 09:59:46.890077 np0000001613 nova-compute[98321]: Logout of [sid: 21, target: iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d, portal: 192.168.40.100,3260] successful.
May 28 09:59:46.890077 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:46.910993 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:46.920496 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-063798ca-3ac7-49cb-8962-43378759f877 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Took 1.41 seconds to destroy the instance on the hypervisor.
May 28 09:59:46.922110 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-063798ca-3ac7-49cb-8962-43378759f877 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 09:59:46.922549 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 09:59:46.922725 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 09:59:46.923032 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:59:46.936704 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:46.978375 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d, portal: 192.168.50.100,3260]
May 28 09:59:46.978375 np0000001613 nova-compute[98321]: Logout of [sid: 22, target: iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d, portal: 192.168.50.100,3260] successful.
May 28 09:59:46.978375 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:46.994307 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:47.002454 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:47.002454 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:59:47.002454 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] <== disconnect_volume: return (377ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 09:59:47.002698 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 09:59:47.059507 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:59:47.252239 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-deb0ecb6-5cb8-42f3-9514-03e2f974f0d5 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 7514b113-ec17-468b-a647-de099d90e787] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:59:47.293442 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b0b45f7b-09d9-482a-a284-14c46ed22488 req-c0438e5d-8e08-447b-8d7b-b17686f0ff53 service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Received event network-vif-unplugged-613dad87-2df3-4db7-a38f-adda943e8770 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:47.300734 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:59:47.301319 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b0b45f7b-09d9-482a-a284-14c46ed22488 req-c0438e5d-8e08-447b-8d7b-b17686f0ff53 service nova] Acquiring lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:47.301910 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:59:47.301910 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b0b45f7b-09d9-482a-a284-14c46ed22488 req-c0438e5d-8e08-447b-8d7b-b17686f0ff53 service nova] Lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:47.302292 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b0b45f7b-09d9-482a-a284-14c46ed22488 req-c0438e5d-8e08-447b-8d7b-b17686f0ff53 service nova] Lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:47.303348 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b0b45f7b-09d9-482a-a284-14c46ed22488 req-c0438e5d-8e08-447b-8d7b-b17686f0ff53 service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] No waiting events found dispatching network-vif-unplugged-613dad87-2df3-4db7-a38f-adda943e8770 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:59:47.303932 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:59:47.304345 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-b0b45f7b-09d9-482a-a284-14c46ed22488 req-c0438e5d-8e08-447b-8d7b-b17686f0ff53 service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Received unexpected event network-vif-unplugged-613dad87-2df3-4db7-a38f-adda943e8770 for instance with vm_state building and task_state block_device_mapping.
May 28 09:59:47.304787 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:59:47.304982 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.49 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 09:59:47.857518 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 09:59:47.857844 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 09:59:48.098302 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Instance destroyed successfully.
May 28 09:59:48.099415 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:58:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-108220691',display_name='tempest-ServerActionsTestOtherA-server-590881060',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-tempest-common-compute-instance-108220691',id=11,image_ref='3427ea11-12a6-4b25-8c73-769d29819fe0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdAbUj53uPVh2c6JmC0f4KuNc7XzB7W4qhLekRIZb4uQ1puOTl+iHN7nlIYOIwGJpx2OcUD9FRst/gQF9pX2F6kz8VeUkdxZMdxvvnrPL706aUB6jSV93natJMiSLTBtQ==',key_name='tempest-keypair-1688806139',keypairs=<?>,launch_index=0,launched_at=2026-05-28T09:58:52Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cb3a501b4f4041ef875ef4d2b4167044',ramdisk_id='',reservation_id='r-v17yjkz1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3427ea11-12a6-4b25-8c73-769d29819fe0',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1557455944',owner_user_name='tempest-ServerActionsTestOtherA-1557455944-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:59:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62efa57da85f458790f3ceeebcc777a7',uuid=c9416092-d229-4f59-aaf3-3b0b692e7924,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fec718e7-b773-4907-abf5-60f374bd420a", "address": "fa:16:3e:ae:54:17", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec718e7-b7", "ovs_interfaceid": "fec718e7-b773-4907-abf5-60f374bd420a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 09:59:48.099701 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Converting VIF {"id": "fec718e7-b773-4907-abf5-60f374bd420a", "address": "fa:16:3e:ae:54:17", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec718e7-b7", "ovs_interfaceid": "fec718e7-b773-4907-abf5-60f374bd420a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:59:48.100239 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:54:17,bridge_name='br-int',has_traffic_filtering=True,id=fec718e7-b773-4907-abf5-60f374bd420a,network=Network(2ae47a43-582b-442f-922d-fe7138b431a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec718e7-b7') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:59:48.100496 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:54:17,bridge_name='br-int',has_traffic_filtering=True,id=fec718e7-b773-4907-abf5-60f374bd420a,network=Network(2ae47a43-582b-442f-922d-fe7138b431a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec718e7-b7') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 09:59:48.108095 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:48.108338 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfec718e7-b7, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:48.109746 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:48.110695 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:59:48.111151 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:48.111315 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=30bc7c18-893b-4b21-b8a7-9a0093949c50) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:48.111867 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:48.112265 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:59:48.112576 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:48.115335 np0000001613 nova-compute[98321]: INFO os_vif [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:54:17,bridge_name='br-int',has_traffic_filtering=True,id=fec718e7-b773-4907-abf5-60f374bd420a,network=Network(2ae47a43-582b-442f-922d-fe7138b431a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec718e7-b7')
May 28 09:59:48.116640 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 09:59:48.116880 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3dad4779-d77b-4473-a132-d2e773ff8b9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 09:59:48.116999 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:59:48.117331 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:59:48.117586 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3dad4779-d77b-4473-a132-d2e773ff8b9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 09:59:48.117714 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 09:59:48.142671 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:48.142671 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:48.142671 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:48.142671 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:48.142671 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:59:48.142943 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:48.142943 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:48.142943 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:48.142943 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:48.142943 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:59:48.142943 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b', '14'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', '6')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 09:59:48.143236 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d, 0): [] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 09:59:48.143648 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d') {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 09:59:48.143811 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d, 0): [] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 09:59:48.143937 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d') {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 09:59:48.144005 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc14ba60>, {}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 09:59:48.144116 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Disconnecting from: [] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 09:59:48.144300 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.027s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:59:48.144389 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] <== disconnect_volume: return (27ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 09:59:48.144489 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 09:59:48.144738 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Deleting instance files /opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924_del
May 28 09:59:48.145438 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Deletion of /opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924_del complete
May 28 09:59:48.361110 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 09:59:48.556247 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:59:48.791931 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:59:48.791931 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 09:59:48.792373 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:59:48.870709 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.665s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:48.872429 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 09:59:48.873562 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.238s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:48.983490 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 09:59:49.012476 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 09:59:49.027119 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3ca0bb32-96ca-4c8d-b98a-f02c6fbbccf2 req-79b7b9b5-4b96-43b2-9dae-631d1d459194 service nova] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Received event network-vif-unplugged-ef420b58-5bcf-43e2-8866-408b9c731893 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:49.027119 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3ca0bb32-96ca-4c8d-b98a-f02c6fbbccf2 req-79b7b9b5-4b96-43b2-9dae-631d1d459194 service nova] Acquiring lock "83f9ce5f-44cb-40c6-be1a-8d5134ee8902-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:49.027119 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3ca0bb32-96ca-4c8d-b98a-f02c6fbbccf2 req-79b7b9b5-4b96-43b2-9dae-631d1d459194 service nova] Lock "83f9ce5f-44cb-40c6-be1a-8d5134ee8902-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:49.027119 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3ca0bb32-96ca-4c8d-b98a-f02c6fbbccf2 req-79b7b9b5-4b96-43b2-9dae-631d1d459194 service nova] Lock "83f9ce5f-44cb-40c6-be1a-8d5134ee8902-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:49.027119 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3ca0bb32-96ca-4c8d-b98a-f02c6fbbccf2 req-79b7b9b5-4b96-43b2-9dae-631d1d459194 service nova] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] No waiting events found dispatching network-vif-unplugged-ef420b58-5bcf-43e2-8866-408b9c731893 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:59:49.027119 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3ca0bb32-96ca-4c8d-b98a-f02c6fbbccf2 req-79b7b9b5-4b96-43b2-9dae-631d1d459194 service nova] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Received event network-vif-unplugged-ef420b58-5bcf-43e2-8866-408b9c731893 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 09:59:49.047755 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:59:49.072878 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Took 2.15 seconds to deallocate network for instance.
May 28 09:59:49.085795 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:49.097588 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 09:59:49.098744 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 09:59:49.108399 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 09:59:49.109989 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe95:8bd3', 'fe80::fc16:3eff:fe2d:94a4', 'fe80::fc16:3eff:fe31:5106', 'fe80::fc96:34ff:fe12:e4df', 'fe80::2844:59ff:feec:5d21', 'fe80::44e2:31ff:fe81:8771', 'fe80::fc16:3eff:fe7a:26b6', 'fe80::fc16:3eff:fe05:61f2'] 
May 28 09:59:49.110140 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 09:59:49.110239 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 09:59:49.110459 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 09:59:49.111155 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Updating existing volume attachment record: 0c5d538f-f3a1-42fd-a65b-5cf25d2bdc90 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 09:59:49.159760 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Booting with volume 3dad4779-d77b-4473-a132-d2e773ff8b9d at /dev/vdb
May 28 09:59:49.219609 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:49.222082 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:49.227307 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 09:59:49.243548 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 09:59:49.269936 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:59:49.303803 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:49.315707 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 09:59:49.317534 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 09:59:49.334041 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 09:59:49.334041 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe95:8bd3', 'fe80::fc16:3eff:fe2d:94a4', 'fe80::fc16:3eff:fe31:5106', 'fe80::fc96:34ff:fe12:e4df', 'fe80::2844:59ff:feec:5d21', 'fe80::44e2:31ff:fe81:8771', 'fe80::fc16:3eff:fe7a:26b6', 'fe80::fc16:3eff:fe05:61f2'] 
May 28 09:59:49.334041 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 09:59:49.334041 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 09:59:49.334041 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 09:59:49.334041 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Updating existing volume attachment record: 243bfb9a-d61f-4d47-a585-c676bbb53883 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 09:59:49.378271 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 09:59:49.379556 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 09:59:49.379556 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:59:49.380015 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:59:49.404951 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f7c9ece1-d9a6-43a7-b144-395aa0cd4c38 req-b2d54705-04fe-462c-ad1c-c956801e64b0 service nova] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Received event network-vif-unplugged-fec718e7-b773-4907-abf5-60f374bd420a {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:49.405255 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f7c9ece1-d9a6-43a7-b144-395aa0cd4c38 req-b2d54705-04fe-462c-ad1c-c956801e64b0 service nova] Acquiring lock "c9416092-d229-4f59-aaf3-3b0b692e7924-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:49.405497 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f7c9ece1-d9a6-43a7-b144-395aa0cd4c38 req-b2d54705-04fe-462c-ad1c-c956801e64b0 service nova] Lock "c9416092-d229-4f59-aaf3-3b0b692e7924-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:49.405679 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f7c9ece1-d9a6-43a7-b144-395aa0cd4c38 req-b2d54705-04fe-462c-ad1c-c956801e64b0 service nova] Lock "c9416092-d229-4f59-aaf3-3b0b692e7924-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:49.405843 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f7c9ece1-d9a6-43a7-b144-395aa0cd4c38 req-b2d54705-04fe-462c-ad1c-c956801e64b0 service nova] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] No waiting events found dispatching network-vif-unplugged-fec718e7-b773-4907-abf5-60f374bd420a {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:59:49.406010 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-f7c9ece1-d9a6-43a7-b144-395aa0cd4c38 req-b2d54705-04fe-462c-ad1c-c956801e64b0 service nova] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Received unexpected event network-vif-unplugged-fec718e7-b773-4907-abf5-60f374bd420a for instance with vm_state active and task_state rebuild_block_device_mapping.
May 28 09:59:49.406178 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f7c9ece1-d9a6-43a7-b144-395aa0cd4c38 req-b2d54705-04fe-462c-ad1c-c956801e64b0 service nova] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Received event network-vif-deleted-ef420b58-5bcf-43e2-8866-408b9c731893 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:49.410362 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f7c9ece1-d9a6-43a7-b144-395aa0cd4c38 req-b2d54705-04fe-462c-ad1c-c956801e64b0 service nova] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Received event network-vif-unplugged-fec718e7-b773-4907-abf5-60f374bd420a {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:49.410362 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f7c9ece1-d9a6-43a7-b144-395aa0cd4c38 req-b2d54705-04fe-462c-ad1c-c956801e64b0 service nova] Acquiring lock "c9416092-d229-4f59-aaf3-3b0b692e7924-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:49.410362 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f7c9ece1-d9a6-43a7-b144-395aa0cd4c38 req-b2d54705-04fe-462c-ad1c-c956801e64b0 service nova] Lock "c9416092-d229-4f59-aaf3-3b0b692e7924-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:49.410362 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f7c9ece1-d9a6-43a7-b144-395aa0cd4c38 req-b2d54705-04fe-462c-ad1c-c956801e64b0 service nova] Lock "c9416092-d229-4f59-aaf3-3b0b692e7924-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:49.410362 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f7c9ece1-d9a6-43a7-b144-395aa0cd4c38 req-b2d54705-04fe-462c-ad1c-c956801e64b0 service nova] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] No waiting events found dispatching network-vif-unplugged-fec718e7-b773-4907-abf5-60f374bd420a {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 09:59:49.410362 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-f7c9ece1-d9a6-43a7-b144-395aa0cd4c38 req-b2d54705-04fe-462c-ad1c-c956801e64b0 service nova] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Received unexpected event network-vif-unplugged-fec718e7-b773-4907-abf5-60f374bd420a for instance with vm_state active and task_state rebuild_block_device_mapping.
May 28 09:59:49.491570 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '263f33d2831141c7b0b8eadbd8d9c315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850a1b46c5954c54a488aa77569e6585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 09:59:49.589366 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-063798ca-3ac7-49cb-8962-43378759f877 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:49.683267 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 09:59:49.684087 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 09:59:49.881747 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 09:59:50.073356 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Successfully created port: 8698560a-9cc7-4c98-ac7e-4430b67281c7 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 09:59:50.190008 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 09:59:50.392262 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 09:59:50.702447 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.829s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:50.704129 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.401s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:50.704574 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:50.708228 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Auditing locally available compute resources for np0000001613 (node: np0000001613) {{(pid=98321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 09:59:50.708228 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-063798ca-3ac7-49cb-8962-43378759f877 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.117s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:50.750273 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Successfully updated port: 8698560a-9cc7-4c98-ac7e-4430b67281c7 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 09:59:50.785603 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Deleted allocations for instance 7514b113-ec17-468b-a647-de099d90e787
May 28 09:59:51.254116 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Acquiring lock "refresh_cache-5214df33-d3dc-4932-b781-dc96b2d90a5a" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:59:51.254336 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Acquired lock "refresh_cache-5214df33-d3dc-4932-b781-dc96b2d90a5a" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:59:51.254568 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 09:59:51.289621 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 09:59:51.290843 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 09:59:51.291073 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Creating image(s)
May 28 09:59:51.291421 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Did not create local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 09:59:51.291553 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Ensure instance console log exists: /opt/stack/data/nova/instances/ef3d846c-c539-41c5-ade2-1f93e7acc2ca/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 09:59:51.291787 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:51.292005 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:51.292089 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:51.292737 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Start _get_guest_xml network_info=[{"id": "613dad87-2df3-4db7-a38f-adda943e8770", "address": "fa:16:3e:03:75:e0", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap613dad87-2d", "ovs_interfaceid": "613dad87-2df3-4db7-a38f-adda943e8770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399', 'iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '258c61ac-673c-4b35-b2b5-182ee3432399', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'ef3d846c-c539-41c5-ade2-1f93e7acc2ca', 'attached_at': '', 'detached_at': '', 'volume_id': '258c61ac-673c-4b35-b2b5-182ee3432399', 'serial': '258c61ac-673c-4b35-b2b5-182ee3432399'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '0c5d538f-f3a1-42fd-a65b-5cf25d2bdc90', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 09:59:51.298234 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 09:59:51.299983 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1211585824', uuid='ef3d846c-c539-41c5-ade2-1f93e7acc2ca'), owner=OwnerMeta(userid='51981c995f2246588f2d58f35be5848a', username='tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member', projectid='a9d04b105229456d9ab53df1886fdb37', projectname='tempest-ServerBootFromVolumeStableRescueTest-283762505'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "613dad87-2df3-4db7-a38f-adda943e8770", "address": "fa:16:3e:03:75:e0", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap613dad87-2d", "ovs_interfaceid": "613dad87-2df3-4db7-a38f-adda943e8770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962391.2993705) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 09:59:51.310775 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 09:59:51.311517 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 09:59:51.314197 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 09:59:51.314197 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 09:59:51.314393 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 09:59:51.314715 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 09:59:51.314892 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 09:59:51.314985 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 09:59:51.315145 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 09:59:51.315328 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 09:59:51.315444 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 09:59:51.315658 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 09:59:51.315745 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 09:59:51.315877 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 09:59:51.315981 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 09:59:51.316090 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 09:59:51.329862 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 09:59:51.330425 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399', 'iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '258c61ac-673c-4b35-b2b5-182ee3432399', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 09:59:51.330425 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:59:51.330876 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:59:51.331108 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399', 'iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '258c61ac-673c-4b35-b2b5-182ee3432399', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 09:59:51.333902 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-063798ca-3ac7-49cb-8962-43378759f877 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 09:59:51.334016 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-063798ca-3ac7-49cb-8962-43378759f877 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 09:59:51.346233 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:59:51.346842 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:59:51.347138 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 09:59:51.350103 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:59:51.350858 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:59:51.351241 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 09:59:51.363214 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 09:59:51.363214 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:51.370042 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 09:59:51.370042 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:51.378457 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399] added
May 28 09:59:51.378457 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 09:59:51.378457 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:59:51.378457 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:59:51.378457 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:59:51.378457 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:59:51.378457 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:51.378816 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 09:59:51.378869 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0318(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 09:59:51.379071 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 09:59:51.382550 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399] added
May 28 09:59:51.382550 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 09:59:51.382550 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:59:51.382550 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:59:51.382550 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:59:51.382550 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:59:51.382550 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:51.382856 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 09:59:51.382999 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0319(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 09:59:51.383157 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 09:59:51.400509 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 09:59:51.401353 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 09:59:51.401626 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Creating image(s)
May 28 09:59:51.402157 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Acquiring lock "/opt/stack/data/nova/instances/5214df33-d3dc-4932-b781-dc96b2d90a5a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:51.402511 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Lock "/opt/stack/data/nova/instances/5214df33-d3dc-4932-b781-dc96b2d90a5a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:51.402889 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Lock "/opt/stack/data/nova/instances/5214df33-d3dc-4932-b781-dc96b2d90a5a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:51.403537 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:59:51.408024 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:59:51.408024 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:59:51.470092 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-77512f65-17e1-442c-ac1b-af16b08bd1d7 req-33a5726b-d33a-4a20-9add-e4013f70e2fd service nova] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Received event network-changed-8698560a-9cc7-4c98-ac7e-4430b67281c7 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:51.470092 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-77512f65-17e1-442c-ac1b-af16b08bd1d7 req-33a5726b-d33a-4a20-9add-e4013f70e2fd service nova] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Refreshing instance network info cache due to event network-changed-8698560a-9cc7-4c98-ac7e-4430b67281c7. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 09:59:51.470092 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-77512f65-17e1-442c-ac1b-af16b08bd1d7 req-33a5726b-d33a-4a20-9add-e4013f70e2fd service nova] Acquiring lock "refresh_cache-5214df33-d3dc-4932-b781-dc96b2d90a5a" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 09:59:51.480796 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 09:59:51.481015 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Creating image(s)
May 28 09:59:51.481679 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "/opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:51.481957 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "/opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:51.482701 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "/opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:51.483049 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "56491f38f2d1b03bde8194ae005695e5f6c664b6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:51.483591 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "56491f38f2d1b03bde8194ae005695e5f6c664b6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:51.494267 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.086s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:59:51.494790 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:51.495250 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:51.495769 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:59:51.500234 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:59:51.501195 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:59:51.613099 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.112s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:59:51.613489 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/5214df33-d3dc-4932-b781-dc96b2d90a5a/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:59:51.671227 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/5214df33-d3dc-4932-b781-dc96b2d90a5a/disk 1073741824" returned: 0 in 0.057s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:59:51.672370 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.177s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:51.672825 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:59:51.769881 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb9e572-ba71-4a8c-b415-44c9e7ebec51/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:59:51.791268 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.117s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:59:51.793557 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5214df33-d3dc-4932-b781-dc96b2d90a5a/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 09:59:51.794269 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5214df33-d3dc-4932-b781-dc96b2d90a5a/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:59:51.827469 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-08bda470-9f9d-4f78-b2a0-572367100261 tempest-TaggedBootDevicesTest_v242-845922542 tempest-TaggedBootDevicesTest_v242-845922542-project-member] Lock "7514b113-ec17-468b-a647-de099d90e787" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 21.102s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:51.838028 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-063798ca-3ac7-49cb-8962-43378759f877 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 09:59:51.886173 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb9e572-ba71-4a8c-b415-44c9e7ebec51/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:59:51.886623 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb9e572-ba71-4a8c-b415-44c9e7ebec51/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:59:51.913070 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 09:59:51.918067 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5214df33-d3dc-4932-b781-dc96b2d90a5a/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:59:51.922541 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Cannot resize image /opt/stack/data/nova/instances/5214df33-d3dc-4932-b781-dc96b2d90a5a/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 09:59:51.923065 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 09:59:51.923348 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Ensure instance console log exists: /opt/stack/data/nova/instances/5214df33-d3dc-4932-b781-dc96b2d90a5a/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 09:59:51.923640 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:51.923984 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:51.924129 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:51.986825 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb9e572-ba71-4a8c-b415-44c9e7ebec51/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:59:51.996945 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ad56cc-eb5b-4e2e-a421-e93deee27fe7/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:59:52.122769 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ad56cc-eb5b-4e2e-a421-e93deee27fe7/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:59:52.123550 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ad56cc-eb5b-4e2e-a421-e93deee27fe7/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:59:52.232252 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ad56cc-eb5b-4e2e-a421-e93deee27fe7/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:59:52.233063 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-7 (vdb) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 09:59:52.238117 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/289e2914-2be4-4f46-92e0-fa623f8db861/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:59:52.322559 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:59:52.349319 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/289e2914-2be4-4f46-92e0-fa623f8db861/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:59:52.352059 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-063798ca-3ac7-49cb-8962-43378759f877 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.644s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:52.353580 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/289e2914-2be4-4f46-92e0-fa623f8db861/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:59:52.382192 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 09:59:52.383768 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.startup = manual
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.port = 0
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 09:59:52.401491 np0000001613 nova-compute[98321]: # END RECORD
May 28 09:59:52.401491 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:52.414129 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:59:52.417752 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:59:52.418985 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.startup = manual
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.port = 0
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 09:59:52.420665 np0000001613 nova-compute[98321]: # END RECORD
May 28 09:59:52.420665 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:52.423054 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56491f38f2d1b03bde8194ae005695e5f6c664b6.part --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:59:52.443952 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:52.443952 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:52.443952 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:52.443952 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:52.443952 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:59:52.443952 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:52.443952 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:52.443952 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:52.443952 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:52.443952 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:59:52.446778 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:52.466674 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/289e2914-2be4-4f46-92e0-fa623f8db861/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:59:52.470610 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:52.470610 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:52.470610 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:52.470610 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:52.470610 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:59:52.471417 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:52.471417 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:52.471417 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:52.471417 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:52.471417 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:59:52.474754 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 09:59:52.480807 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:59:52.502836 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-063798ca-3ac7-49cb-8962-43378759f877 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Deleted allocations for instance 83f9ce5f-44cb-40c6-be1a-8d5134ee8902
May 28 09:59:52.512298 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399, portal: 192.168.40.100,3260]
May 28 09:59:52.512298 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399, portal: 192.168.40.100,3260] successful.
May 28 09:59:52.512298 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:52.522635 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399, portal: 192.168.50.100,3260]
May 28 09:59:52.522635 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399, portal: 192.168.50.100,3260] successful.
May 28 09:59:52.522635 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:52.531178 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:52.539044 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:52.544755 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56491f38f2d1b03bde8194ae005695e5f6c664b6.part --force-share --output=json" returned: 0 in 0.124s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:59:52.548307 np0000001613 nova-compute[98321]: DEBUG nova.virt.images [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] 3427ea11-12a6-4b25-8c73-769d29819fe0 was qcow2, converting to raw {{(pid=98321) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 09:59:52.548307 np0000001613 nova-compute[98321]: DEBUG nova.privsep.utils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98321) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 09:59:52.548307 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/56491f38f2d1b03bde8194ae005695e5f6c664b6.part /opt/stack/data/nova/instances/_base/56491f38f2d1b03bde8194ae005695e5f6c664b6.converted {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:59:52.567633 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:52.567633 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:52.567633 np0000001613 nova-compute[98321]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 09:59:52.567633 np0000001613 nova-compute[98321]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 09:59:52.567633 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:52.567633 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:52.567633 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:59:52.567917 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:52.567917 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:52.567917 np0000001613 nova-compute[98321]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 09:59:52.567917 np0000001613 nova-compute[98321]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 09:59:52.567917 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:52.567917 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:52.567917 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:59:52.569459 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:52.569459 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:52.569459 np0000001613 nova-compute[98321]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 09:59:52.569459 np0000001613 nova-compute[98321]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 09:59:52.569459 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:52.569459 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:52.569459 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:59:52.569794 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:52.569794 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:52.569794 np0000001613 nova-compute[98321]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 09:59:52.569794 np0000001613 nova-compute[98321]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 09:59:52.569794 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:52.569794 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:52.569794 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:59:52.570405 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.223s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:59:52.571483 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 09:59:52.575373 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.224s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:59:52.576456 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 09:59:52.578140 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] HCTL ('7', '-', '-', 0) found on session 25 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 09:59:52.578983 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 09:59:52.581600 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] HCTL ('8', '-', '-', 0) found on session 26 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 09:59:52.581600 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 09:59:52.595224 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:59:52.598726 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:59:52.616706 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Searching for a device in session 25 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 09:59:52.617039 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '258c61ac-673c-4b35-b2b5-182ee3432399', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 09:59:52.619067 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Searching for a device in session 26 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 09:59:52.619345 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '258c61ac-673c-4b35-b2b5-182ee3432399', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 09:59:52.713736 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:59:52.721151 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 09:59:52.725856 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:59:52.780726 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "env LANG=C uptime" returned: 0 in 0.055s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:59:52.780726 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Hypervisor/Node resource view: name=np0000001613 free_ram=13102MB free_disk=74.49630737304688GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 09:59:52.780726 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:52.781055 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:52.827930 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/56491f38f2d1b03bde8194ae005695e5f6c664b6.part /opt/stack/data/nova/instances/_base/56491f38f2d1b03bde8194ae005695e5f6c664b6.converted" returned: 0 in 0.280s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:59:52.834270 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56491f38f2d1b03bde8194ae005695e5f6c664b6.converted --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:59:52.943676 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56491f38f2d1b03bde8194ae005695e5f6c664b6.converted --force-share --output=json" returned: 0 in 0.109s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:59:52.944723 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "56491f38f2d1b03bde8194ae005695e5f6c664b6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.461s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:52.945495 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:59:52.952059 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:59:52.953139 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56491f38f2d1b03bde8194ae005695e5f6c664b6 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:59:53.060119 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56491f38f2d1b03bde8194ae005695e5f6c664b6 --force-share --output=json" returned: 0 in 0.106s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:59:53.061509 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "56491f38f2d1b03bde8194ae005695e5f6c664b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:53.061816 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "56491f38f2d1b03bde8194ae005695e5f6c664b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:53.062387 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:59:53.066142 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 09:59:53.066142 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56491f38f2d1b03bde8194ae005695e5f6c664b6 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:59:53.113965 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:53.164923 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "6895009a-024f-4919-9d25-a52905eac818" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:53.166559 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "6895009a-024f-4919-9d25-a52905eac818" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:53.169838 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56491f38f2d1b03bde8194ae005695e5f6c664b6 --force-share --output=json" returned: 0 in 0.103s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:59:53.173116 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/56491f38f2d1b03bde8194ae005695e5f6c664b6,backing_fmt=raw /opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:59:53.208556 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:53.233635 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/56491f38f2d1b03bde8194ae005695e5f6c664b6,backing_fmt=raw /opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924/disk 1073741824" returned: 0 in 0.060s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:59:53.234360 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "56491f38f2d1b03bde8194ae005695e5f6c664b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.172s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:53.234966 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56491f38f2d1b03bde8194ae005695e5f6c664b6 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:59:53.265887 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Updating instance_info_cache with network_info: [{"id": "8698560a-9cc7-4c98-ac7e-4430b67281c7", "address": "fa:16:3e:1e:81:86", "network": {"id": "b13d51a0-e043-42d6-a585-4e136f314ab6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1696131701-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "850a1b46c5954c54a488aa77569e6585", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8698560a-9c", "ovs_interfaceid": "8698560a-9cc7-4c98-ac7e-4430b67281c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:59:53.333769 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56491f38f2d1b03bde8194ae005695e5f6c664b6 --force-share --output=json" returned: 0 in 0.098s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:59:53.333769 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 09:59:53.333977 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:59:53.353809 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 09:59:53.446348 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:59:53.448823 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Cannot resize image /opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 09:59:53.448823 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 09:59:53.450942 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Ensure instance console log exists: /opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 09:59:53.450942 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:53.450942 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:53.450942 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:53.454134 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Start _get_guest_xml network_info=[{"id": "fec718e7-b773-4907-abf5-60f374bd420a", "address": "fa:16:3e:ae:54:17", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec718e7-b7", "ovs_interfaceid": "fec718e7-b773-4907-abf5-60f374bd420a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-28T09:55:05Z,direct_url=<?>,disk_format='qcow2',id=3427ea11-12a6-4b25-8c73-769d29819fe0,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-28T09:55:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3dad4779-d77b-4473-a132-d2e773ff8b9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'c9416092-d229-4f59-aaf3-3b0b692e7924', 'attached_at': '', 'detached_at': '', 'volume_id': '3dad4779-d77b-4473-a132-d2e773ff8b9d', 'serial': '3dad4779-d77b-4473-a132-d2e773ff8b9d'}, 'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': '243bfb9a-d61f-4d47-a585-c676bbb53883', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 09:59:53.459504 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
May 28 09:59:53.459966 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='3427ea11-12a6-4b25-8c73-769d29819fe0', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-590881060', uuid='c9416092-d229-4f59-aaf3-3b0b692e7924'), owner=OwnerMeta(userid='62efa57da85f458790f3ceeebcc777a7', username='tempest-ServerActionsTestOtherA-1557455944-project-member', projectid='cb3a501b4f4041ef875ef4d2b4167044', projectname='tempest-ServerActionsTestOtherA-1557455944'), image=ImageMeta(id='3427ea11-12a6-4b25-8c73-769d29819fe0', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fec718e7-b773-4907-abf5-60f374bd420a", "address": "fa:16:3e:ae:54:17", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec718e7-b7", "ovs_interfaceid": "fec718e7-b773-4907-abf5-60f374bd420a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962393.4594057) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 09:59:53.461544 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 09:59:53.462033 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 09:59:53.463909 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 09:59:53.464140 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 09:59:53.465575 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 09:59:53.465992 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-28T09:55:05Z,direct_url=<?>,disk_format='qcow2',id=3427ea11-12a6-4b25-8c73-769d29819fe0,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-28T09:55:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 09:59:53.466153 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 09:59:53.466274 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 09:59:53.466411 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 09:59:53.466497 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 09:59:53.466585 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 09:59:53.466813 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 09:59:53.466916 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 09:59:53.467030 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 09:59:53.467180 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 09:59:53.467363 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 09:59:53.467580 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lazy-loading 'vcpu_model' on Instance uuid c9416092-d229-4f59-aaf3-3b0b692e7924 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:59:53.526050 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-063798ca-3ac7-49cb-8962-43378759f877 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "83f9ce5f-44cb-40c6-be1a-8d5134ee8902" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.533s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:53.670726 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 09:59:53.770274 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Releasing lock "refresh_cache-5214df33-d3dc-4932-b781-dc96b2d90a5a" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:59:53.770714 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Instance network_info: |[{"id": "8698560a-9cc7-4c98-ac7e-4430b67281c7", "address": "fa:16:3e:1e:81:86", "network": {"id": "b13d51a0-e043-42d6-a585-4e136f314ab6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1696131701-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "850a1b46c5954c54a488aa77569e6585", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8698560a-9c", "ovs_interfaceid": "8698560a-9cc7-4c98-ac7e-4430b67281c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 09:59:53.771285 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-77512f65-17e1-442c-ac1b-af16b08bd1d7 req-33a5726b-d33a-4a20-9add-e4013f70e2fd service nova] Acquired lock "refresh_cache-5214df33-d3dc-4932-b781-dc96b2d90a5a" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 09:59:53.771580 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-77512f65-17e1-442c-ac1b-af16b08bd1d7 req-33a5726b-d33a-4a20-9add-e4013f70e2fd service nova] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Refreshing network info cache for port 8698560a-9cc7-4c98-ac7e-4430b67281c7 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 09:59:53.774696 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Start _get_guest_xml network_info=[{"id": "8698560a-9cc7-4c98-ac7e-4430b67281c7", "address": "fa:16:3e:1e:81:86", "network": {"id": "b13d51a0-e043-42d6-a585-4e136f314ab6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1696131701-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "850a1b46c5954c54a488aa77569e6585", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8698560a-9c", "ovs_interfaceid": "8698560a-9cc7-4c98-ac7e-4430b67281c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 09:59:53.776320 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 09:59:53.777397 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-VolumesAdminNegativeTest-server-1520224255', uuid='5214df33-d3dc-4932-b781-dc96b2d90a5a'), owner=OwnerMeta(userid='263f33d2831141c7b0b8eadbd8d9c315', username='tempest-VolumesAdminNegativeTest-1478180913-project-member', projectid='850a1b46c5954c54a488aa77569e6585', projectname='tempest-VolumesAdminNegativeTest-1478180913'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8698560a-9cc7-4c98-ac7e-4430b67281c7", "address": "fa:16:3e:1e:81:86", "network": {"id": "b13d51a0-e043-42d6-a585-4e136f314ab6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1696131701-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "850a1b46c5954c54a488aa77569e6585", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8698560a-9c", "ovs_interfaceid": "8698560a-9cc7-4c98-ac7e-4430b67281c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962393.7771044) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 09:59:53.779343 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 09:59:53.779343 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 09:59:53.783182 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 09:59:53.783182 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 09:59:53.783182 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 09:59:53.783182 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 09:59:53.783182 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 09:59:53.783182 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 09:59:53.783182 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 09:59:53.783182 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 09:59:53.783182 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 09:59:53.783182 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 09:59:53.783182 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 09:59:53.783182 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 09:59:53.783182 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 09:59:53.783182 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 09:59:53.808798 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T09:59:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1520224255',display_name='tempest-VolumesAdminNegativeTest-server-1520224255',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumesadminnegativetest-server-1520224255',id=15,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='850a1b46c5954c54a488aa77569e6585',ramdisk_id='',reservation_id='r-68w2umkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1478180913',owner_user_name='tempest-VolumesAdminNegativeTest-1478180913-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:59:50Z,user_data=None,user_id='263f33d2831141c7b0b8eadbd8d9c315',uuid=5214df33-d3dc-4932-b781-dc96b2d90a5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8698560a-9cc7-4c98-ac7e-4430b67281c7", "address": "fa:16:3e:1e:81:86", "network": {"id": "b13d51a0-e043-42d6-a585-4e136f314ab6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1696131701-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "850a1b46c5954c54a488aa77569e6585", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8698560a-9c", "ovs_interfaceid": "8698560a-9cc7-4c98-ac7e-4430b67281c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 09:59:53.809283 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Converting VIF {"id": "8698560a-9cc7-4c98-ac7e-4430b67281c7", "address": "fa:16:3e:1e:81:86", "network": {"id": "b13d51a0-e043-42d6-a585-4e136f314ab6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1696131701-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "850a1b46c5954c54a488aa77569e6585", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8698560a-9c", "ovs_interfaceid": "8698560a-9cc7-4c98-ac7e-4430b67281c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:59:53.810882 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:81:86,bridge_name='br-int',has_traffic_filtering=True,id=8698560a-9cc7-4c98-ac7e-4430b67281c7,network=Network(b13d51a0-e043-42d6-a585-4e136f314ab6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8698560a-9c') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:59:53.811297 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Lazy-loading 'pci_devices' on Instance uuid 5214df33-d3dc-4932-b781-dc96b2d90a5a {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:59:53.864644 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 289e2914-2be4-4f46-92e0-fa623f8db861 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 09:59:53.865017 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 09:59:53.865017 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 53ad56cc-eb5b-4e2e-a421-e93deee27fe7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 09:59:53.865736 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 57d353b6-133e-4354-a4f4-7bcec543d586 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 09:59:53.865736 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance c9416092-d229-4f59-aaf3-3b0b692e7924 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 09:59:53.865736 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance ceb9e572-ba71-4a8c-b415-44c9e7ebec51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 09:59:53.865736 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance ef3d846c-c539-41c5-ade2-1f93e7acc2ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 09:59:53.865736 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 5214df33-d3dc-4932-b781-dc96b2d90a5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 09:59:53.983180 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 09:59:53.983544 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3dad4779-d77b-4473-a132-d2e773ff8b9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 09:59:53.983722 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:59:54.222073 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:54.237865 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:54.275714 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-77512f65-17e1-442c-ac1b-af16b08bd1d7 req-33a5726b-d33a-4a20-9add-e4013f70e2fd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:59:54.315805 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] End _get_guest_xml xml=<domain type="qemu">
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:   <uuid>5214df33-d3dc-4932-b781-dc96b2d90a5a</uuid>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:   <name>instance-0000000f</name>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:   <metadata>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1520224255</nova:name>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 09:59:53</nova:creationTime>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:       </nova:image>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:         <nova:user uuid="263f33d2831141c7b0b8eadbd8d9c315">tempest-VolumesAdminNegativeTest-1478180913-project-member</nova:user>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:         <nova:project uuid="850a1b46c5954c54a488aa77569e6585">tempest-VolumesAdminNegativeTest-1478180913</nova:project>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:         <nova:port uuid="8698560a-9cc7-4c98-ac7e-4430b67281c7">
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:         </nova:port>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:   </metadata>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:     <system>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:       <entry name="serial">5214df33-d3dc-4932-b781-dc96b2d90a5a</entry>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:       <entry name="uuid">5214df33-d3dc-4932-b781-dc96b2d90a5a</entry>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:     </system>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:   <os>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:   </os>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:   <features>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:     <acpi/>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:     <tcg>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:     </tcg>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:   </features>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:   <devices>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/5214df33-d3dc-4932-b781-dc96b2d90a5a/disk"/>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:     </disk>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/5214df33-d3dc-4932-b781-dc96b2d90a5a/disk.config"/>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:     </disk>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:1e:81:86"/>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:       <target dev="tap8698560a-9c"/>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:     </interface>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/5214df33-d3dc-4932-b781-dc96b2d90a5a/console.log" append="off"/>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:     </serial>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:     <video>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:     </video>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:     </rng>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:     </memballoon>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:   </devices>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]: </domain>
May 28 09:59:54.315805 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 09:59:54.318020 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Preparing to wait for external event network-vif-plugged-8698560a-9cc7-4c98-ac7e-4430b67281c7 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 09:59:54.318020 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Acquiring lock "5214df33-d3dc-4932-b781-dc96b2d90a5a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:54.318020 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Lock "5214df33-d3dc-4932-b781-dc96b2d90a5a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:54.318020 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Lock "5214df33-d3dc-4932-b781-dc96b2d90a5a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:54.318020 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T09:59:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1520224255',display_name='tempest-VolumesAdminNegativeTest-server-1520224255',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumesadminnegativetest-server-1520224255',id=15,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='850a1b46c5954c54a488aa77569e6585',ramdisk_id='',reservation_id='r-68w2umkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1478180913',owner_user_name='tempest-VolumesAdminNegativeTest-1478180913-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:59:50Z,user_data=None,user_id='263f33d2831141c7b0b8eadbd8d9c315',uuid=5214df33-d3dc-4932-b781-dc96b2d90a5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8698560a-9cc7-4c98-ac7e-4430b67281c7", "address": "fa:16:3e:1e:81:86", "network": {"id": "b13d51a0-e043-42d6-a585-4e136f314ab6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1696131701-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "850a1b46c5954c54a488aa77569e6585", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8698560a-9c", "ovs_interfaceid": "8698560a-9cc7-4c98-ac7e-4430b67281c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 09:59:54.318020 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Converting VIF {"id": "8698560a-9cc7-4c98-ac7e-4430b67281c7", "address": "fa:16:3e:1e:81:86", "network": {"id": "b13d51a0-e043-42d6-a585-4e136f314ab6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1696131701-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "850a1b46c5954c54a488aa77569e6585", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8698560a-9c", "ovs_interfaceid": "8698560a-9cc7-4c98-ac7e-4430b67281c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:59:54.318020 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:81:86,bridge_name='br-int',has_traffic_filtering=True,id=8698560a-9cc7-4c98-ac7e-4430b67281c7,network=Network(b13d51a0-e043-42d6-a585-4e136f314ab6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8698560a-9c') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:59:54.318443 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:81:86,bridge_name='br-int',has_traffic_filtering=True,id=8698560a-9cc7-4c98-ac7e-4430b67281c7,network=Network(b13d51a0-e043-42d6-a585-4e136f314ab6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8698560a-9c') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 09:59:54.319104 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:54.319104 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:54.319337 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 09:59:54.320242 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:54.320413 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '87125d20-f237-5251-97df-95127d58e819', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:54.330207 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:54.330552 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:59:54.332821 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:54.334771 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8698560a-9c, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:54.334771 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8698560a-9c, col_values=(('qos', UUID('0e29af0d-8c9b-4262-a448-80509f111423')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:54.334771 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8698560a-9c, col_values=(('external_ids', {'iface-id': '8698560a-9cc7-4c98-ac7e-4430b67281c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:81:86', 'vm-uuid': '5214df33-d3dc-4932-b781-dc96b2d90a5a'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:54.335646 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:54.336894 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:59:54.342546 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:54.342870 np0000001613 nova-compute[98321]: INFO os_vif [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:81:86,bridge_name='br-int',has_traffic_filtering=True,id=8698560a-9cc7-4c98-ac7e-4430b67281c7,network=Network(b13d51a0-e043-42d6-a585-4e136f314ab6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8698560a-9c')
May 28 09:59:54.369507 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 6895009a-024f-4919-9d25-a52905eac818 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 28 09:59:54.369758 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 09:59:54.369906 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Final resource view: name=np0000001613 phys_ram=24030MB used_ram=2048MB phys_disk=95GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 09:59:52 up 32 min,  2 users,  load average: 8.49, 4.55, 2.09\n', 'num_instances': '8', 'num_vm_active': '6', 'num_task_None': '5', 'num_os_type_None': '8', 'num_proj_a9d04b105229456d9ab53df1886fdb37': '4', 'io_workload': '2', 'num_proj_cb3a501b4f4041ef875ef4d2b4167044': '2', 'num_proj_9a85ba31f98b45b6974118c6560bbc53': '1', 'num_task_rebuild_spawning': '1', 'num_vm_building': '2', 'num_task_spawning': '2', 'num_proj_850a1b46c5954c54a488aa77569e6585': '1'} {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 09:59:54.377363 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Found WWN 3300000006b5aa7c9 for multipath device dm-0 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 09:59:54.377363 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.046s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:59:54.377363 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] <== connect_volume: return (3046ms) {'type': 'block', 'scsi_wwn': '3300000006b5aa7c9', 'path': '/dev/dm-0', 'multipath_id': '3300000006b5aa7c9'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 09:59:54.377363 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006b5aa7c9', 'path': '/dev/dm-0', 'multipath_id': '3300000006b5aa7c9'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 09:59:54.377662 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.394s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:59:54.378141 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3dad4779-d77b-4473-a132-d2e773ff8b9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 09:59:54.392216 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:59:54.393172 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:59:54.393754 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:59:54.396320 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 09:59:54.397148 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:59:54.397764 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 09:59:54.416095 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 09:59:54.416095 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:54.422027 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 09:59:54.422027 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:54.434420 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d] added
May 28 09:59:54.434420 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 09:59:54.434420 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:59:54.434420 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:59:54.434420 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:59:54.434420 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:59:54.434420 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:54.434420 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 09:59:54.434420 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0391(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 09:59:54.434420 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 09:59:54.435250 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d] added
May 28 09:59:54.435250 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 09:59:54.435250 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:59:54.435250 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:59:54.435250 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 09:59:54.435250 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 09:59:54.435250 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:54.435469 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 09:59:54.435585 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.038(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 09:59:54.435722 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 09:59:54.885401 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T09:59:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1211585824',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serverbootfromvolumestablerescuetest-server-1211585824',id=14,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9d04b105229456d9ab53df1886fdb37',ramdisk_id='',reservation_id='r-iqn0w26d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-283762505',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:59:39Z,user_data=None,user_id='51981c995f2246588f2d58f35be5848a',uuid=ef3d846c-c539-41c5-ade2-1f93e7acc2ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "613dad87-2df3-4db7-a38f-adda943e8770", "address": "fa:16:3e:03:75:e0", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap613dad87-2d", "ovs_interfaceid": "613dad87-2df3-4db7-a38f-adda943e8770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 09:59:54.885907 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Converting VIF {"id": "613dad87-2df3-4db7-a38f-adda943e8770", "address": "fa:16:3e:03:75:e0", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap613dad87-2d", "ovs_interfaceid": "613dad87-2df3-4db7-a38f-adda943e8770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:59:54.886203 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:75:e0,bridge_name='br-int',has_traffic_filtering=True,id=613dad87-2df3-4db7-a38f-adda943e8770,network=Network(e5543f88-c716-4e02-82e9-2cb7570bf25e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap613dad87-2d') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:59:54.886893 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lazy-loading 'pci_devices' on Instance uuid ef3d846c-c539-41c5-ade2-1f93e7acc2ca {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:59:54.938885 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 09:59:54.939187 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 09:59:55.327104 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "53ad56cc-eb5b-4e2e-a421-e93deee27fe7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:55.327384 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "53ad56cc-eb5b-4e2e-a421-e93deee27fe7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:55.390132 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] End _get_guest_xml xml=<domain type="qemu">
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:   <uuid>ef3d846c-c539-41c5-ade2-1f93e7acc2ca</uuid>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:   <name>instance-0000000e</name>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:   <metadata>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1211585824</nova:name>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 09:59:51</nova:creationTime>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:       </nova:image>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:         <nova:user uuid="51981c995f2246588f2d58f35be5848a">tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member</nova:user>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:         <nova:project uuid="a9d04b105229456d9ab53df1886fdb37">tempest-ServerBootFromVolumeStableRescueTest-283762505</nova:project>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:         <nova:port uuid="613dad87-2df3-4db7-a38f-adda943e8770">
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:         </nova:port>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:   </metadata>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:     <system>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:       <entry name="serial">ef3d846c-c539-41c5-ade2-1f93e7acc2ca</entry>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:       <entry name="uuid">ef3d846c-c539-41c5-ade2-1f93e7acc2ca</entry>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:     </system>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:   <os>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:   </os>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:   <features>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:     <acpi/>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:     <tcg>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:     </tcg>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:   </features>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:   <devices>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/ef3d846c-c539-41c5-ade2-1f93e7acc2ca/disk.config"/>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:     </disk>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:       <alias name="ua-258c61ac-673c-4b35-b2b5-182ee3432399"/>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-0"/>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:       <serial>258c61ac-673c-4b35-b2b5-182ee3432399</serial>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:     </disk>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:03:75:e0"/>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:       <target dev="tap613dad87-2d"/>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:     </interface>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/ef3d846c-c539-41c5-ade2-1f93e7acc2ca/console.log" append="off"/>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:     </serial>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:     <video>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:     </video>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:     </rng>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:     </memballoon>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:   </devices>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]: </domain>
May 28 09:59:55.390132 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 09:59:55.391882 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Preparing to wait for external event network-vif-plugged-613dad87-2df3-4db7-a38f-adda943e8770 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 09:59:55.391882 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:55.391882 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:55.391882 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:55.391882 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T09:59:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1211585824',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serverbootfromvolumestablerescuetest-server-1211585824',id=14,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9d04b105229456d9ab53df1886fdb37',ramdisk_id='',reservation_id='r-iqn0w26d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-283762505',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:59:39Z,user_data=None,user_id='51981c995f2246588f2d58f35be5848a',uuid=ef3d846c-c539-41c5-ade2-1f93e7acc2ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "613dad87-2df3-4db7-a38f-adda943e8770", "address": "fa:16:3e:03:75:e0", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap613dad87-2d", "ovs_interfaceid": "613dad87-2df3-4db7-a38f-adda943e8770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 09:59:55.391882 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Converting VIF {"id": "613dad87-2df3-4db7-a38f-adda943e8770", "address": "fa:16:3e:03:75:e0", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap613dad87-2d", "ovs_interfaceid": "613dad87-2df3-4db7-a38f-adda943e8770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:59:55.392373 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:75:e0,bridge_name='br-int',has_traffic_filtering=True,id=613dad87-2df3-4db7-a38f-adda943e8770,network=Network(e5543f88-c716-4e02-82e9-2cb7570bf25e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap613dad87-2d') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:59:55.392630 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:75:e0,bridge_name='br-int',has_traffic_filtering=True,id=613dad87-2df3-4db7-a38f-adda943e8770,network=Network(e5543f88-c716-4e02-82e9-2cb7570bf25e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap613dad87-2d') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 09:59:55.393028 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:55.393310 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:55.393568 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 09:59:55.394379 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:55.394605 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b9eb94c8-4456-5ba5-8c8c-d9bff21a45c4', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:55.407094 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:55.407862 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:59:55.413117 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:55.415335 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:55.415506 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap613dad87-2d, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:55.415835 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap613dad87-2d, col_values=(('qos', UUID('434c3d66-1967-4fc2-9e7e-bcaa7ecdd276')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:55.415983 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap613dad87-2d, col_values=(('external_ids', {'iface-id': '613dad87-2df3-4db7-a38f-adda943e8770', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:75:e0', 'vm-uuid': 'ef3d846c-c539-41c5-ade2-1f93e7acc2ca'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:55.417211 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:55.418448 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:59:55.427955 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:55.429151 np0000001613 nova-compute[98321]: INFO os_vif [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:75:e0,bridge_name='br-int',has_traffic_filtering=True,id=613dad87-2df3-4db7-a38f-adda943e8770,network=Network(e5543f88-c716-4e02-82e9-2cb7570bf25e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap613dad87-2d')
May 28 09:59:55.433700 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 09:59:55.438376 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 09:59:55.442632 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.startup = manual
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.port = 0
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 09:59:55.449429 np0000001613 nova-compute[98321]: # END RECORD
May 28 09:59:55.449429 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.startup = manual
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.port = 0
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 09:59:55.451779 np0000001613 nova-compute[98321]: # END RECORD
May 28 09:59:55.451779 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:55.460910 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:55.466763 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:55.478829 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:55.478829 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:55.478829 np0000001613 nova-compute[98321]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 09:59:55.478829 np0000001613 nova-compute[98321]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 09:59:55.478829 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:55.478829 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:55.478829 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:59:55.479065 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:55.479065 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:55.479065 np0000001613 nova-compute[98321]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 09:59:55.479065 np0000001613 nova-compute[98321]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 09:59:55.479065 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:55.479065 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:55.479065 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:59:55.484941 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:55.484941 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:55.484941 np0000001613 nova-compute[98321]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 09:59:55.484941 np0000001613 nova-compute[98321]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 09:59:55.484941 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:55.484941 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:55.484941 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:59:55.485182 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:55.485182 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:55.485182 np0000001613 nova-compute[98321]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 09:59:55.485182 np0000001613 nova-compute[98321]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 09:59:55.485182 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:55.485182 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:55.485182 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:59:55.524830 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d, portal: 192.168.40.100,3260]
May 28 09:59:55.524830 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d, portal: 192.168.40.100,3260] successful.
May 28 09:59:55.524830 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:55.532663 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d, portal: 192.168.50.100,3260]
May 28 09:59:55.532663 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d, portal: 192.168.50.100,3260] successful.
May 28 09:59:55.532663 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:55.537032 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:55.546996 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:55.556774 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:55.556774 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:55.556774 np0000001613 nova-compute[98321]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 09:59:55.556774 np0000001613 nova-compute[98321]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 09:59:55.556774 np0000001613 nova-compute[98321]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 09:59:55.556774 np0000001613 nova-compute[98321]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 09:59:55.556774 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:55.556774 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:55.556774 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:59:55.557031 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:55.557031 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:55.557031 np0000001613 nova-compute[98321]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 09:59:55.557031 np0000001613 nova-compute[98321]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 09:59:55.557031 np0000001613 nova-compute[98321]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 09:59:55.557031 np0000001613 nova-compute[98321]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 09:59:55.557031 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:55.557031 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:55.557031 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:59:55.557250 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.164s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:59:55.557250 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 09:59:55.558145 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] HCTL ('11', '-', '-', 0) found on session 27 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 09:59:55.558274 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 09:59:55.566927 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:55.566927 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:55.566927 np0000001613 nova-compute[98321]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 09:59:55.566927 np0000001613 nova-compute[98321]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 09:59:55.566927 np0000001613 nova-compute[98321]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 09:59:55.566927 np0000001613 nova-compute[98321]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 09:59:55.566927 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:55.566927 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:55.566927 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:59:55.566927 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:55.566927 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:55.566927 np0000001613 nova-compute[98321]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 09:59:55.566927 np0000001613 nova-compute[98321]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 09:59:55.566927 np0000001613 nova-compute[98321]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 09:59:55.566927 np0000001613 nova-compute[98321]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 09:59:55.566927 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:55.566927 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:55.566927 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:59:55.566927 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.170s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:59:55.567482 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 09:59:55.567895 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] HCTL ('12', '-', '-', 0) found on session 28 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 09:59:55.568038 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 09:59:55.573073 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Searching for a device in session 27 and hctl ['11', '*', '*', 0] yield: None {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 09:59:55.584086 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Searching for a device in session 28 and hctl ['12', '*', '*', 0] yield: None {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 09:59:55.830022 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Detaching volume 08d8c7ce-386e-488e-a0f2-c61fdb5a686b
May 28 09:59:55.860554 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:59:55.860712 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:59:55.860833 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] No VIF found with MAC fa:16:3e:1e:81:86, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 09:59:55.861290 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Using config drive
May 28 09:59:55.887727 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Attempting to driver detach volume 08d8c7ce-386e-488e-a0f2-c61fdb5a686b from mountpoint /dev/vdb
May 28 09:59:55.897347 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Found disk vdb by alias ua-08d8c7ce-386e-488e-a0f2-c61fdb5a686b {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 09:59:55.899462 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Found disk vdb by alias ua-08d8c7ce-386e-488e-a0f2-c61fdb5a686b {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 09:59:55.899462 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Attempting to detach device vdb from instance 53ad56cc-eb5b-4e2e-a421-e93deee27fe7 from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 09:59:55.899462 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] detach device xml: <disk type="block" device="disk">
May 28 09:59:55.899462 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 09:59:55.899462 np0000001613 nova-compute[98321]:   <alias name="ua-08d8c7ce-386e-488e-a0f2-c61fdb5a686b"/>
May 28 09:59:55.899462 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-7"/>
May 28 09:59:55.899462 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 09:59:55.899462 np0000001613 nova-compute[98321]:   <serial>08d8c7ce-386e-488e-a0f2-c61fdb5a686b</serial>
May 28 09:59:55.899462 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 09:59:55.899462 np0000001613 nova-compute[98321]: </disk>
May 28 09:59:55.899462 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 09:59:55.909927 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Successfully detached device vdb from instance 53ad56cc-eb5b-4e2e-a421-e93deee27fe7 from the persistent domain config.
May 28 09:59:55.910073 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] (1/8): Attempting to detach device vdb with device alias ua-08d8c7ce-386e-488e-a0f2-c61fdb5a686b from instance 53ad56cc-eb5b-4e2e-a421-e93deee27fe7 from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 09:59:55.910390 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] detach device xml: <disk type="block" device="disk">
May 28 09:59:55.910390 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 09:59:55.910390 np0000001613 nova-compute[98321]:   <alias name="ua-08d8c7ce-386e-488e-a0f2-c61fdb5a686b"/>
May 28 09:59:55.910390 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-7"/>
May 28 09:59:55.910390 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 09:59:55.910390 np0000001613 nova-compute[98321]:   <serial>08d8c7ce-386e-488e-a0f2-c61fdb5a686b</serial>
May 28 09:59:55.910390 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 09:59:55.910390 np0000001613 nova-compute[98321]: </disk>
May 28 09:59:55.910390 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 09:59:55.951220 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Compute_service record updated for np0000001613:np0000001613 {{(pid=98321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 09:59:55.951378 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.170s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:55.951803 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.714s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:55.952524 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 09:59:55.961756 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 09:59:55.963238 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Claim successful on node np0000001613
May 28 09:59:55.990330 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:56.368413 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:59:56.402879 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-08d8c7ce-386e-488e-a0f2-c61fdb5a686b for instance 53ad56cc-eb5b-4e2e-a421-e93deee27fe7 {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 09:59:56.404373 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779962396.4035053, 53ad56cc-eb5b-4e2e-a421-e93deee27fe7 => ua-08d8c7ce-386e-488e-a0f2-c61fdb5a686b> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 09:59:56.413584 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Successfully detached device vdb from instance 53ad56cc-eb5b-4e2e-a421-e93deee27fe7 from the live domain config.
May 28 09:59:56.420266 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:56.421382 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 09:59:56.422141 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b', 'iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '08d8c7ce-386e-488e-a0f2-c61fdb5a686b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 09:59:56.422712 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 09:59:56.574017 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Searching for a device in session 27 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 09:59:56.574889 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3dad4779-d77b-4473-a132-d2e773ff8b9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 09:59:56.584662 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Searching for a device in session 28 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 09:59:56.584883 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3dad4779-d77b-4473-a132-d2e773ff8b9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 09:59:56.640643 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Creating config drive at /opt/stack/data/nova/instances/5214df33-d3dc-4932-b781-dc96b2d90a5a/disk.config
May 28 09:59:56.646408 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-77512f65-17e1-442c-ac1b-af16b08bd1d7 req-33a5726b-d33a-4a20-9add-e4013f70e2fd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:59:56.650520 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5214df33-d3dc-4932-b781-dc96b2d90a5a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2mmayksx {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:59:56.700773 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5214df33-d3dc-4932-b781-dc96b2d90a5a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2mmayksx" returned: 0 in 0.050s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:59:56.895442 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-77512f65-17e1-442c-ac1b-af16b08bd1d7 req-33a5726b-d33a-4a20-9add-e4013f70e2fd service nova] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Updated VIF entry in instance network info cache for port 8698560a-9cc7-4c98-ac7e-4430b67281c7. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 09:59:56.895963 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-77512f65-17e1-442c-ac1b-af16b08bd1d7 req-33a5726b-d33a-4a20-9add-e4013f70e2fd service nova] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Updating instance_info_cache with network_info: [{"id": "8698560a-9cc7-4c98-ac7e-4430b67281c7", "address": "fa:16:3e:1e:81:86", "network": {"id": "b13d51a0-e043-42d6-a585-4e136f314ab6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1696131701-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "850a1b46c5954c54a488aa77569e6585", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8698560a-9c", "ovs_interfaceid": "8698560a-9cc7-4c98-ac7e-4430b67281c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 09:59:56.951414 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:59:56.951615 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 09:59:56.951928 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] No VIF found with MAC fa:16:3e:03:75:e0, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 09:59:56.952564 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Using config drive
May 28 09:59:56.955230 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:59:56.955351 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 09:59:56.956148 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.83 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 09:59:57.196508 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:57.235848 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:57.325216 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:57.395271 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 09:59:57.399131 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-77512f65-17e1-442c-ac1b-af16b08bd1d7 req-33a5726b-d33a-4a20-9add-e4013f70e2fd service nova] Releasing lock "refresh_cache-5214df33-d3dc-4932-b781-dc96b2d90a5a" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 09:59:57.399516 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-77512f65-17e1-442c-ac1b-af16b08bd1d7 req-33a5726b-d33a-4a20-9add-e4013f70e2fd service nova] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Received event network-vif-unplugged-8698560a-9cc7-4c98-ac7e-4430b67281c7 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:57.399836 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-77512f65-17e1-442c-ac1b-af16b08bd1d7 req-33a5726b-d33a-4a20-9add-e4013f70e2fd service nova] Acquiring lock "5214df33-d3dc-4932-b781-dc96b2d90a5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:57.400085 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-77512f65-17e1-442c-ac1b-af16b08bd1d7 req-33a5726b-d33a-4a20-9add-e4013f70e2fd service nova] Lock "5214df33-d3dc-4932-b781-dc96b2d90a5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:57.400271 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-77512f65-17e1-442c-ac1b-af16b08bd1d7 req-33a5726b-d33a-4a20-9add-e4013f70e2fd service nova] Lock "5214df33-d3dc-4932-b781-dc96b2d90a5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:57.400404 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-77512f65-17e1-442c-ac1b-af16b08bd1d7 req-33a5726b-d33a-4a20-9add-e4013f70e2fd service nova] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] No event matching network-vif-unplugged-8698560a-9cc7-4c98-ac7e-4430b67281c7 in dict_keys([('network-vif-plugged', '8698560a-9cc7-4c98-ac7e-4430b67281c7')]) {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 09:59:57.400557 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-77512f65-17e1-442c-ac1b-af16b08bd1d7 req-33a5726b-d33a-4a20-9add-e4013f70e2fd service nova] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Received unexpected event network-vif-unplugged-8698560a-9cc7-4c98-ac7e-4430b67281c7 for instance with vm_state building and task_state spawning.
May 28 09:59:57.460869 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:59:57.544073 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 09:59:57.544482 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 09:59:57.586337 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:57.593418 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:57.599479 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:57.625899 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:57.633822 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:57.734255 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Creating config drive at /opt/stack/data/nova/instances/ef3d846c-c539-41c5-ade2-1f93e7acc2ca/disk.config
May 28 09:59:57.738524 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ef3d846c-c539-41c5-ade2-1f93e7acc2ca/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqm1dsx8s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 09:59:57.802208 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ef3d846c-c539-41c5-ade2-1f93e7acc2ca/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqm1dsx8s" returned: 0 in 0.063s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 09:59:58.048143 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 09:59:58.134104 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962398.1335855, 5214df33-d3dc-4932-b781-dc96b2d90a5a => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:59:58.134409 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] VM Started (Lifecycle Event)
May 28 09:59:58.271824 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:58.298859 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:58.301201 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:58.385104 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:58.413920 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Found WWN 330000000b29350f3 for multipath device dm-4 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 09:59:58.414531 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.037s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:59:58.415040 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] <== connect_volume: return (4431ms) {'type': 'block', 'scsi_wwn': '330000000b29350f3', 'path': '/dev/dm-4', 'multipath_id': '330000000b29350f3'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 09:59:58.415128 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b29350f3', 'path': '/dev/dm-4', 'multipath_id': '330000000b29350f3'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 09:59:58.415815 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.993s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 09:59:58.416271 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b', 'iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '08d8c7ce-386e-488e-a0f2-c61fdb5a686b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 09:59:58.416528 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 09:59:58.438908 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:58.439927 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:58.447219 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:58.447219 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:58.447219 np0000001613 nova-compute[98321]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 09:59:58.447219 np0000001613 nova-compute[98321]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 09:59:58.447219 np0000001613 nova-compute[98321]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 09:59:58.447219 np0000001613 nova-compute[98321]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 09:59:58.447219 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:58.447219 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:58.447219 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 09:59:58.447219 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:58.447219 np0000001613 nova-compute[98321]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b (non-flash)
May 28 09:59:58.447219 np0000001613 nova-compute[98321]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 09:59:58.447219 np0000001613 nova-compute[98321]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 09:59:58.447219 np0000001613 nova-compute[98321]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 09:59:58.447219 np0000001613 nova-compute[98321]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 09:59:58.447219 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:58.447219 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 09:59:58.447219 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 09:59:58.447896 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', '6')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 09:59:58.447896 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b', '13')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 09:59:58.449086 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b', '14')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 09:59:58.449986 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc20bec0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b'): ({'sdm'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 09:59:58.450251 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Removing multipathed devices sdl, sdm {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 09:59:58.450482 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Flush multipath device 3300000006f9c6bd4 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 09:59:58.486123 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 09:59:58.528345 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 09:59:58.557029 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.605s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:58.557381 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 09:59:58.576587 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Checking to see if SCSI volumes sdl, sdm have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 09:59:58.576815 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] SCSI volumes sdl, sdm have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 09:59:58.578720 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Checking to see if device paths {'sdl', 'sdm'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 09:59:58.594213 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Device paths {'sdl', 'sdm'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 09:59:58.594213 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 09:59:58.607760 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:58.619393 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Acquiring lock "6002d2d6-f312-48bf-9f07-7fcea8c5e52d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:58.619674 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Lock "6002d2d6-f312-48bf-9f07-7fcea8c5e52d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:58.637744 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:59:58.639430 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962398.6391807, 5214df33-d3dc-4932-b781-dc96b2d90a5a => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:59:58.639824 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] VM Paused (Lifecycle Event)
May 28 09:59:58.649870 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b, portal: 192.168.40.100,3260]
May 28 09:59:58.649870 np0000001613 nova-compute[98321]: Logout of [sid: 13, target: iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b, portal: 192.168.40.100,3260] successful.
May 28 09:59:58.649870 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:58.671024 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:58.682775 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:58.726618 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b, portal: 192.168.50.100,3260]
May 28 09:59:58.726618 np0000001613 nova-compute[98321]: Logout of [sid: 14, target: iqn.2023-03.storpool.com:os--volume-08d8c7ce-386e-488e-a0f2-c61fdb5a686b, portal: 192.168.50.100,3260] successful.
May 28 09:59:58.726618 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:58.744570 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 09:59:58.744831 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 09:59:58.744944 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] <== disconnect_volume: return (2322ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 09:59:58.745182 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 09:59:58.922987 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T09:58:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-108220691',display_name='tempest-ServerActionsTestOtherA-server-590881060',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-tempest-common-compute-instance-108220691',id=11,image_ref='3427ea11-12a6-4b25-8c73-769d29819fe0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdAbUj53uPVh2c6JmC0f4KuNc7XzB7W4qhLekRIZb4uQ1puOTl+iHN7nlIYOIwGJpx2OcUD9FRst/gQF9pX2F6kz8VeUkdxZMdxvvnrPL706aUB6jSV93natJMiSLTBtQ==',key_name='tempest-keypair-1688806139',keypairs=<?>,launch_index=0,launched_at=2026-05-28T09:58:52Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cb3a501b4f4041ef875ef4d2b4167044',ramdisk_id='',reservation_id='r-v17yjkz1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3427ea11-12a6-4b25-8c73-769d29819fe0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1557455944',owner_user_name='tempest-ServerActionsTestOtherA-1557455944-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:59:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62efa57da85f458790f3ceeebcc777a7',uuid=c9416092-d229-4f59-aaf3-3b0b692e7924,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fec718e7-b773-4907-abf5-60f374bd420a", "address": "fa:16:3e:ae:54:17", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec718e7-b7", "ovs_interfaceid": "fec718e7-b773-4907-abf5-60f374bd420a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 09:59:58.923251 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Converting VIF {"id": "fec718e7-b773-4907-abf5-60f374bd420a", "address": "fa:16:3e:ae:54:17", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec718e7-b7", "ovs_interfaceid": "fec718e7-b773-4907-abf5-60f374bd420a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:59:58.924430 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:54:17,bridge_name='br-int',has_traffic_filtering=True,id=fec718e7-b773-4907-abf5-60f374bd420a,network=Network(2ae47a43-582b-442f-922d-fe7138b431a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec718e7-b7') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:59:58.927362 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] End _get_guest_xml xml=<domain type="qemu">
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:   <uuid>c9416092-d229-4f59-aaf3-3b0b692e7924</uuid>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:   <name>instance-0000000b</name>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:   <metadata>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:       <nova:name>tempest-ServerActionsTestOtherA-server-590881060</nova:name>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 09:59:53</nova:creationTime>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:       <nova:image uuid="3427ea11-12a6-4b25-8c73-769d29819fe0">
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:       </nova:image>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:         <nova:user uuid="62efa57da85f458790f3ceeebcc777a7">tempest-ServerActionsTestOtherA-1557455944-project-member</nova:user>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:         <nova:project uuid="cb3a501b4f4041ef875ef4d2b4167044">tempest-ServerActionsTestOtherA-1557455944</nova:project>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="3427ea11-12a6-4b25-8c73-769d29819fe0"/>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:         <nova:port uuid="fec718e7-b773-4907-abf5-60f374bd420a">
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:         </nova:port>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:   </metadata>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:     <system>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:       <entry name="serial">c9416092-d229-4f59-aaf3-3b0b692e7924</entry>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:       <entry name="uuid">c9416092-d229-4f59-aaf3-3b0b692e7924</entry>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:     </system>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:   <os>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:   </os>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:   <features>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:     <acpi/>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:     <tcg>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:     </tcg>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:   </features>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:   </cpu>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:   <devices>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924/disk"/>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:     </disk>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924/disk.config"/>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:     </disk>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:       <alias name="ua-3dad4779-d77b-4473-a132-d2e773ff8b9d"/>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-4"/>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:       <target dev="vdb" bus="virtio"/>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:       <serial>3dad4779-d77b-4473-a132-d2e773ff8b9d</serial>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:     </disk>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:ae:54:17"/>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:       <target dev="tapfec718e7-b7"/>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:     </interface>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924/console.log" append="off"/>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:     </serial>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:     <video>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:     </video>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:     </rng>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:     </memballoon>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:   </devices>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]: </domain>
May 28 09:59:58.927362 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 09:59:58.930327 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T09:58:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-108220691',display_name='tempest-ServerActionsTestOtherA-server-590881060',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-tempest-common-compute-instance-108220691',id=11,image_ref='3427ea11-12a6-4b25-8c73-769d29819fe0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdAbUj53uPVh2c6JmC0f4KuNc7XzB7W4qhLekRIZb4uQ1puOTl+iHN7nlIYOIwGJpx2OcUD9FRst/gQF9pX2F6kz8VeUkdxZMdxvvnrPL706aUB6jSV93natJMiSLTBtQ==',key_name='tempest-keypair-1688806139',keypairs=<?>,launch_index=0,launched_at=2026-05-28T09:58:52Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cb3a501b4f4041ef875ef4d2b4167044',ramdisk_id='',reservation_id='r-v17yjkz1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3427ea11-12a6-4b25-8c73-769d29819fe0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1557455944',owner_user_name='tempest-ServerActionsTestOtherA-1557455944-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T09:59:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62efa57da85f458790f3ceeebcc777a7',uuid=c9416092-d229-4f59-aaf3-3b0b692e7924,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fec718e7-b773-4907-abf5-60f374bd420a", "address": "fa:16:3e:ae:54:17", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec718e7-b7", "ovs_interfaceid": "fec718e7-b773-4907-abf5-60f374bd420a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 09:59:58.930327 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Converting VIF {"id": "fec718e7-b773-4907-abf5-60f374bd420a", "address": "fa:16:3e:ae:54:17", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec718e7-b7", "ovs_interfaceid": "fec718e7-b773-4907-abf5-60f374bd420a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 09:59:58.930327 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:54:17,bridge_name='br-int',has_traffic_filtering=True,id=fec718e7-b773-4907-abf5-60f374bd420a,network=Network(2ae47a43-582b-442f-922d-fe7138b431a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec718e7-b7') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 09:59:58.930327 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:54:17,bridge_name='br-int',has_traffic_filtering=True,id=fec718e7-b773-4907-abf5-60f374bd420a,network=Network(2ae47a43-582b-442f-922d-fe7138b431a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec718e7-b7') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 09:59:58.932250 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:58.932250 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:58.932414 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 09:59:58.934873 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:58.934873 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0840deca-8296-5f8d-8d0a-755ff9bf12b1', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:58.936495 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:58.937928 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:59:58.940462 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:58.940717 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfec718e7-b7, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:58.941028 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfec718e7-b7, col_values=(('qos', UUID('21983718-6f14-4380-ad58-aed05e5e2a3f')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:58.941440 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfec718e7-b7, col_values=(('external_ids', {'iface-id': 'fec718e7-b773-4907-abf5-60f374bd420a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:54:17', 'vm-uuid': 'c9416092-d229-4f59-aaf3-3b0b692e7924'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 09:59:58.943715 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:58.944703 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 09:59:58.950564 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:58.951730 np0000001613 nova-compute[98321]: INFO os_vif [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:54:17,bridge_name='br-int',has_traffic_filtering=True,id=fec718e7-b773-4907-abf5-60f374bd420a,network=Network(2ae47a43-582b-442f-922d-fe7138b431a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec718e7-b7')
May 28 09:59:59.064093 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 09:59:59.064093 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 09:59:59.064552 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:59:59.064552 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 09:59:59.125516 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 09:59:59.142136 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 09:59:59.144408 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 09:59:59.182580 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13481913e22d4bf1a94e1a9a270f5494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3403b533910644d2b254922fb84b1ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 09:59:59.225402 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:59.298240 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lazy-loading 'flavor' on Instance uuid 53ad56cc-eb5b-4e2e-a421-e93deee27fe7 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 09:59:59.387092 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cd94428c-1412-4983-a02d-4181d70f0ddc req-39f57964-82eb-44a6-aaa1-b715415882a6 service nova] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Received event network-vif-plugged-8698560a-9cc7-4c98-ac7e-4430b67281c7 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 09:59:59.387547 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cd94428c-1412-4983-a02d-4181d70f0ddc req-39f57964-82eb-44a6-aaa1-b715415882a6 service nova] Acquiring lock "5214df33-d3dc-4932-b781-dc96b2d90a5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:59.387729 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cd94428c-1412-4983-a02d-4181d70f0ddc req-39f57964-82eb-44a6-aaa1-b715415882a6 service nova] Lock "5214df33-d3dc-4932-b781-dc96b2d90a5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:59.387886 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cd94428c-1412-4983-a02d-4181d70f0ddc req-39f57964-82eb-44a6-aaa1-b715415882a6 service nova] Lock "5214df33-d3dc-4932-b781-dc96b2d90a5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 09:59:59.388066 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cd94428c-1412-4983-a02d-4181d70f0ddc req-39f57964-82eb-44a6-aaa1-b715415882a6 service nova] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Processing event network-vif-plugged-8698560a-9cc7-4c98-ac7e-4430b67281c7 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 09:59:59.388463 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 09:59:59.392747 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 09:59:59.394004 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Instance spawned successfully.
May 28 09:59:59.394921 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 09:59:59.418657 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 09:59:59.567183 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 09:59:59.647357 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 09:59:59.647725 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962399.6474826, ef3d846c-c539-41c5-ade2-1f93e7acc2ca => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 09:59:59.647901 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] VM Started (Lifecycle Event)
May 28 09:59:59.700995 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 09:59:59.701946 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 09:59:59.706378 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 09:59:59.706605 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Claim successful on node np0000001613
May 28 09:59:59.712706 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Successfully created port: 8ec1ac70-71ab-4f36-93a8-fd51f9c08833 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 09:59:59.899364 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:59:59.899512 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:59:59.899802 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:59:59.900014 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:59:59.900276 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 09:59:59.900546 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:00.073525 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:00:00.151450 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:00.157928 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962400.1560016, ef3d846c-c539-41c5-ade2-1f93e7acc2ca => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:00:00.157928 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] VM Paused (Lifecycle Event)
May 28 10:00:00.305352 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-02edcf6a-f982-4041-9f17-03ec05715e39 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "53ad56cc-eb5b-4e2e-a421-e93deee27fe7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.977s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:00.406186 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Took 9.01 seconds to spawn the instance on the hypervisor.
May 28 10:00:00.406334 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:00.468473 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Successfully updated port: 8ec1ac70-71ab-4f36-93a8-fd51f9c08833 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:00:00.483463 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:00:00.483621 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:00:00.483772 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:00:00.483911 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] No VIF found with MAC fa:16:3e:ae:54:17, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:00:00.484443 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Using config drive
May 28 10:00:00.580431 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Booting with volume edc07b36-f6b6-4feb-855e-506d7efb58ee at /dev/vda
May 28 10:00:00.630399 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-59769649-b209-4653-9915-71761322a42b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "53ad56cc-eb5b-4e2e-a421-e93deee27fe7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:00.630802 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-59769649-b209-4653-9915-71761322a42b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "53ad56cc-eb5b-4e2e-a421-e93deee27fe7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:00.631106 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-59769649-b209-4653-9915-71761322a42b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "53ad56cc-eb5b-4e2e-a421-e93deee27fe7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:00.633982 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-59769649-b209-4653-9915-71761322a42b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "53ad56cc-eb5b-4e2e-a421-e93deee27fe7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:00.634540 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:00:00.634762 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-59769649-b209-4653-9915-71761322a42b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "53ad56cc-eb5b-4e2e-a421-e93deee27fe7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:00.640127 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-59769649-b209-4653-9915-71761322a42b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Terminating instance
May 28 10:00:00.649907 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:00:00.664630 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:00.667342 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:00:00.672621 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:00.723824 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:00:00.724294 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:00:00.732896 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:00:00.734486 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe95:8bd3', 'fe80::fc16:3eff:fe2d:94a4', 'fe80::fc16:3eff:fe31:5106', 'fe80::fc96:34ff:fe12:e4df', 'fe80::2844:59ff:feec:5d21', 'fe80::44e2:31ff:fe81:8771', 'fe80::fc16:3eff:fe7a:26b6', 'fe80::fc16:3eff:fe05:61f2', 'fe80::fc16:3eff:fe1e:8186', 'fe80::6826:21ff:fe0b:78d5', 'fe80::fc16:3eff:fe03:75e0'] 
May 28 10:00:00.734697 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:00:00.734805 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:00:00.735081 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] <== get_connector_properties: return (100ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:00:00.736595 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Updating existing volume attachment record: 600d8066-c1ca-477b-a03c-a34369322161 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:00:00.867606 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0004776990001573722 future=<Future at 0x73c1fc500710 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:00.867843 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:00.867907 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=0.5951956529997915 future=<Future at 0x73c1fc1ce090 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:00.867984 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=0.5950945539998429 future=<Future at 0x73c1fc1ce090 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:00.868678 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Emitting event <LifecycleEvent: 1779962385.8670084, 83f9ce5f-44cb-40c6-be1a-8d5134ee8902 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:00:00.868763 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] VM Stopped (Lifecycle Event)
May 28 10:00:00.920183 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Took 14.82 seconds to build instance.
May 28 10:00:00.951409 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c2b76a30-b8b5-4cd4-8834-4109f6bbc105 req-00c786c6-5244-4b30-a1ad-da152c62ff0f service nova] [instance: 6895009a-024f-4919-9d25-a52905eac818] Received event network-changed-8ec1ac70-71ab-4f36-93a8-fd51f9c08833 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:00.951569 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c2b76a30-b8b5-4cd4-8834-4109f6bbc105 req-00c786c6-5244-4b30-a1ad-da152c62ff0f service nova] [instance: 6895009a-024f-4919-9d25-a52905eac818] Refreshing instance network info cache due to event network-changed-8ec1ac70-71ab-4f36-93a8-fd51f9c08833. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:00:00.951784 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c2b76a30-b8b5-4cd4-8834-4109f6bbc105 req-00c786c6-5244-4b30-a1ad-da152c62ff0f service nova] Acquiring lock "refresh_cache-6895009a-024f-4919-9d25-a52905eac818" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:00:00.953326 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c2b76a30-b8b5-4cd4-8834-4109f6bbc105 req-00c786c6-5244-4b30-a1ad-da152c62ff0f service nova] Acquired lock "refresh_cache-6895009a-024f-4919-9d25-a52905eac818" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:00:00.954868 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-c2b76a30-b8b5-4cd4-8834-4109f6bbc105 req-00c786c6-5244-4b30-a1ad-da152c62ff0f service nova] [instance: 6895009a-024f-4919-9d25-a52905eac818] Refreshing network info cache for port 8ec1ac70-71ab-4f36-93a8-fd51f9c08833 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:00:00.970665 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "refresh_cache-6895009a-024f-4919-9d25-a52905eac818" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:00:00.989299 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lazy-loading 'ec2_ids' on Instance uuid c9416092-d229-4f59-aaf3-3b0b692e7924 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:00:01.145145 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-59769649-b209-4653-9915-71761322a42b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:00:01.174272 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:00:01.174951 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962401.174675, 5214df33-d3dc-4932-b781-dc96b2d90a5a => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:00:01.175194 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] VM Resumed (Lifecycle Event)
May 28 10:00:01.177192 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:01.200183 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:01.212891 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:01.244532 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:01.245724 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:01.373318 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 83f9ce5f-44cb-40c6-be1a-8d5134ee8902] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:01.420441 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Lock "5214df33-d3dc-4932-b781-dc96b2d90a5a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.327s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:01.453258 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:00:01.453934 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:00:01.460572 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-c2b76a30-b8b5-4cd4-8834-4109f6bbc105 req-00c786c6-5244-4b30-a1ad-da152c62ff0f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:01.465116 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0008435600000211707 future=<Future at 0x73c1fc1ce090 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:01.465116 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:01.465116 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1779962386.4630136, c9416092-d229-4f59-aaf3-3b0b692e7924 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:00:01.465116 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] VM Stopped (Lifecycle Event)
May 28 10:00:01.492688 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Object Instance<c9416092-d229-4f59-aaf3-3b0b692e7924> lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:00:01.495573 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lazy-loading 'keypairs' on Instance uuid c9416092-d229-4f59-aaf3-3b0b692e7924 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:00:01.520730 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-807e6d79-634a-4b80-b6ce-58a522dec045 req-b35674b1-b3e6-4b9e-a5be-65584accb815 service nova] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Received event network-vif-plugged-8698560a-9cc7-4c98-ac7e-4430b67281c7 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:01.521089 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-807e6d79-634a-4b80-b6ce-58a522dec045 req-b35674b1-b3e6-4b9e-a5be-65584accb815 service nova] Acquiring lock "5214df33-d3dc-4932-b781-dc96b2d90a5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:01.521273 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-807e6d79-634a-4b80-b6ce-58a522dec045 req-b35674b1-b3e6-4b9e-a5be-65584accb815 service nova] Lock "5214df33-d3dc-4932-b781-dc96b2d90a5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:01.521446 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-807e6d79-634a-4b80-b6ce-58a522dec045 req-b35674b1-b3e6-4b9e-a5be-65584accb815 service nova] Lock "5214df33-d3dc-4932-b781-dc96b2d90a5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:01.521637 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-807e6d79-634a-4b80-b6ce-58a522dec045 req-b35674b1-b3e6-4b9e-a5be-65584accb815 service nova] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] No waiting events found dispatching network-vif-plugged-8698560a-9cc7-4c98-ac7e-4430b67281c7 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:00:01.521830 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-807e6d79-634a-4b80-b6ce-58a522dec045 req-b35674b1-b3e6-4b9e-a5be-65584accb815 service nova] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Received unexpected event network-vif-plugged-8698560a-9cc7-4c98-ac7e-4430b67281c7 for instance with vm_state active and task_state None.
May 28 10:00:01.522398 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-807e6d79-634a-4b80-b6ce-58a522dec045 req-b35674b1-b3e6-4b9e-a5be-65584accb815 service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Received event network-vif-plugged-613dad87-2df3-4db7-a38f-adda943e8770 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:01.522398 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-807e6d79-634a-4b80-b6ce-58a522dec045 req-b35674b1-b3e6-4b9e-a5be-65584accb815 service nova] Acquiring lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:01.531518 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-807e6d79-634a-4b80-b6ce-58a522dec045 req-b35674b1-b3e6-4b9e-a5be-65584accb815 service nova] Lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:01.531518 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-807e6d79-634a-4b80-b6ce-58a522dec045 req-b35674b1-b3e6-4b9e-a5be-65584accb815 service nova] Lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:01.531518 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-807e6d79-634a-4b80-b6ce-58a522dec045 req-b35674b1-b3e6-4b9e-a5be-65584accb815 service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Processing event network-vif-plugged-613dad87-2df3-4db7-a38f-adda943e8770 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:00:01.531518 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-807e6d79-634a-4b80-b6ce-58a522dec045 req-b35674b1-b3e6-4b9e-a5be-65584accb815 service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Received event network-vif-plugged-613dad87-2df3-4db7-a38f-adda943e8770 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:01.531518 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-807e6d79-634a-4b80-b6ce-58a522dec045 req-b35674b1-b3e6-4b9e-a5be-65584accb815 service nova] Acquiring lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:01.531518 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-807e6d79-634a-4b80-b6ce-58a522dec045 req-b35674b1-b3e6-4b9e-a5be-65584accb815 service nova] Lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:01.531518 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-807e6d79-634a-4b80-b6ce-58a522dec045 req-b35674b1-b3e6-4b9e-a5be-65584accb815 service nova] Lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:01.531518 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-807e6d79-634a-4b80-b6ce-58a522dec045 req-b35674b1-b3e6-4b9e-a5be-65584accb815 service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] No waiting events found dispatching network-vif-plugged-613dad87-2df3-4db7-a38f-adda943e8770 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:00:01.531518 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-807e6d79-634a-4b80-b6ce-58a522dec045 req-b35674b1-b3e6-4b9e-a5be-65584accb815 service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Received unexpected event network-vif-plugged-613dad87-2df3-4db7-a38f-adda943e8770 for instance with vm_state building and task_state spawning.
May 28 10:00:01.531518 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:00:01.548694 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:00:01.568737 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Instance destroyed successfully.
May 28 10:00:01.568737 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-59769649-b209-4653-9915-71761322a42b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lazy-loading 'resources' on Instance uuid 53ad56cc-eb5b-4e2e-a421-e93deee27fe7 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:00:01.568737 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Instance spawned successfully.
May 28 10:00:01.573967 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:00:01.649273 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-c2b76a30-b8b5-4cd4-8834-4109f6bbc105 req-00c786c6-5244-4b30-a1ad-da152c62ff0f service nova] [instance: 6895009a-024f-4919-9d25-a52905eac818] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:00:01.690567 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:01.701122 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:00:01.963434 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:00:01.977709 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2f76a4a4-5d9f-4e5a-8501-f56688d34553 None None] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:02.000296 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Object Instance<c9416092-d229-4f59-aaf3-3b0b692e7924> lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:00:02.017833 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError
May 28 10:00:02.025776 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2f76a4a4-5d9f-4e5a-8501-f56688d34553 None None] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 4 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:00:02.069845 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-59769649-b209-4653-9915-71761322a42b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:57:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1127018178',display_name='tempest-AttachVolumeNegativeTest-server-1127018178',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumenegativetest-server-1127018178',id=3,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfEzrDpvX+Cb2A6iydtPeqQcs6tszqFfpe/AtRnOqrfv3UKFlvb/KatCH68AhguXf+mQ6BwGWMYvWwY1uYAw+uDeebadCiScBpQV03iDWD+z1toHUEYkgrxcdsvJhm01w==',key_name='tempest-keypair-618860882',keypairs=<?>,launch_index=0,launched_at=2026-05-28T09:57:55Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a85ba31f98b45b6974118c6560bbc53',ramdisk_id='',reservation_id='r-suklovqv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-775348461',owner_user_name='tempest-AttachVolumeNegativeTest-775348461-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T09:57:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9297977bbf334232a4a74bd6808b863b',uuid=53ad56cc-eb5b-4e2e-a421-e93deee27fe7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7be666db-db21-439b-958d-3721cb9c4fdd", "address": "fa:16:3e:31:51:06", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be666db-db", "ovs_interfaceid": "7be666db-db21-439b-958d-3721cb9c4fdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:00:02.070411 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-59769649-b209-4653-9915-71761322a42b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Converting VIF {"id": "7be666db-db21-439b-958d-3721cb9c4fdd", "address": "fa:16:3e:31:51:06", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be666db-db", "ovs_interfaceid": "7be666db-db21-439b-958d-3721cb9c4fdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:00:02.071839 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-59769649-b209-4653-9915-71761322a42b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:51:06,bridge_name='br-int',has_traffic_filtering=True,id=7be666db-db21-439b-958d-3721cb9c4fdd,network=Network(bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be666db-db') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:00:02.073922 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-59769649-b209-4653-9915-71761322a42b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:51:06,bridge_name='br-int',has_traffic_filtering=True,id=7be666db-db21-439b-958d-3721cb9c4fdd,network=Network(bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be666db-db') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:00:02.080599 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:02.081040 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7be666db-db, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:02.090209 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:02.094367 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:00:02.098137 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:02.098440 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:02.099533 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:02.101536 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:02.102615 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:02.103131 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:02.103566 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:02.110783 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:02.111309 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=34841b20-6ce4-48d5-82d8-7d330f7e0a4d) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:02.113642 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:02.113642 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:00:02.123222 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:02.128687 np0000001613 nova-compute[98321]: INFO os_vif [None req-59769649-b209-4653-9915-71761322a42b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:51:06,bridge_name='br-int',has_traffic_filtering=True,id=7be666db-db21-439b-958d-3721cb9c4fdd,network=Network(bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be666db-db')
May 28 10:00:02.129701 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-59769649-b209-4653-9915-71761322a42b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Deleting instance files /opt/stack/data/nova/instances/53ad56cc-eb5b-4e2e-a421-e93deee27fe7_del
May 28 10:00:02.130385 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-59769649-b209-4653-9915-71761322a42b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Deletion of /opt/stack/data/nova/instances/53ad56cc-eb5b-4e2e-a421-e93deee27fe7_del complete
May 28 10:00:02.206360 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999257177000118 future=<Future at 0x73c1fc328500 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:02.206360 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962402.2055283, ef3d846c-c539-41c5-ade2-1f93e7acc2ca => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:00:02.206360 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] VM Resumed (Lifecycle Event)
May 28 10:00:02.207508 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.997393840000086 future=<Future at 0x73c1fc328500 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:02.207508 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.997069455999963 future=<Future at 0x73c1fc328500 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:02.229944 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-c2b76a30-b8b5-4cd4-8834-4109f6bbc105 req-00c786c6-5244-4b30-a1ad-da152c62ff0f service nova] [instance: 6895009a-024f-4919-9d25-a52905eac818] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:00:02.525786 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.824s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:02.527026 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:00:02.537484 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-2f76a4a4-5d9f-4e5a-8501-f56688d34553 None None] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
May 28 10:00:02.608248 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Creating config drive at /opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924/disk.config
May 28 10:00:02.614268 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Took 11.32 seconds to spawn the instance on the hypervisor.
May 28 10:00:02.614268 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:02.618464 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpoz4s3dyl {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:02.651741 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-59769649-b209-4653-9915-71761322a42b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Took 1.51 seconds to destroy the instance on the hypervisor.
May 28 10:00:02.653582 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-59769649-b209-4653-9915-71761322a42b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:00:02.655445 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:00:02.655683 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:00:02.656438 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:02.686065 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpoz4s3dyl" returned: 0 in 0.067s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:02.709483 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:02.719078 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:00:02.735694 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c2b76a30-b8b5-4cd4-8834-4109f6bbc105 req-00c786c6-5244-4b30-a1ad-da152c62ff0f service nova] Releasing lock "refresh_cache-6895009a-024f-4919-9d25-a52905eac818" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:00:02.737945 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquired lock "refresh_cache-6895009a-024f-4919-9d25-a52905eac818" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:00:02.737945 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:00:02.821489 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:02.875611 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:03.041061 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:00:03.041418 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:00:03.041691 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:03.041897 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:03.069250 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:00:03.072316 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:00:03.073097 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Creating image(s)
May 28 10:00:03.073543 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Did not create local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 10:00:03.074023 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Ensure instance console log exists: /opt/stack/data/nova/instances/6895009a-024f-4919-9d25-a52905eac818/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:00:03.074239 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:03.074596 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:03.074808 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:03.157975 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Took 28.65 seconds to build instance.
May 28 10:00:03.238982 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:03.262811 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:03.263251 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:03.389071 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:03.442946 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e96e96039e43475a8bbea8acb05d67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0098401beaa4ad0967c1b5cfc2f61f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:00:03.455954 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:03.477802 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:00:03.544240 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:00:03.660311 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a06b31af-242d-4332-8b75-48ec921bdf8c tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.172s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:03.728558 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:04.052238 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:00:04.226482 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:04.317705 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962404.3172882, c9416092-d229-4f59-aaf3-3b0b692e7924 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:00:04.318268 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] VM Resumed (Lifecycle Event)
May 28 10:00:04.320064 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Instance event wait completed in 0 seconds for  {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:00:04.322963 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:00:04.325819 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Instance spawned successfully.
May 28 10:00:04.328067 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:00:04.467250 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Successfully created port: 191c304c-b4ad-4084-9d48-b5dab07b9e5c {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:00:04.685531 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:00:04.755509 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-92544e08-7cc7-4e66-ab5e-0feb097dfe11 req-f6287ab4-7327-44a9-bd9f-c819546d3bfd service nova] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Received event network-vif-plugged-fec718e7-b773-4907-abf5-60f374bd420a {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:04.755698 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-92544e08-7cc7-4e66-ab5e-0feb097dfe11 req-f6287ab4-7327-44a9-bd9f-c819546d3bfd service nova] Acquiring lock "c9416092-d229-4f59-aaf3-3b0b692e7924-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:04.755842 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-92544e08-7cc7-4e66-ab5e-0feb097dfe11 req-f6287ab4-7327-44a9-bd9f-c819546d3bfd service nova] Lock "c9416092-d229-4f59-aaf3-3b0b692e7924-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:04.755943 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-92544e08-7cc7-4e66-ab5e-0feb097dfe11 req-f6287ab4-7327-44a9-bd9f-c819546d3bfd service nova] Lock "c9416092-d229-4f59-aaf3-3b0b692e7924-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:04.756065 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-92544e08-7cc7-4e66-ab5e-0feb097dfe11 req-f6287ab4-7327-44a9-bd9f-c819546d3bfd service nova] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] No waiting events found dispatching network-vif-plugged-fec718e7-b773-4907-abf5-60f374bd420a {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:00:04.756173 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-92544e08-7cc7-4e66-ab5e-0feb097dfe11 req-f6287ab4-7327-44a9-bd9f-c819546d3bfd service nova] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Received unexpected event network-vif-plugged-fec718e7-b773-4907-abf5-60f374bd420a for instance with vm_state active and task_state rebuild_spawning.
May 28 10:00:04.826696 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:04.829129 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:00:04.845868 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:04.846886 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:04.847516 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:04.847878 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:04.850005 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:04.850005 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:04.883386 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-39626ed4-1406-4965-9031-b7fc90abfa5a req-fd4627b5-5222-4c13-9dfe-973a305b161f service nova] [instance: 6895009a-024f-4919-9d25-a52905eac818] Received event network-vif-unplugged-8ec1ac70-71ab-4f36-93a8-fd51f9c08833 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:04.883630 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-39626ed4-1406-4965-9031-b7fc90abfa5a req-fd4627b5-5222-4c13-9dfe-973a305b161f service nova] Acquiring lock "6895009a-024f-4919-9d25-a52905eac818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:04.884394 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-39626ed4-1406-4965-9031-b7fc90abfa5a req-fd4627b5-5222-4c13-9dfe-973a305b161f service nova] Lock "6895009a-024f-4919-9d25-a52905eac818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:04.884884 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-39626ed4-1406-4965-9031-b7fc90abfa5a req-fd4627b5-5222-4c13-9dfe-973a305b161f service nova] Lock "6895009a-024f-4919-9d25-a52905eac818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:04.886573 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-39626ed4-1406-4965-9031-b7fc90abfa5a req-fd4627b5-5222-4c13-9dfe-973a305b161f service nova] [instance: 6895009a-024f-4919-9d25-a52905eac818] No waiting events found dispatching network-vif-unplugged-8ec1ac70-71ab-4f36-93a8-fd51f9c08833 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:00:04.886767 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-39626ed4-1406-4965-9031-b7fc90abfa5a req-fd4627b5-5222-4c13-9dfe-973a305b161f service nova] [instance: 6895009a-024f-4919-9d25-a52905eac818] Received unexpected event network-vif-unplugged-8ec1ac70-71ab-4f36-93a8-fd51f9c08833 for instance with vm_state building and task_state spawning.
May 28 10:00:05.009733 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:05.063596 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:00:05.064682 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:00:05.064987 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Creating image(s)
May 28 10:00:05.068088 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Acquiring lock "/opt/stack/data/nova/instances/6002d2d6-f312-48bf-9f07-7fcea8c5e52d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:05.068335 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Lock "/opt/stack/data/nova/instances/6002d2d6-f312-48bf-9f07-7fcea8c5e52d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:05.068888 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Lock "/opt/stack/data/nova/instances/6002d2d6-f312-48bf-9f07-7fcea8c5e52d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:05.079860 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:00:05.079860 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:00:05.079860 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:05.188339 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.112s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:05.191085 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Took 2.53 seconds to deallocate network for instance.
May 28 10:00:05.191575 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:05.194385 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:05.195849 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:00:05.199534 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:00:05.200067 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:05.308522 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.108s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:05.309198 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/6002d2d6-f312-48bf-9f07-7fcea8c5e52d/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:05.335033 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
May 28 10:00:05.335656 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962405.3353186, c9416092-d229-4f59-aaf3-3b0b692e7924 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:00:05.335852 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] VM Started (Lifecycle Event)
May 28 10:00:05.343781 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4c730413-48a8-4f57-8e08-e82c2db3a5a5 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Acquiring lock "5214df33-d3dc-4932-b781-dc96b2d90a5a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:05.344077 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4c730413-48a8-4f57-8e08-e82c2db3a5a5 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Lock "5214df33-d3dc-4932-b781-dc96b2d90a5a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:05.344346 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4c730413-48a8-4f57-8e08-e82c2db3a5a5 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Acquiring lock "5214df33-d3dc-4932-b781-dc96b2d90a5a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:05.345011 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4c730413-48a8-4f57-8e08-e82c2db3a5a5 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Lock "5214df33-d3dc-4932-b781-dc96b2d90a5a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:05.345011 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4c730413-48a8-4f57-8e08-e82c2db3a5a5 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Lock "5214df33-d3dc-4932-b781-dc96b2d90a5a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:05.351698 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-4c730413-48a8-4f57-8e08-e82c2db3a5a5 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Terminating instance
May 28 10:00:05.356397 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:05.380593 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/6002d2d6-f312-48bf-9f07-7fcea8c5e52d/disk 1073741824" returned: 0 in 0.071s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:05.381024 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:05.381404 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:05.427104 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Successfully updated port: 191c304c-b4ad-4084-9d48-b5dab07b9e5c {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:00:05.444129 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:05.489432 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.108s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:05.489803 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6002d2d6-f312-48bf-9f07-7fcea8c5e52d/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:00:05.490058 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6002d2d6-f312-48bf-9f07-7fcea8c5e52d/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:05.575932 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6002d2d6-f312-48bf-9f07-7fcea8c5e52d/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:05.576640 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Cannot resize image /opt/stack/data/nova/instances/6002d2d6-f312-48bf-9f07-7fcea8c5e52d/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:00:05.577254 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:00:05.577536 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Ensure instance console log exists: /opt/stack/data/nova/instances/6002d2d6-f312-48bf-9f07-7fcea8c5e52d/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:00:05.577924 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:05.578242 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:05.578463 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:05.729005 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-59769649-b209-4653-9915-71761322a42b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:05.729558 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-59769649-b209-4653-9915-71761322a42b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:05.841870 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:05.846212 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:00:05.865089 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-4c730413-48a8-4f57-8e08-e82c2db3a5a5 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:00:05.885617 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:05.908703 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:05.915816 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:05.930946 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Acquiring lock "refresh_cache-6002d2d6-f312-48bf-9f07-7fcea8c5e52d" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:00:05.930946 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Acquired lock "refresh_cache-6002d2d6-f312-48bf-9f07-7fcea8c5e52d" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:00:05.930946 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:00:05.935936 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:05.944256 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:05.967324 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:05.997009 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Updating instance_info_cache with network_info: [{"id": "8ec1ac70-71ab-4f36-93a8-fd51f9c08833", "address": "fa:16:3e:fd:30:e7", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ec1ac70-71", "ovs_interfaceid": "8ec1ac70-71ab-4f36-93a8-fd51f9c08833", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:00:06.005604 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-59769649-b209-4653-9915-71761322a42b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Refreshing inventories for resource provider ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 28 10:00:06.077689 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-59769649-b209-4653-9915-71761322a42b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Updating ProviderTree inventory for provider ad4de091-3626-4008-ac9a-3e83de44a510 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 28 10:00:06.078073 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-59769649-b209-4653-9915-71761322a42b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Updating inventory in ProviderTree for provider ad4de091-3626-4008-ac9a-3e83de44a510 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 28 10:00:06.142628 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-59769649-b209-4653-9915-71761322a42b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Refreshing aggregate associations for resource provider ad4de091-3626-4008-ac9a-3e83de44a510, aggregates: None {{(pid=98321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 28 10:00:06.231853 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-59769649-b209-4653-9915-71761322a42b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Refreshing trait associations for resource provider ad4de091-3626-4008-ac9a-3e83de44a510, traits: COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ARCH_PPC64LE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ARCH_RISCV64,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_ARCH_S390X,COMPUTE_VOLUME_EXTEND,COMPUTE_ARCH_AARCH64,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOUND_MODEL_SB16,COMPUTE_ACCELERATORS,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_SOUND_MODEL_AC97,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_ARCH_MIPSEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_LAN9118,HW_ARCH_X86_64,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ARCH_X86_64,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOUND_MODEL_USB,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=98321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 28 10:00:06.232933 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:06.242758 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:06.260731 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Instance destroyed successfully.
May 28 10:00:06.261561 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-4c730413-48a8-4f57-8e08-e82c2db3a5a5 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Lazy-loading 'resources' on Instance uuid 5214df33-d3dc-4932-b781-dc96b2d90a5a {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:00:06.350016 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999760194000146 future=<Future at 0x73c1ffedd760 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:06.500684 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Releasing lock "refresh_cache-6895009a-024f-4919-9d25-a52905eac818" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:00:06.501094 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Instance network_info: |[{"id": "8ec1ac70-71ab-4f36-93a8-fd51f9c08833", "address": "fa:16:3e:fd:30:e7", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ec1ac70-71", "ovs_interfaceid": "8ec1ac70-71ab-4f36-93a8-fd51f9c08833", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:00:06.503070 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Start _get_guest_xml network_info=[{"id": "8ec1ac70-71ab-4f36-93a8-fd51f9c08833", "address": "fa:16:3e:fd:30:e7", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ec1ac70-71", "ovs_interfaceid": "8ec1ac70-71ab-4f36-93a8-fd51f9c08833", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'edc07b36-f6b6-4feb-855e-506d7efb58ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '6895009a-024f-4919-9d25-a52905eac818', 'attached_at': '', 'detached_at': '', 'volume_id': 'edc07b36-f6b6-4feb-855e-506d7efb58ee', 'serial': 'edc07b36-f6b6-4feb-855e-506d7efb58ee', 'multiattach': True}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '600d8066-c1ca-477b-a03c-a34369322161', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:00:06.505689 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:00:06.507860 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-329318184', uuid='6895009a-024f-4919-9d25-a52905eac818'), owner=OwnerMeta(userid='13481913e22d4bf1a94e1a9a270f5494', username='tempest-AttachVolumeMultiAttachTest-1052626787-project-member', projectid='3403b533910644d2b254922fb84b1ac0', projectname='tempest-AttachVolumeMultiAttachTest-1052626787'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8ec1ac70-71ab-4f36-93a8-fd51f9c08833", "address": "fa:16:3e:fd:30:e7", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ec1ac70-71", "ovs_interfaceid": "8ec1ac70-71ab-4f36-93a8-fd51f9c08833", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962406.5069642) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:00:06.510464 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:00:06.510464 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:00:06.514193 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:00:06.514193 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:00:06.514193 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:00:06.514193 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:00:06.514193 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:00:06.514193 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:00:06.514748 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:00:06.514981 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:00:06.515243 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:00:06.515562 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:00:06.515813 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:00:06.516065 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:00:06.516343 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:00:06.516639 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:00:06.539726 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:00:06.540281 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'edc07b36-f6b6-4feb-855e-506d7efb58ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:00:06.540577 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:00:06.541095 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:00:06.541400 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'edc07b36-f6b6-4feb-855e-506d7efb58ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:00:06.559694 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:00:06.560564 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:00:06.561177 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:00:06.561773 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:00:06.562044 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:00:06.564444 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:00:06.577435 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:00:06.577435 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:06.583316 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:00:06.583316 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:06.596300 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee] added
May 28 10:00:06.596300 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:00:06.596300 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:00:06.596300 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:00:06.596300 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:00:06.596300 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:00:06.596300 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:06.596676 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:00:06.597323 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0351(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:00:06.597597 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:00:06.598849 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee] added
May 28 10:00:06.598849 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:00:06.598849 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:00:06.598849 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:00:06.598849 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:00:06.598849 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:00:06.598849 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:06.599206 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:00:06.599206 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0372(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:00:06.599381 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:00:06.646328 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Rescuing
May 28 10:00:06.646574 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "refresh_cache-ef3d846c-c539-41c5-ade2-1f93e7acc2ca" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:00:06.646778 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquired lock "refresh_cache-ef3d846c-c539-41c5-ade2-1f93e7acc2ca" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:00:06.649318 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:00:06.765543 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-4c730413-48a8-4f57-8e08-e82c2db3a5a5 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:59:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1520224255',display_name='tempest-VolumesAdminNegativeTest-server-1520224255',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumesadminnegativetest-server-1520224255',id=15,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:00:00Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='850a1b46c5954c54a488aa77569e6585',ramdisk_id='',reservation_id='r-68w2umkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1478180913',owner_user_name='tempest-VolumesAdminNegativeTest-1478180913-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:00:00Z,user_data=None,user_id='263f33d2831141c7b0b8eadbd8d9c315',uuid=5214df33-d3dc-4932-b781-dc96b2d90a5a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8698560a-9cc7-4c98-ac7e-4430b67281c7", "address": "fa:16:3e:1e:81:86", "network": {"id": "b13d51a0-e043-42d6-a585-4e136f314ab6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1696131701-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "850a1b46c5954c54a488aa77569e6585", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8698560a-9c", "ovs_interfaceid": "8698560a-9cc7-4c98-ac7e-4430b67281c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:00:06.765679 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-4c730413-48a8-4f57-8e08-e82c2db3a5a5 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Converting VIF {"id": "8698560a-9cc7-4c98-ac7e-4430b67281c7", "address": "fa:16:3e:1e:81:86", "network": {"id": "b13d51a0-e043-42d6-a585-4e136f314ab6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1696131701-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "850a1b46c5954c54a488aa77569e6585", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8698560a-9c", "ovs_interfaceid": "8698560a-9cc7-4c98-ac7e-4430b67281c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:00:06.766488 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-4c730413-48a8-4f57-8e08-e82c2db3a5a5 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:81:86,bridge_name='br-int',has_traffic_filtering=True,id=8698560a-9cc7-4c98-ac7e-4430b67281c7,network=Network(b13d51a0-e043-42d6-a585-4e136f314ab6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8698560a-9c') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:00:06.766708 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-4c730413-48a8-4f57-8e08-e82c2db3a5a5 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:81:86,bridge_name='br-int',has_traffic_filtering=True,id=8698560a-9cc7-4c98-ac7e-4430b67281c7,network=Network(b13d51a0-e043-42d6-a585-4e136f314ab6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8698560a-9c') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:00:06.770260 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:06.770457 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8698560a-9c, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:06.777768 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:06.782098 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:00:06.783087 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:06.783267 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0e29af0d-8c9b-4262-a448-80509f111423) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:06.786551 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:06.787295 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:00:06.791075 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:00:06.817193 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:06.817193 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:06.825546 np0000001613 nova-compute[98321]: INFO os_vif [None req-4c730413-48a8-4f57-8e08-e82c2db3a5a5 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:81:86,bridge_name='br-int',has_traffic_filtering=True,id=8698560a-9cc7-4c98-ac7e-4430b67281c7,network=Network(b13d51a0-e043-42d6-a585-4e136f314ab6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8698560a-9c')
May 28 10:00:06.826225 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-4c730413-48a8-4f57-8e08-e82c2db3a5a5 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Deleting instance files /opt/stack/data/nova/instances/5214df33-d3dc-4932-b781-dc96b2d90a5a_del
May 28 10:00:06.826957 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-4c730413-48a8-4f57-8e08-e82c2db3a5a5 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Deletion of /opt/stack/data/nova/instances/5214df33-d3dc-4932-b781-dc96b2d90a5a_del complete
May 28 10:00:06.981193 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-78784c31-4098-4b78-8f70-332ceb29605a req-975c60e1-22ed-4c3e-8a30-b47257155e19 service nova] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Received event network-vif-deleted-7be666db-db21-439b-958d-3721cb9c4fdd {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:06.981619 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-78784c31-4098-4b78-8f70-332ceb29605a req-975c60e1-22ed-4c3e-8a30-b47257155e19 service nova] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Received event network-vif-plugged-fec718e7-b773-4907-abf5-60f374bd420a {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:06.981619 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-78784c31-4098-4b78-8f70-332ceb29605a req-975c60e1-22ed-4c3e-8a30-b47257155e19 service nova] Acquiring lock "c9416092-d229-4f59-aaf3-3b0b692e7924-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:06.981841 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-78784c31-4098-4b78-8f70-332ceb29605a req-975c60e1-22ed-4c3e-8a30-b47257155e19 service nova] Lock "c9416092-d229-4f59-aaf3-3b0b692e7924-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:06.981962 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-78784c31-4098-4b78-8f70-332ceb29605a req-975c60e1-22ed-4c3e-8a30-b47257155e19 service nova] Lock "c9416092-d229-4f59-aaf3-3b0b692e7924-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:06.982137 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-78784c31-4098-4b78-8f70-332ceb29605a req-975c60e1-22ed-4c3e-8a30-b47257155e19 service nova] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] No waiting events found dispatching network-vif-plugged-fec718e7-b773-4907-abf5-60f374bd420a {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:00:06.984395 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-78784c31-4098-4b78-8f70-332ceb29605a req-975c60e1-22ed-4c3e-8a30-b47257155e19 service nova] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Received unexpected event network-vif-plugged-fec718e7-b773-4907-abf5-60f374bd420a for instance with vm_state active and task_state None.
May 28 10:00:06.984745 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-78784c31-4098-4b78-8f70-332ceb29605a req-975c60e1-22ed-4c3e-8a30-b47257155e19 service nova] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Received event network-vif-unplugged-8698560a-9cc7-4c98-ac7e-4430b67281c7 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:06.984998 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-78784c31-4098-4b78-8f70-332ceb29605a req-975c60e1-22ed-4c3e-8a30-b47257155e19 service nova] Acquiring lock "5214df33-d3dc-4932-b781-dc96b2d90a5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:06.987296 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-78784c31-4098-4b78-8f70-332ceb29605a req-975c60e1-22ed-4c3e-8a30-b47257155e19 service nova] Lock "5214df33-d3dc-4932-b781-dc96b2d90a5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:06.987296 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-78784c31-4098-4b78-8f70-332ceb29605a req-975c60e1-22ed-4c3e-8a30-b47257155e19 service nova] Lock "5214df33-d3dc-4932-b781-dc96b2d90a5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:06.987404 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-78784c31-4098-4b78-8f70-332ceb29605a req-975c60e1-22ed-4c3e-8a30-b47257155e19 service nova] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] No waiting events found dispatching network-vif-unplugged-8698560a-9cc7-4c98-ac7e-4430b67281c7 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:00:06.987555 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-78784c31-4098-4b78-8f70-332ceb29605a req-975c60e1-22ed-4c3e-8a30-b47257155e19 service nova] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Received event network-vif-unplugged-8698560a-9cc7-4c98-ac7e-4430b67281c7 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:00:06.987639 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-78784c31-4098-4b78-8f70-332ceb29605a req-975c60e1-22ed-4c3e-8a30-b47257155e19 service nova] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Received event network-vif-unplugged-8698560a-9cc7-4c98-ac7e-4430b67281c7 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:06.987841 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-78784c31-4098-4b78-8f70-332ceb29605a req-975c60e1-22ed-4c3e-8a30-b47257155e19 service nova] Acquiring lock "5214df33-d3dc-4932-b781-dc96b2d90a5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:06.987950 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-78784c31-4098-4b78-8f70-332ceb29605a req-975c60e1-22ed-4c3e-8a30-b47257155e19 service nova] Lock "5214df33-d3dc-4932-b781-dc96b2d90a5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:06.988092 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-78784c31-4098-4b78-8f70-332ceb29605a req-975c60e1-22ed-4c3e-8a30-b47257155e19 service nova] Lock "5214df33-d3dc-4932-b781-dc96b2d90a5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:06.991408 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-78784c31-4098-4b78-8f70-332ceb29605a req-975c60e1-22ed-4c3e-8a30-b47257155e19 service nova] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] No waiting events found dispatching network-vif-unplugged-8698560a-9cc7-4c98-ac7e-4430b67281c7 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:00:06.991761 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-78784c31-4098-4b78-8f70-332ceb29605a req-975c60e1-22ed-4c3e-8a30-b47257155e19 service nova] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Received event network-vif-unplugged-8698560a-9cc7-4c98-ac7e-4430b67281c7 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:00:06.995573 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-59769649-b209-4653-9915-71761322a42b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:00:06.995795 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-59769649-b209-4653-9915-71761322a42b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:00:07.037095 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6fe89f12-975c-4436-95fc-73d2acbac1ca req-1c23bb23-9c11-49bf-bad6-07c140ee3049 service nova] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Received event network-changed-191c304c-b4ad-4084-9d48-b5dab07b9e5c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:07.037228 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6fe89f12-975c-4436-95fc-73d2acbac1ca req-1c23bb23-9c11-49bf-bad6-07c140ee3049 service nova] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Refreshing instance network info cache due to event network-changed-191c304c-b4ad-4084-9d48-b5dab07b9e5c. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:00:07.037392 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6fe89f12-975c-4436-95fc-73d2acbac1ca req-1c23bb23-9c11-49bf-bad6-07c140ee3049 service nova] Acquiring lock "refresh_cache-6002d2d6-f312-48bf-9f07-7fcea8c5e52d" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:00:07.121295 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:07.149786 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:07.235675 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:07.318798 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Updating instance_info_cache with network_info: [{"id": "191c304c-b4ad-4084-9d48-b5dab07b9e5c", "address": "fa:16:3e:94:18:95", "network": {"id": "ed5c028e-ea22-4128-b280-20aed5f49bd8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1268885172-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0098401beaa4ad0967c1b5cfc2f61f8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap191c304c-b4", "ovs_interfaceid": "191c304c-b4ad-4084-9d48-b5dab07b9e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:00:07.346878 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-4c730413-48a8-4f57-8e08-e82c2db3a5a5 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Took 1.47 seconds to destroy the instance on the hypervisor.
May 28 10:00:07.348487 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-4c730413-48a8-4f57-8e08-e82c2db3a5a5 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:00:07.348878 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:00:07.348970 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:00:07.349254 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:07.501660 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-59769649-b209-4653-9915-71761322a42b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:00:07.511824 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:07.599029 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:00:07.599955 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:00:07.613060 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:00:07.613060 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:00:07.621362 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:00:07.621362 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:07.626916 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:07.629577 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:07.637024 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:07.648347 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:07.648347 np0000001613 nova-compute[98321]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:07.648347 np0000001613 nova-compute[98321]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:07.648347 np0000001613 nova-compute[98321]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:07.648347 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:07.648347 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:07.648347 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:00:07.648665 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:07.648665 np0000001613 nova-compute[98321]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:07.648665 np0000001613 nova-compute[98321]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:07.648665 np0000001613 nova-compute[98321]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:07.648665 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:07.648665 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:07.648665 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:00:07.656986 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:07.656986 np0000001613 nova-compute[98321]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:07.656986 np0000001613 nova-compute[98321]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:07.656986 np0000001613 nova-compute[98321]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:07.656986 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:07.656986 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:07.656986 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:00:07.657338 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:07.657338 np0000001613 nova-compute[98321]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:07.657338 np0000001613 nova-compute[98321]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:07.657338 np0000001613 nova-compute[98321]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:07.657338 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:07.657338 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:07.657338 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:00:07.688932 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee, portal: 192.168.50.100,3260]
May 28 10:00:07.688932 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee, portal: 192.168.50.100,3260] successful.
May 28 10:00:07.688932 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:07.700000 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee, portal: 192.168.40.100,3260]
May 28 10:00:07.700000 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee, portal: 192.168.40.100,3260] successful.
May 28 10:00:07.700000 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:07.706995 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:07.717967 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:07.730975 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:07.730975 np0000001613 nova-compute[98321]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:07.730975 np0000001613 nova-compute[98321]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:07.730975 np0000001613 nova-compute[98321]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:07.730975 np0000001613 nova-compute[98321]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:07.730975 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:07.730975 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:07.730975 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:07.730975 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:00:07.733973 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:07.733973 np0000001613 nova-compute[98321]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:07.733973 np0000001613 nova-compute[98321]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:07.733973 np0000001613 nova-compute[98321]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:07.733973 np0000001613 nova-compute[98321]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:07.733973 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:07.733973 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:07.733973 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:07.733973 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:00:07.733973 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.170s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:00:07.733973 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:00:07.734926 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] HCTL ('13', '-', '-', 0) found on session 29 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:00:07.735239 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:00:07.742877 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:07.742877 np0000001613 nova-compute[98321]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:07.742877 np0000001613 nova-compute[98321]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:07.742877 np0000001613 nova-compute[98321]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:07.742877 np0000001613 nova-compute[98321]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:07.742877 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:07.742877 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:07.742877 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:07.742877 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:00:07.743291 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:07.743291 np0000001613 nova-compute[98321]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:07.743291 np0000001613 nova-compute[98321]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:07.743291 np0000001613 nova-compute[98321]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:07.743291 np0000001613 nova-compute[98321]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:07.743291 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:07.743291 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:07.743291 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:07.743291 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:00:07.743696 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:00:07.743696 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:00:07.745243 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] HCTL ('14', '-', '-', 0) found on session 30 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:00:07.745372 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:00:07.766469 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Searching for a device in session 29 and hctl ['13', '*', '*', 0] yield: None {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:00:07.794190 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Searching for a device in session 30 and hctl ['14', '*', '*', 0] yield: None {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:00:07.825066 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Releasing lock "refresh_cache-6002d2d6-f312-48bf-9f07-7fcea8c5e52d" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:00:07.825066 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Instance network_info: |[{"id": "191c304c-b4ad-4084-9d48-b5dab07b9e5c", "address": "fa:16:3e:94:18:95", "network": {"id": "ed5c028e-ea22-4128-b280-20aed5f49bd8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1268885172-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0098401beaa4ad0967c1b5cfc2f61f8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap191c304c-b4", "ovs_interfaceid": "191c304c-b4ad-4084-9d48-b5dab07b9e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:00:07.826754 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Start _get_guest_xml network_info=[{"id": "191c304c-b4ad-4084-9d48-b5dab07b9e5c", "address": "fa:16:3e:94:18:95", "network": {"id": "ed5c028e-ea22-4128-b280-20aed5f49bd8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1268885172-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0098401beaa4ad0967c1b5cfc2f61f8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap191c304c-b4", "ovs_interfaceid": "191c304c-b4ad-4084-9d48-b5dab07b9e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:00:07.827091 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6fe89f12-975c-4436-95fc-73d2acbac1ca req-1c23bb23-9c11-49bf-bad6-07c140ee3049 service nova] Acquired lock "refresh_cache-6002d2d6-f312-48bf-9f07-7fcea8c5e52d" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:00:07.827468 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-6fe89f12-975c-4436-95fc-73d2acbac1ca req-1c23bb23-9c11-49bf-bad6-07c140ee3049 service nova] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Refreshing network info cache for port 191c304c-b4ad-4084-9d48-b5dab07b9e5c {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:00:07.838382 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:00:07.840912 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-DeleteServersTestJSON-server-300551735', uuid='6002d2d6-f312-48bf-9f07-7fcea8c5e52d'), owner=OwnerMeta(userid='e96e96039e43475a8bbea8acb05d67f7', username='tempest-DeleteServersTestJSON-152188913-project-member', projectid='c0098401beaa4ad0967c1b5cfc2f61f8', projectname='tempest-DeleteServersTestJSON-152188913'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "191c304c-b4ad-4084-9d48-b5dab07b9e5c", "address": "fa:16:3e:94:18:95", "network": {"id": "ed5c028e-ea22-4128-b280-20aed5f49bd8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1268885172-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0098401beaa4ad0967c1b5cfc2f61f8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap191c304c-b4", "ovs_interfaceid": "191c304c-b4ad-4084-9d48-b5dab07b9e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962407.8393323) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:00:07.854984 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Updating instance_info_cache with network_info: [{"id": "613dad87-2df3-4db7-a38f-adda943e8770", "address": "fa:16:3e:03:75:e0", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap613dad87-2d", "ovs_interfaceid": "613dad87-2df3-4db7-a38f-adda943e8770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:00:07.859098 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:00:07.860659 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:00:07.865140 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:00:07.865499 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:00:07.867519 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:00:07.868267 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:00:07.875871 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:00:07.876891 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:00:07.876891 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:00:07.876891 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:00:07.876891 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:00:07.876891 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:00:07.877315 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:00:07.878064 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:00:07.878225 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:00:07.878542 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:00:07.910173 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T09:59:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-300551735',display_name='tempest-DeleteServersTestJSON-server-300551735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-deleteserverstestjson-server-300551735',id=17,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0098401beaa4ad0967c1b5cfc2f61f8',ramdisk_id='',reservation_id='r-2h4xn2z2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-152188913',owner_user_name='tempest-DeleteServersTestJSON-152188913-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:00:04Z,user_data=None,user_id='e96e96039e43475a8bbea8acb05d67f7',uuid=6002d2d6-f312-48bf-9f07-7fcea8c5e52d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "191c304c-b4ad-4084-9d48-b5dab07b9e5c", "address": "fa:16:3e:94:18:95", "network": {"id": "ed5c028e-ea22-4128-b280-20aed5f49bd8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1268885172-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0098401beaa4ad0967c1b5cfc2f61f8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap191c304c-b4", "ovs_interfaceid": "191c304c-b4ad-4084-9d48-b5dab07b9e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:00:07.910173 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Converting VIF {"id": "191c304c-b4ad-4084-9d48-b5dab07b9e5c", "address": "fa:16:3e:94:18:95", "network": {"id": "ed5c028e-ea22-4128-b280-20aed5f49bd8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1268885172-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0098401beaa4ad0967c1b5cfc2f61f8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap191c304c-b4", "ovs_interfaceid": "191c304c-b4ad-4084-9d48-b5dab07b9e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:00:07.911808 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:18:95,bridge_name='br-int',has_traffic_filtering=True,id=191c304c-b4ad-4084-9d48-b5dab07b9e5c,network=Network(ed5c028e-ea22-4128-b280-20aed5f49bd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap191c304c-b4') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:00:07.913463 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Lazy-loading 'pci_devices' on Instance uuid 6002d2d6-f312-48bf-9f07-7fcea8c5e52d {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:00:08.016252 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-59769649-b209-4653-9915-71761322a42b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.284s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:08.016252 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 2.132s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:08.016740 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Trying to apply a migration context that does not seem to be set for this instance {{(pid=98321) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}}
May 28 10:00:08.140211 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-59769649-b209-4653-9915-71761322a42b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Deleted allocations for instance 53ad56cc-eb5b-4e2e-a421-e93deee27fe7
May 28 10:00:08.337458 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-6fe89f12-975c-4436-95fc-73d2acbac1ca req-1c23bb23-9c11-49bf-bad6-07c140ee3049 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:08.359160 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Releasing lock "refresh_cache-ef3d846c-c539-41c5-ade2-1f93e7acc2ca" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:00:08.390427 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:00:08.421308 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] End _get_guest_xml xml=<domain type="qemu">
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:   <uuid>6002d2d6-f312-48bf-9f07-7fcea8c5e52d</uuid>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:   <name>instance-00000011</name>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:       <nova:name>tempest-DeleteServersTestJSON-server-300551735</nova:name>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:00:07</nova:creationTime>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:         <nova:user uuid="e96e96039e43475a8bbea8acb05d67f7">tempest-DeleteServersTestJSON-152188913-project-member</nova:user>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:         <nova:project uuid="c0098401beaa4ad0967c1b5cfc2f61f8">tempest-DeleteServersTestJSON-152188913</nova:project>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:         <nova:port uuid="191c304c-b4ad-4084-9d48-b5dab07b9e5c">
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:     <system>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:       <entry name="serial">6002d2d6-f312-48bf-9f07-7fcea8c5e52d</entry>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:       <entry name="uuid">6002d2d6-f312-48bf-9f07-7fcea8c5e52d</entry>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:     </system>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:   <os>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:   </os>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:   <features>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:   </features>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:   <devices>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/6002d2d6-f312-48bf-9f07-7fcea8c5e52d/disk"/>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:     </disk>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/6002d2d6-f312-48bf-9f07-7fcea8c5e52d/disk.config"/>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:     </disk>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:94:18:95"/>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:       <target dev="tap191c304c-b4"/>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:     </interface>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/6002d2d6-f312-48bf-9f07-7fcea8c5e52d/console.log" append="off"/>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:     </serial>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:     <video>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:     </video>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:     </rng>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:   </devices>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]: </domain>
May 28 10:00:08.421308 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:00:08.423934 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Preparing to wait for external event network-vif-plugged-191c304c-b4ad-4084-9d48-b5dab07b9e5c {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:00:08.423934 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Acquiring lock "6002d2d6-f312-48bf-9f07-7fcea8c5e52d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:08.424354 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Lock "6002d2d6-f312-48bf-9f07-7fcea8c5e52d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:08.424526 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Lock "6002d2d6-f312-48bf-9f07-7fcea8c5e52d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:08.425669 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T09:59:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-300551735',display_name='tempest-DeleteServersTestJSON-server-300551735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-deleteserverstestjson-server-300551735',id=17,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0098401beaa4ad0967c1b5cfc2f61f8',ramdisk_id='',reservation_id='r-2h4xn2z2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-152188913',owner_user_name='tempest-DeleteServersTestJSON-152188913-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:00:04Z,user_data=None,user_id='e96e96039e43475a8bbea8acb05d67f7',uuid=6002d2d6-f312-48bf-9f07-7fcea8c5e52d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "191c304c-b4ad-4084-9d48-b5dab07b9e5c", "address": "fa:16:3e:94:18:95", "network": {"id": "ed5c028e-ea22-4128-b280-20aed5f49bd8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1268885172-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0098401beaa4ad0967c1b5cfc2f61f8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap191c304c-b4", "ovs_interfaceid": "191c304c-b4ad-4084-9d48-b5dab07b9e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:00:08.426102 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Converting VIF {"id": "191c304c-b4ad-4084-9d48-b5dab07b9e5c", "address": "fa:16:3e:94:18:95", "network": {"id": "ed5c028e-ea22-4128-b280-20aed5f49bd8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1268885172-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0098401beaa4ad0967c1b5cfc2f61f8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap191c304c-b4", "ovs_interfaceid": "191c304c-b4ad-4084-9d48-b5dab07b9e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:00:08.427139 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:18:95,bridge_name='br-int',has_traffic_filtering=True,id=191c304c-b4ad-4084-9d48-b5dab07b9e5c,network=Network(ed5c028e-ea22-4128-b280-20aed5f49bd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap191c304c-b4') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:00:08.427727 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:18:95,bridge_name='br-int',has_traffic_filtering=True,id=191c304c-b4ad-4084-9d48-b5dab07b9e5c,network=Network(ed5c028e-ea22-4128-b280-20aed5f49bd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap191c304c-b4') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:00:08.431337 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:08.431684 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:08.431934 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:00:08.433136 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:08.433355 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '66c01275-eb2d-5351-b054-abbb95161eb3', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:08.436392 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:08.437306 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:00:08.440363 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:08.440750 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap191c304c-b4, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:08.441403 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap191c304c-b4, col_values=(('qos', UUID('f79fb6b2-567a-47c5-ae86-6e1f336dae3a')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:08.441792 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap191c304c-b4, col_values=(('external_ids', {'iface-id': '191c304c-b4ad-4084-9d48-b5dab07b9e5c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:18:95', 'vm-uuid': '6002d2d6-f312-48bf-9f07-7fcea8c5e52d'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:08.443719 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:08.449252 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:00:08.450818 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:08.452358 np0000001613 nova-compute[98321]: INFO os_vif [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:18:95,bridge_name='br-int',has_traffic_filtering=True,id=191c304c-b4ad-4084-9d48-b5dab07b9e5c,network=Network(ed5c028e-ea22-4128-b280-20aed5f49bd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap191c304c-b4')
May 28 10:00:08.733235 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-6fe89f12-975c-4436-95fc-73d2acbac1ca req-1c23bb23-9c11-49bf-bad6-07c140ee3049 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:08.765865 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Searching for a device in session 29 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:00:08.765865 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'edc07b36-f6b6-4feb-855e-506d7efb58ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:00:08.792021 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Searching for a device in session 30 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:00:08.792189 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'edc07b36-f6b6-4feb-855e-506d7efb58ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:00:08.894119 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Took 1.54 seconds to deallocate network for instance.
May 28 10:00:08.901651 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-6fe89f12-975c-4436-95fc-73d2acbac1ca req-1c23bb23-9c11-49bf-bad6-07c140ee3049 service nova] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Updated VIF entry in instance network info cache for port 191c304c-b4ad-4084-9d48-b5dab07b9e5c. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:00:08.902056 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-6fe89f12-975c-4436-95fc-73d2acbac1ca req-1c23bb23-9c11-49bf-bad6-07c140ee3049 service nova] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Updating instance_info_cache with network_info: [{"id": "191c304c-b4ad-4084-9d48-b5dab07b9e5c", "address": "fa:16:3e:94:18:95", "network": {"id": "ed5c028e-ea22-4128-b280-20aed5f49bd8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1268885172-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0098401beaa4ad0967c1b5cfc2f61f8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap191c304c-b4", "ovs_interfaceid": "191c304c-b4ad-4084-9d48-b5dab07b9e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:00:09.033554 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c9606c67-6e11-4b22-8398-4223fd5b1c64 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.018s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:09.141300 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ff33c97e-4f8f-41ac-acfb-4f059d8e4fba req-67978b8a-5392-42f3-975b-0a5fdb1e6f34 service nova] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Received event network-vif-deleted-8698560a-9cc7-4c98-ac7e-4430b67281c7 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:09.159293 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-59769649-b209-4653-9915-71761322a42b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "53ad56cc-eb5b-4e2e-a421-e93deee27fe7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.529s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:09.230587 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:09.399507 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4c730413-48a8-4f57-8e08-e82c2db3a5a5 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:09.399926 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4c730413-48a8-4f57-8e08-e82c2db3a5a5 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:09.405640 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6fe89f12-975c-4436-95fc-73d2acbac1ca req-1c23bb23-9c11-49bf-bad6-07c140ee3049 service nova] Releasing lock "refresh_cache-6002d2d6-f312-48bf-9f07-7fcea8c5e52d" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:00:09.565152 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:00:09.974016 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:00:09.975682 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:00:09.976573 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] No VIF found with MAC fa:16:3e:94:18:95, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:00:09.977187 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Using config drive
May 28 10:00:09.997770 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4c730413-48a8-4f57-8e08-e82c2db3a5a5 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:00:09.998024 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-4c730413-48a8-4f57-8e08-e82c2db3a5a5 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:00:10.029610 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:10.034745 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:10.060111 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:10.223451 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:10.235871 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:10.299969 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-80394f42-648b-45e7-9aa9-958a97959ed0 req-9175c579-5fd6-4d44-88b9-ecf741f0e299 service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Received event network-vif-unplugged-613dad87-2df3-4db7-a38f-adda943e8770 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:10.300179 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-80394f42-648b-45e7-9aa9-958a97959ed0 req-9175c579-5fd6-4d44-88b9-ecf741f0e299 service nova] Acquiring lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:10.300379 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-80394f42-648b-45e7-9aa9-958a97959ed0 req-9175c579-5fd6-4d44-88b9-ecf741f0e299 service nova] Lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:10.300683 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-80394f42-648b-45e7-9aa9-958a97959ed0 req-9175c579-5fd6-4d44-88b9-ecf741f0e299 service nova] Lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:10.300745 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-80394f42-648b-45e7-9aa9-958a97959ed0 req-9175c579-5fd6-4d44-88b9-ecf741f0e299 service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] No waiting events found dispatching network-vif-unplugged-613dad87-2df3-4db7-a38f-adda943e8770 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:00:10.300884 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-80394f42-648b-45e7-9aa9-958a97959ed0 req-9175c579-5fd6-4d44-88b9-ecf741f0e299 service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Received unexpected event network-vif-unplugged-613dad87-2df3-4db7-a38f-adda943e8770 for instance with vm_state active and task_state rescuing.
May 28 10:00:10.350947 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999631604999877 future=<Future at 0x73c1f41725d0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:10.352767 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Instance destroyed successfully.
May 28 10:00:10.353595 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lazy-loading 'numa_topology' on Instance uuid ef3d846c-c539-41c5-ade2-1f93e7acc2ca {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:00:10.487725 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:10.503066 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-4c730413-48a8-4f57-8e08-e82c2db3a5a5 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:00:10.580552 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Found WWN 330000000da67e242 for multipath device dm-5 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:00:10.580850 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.040s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:00:10.581470 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] <== connect_volume: return (4040ms) {'type': 'block', 'scsi_wwn': '330000000da67e242', 'path': '/dev/dm-5', 'multipath_id': '330000000da67e242'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:00:10.581635 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000da67e242', 'path': '/dev/dm-5', 'multipath_id': '330000000da67e242'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:00:10.861776 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Attempting a stable device rescue
May 28 10:00:10.911368 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Creating config drive at /opt/stack/data/nova/instances/6002d2d6-f312-48bf-9f07-7fcea8c5e52d/disk.config
May 28 10:00:10.914617 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6002d2d6-f312-48bf-9f07-7fcea8c5e52d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpi6b5bsb2 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:10.948150 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:10.974492 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6002d2d6-f312-48bf-9f07-7fcea8c5e52d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpi6b5bsb2" returned: 0 in 0.060s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:11.008002 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=98321) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 28 10:00:11.013315 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4c730413-48a8-4f57-8e08-e82c2db3a5a5 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.613s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:11.024759 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Instance directory exists: not creating {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 10:00:11.025577 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Creating image(s)
May 28 10:00:11.026750 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "/opt/stack/data/nova/instances/ef3d846c-c539-41c5-ade2-1f93e7acc2ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:11.028485 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "/opt/stack/data/nova/instances/ef3d846c-c539-41c5-ade2-1f93e7acc2ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:11.028597 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "/opt/stack/data/nova/instances/ef3d846c-c539-41c5-ade2-1f93e7acc2ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:11.028847 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lazy-loading 'trusted_certs' on Instance uuid ef3d846c-c539-41c5-ade2-1f93e7acc2ca {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:00:11.092453 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T09:59:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-329318184',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumemultiattachtest-server-329318184',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3403b533910644d2b254922fb84b1ac0',ramdisk_id='',reservation_id='r-n7z7kv0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1052626787',owner_user_name='tempest-AttachVolumeMultiAttachTest-1052626787-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:00:00Z,user_data=None,user_id='13481913e22d4bf1a94e1a9a270f5494',uuid=6895009a-024f-4919-9d25-a52905eac818,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ec1ac70-71ab-4f36-93a8-fd51f9c08833", "address": "fa:16:3e:fd:30:e7", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ec1ac70-71", "ovs_interfaceid": "8ec1ac70-71ab-4f36-93a8-fd51f9c08833", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:00:11.092705 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converting VIF {"id": "8ec1ac70-71ab-4f36-93a8-fd51f9c08833", "address": "fa:16:3e:fd:30:e7", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ec1ac70-71", "ovs_interfaceid": "8ec1ac70-71ab-4f36-93a8-fd51f9c08833", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:00:11.093483 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:30:e7,bridge_name='br-int',has_traffic_filtering=True,id=8ec1ac70-71ab-4f36-93a8-fd51f9c08833,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ec1ac70-71') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:00:11.094889 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lazy-loading 'pci_devices' on Instance uuid 6895009a-024f-4919-9d25-a52905eac818 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:00:11.098226 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-4c730413-48a8-4f57-8e08-e82c2db3a5a5 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Deleted allocations for instance 5214df33-d3dc-4932-b781-dc96b2d90a5a
May 28 10:00:11.516439 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:11.533555 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Object Instance<ef3d846c-c539-41c5-ade2-1f93e7acc2ca> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:00:11.535223 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "8edd1ab622ff632038924cffb741305779259be3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:11.535223 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "8edd1ab622ff632038924cffb741305779259be3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:11.555136 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:11.605684 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] End _get_guest_xml xml=<domain type="qemu">
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:   <uuid>6895009a-024f-4919-9d25-a52905eac818</uuid>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:   <name>instance-00000010</name>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:       <nova:name>tempest-AttachVolumeMultiAttachTest-server-329318184</nova:name>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:00:06</nova:creationTime>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:       <nova:image uuid="">
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:         <nova:user uuid="13481913e22d4bf1a94e1a9a270f5494">tempest-AttachVolumeMultiAttachTest-1052626787-project-member</nova:user>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:         <nova:project uuid="3403b533910644d2b254922fb84b1ac0">tempest-AttachVolumeMultiAttachTest-1052626787</nova:project>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:       <nova:root type="volume" uuid=""/>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:         <nova:port uuid="8ec1ac70-71ab-4f36-93a8-fd51f9c08833">
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:     <system>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:       <entry name="serial">6895009a-024f-4919-9d25-a52905eac818</entry>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:       <entry name="uuid">6895009a-024f-4919-9d25-a52905eac818</entry>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:     </system>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:   <os>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:   </os>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:   <features>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:   </features>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:   <devices>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/6895009a-024f-4919-9d25-a52905eac818/disk.config"/>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:     </disk>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:       <alias name="ua-edc07b36-f6b6-4feb-855e-506d7efb58ee"/>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-5"/>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:       <serial>edc07b36-f6b6-4feb-855e-506d7efb58ee</serial>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:       <shareable/>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:     </disk>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:fd:30:e7"/>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:       <target dev="tap8ec1ac70-71"/>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:     </interface>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/6895009a-024f-4919-9d25-a52905eac818/console.log" append="off"/>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:     </serial>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:     <video>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:     </video>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:     </rng>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:   </devices>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]: </domain>
May 28 10:00:11.605684 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:00:11.608416 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Preparing to wait for external event network-vif-plugged-8ec1ac70-71ab-4f36-93a8-fd51f9c08833 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:00:11.608416 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "6895009a-024f-4919-9d25-a52905eac818-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:11.608416 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "6895009a-024f-4919-9d25-a52905eac818-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:11.608416 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "6895009a-024f-4919-9d25-a52905eac818-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:11.608416 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T09:59:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-329318184',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumemultiattachtest-server-329318184',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3403b533910644d2b254922fb84b1ac0',ramdisk_id='',reservation_id='r-n7z7kv0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1052626787',owner_user_name='tempest-AttachVolumeMultiAttachTest-1052626787-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:00:00Z,user_data=None,user_id='13481913e22d4bf1a94e1a9a270f5494',uuid=6895009a-024f-4919-9d25-a52905eac818,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ec1ac70-71ab-4f36-93a8-fd51f9c08833", "address": "fa:16:3e:fd:30:e7", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ec1ac70-71", "ovs_interfaceid": "8ec1ac70-71ab-4f36-93a8-fd51f9c08833", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:00:11.608416 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converting VIF {"id": "8ec1ac70-71ab-4f36-93a8-fd51f9c08833", "address": "fa:16:3e:fd:30:e7", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ec1ac70-71", "ovs_interfaceid": "8ec1ac70-71ab-4f36-93a8-fd51f9c08833", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:00:11.608416 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:30:e7,bridge_name='br-int',has_traffic_filtering=True,id=8ec1ac70-71ab-4f36-93a8-fd51f9c08833,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ec1ac70-71') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:00:11.612516 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:30:e7,bridge_name='br-int',has_traffic_filtering=True,id=8ec1ac70-71ab-4f36-93a8-fd51f9c08833,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ec1ac70-71') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:00:11.614497 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:11.615063 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:11.616215 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:00:11.619122 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:11.619635 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cb3c9044-52c2-5000-a1d5-edb0e8fdc31a', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:11.622605 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:11.623506 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:00:11.640588 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:11.649477 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:11.649847 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ec1ac70-71, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:11.650218 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8ec1ac70-71, col_values=(('qos', UUID('e94a6b76-a802-45e8-acda-b7fc283a42d4')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:11.650519 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8ec1ac70-71, col_values=(('external_ids', {'iface-id': '8ec1ac70-71ab-4f36-93a8-fd51f9c08833', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:30:e7', 'vm-uuid': '6895009a-024f-4919-9d25-a52905eac818'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:11.652048 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:11.654110 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:00:11.670853 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:11.670853 np0000001613 nova-compute[98321]: INFO os_vif [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:30:e7,bridge_name='br-int',has_traffic_filtering=True,id=8ec1ac70-71ab-4f36-93a8-fd51f9c08833,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ec1ac70-71')
May 28 10:00:11.686694 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:11.987734 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:12.006240 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:12.010581 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:12.041029 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:12.059369 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:12.130056 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4c730413-48a8-4f57-8e08-e82c2db3a5a5 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Lock "5214df33-d3dc-4932-b781-dc96b2d90a5a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.786s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:12.429262 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:00:12.433960 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:00:12.433960 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8edd1ab622ff632038924cffb741305779259be3.part --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:12.535462 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8edd1ab622ff632038924cffb741305779259be3.part --force-share --output=json" returned: 0 in 0.101s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:12.535946 np0000001613 nova-compute[98321]: DEBUG nova.virt.images [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] 89110e84-dc49-4634-99bc-a4166ce9a5b8 was qcow2, converting to raw {{(pid=98321) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 10:00:12.536761 np0000001613 nova-compute[98321]: DEBUG nova.privsep.utils [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98321) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 10:00:12.537222 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8edd1ab622ff632038924cffb741305779259be3.part /opt/stack/data/nova/instances/_base/8edd1ab622ff632038924cffb741305779259be3.converted {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:12.626950 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8edd1ab622ff632038924cffb741305779259be3.part /opt/stack/data/nova/instances/_base/8edd1ab622ff632038924cffb741305779259be3.converted" returned: 0 in 0.089s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:12.633018 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8edd1ab622ff632038924cffb741305779259be3.converted --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:12.650264 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962412.648611, 6002d2d6-f312-48bf-9f07-7fcea8c5e52d => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:00:12.652109 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] VM Started (Lifecycle Event)
May 28 10:00:12.734266 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8edd1ab622ff632038924cffb741305779259be3.converted --force-share --output=json" returned: 0 in 0.101s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:12.734930 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "8edd1ab622ff632038924cffb741305779259be3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.200s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:12.735454 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:00:12.738811 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:00:12.740336 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "8edd1ab622ff632038924cffb741305779259be3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:12.740873 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "8edd1ab622ff632038924cffb741305779259be3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:12.741288 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:00:12.745808 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:00:12.746385 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8edd1ab622ff632038924cffb741305779259be3 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:12.852360 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8edd1ab622ff632038924cffb741305779259be3 --force-share --output=json" returned: 0 in 0.106s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:12.852878 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8edd1ab622ff632038924cffb741305779259be3,backing_fmt=raw /opt/stack/data/nova/instances/ef3d846c-c539-41c5-ade2-1f93e7acc2ca/disk.rescue {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:12.903260 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8edd1ab622ff632038924cffb741305779259be3,backing_fmt=raw /opt/stack/data/nova/instances/ef3d846c-c539-41c5-ade2-1f93e7acc2ca/disk.rescue" returned: 0 in 0.050s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:12.904184 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "8edd1ab622ff632038924cffb741305779259be3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.163s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:12.904523 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lazy-loading 'migration_context' on Instance uuid ef3d846c-c539-41c5-ade2-1f93e7acc2ca {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:00:13.160175 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:13.165253 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962413.1648612, 6002d2d6-f312-48bf-9f07-7fcea8c5e52d => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:00:13.165396 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] VM Paused (Lifecycle Event)
May 28 10:00:13.208667 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:00:13.208789 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:00:13.208872 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No VIF found with MAC fa:16:3e:fd:30:e7, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:00:13.209423 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Using config drive
May 28 10:00:13.241721 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:13.408346 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Object Instance<ef3d846c-c539-41c5-ade2-1f93e7acc2ca> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:00:13.408664 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:00:13.409730 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Start _get_guest_xml network_info=[{"id": "613dad87-2df3-4db7-a38f-adda943e8770", "address": "fa:16:3e:03:75:e0", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "vif_mac": "fa:16:3e:03:75:e0"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap613dad87-2d", "ovs_interfaceid": "613dad87-2df3-4db7-a38f-adda943e8770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '89110e84-dc49-4634-99bc-a4166ce9a5b8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399', 'iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '258c61ac-673c-4b35-b2b5-182ee3432399', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, 'status': 'reserved', 'instance': 'ef3d846c-c539-41c5-ade2-1f93e7acc2ca', 'attached_at': '', 'detached_at': '', 'volume_id': '258c61ac-673c-4b35-b2b5-182ee3432399', 'serial': '258c61ac-673c-4b35-b2b5-182ee3432399'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '0c5d538f-f3a1-42fd-a65b-5cf25d2bdc90', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:00:13.410220 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lazy-loading 'resources' on Instance uuid ef3d846c-c539-41c5-ade2-1f93e7acc2ca {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:00:13.668093 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:13.669950 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:00:13.720962 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:13.916713 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Object Instance<ef3d846c-c539-41c5-ade2-1f93e7acc2ca> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:00:13.918617 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:00:13.920244 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1211585824', uuid='ef3d846c-c539-41c5-ade2-1f93e7acc2ca'), owner=OwnerMeta(userid='51981c995f2246588f2d58f35be5848a', username='tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member', projectid='a9d04b105229456d9ab53df1886fdb37', projectname='tempest-ServerBootFromVolumeStableRescueTest-283762505'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "613dad87-2df3-4db7-a38f-adda943e8770", "address": "fa:16:3e:03:75:e0", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "vif_mac": "fa:16:3e:03:75:e0"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap613dad87-2d", "ovs_interfaceid": "613dad87-2df3-4db7-a38f-adda943e8770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962413.9198043) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:00:13.924130 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:00:13.924523 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:00:13.925425 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:00:13.925603 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:00:13.926895 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:00:13.927123 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:00:13.927303 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:00:13.927412 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:00:13.927561 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:00:13.927682 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:00:13.927787 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:00:13.927951 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:00:13.928075 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:00:13.928408 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:00:13.928489 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:00:13.928638 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:00:13.928814 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lazy-loading 'vcpu_model' on Instance uuid ef3d846c-c539-41c5-ade2-1f93e7acc2ca {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:00:14.172673 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:00:14.231780 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:14.431878 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Object Instance<ef3d846c-c539-41c5-ade2-1f93e7acc2ca> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:00:14.450973 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef3d846c-c539-41c5-ade2-1f93e7acc2ca/disk.config --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:14.551455 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef3d846c-c539-41c5-ade2-1f93e7acc2ca/disk.config --force-share --output=json" returned: 0 in 0.100s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:14.553049 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "/opt/stack/data/nova/instances/ef3d846c-c539-41c5-ade2-1f93e7acc2ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:14.554578 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "/opt/stack/data/nova/instances/ef3d846c-c539-41c5-ade2-1f93e7acc2ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:14.555294 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "/opt/stack/data/nova/instances/ef3d846c-c539-41c5-ade2-1f93e7acc2ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:14.555836 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:00:14.556311 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399', 'iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '258c61ac-673c-4b35-b2b5-182ee3432399', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:00:14.556496 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:00:14.556900 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:00:14.559008 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399', 'iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '258c61ac-673c-4b35-b2b5-182ee3432399', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:00:14.573550 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:00:14.574292 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:00:14.574984 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:00:14.575284 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:00:14.576211 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:00:14.576211 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.startup = automatic
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.session.scan = manual
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:00:14.590602 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:00:14.590602 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.startup = automatic
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.session.scan = manual
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:00:14.593002 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:00:14.593002 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:14.609094 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:14.614232 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:14.627311 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:14.627311 np0000001613 nova-compute[98321]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:14.627311 np0000001613 nova-compute[98321]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:14.627311 np0000001613 nova-compute[98321]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:14.627311 np0000001613 nova-compute[98321]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:14.627311 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:14.627311 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:14.627311 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:14.627311 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:00:14.627499 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:14.627499 np0000001613 nova-compute[98321]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:14.627499 np0000001613 nova-compute[98321]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:14.627499 np0000001613 nova-compute[98321]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:14.627499 np0000001613 nova-compute[98321]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:14.627499 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:14.627499 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:14.627499 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:14.627499 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:00:14.627787 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.052s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:00:14.627921 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:00:14.628593 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] HCTL ('8', '0', '0', 0) found on session 26 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:00:14.628732 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Scanning host 8 c: 0, t: 0, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:00:14.635248 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:14.635248 np0000001613 nova-compute[98321]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:14.635248 np0000001613 nova-compute[98321]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:14.635248 np0000001613 nova-compute[98321]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:14.635248 np0000001613 nova-compute[98321]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:14.635248 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:14.635248 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:14.635248 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:14.635248 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:00:14.635248 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:14.635248 np0000001613 nova-compute[98321]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:14.635248 np0000001613 nova-compute[98321]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:14.635248 np0000001613 nova-compute[98321]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:14.635248 np0000001613 nova-compute[98321]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:14.635248 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:14.635248 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:14.635248 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:14.635248 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:00:14.635248 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.060s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:00:14.635248 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:00:14.636754 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] HCTL ('7', '0', '0', 0) found on session 25 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:00:14.636754 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Scanning host 7 c: 0, t: 0, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:00:14.643556 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Searching for a device in session 26 and hctl ('8', '0', '0', 0) yield: sdc {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:00:14.644021 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '258c61ac-673c-4b35-b2b5-182ee3432399', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:00:14.647753 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Searching for a device in session 25 and hctl ('7', '0', '0', 0) yield: sdb {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:00:14.647753 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '258c61ac-673c-4b35-b2b5-182ee3432399', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:00:14.740175 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:14.956560 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-56c17bbb-670a-4047-8376-3d262992ecf7 req-a6fca578-cb08-40fe-8a18-ac5aa47f5db9 service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Received event network-vif-unplugged-613dad87-2df3-4db7-a38f-adda943e8770 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:14.956807 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-56c17bbb-670a-4047-8376-3d262992ecf7 req-a6fca578-cb08-40fe-8a18-ac5aa47f5db9 service nova] Acquiring lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:14.956995 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-56c17bbb-670a-4047-8376-3d262992ecf7 req-a6fca578-cb08-40fe-8a18-ac5aa47f5db9 service nova] Lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:14.957108 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-56c17bbb-670a-4047-8376-3d262992ecf7 req-a6fca578-cb08-40fe-8a18-ac5aa47f5db9 service nova] Lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:14.957393 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-56c17bbb-670a-4047-8376-3d262992ecf7 req-a6fca578-cb08-40fe-8a18-ac5aa47f5db9 service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] No waiting events found dispatching network-vif-unplugged-613dad87-2df3-4db7-a38f-adda943e8770 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:00:14.957561 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-56c17bbb-670a-4047-8376-3d262992ecf7 req-a6fca578-cb08-40fe-8a18-ac5aa47f5db9 service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Received unexpected event network-vif-unplugged-613dad87-2df3-4db7-a38f-adda943e8770 for instance with vm_state active and task_state rescuing.
May 28 10:00:15.117277 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-41be11c6-5cc5-4558-b34a-7ce183aa69ff req-06e104f6-3ff6-41ff-97e0-9f1a0c3805ef service nova] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Received event network-vif-plugged-191c304c-b4ad-4084-9d48-b5dab07b9e5c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:15.117576 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-41be11c6-5cc5-4558-b34a-7ce183aa69ff req-06e104f6-3ff6-41ff-97e0-9f1a0c3805ef service nova] Acquiring lock "6002d2d6-f312-48bf-9f07-7fcea8c5e52d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:15.117691 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-41be11c6-5cc5-4558-b34a-7ce183aa69ff req-06e104f6-3ff6-41ff-97e0-9f1a0c3805ef service nova] Lock "6002d2d6-f312-48bf-9f07-7fcea8c5e52d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:15.117859 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-41be11c6-5cc5-4558-b34a-7ce183aa69ff req-06e104f6-3ff6-41ff-97e0-9f1a0c3805ef service nova] Lock "6002d2d6-f312-48bf-9f07-7fcea8c5e52d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:15.118104 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-41be11c6-5cc5-4558-b34a-7ce183aa69ff req-06e104f6-3ff6-41ff-97e0-9f1a0c3805ef service nova] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Processing event network-vif-plugged-191c304c-b4ad-4084-9d48-b5dab07b9e5c {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:00:15.120363 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:00:15.126223 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962415.1258445, 6002d2d6-f312-48bf-9f07-7fcea8c5e52d => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:00:15.126541 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] VM Resumed (Lifecycle Event)
May 28 10:00:15.127991 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:00:15.131393 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Instance spawned successfully.
May 28 10:00:15.133249 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:00:15.280540 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:15.299350 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Creating config drive at /opt/stack/data/nova/instances/6895009a-024f-4919-9d25-a52905eac818/disk.config
May 28 10:00:15.306535 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6895009a-024f-4919-9d25-a52905eac818/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp49v291_2 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:15.372119 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6895009a-024f-4919-9d25-a52905eac818/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp49v291_2" returned: 0 in 0.066s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:15.576274 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:00:15.630295 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:15.637778 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:00:15.646474 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:15.646474 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:15.647460 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:15.648056 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:15.650459 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:15.650459 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:15.935088 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:15.967966 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:15.999897 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:16.121554 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:16.141884 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:00:16.157068 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Took 11.09 seconds to spawn the instance on the hypervisor.
May 28 10:00:16.157246 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:16.372001 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "f9fd8989-d182-47e4-9409-266a1440bf58" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:16.372001 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "f9fd8989-d182-47e4-9409-266a1440bf58" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:16.411470 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:16.420238 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:16.422883 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:16.449540 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:16.458306 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:16.607866 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Found WWN 3300000006b5aa7c9 for multipath device dm-0 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:00:16.608071 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.051s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:00:16.608326 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] <== connect_volume: return (2051ms) {'type': 'block', 'scsi_wwn': '3300000006b5aa7c9', 'path': '/dev/dm-0', 'multipath_id': '3300000006b5aa7c9'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:00:16.608481 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006b5aa7c9', 'path': '/dev/dm-0', 'multipath_id': '3300000006b5aa7c9'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:00:16.652251 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:16.672729 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Took 17.04 seconds to build instance.
May 28 10:00:16.877018 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:00:17.041518 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962417.0411475, 6895009a-024f-4919-9d25-a52905eac818 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:00:17.041743 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 6895009a-024f-4919-9d25-a52905eac818] VM Started (Lifecycle Event)
May 28 10:00:17.119762 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:59:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1211585824',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serverbootfromvolumestablerescuetest-server-1211585824',id=14,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:00:02Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9d04b105229456d9ab53df1886fdb37',ramdisk_id='',reservation_id='r-iqn0w26d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-283762505',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:00:03Z,user_data=None,user_id='51981c995f2246588f2d58f35be5848a',uuid=ef3d846c-c539-41c5-ade2-1f93e7acc2ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "613dad87-2df3-4db7-a38f-adda943e8770", "address": "fa:16:3e:03:75:e0", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "vif_mac": "fa:16:3e:03:75:e0"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap613dad87-2d", "ovs_interfaceid": "613dad87-2df3-4db7-a38f-adda943e8770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:00:17.120132 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Converting VIF {"id": "613dad87-2df3-4db7-a38f-adda943e8770", "address": "fa:16:3e:03:75:e0", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "vif_mac": "fa:16:3e:03:75:e0"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap613dad87-2d", "ovs_interfaceid": "613dad87-2df3-4db7-a38f-adda943e8770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:00:17.121076 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:75:e0,bridge_name='br-int',has_traffic_filtering=True,id=613dad87-2df3-4db7-a38f-adda943e8770,network=Network(e5543f88-c716-4e02-82e9-2cb7570bf25e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap613dad87-2d') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:00:17.122712 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lazy-loading 'pci_devices' on Instance uuid ef3d846c-c539-41c5-ade2-1f93e7acc2ca {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:00:17.175025 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Lock "6002d2d6-f312-48bf-9f07-7fcea8c5e52d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.555s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:17.205051 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0004871270000421646 future=<Future at 0x73c1fc328500 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:17.205231 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:17.205738 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] Emitting event <LifecycleEvent: 1779962402.2044468, 53ad56cc-eb5b-4e2e-a421-e93deee27fe7 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:00:17.205896 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=4.143834378000065 future=<Future at 0x73c1ffedd760 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:17.206099 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] VM Stopped (Lifecycle Event)
May 28 10:00:17.206222 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=4.143512740000006 future=<Future at 0x73c1ffedd760 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:17.234332 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f1acdd61-3bd5-44ad-abaa-f69470200df6 req-3aa5da6b-bea7-43e0-bd04-7abb2fff4424 service nova] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Received event network-vif-plugged-191c304c-b4ad-4084-9d48-b5dab07b9e5c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:17.235689 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f1acdd61-3bd5-44ad-abaa-f69470200df6 req-3aa5da6b-bea7-43e0-bd04-7abb2fff4424 service nova] Acquiring lock "6002d2d6-f312-48bf-9f07-7fcea8c5e52d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:17.236993 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f1acdd61-3bd5-44ad-abaa-f69470200df6 req-3aa5da6b-bea7-43e0-bd04-7abb2fff4424 service nova] Lock "6002d2d6-f312-48bf-9f07-7fcea8c5e52d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:17.237473 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f1acdd61-3bd5-44ad-abaa-f69470200df6 req-3aa5da6b-bea7-43e0-bd04-7abb2fff4424 service nova] Lock "6002d2d6-f312-48bf-9f07-7fcea8c5e52d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:17.237826 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f1acdd61-3bd5-44ad-abaa-f69470200df6 req-3aa5da6b-bea7-43e0-bd04-7abb2fff4424 service nova] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] No waiting events found dispatching network-vif-plugged-191c304c-b4ad-4084-9d48-b5dab07b9e5c {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:00:17.238755 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-f1acdd61-3bd5-44ad-abaa-f69470200df6 req-3aa5da6b-bea7-43e0-bd04-7abb2fff4424 service nova] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Received unexpected event network-vif-plugged-191c304c-b4ad-4084-9d48-b5dab07b9e5c for instance with vm_state active and task_state None.
May 28 10:00:17.439849 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:17.440246 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:17.443963 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:00:17.444131 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Claim successful on node np0000001613
May 28 10:00:17.546602 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 6895009a-024f-4919-9d25-a52905eac818] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:17.557244 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962417.5553157, 6895009a-024f-4919-9d25-a52905eac818 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:00:17.557244 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 6895009a-024f-4919-9d25-a52905eac818] VM Paused (Lifecycle Event)
May 28 10:00:17.627037 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Object Instance<ef3d846c-c539-41c5-ade2-1f93e7acc2ca> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:00:17.628151 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] End _get_guest_xml xml=<domain type="qemu">
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:   <uuid>ef3d846c-c539-41c5-ade2-1f93e7acc2ca</uuid>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:   <name>instance-0000000e</name>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1211585824</nova:name>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:00:13</nova:creationTime>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:         <nova:user uuid="51981c995f2246588f2d58f35be5848a">tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member</nova:user>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:         <nova:project uuid="a9d04b105229456d9ab53df1886fdb37">tempest-ServerBootFromVolumeStableRescueTest-283762505</nova:project>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:         <nova:port uuid="613dad87-2df3-4db7-a38f-adda943e8770">
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:     <system>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:       <entry name="serial">ef3d846c-c539-41c5-ade2-1f93e7acc2ca</entry>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:       <entry name="uuid">ef3d846c-c539-41c5-ade2-1f93e7acc2ca</entry>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:     </system>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:   <os>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:   </os>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:   <features>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:   </features>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:   <devices>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/ef3d846c-c539-41c5-ade2-1f93e7acc2ca/disk.config"/>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:     </disk>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:       <alias name="ua-258c61ac-673c-4b35-b2b5-182ee3432399"/>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-0"/>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:       <serial>258c61ac-673c-4b35-b2b5-182ee3432399</serial>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:     </disk>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/ef3d846c-c539-41c5-ade2-1f93e7acc2ca/disk.rescue"/>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:       <target dev="vdb" bus="virtio"/>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:       <boot order="1"/>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:     </disk>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:03:75:e0"/>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:       <target dev="tap613dad87-2d"/>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:     </interface>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/ef3d846c-c539-41c5-ade2-1f93e7acc2ca/console.log" append="off"/>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:     </serial>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:     <video>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:     </video>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:     </rng>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:   </devices>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]: </domain>
May 28 10:00:17.628151 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:00:17.650914 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Instance destroyed successfully.
May 28 10:00:17.709833 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bd1eedd7-28eb-4eb8-87d2-f7258233ab7e tempest-TestMultiAttachVolumeSwap-193507140 tempest-TestMultiAttachVolumeSwap-193507140-project-member] [instance: 53ad56cc-eb5b-4e2e-a421-e93deee27fe7] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:18.059920 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 6895009a-024f-4919-9d25-a52905eac818] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:18.063176 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 6895009a-024f-4919-9d25-a52905eac818] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:00:18.077565 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:18.117965 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "87f6620a-fa87-4d27-8512-74215ef4fe34" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:18.119047 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "87f6620a-fa87-4d27-8512-74215ef4fe34" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:18.567045 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 6895009a-024f-4919-9d25-a52905eac818] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:00:18.621622 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:00:18.689496 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:00:18.691835 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:00:18.691835 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:00:18.691835 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] No VIF found with MAC fa:16:3e:03:75:e0, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:00:18.691835 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Using config drive
May 28 10:00:18.722283 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:19.143803 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:00:19.145507 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:00:19.197306 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lazy-loading 'ec2_ids' on Instance uuid ef3d846c-c539-41c5-ade2-1f93e7acc2ca {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:00:19.207435 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:19.232365 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:19.649225 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:00:19.703618 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Object Instance<ef3d846c-c539-41c5-ade2-1f93e7acc2ca> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:00:19.703851 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lazy-loading 'keypairs' on Instance uuid ef3d846c-c539-41c5-ade2-1f93e7acc2ca {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:00:19.756449 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "d2e043b6-afe6-4afb-92d6-7d8b33545f19" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:19.756864 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "d2e043b6-afe6-4afb-92d6-7d8b33545f19" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.005s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:19.986293 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Acquiring lock "6002d2d6-f312-48bf-9f07-7fcea8c5e52d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:19.986920 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Lock "6002d2d6-f312-48bf-9f07-7fcea8c5e52d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:20.164599 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.721s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:20.164599 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:00:20.164936 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.958s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:20.168517 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:00:20.168517 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Claim successful on node np0000001613
May 28 10:00:20.210202 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Object Instance<ef3d846c-c539-41c5-ade2-1f93e7acc2ca> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:00:20.211792 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:20.267853 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:00:20.411317 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Creating config drive at /opt/stack/data/nova/instances/ef3d846c-c539-41c5-ade2-1f93e7acc2ca/disk.config.rescue
May 28 10:00:20.417286 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ef3d846c-c539-41c5-ade2-1f93e7acc2ca/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptpbss_jo {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:20.494231 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Lazy-loading 'flavor' on Instance uuid 6002d2d6-f312-48bf-9f07-7fcea8c5e52d {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:00:20.496387 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ef3d846c-c539-41c5-ade2-1f93e7acc2ca/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptpbss_jo" returned: 0 in 0.079s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:20.673590 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:20.682514 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:00:20.682951 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:00:20.683456 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:20.683879 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:20.784394 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9297977bbf334232a4a74bd6808b863b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a85ba31f98b45b6974118c6560bbc53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:00:20.849296 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:21.017489 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:21.044536 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:21.183790 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:21.188098 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:00:21.264384 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:21.350444 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0006072890000723419 future=<Future at 0x73c1ffedd760 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:21.354396 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Emitting event <LifecycleEvent: 1779962406.3496602, 5214df33-d3dc-4932-b781-dc96b2d90a5a => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:00:21.354396 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] VM Stopped (Lifecycle Event)
May 28 10:00:21.356010 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:21.356010 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=3.994364302999884 future=<Future at 0x73c1f41725d0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:21.356010 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=3.9942128109998976 future=<Future at 0x73c1f41725d0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:21.503308 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Lock "6002d2d6-f312-48bf-9f07-7fcea8c5e52d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.516s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:21.531542 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-466a94b5-884b-4401-ac5f-6fd7bb8d87de req-553d70be-c4a0-47f2-933a-2e792d68c2cb service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Received event network-vif-plugged-613dad87-2df3-4db7-a38f-adda943e8770 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:21.531542 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-466a94b5-884b-4401-ac5f-6fd7bb8d87de req-553d70be-c4a0-47f2-933a-2e792d68c2cb service nova] Acquiring lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:21.531542 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-466a94b5-884b-4401-ac5f-6fd7bb8d87de req-553d70be-c4a0-47f2-933a-2e792d68c2cb service nova] Lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:21.531542 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-466a94b5-884b-4401-ac5f-6fd7bb8d87de req-553d70be-c4a0-47f2-933a-2e792d68c2cb service nova] Lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:21.531542 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-466a94b5-884b-4401-ac5f-6fd7bb8d87de req-553d70be-c4a0-47f2-933a-2e792d68c2cb service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] No waiting events found dispatching network-vif-plugged-613dad87-2df3-4db7-a38f-adda943e8770 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:00:21.531542 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-466a94b5-884b-4401-ac5f-6fd7bb8d87de req-553d70be-c4a0-47f2-933a-2e792d68c2cb service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Received unexpected event network-vif-plugged-613dad87-2df3-4db7-a38f-adda943e8770 for instance with vm_state active and task_state rescuing.
May 28 10:00:21.547935 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:21.654071 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:21.695799 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:00:21.859427 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 5214df33-d3dc-4932-b781-dc96b2d90a5a] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:22.012285 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:00:22.012611 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:00:22.180538 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Successfully created port: b5ee2b20-4839-4467-aa06-cd09a19252bf {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:00:22.183204 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Removed pending STOPPED event for ef3d846c-c539-41c5-ade2-1f93e7acc2ca due to new event <LifecycleEvent: 1779962422.1828363, ef3d846c-c539-41c5-ade2-1f93e7acc2ca => Resumed> {{(pid=98321) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 10:00:22.183750 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962422.1828363, ef3d846c-c539-41c5-ade2-1f93e7acc2ca => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:00:22.185688 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] VM Resumed (Lifecycle Event)
May 28 10:00:22.190598 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-5960e8fe-6199-440d-88f1-71e609b7bb23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:22.519846 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:00:22.632120 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Acquiring lock "6002d2d6-f312-48bf-9f07-7fcea8c5e52d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:22.632397 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Lock "6002d2d6-f312-48bf-9f07-7fcea8c5e52d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:22.632737 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Attaching volume 0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f to /dev/vdb
May 28 10:00:22.692381 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:22.694823 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:00:22.696992 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:00:22.715123 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:00:22.719738 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:00:22.725241 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:00:22.725582 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Creating image(s)
May 28 10:00:22.726691 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9fd8989-d182-47e4-9409-266a1440bf58/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:22.726924 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "/opt/stack/data/nova/instances/f9fd8989-d182-47e4-9409-266a1440bf58/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:22.727588 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "/opt/stack/data/nova/instances/f9fd8989-d182-47e4-9409-266a1440bf58/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:22.728380 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:00:22.738062 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:00:22.742558 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:22.762537 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:22.797032 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3764a07f-da41-4f82-8c87-765dc58241dd req-a150d463-e690-4465-9821-e5141793d158 service nova] [instance: 6895009a-024f-4919-9d25-a52905eac818] Received event network-vif-plugged-8ec1ac70-71ab-4f36-93a8-fd51f9c08833 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:22.800408 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3764a07f-da41-4f82-8c87-765dc58241dd req-a150d463-e690-4465-9821-e5141793d158 service nova] Acquiring lock "6895009a-024f-4919-9d25-a52905eac818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:22.802672 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3764a07f-da41-4f82-8c87-765dc58241dd req-a150d463-e690-4465-9821-e5141793d158 service nova] Lock "6895009a-024f-4919-9d25-a52905eac818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:22.803302 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3764a07f-da41-4f82-8c87-765dc58241dd req-a150d463-e690-4465-9821-e5141793d158 service nova] Lock "6895009a-024f-4919-9d25-a52905eac818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:22.803587 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3764a07f-da41-4f82-8c87-765dc58241dd req-a150d463-e690-4465-9821-e5141793d158 service nova] [instance: 6895009a-024f-4919-9d25-a52905eac818] Processing event network-vif-plugged-8ec1ac70-71ab-4f36-93a8-fd51f9c08833 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:00:22.805209 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Instance event wait completed in 5 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:00:22.810017 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:00:22.810426 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:00:22.812356 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:00:22.816355 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 6895009a-024f-4919-9d25-a52905eac818] Instance spawned successfully.
May 28 10:00:22.816784 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:00:22.823668 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:00:22.824954 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe95:8bd3', 'fe80::fc16:3eff:fe2d:94a4', 'fe80::fc96:34ff:fe12:e4df', 'fe80::2844:59ff:feec:5d21', 'fe80::fc16:3eff:fe7a:26b6', 'fe80::fc16:3eff:fe05:61f2', 'fe80::fc16:3eff:feae:5417', 'fe80::fc16:3eff:fe94:1895', 'fe80::b0d6:b8ff:fe22:7266', 'fe80::fc16:3eff:fefd:30e7', 'fe80::e4df:c0ff:fe86:6341', 'fe80::fc16:3eff:fe03:75e0'] 
May 28 10:00:22.825072 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:00:22.825171 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:00:22.825405 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:00:22.825611 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Updating existing volume attachment record: d26eb21e-6f54-4c53-91bc-14961b1f6df5 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:00:22.836911 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.094s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:22.839684 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:22.840113 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:22.843650 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:00:22.849516 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:00:22.850288 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:22.998806 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.148s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:23.002179 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/f9fd8989-d182-47e4-9409-266a1440bf58/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:23.038418 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.873s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:23.039496 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:00:23.045236 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.196s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:23.052942 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:00:23.053190 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Claim successful on node np0000001613
May 28 10:00:23.074926 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/f9fd8989-d182-47e4-9409-266a1440bf58/disk 1073741824" returned: 0 in 0.075s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:23.075591 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:23.075879 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:23.182220 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.106s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:23.184009 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f9fd8989-d182-47e4-9409-266a1440bf58/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:00:23.184009 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9fd8989-d182-47e4-9409-266a1440bf58/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:23.204038 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962423.2007608, ef3d846c-c539-41c5-ade2-1f93e7acc2ca => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:00:23.204782 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] VM Started (Lifecycle Event)
May 28 10:00:23.304088 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9fd8989-d182-47e4-9409-266a1440bf58/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:23.306556 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Cannot resize image /opt/stack/data/nova/instances/f9fd8989-d182-47e4-9409-266a1440bf58/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:00:23.306556 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:00:23.306556 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Ensure instance console log exists: /opt/stack/data/nova/instances/f9fd8989-d182-47e4-9409-266a1440bf58/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:00:23.306556 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:23.306556 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:23.306556 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:23.330225 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:23.330225 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:23.330225 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:23.330225 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:23.330225 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:23.330225 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:23.427424 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:00:23.429960 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f', 'iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:00:23.430416 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:00:23.430900 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:00:23.431122 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f', 'iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:00:23.455633 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:00:23.457364 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:00:23.458140 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:00:23.458452 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:00:23.459646 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:00:23.460267 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:00:23.482368 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:00:23.482368 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:23.496542 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:00:23.496542 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:23.500405 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f] added
May 28 10:00:23.500405 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:00:23.500405 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:00:23.500405 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:00:23.500405 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:00:23.500405 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:00:23.500405 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:23.500405 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:00:23.501268 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0415(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:00:23.501664 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:00:23.512801 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f] added
May 28 10:00:23.512801 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:00:23.512801 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:00:23.512801 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:00:23.512801 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:00:23.512801 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:00:23.512801 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:23.513077 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:00:23.513204 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.053(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:00:23.513358 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:00:23.534324 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Successfully updated port: b5ee2b20-4839-4467-aa06-cd09a19252bf {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:00:23.554766 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:00:23.555032 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:00:23.555571 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:23.557760 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:23.716947 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:23.726648 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '45c67299cd204090b9ebf7e0eb873e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5fc8bc5d1984c1c839a3ef7e30b9d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:00:23.726648 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:00:23.798717 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:23.811582 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-052c27ea-f40e-437b-ab62-31ec439f7727 req-ab413079-7920-4d39-bbdf-2ab7f3f357ed service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Received event network-vif-plugged-613dad87-2df3-4db7-a38f-adda943e8770 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:23.811940 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-052c27ea-f40e-437b-ab62-31ec439f7727 req-ab413079-7920-4d39-bbdf-2ab7f3f357ed service nova] Acquiring lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:23.812049 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-052c27ea-f40e-437b-ab62-31ec439f7727 req-ab413079-7920-4d39-bbdf-2ab7f3f357ed service nova] Lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:23.812218 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-052c27ea-f40e-437b-ab62-31ec439f7727 req-ab413079-7920-4d39-bbdf-2ab7f3f357ed service nova] Lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:23.812312 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-052c27ea-f40e-437b-ab62-31ec439f7727 req-ab413079-7920-4d39-bbdf-2ab7f3f357ed service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] No waiting events found dispatching network-vif-plugged-613dad87-2df3-4db7-a38f-adda943e8770 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:00:23.812408 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-052c27ea-f40e-437b-ab62-31ec439f7727 req-ab413079-7920-4d39-bbdf-2ab7f3f357ed service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Received unexpected event network-vif-plugged-613dad87-2df3-4db7-a38f-adda943e8770 for instance with vm_state rescued and task_state None.
May 28 10:00:23.835145 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Took 20.77 seconds to spawn the instance on the hypervisor.
May 28 10:00:23.835959 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:24.036950 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "refresh_cache-f9fd8989-d182-47e4-9409-266a1440bf58" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:00:24.036950 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquired lock "refresh_cache-f9fd8989-d182-47e4-9409-266a1440bf58" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:00:24.037217 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:00:24.057770 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:00:24.230493 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962424.2301226, 6895009a-024f-4919-9d25-a52905eac818 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:00:24.230692 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 6895009a-024f-4919-9d25-a52905eac818] VM Resumed (Lifecycle Event)
May 28 10:00:24.236742 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:24.347997 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Took 30.17 seconds to build instance.
May 28 10:00:24.372562 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-d383a064-24f7-4526-9243-bebf4e370629 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Unrescuing
May 28 10:00:24.374111 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d383a064-24f7-4526-9243-bebf4e370629 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "refresh_cache-ef3d846c-c539-41c5-ade2-1f93e7acc2ca" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:00:24.374111 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d383a064-24f7-4526-9243-bebf4e370629 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquired lock "refresh_cache-ef3d846c-c539-41c5-ade2-1f93e7acc2ca" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:00:24.374111 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d383a064-24f7-4526-9243-bebf4e370629 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:00:24.502083 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:00:24.514076 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:00:24.525050 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:00:24.525050 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:00:24.538994 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:00:24.538994 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:24.544652 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:24.563120 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:24.564216 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:00:24.572696 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:24.572696 np0000001613 nova-compute[98321]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:24.572696 np0000001613 nova-compute[98321]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:24.572696 np0000001613 nova-compute[98321]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:24.572696 np0000001613 nova-compute[98321]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:24.572696 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:24.572696 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:24.572696 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:24.572696 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:00:24.574994 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:24.574994 np0000001613 nova-compute[98321]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:24.574994 np0000001613 nova-compute[98321]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:24.574994 np0000001613 nova-compute[98321]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:24.574994 np0000001613 nova-compute[98321]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:24.574994 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:24.574994 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:24.574994 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:24.574994 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:00:24.589817 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:24.589817 np0000001613 nova-compute[98321]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:24.589817 np0000001613 nova-compute[98321]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:24.589817 np0000001613 nova-compute[98321]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:24.589817 np0000001613 nova-compute[98321]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:24.589817 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:24.589817 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:24.589817 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:24.589817 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:00:24.589817 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:24.589817 np0000001613 nova-compute[98321]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:24.589817 np0000001613 nova-compute[98321]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:24.589817 np0000001613 nova-compute[98321]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:24.589817 np0000001613 nova-compute[98321]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:24.589817 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:24.589817 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:24.589817 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:24.589817 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:00:24.636432 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f, portal: 192.168.50.100,3260]
May 28 10:00:24.636432 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f, portal: 192.168.50.100,3260] successful.
May 28 10:00:24.636432 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:24.643646 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Successfully created port: 6ac6cb03-1362-4f61-8f2d-3ae856d28f49 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:00:24.659710 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f, portal: 192.168.40.100,3260]
May 28 10:00:24.659710 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f, portal: 192.168.40.100,3260] successful.
May 28 10:00:24.659710 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:24.660672 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:24.666479 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:00:24.684319 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:24.697322 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:24.697322 np0000001613 nova-compute[98321]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:24.697322 np0000001613 nova-compute[98321]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:24.697322 np0000001613 nova-compute[98321]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:24.697322 np0000001613 nova-compute[98321]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:24.697322 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:24.697322 np0000001613 nova-compute[98321]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f (non-flash)
May 28 10:00:24.697322 np0000001613 nova-compute[98321]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f (non-flash)
May 28 10:00:24.697322 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:24.697322 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:24.697322 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:00:24.697322 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:24.697322 np0000001613 nova-compute[98321]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:24.697322 np0000001613 nova-compute[98321]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:24.697322 np0000001613 nova-compute[98321]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:24.697322 np0000001613 nova-compute[98321]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:24.697322 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:24.697322 np0000001613 nova-compute[98321]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f (non-flash)
May 28 10:00:24.697322 np0000001613 nova-compute[98321]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f (non-flash)
May 28 10:00:24.697322 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:24.697322 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:24.697322 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:00:24.697322 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.239s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:00:24.702456 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:00:24.702456 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] HCTL ('15', '-', '-', 0) found on session 31 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:00:24.702456 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:00:24.712737 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:24.712737 np0000001613 nova-compute[98321]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:24.712737 np0000001613 nova-compute[98321]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:24.712737 np0000001613 nova-compute[98321]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:24.712737 np0000001613 nova-compute[98321]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:24.712737 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:24.712737 np0000001613 nova-compute[98321]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f (non-flash)
May 28 10:00:24.712737 np0000001613 nova-compute[98321]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f (non-flash)
May 28 10:00:24.712737 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:24.712737 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:24.712737 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:00:24.713123 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:24.713123 np0000001613 nova-compute[98321]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:24.713123 np0000001613 nova-compute[98321]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:24.713123 np0000001613 nova-compute[98321]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:24.713123 np0000001613 nova-compute[98321]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:24.713123 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:24.713123 np0000001613 nova-compute[98321]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f (non-flash)
May 28 10:00:24.713123 np0000001613 nova-compute[98321]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f (non-flash)
May 28 10:00:24.713123 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:24.713123 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:24.713123 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:00:24.715314 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.255s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:00:24.715550 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:00:24.719291 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] HCTL ('16', '-', '-', 0) found on session 32 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:00:24.719291 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:00:24.732293 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Searching for a device in session 31 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:00:24.732293 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:00:24.735290 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 6895009a-024f-4919-9d25-a52905eac818] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:24.745205 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 6895009a-024f-4919-9d25-a52905eac818] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:00:24.760565 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Searching for a device in session 32 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:00:24.760565 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:00:24.850617 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "6895009a-024f-4919-9d25-a52905eac818" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.684s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:24.878606 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-d383a064-24f7-4526-9243-bebf4e370629 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:24.918147 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:00:24.918446 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:00:24.943681 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-1315c0d8-6704-4f37-a805-b63e03b7cffb req-b47718d5-b521-45ce-abae-f9f31c934daa service nova] [instance: 6895009a-024f-4919-9d25-a52905eac818] Received event network-vif-plugged-8ec1ac70-71ab-4f36-93a8-fd51f9c08833 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:24.943882 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1315c0d8-6704-4f37-a805-b63e03b7cffb req-b47718d5-b521-45ce-abae-f9f31c934daa service nova] Acquiring lock "6895009a-024f-4919-9d25-a52905eac818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:24.944046 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1315c0d8-6704-4f37-a805-b63e03b7cffb req-b47718d5-b521-45ce-abae-f9f31c934daa service nova] Lock "6895009a-024f-4919-9d25-a52905eac818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:24.944226 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1315c0d8-6704-4f37-a805-b63e03b7cffb req-b47718d5-b521-45ce-abae-f9f31c934daa service nova] Lock "6895009a-024f-4919-9d25-a52905eac818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:24.944436 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-1315c0d8-6704-4f37-a805-b63e03b7cffb req-b47718d5-b521-45ce-abae-f9f31c934daa service nova] [instance: 6895009a-024f-4919-9d25-a52905eac818] No waiting events found dispatching network-vif-plugged-8ec1ac70-71ab-4f36-93a8-fd51f9c08833 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:00:24.944519 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-1315c0d8-6704-4f37-a805-b63e03b7cffb req-b47718d5-b521-45ce-abae-f9f31c934daa service nova] [instance: 6895009a-024f-4919-9d25-a52905eac818] Received unexpected event network-vif-plugged-8ec1ac70-71ab-4f36-93a8-fd51f9c08833 for instance with vm_state active and task_state None.
May 28 10:00:24.944652 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-1315c0d8-6704-4f37-a805-b63e03b7cffb req-b47718d5-b521-45ce-abae-f9f31c934daa service nova] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Received event network-changed-b5ee2b20-4839-4467-aa06-cd09a19252bf {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:24.944790 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-1315c0d8-6704-4f37-a805-b63e03b7cffb req-b47718d5-b521-45ce-abae-f9f31c934daa service nova] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Refreshing instance network info cache due to event network-changed-b5ee2b20-4839-4467-aa06-cd09a19252bf. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:00:24.944959 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1315c0d8-6704-4f37-a805-b63e03b7cffb req-b47718d5-b521-45ce-abae-f9f31c934daa service nova] Acquiring lock "refresh_cache-f9fd8989-d182-47e4-9409-266a1440bf58" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:00:25.038194 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:25.259793 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Updating instance_info_cache with network_info: [{"id": "b5ee2b20-4839-4467-aa06-cd09a19252bf", "address": "fa:16:3e:0f:9f:68", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ee2b20-48", "ovs_interfaceid": "b5ee2b20-4839-4467-aa06-cd09a19252bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:00:25.353526 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0033804700001383026 future=<Future at 0x73c1f41725d0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:25.353688 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:25.412192 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-d383a064-24f7-4526-9243-bebf4e370629 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:25.424106 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:00:25.460645 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:00:25.576411 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Successfully updated port: 6ac6cb03-1362-4f61-8f2d-3ae856d28f49 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:00:25.581571 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:00:25.582605 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:00:25.583019 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Creating image(s)
May 28 10:00:25.583494 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "/opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:25.583708 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "/opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:25.584339 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "/opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:25.584986 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:00:25.589445 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:00:25.591215 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:25.672749 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c27a2a02-8458-4c3d-adb4-6086432f5f9f req-feb8a627-cedb-49cd-a1e8-cd49ca5d735f service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Received event network-changed-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:25.672865 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c27a2a02-8458-4c3d-adb4-6086432f5f9f req-feb8a627-cedb-49cd-a1e8-cd49ca5d735f service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Refreshing instance network info cache due to event network-changed-6ac6cb03-1362-4f61-8f2d-3ae856d28f49. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:00:25.673157 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c27a2a02-8458-4c3d-adb4-6086432f5f9f req-feb8a627-cedb-49cd-a1e8-cd49ca5d735f service nova] Acquiring lock "refresh_cache-87f6620a-fa87-4d27-8512-74215ef4fe34" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:00:25.673329 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c27a2a02-8458-4c3d-adb4-6086432f5f9f req-feb8a627-cedb-49cd-a1e8-cd49ca5d735f service nova] Acquired lock "refresh_cache-87f6620a-fa87-4d27-8512-74215ef4fe34" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:00:25.675254 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-c27a2a02-8458-4c3d-adb4-6086432f5f9f req-feb8a627-cedb-49cd-a1e8-cd49ca5d735f service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Refreshing network info cache for port 6ac6cb03-1362-4f61-8f2d-3ae856d28f49 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:00:25.720805 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.129s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:25.723822 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:25.723822 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:25.723822 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:00:25.726176 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:00:25.726600 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:25.764921 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Releasing lock "refresh_cache-f9fd8989-d182-47e4-9409-266a1440bf58" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:00:25.766399 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Instance network_info: |[{"id": "b5ee2b20-4839-4467-aa06-cd09a19252bf", "address": "fa:16:3e:0f:9f:68", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ee2b20-48", "ovs_interfaceid": "b5ee2b20-4839-4467-aa06-cd09a19252bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:00:25.772735 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1315c0d8-6704-4f37-a805-b63e03b7cffb req-b47718d5-b521-45ce-abae-f9f31c934daa service nova] Acquired lock "refresh_cache-f9fd8989-d182-47e4-9409-266a1440bf58" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:00:25.772735 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-1315c0d8-6704-4f37-a805-b63e03b7cffb req-b47718d5-b521-45ce-abae-f9f31c934daa service nova] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Refreshing network info cache for port b5ee2b20-4839-4467-aa06-cd09a19252bf {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:00:25.775319 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Start _get_guest_xml network_info=[{"id": "b5ee2b20-4839-4467-aa06-cd09a19252bf", "address": "fa:16:3e:0f:9f:68", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ee2b20-48", "ovs_interfaceid": "b5ee2b20-4839-4467-aa06-cd09a19252bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:00:25.786932 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d383a064-24f7-4526-9243-bebf4e370629 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Updating instance_info_cache with network_info: [{"id": "613dad87-2df3-4db7-a38f-adda943e8770", "address": "fa:16:3e:03:75:e0", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap613dad87-2d", "ovs_interfaceid": "613dad87-2df3-4db7-a38f-adda943e8770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:00:25.792818 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:00:25.794227 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-86745832', uuid='f9fd8989-d182-47e4-9409-266a1440bf58'), owner=OwnerMeta(userid='9297977bbf334232a4a74bd6808b863b', username='tempest-AttachVolumeNegativeTest-775348461-project-member', projectid='9a85ba31f98b45b6974118c6560bbc53', projectname='tempest-AttachVolumeNegativeTest-775348461'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b5ee2b20-4839-4467-aa06-cd09a19252bf", "address": "fa:16:3e:0f:9f:68", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ee2b20-48", "ovs_interfaceid": "b5ee2b20-4839-4467-aa06-cd09a19252bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962425.7938166) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:00:25.795883 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:00:25.796293 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:00:25.798482 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:00:25.798759 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:00:25.799908 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:00:25.800279 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:00:25.800433 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:00:25.800522 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:00:25.800645 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:00:25.800730 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:00:25.800825 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:00:25.802588 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:00:25.802588 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:00:25.802588 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:00:25.802588 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:00:25.802588 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:00:25.815208 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:00:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-86745832',display_name='tempest-AttachVolumeNegativeTest-server-86745832',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumenegativetest-server-86745832',id=18,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjr7/2MSqqVwrs28eG/a+bcR/VwOiSGqWlrHCYSfji/7M/g+Mfwk1esX+OfaMVPgHZBUmBkKY2bBrwCeGZl+UC4ih0v0XxSxYAHy82LELkL6DJA+t0CZOdRTnQGOQXb9g==',key_name='tempest-keypair-728059437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a85ba31f98b45b6974118c6560bbc53',ramdisk_id='',reservation_id='r-a0o556d4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-775348461',owner_user_name='tempest-AttachVolumeNegativeTest-775348461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:00:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9297977bbf334232a4a74bd6808b863b',uuid=f9fd8989-d182-47e4-9409-266a1440bf58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5ee2b20-4839-4467-aa06-cd09a19252bf", "address": "fa:16:3e:0f:9f:68", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ee2b20-48", "ovs_interfaceid": "b5ee2b20-4839-4467-aa06-cd09a19252bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:00:25.815687 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Converting VIF {"id": "b5ee2b20-4839-4467-aa06-cd09a19252bf", "address": "fa:16:3e:0f:9f:68", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ee2b20-48", "ovs_interfaceid": "b5ee2b20-4839-4467-aa06-cd09a19252bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:00:25.816367 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:9f:68,bridge_name='br-int',has_traffic_filtering=True,id=b5ee2b20-4839-4467-aa06-cd09a19252bf,network=Network(bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5ee2b20-48') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:00:25.817124 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lazy-loading 'pci_devices' on Instance uuid f9fd8989-d182-47e4-9409-266a1440bf58 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:00:25.854179 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.127s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:25.854776 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:25.933233 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34/disk 1073741824" returned: 0 in 0.077s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:25.937215 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:25.942024 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.895s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:25.943921 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:25.956956 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:00:26.034226 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.092s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:26.034731 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Checking if we can resize image /opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:00:26.035048 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:26.080843 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "refresh_cache-87f6620a-fa87-4d27-8512-74215ef4fe34" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:00:26.155376 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:26.155376 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Cannot resize image /opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:00:26.155676 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:00:26.155818 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Ensure instance console log exists: /opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:00:26.156396 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:26.157068 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:26.157068 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:26.181877 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-c27a2a02-8458-4c3d-adb4-6086432f5f9f req-feb8a627-cedb-49cd-a1e8-cd49ca5d735f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:26.279590 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-1315c0d8-6704-4f37-a805-b63e03b7cffb req-b47718d5-b521-45ce-abae-f9f31c934daa service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:26.287428 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-c27a2a02-8458-4c3d-adb4-6086432f5f9f req-feb8a627-cedb-49cd-a1e8-cd49ca5d735f service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:00:26.293357 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d383a064-24f7-4526-9243-bebf4e370629 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Releasing lock "refresh_cache-ef3d846c-c539-41c5-ade2-1f93e7acc2ca" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:00:26.294122 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-d383a064-24f7-4526-9243-bebf4e370629 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lazy-loading 'flavor' on Instance uuid ef3d846c-c539-41c5-ade2-1f93e7acc2ca {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:00:26.321541 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] End _get_guest_xml xml=<domain type="qemu">
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:   <uuid>f9fd8989-d182-47e4-9409-266a1440bf58</uuid>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:   <name>instance-00000012</name>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:       <nova:name>tempest-AttachVolumeNegativeTest-server-86745832</nova:name>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:00:25</nova:creationTime>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:         <nova:user uuid="9297977bbf334232a4a74bd6808b863b">tempest-AttachVolumeNegativeTest-775348461-project-member</nova:user>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:         <nova:project uuid="9a85ba31f98b45b6974118c6560bbc53">tempest-AttachVolumeNegativeTest-775348461</nova:project>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:         <nova:port uuid="b5ee2b20-4839-4467-aa06-cd09a19252bf">
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:     <system>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:       <entry name="serial">f9fd8989-d182-47e4-9409-266a1440bf58</entry>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:       <entry name="uuid">f9fd8989-d182-47e4-9409-266a1440bf58</entry>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:     </system>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:   <os>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:   </os>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:   <features>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:   </features>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:   <devices>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/f9fd8989-d182-47e4-9409-266a1440bf58/disk"/>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:     </disk>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/f9fd8989-d182-47e4-9409-266a1440bf58/disk.config"/>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:     </disk>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:0f:9f:68"/>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:       <target dev="tapb5ee2b20-48"/>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:     </interface>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/f9fd8989-d182-47e4-9409-266a1440bf58/console.log" append="off"/>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:     </serial>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:     <video>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:     </video>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:     </rng>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:   </devices>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]: </domain>
May 28 10:00:26.321541 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:00:26.327904 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Preparing to wait for external event network-vif-plugged-b5ee2b20-4839-4467-aa06-cd09a19252bf {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:00:26.327904 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "f9fd8989-d182-47e4-9409-266a1440bf58-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:26.327904 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "f9fd8989-d182-47e4-9409-266a1440bf58-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:26.327904 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "f9fd8989-d182-47e4-9409-266a1440bf58-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:26.327904 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:00:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-86745832',display_name='tempest-AttachVolumeNegativeTest-server-86745832',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumenegativetest-server-86745832',id=18,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjr7/2MSqqVwrs28eG/a+bcR/VwOiSGqWlrHCYSfji/7M/g+Mfwk1esX+OfaMVPgHZBUmBkKY2bBrwCeGZl+UC4ih0v0XxSxYAHy82LELkL6DJA+t0CZOdRTnQGOQXb9g==',key_name='tempest-keypair-728059437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a85ba31f98b45b6974118c6560bbc53',ramdisk_id='',reservation_id='r-a0o556d4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-775348461',owner_user_name='tempest-AttachVolumeNegativeTest-775348461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:00:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9297977bbf334232a4a74bd6808b863b',uuid=f9fd8989-d182-47e4-9409-266a1440bf58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5ee2b20-4839-4467-aa06-cd09a19252bf", "address": "fa:16:3e:0f:9f:68", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ee2b20-48", "ovs_interfaceid": "b5ee2b20-4839-4467-aa06-cd09a19252bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:00:26.327904 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Converting VIF {"id": "b5ee2b20-4839-4467-aa06-cd09a19252bf", "address": "fa:16:3e:0f:9f:68", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ee2b20-48", "ovs_interfaceid": "b5ee2b20-4839-4467-aa06-cd09a19252bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:00:26.327904 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:9f:68,bridge_name='br-int',has_traffic_filtering=True,id=b5ee2b20-4839-4467-aa06-cd09a19252bf,network=Network(bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5ee2b20-48') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:00:26.327904 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:9f:68,bridge_name='br-int',has_traffic_filtering=True,id=b5ee2b20-4839-4467-aa06-cd09a19252bf,network=Network(bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5ee2b20-48') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:00:26.327904 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:26.329527 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:26.329527 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:00:26.331179 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:26.331448 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9fb40e43-72b7-5456-8a81-287684d82e85', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:26.332420 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:26.333333 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:00:26.335789 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:26.344076 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:26.344076 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5ee2b20-48, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:26.344280 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb5ee2b20-48, col_values=(('qos', UUID('fbcdf85b-34af-464f-823b-6e0ca2ea3e5b')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:26.344473 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb5ee2b20-48, col_values=(('external_ids', {'iface-id': 'b5ee2b20-4839-4467-aa06-cd09a19252bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:9f:68', 'vm-uuid': 'f9fd8989-d182-47e4-9409-266a1440bf58'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:26.348886 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:00:26.357005 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:26.359477 np0000001613 nova-compute[98321]: INFO os_vif [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:9f:68,bridge_name='br-int',has_traffic_filtering=True,id=b5ee2b20-4839-4467-aa06-cd09a19252bf,network=Network(bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5ee2b20-48')
May 28 10:00:26.468469 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:00:26.470135 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:00:26.470666 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:26.472303 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:26.486922 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Found WWN 330000000ceefecf2 for multipath device dm-8 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:00:26.487362 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.056s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:00:26.487605 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] <== connect_volume: return (3056ms) {'type': 'block', 'scsi_wwn': '330000000ceefecf2', 'path': '/dev/dm-8', 'multipath_id': '330000000ceefecf2'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:00:26.487758 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ceefecf2', 'path': '/dev/dm-8', 'multipath_id': '330000000ceefecf2'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:00:26.493929 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Lazy-loading 'flavor' on Instance uuid 6002d2d6-f312-48bf-9f07-7fcea8c5e52d {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:00:26.751924 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '45c67299cd204090b9ebf7e0eb873e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5fc8bc5d1984c1c839a3ef7e30b9d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:00:26.776552 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-c27a2a02-8458-4c3d-adb4-6086432f5f9f req-feb8a627-cedb-49cd-a1e8-cd49ca5d735f service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:00:26.843660 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:26.868920 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:26.981399 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:00:26.999386 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Attempting to attach volume 0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 10:00:27.001906 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] attach device xml: <disk type="block" device="disk">
May 28 10:00:27.001906 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:00:27.001906 np0000001613 nova-compute[98321]:   <alias name="ua-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f"/>
May 28 10:00:27.001906 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-8"/>
May 28 10:00:27.001906 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:00:27.001906 np0000001613 nova-compute[98321]:   <serial>0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f</serial>
May 28 10:00:27.001906 np0000001613 nova-compute[98321]: </disk>
May 28 10:00:27.001906 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 10:00:27.035866 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:27.049511 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:27.195887 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-1315c0d8-6704-4f37-a805-b63e03b7cffb req-b47718d5-b521-45ce-abae-f9f31c934daa service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:27.219994 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-99d184b9-7c83-4e3b-bf53-0611024b416d req-f3a9f2ce-62b1-4dbf-ac9b-5880ef140559 service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Received event network-vif-unplugged-613dad87-2df3-4db7-a38f-adda943e8770 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:27.220236 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-99d184b9-7c83-4e3b-bf53-0611024b416d req-f3a9f2ce-62b1-4dbf-ac9b-5880ef140559 service nova] Acquiring lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:27.220458 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-99d184b9-7c83-4e3b-bf53-0611024b416d req-f3a9f2ce-62b1-4dbf-ac9b-5880ef140559 service nova] Lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:27.220571 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-99d184b9-7c83-4e3b-bf53-0611024b416d req-f3a9f2ce-62b1-4dbf-ac9b-5880ef140559 service nova] Lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:27.220748 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-99d184b9-7c83-4e3b-bf53-0611024b416d req-f3a9f2ce-62b1-4dbf-ac9b-5880ef140559 service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] No waiting events found dispatching network-vif-unplugged-613dad87-2df3-4db7-a38f-adda943e8770 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:00:27.220925 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-99d184b9-7c83-4e3b-bf53-0611024b416d req-f3a9f2ce-62b1-4dbf-ac9b-5880ef140559 service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Received unexpected event network-vif-unplugged-613dad87-2df3-4db7-a38f-adda943e8770 for instance with vm_state rescued and task_state unrescuing.
May 28 10:00:27.280256 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c27a2a02-8458-4c3d-adb4-6086432f5f9f req-feb8a627-cedb-49cd-a1e8-cd49ca5d735f service nova] Releasing lock "refresh_cache-87f6620a-fa87-4d27-8512-74215ef4fe34" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:00:27.281177 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquired lock "refresh_cache-87f6620a-fa87-4d27-8512-74215ef4fe34" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:00:27.281692 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:00:27.362465 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999498185999983 future=<Future at 0x73c1f41e87d0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:27.363058 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.998186165000106 future=<Future at 0x73c1f41e87d0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:27.363336 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.99805672399998 future=<Future at 0x73c1f41e87d0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:27.382863 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Instance destroyed successfully.
May 28 10:00:27.383125 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-d383a064-24f7-4526-9243-bebf4e370629 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lazy-loading 'numa_topology' on Instance uuid ef3d846c-c539-41c5-ade2-1f93e7acc2ca {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:00:27.497049 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:00:27.528240 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-1315c0d8-6704-4f37-a805-b63e03b7cffb req-b47718d5-b521-45ce-abae-f9f31c934daa service nova] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Updated VIF entry in instance network info cache for port b5ee2b20-4839-4467-aa06-cd09a19252bf. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:00:27.535939 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-1315c0d8-6704-4f37-a805-b63e03b7cffb req-b47718d5-b521-45ce-abae-f9f31c934daa service nova] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Updating instance_info_cache with network_info: [{"id": "b5ee2b20-4839-4467-aa06-cd09a19252bf", "address": "fa:16:3e:0f:9f:68", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ee2b20-48", "ovs_interfaceid": "b5ee2b20-4839-4467-aa06-cd09a19252bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:00:27.585086 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Successfully created port: f58856d7-37d0-48f5-8883-32267e5b73bc {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:00:27.879808 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:00:27.880298 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:00:27.880298 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] No VIF found with MAC fa:16:3e:0f:9f:68, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:00:27.880609 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Using config drive
May 28 10:00:27.887652 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-d383a064-24f7-4526-9243-bebf4e370629 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Object Instance<ef3d846c-c539-41c5-ade2-1f93e7acc2ca> lazy-loaded attributes: flavor,numa_topology {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:00:28.042096 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1315c0d8-6704-4f37-a805-b63e03b7cffb req-b47718d5-b521-45ce-abae-f9f31c934daa service nova] Releasing lock "refresh_cache-f9fd8989-d182-47e4-9409-266a1440bf58" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:00:28.168118 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:00:28.375791 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Successfully updated port: f58856d7-37d0-48f5-8883-32267e5b73bc {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:00:28.389520 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:28.448744 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:28.488876 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:28.491451 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:28.511513 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:00:28.516101 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:00:28.516450 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Creating image(s)
May 28 10:00:28.517096 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "/opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:28.517345 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "/opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:28.518190 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "/opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:28.519247 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:00:28.525889 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:00:28.527220 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:28.601978 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f2c9a10f-3918-4ba3-8155-20339b12a389 req-bf5d2243-432b-4d25-bb98-20465bb427f6 service nova] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Received event network-changed-f58856d7-37d0-48f5-8883-32267e5b73bc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:28.603796 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f2c9a10f-3918-4ba3-8155-20339b12a389 req-bf5d2243-432b-4d25-bb98-20465bb427f6 service nova] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Refreshing instance network info cache due to event network-changed-f58856d7-37d0-48f5-8883-32267e5b73bc. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:00:28.603796 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f2c9a10f-3918-4ba3-8155-20339b12a389 req-bf5d2243-432b-4d25-bb98-20465bb427f6 service nova] Acquiring lock "refresh_cache-d2e043b6-afe6-4afb-92d6-7d8b33545f19" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:00:28.603796 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f2c9a10f-3918-4ba3-8155-20339b12a389 req-bf5d2243-432b-4d25-bb98-20465bb427f6 service nova] Acquired lock "refresh_cache-d2e043b6-afe6-4afb-92d6-7d8b33545f19" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:00:28.603796 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-f2c9a10f-3918-4ba3-8155-20339b12a389 req-bf5d2243-432b-4d25-bb98-20465bb427f6 service nova] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Refreshing network info cache for port f58856d7-37d0-48f5-8883-32267e5b73bc {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:00:28.616824 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:28.636412 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.109s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:28.638563 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:28.639089 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:28.639688 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:00:28.646621 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:00:28.647749 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:28.704875 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:28.718625 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:28.748982 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:00:28.748982 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:00:28.748982 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:00:28.748982 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] No VIF found with MAC fa:16:3e:94:18:95, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:00:28.783294 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.134s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:28.783294 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:28.851060 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk 1073741824" returned: 0 in 0.068s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:28.852624 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:28.853695 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:28.882006 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "refresh_cache-d2e043b6-afe6-4afb-92d6-7d8b33545f19" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:00:28.910125 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Creating config drive at /opt/stack/data/nova/instances/f9fd8989-d182-47e4-9409-266a1440bf58/disk.config
May 28 10:00:28.918866 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f9fd8989-d182-47e4-9409-266a1440bf58/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpi9j_2s6h {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:28.971093 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.117s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:28.971245 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:00:28.971538 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:28.996404 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f9fd8989-d182-47e4-9409-266a1440bf58/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpi9j_2s6h" returned: 0 in 0.076s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:29.001083 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:29.095269 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:29.096223 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Cannot resize image /opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:00:29.096554 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:00:29.096720 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Ensure instance console log exists: /opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:00:29.098533 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:29.098806 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:29.099103 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:29.108531 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-f2c9a10f-3918-4ba3-8155-20339b12a389 req-bf5d2243-432b-4d25-bb98-20465bb427f6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:29.220397 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Updating instance_info_cache with network_info: [{"id": "6ac6cb03-1362-4f61-8f2d-3ae856d28f49", "address": "fa:16:3e:86:60:4b", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac6cb03-13", "ovs_interfaceid": "6ac6cb03-1362-4f61-8f2d-3ae856d28f49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:00:29.244192 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:29.256490 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-f2c9a10f-3918-4ba3-8155-20339b12a389 req-bf5d2243-432b-4d25-bb98-20465bb427f6 service nova] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:00:29.387219 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6c8350ab-b7b9-4fb3-a075-f74d9de9f4e0 req-57d3a909-c169-42d2-9c15-923300eb0d0f service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Received event network-vif-unplugged-613dad87-2df3-4db7-a38f-adda943e8770 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:29.389390 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6c8350ab-b7b9-4fb3-a075-f74d9de9f4e0 req-57d3a909-c169-42d2-9c15-923300eb0d0f service nova] Acquiring lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:29.390354 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6c8350ab-b7b9-4fb3-a075-f74d9de9f4e0 req-57d3a909-c169-42d2-9c15-923300eb0d0f service nova] Lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:29.390354 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6c8350ab-b7b9-4fb3-a075-f74d9de9f4e0 req-57d3a909-c169-42d2-9c15-923300eb0d0f service nova] Lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:29.390354 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6c8350ab-b7b9-4fb3-a075-f74d9de9f4e0 req-57d3a909-c169-42d2-9c15-923300eb0d0f service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] No waiting events found dispatching network-vif-unplugged-613dad87-2df3-4db7-a38f-adda943e8770 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:00:29.390354 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-6c8350ab-b7b9-4fb3-a075-f74d9de9f4e0 req-57d3a909-c169-42d2-9c15-923300eb0d0f service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Received unexpected event network-vif-unplugged-613dad87-2df3-4db7-a38f-adda943e8770 for instance with vm_state rescued and task_state unrescuing.
May 28 10:00:29.390354 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6c8350ab-b7b9-4fb3-a075-f74d9de9f4e0 req-57d3a909-c169-42d2-9c15-923300eb0d0f service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Received event network-vif-plugged-613dad87-2df3-4db7-a38f-adda943e8770 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:29.390602 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6c8350ab-b7b9-4fb3-a075-f74d9de9f4e0 req-57d3a909-c169-42d2-9c15-923300eb0d0f service nova] Acquiring lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:29.390668 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6c8350ab-b7b9-4fb3-a075-f74d9de9f4e0 req-57d3a909-c169-42d2-9c15-923300eb0d0f service nova] Lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:29.391135 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6c8350ab-b7b9-4fb3-a075-f74d9de9f4e0 req-57d3a909-c169-42d2-9c15-923300eb0d0f service nova] Lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:29.391135 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6c8350ab-b7b9-4fb3-a075-f74d9de9f4e0 req-57d3a909-c169-42d2-9c15-923300eb0d0f service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] No waiting events found dispatching network-vif-plugged-613dad87-2df3-4db7-a38f-adda943e8770 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:00:29.391303 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-6c8350ab-b7b9-4fb3-a075-f74d9de9f4e0 req-57d3a909-c169-42d2-9c15-923300eb0d0f service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Received unexpected event network-vif-plugged-613dad87-2df3-4db7-a38f-adda943e8770 for instance with vm_state rescued and task_state unrescuing.
May 28 10:00:29.516448 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-f2c9a10f-3918-4ba3-8155-20339b12a389 req-bf5d2243-432b-4d25-bb98-20465bb427f6 service nova] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:00:29.631295 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:29.658798 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d383a064-24f7-4526-9243-bebf4e370629 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:29.660492 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Removed pending STOPPED event for ef3d846c-c539-41c5-ade2-1f93e7acc2ca due to new event <LifecycleEvent: 1779962429.66007, ef3d846c-c539-41c5-ade2-1f93e7acc2ca => Resumed> {{(pid=98321) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 10:00:29.660669 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962429.66007, ef3d846c-c539-41c5-ade2-1f93e7acc2ca => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:00:29.660838 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] VM Resumed (Lifecycle Event)
May 28 10:00:29.669609 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:29.673208 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:29.723810 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Releasing lock "refresh_cache-87f6620a-fa87-4d27-8512-74215ef4fe34" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:00:29.724065 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Instance network_info: |[{"id": "6ac6cb03-1362-4f61-8f2d-3ae856d28f49", "address": "fa:16:3e:86:60:4b", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac6cb03-13", "ovs_interfaceid": "6ac6cb03-1362-4f61-8f2d-3ae856d28f49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:00:29.726319 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Start _get_guest_xml network_info=[{"id": "6ac6cb03-1362-4f61-8f2d-3ae856d28f49", "address": "fa:16:3e:86:60:4b", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac6cb03-13", "ovs_interfaceid": "6ac6cb03-1362-4f61-8f2d-3ae856d28f49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:00:29.745564 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:00:29.748571 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1834037810', uuid='87f6620a-fa87-4d27-8512-74215ef4fe34'), owner=OwnerMeta(userid='45c67299cd204090b9ebf7e0eb873e37', username='tempest-ServerRescueNegativeTestJSON-1286552851-project-member', projectid='f5fc8bc5d1984c1c839a3ef7e30b9d36', projectname='tempest-ServerRescueNegativeTestJSON-1286552851'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6ac6cb03-1362-4f61-8f2d-3ae856d28f49", "address": "fa:16:3e:86:60:4b", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac6cb03-13", "ovs_interfaceid": "6ac6cb03-1362-4f61-8f2d-3ae856d28f49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962429.7481027) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:00:29.752649 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:00:29.755457 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:00:29.759287 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:00:29.759287 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:00:29.761331 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:00:29.762113 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:00:29.763202 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:00:29.763946 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:00:29.763946 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:00:29.763946 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:00:29.763946 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:00:29.764548 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:00:29.772523 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:00:29.772523 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:00:29.772523 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:00:29.773711 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:00:29.794925 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:29.813057 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:00:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1834037810',display_name='tempest-ServerRescueNegativeTestJSON-server-1834037810',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serverrescuenegativetestjson-server-1834037810',id=19,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5fc8bc5d1984c1c839a3ef7e30b9d36',ramdisk_id='',reservation_id='r-ieli90wk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1286552851',owner_user_name='tempest-ServerRescueNegativeTestJSON-1286552851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:00:25Z,user_data=None,user_id='45c67299cd204090b9ebf7e0eb873e37',uuid=87f6620a-fa87-4d27-8512-74215ef4fe34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ac6cb03-1362-4f61-8f2d-3ae856d28f49", "address": "fa:16:3e:86:60:4b", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac6cb03-13", "ovs_interfaceid": "6ac6cb03-1362-4f61-8f2d-3ae856d28f49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:00:29.816057 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Converting VIF {"id": "6ac6cb03-1362-4f61-8f2d-3ae856d28f49", "address": "fa:16:3e:86:60:4b", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac6cb03-13", "ovs_interfaceid": "6ac6cb03-1362-4f61-8f2d-3ae856d28f49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:00:29.817153 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:60:4b,bridge_name='br-int',has_traffic_filtering=True,id=6ac6cb03-1362-4f61-8f2d-3ae856d28f49,network=Network(729946be-b963-4dfb-ad38-335762a8666c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ac6cb03-13') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:00:29.818063 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lazy-loading 'pci_devices' on Instance uuid 87f6620a-fa87-4d27-8512-74215ef4fe34 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:00:29.909035 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "b50eced2-71bf-4448-b2e1-f9657509f34c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:29.909523 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "b50eced2-71bf-4448-b2e1-f9657509f34c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:30.024790 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f2c9a10f-3918-4ba3-8155-20339b12a389 req-bf5d2243-432b-4d25-bb98-20465bb427f6 service nova] Releasing lock "refresh_cache-d2e043b6-afe6-4afb-92d6-7d8b33545f19" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:00:30.025783 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquired lock "refresh_cache-d2e043b6-afe6-4afb-92d6-7d8b33545f19" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:00:30.025988 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:00:30.165992 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:30.167407 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:30.176685 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:30.178804 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:30.184618 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:30.201485 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:00:30.207552 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:30.325941 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] End _get_guest_xml xml=<domain type="qemu">
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:   <uuid>87f6620a-fa87-4d27-8512-74215ef4fe34</uuid>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:   <name>instance-00000013</name>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1834037810</nova:name>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:00:29</nova:creationTime>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:         <nova:user uuid="45c67299cd204090b9ebf7e0eb873e37">tempest-ServerRescueNegativeTestJSON-1286552851-project-member</nova:user>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:         <nova:project uuid="f5fc8bc5d1984c1c839a3ef7e30b9d36">tempest-ServerRescueNegativeTestJSON-1286552851</nova:project>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:         <nova:port uuid="6ac6cb03-1362-4f61-8f2d-3ae856d28f49">
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:     <system>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:       <entry name="serial">87f6620a-fa87-4d27-8512-74215ef4fe34</entry>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:       <entry name="uuid">87f6620a-fa87-4d27-8512-74215ef4fe34</entry>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:     </system>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:   <os>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:   </os>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:   <features>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:   </features>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:   <devices>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34/disk"/>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:     </disk>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34/disk.config"/>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:     </disk>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:86:60:4b"/>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:       <target dev="tap6ac6cb03-13"/>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:     </interface>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34/console.log" append="off"/>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:     </serial>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:     <video>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:     </video>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:     </rng>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:   </devices>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]: </domain>
May 28 10:00:30.325941 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:00:30.325941 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Preparing to wait for external event network-vif-plugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:00:30.325941 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:30.325941 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:30.325941 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:30.330962 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:00:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1834037810',display_name='tempest-ServerRescueNegativeTestJSON-server-1834037810',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serverrescuenegativetestjson-server-1834037810',id=19,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5fc8bc5d1984c1c839a3ef7e30b9d36',ramdisk_id='',reservation_id='r-ieli90wk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1286552851',owner_user_name='tempest-ServerRescueNegativeTestJSON-1286552851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:00:25Z,user_data=None,user_id='45c67299cd204090b9ebf7e0eb873e37',uuid=87f6620a-fa87-4d27-8512-74215ef4fe34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ac6cb03-1362-4f61-8f2d-3ae856d28f49", "address": "fa:16:3e:86:60:4b", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac6cb03-13", "ovs_interfaceid": "6ac6cb03-1362-4f61-8f2d-3ae856d28f49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:00:30.330962 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Converting VIF {"id": "6ac6cb03-1362-4f61-8f2d-3ae856d28f49", "address": "fa:16:3e:86:60:4b", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac6cb03-13", "ovs_interfaceid": "6ac6cb03-1362-4f61-8f2d-3ae856d28f49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:00:30.330962 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:60:4b,bridge_name='br-int',has_traffic_filtering=True,id=6ac6cb03-1362-4f61-8f2d-3ae856d28f49,network=Network(729946be-b963-4dfb-ad38-335762a8666c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ac6cb03-13') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:00:30.330962 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:60:4b,bridge_name='br-int',has_traffic_filtering=True,id=6ac6cb03-1362-4f61-8f2d-3ae856d28f49,network=Network(729946be-b963-4dfb-ad38-335762a8666c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ac6cb03-13') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:00:30.330962 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:30.330962 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:30.330962 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:00:30.335343 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:30.335489 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f8dc3cdc-eec1-5a95-b930-6e142490eb4e', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:30.346656 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:30.347294 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:00:30.353195 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:30.355095 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ac6cb03-13, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:30.355792 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6ac6cb03-13, col_values=(('qos', UUID('e7a4a45c-37c3-400e-9dac-db1ab6cc75da')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:30.358210 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6ac6cb03-13, col_values=(('external_ids', {'iface-id': '6ac6cb03-1362-4f61-8f2d-3ae856d28f49', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:60:4b', 'vm-uuid': '87f6620a-fa87-4d27-8512-74215ef4fe34'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:30.361356 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:00:30.371573 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:30.374350 np0000001613 nova-compute[98321]: INFO os_vif [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:60:4b,bridge_name='br-int',has_traffic_filtering=True,id=6ac6cb03-1362-4f61-8f2d-3ae856d28f49,network=Network(729946be-b963-4dfb-ad38-335762a8666c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ac6cb03-13')
May 28 10:00:30.413933 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:00:30.436875 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e0781d0f-6e4a-4d48-9e99-90e7907c750b tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Lock "6002d2d6-f312-48bf-9f07-7fcea8c5e52d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.804s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:30.650474 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:00:30.711832 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962430.7105799, ef3d846c-c539-41c5-ade2-1f93e7acc2ca => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:00:30.712030 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] VM Started (Lifecycle Event)
May 28 10:00:30.718820 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Acquiring lock "6002d2d6-f312-48bf-9f07-7fcea8c5e52d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:30.719007 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Lock "6002d2d6-f312-48bf-9f07-7fcea8c5e52d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:30.719123 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Acquiring lock "6002d2d6-f312-48bf-9f07-7fcea8c5e52d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:30.719302 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Lock "6002d2d6-f312-48bf-9f07-7fcea8c5e52d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:30.719376 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Lock "6002d2d6-f312-48bf-9f07-7fcea8c5e52d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:30.721813 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Terminating instance
May 28 10:00:30.898779 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:30.898960 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:30.899385 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:30.899385 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:30.899558 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:30.902019 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Terminating instance
May 28 10:00:30.917104 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:31.019776 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:31.020038 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:31.023556 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:00:31.023855 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Claim successful on node np0000001613
May 28 10:00:31.124746 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Updating instance_info_cache with network_info: [{"id": "f58856d7-37d0-48f5-8883-32267e5b73bc", "address": "fa:16:3e:e0:9c:cd", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf58856d7-37", "ovs_interfaceid": "f58856d7-37d0-48f5-8883-32267e5b73bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:00:31.197063 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:31.216196 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:31.218438 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: deleting, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:00:31.227194 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:00:31.264197 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:31.264977 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:31.290216 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:31.298231 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:31.334651 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:31.408419 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:00:31.455430 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:31.460366 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:31.486014 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:31.517256 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-bccc9d35-e889-493a-b0a1-4a8dbe36d663 req-4558c96e-0a34-4c56-b6aa-636c2683b066 service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Received event network-vif-plugged-613dad87-2df3-4db7-a38f-adda943e8770 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:31.518290 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-bccc9d35-e889-493a-b0a1-4a8dbe36d663 req-4558c96e-0a34-4c56-b6aa-636c2683b066 service nova] Acquiring lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:31.518290 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-bccc9d35-e889-493a-b0a1-4a8dbe36d663 req-4558c96e-0a34-4c56-b6aa-636c2683b066 service nova] Lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:31.518290 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-bccc9d35-e889-493a-b0a1-4a8dbe36d663 req-4558c96e-0a34-4c56-b6aa-636c2683b066 service nova] Lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:31.518290 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-bccc9d35-e889-493a-b0a1-4a8dbe36d663 req-4558c96e-0a34-4c56-b6aa-636c2683b066 service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] No waiting events found dispatching network-vif-plugged-613dad87-2df3-4db7-a38f-adda943e8770 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:00:31.519083 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-bccc9d35-e889-493a-b0a1-4a8dbe36d663 req-4558c96e-0a34-4c56-b6aa-636c2683b066 service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Received unexpected event network-vif-plugged-613dad87-2df3-4db7-a38f-adda943e8770 for instance with vm_state active and task_state deleting.
May 28 10:00:31.519277 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-bccc9d35-e889-493a-b0a1-4a8dbe36d663 req-4558c96e-0a34-4c56-b6aa-636c2683b066 service nova] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Received event network-vif-plugged-b5ee2b20-4839-4467-aa06-cd09a19252bf {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:31.519851 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-bccc9d35-e889-493a-b0a1-4a8dbe36d663 req-4558c96e-0a34-4c56-b6aa-636c2683b066 service nova] Acquiring lock "f9fd8989-d182-47e4-9409-266a1440bf58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:31.520104 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-bccc9d35-e889-493a-b0a1-4a8dbe36d663 req-4558c96e-0a34-4c56-b6aa-636c2683b066 service nova] Lock "f9fd8989-d182-47e4-9409-266a1440bf58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:31.520364 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-bccc9d35-e889-493a-b0a1-4a8dbe36d663 req-4558c96e-0a34-4c56-b6aa-636c2683b066 service nova] Lock "f9fd8989-d182-47e4-9409-266a1440bf58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:31.520476 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-bccc9d35-e889-493a-b0a1-4a8dbe36d663 req-4558c96e-0a34-4c56-b6aa-636c2683b066 service nova] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Processing event network-vif-plugged-b5ee2b20-4839-4467-aa06-cd09a19252bf {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:00:31.520667 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-bccc9d35-e889-493a-b0a1-4a8dbe36d663 req-4558c96e-0a34-4c56-b6aa-636c2683b066 service nova] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Received event network-vif-plugged-b5ee2b20-4839-4467-aa06-cd09a19252bf {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:31.520826 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-bccc9d35-e889-493a-b0a1-4a8dbe36d663 req-4558c96e-0a34-4c56-b6aa-636c2683b066 service nova] Acquiring lock "f9fd8989-d182-47e4-9409-266a1440bf58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:31.520988 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-bccc9d35-e889-493a-b0a1-4a8dbe36d663 req-4558c96e-0a34-4c56-b6aa-636c2683b066 service nova] Lock "f9fd8989-d182-47e4-9409-266a1440bf58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:31.521119 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-bccc9d35-e889-493a-b0a1-4a8dbe36d663 req-4558c96e-0a34-4c56-b6aa-636c2683b066 service nova] Lock "f9fd8989-d182-47e4-9409-266a1440bf58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:31.521283 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-bccc9d35-e889-493a-b0a1-4a8dbe36d663 req-4558c96e-0a34-4c56-b6aa-636c2683b066 service nova] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] No waiting events found dispatching network-vif-plugged-b5ee2b20-4839-4467-aa06-cd09a19252bf {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:00:31.521424 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-bccc9d35-e889-493a-b0a1-4a8dbe36d663 req-4558c96e-0a34-4c56-b6aa-636c2683b066 service nova] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Received unexpected event network-vif-plugged-b5ee2b20-4839-4467-aa06-cd09a19252bf for instance with vm_state building and task_state spawning.
May 28 10:00:31.522094 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:00:31.529472 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:00:31.538969 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Instance spawned successfully.
May 28 10:00:31.538969 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:00:31.621671 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Instance destroyed successfully.
May 28 10:00:31.621810 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Lazy-loading 'resources' on Instance uuid 6002d2d6-f312-48bf-9f07-7fcea8c5e52d {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:00:31.629388 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Releasing lock "refresh_cache-d2e043b6-afe6-4afb-92d6-7d8b33545f19" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:00:31.631363 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Instance network_info: |[{"id": "f58856d7-37d0-48f5-8883-32267e5b73bc", "address": "fa:16:3e:e0:9c:cd", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf58856d7-37", "ovs_interfaceid": "f58856d7-37d0-48f5-8883-32267e5b73bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:00:31.636000 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Start _get_guest_xml network_info=[{"id": "f58856d7-37d0-48f5-8883-32267e5b73bc", "address": "fa:16:3e:e0:9c:cd", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf58856d7-37", "ovs_interfaceid": "f58856d7-37d0-48f5-8883-32267e5b73bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:00:31.651125 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:00:31.653257 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-246966041', uuid='d2e043b6-afe6-4afb-92d6-7d8b33545f19'), owner=OwnerMeta(userid='45c67299cd204090b9ebf7e0eb873e37', username='tempest-ServerRescueNegativeTestJSON-1286552851-project-member', projectid='f5fc8bc5d1984c1c839a3ef7e30b9d36', projectname='tempest-ServerRescueNegativeTestJSON-1286552851'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f58856d7-37d0-48f5-8883-32267e5b73bc", "address": "fa:16:3e:e0:9c:cd", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf58856d7-37", "ovs_interfaceid": "f58856d7-37d0-48f5-8883-32267e5b73bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962431.651865) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:00:31.664192 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-fd4fd181-b04a-4b81-b884-3cfc968aa5cb req-83549aaa-5693-4709-bc0c-cabf9f704f8d service nova] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Received event network-vif-unplugged-191c304c-b4ad-4084-9d48-b5dab07b9e5c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:31.666186 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-fd4fd181-b04a-4b81-b884-3cfc968aa5cb req-83549aaa-5693-4709-bc0c-cabf9f704f8d service nova] Acquiring lock "6002d2d6-f312-48bf-9f07-7fcea8c5e52d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:31.666186 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-fd4fd181-b04a-4b81-b884-3cfc968aa5cb req-83549aaa-5693-4709-bc0c-cabf9f704f8d service nova] Lock "6002d2d6-f312-48bf-9f07-7fcea8c5e52d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:31.666186 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-fd4fd181-b04a-4b81-b884-3cfc968aa5cb req-83549aaa-5693-4709-bc0c-cabf9f704f8d service nova] Lock "6002d2d6-f312-48bf-9f07-7fcea8c5e52d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:31.666186 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-fd4fd181-b04a-4b81-b884-3cfc968aa5cb req-83549aaa-5693-4709-bc0c-cabf9f704f8d service nova] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] No waiting events found dispatching network-vif-unplugged-191c304c-b4ad-4084-9d48-b5dab07b9e5c {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:00:31.666186 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-fd4fd181-b04a-4b81-b884-3cfc968aa5cb req-83549aaa-5693-4709-bc0c-cabf9f704f8d service nova] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Received event network-vif-unplugged-191c304c-b4ad-4084-9d48-b5dab07b9e5c for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:00:31.666895 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:00:31.667122 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:00:31.669294 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:00:31.670698 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:00:31.670809 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:00:31.671555 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:00:31.671555 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:00:31.671555 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:00:31.671817 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:00:31.673048 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:00:31.673421 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:00:31.674410 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:00:31.676135 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:00:31.676467 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:00:31.676659 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:00:31.676875 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:00:31.696966 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-246966041',display_name='tempest-ServerRescueNegativeTestJSON-server-246966041',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serverrescuenegativetestjson-server-246966041',id=20,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5fc8bc5d1984c1c839a3ef7e30b9d36',ramdisk_id='',reservation_id='r-i9h0da26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1286552851',owner_user_name='tempest-ServerRescueNegativeTestJSON-1286552851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:00:28Z,user_data=None,user_id='45c67299cd204090b9ebf7e0eb873e37',uuid=d2e043b6-afe6-4afb-92d6-7d8b33545f19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f58856d7-37d0-48f5-8883-32267e5b73bc", "address": "fa:16:3e:e0:9c:cd", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf58856d7-37", "ovs_interfaceid": "f58856d7-37d0-48f5-8883-32267e5b73bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:00:31.696966 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Converting VIF {"id": "f58856d7-37d0-48f5-8883-32267e5b73bc", "address": "fa:16:3e:e0:9c:cd", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf58856d7-37", "ovs_interfaceid": "f58856d7-37d0-48f5-8883-32267e5b73bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:00:31.696966 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:9c:cd,bridge_name='br-int',has_traffic_filtering=True,id=f58856d7-37d0-48f5-8883-32267e5b73bc,network=Network(729946be-b963-4dfb-ad38-335762a8666c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf58856d7-37') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:00:31.697310 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lazy-loading 'pci_devices' on Instance uuid d2e043b6-afe6-4afb-92d6-7d8b33545f19 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:00:31.706892 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:31.721004 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] During sync_power_state the instance has a pending task (deleting). Skip.
May 28 10:00:31.721306 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962431.7210846, f9fd8989-d182-47e4-9409-266a1440bf58 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:00:31.721469 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] VM Started (Lifecycle Event)
May 28 10:00:31.727543 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:31.786679 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Instance destroyed successfully.
May 28 10:00:31.787386 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lazy-loading 'resources' on Instance uuid ef3d846c-c539-41c5-ade2-1f93e7acc2ca {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:00:31.903260 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:00:31.903397 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:00:31.903547 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] No VIF found with MAC fa:16:3e:86:60:4b, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:00:31.904073 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Using config drive
May 28 10:00:32.046266 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:32.048555 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:32.048555 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:32.048555 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:32.048555 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:32.048555 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:32.128356 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:59:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-300551735',display_name='tempest-DeleteServersTestJSON-server-300551735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-deleteserverstestjson-server-300551735',id=17,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:00:16Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0098401beaa4ad0967c1b5cfc2f61f8',ramdisk_id='',reservation_id='r-2h4xn2z2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-152188913',owner_user_name='tempest-DeleteServersTestJSON-152188913-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:00:16Z,user_data=None,user_id='e96e96039e43475a8bbea8acb05d67f7',uuid=6002d2d6-f312-48bf-9f07-7fcea8c5e52d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "191c304c-b4ad-4084-9d48-b5dab07b9e5c", "address": "fa:16:3e:94:18:95", "network": {"id": "ed5c028e-ea22-4128-b280-20aed5f49bd8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1268885172-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0098401beaa4ad0967c1b5cfc2f61f8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap191c304c-b4", "ovs_interfaceid": "191c304c-b4ad-4084-9d48-b5dab07b9e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:00:32.128602 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Converting VIF {"id": "191c304c-b4ad-4084-9d48-b5dab07b9e5c", "address": "fa:16:3e:94:18:95", "network": {"id": "ed5c028e-ea22-4128-b280-20aed5f49bd8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1268885172-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0098401beaa4ad0967c1b5cfc2f61f8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap191c304c-b4", "ovs_interfaceid": "191c304c-b4ad-4084-9d48-b5dab07b9e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:00:32.129376 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:18:95,bridge_name='br-int',has_traffic_filtering=True,id=191c304c-b4ad-4084-9d48-b5dab07b9e5c,network=Network(ed5c028e-ea22-4128-b280-20aed5f49bd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap191c304c-b4') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:00:32.129679 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:18:95,bridge_name='br-int',has_traffic_filtering=True,id=191c304c-b4ad-4084-9d48-b5dab07b9e5c,network=Network(ed5c028e-ea22-4128-b280-20aed5f49bd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap191c304c-b4') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:00:32.137221 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:32.137553 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap191c304c-b4, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:32.138720 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:32.139653 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:00:32.151779 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:32.153108 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:32.153379 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f79fb6b2-567a-47c5-ae86-6e1f336dae3a) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:32.153800 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:32.155230 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:00:32.171462 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:32.176204 np0000001613 nova-compute[98321]: INFO os_vif [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:18:95,bridge_name='br-int',has_traffic_filtering=True,id=191c304c-b4ad-4084-9d48-b5dab07b9e5c,network=Network(ed5c028e-ea22-4128-b280-20aed5f49bd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap191c304c-b4')
May 28 10:00:32.186769 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:00:32.187198 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f', 'iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:00:32.187396 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:00:32.188527 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:00:32.188527 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f', 'iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:00:32.188527 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:00:32.200143 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] End _get_guest_xml xml=<domain type="qemu">
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:   <uuid>d2e043b6-afe6-4afb-92d6-7d8b33545f19</uuid>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:   <name>instance-00000014</name>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-246966041</nova:name>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:00:31</nova:creationTime>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:         <nova:user uuid="45c67299cd204090b9ebf7e0eb873e37">tempest-ServerRescueNegativeTestJSON-1286552851-project-member</nova:user>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:         <nova:project uuid="f5fc8bc5d1984c1c839a3ef7e30b9d36">tempest-ServerRescueNegativeTestJSON-1286552851</nova:project>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:         <nova:port uuid="f58856d7-37d0-48f5-8883-32267e5b73bc">
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:     <system>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:       <entry name="serial">d2e043b6-afe6-4afb-92d6-7d8b33545f19</entry>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:       <entry name="uuid">d2e043b6-afe6-4afb-92d6-7d8b33545f19</entry>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:     </system>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:   <os>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:   </os>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:   <features>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:   </features>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:   <devices>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk"/>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:     </disk>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk.config"/>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:     </disk>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:e0:9c:cd"/>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:       <target dev="tapf58856d7-37"/>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:     </interface>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/console.log" append="off"/>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:     </serial>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:     <video>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:     </video>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:     </rng>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:   </devices>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]: </domain>
May 28 10:00:32.200143 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:00:32.203902 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Preparing to wait for external event network-vif-plugged-f58856d7-37d0-48f5-8883-32267e5b73bc {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:00:32.203902 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "d2e043b6-afe6-4afb-92d6-7d8b33545f19-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:32.203902 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "d2e043b6-afe6-4afb-92d6-7d8b33545f19-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:32.203902 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "d2e043b6-afe6-4afb-92d6-7d8b33545f19-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:32.203902 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-246966041',display_name='tempest-ServerRescueNegativeTestJSON-server-246966041',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serverrescuenegativetestjson-server-246966041',id=20,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5fc8bc5d1984c1c839a3ef7e30b9d36',ramdisk_id='',reservation_id='r-i9h0da26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1286552851',owner_user_name='tempest-ServerRescueNegativeTestJSON-1286552851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:00:28Z,user_data=None,user_id='45c67299cd204090b9ebf7e0eb873e37',uuid=d2e043b6-afe6-4afb-92d6-7d8b33545f19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f58856d7-37d0-48f5-8883-32267e5b73bc", "address": "fa:16:3e:e0:9c:cd", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf58856d7-37", "ovs_interfaceid": "f58856d7-37d0-48f5-8883-32267e5b73bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:00:32.203902 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Converting VIF {"id": "f58856d7-37d0-48f5-8883-32267e5b73bc", "address": "fa:16:3e:e0:9c:cd", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf58856d7-37", "ovs_interfaceid": "f58856d7-37d0-48f5-8883-32267e5b73bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:00:32.203902 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:9c:cd,bridge_name='br-int',has_traffic_filtering=True,id=f58856d7-37d0-48f5-8883-32267e5b73bc,network=Network(729946be-b963-4dfb-ad38-335762a8666c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf58856d7-37') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:00:32.205060 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:9c:cd,bridge_name='br-int',has_traffic_filtering=True,id=f58856d7-37d0-48f5-8883-32267e5b73bc,network=Network(729946be-b963-4dfb-ad38-335762a8666c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf58856d7-37') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:00:32.205060 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:32.207302 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:32.207302 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:00:32.213515 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:32.214176 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '36eb7eef-71f2-53b1-ba5b-de40ebefe47e', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:32.218577 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:32.218577 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:00:32.225115 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:32.228691 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:00:32.231979 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:32.239664 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:32.240108 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf58856d7-37, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:32.240837 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf58856d7-37, col_values=(('qos', UUID('f6f6ff9a-35ec-46f6-9905-8ae84ea5d689')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:32.240837 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf58856d7-37, col_values=(('external_ids', {'iface-id': 'f58856d7-37d0-48f5-8883-32267e5b73bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:9c:cd', 'vm-uuid': 'd2e043b6-afe6-4afb-92d6-7d8b33545f19'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:32.243856 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:32.251548 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:32.251548 np0000001613 nova-compute[98321]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:32.251548 np0000001613 nova-compute[98321]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:32.251548 np0000001613 nova-compute[98321]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:32.251548 np0000001613 nova-compute[98321]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:32.251548 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:32.251548 np0000001613 nova-compute[98321]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f (non-flash)
May 28 10:00:32.251548 np0000001613 nova-compute[98321]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f (non-flash)
May 28 10:00:32.251548 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:32.251548 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:32.251548 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:00:32.252846 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:32.252846 np0000001613 nova-compute[98321]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:32.252846 np0000001613 nova-compute[98321]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:32.252846 np0000001613 nova-compute[98321]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:32.252846 np0000001613 nova-compute[98321]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:32.252846 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:32.252846 np0000001613 nova-compute[98321]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f (non-flash)
May 28 10:00:32.252846 np0000001613 nova-compute[98321]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f (non-flash)
May 28 10:00:32.252846 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:32.252846 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:32.252846 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:00:32.255521 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f', '32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', '6')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:00:32.255521 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f', '32')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:00:32.255521 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f', '31')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:00:32.256264 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:00:32.257993 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1f4344680>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f'): ({'sdj'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:00:32.259080 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Removing multipathed devices sdj, sdk {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:00:32.259837 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Flush multipath device 330000000ceefecf2 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:00:32.293953 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:00:32.295322 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:59:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1211585824',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serverbootfromvolumestablerescuetest-server-1211585824',id=14,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:00:22Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9d04b105229456d9ab53df1886fdb37',ramdisk_id='',reservation_id='r-iqn0w26d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-283762505',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:00:30Z,user_data=None,user_id='51981c995f2246588f2d58f35be5848a',uuid=ef3d846c-c539-41c5-ade2-1f93e7acc2ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "613dad87-2df3-4db7-a38f-adda943e8770", "address": "fa:16:3e:03:75:e0", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap613dad87-2d", "ovs_interfaceid": "613dad87-2df3-4db7-a38f-adda943e8770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:00:32.295817 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Converting VIF {"id": "613dad87-2df3-4db7-a38f-adda943e8770", "address": "fa:16:3e:03:75:e0", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap613dad87-2d", "ovs_interfaceid": "613dad87-2df3-4db7-a38f-adda943e8770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:00:32.296590 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:75:e0,bridge_name='br-int',has_traffic_filtering=True,id=613dad87-2df3-4db7-a38f-adda943e8770,network=Network(e5543f88-c716-4e02-82e9-2cb7570bf25e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap613dad87-2d') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:00:32.296937 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:75:e0,bridge_name='br-int',has_traffic_filtering=True,id=613dad87-2df3-4db7-a38f-adda943e8770,network=Network(e5543f88-c716-4e02-82e9-2cb7570bf25e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap613dad87-2d') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:00:32.320791 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:32.320791 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:32.320791 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap613dad87-2d, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:32.320791 np0000001613 nova-compute[98321]: INFO os_vif [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:9c:cd,bridge_name='br-int',has_traffic_filtering=True,id=f58856d7-37d0-48f5-8883-32267e5b73bc,network=Network(729946be-b963-4dfb-ad38-335762a8666c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf58856d7-37')
May 28 10:00:32.322214 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:32.326251 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:00:32.330227 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:00:32.336595 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:32.338748 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:32.339077 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=434c3d66-1967-4fc2-9e7e-bcaa7ecdd276) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:32.341066 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:32.344717 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:00:32.361221 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:32.370266 np0000001613 nova-compute[98321]: INFO os_vif [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:75:e0,bridge_name='br-int',has_traffic_filtering=True,id=613dad87-2df3-4db7-a38f-adda943e8770,network=Network(e5543f88-c716-4e02-82e9-2cb7570bf25e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap613dad87-2d')
May 28 10:00:32.370266 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:00:32.370266 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399', 'iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '258c61ac-673c-4b35-b2b5-182ee3432399', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:00:32.370266 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:00:32.377767 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:00:32.378013 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:00:32.381325 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:00:32.403774 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:00:32.404236 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:00:32.412998 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:32.425952 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:32.467436 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f, portal: 192.168.40.100,3260]
May 28 10:00:32.467436 np0000001613 nova-compute[98321]: Logout of [sid: 32, target: iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f, portal: 192.168.40.100,3260] successful.
May 28 10:00:32.467436 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:32.501015 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:32.521531 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:32.556135 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Took 9.83 seconds to spawn the instance on the hypervisor.
May 28 10:00:32.556844 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:32.570204 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f, portal: 192.168.50.100,3260]
May 28 10:00:32.570204 np0000001613 nova-compute[98321]: Logout of [sid: 31, target: iqn.2023-03.storpool.com:os--volume-0e77613d-5392-4ac1-b5b1-9cd8e6c57c7f, portal: 192.168.50.100,3260] successful.
May 28 10:00:32.570204 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:32.600826 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:32.600826 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.413s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:00:32.604001 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.232s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:00:32.604001 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] <== disconnect_volume: return (413ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:00:32.604001 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:00:32.604001 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Deleting instance files /opt/stack/data/nova/instances/6002d2d6-f312-48bf-9f07-7fcea8c5e52d_del
May 28 10:00:32.604001 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Deletion of /opt/stack/data/nova/instances/6002d2d6-f312-48bf-9f07-7fcea8c5e52d_del complete
May 28 10:00:32.605902 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399', 'iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '258c61ac-673c-4b35-b2b5-182ee3432399', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:00:32.606053 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:00:32.649588 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:32.649588 np0000001613 nova-compute[98321]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:32.649588 np0000001613 nova-compute[98321]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:32.649588 np0000001613 nova-compute[98321]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:32.649588 np0000001613 nova-compute[98321]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:32.649588 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:32.649588 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:32.649588 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:32.649588 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:00:32.650003 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:32.650003 np0000001613 nova-compute[98321]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399 (non-flash)
May 28 10:00:32.650003 np0000001613 nova-compute[98321]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:32.650003 np0000001613 nova-compute[98321]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:32.650003 np0000001613 nova-compute[98321]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:32.650003 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:32.650003 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:32.650003 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:32.650003 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:00:32.650305 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', '6')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:00:32.650411 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399', '25')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:00:32.652522 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399', '26')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:00:32.655713 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1f4717740>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399'): ({'sdc'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:00:32.657485 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Removing multipathed devices sdb, sdc {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:00:32.657485 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Flush multipath device 3300000006b5aa7c9 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:00:32.705715 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:00:32.731405 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:00:32.733649 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962432.7322426, f9fd8989-d182-47e4-9409-266a1440bf58 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:00:32.733649 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] VM Paused (Lifecycle Event)
May 28 10:00:32.747995 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:00:32.794814 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:00:32.794814 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:00:32.794814 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:00:32.808759 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:00:32.809266 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:00:32.822941 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:32.857106 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399, portal: 192.168.40.100,3260]
May 28 10:00:32.857106 np0000001613 nova-compute[98321]: Logout of [sid: 25, target: iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399, portal: 192.168.40.100,3260] successful.
May 28 10:00:32.857106 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:32.879534 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:32.894823 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:32.941246 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399, portal: 192.168.50.100,3260]
May 28 10:00:32.941246 np0000001613 nova-compute[98321]: Logout of [sid: 26, target: iqn.2023-03.storpool.com:os--volume-258c61ac-673c-4b35-b2b5-182ee3432399, portal: 192.168.50.100,3260] successful.
May 28 10:00:32.941246 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:32.968133 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:32.968469 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:00:32.968822 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] <== disconnect_volume: return (599ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:00:32.968980 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:00:32.970109 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Deleting instance files /opt/stack/data/nova/instances/ef3d846c-c539-41c5-ade2-1f93e7acc2ca_del
May 28 10:00:32.970695 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Deletion of /opt/stack/data/nova/instances/ef3d846c-c539-41c5-ade2-1f93e7acc2ca_del complete
May 28 10:00:32.993378 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:00:32.993649 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:00:33.075930 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Took 15.69 seconds to build instance.
May 28 10:00:33.115179 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Took 1.89 seconds to destroy the instance on the hypervisor.
May 28 10:00:33.116114 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:00:33.116603 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:00:33.116603 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:00:33.116866 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:33.136274 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Creating config drive at /opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34/disk.config
May 28 10:00:33.140232 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpb4_s9y3s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:33.212005 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpb4_s9y3s" returned: 0 in 0.071s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:33.237600 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:33.242025 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962433.2415197, f9fd8989-d182-47e4-9409-266a1440bf58 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:00:33.242461 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] VM Resumed (Lifecycle Event)
May 28 10:00:33.481120 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Took 2.07 seconds to destroy the instance on the hypervisor.
May 28 10:00:33.482484 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:00:33.482739 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:00:33.482870 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:00:33.483296 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:33.499141 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:00:33.578241 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-346e058c-5b82-41ba-b945-3d4cd8c8acd2 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "f9fd8989-d182-47e4-9409-266a1440bf58" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.213s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:33.624903 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2409ddf8-3b83-48f7-9e73-c3710ac5fc41 req-2cc135bf-9f6a-44e2-b016-acd632acb077 service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Received event network-vif-unplugged-613dad87-2df3-4db7-a38f-adda943e8770 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:33.624903 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2409ddf8-3b83-48f7-9e73-c3710ac5fc41 req-2cc135bf-9f6a-44e2-b016-acd632acb077 service nova] Acquiring lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:33.625235 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2409ddf8-3b83-48f7-9e73-c3710ac5fc41 req-2cc135bf-9f6a-44e2-b016-acd632acb077 service nova] Lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:33.625295 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2409ddf8-3b83-48f7-9e73-c3710ac5fc41 req-2cc135bf-9f6a-44e2-b016-acd632acb077 service nova] Lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:33.625425 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2409ddf8-3b83-48f7-9e73-c3710ac5fc41 req-2cc135bf-9f6a-44e2-b016-acd632acb077 service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] No waiting events found dispatching network-vif-unplugged-613dad87-2df3-4db7-a38f-adda943e8770 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:00:33.625851 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2409ddf8-3b83-48f7-9e73-c3710ac5fc41 req-2cc135bf-9f6a-44e2-b016-acd632acb077 service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Received event network-vif-unplugged-613dad87-2df3-4db7-a38f-adda943e8770 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:00:33.625946 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2409ddf8-3b83-48f7-9e73-c3710ac5fc41 req-2cc135bf-9f6a-44e2-b016-acd632acb077 service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Received event network-vif-unplugged-613dad87-2df3-4db7-a38f-adda943e8770 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:33.626073 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2409ddf8-3b83-48f7-9e73-c3710ac5fc41 req-2cc135bf-9f6a-44e2-b016-acd632acb077 service nova] Acquiring lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:33.626215 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2409ddf8-3b83-48f7-9e73-c3710ac5fc41 req-2cc135bf-9f6a-44e2-b016-acd632acb077 service nova] Lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:33.626340 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2409ddf8-3b83-48f7-9e73-c3710ac5fc41 req-2cc135bf-9f6a-44e2-b016-acd632acb077 service nova] Lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:33.626434 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2409ddf8-3b83-48f7-9e73-c3710ac5fc41 req-2cc135bf-9f6a-44e2-b016-acd632acb077 service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] No waiting events found dispatching network-vif-unplugged-613dad87-2df3-4db7-a38f-adda943e8770 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:00:33.626524 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2409ddf8-3b83-48f7-9e73-c3710ac5fc41 req-2cc135bf-9f6a-44e2-b016-acd632acb077 service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Received event network-vif-unplugged-613dad87-2df3-4db7-a38f-adda943e8770 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:00:33.639286 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:33.726216 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:33.751043 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:33.762539 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:00:33.794354 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:33.809934 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-9bcee1df-e82c-4d9b-85d5-3500747692e1 req-7d2617c5-2a49-4c88-825a-c0eaa4dedec7 service nova] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Received event network-vif-unplugged-191c304c-b4ad-4084-9d48-b5dab07b9e5c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:33.810316 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9bcee1df-e82c-4d9b-85d5-3500747692e1 req-7d2617c5-2a49-4c88-825a-c0eaa4dedec7 service nova] Acquiring lock "6002d2d6-f312-48bf-9f07-7fcea8c5e52d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:33.810454 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9bcee1df-e82c-4d9b-85d5-3500747692e1 req-7d2617c5-2a49-4c88-825a-c0eaa4dedec7 service nova] Lock "6002d2d6-f312-48bf-9f07-7fcea8c5e52d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:33.810558 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9bcee1df-e82c-4d9b-85d5-3500747692e1 req-7d2617c5-2a49-4c88-825a-c0eaa4dedec7 service nova] Lock "6002d2d6-f312-48bf-9f07-7fcea8c5e52d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:33.810719 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-9bcee1df-e82c-4d9b-85d5-3500747692e1 req-7d2617c5-2a49-4c88-825a-c0eaa4dedec7 service nova] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] No waiting events found dispatching network-vif-unplugged-191c304c-b4ad-4084-9d48-b5dab07b9e5c {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:00:33.810829 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-9bcee1df-e82c-4d9b-85d5-3500747692e1 req-7d2617c5-2a49-4c88-825a-c0eaa4dedec7 service nova] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Received event network-vif-unplugged-191c304c-b4ad-4084-9d48-b5dab07b9e5c for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:00:33.832716 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:33.848219 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:00:33.848219 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:00:33.848219 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] No VIF found with MAC fa:16:3e:e0:9c:cd, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:00:33.848219 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Using config drive
May 28 10:00:33.884207 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:33.936123 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:34.010792 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.991s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:34.013616 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:00:34.233783 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:34.242461 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:34.251469 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:34.267770 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999641251999947 future=<Future at 0x73c1f43504d0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:34.268140 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999808032999908 future=<Future at 0x73c1f41ebd10 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:34.274459 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:34.289282 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:34.362556 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:34.397769 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c3e38b3d-93a8-494a-9ba4-d8c8c2c45874 req-308ab496-cb4c-40a4-bfdf-9f0d297aa2d5 service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Received event network-vif-deleted-613dad87-2df3-4db7-a38f-adda943e8770 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:34.397769 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-c3e38b3d-93a8-494a-9ba4-d8c8c2c45874 req-308ab496-cb4c-40a4-bfdf-9f0d297aa2d5 service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Neutron deleted interface 613dad87-2df3-4db7-a38f-adda943e8770; detaching it from the instance and deleting it from the info cache
May 28 10:00:34.399911 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c3e38b3d-93a8-494a-9ba4-d8c8c2c45874 req-308ab496-cb4c-40a4-bfdf-9f0d297aa2d5 service nova] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Detach interface failed, port_id=613dad87-2df3-4db7-a38f-adda943e8770, reason: Instance ef3d846c-c539-41c5-ade2-1f93e7acc2ca could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:00:34.527269 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:00:34.527528 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:00:34.527932 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:34.528141 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:34.561148 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Creating config drive at /opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk.config
May 28 10:00:34.568528 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfj_i_6zx {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:34.643824 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfj_i_6zx" returned: 0 in 0.075s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:34.654701 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13481913e22d4bf1a94e1a9a270f5494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3403b533910644d2b254922fb84b1ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:00:34.805027 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:00:34.897543 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:34.994362 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962434.9939446, 87f6620a-fa87-4d27-8512-74215ef4fe34 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:00:34.994603 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] VM Started (Lifecycle Event)
May 28 10:00:35.032234 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:00:35.249111 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:35.280404 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:35.311983 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Took 1.83 seconds to deallocate network for instance.
May 28 10:00:35.417573 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:35.474128 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:35.476195 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:35.499875 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:35.506304 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962435.5059125, 87f6620a-fa87-4d27-8512-74215ef4fe34 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:00:35.506503 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] VM Paused (Lifecycle Event)
May 28 10:00:35.518313 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Successfully created port: 285e920e-6acb-4c37-ab27-552538efb652 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:00:35.541959 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:00:35.912957 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Took 0.60 seconds to detach 1 volumes for instance.
May 28 10:00:35.915802 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Deleting volume: 258c61ac-673c-4b35-b2b5-182ee3432399 {{(pid=98321) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 10:00:36.010655 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:36.015391 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:00:36.468064 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7c8293d6-f7a9-4c88-8bc1-7e17eff30824 req-dd81c710-e949-495a-8007-1be9425c235c service nova] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Received event network-vif-deleted-191c304c-b4ad-4084-9d48-b5dab07b9e5c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:36.468584 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-7c8293d6-f7a9-4c88-8bc1-7e17eff30824 req-dd81c710-e949-495a-8007-1be9425c235c service nova] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Neutron deleted interface 191c304c-b4ad-4084-9d48-b5dab07b9e5c; detaching it from the instance and deleting it from the info cache
May 28 10:00:36.473396 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7c8293d6-f7a9-4c88-8bc1-7e17eff30824 req-dd81c710-e949-495a-8007-1be9425c235c service nova] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Detach interface failed, port_id=191c304c-b4ad-4084-9d48-b5dab07b9e5c, reason: Instance 6002d2d6-f312-48bf-9f07-7fcea8c5e52d could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:00:36.492205 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ea593fe5-9d75-4329-900a-d02ed3fa8f0e req-b11f1505-73ce-4b95-92ff-1f2faccdcb79 service nova] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Received event network-changed-b5ee2b20-4839-4467-aa06-cd09a19252bf {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:36.495343 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ea593fe5-9d75-4329-900a-d02ed3fa8f0e req-b11f1505-73ce-4b95-92ff-1f2faccdcb79 service nova] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Refreshing instance network info cache due to event network-changed-b5ee2b20-4839-4467-aa06-cd09a19252bf. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:00:36.495343 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ea593fe5-9d75-4329-900a-d02ed3fa8f0e req-b11f1505-73ce-4b95-92ff-1f2faccdcb79 service nova] Acquiring lock "refresh_cache-f9fd8989-d182-47e4-9409-266a1440bf58" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:00:36.495343 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ea593fe5-9d75-4329-900a-d02ed3fa8f0e req-b11f1505-73ce-4b95-92ff-1f2faccdcb79 service nova] Acquired lock "refresh_cache-f9fd8989-d182-47e4-9409-266a1440bf58" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:00:36.495343 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-ea593fe5-9d75-4329-900a-d02ed3fa8f0e req-b11f1505-73ce-4b95-92ff-1f2faccdcb79 service nova] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Refreshing network info cache for port b5ee2b20-4839-4467-aa06-cd09a19252bf {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:00:36.500133 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:36.500133 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:36.518749 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:00:36.519031 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962436.5188153, d2e043b6-afe6-4afb-92d6-7d8b33545f19 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:00:36.519130 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] VM Started (Lifecycle Event)
May 28 10:00:36.560302 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Successfully updated port: 285e920e-6acb-4c37-ab27-552538efb652 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:00:36.562003 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:00:36.564194 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:00:36.565007 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Creating image(s)
May 28 10:00:36.565242 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "/opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:36.565437 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "/opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:36.566623 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "/opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:36.571424 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:00:36.577537 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:00:36.584388 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:36.645019 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:00:36.663105 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-bb891cef-d648-4a4f-9513-2553cc26746c req-f08c8786-f4be-4315-b7d9-5fc49b845b06 service nova] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Received event network-changed-285e920e-6acb-4c37-ab27-552538efb652 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:36.663787 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-bb891cef-d648-4a4f-9513-2553cc26746c req-f08c8786-f4be-4315-b7d9-5fc49b845b06 service nova] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Refreshing instance network info cache due to event network-changed-285e920e-6acb-4c37-ab27-552538efb652. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:00:36.664094 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-bb891cef-d648-4a4f-9513-2553cc26746c req-f08c8786-f4be-4315-b7d9-5fc49b845b06 service nova] Acquiring lock "refresh_cache-b50eced2-71bf-4448-b2e1-f9657509f34c" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:00:36.664264 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-bb891cef-d648-4a4f-9513-2553cc26746c req-f08c8786-f4be-4315-b7d9-5fc49b845b06 service nova] Acquired lock "refresh_cache-b50eced2-71bf-4448-b2e1-f9657509f34c" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:00:36.664473 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-bb891cef-d648-4a4f-9513-2553cc26746c req-f08c8786-f4be-4315-b7d9-5fc49b845b06 service nova] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Refreshing network info cache for port 285e920e-6acb-4c37-ab27-552538efb652 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:00:36.703795 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.119s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:36.704675 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:36.705301 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:36.706143 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:00:36.710541 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:00:36.711038 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:36.827109 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.116s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:36.827526 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:36.883086 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c/disk 1073741824" returned: 0 in 0.055s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:36.883086 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.178s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:36.883781 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:37.004809 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-ea593fe5-9d75-4329-900a-d02ed3fa8f0e req-b11f1505-73ce-4b95-92ff-1f2faccdcb79 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:37.010756 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.127s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:37.011379 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:00:37.011706 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:37.037260 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:37.043173 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962437.0424778, d2e043b6-afe6-4afb-92d6-7d8b33545f19 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:00:37.043465 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] VM Paused (Lifecycle Event)
May 28 10:00:37.066986 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "refresh_cache-b50eced2-71bf-4448-b2e1-f9657509f34c" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:00:37.116660 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:37.118621 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Cannot resize image /opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:00:37.118621 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:00:37.118621 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Ensure instance console log exists: /opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:00:37.118621 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:37.118621 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:37.118939 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:37.152069 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Took 4.04 seconds to deallocate network for instance.
May 28 10:00:37.168733 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-bb891cef-d648-4a4f-9513-2553cc26746c req-f08c8786-f4be-4315-b7d9-5fc49b845b06 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:37.333766 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-bb891cef-d648-4a4f-9513-2553cc26746c req-f08c8786-f4be-4315-b7d9-5fc49b845b06 service nova] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:00:37.341437 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:37.405978 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:00:37.407371 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:00:37.550196 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:37.554256 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:00:37.664853 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-ea593fe5-9d75-4329-900a-d02ed3fa8f0e req-b11f1505-73ce-4b95-92ff-1f2faccdcb79 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:37.694516 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-bb891cef-d648-4a4f-9513-2553cc26746c req-f08c8786-f4be-4315-b7d9-5fc49b845b06 service nova] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:00:37.743502 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Took 0.59 seconds to detach 1 volumes for instance.
May 28 10:00:37.912660 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:00:37.941188 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-ea593fe5-9d75-4329-900a-d02ed3fa8f0e req-b11f1505-73ce-4b95-92ff-1f2faccdcb79 service nova] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Updated VIF entry in instance network info cache for port b5ee2b20-4839-4467-aa06-cd09a19252bf. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:00:37.941465 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-ea593fe5-9d75-4329-900a-d02ed3fa8f0e req-b11f1505-73ce-4b95-92ff-1f2faccdcb79 service nova] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Updating instance_info_cache with network_info: [{"id": "b5ee2b20-4839-4467-aa06-cd09a19252bf", "address": "fa:16:3e:0f:9f:68", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ee2b20-48", "ovs_interfaceid": "b5ee2b20-4839-4467-aa06-cd09a19252bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:00:38.059743 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:00:38.197755 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-bb891cef-d648-4a4f-9513-2553cc26746c req-f08c8786-f4be-4315-b7d9-5fc49b845b06 service nova] Releasing lock "refresh_cache-b50eced2-71bf-4448-b2e1-f9657509f34c" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:00:38.198222 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquired lock "refresh_cache-b50eced2-71bf-4448-b2e1-f9657509f34c" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:00:38.199018 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:00:38.251545 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:38.429231 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.930s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:38.431253 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.179s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:38.446090 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ea593fe5-9d75-4329-900a-d02ed3fa8f0e req-b11f1505-73ce-4b95-92ff-1f2faccdcb79 service nova] Releasing lock "refresh_cache-f9fd8989-d182-47e4-9409-266a1440bf58" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:00:38.499310 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Deleted allocations for instance ef3d846c-c539-41c5-ade2-1f93e7acc2ca
May 28 10:00:38.741086 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-68275051-105f-4311-aa6b-9a04ccda7257 req-7b47732e-d5f5-40cd-857e-46e225fe93bc service nova] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Received event network-vif-plugged-f58856d7-37d0-48f5-8883-32267e5b73bc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:38.743617 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-68275051-105f-4311-aa6b-9a04ccda7257 req-7b47732e-d5f5-40cd-857e-46e225fe93bc service nova] Acquiring lock "d2e043b6-afe6-4afb-92d6-7d8b33545f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:38.745235 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-68275051-105f-4311-aa6b-9a04ccda7257 req-7b47732e-d5f5-40cd-857e-46e225fe93bc service nova] Lock "d2e043b6-afe6-4afb-92d6-7d8b33545f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:38.745626 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-68275051-105f-4311-aa6b-9a04ccda7257 req-7b47732e-d5f5-40cd-857e-46e225fe93bc service nova] Lock "d2e043b6-afe6-4afb-92d6-7d8b33545f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:38.747788 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-68275051-105f-4311-aa6b-9a04ccda7257 req-7b47732e-d5f5-40cd-857e-46e225fe93bc service nova] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Processing event network-vif-plugged-f58856d7-37d0-48f5-8883-32267e5b73bc {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:00:38.747788 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-68275051-105f-4311-aa6b-9a04ccda7257 req-7b47732e-d5f5-40cd-857e-46e225fe93bc service nova] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Received event network-vif-plugged-f58856d7-37d0-48f5-8883-32267e5b73bc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:38.747788 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-68275051-105f-4311-aa6b-9a04ccda7257 req-7b47732e-d5f5-40cd-857e-46e225fe93bc service nova] Acquiring lock "d2e043b6-afe6-4afb-92d6-7d8b33545f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:38.747788 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-68275051-105f-4311-aa6b-9a04ccda7257 req-7b47732e-d5f5-40cd-857e-46e225fe93bc service nova] Lock "d2e043b6-afe6-4afb-92d6-7d8b33545f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:38.747788 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-68275051-105f-4311-aa6b-9a04ccda7257 req-7b47732e-d5f5-40cd-857e-46e225fe93bc service nova] Lock "d2e043b6-afe6-4afb-92d6-7d8b33545f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:38.747788 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-68275051-105f-4311-aa6b-9a04ccda7257 req-7b47732e-d5f5-40cd-857e-46e225fe93bc service nova] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] No waiting events found dispatching network-vif-plugged-f58856d7-37d0-48f5-8883-32267e5b73bc {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:00:38.747788 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-68275051-105f-4311-aa6b-9a04ccda7257 req-7b47732e-d5f5-40cd-857e-46e225fe93bc service nova] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Received unexpected event network-vif-plugged-f58856d7-37d0-48f5-8883-32267e5b73bc for instance with vm_state building and task_state spawning.
May 28 10:00:38.747788 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-68275051-105f-4311-aa6b-9a04ccda7257 req-7b47732e-d5f5-40cd-857e-46e225fe93bc service nova] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Received event network-vif-unplugged-285e920e-6acb-4c37-ab27-552538efb652 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:38.747788 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-68275051-105f-4311-aa6b-9a04ccda7257 req-7b47732e-d5f5-40cd-857e-46e225fe93bc service nova] Acquiring lock "b50eced2-71bf-4448-b2e1-f9657509f34c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:38.747788 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-68275051-105f-4311-aa6b-9a04ccda7257 req-7b47732e-d5f5-40cd-857e-46e225fe93bc service nova] Lock "b50eced2-71bf-4448-b2e1-f9657509f34c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:38.747788 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-68275051-105f-4311-aa6b-9a04ccda7257 req-7b47732e-d5f5-40cd-857e-46e225fe93bc service nova] Lock "b50eced2-71bf-4448-b2e1-f9657509f34c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:38.747788 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-68275051-105f-4311-aa6b-9a04ccda7257 req-7b47732e-d5f5-40cd-857e-46e225fe93bc service nova] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] No waiting events found dispatching network-vif-unplugged-285e920e-6acb-4c37-ab27-552538efb652 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:00:38.747788 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-68275051-105f-4311-aa6b-9a04ccda7257 req-7b47732e-d5f5-40cd-857e-46e225fe93bc service nova] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Received unexpected event network-vif-unplugged-285e920e-6acb-4c37-ab27-552538efb652 for instance with vm_state building and task_state spawning.
May 28 10:00:38.749573 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:00:38.754187 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962438.7514215, d2e043b6-afe6-4afb-92d6-7d8b33545f19 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:00:38.754187 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] VM Resumed (Lifecycle Event)
May 28 10:00:38.754187 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:00:38.758930 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Instance spawned successfully.
May 28 10:00:38.760715 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:00:38.805190 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:00:39.064226 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:39.166848 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:00:39.168141 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:00:39.254683 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Updating instance_info_cache with network_info: [{"id": "285e920e-6acb-4c37-ab27-552538efb652", "address": "fa:16:3e:db:10:77", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap285e920e-6a", "ovs_interfaceid": "285e920e-6acb-4c37-ab27-552538efb652", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:00:39.256079 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:39.258604 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:00:39.268136 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:39.268282 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:39.268700 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:39.268944 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:39.269509 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:39.270142 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:39.276213 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:39.512506 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f846f6c6-73ff-4612-bb91-774b9ed07eba tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "ef3d846c-c539-41c5-ade2-1f93e7acc2ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.613s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:39.678250 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:00:39.744665 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Acquiring lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:39.745087 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:39.757849 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Releasing lock "refresh_cache-b50eced2-71bf-4448-b2e1-f9657509f34c" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:00:39.758101 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Instance network_info: |[{"id": "285e920e-6acb-4c37-ab27-552538efb652", "address": "fa:16:3e:db:10:77", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap285e920e-6a", "ovs_interfaceid": "285e920e-6acb-4c37-ab27-552538efb652", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:00:39.760965 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Start _get_guest_xml network_info=[{"id": "285e920e-6acb-4c37-ab27-552538efb652", "address": "fa:16:3e:db:10:77", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap285e920e-6a", "ovs_interfaceid": "285e920e-6acb-4c37-ab27-552538efb652", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:00:39.763239 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:00:39.765098 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:00:39.767114 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='b50eced2-71bf-4448-b2e1-f9657509f34c'), owner=OwnerMeta(userid='13481913e22d4bf1a94e1a9a270f5494', username='tempest-AttachVolumeMultiAttachTest-1052626787-project-member', projectid='3403b533910644d2b254922fb84b1ac0', projectname='tempest-AttachVolumeMultiAttachTest-1052626787'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "285e920e-6acb-4c37-ab27-552538efb652", "address": "fa:16:3e:db:10:77", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap285e920e-6a", "ovs_interfaceid": "285e920e-6acb-4c37-ab27-552538efb652", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962439.7664669) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:00:39.768556 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:00:39.769214 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:00:39.772882 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:00:39.773312 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:00:39.776920 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Took 11.26 seconds to spawn the instance on the hypervisor.
May 28 10:00:39.777425 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:00:39.777738 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:39.778104 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:00:39.778326 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:00:39.778496 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:00:39.778875 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:00:39.779110 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:00:39.779324 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:00:39.780116 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:00:39.783563 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:00:39.783563 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:00:39.783563 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:00:39.783825 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:00:39.812977 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:00:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='multiattach-server-0',id=21,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrmebBJn1C7uIkB9JjrF4yuEuto77kf4SaBedfdmOdQwZzJyqrVQd0Wq/SA1eDV6FpWwBB4BKjLBcFgkvBrXSx4LeKHMUic/tPGA5px/F625klLXypbV+9p49FvQ4XImQ==',key_name='tempest-keypair-2082049331',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3403b533910644d2b254922fb84b1ac0',ramdisk_id='',reservation_id='r-t0zr0m60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1052626787',owner_user_name='tempest-AttachVolumeMultiAttachTest-1052626787-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:00:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13481913e22d4bf1a94e1a9a270f5494',uuid=b50eced2-71bf-4448-b2e1-f9657509f34c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "285e920e-6acb-4c37-ab27-552538efb652", "address": "fa:16:3e:db:10:77", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap285e920e-6a", "ovs_interfaceid": "285e920e-6acb-4c37-ab27-552538efb652", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:00:39.817839 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converting VIF {"id": "285e920e-6acb-4c37-ab27-552538efb652", "address": "fa:16:3e:db:10:77", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap285e920e-6a", "ovs_interfaceid": "285e920e-6acb-4c37-ab27-552538efb652", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:00:39.818287 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:10:77,bridge_name='br-int',has_traffic_filtering=True,id=285e920e-6acb-4c37-ab27-552538efb652,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap285e920e-6a') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:00:39.819052 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lazy-loading 'pci_devices' on Instance uuid b50eced2-71bf-4448-b2e1-f9657509f34c {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:00:40.186035 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.755s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:40.235936 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Deleted allocations for instance 6002d2d6-f312-48bf-9f07-7fcea8c5e52d
May 28 10:00:40.247277 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:00:40.288277 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Took 19.51 seconds to build instance.
May 28 10:00:40.323735 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] End _get_guest_xml xml=<domain type="qemu">
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:   <uuid>b50eced2-71bf-4448-b2e1-f9657509f34c</uuid>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:   <name>instance-00000015</name>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:       <nova:name>multiattach-server-0</nova:name>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:00:39</nova:creationTime>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:         <nova:user uuid="13481913e22d4bf1a94e1a9a270f5494">tempest-AttachVolumeMultiAttachTest-1052626787-project-member</nova:user>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:         <nova:project uuid="3403b533910644d2b254922fb84b1ac0">tempest-AttachVolumeMultiAttachTest-1052626787</nova:project>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:         <nova:port uuid="285e920e-6acb-4c37-ab27-552538efb652">
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:     <system>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:       <entry name="serial">b50eced2-71bf-4448-b2e1-f9657509f34c</entry>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:       <entry name="uuid">b50eced2-71bf-4448-b2e1-f9657509f34c</entry>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:     </system>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:   <os>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:   </os>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:   <features>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:   </features>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:   <devices>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c/disk"/>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:     </disk>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c/disk.config"/>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:     </disk>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:db:10:77"/>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:       <target dev="tap285e920e-6a"/>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:     </interface>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c/console.log" append="off"/>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:     </serial>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:     <video>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:     </video>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:     </rng>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:   </devices>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]: </domain>
May 28 10:00:40.323735 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:00:40.325578 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Preparing to wait for external event network-vif-plugged-285e920e-6acb-4c37-ab27-552538efb652 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:00:40.325578 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "b50eced2-71bf-4448-b2e1-f9657509f34c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:40.325578 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "b50eced2-71bf-4448-b2e1-f9657509f34c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:40.325578 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "b50eced2-71bf-4448-b2e1-f9657509f34c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:40.326077 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:00:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='multiattach-server-0',id=21,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrmebBJn1C7uIkB9JjrF4yuEuto77kf4SaBedfdmOdQwZzJyqrVQd0Wq/SA1eDV6FpWwBB4BKjLBcFgkvBrXSx4LeKHMUic/tPGA5px/F625klLXypbV+9p49FvQ4XImQ==',key_name='tempest-keypair-2082049331',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3403b533910644d2b254922fb84b1ac0',ramdisk_id='',reservation_id='r-t0zr0m60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1052626787',owner_user_name='tempest-AttachVolumeMultiAttachTest-1052626787-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:00:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13481913e22d4bf1a94e1a9a270f5494',uuid=b50eced2-71bf-4448-b2e1-f9657509f34c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "285e920e-6acb-4c37-ab27-552538efb652", "address": "fa:16:3e:db:10:77", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap285e920e-6a", "ovs_interfaceid": "285e920e-6acb-4c37-ab27-552538efb652", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:00:40.326218 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converting VIF {"id": "285e920e-6acb-4c37-ab27-552538efb652", "address": "fa:16:3e:db:10:77", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap285e920e-6a", "ovs_interfaceid": "285e920e-6acb-4c37-ab27-552538efb652", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:00:40.326811 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:10:77,bridge_name='br-int',has_traffic_filtering=True,id=285e920e-6acb-4c37-ab27-552538efb652,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap285e920e-6a') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:00:40.327720 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:10:77,bridge_name='br-int',has_traffic_filtering=True,id=285e920e-6acb-4c37-ab27-552538efb652,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap285e920e-6a') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:00:40.328143 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:40.328411 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:40.328679 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:00:40.329662 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:40.329777 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '017bb32d-83a7-5c0d-b505-ce3e18ac3804', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:40.330520 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:40.332105 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:00:40.334871 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:40.337741 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:40.338533 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap285e920e-6a, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:40.338533 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap285e920e-6a, col_values=(('qos', UUID('8dea4167-a386-4d88-8469-69a2408f1ddb')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:40.338743 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap285e920e-6a, col_values=(('external_ids', {'iface-id': '285e920e-6acb-4c37-ab27-552538efb652', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:10:77', 'vm-uuid': 'b50eced2-71bf-4448-b2e1-f9657509f34c'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:40.339685 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:40.341224 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:00:40.352518 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:40.352518 np0000001613 nova-compute[98321]: INFO os_vif [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:10:77,bridge_name='br-int',has_traffic_filtering=True,id=285e920e-6acb-4c37-ab27-552538efb652,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap285e920e-6a')
May 28 10:00:40.791581 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-321e8ba5-4de2-426f-80e7-744bd202b474 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "d2e043b6-afe6-4afb-92d6-7d8b33545f19" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.035s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:40.819860 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:40.820135 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.008s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:40.823287 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:00:40.823985 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Claim successful on node np0000001613
May 28 10:00:40.848394 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-56ebbb96-e93f-4011-9b73-81a549dbea56 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "ceb9e572-ba71-4a8c-b415-44c9e7ebec51" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:40.848624 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-56ebbb96-e93f-4011-9b73-81a549dbea56 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "ceb9e572-ba71-4a8c-b415-44c9e7ebec51" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:40.848864 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-56ebbb96-e93f-4011-9b73-81a549dbea56 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "ceb9e572-ba71-4a8c-b415-44c9e7ebec51-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:40.849020 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-56ebbb96-e93f-4011-9b73-81a549dbea56 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "ceb9e572-ba71-4a8c-b415-44c9e7ebec51-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:40.849125 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-56ebbb96-e93f-4011-9b73-81a549dbea56 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "ceb9e572-ba71-4a8c-b415-44c9e7ebec51-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:40.851180 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-56ebbb96-e93f-4011-9b73-81a549dbea56 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Terminating instance
May 28 10:00:40.948935 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Acquiring lock "9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:40.949482 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lock "9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:41.075695 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Rescuing
May 28 10:00:41.075874 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "refresh_cache-d2e043b6-afe6-4afb-92d6-7d8b33545f19" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:00:41.076014 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquired lock "refresh_cache-d2e043b6-afe6-4afb-92d6-7d8b33545f19" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:00:41.076119 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:00:41.245612 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-82f7198b-63eb-40d2-8be3-57e38cc58daf tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Lock "6002d2d6-f312-48bf-9f07-7fcea8c5e52d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.526s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:41.354490 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-56ebbb96-e93f-4011-9b73-81a549dbea56 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:00:41.387758 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:41.394531 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:41.415574 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:41.452886 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:00:41.572205 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:41.578391 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:41.583110 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:41.591309 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-04638251-43da-4b68-8adc-9c42f7c24bf4 req-a3cfb0f4-10fe-4232-b6bd-01635ec003a9 service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Received event network-vif-plugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:41.591415 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-04638251-43da-4b68-8adc-9c42f7c24bf4 req-a3cfb0f4-10fe-4232-b6bd-01635ec003a9 service nova] Acquiring lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:41.591587 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-04638251-43da-4b68-8adc-9c42f7c24bf4 req-a3cfb0f4-10fe-4232-b6bd-01635ec003a9 service nova] Lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:41.592919 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-04638251-43da-4b68-8adc-9c42f7c24bf4 req-a3cfb0f4-10fe-4232-b6bd-01635ec003a9 service nova] Lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:41.592919 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-04638251-43da-4b68-8adc-9c42f7c24bf4 req-a3cfb0f4-10fe-4232-b6bd-01635ec003a9 service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Processing event network-vif-plugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:00:41.592919 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Instance event wait completed in 6 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:00:41.595717 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962441.5952816, 87f6620a-fa87-4d27-8512-74215ef4fe34 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:00:41.595870 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] VM Resumed (Lifecycle Event)
May 28 10:00:41.598735 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:00:41.602573 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Instance spawned successfully.
May 28 10:00:41.602977 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:00:41.731807 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Instance destroyed successfully.
May 28 10:00:41.732733 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-56ebbb96-e93f-4011-9b73-81a549dbea56 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lazy-loading 'resources' on Instance uuid ceb9e572-ba71-4a8c-b415-44c9e7ebec51 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:00:41.881213 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:00:41.885090 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:00:41.885090 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No VIF found with MAC fa:16:3e:db:10:77, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:00:41.885090 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Using config drive
May 28 10:00:42.035492 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:42.041546 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:42.099345 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:42.104975 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:00:42.112265 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:42.115186 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:42.115186 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:42.115186 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:42.115186 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:42.115186 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:42.232152 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Updating instance_info_cache with network_info: [{"id": "f58856d7-37d0-48f5-8883-32267e5b73bc", "address": "fa:16:3e:e0:9c:cd", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf58856d7-37", "ovs_interfaceid": "f58856d7-37d0-48f5-8883-32267e5b73bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:00:42.237888 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-56ebbb96-e93f-4011-9b73-81a549dbea56 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:59:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2121113509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serverbootfromvolumestablerescuetest-server-2121113509',id=13,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T09:59:18Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9d04b105229456d9ab53df1886fdb37',ramdisk_id='',reservation_id='r-v57ft0uc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-283762505',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T09:59:29Z,user_data=None,user_id='51981c995f2246588f2d58f35be5848a',uuid=ceb9e572-ba71-4a8c-b415-44c9e7ebec51,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea7215be-0ccc-4d7a-ab01-5bb86ae75830", "address": "fa:16:3e:05:61:f2", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea7215be-0c", "ovs_interfaceid": "ea7215be-0ccc-4d7a-ab01-5bb86ae75830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:00:42.237888 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-56ebbb96-e93f-4011-9b73-81a549dbea56 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Converting VIF {"id": "ea7215be-0ccc-4d7a-ab01-5bb86ae75830", "address": "fa:16:3e:05:61:f2", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea7215be-0c", "ovs_interfaceid": "ea7215be-0ccc-4d7a-ab01-5bb86ae75830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:00:42.237888 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-56ebbb96-e93f-4011-9b73-81a549dbea56 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:61:f2,bridge_name='br-int',has_traffic_filtering=True,id=ea7215be-0ccc-4d7a-ab01-5bb86ae75830,network=Network(e5543f88-c716-4e02-82e9-2cb7570bf25e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea7215be-0c') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:00:42.237888 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-56ebbb96-e93f-4011-9b73-81a549dbea56 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:61:f2,bridge_name='br-int',has_traffic_filtering=True,id=ea7215be-0ccc-4d7a-ab01-5bb86ae75830,network=Network(e5543f88-c716-4e02-82e9-2cb7570bf25e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea7215be-0c') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:00:42.238309 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:42.239811 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea7215be-0c, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:42.245802 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:00:42.250704 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:42.252387 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:42.252771 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7d7273de-d29c-43ee-88d6-2940e812ec6c) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:42.253695 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:42.254003 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:00:42.260268 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:42.263199 np0000001613 nova-compute[98321]: INFO os_vif [None req-56ebbb96-e93f-4011-9b73-81a549dbea56 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:61:f2,bridge_name='br-int',has_traffic_filtering=True,id=ea7215be-0ccc-4d7a-ab01-5bb86ae75830,network=Network(e5543f88-c716-4e02-82e9-2cb7570bf25e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea7215be-0c')
May 28 10:00:42.263199 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-56ebbb96-e93f-4011-9b73-81a549dbea56 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Deleting instance files /opt/stack/data/nova/instances/ceb9e572-ba71-4a8c-b415-44c9e7ebec51_del
May 28 10:00:42.263903 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-56ebbb96-e93f-4011-9b73-81a549dbea56 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Deletion of /opt/stack/data/nova/instances/ceb9e572-ba71-4a8c-b415-44c9e7ebec51_del complete
May 28 10:00:42.362051 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0007873749998452695 future=<Future at 0x73c1f41e87d0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:42.363552 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:42.363552 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=6.903797735000126 future=<Future at 0x73c1f43504d0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:42.364260 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=6.903712977000168 future=<Future at 0x73c1f43504d0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:42.389951 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:42.543763 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Creating config drive at /opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c/disk.config
May 28 10:00:42.548523 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpejo43pws {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:42.611546 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:00:42.612195 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999821569000005 future=<Future at 0x73c1f41c30b0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:42.613363 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpejo43pws" returned: 0 in 0.065s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:42.625254 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Took 17.04 seconds to spawn the instance on the hypervisor.
May 28 10:00:42.625254 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:42.672689 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:00:42.672981 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:00:42.734983 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Releasing lock "refresh_cache-d2e043b6-afe6-4afb-92d6-7d8b33545f19" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:00:42.772221 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-56ebbb96-e93f-4011-9b73-81a549dbea56 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Took 1.42 seconds to destroy the instance on the hypervisor.
May 28 10:00:42.773705 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-56ebbb96-e93f-4011-9b73-81a549dbea56 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:00:42.774248 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:00:42.774248 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:00:42.774400 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:42.919752 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:43.143783 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Took 24.01 seconds to build instance.
May 28 10:00:43.176572 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:00:43.197113 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:43.236348 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:43.367321 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:43.443281 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cb3c76a4-2e90-4767-a41d-740fe5121451 req-b2cdcf3e-e836-4c95-a04a-48c903b75c7e service nova] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Received event network-vif-deleted-ea7215be-0ccc-4d7a-ab01-5bb86ae75830 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:43.443281 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-cb3c76a4-2e90-4767-a41d-740fe5121451 req-b2cdcf3e-e836-4c95-a04a-48c903b75c7e service nova] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Neutron deleted interface ea7215be-0ccc-4d7a-ab01-5bb86ae75830; detaching it from the instance and deleting it from the info cache
May 28 10:00:43.443422 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:43.446908 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cb3c76a4-2e90-4767-a41d-740fe5121451 req-b2cdcf3e-e836-4c95-a04a-48c903b75c7e service nova] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Detach interface failed, port_id=ea7215be-0ccc-4d7a-ab01-5bb86ae75830, reason: Instance ceb9e572-ba71-4a8c-b415-44c9e7ebec51 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:00:43.646553 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3fb5228b-d6af-470f-8507-6420442ee486 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "87f6620a-fa87-4d27-8512-74215ef4fe34" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.528s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:43.693041 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5a622b12-0a6a-4f33-9a87-d272ce721956 req-50ea1c98-baa3-4691-a1af-c061c6b37266 service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Received event network-vif-plugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:43.694435 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5a622b12-0a6a-4f33-9a87-d272ce721956 req-50ea1c98-baa3-4691-a1af-c061c6b37266 service nova] Acquiring lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:43.694706 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5a622b12-0a6a-4f33-9a87-d272ce721956 req-50ea1c98-baa3-4691-a1af-c061c6b37266 service nova] Lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:43.694878 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5a622b12-0a6a-4f33-9a87-d272ce721956 req-50ea1c98-baa3-4691-a1af-c061c6b37266 service nova] Lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:43.695372 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5a622b12-0a6a-4f33-9a87-d272ce721956 req-50ea1c98-baa3-4691-a1af-c061c6b37266 service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] No waiting events found dispatching network-vif-plugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:00:43.696739 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-5a622b12-0a6a-4f33-9a87-d272ce721956 req-50ea1c98-baa3-4691-a1af-c061c6b37266 service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Received unexpected event network-vif-plugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 for instance with vm_state active and task_state None.
May 28 10:00:43.701198 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.881s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:43.701741 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:00:43.705000 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.663s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:43.710994 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:00:43.711758 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Claim successful on node np0000001613
May 28 10:00:43.843252 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:00:44.214428 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:00:44.214428 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:00:44.215049 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:44.215494 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:44.232035 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962444.2283988, b50eced2-71bf-4448-b2e1-f9657509f34c => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:00:44.233057 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] VM Started (Lifecycle Event)
May 28 10:00:44.280702 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:44.344357 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11b9cab1ceef4e4b8cba521b61ad3f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11e1727c7fbc44459c6972d182fc25b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:00:44.346281 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Took 1.57 seconds to deallocate network for instance.
May 28 10:00:44.391073 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:44.416093 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:44.590851 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:44.601994 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:44.721516 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Instance destroyed successfully.
May 28 10:00:44.721944 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lazy-loading 'numa_topology' on Instance uuid d2e043b6-afe6-4afb-92d6-7d8b33545f19 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:00:44.725537 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:00:44.741071 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:44.745090 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962444.744724, b50eced2-71bf-4448-b2e1-f9657509f34c => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:00:44.745315 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] VM Paused (Lifecycle Event)
May 28 10:00:44.864769 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-56ebbb96-e93f-4011-9b73-81a549dbea56 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:45.163532 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:45.231147 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Attempting rescue
May 28 10:00:45.231771 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98321) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 28 10:00:45.233874 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:00:45.243205 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Instance directory exists: not creating {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 10:00:45.243439 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Creating image(s)
May 28 10:00:45.244408 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "/opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:45.244564 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "/opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:45.245655 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "/opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:45.245874 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lazy-loading 'trusted_certs' on Instance uuid d2e043b6-afe6-4afb-92d6-7d8b33545f19 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:00:45.251078 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:45.253762 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:00:45.294853 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Successfully created port: 11a01cd4-8a62-4e25-b303-ac907a1aa4c3 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:00:45.331826 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "c9416092-d229-4f59-aaf3-3b0b692e7924" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:45.332150 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "c9416092-d229-4f59-aaf3-3b0b692e7924" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:45.537135 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:00:45.537356 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:00:45.551396 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-db2e0470-c164-434a-8a7b-55bdd0e89651 req-7f0a27a0-58bf-4b21-a42b-4494483af59f service nova] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Received event network-vif-plugged-285e920e-6acb-4c37-ab27-552538efb652 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:45.552693 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-db2e0470-c164-434a-8a7b-55bdd0e89651 req-7f0a27a0-58bf-4b21-a42b-4494483af59f service nova] Acquiring lock "b50eced2-71bf-4448-b2e1-f9657509f34c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:45.552926 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-db2e0470-c164-434a-8a7b-55bdd0e89651 req-7f0a27a0-58bf-4b21-a42b-4494483af59f service nova] Lock "b50eced2-71bf-4448-b2e1-f9657509f34c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:45.552926 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-db2e0470-c164-434a-8a7b-55bdd0e89651 req-7f0a27a0-58bf-4b21-a42b-4494483af59f service nova] Lock "b50eced2-71bf-4448-b2e1-f9657509f34c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:45.553080 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-db2e0470-c164-434a-8a7b-55bdd0e89651 req-7f0a27a0-58bf-4b21-a42b-4494483af59f service nova] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Processing event network-vif-plugged-285e920e-6acb-4c37-ab27-552538efb652 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:00:45.553186 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-db2e0470-c164-434a-8a7b-55bdd0e89651 req-7f0a27a0-58bf-4b21-a42b-4494483af59f service nova] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Received event network-vif-plugged-285e920e-6acb-4c37-ab27-552538efb652 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:45.553324 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-db2e0470-c164-434a-8a7b-55bdd0e89651 req-7f0a27a0-58bf-4b21-a42b-4494483af59f service nova] Acquiring lock "b50eced2-71bf-4448-b2e1-f9657509f34c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:45.553446 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-db2e0470-c164-434a-8a7b-55bdd0e89651 req-7f0a27a0-58bf-4b21-a42b-4494483af59f service nova] Lock "b50eced2-71bf-4448-b2e1-f9657509f34c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:45.554125 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-db2e0470-c164-434a-8a7b-55bdd0e89651 req-7f0a27a0-58bf-4b21-a42b-4494483af59f service nova] Lock "b50eced2-71bf-4448-b2e1-f9657509f34c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:45.554410 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-db2e0470-c164-434a-8a7b-55bdd0e89651 req-7f0a27a0-58bf-4b21-a42b-4494483af59f service nova] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] No waiting events found dispatching network-vif-plugged-285e920e-6acb-4c37-ab27-552538efb652 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:00:45.557376 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:00:45.557830 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-db2e0470-c164-434a-8a7b-55bdd0e89651 req-7f0a27a0-58bf-4b21-a42b-4494483af59f service nova] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Received unexpected event network-vif-plugged-285e920e-6acb-4c37-ab27-552538efb652 for instance with vm_state building and task_state spawning.
May 28 10:00:45.557880 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-db2e0470-c164-434a-8a7b-55bdd0e89651 req-7f0a27a0-58bf-4b21-a42b-4494483af59f service nova] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Received event network-vif-unplugged-f58856d7-37d0-48f5-8883-32267e5b73bc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:45.558049 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-db2e0470-c164-434a-8a7b-55bdd0e89651 req-7f0a27a0-58bf-4b21-a42b-4494483af59f service nova] Acquiring lock "d2e043b6-afe6-4afb-92d6-7d8b33545f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:45.558224 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-db2e0470-c164-434a-8a7b-55bdd0e89651 req-7f0a27a0-58bf-4b21-a42b-4494483af59f service nova] Lock "d2e043b6-afe6-4afb-92d6-7d8b33545f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:45.558328 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-db2e0470-c164-434a-8a7b-55bdd0e89651 req-7f0a27a0-58bf-4b21-a42b-4494483af59f service nova] Lock "d2e043b6-afe6-4afb-92d6-7d8b33545f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:45.558467 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-db2e0470-c164-434a-8a7b-55bdd0e89651 req-7f0a27a0-58bf-4b21-a42b-4494483af59f service nova] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] No waiting events found dispatching network-vif-unplugged-f58856d7-37d0-48f5-8883-32267e5b73bc {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:00:45.558713 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-db2e0470-c164-434a-8a7b-55bdd0e89651 req-7f0a27a0-58bf-4b21-a42b-4494483af59f service nova] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Received unexpected event network-vif-unplugged-f58856d7-37d0-48f5-8883-32267e5b73bc for instance with vm_state active and task_state rescuing.
May 28 10:00:45.558713 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-db2e0470-c164-434a-8a7b-55bdd0e89651 req-7f0a27a0-58bf-4b21-a42b-4494483af59f service nova] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Received event network-vif-unplugged-f58856d7-37d0-48f5-8883-32267e5b73bc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:45.558826 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-db2e0470-c164-434a-8a7b-55bdd0e89651 req-7f0a27a0-58bf-4b21-a42b-4494483af59f service nova] Acquiring lock "d2e043b6-afe6-4afb-92d6-7d8b33545f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:45.558960 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-db2e0470-c164-434a-8a7b-55bdd0e89651 req-7f0a27a0-58bf-4b21-a42b-4494483af59f service nova] Lock "d2e043b6-afe6-4afb-92d6-7d8b33545f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:45.559090 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-db2e0470-c164-434a-8a7b-55bdd0e89651 req-7f0a27a0-58bf-4b21-a42b-4494483af59f service nova] Lock "d2e043b6-afe6-4afb-92d6-7d8b33545f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:45.559457 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-db2e0470-c164-434a-8a7b-55bdd0e89651 req-7f0a27a0-58bf-4b21-a42b-4494483af59f service nova] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] No waiting events found dispatching network-vif-unplugged-f58856d7-37d0-48f5-8883-32267e5b73bc {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:00:45.559457 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-db2e0470-c164-434a-8a7b-55bdd0e89651 req-7f0a27a0-58bf-4b21-a42b-4494483af59f service nova] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Received unexpected event network-vif-unplugged-f58856d7-37d0-48f5-8883-32267e5b73bc for instance with vm_state active and task_state rescuing.
May 28 10:00:45.563431 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:00:45.565434 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Instance spawned successfully.
May 28 10:00:45.565822 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:00:45.749005 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Object Instance<d2e043b6-afe6-4afb-92d6-7d8b33545f19> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:00:45.752756 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:00:45.758987 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:00:45.760179 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:00:45.760418 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.9998168300001 future=<Future at 0x73c1f41b5c40 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:45.760825 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962445.7605727, b50eced2-71bf-4448-b2e1-f9657509f34c => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:00:45.760984 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] VM Resumed (Lifecycle Event)
May 28 10:00:45.764205 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:45.764690 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:45.765051 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:00:45.767888 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:00:45.768279 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:45.835410 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Detaching volume 3dad4779-d77b-4473-a132-d2e773ff8b9d
May 28 10:00:45.870024 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.101s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:45.871347 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk.rescue {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:45.920680 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Attempting to driver detach volume 3dad4779-d77b-4473-a132-d2e773ff8b9d from mountpoint /dev/vdb
May 28 10:00:45.930463 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Found disk vdb by alias ua-3dad4779-d77b-4473-a132-d2e773ff8b9d {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:00:45.931875 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Found disk vdb by alias ua-3dad4779-d77b-4473-a132-d2e773ff8b9d {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:00:45.932067 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Attempting to detach device vdb from instance c9416092-d229-4f59-aaf3-3b0b692e7924 from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 10:00:45.932453 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:00:45.932453 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:00:45.932453 np0000001613 nova-compute[98321]:   <alias name="ua-3dad4779-d77b-4473-a132-d2e773ff8b9d"/>
May 28 10:00:45.932453 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-4"/>
May 28 10:00:45.932453 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:00:45.932453 np0000001613 nova-compute[98321]:   <serial>3dad4779-d77b-4473-a132-d2e773ff8b9d</serial>
May 28 10:00:45.932453 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 10:00:45.932453 np0000001613 nova-compute[98321]: </disk>
May 28 10:00:45.932453 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:00:45.945746 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk.rescue" returned: 0 in 0.074s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:45.946561 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.182s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:45.947281 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lazy-loading 'migration_context' on Instance uuid d2e043b6-afe6-4afb-92d6-7d8b33545f19 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:00:45.949076 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Successfully detached device vdb from instance c9416092-d229-4f59-aaf3-3b0b692e7924 from the persistent domain config.
May 28 10:00:45.949369 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] (1/8): Attempting to detach device vdb with device alias ua-3dad4779-d77b-4473-a132-d2e773ff8b9d from instance c9416092-d229-4f59-aaf3-3b0b692e7924 from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 10:00:45.950638 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:00:45.950638 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:00:45.950638 np0000001613 nova-compute[98321]:   <alias name="ua-3dad4779-d77b-4473-a132-d2e773ff8b9d"/>
May 28 10:00:45.950638 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-4"/>
May 28 10:00:45.950638 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:00:45.950638 np0000001613 nova-compute[98321]:   <serial>3dad4779-d77b-4473-a132-d2e773ff8b9d</serial>
May 28 10:00:45.950638 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 10:00:45.950638 np0000001613 nova-compute[98321]: </disk>
May 28 10:00:45.950638 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:00:45.994202 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Successfully updated port: 11a01cd4-8a62-4e25-b303-ac907a1aa4c3 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:00:46.041050 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:00:46.053556 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5a6f1b12-718e-46b4-9e09-12f3a52a6162 req-e57c13f2-0979-463f-af0e-24c34cd37d7b service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Received event network-changed-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:46.053759 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5a6f1b12-718e-46b4-9e09-12f3a52a6162 req-e57c13f2-0979-463f-af0e-24c34cd37d7b service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Refreshing instance network info cache due to event network-changed-11a01cd4-8a62-4e25-b303-ac907a1aa4c3. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:00:46.053917 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5a6f1b12-718e-46b4-9e09-12f3a52a6162 req-e57c13f2-0979-463f-af0e-24c34cd37d7b service nova] Acquiring lock "refresh_cache-b90b1ecd-e640-4f4e-bd02-fb74021db82b" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:00:46.056726 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5a6f1b12-718e-46b4-9e09-12f3a52a6162 req-e57c13f2-0979-463f-af0e-24c34cd37d7b service nova] Acquired lock "refresh_cache-b90b1ecd-e640-4f4e-bd02-fb74021db82b" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:00:46.056726 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-5a6f1b12-718e-46b4-9e09-12f3a52a6162 req-e57c13f2-0979-463f-af0e-24c34cd37d7b service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Refreshing network info cache for port 11a01cd4-8a62-4e25-b303-ac907a1aa4c3 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:00:46.079246 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:46.083274 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:46.083274 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:46.083580 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:46.083881 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:46.084154 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:46.247539 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:00:46.248486 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:00:46.248734 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Creating image(s)
May 28 10:00:46.249975 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Acquiring lock "/opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:46.249975 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "/opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:46.250735 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "/opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:46.251272 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:00:46.254399 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:00:46.256894 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:46.270517 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:46.276963 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:00:46.362456 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.106s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:46.363311 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:46.363638 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:46.364232 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:00:46.368616 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:00:46.369333 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:46.452476 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Object Instance<d2e043b6-afe6-4afb-92d6-7d8b33545f19> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:00:46.452991 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:00:46.453944 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Start _get_guest_xml network_info=[{"id": "f58856d7-37d0-48f5-8883-32267e5b73bc", "address": "fa:16:3e:e0:9c:cd", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "vif_mac": "fa:16:3e:e0:9c:cd"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf58856d7-37", "ovs_interfaceid": "f58856d7-37d0-48f5-8883-32267e5b73bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:00:46.454476 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lazy-loading 'resources' on Instance uuid d2e043b6-afe6-4afb-92d6-7d8b33545f19 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:00:46.479896 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.110s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:46.480156 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:46.499710 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Acquiring lock "refresh_cache-b90b1ecd-e640-4f4e-bd02-fb74021db82b" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:00:46.538077 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk 1073741824" returned: 0 in 0.058s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:46.538888 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.175s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:46.539278 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:46.562575 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.855s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:46.563678 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:00:46.566859 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-56ebbb96-e93f-4011-9b73-81a549dbea56 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.697s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:46.570363 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-5a6f1b12-718e-46b4-9e09-12f3a52a6162 req-e57c13f2-0979-463f-af0e-24c34cd37d7b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:46.591305 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Took 10.03 seconds to spawn the instance on the hypervisor.
May 28 10:00:46.591794 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:46.656542 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.117s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:46.657086 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:00:46.657366 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:46.700965 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-5a6f1b12-718e-46b4-9e09-12f3a52a6162 req-e57c13f2-0979-463f-af0e-24c34cd37d7b service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:00:46.761867 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:46.762426 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Cannot resize image /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:00:46.762779 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:00:46.763014 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Ensure instance console log exists: /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:00:46.763424 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:46.763681 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:46.763855 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:46.780523 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:00:46.889465 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-5a6f1b12-718e-46b4-9e09-12f3a52a6162 req-e57c13f2-0979-463f-af0e-24c34cd37d7b service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:00:46.891238 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779962446.890891, c9416092-d229-4f59-aaf3-3b0b692e7924 => ua-3dad4779-d77b-4473-a132-d2e773ff8b9d> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 10:00:46.894090 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-3dad4779-d77b-4473-a132-d2e773ff8b9d for instance c9416092-d229-4f59-aaf3-3b0b692e7924 {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 10:00:46.896131 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Successfully detached device vdb from instance c9416092-d229-4f59-aaf3-3b0b692e7924 from the live domain config.
May 28 10:00:46.899355 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:00:46.899934 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3dad4779-d77b-4473-a132-d2e773ff8b9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:00:46.900184 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:00:46.902693 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:00:46.902693 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3dad4779-d77b-4473-a132-d2e773ff8b9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:00:46.902693 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:00:46.937644 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:46.937644 np0000001613 nova-compute[98321]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:46.937644 np0000001613 nova-compute[98321]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:46.937644 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:46.937644 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:46.937644 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:46.937644 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:00:46.937872 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:46.937872 np0000001613 nova-compute[98321]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d (non-flash)
May 28 10:00:46.937872 np0000001613 nova-compute[98321]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:46.937872 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:46.937872 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:46.937872 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:46.937872 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:00:46.937994 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', '6')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:00:46.938142 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', '27')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:00:46.939410 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d', '28')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:00:46.940983 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1f4345300>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d'): ({'sdg'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:00:46.941288 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Removing multipathed devices sdf, sdg {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:00:46.942254 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Flush multipath device 330000000b29350f3 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:00:46.958715 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Object Instance<d2e043b6-afe6-4afb-92d6-7d8b33545f19> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:00:46.963975 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:00:46.966004 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-246966041', uuid='d2e043b6-afe6-4afb-92d6-7d8b33545f19'), owner=OwnerMeta(userid='45c67299cd204090b9ebf7e0eb873e37', username='tempest-ServerRescueNegativeTestJSON-1286552851-project-member', projectid='f5fc8bc5d1984c1c839a3ef7e30b9d36', projectname='tempest-ServerRescueNegativeTestJSON-1286552851'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f58856d7-37d0-48f5-8883-32267e5b73bc", "address": "fa:16:3e:e0:9c:cd", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "vif_mac": "fa:16:3e:e0:9c:cd"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf58856d7-37", "ovs_interfaceid": "f58856d7-37d0-48f5-8883-32267e5b73bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962446.9654884) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:00:46.968752 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:00:46.969408 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:00:46.971526 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:00:46.971851 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:00:46.973522 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:00:46.974182 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:00:46.975311 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:00:46.975311 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:00:46.975311 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:00:46.975311 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:00:46.975311 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:00:46.975311 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:00:46.975640 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:00:46.975817 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:00:46.976039 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:00:46.976215 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:00:46.976584 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lazy-loading 'vcpu_model' on Instance uuid d2e043b6-afe6-4afb-92d6-7d8b33545f19 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:00:46.979181 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:00:47.031667 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:00:47.084190 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:00:47.084190 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:00:47.084190 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:47.084190 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:47.085195 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:00:47.085792 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:00:47.088228 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:00:47.103469 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:00:47.103469 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:00:47.117573 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Took 16.19 seconds to build instance.
May 28 10:00:47.119865 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:47.154196 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d, portal: 192.168.40.100,3260]
May 28 10:00:47.154196 np0000001613 nova-compute[98321]: Logout of [sid: 27, target: iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d, portal: 192.168.40.100,3260] successful.
May 28 10:00:47.154196 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:47.174287 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:47.188897 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:47.219442 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '321e041ada2b405e821acd703457ddcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4cc0430ca14757a829b60eb7e0081e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:00:47.230465 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d, portal: 192.168.50.100,3260]
May 28 10:00:47.230465 np0000001613 nova-compute[98321]: Logout of [sid: 28, target: iqn.2023-03.storpool.com:os--volume-3dad4779-d77b-4473-a132-d2e773ff8b9d, portal: 192.168.50.100,3260] successful.
May 28 10:00:47.230465 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:47.249125 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:47.249670 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:00:47.249820 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] <== disconnect_volume: return (350ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:00:47.249965 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:00:47.254688 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:47.394701 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5a6f1b12-718e-46b4-9e09-12f3a52a6162 req-e57c13f2-0979-463f-af0e-24c34cd37d7b service nova] Releasing lock "refresh_cache-b90b1ecd-e640-4f4e-bd02-fb74021db82b" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:00:47.396417 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Acquired lock "refresh_cache-b90b1ecd-e640-4f4e-bd02-fb74021db82b" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:00:47.396705 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:00:47.450585 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-56ebbb96-e93f-4011-9b73-81a549dbea56 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:00:47.450872 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-56ebbb96-e93f-4011-9b73-81a549dbea56 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:00:47.484194 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Object Instance<d2e043b6-afe6-4afb-92d6-7d8b33545f19> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:00:47.505745 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-246966041',display_name='tempest-ServerRescueNegativeTestJSON-server-246966041',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serverrescuenegativetestjson-server-246966041',id=20,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:00:39Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f5fc8bc5d1984c1c839a3ef7e30b9d36',ramdisk_id='',reservation_id='r-i9h0da26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1286552851',owner_user_name='tempest-ServerRescueNegativeTestJSON-1286552851-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:00:40Z,user_data=None,user_id='45c67299cd204090b9ebf7e0eb873e37',uuid=d2e043b6-afe6-4afb-92d6-7d8b33545f19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f58856d7-37d0-48f5-8883-32267e5b73bc", "address": "fa:16:3e:e0:9c:cd", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "vif_mac": "fa:16:3e:e0:9c:cd"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf58856d7-37", "ovs_interfaceid": "f58856d7-37d0-48f5-8883-32267e5b73bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:00:47.505958 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Converting VIF {"id": "f58856d7-37d0-48f5-8883-32267e5b73bc", "address": "fa:16:3e:e0:9c:cd", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "vif_mac": "fa:16:3e:e0:9c:cd"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf58856d7-37", "ovs_interfaceid": "f58856d7-37d0-48f5-8883-32267e5b73bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:00:47.506818 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:9c:cd,bridge_name='br-int',has_traffic_filtering=True,id=f58856d7-37d0-48f5-8883-32267e5b73bc,network=Network(729946be-b963-4dfb-ad38-335762a8666c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf58856d7-37') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:00:47.507659 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lazy-loading 'pci_devices' on Instance uuid d2e043b6-afe6-4afb-92d6-7d8b33545f19 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:00:47.586725 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:00:47.622041 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-510f1f81-76b0-4601-a035-b8e0ed8bcb06 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "b50eced2-71bf-4448-b2e1-f9657509f34c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.713s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:47.790400 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:00:47.790931 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:00:47.791574 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:00:47.791955 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:00:47.792157 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:00:47.792491 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:00:47.817927 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lazy-loading 'flavor' on Instance uuid c9416092-d229-4f59-aaf3-3b0b692e7924 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:00:47.844116 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Successfully created port: b45721cf-794a-4cef-9660-816123b5b144 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:00:47.954324 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-56ebbb96-e93f-4011-9b73-81a549dbea56 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:00:48.009791 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Object Instance<d2e043b6-afe6-4afb-92d6-7d8b33545f19> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:00:48.010972 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] End _get_guest_xml xml=<domain type="qemu">
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:   <uuid>d2e043b6-afe6-4afb-92d6-7d8b33545f19</uuid>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:   <name>instance-00000014</name>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-246966041</nova:name>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:00:46</nova:creationTime>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:         <nova:user uuid="45c67299cd204090b9ebf7e0eb873e37">tempest-ServerRescueNegativeTestJSON-1286552851-project-member</nova:user>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:         <nova:project uuid="f5fc8bc5d1984c1c839a3ef7e30b9d36">tempest-ServerRescueNegativeTestJSON-1286552851</nova:project>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:         <nova:port uuid="f58856d7-37d0-48f5-8883-32267e5b73bc">
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:     <system>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:       <entry name="serial">d2e043b6-afe6-4afb-92d6-7d8b33545f19</entry>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:       <entry name="uuid">d2e043b6-afe6-4afb-92d6-7d8b33545f19</entry>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:     </system>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:   <os>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:   </os>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:   <features>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:   </features>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:   <devices>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk.rescue"/>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:     </disk>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk"/>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:       <target dev="vdb" bus="virtio"/>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:     </disk>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk.config.rescue"/>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:     </disk>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:e0:9c:cd"/>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:       <target dev="tapf58856d7-37"/>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:     </interface>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/console.log" append="off"/>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:     </serial>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:     <video>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:     </video>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:     </rng>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:   </devices>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]: </domain>
May 28 10:00:48.010972 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:00:48.016113 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Instance destroyed successfully.
May 28 10:00:48.090718 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:00:48.140562 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4d12f7db-2245-4a6f-bb87-7a5edd7ebf71 req-9be00f2e-b132-4174-9205-e1b5e487f459 service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Received event network-vif-unplugged-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:48.140562 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4d12f7db-2245-4a6f-bb87-7a5edd7ebf71 req-9be00f2e-b132-4174-9205-e1b5e487f459 service nova] Acquiring lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:48.140562 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4d12f7db-2245-4a6f-bb87-7a5edd7ebf71 req-9be00f2e-b132-4174-9205-e1b5e487f459 service nova] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:48.140933 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4d12f7db-2245-4a6f-bb87-7a5edd7ebf71 req-9be00f2e-b132-4174-9205-e1b5e487f459 service nova] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:48.140933 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4d12f7db-2245-4a6f-bb87-7a5edd7ebf71 req-9be00f2e-b132-4174-9205-e1b5e487f459 service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] No waiting events found dispatching network-vif-unplugged-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:00:48.141018 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-4d12f7db-2245-4a6f-bb87-7a5edd7ebf71 req-9be00f2e-b132-4174-9205-e1b5e487f459 service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Received unexpected event network-vif-unplugged-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 for instance with vm_state building and task_state spawning.
May 28 10:00:48.465185 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-56ebbb96-e93f-4011-9b73-81a549dbea56 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.903s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:48.543548 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Successfully updated port: b45721cf-794a-4cef-9660-816123b5b144 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:00:48.561190 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-56ebbb96-e93f-4011-9b73-81a549dbea56 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Deleted allocations for instance ceb9e572-ba71-4a8c-b415-44c9e7ebec51
May 28 10:00:48.586881 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:00:48.598940 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Booting with volume 83485657-e133-49aa-baed-d67cb2fd1720 at /dev/vda
May 28 10:00:48.664945 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:00:48.684420 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:00:48.707149 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:48.754896 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:00:48.755443 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:00:48.767432 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:00:48.768755 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe95:8bd3', 'fe80::fc16:3eff:fe2d:94a4', 'fe80::fc96:34ff:fe12:e4df', 'fe80::2844:59ff:feec:5d21', 'fe80::fc16:3eff:fe7a:26b6', 'fe80::fc16:3eff:feae:5417', 'fe80::fc16:3eff:fefd:30e7', 'fe80::e4df:c0ff:fe86:6341', 'fe80::fc16:3eff:fe0f:9f68', 'fe80::44e2:31ff:fe81:8771', 'fe80::fc16:3eff:fe86:604b', 'fe80::ce2:7bff:fe0e:d096', 'fe80::fc16:3eff:fedb:1077'] 
May 28 10:00:48.768895 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:00:48.769025 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:00:48.769282 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] <== get_connector_properties: return (104ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:00:48.769518 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Updating existing volume attachment record: 563f7872-378e-4742-b417-5fc2435ccf2b {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:00:48.788747 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:00:48.789181 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:00:48.800690 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:00:48.807001 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-08797361-c07a-450b-a1ce-e7f76e0fec4f req-a7a2d64a-8477-4f9a-b14c-4f5eaa714eaa service nova] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Received event network-changed-b45721cf-794a-4cef-9660-816123b5b144 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:48.807001 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-08797361-c07a-450b-a1ce-e7f76e0fec4f req-a7a2d64a-8477-4f9a-b14c-4f5eaa714eaa service nova] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Refreshing instance network info cache due to event network-changed-b45721cf-794a-4cef-9660-816123b5b144. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:00:48.807372 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-08797361-c07a-450b-a1ce-e7f76e0fec4f req-a7a2d64a-8477-4f9a-b14c-4f5eaa714eaa service nova] Acquiring lock "refresh_cache-9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:00:48.807534 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-08797361-c07a-450b-a1ce-e7f76e0fec4f req-a7a2d64a-8477-4f9a-b14c-4f5eaa714eaa service nova] Acquired lock "refresh_cache-9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:00:48.807743 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-08797361-c07a-450b-a1ce-e7f76e0fec4f req-a7a2d64a-8477-4f9a-b14c-4f5eaa714eaa service nova] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Refreshing network info cache for port b45721cf-794a-4cef-9660-816123b5b144 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:00:48.825186 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-1e69381e-5e93-4076-8c8f-fd4aab7ae34d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "c9416092-d229-4f59-aaf3-3b0b692e7924" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.492s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:48.867188 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:49.040615 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Updating instance_info_cache with network_info: [{"id": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "address": "fa:16:3e:b1:88:d2", "network": {"id": "9d46c174-21e3-464e-83c9-e8db18f486a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-151012625-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e1727c7fbc44459c6972d182fc25b1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a01cd4-8a", "ovs_interfaceid": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:00:49.047328 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Acquiring lock "refresh_cache-9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:00:49.267890 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0004693020000559045 future=<Future at 0x73c1f43504d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:49.268455 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Emitting event <LifecycleEvent: 1779962434.2672732, 6002d2d6-f312-48bf-9f07-7fcea8c5e52d => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:00:49.268628 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:49.268866 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] VM Stopped (Lifecycle Event)
May 28 10:00:49.268977 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0010675450000690034 future=<Future at 0x73c1f41ebd10 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:49.269131 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0012364690001049894 future=<Future at 0x73c1f41ebd10 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:49.269222 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:49.269314 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=8.342620196000098 future=<Future at 0x73c1f41c30b0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:49.269401 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=8.342534798000088 future=<Future at 0x73c1f41c30b0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:49.269957 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Emitting event <LifecycleEvent: 1779962434.2678485, ef3d846c-c539-41c5-ade2-1f93e7acc2ca => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:00:49.270103 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] VM Stopped (Lifecycle Event)
May 28 10:00:49.286750 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:49.313317 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-08797361-c07a-450b-a1ce-e7f76e0fec4f req-a7a2d64a-8477-4f9a-b14c-4f5eaa714eaa service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:49.317574 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:49.319569 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:49.319749 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:49.319910 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Auditing locally available compute resources for np0000001613 (node: np0000001613) {{(pid=98321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 10:00:49.445927 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-08797361-c07a-450b-a1ce-e7f76e0fec4f req-a7a2d64a-8477-4f9a-b14c-4f5eaa714eaa service nova] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:00:49.538600 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:00:49.539322 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:00:49.539564 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:00:49.539782 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] No VIF found with MAC fa:16:3e:e0:9c:cd, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:00:49.540548 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Using config drive
May 28 10:00:49.542881 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Releasing lock "refresh_cache-b90b1ecd-e640-4f4e-bd02-fb74021db82b" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:00:49.543339 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Instance network_info: |[{"id": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "address": "fa:16:3e:b1:88:d2", "network": {"id": "9d46c174-21e3-464e-83c9-e8db18f486a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-151012625-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e1727c7fbc44459c6972d182fc25b1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a01cd4-8a", "ovs_interfaceid": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:00:49.546495 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Start _get_guest_xml network_info=[{"id": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "address": "fa:16:3e:b1:88:d2", "network": {"id": "9d46c174-21e3-464e-83c9-e8db18f486a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-151012625-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e1727c7fbc44459c6972d182fc25b1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a01cd4-8a", "ovs_interfaceid": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:00:49.556239 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:00:49.558734 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-1921152164', uuid='b90b1ecd-e640-4f4e-bd02-fb74021db82b'), owner=OwnerMeta(userid='11b9cab1ceef4e4b8cba521b61ad3f55', username='tempest-ServerActionsTestOtherB-634969206-project-member', projectid='11e1727c7fbc44459c6972d182fc25b1', projectname='tempest-ServerActionsTestOtherB-634969206'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "address": "fa:16:3e:b1:88:d2", "network": {"id": "9d46c174-21e3-464e-83c9-e8db18f486a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-151012625-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e1727c7fbc44459c6972d182fc25b1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a01cd4-8a", "ovs_interfaceid": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962449.5581079) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:00:49.560258 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:00:49.561155 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:00:49.561997 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:00:49.562324 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:00:49.563496 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:00:49.563912 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:00:49.564090 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:00:49.564224 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:00:49.564457 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:00:49.564576 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:00:49.565155 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:00:49.565438 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:00:49.565581 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:00:49.565720 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:00:49.565830 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:00:49.565959 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:00:49.579845 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-56ebbb96-e93f-4011-9b73-81a549dbea56 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "ceb9e572-ba71-4a8c-b415-44c9e7ebec51" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.731s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:49.587806 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:00:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1921152164',display_name='tempest-ServerActionsTestOtherB-server-1921152164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serveractionstestotherb-server-1921152164',id=22,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGxE2KIr85UjQ+BCoXx5lmchxbSom5hESV9GE6OjN6uhpkJJULrQoc25hFxuYqlX95IN2Z2yCPiXDLbNxuH0vzgNuyZ6PJzEAoF/ugoalqeMA/O7CY5J9Uu00S0irELsQ==',key_name='tempest-keypair-993221961',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11e1727c7fbc44459c6972d182fc25b1',ramdisk_id='',reservation_id='r-v5rhfg8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-634969206',owner_user_name='tempest-ServerActionsTestOtherB-634969206-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:00:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11b9cab1ceef4e4b8cba521b61ad3f55',uuid=b90b1ecd-e640-4f4e-bd02-fb74021db82b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "address": "fa:16:3e:b1:88:d2", "network": {"id": "9d46c174-21e3-464e-83c9-e8db18f486a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-151012625-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e1727c7fbc44459c6972d182fc25b1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a01cd4-8a", "ovs_interfaceid": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:00:49.588070 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Converting VIF {"id": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "address": "fa:16:3e:b1:88:d2", "network": {"id": "9d46c174-21e3-464e-83c9-e8db18f486a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-151012625-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e1727c7fbc44459c6972d182fc25b1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a01cd4-8a", "ovs_interfaceid": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:00:49.589398 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:88:d2,bridge_name='br-int',has_traffic_filtering=True,id=11a01cd4-8a62-4e25-b303-ac907a1aa4c3,network=Network(9d46c174-21e3-464e-83c9-e8db18f486a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a01cd4-8a') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:00:49.589997 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lazy-loading 'pci_devices' on Instance uuid b90b1ecd-e640-4f4e-bd02-fb74021db82b {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:00:49.653181 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-08797361-c07a-450b-a1ce-e7f76e0fec4f req-a7a2d64a-8477-4f9a-b14c-4f5eaa714eaa service nova] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:00:49.723479 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f3b34456-e103-456a-9721-00d0177ce8d8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "c9416092-d229-4f59-aaf3-3b0b692e7924" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:49.724091 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f3b34456-e103-456a-9721-00d0177ce8d8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "c9416092-d229-4f59-aaf3-3b0b692e7924" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:49.724091 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f3b34456-e103-456a-9721-00d0177ce8d8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "c9416092-d229-4f59-aaf3-3b0b692e7924-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:49.724313 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f3b34456-e103-456a-9721-00d0177ce8d8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "c9416092-d229-4f59-aaf3-3b0b692e7924-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:49.724313 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f3b34456-e103-456a-9721-00d0177ce8d8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "c9416092-d229-4f59-aaf3-3b0b692e7924-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:49.726990 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-f3b34456-e103-456a-9721-00d0177ce8d8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Terminating instance
May 28 10:00:49.775013 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ef3d846c-c539-41c5-ade2-1f93e7acc2ca] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:49.778421 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: 6002d2d6-f312-48bf-9f07-7fcea8c5e52d] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:50.047077 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lazy-loading 'ec2_ids' on Instance uuid d2e043b6-afe6-4afb-92d6-7d8b33545f19 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:00:50.094349 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] End _get_guest_xml xml=<domain type="qemu">
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:   <uuid>b90b1ecd-e640-4f4e-bd02-fb74021db82b</uuid>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:   <name>instance-00000016</name>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:       <nova:name>tempest-ServerActionsTestOtherB-server-1921152164</nova:name>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:00:49</nova:creationTime>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:         <nova:user uuid="11b9cab1ceef4e4b8cba521b61ad3f55">tempest-ServerActionsTestOtherB-634969206-project-member</nova:user>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:         <nova:project uuid="11e1727c7fbc44459c6972d182fc25b1">tempest-ServerActionsTestOtherB-634969206</nova:project>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:         <nova:port uuid="11a01cd4-8a62-4e25-b303-ac907a1aa4c3">
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:     <system>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:       <entry name="serial">b90b1ecd-e640-4f4e-bd02-fb74021db82b</entry>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:       <entry name="uuid">b90b1ecd-e640-4f4e-bd02-fb74021db82b</entry>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:     </system>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:   <os>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:   </os>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:   <features>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:   </features>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:   <devices>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk"/>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:     </disk>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk.config"/>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:     </disk>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:b1:88:d2"/>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:       <target dev="tap11a01cd4-8a"/>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:     </interface>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/console.log" append="off"/>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:     </serial>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:     <video>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:     </video>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:     </rng>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:   </devices>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]: </domain>
May 28 10:00:50.094349 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:00:50.094349 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Preparing to wait for external event network-vif-plugged-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:00:50.094349 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Acquiring lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:50.094349 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:50.094349 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:50.098735 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:00:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1921152164',display_name='tempest-ServerActionsTestOtherB-server-1921152164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serveractionstestotherb-server-1921152164',id=22,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGxE2KIr85UjQ+BCoXx5lmchxbSom5hESV9GE6OjN6uhpkJJULrQoc25hFxuYqlX95IN2Z2yCPiXDLbNxuH0vzgNuyZ6PJzEAoF/ugoalqeMA/O7CY5J9Uu00S0irELsQ==',key_name='tempest-keypair-993221961',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11e1727c7fbc44459c6972d182fc25b1',ramdisk_id='',reservation_id='r-v5rhfg8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-634969206',owner_user_name='tempest-ServerActionsTestOtherB-634969206-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:00:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11b9cab1ceef4e4b8cba521b61ad3f55',uuid=b90b1ecd-e640-4f4e-bd02-fb74021db82b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "address": "fa:16:3e:b1:88:d2", "network": {"id": "9d46c174-21e3-464e-83c9-e8db18f486a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-151012625-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e1727c7fbc44459c6972d182fc25b1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a01cd4-8a", "ovs_interfaceid": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:00:50.098735 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Converting VIF {"id": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "address": "fa:16:3e:b1:88:d2", "network": {"id": "9d46c174-21e3-464e-83c9-e8db18f486a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-151012625-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e1727c7fbc44459c6972d182fc25b1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a01cd4-8a", "ovs_interfaceid": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:00:50.098735 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:88:d2,bridge_name='br-int',has_traffic_filtering=True,id=11a01cd4-8a62-4e25-b303-ac907a1aa4c3,network=Network(9d46c174-21e3-464e-83c9-e8db18f486a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a01cd4-8a') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:00:50.098735 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:88:d2,bridge_name='br-int',has_traffic_filtering=True,id=11a01cd4-8a62-4e25-b303-ac907a1aa4c3,network=Network(9d46c174-21e3-464e-83c9-e8db18f486a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a01cd4-8a') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:00:50.099319 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:50.099319 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:50.099443 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:00:50.100569 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:50.100758 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e920fbcb-3653-5b58-894a-5da8e2591c0d', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:50.101594 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:50.103837 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:00:50.110318 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:50.116517 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:50.119501 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11a01cd4-8a, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:50.120317 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap11a01cd4-8a, col_values=(('qos', UUID('6a1393fc-9685-4718-b665-4c337cf1a6a1')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:50.120317 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap11a01cd4-8a, col_values=(('external_ids', {'iface-id': '11a01cd4-8a62-4e25-b303-ac907a1aa4c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:88:d2', 'vm-uuid': 'b90b1ecd-e640-4f4e-bd02-fb74021db82b'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:50.121892 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:50.123312 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:00:50.135700 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:50.139250 np0000001613 nova-compute[98321]: INFO os_vif [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:88:d2,bridge_name='br-int',has_traffic_filtering=True,id=11a01cd4-8a62-4e25-b303-ac907a1aa4c3,network=Network(9d46c174-21e3-464e-83c9-e8db18f486a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a01cd4-8a')
May 28 10:00:50.158672 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-08797361-c07a-450b-a1ce-e7f76e0fec4f req-a7a2d64a-8477-4f9a-b14c-4f5eaa714eaa service nova] Releasing lock "refresh_cache-9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:00:50.158672 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Acquired lock "refresh_cache-9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:00:50.158672 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:00:50.235105 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f3b34456-e103-456a-9721-00d0177ce8d8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:00:50.235105 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:50.277102 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:50.283468 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:50.309786 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-92cf5b30-6407-4307-972f-a2f78b059fe6 req-b8d79119-d90c-4bde-a191-4635fbfcdd13 service nova] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Received event network-changed-285e920e-6acb-4c37-ab27-552538efb652 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:50.309786 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-92cf5b30-6407-4307-972f-a2f78b059fe6 req-b8d79119-d90c-4bde-a191-4635fbfcdd13 service nova] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Refreshing instance network info cache due to event network-changed-285e920e-6acb-4c37-ab27-552538efb652. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:00:50.309786 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-92cf5b30-6407-4307-972f-a2f78b059fe6 req-b8d79119-d90c-4bde-a191-4635fbfcdd13 service nova] Acquiring lock "refresh_cache-b50eced2-71bf-4448-b2e1-f9657509f34c" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:00:50.309786 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-92cf5b30-6407-4307-972f-a2f78b059fe6 req-b8d79119-d90c-4bde-a191-4635fbfcdd13 service nova] Acquired lock "refresh_cache-b50eced2-71bf-4448-b2e1-f9657509f34c" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:00:50.309786 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-92cf5b30-6407-4307-972f-a2f78b059fe6 req-b8d79119-d90c-4bde-a191-4635fbfcdd13 service nova] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Refreshing network info cache for port 285e920e-6acb-4c37-ab27-552538efb652 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:00:50.313112 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:50.314417 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "57d353b6-133e-4354-a4f4-7bcec543d586" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:50.316409 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "57d353b6-133e-4354-a4f4-7bcec543d586" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:50.317412 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:50.317696 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:50.317896 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:50.322066 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Terminating instance
May 28 10:00:50.396661 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "3edc00a8-2c60-4c44-acb8-6f4d02114bf0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:50.397063 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "3edc00a8-2c60-4c44-acb8-6f4d02114bf0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:50.442763 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:50.499804 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:50.515898 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:50.554546 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Object Instance<d2e043b6-afe6-4afb-92d6-7d8b33545f19> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:00:50.555040 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lazy-loading 'keypairs' on Instance uuid d2e043b6-afe6-4afb-92d6-7d8b33545f19 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:00:50.571318 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:50.571894 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:50.617487 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999073887000122 future=<Future at 0x73c1f4239e20 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:50.623058 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Instance destroyed successfully.
May 28 10:00:50.624881 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-f3b34456-e103-456a-9721-00d0177ce8d8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lazy-loading 'resources' on Instance uuid c9416092-d229-4f59-aaf3-3b0b692e7924 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:00:50.704131 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:50.706524 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk.rescue --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:50.796428 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:00:50.816665 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk.rescue --force-share --output=json" returned: 0 in 0.110s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:50.817104 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk.rescue --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:50.842199 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-92cf5b30-6407-4307-972f-a2f78b059fe6 req-b8d79119-d90c-4bde-a191-4635fbfcdd13 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:50.845933 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:00:50.903077 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:00:50.920434 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:50.927186 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:50.936461 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:00:50.938259 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:00:50.938684 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Creating image(s)
May 28 10:00:50.939180 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Did not create local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 10:00:50.939575 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Ensure instance console log exists: /opt/stack/data/nova/instances/9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:00:50.939860 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:50.940196 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:50.940394 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:50.943897 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk.rescue --force-share --output=json" returned: 0 in 0.127s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:50.945741 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:50.963660 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:51.061204 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Object Instance<d2e043b6-afe6-4afb-92d6-7d8b33545f19> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:00:51.066828 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:51.084550 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:51.087794 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:51.145375 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-f3b34456-e103-456a-9721-00d0177ce8d8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T09:58:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-108220691',display_name='tempest-ServerActionsTestOtherA-server-590881060',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-tempest-common-compute-instance-108220691',id=11,image_ref='3427ea11-12a6-4b25-8c73-769d29819fe0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdAbUj53uPVh2c6JmC0f4KuNc7XzB7W4qhLekRIZb4uQ1puOTl+iHN7nlIYOIwGJpx2OcUD9FRst/gQF9pX2F6kz8VeUkdxZMdxvvnrPL706aUB6jSV93natJMiSLTBtQ==',key_name='tempest-keypair-1688806139',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:00:05Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb3a501b4f4041ef875ef4d2b4167044',ramdisk_id='',reservation_id='r-v17yjkz1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3427ea11-12a6-4b25-8c73-769d29819fe0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1557455944',owner_user_name='tempest-ServerActionsTestOtherA-1557455944-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:00:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62efa57da85f458790f3ceeebcc777a7',uuid=c9416092-d229-4f59-aaf3-3b0b692e7924,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fec718e7-b773-4907-abf5-60f374bd420a", "address": "fa:16:3e:ae:54:17", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec718e7-b7", "ovs_interfaceid": "fec718e7-b773-4907-abf5-60f374bd420a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:00:51.145967 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-f3b34456-e103-456a-9721-00d0177ce8d8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Converting VIF {"id": "fec718e7-b773-4907-abf5-60f374bd420a", "address": "fa:16:3e:ae:54:17", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec718e7-b7", "ovs_interfaceid": "fec718e7-b773-4907-abf5-60f374bd420a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:00:51.147234 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-f3b34456-e103-456a-9721-00d0177ce8d8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:54:17,bridge_name='br-int',has_traffic_filtering=True,id=fec718e7-b773-4907-abf5-60f374bd420a,network=Network(2ae47a43-582b-442f-922d-fe7138b431a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec718e7-b7') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:00:51.147772 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-f3b34456-e103-456a-9721-00d0177ce8d8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:54:17,bridge_name='br-int',has_traffic_filtering=True,id=fec718e7-b773-4907-abf5-60f374bd420a,network=Network(2ae47a43-582b-442f-922d-fe7138b431a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec718e7-b7') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:00:51.151569 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:51.152014 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfec718e7-b7, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:51.171459 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:51.171979 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:00:51.188138 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:51.196630 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:51.196630 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=21983718-6f14-4380-ad58-aed05e5e2a3f) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:51.196630 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:51.196630 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:00:51.205485 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:51.216091 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:51.220252 np0000001613 nova-compute[98321]: INFO os_vif [None req-f3b34456-e103-456a-9721-00d0177ce8d8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:54:17,bridge_name='br-int',has_traffic_filtering=True,id=fec718e7-b773-4907-abf5-60f374bd420a,network=Network(2ae47a43-582b-442f-922d-fe7138b431a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfec718e7-b7')
May 28 10:00:51.220448 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-f3b34456-e103-456a-9721-00d0177ce8d8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Deleting instance files /opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924_del
May 28 10:00:51.223172 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-f3b34456-e103-456a-9721-00d0177ce8d8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Deletion of /opt/stack/data/nova/instances/c9416092-d229-4f59-aaf3-3b0b692e7924_del complete
May 28 10:00:51.234579 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:51.251918 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:51.252676 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Periodic task is updating the host stat, it is trying to get disk instance-00000014, but disk file was removed by concurrent operations such as resize.: FileNotFoundError: [Errno 2] No such file or directory: '/opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk.config.rescue'
May 28 10:00:51.257902 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-5 (vda) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:00:51.267257 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/289e2914-2be4-4f46-92e0-fa623f8db861/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:51.341586 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.998957109999992 future=<Future at 0x73c1f4045640 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:51.355009 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:51.371303 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Instance destroyed successfully.
May 28 10:00:51.379799 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lazy-loading 'resources' on Instance uuid 57d353b6-133e-4354-a4f4-7bcec543d586 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:00:51.428422 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/289e2914-2be4-4f46-92e0-fa623f8db861/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:51.429340 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/289e2914-2be4-4f46-92e0-fa623f8db861/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:51.514436 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:51.515142 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:51.525711 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:00:51.525914 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Claim successful on node np0000001613
May 28 10:00:51.576017 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Creating config drive at /opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk.config.rescue
May 28 10:00:51.576885 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/289e2914-2be4-4f46-92e0-fa623f8db861/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:51.581195 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:00:51.585725 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:51.614744 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpeb18tsof {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:51.672902 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpeb18tsof" returned: 0 in 0.058s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:51.687759 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:00:51.687996 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:00:51.688795 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] No VIF found with MAC fa:16:3e:b1:88:d2, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:00:51.688997 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Using config drive
May 28 10:00:51.722331 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:51.724232 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:51.778693 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-f3b34456-e103-456a-9721-00d0177ce8d8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Took 1.54 seconds to destroy the instance on the hypervisor.
May 28 10:00:51.780341 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-f3b34456-e103-456a-9721-00d0177ce8d8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:00:51.780899 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:00:51.781378 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:00:51.782101 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:51.884480 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:51.891018 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-665492048',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serverbootfromvolumestablerescuetest-server-665492048',id=10,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T09:58:56Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9d04b105229456d9ab53df1886fdb37',ramdisk_id='',reservation_id='r-7cgj5of9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-283762505',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T09:59:02Z,user_data=None,user_id='51981c995f2246588f2d58f35be5848a',uuid=57d353b6-133e-4354-a4f4-7bcec543d586,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d6ec393-b62a-4342-a355-3cf8291ec2fe", "address": "fa:16:3e:7a:26:b6", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d6ec393-b6", "ovs_interfaceid": "9d6ec393-b62a-4342-a355-3cf8291ec2fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:00:51.891329 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Converting VIF {"id": "9d6ec393-b62a-4342-a355-3cf8291ec2fe", "address": "fa:16:3e:7a:26:b6", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d6ec393-b6", "ovs_interfaceid": "9d6ec393-b62a-4342-a355-3cf8291ec2fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:00:51.892420 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:26:b6,bridge_name='br-int',has_traffic_filtering=True,id=9d6ec393-b62a-4342-a355-3cf8291ec2fe,network=Network(e5543f88-c716-4e02-82e9-2cb7570bf25e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d6ec393-b6') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:00:51.892960 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:26:b6,bridge_name='br-int',has_traffic_filtering=True,id=9d6ec393-b62a-4342-a355-3cf8291ec2fe,network=Network(e5543f88-c716-4e02-82e9-2cb7570bf25e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d6ec393-b6') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:00:51.897862 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:51.901695 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:51.903335 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:51.905701 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d6ec393-b6, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:51.944376 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Updating instance_info_cache with network_info: [{"id": "b45721cf-794a-4cef-9660-816123b5b144", "address": "fa:16:3e:15:41:54", "network": {"id": "a546cd76-74b1-4628-b9bf-c80f6b8f1bec", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1194909584-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2b4cc0430ca14757a829b60eb7e0081e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45721cf-79", "ovs_interfaceid": "b45721cf-794a-4cef-9660-816123b5b144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:00:51.953544 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:00:51.959231 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:51.959231 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=601a1555-ee15-4c9e-a0af-8250ead7feb4) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:51.959231 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:51.959231 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:00:51.969046 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:51.973789 np0000001613 nova-compute[98321]: INFO os_vif [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:26:b6,bridge_name='br-int',has_traffic_filtering=True,id=9d6ec393-b62a-4342-a355-3cf8291ec2fe,network=Network(e5543f88-c716-4e02-82e9-2cb7570bf25e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d6ec393-b6')
May 28 10:00:51.982060 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:00:51.982566 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd1dfc5cc-6703-445f-9daa-05afb78f89f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:00:51.984862 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:00:51.985082 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:00:51.986563 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd1dfc5cc-6703-445f-9daa-05afb78f89f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:00:51.987513 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:00:52.012229 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:52.012229 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:52.029195 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:52.029195 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:52.029195 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:52.029195 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:52.029195 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:00:52.029195 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:52.029195 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:52.029195 np0000001613 nova-compute[98321]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:52.029195 np0000001613 nova-compute[98321]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0 (non-flash)
May 28 10:00:52.029195 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:00:52.029195 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', '6')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:00:52.029195 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', '6')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:00:52.029845 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0', '5')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:00:52.034134 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc22c0e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0'): ({'sdd'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:00:52.036320 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Removing multipathed devices sdd, sde {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:00:52.042688 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Flush multipath device 330000000605f379a {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:00:52.058054 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-92cf5b30-6407-4307-972f-a2f78b059fe6 req-b8d79119-d90c-4bde-a191-4635fbfcdd13 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:52.084608 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:00:52.133221 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:00:52.148117 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:52.158907 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:52.185908 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:00:52.185908 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:00:52.187956 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:00:52.206357 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:52.210880 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:00:52.211304 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:00:52.225219 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:52.265426 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0, portal: 192.168.40.100,3260]
May 28 10:00:52.265426 np0000001613 nova-compute[98321]: Logout of [sid: 6, target: iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0, portal: 192.168.40.100,3260] successful.
May 28 10:00:52.265426 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:52.274062 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:52.274062 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:52.298406 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:52.327318 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:52.331916 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:52.352458 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:52.388267 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:52.392040 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0, portal: 192.168.50.100,3260]
May 28 10:00:52.392040 np0000001613 nova-compute[98321]: Logout of [sid: 5, target: iqn.2023-03.storpool.com:os--volume-d1dfc5cc-6703-445f-9daa-05afb78f89f0, portal: 192.168.50.100,3260] successful.
May 28 10:00:52.392040 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:52.393414 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9fd8989-d182-47e4-9409-266a1440bf58/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:52.413506 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:52.414462 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.429s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:00:52.414650 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] <== disconnect_volume: return (429ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:00:52.414874 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:00:52.415309 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Deleting instance files /opt/stack/data/nova/instances/57d353b6-133e-4354-a4f4-7bcec543d586_del
May 28 10:00:52.416128 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Deletion of /opt/stack/data/nova/instances/57d353b6-133e-4354-a4f4-7bcec543d586_del complete
May 28 10:00:52.444909 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:52.456515 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Releasing lock "refresh_cache-9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:00:52.456515 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Instance network_info: |[{"id": "b45721cf-794a-4cef-9660-816123b5b144", "address": "fa:16:3e:15:41:54", "network": {"id": "a546cd76-74b1-4628-b9bf-c80f6b8f1bec", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1194909584-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2b4cc0430ca14757a829b60eb7e0081e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45721cf-79", "ovs_interfaceid": "b45721cf-794a-4cef-9660-816123b5b144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:00:52.458809 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Start _get_guest_xml network_info=[{"id": "b45721cf-794a-4cef-9660-816123b5b144", "address": "fa:16:3e:15:41:54", "network": {"id": "a546cd76-74b1-4628-b9bf-c80f6b8f1bec", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1194909584-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2b4cc0430ca14757a829b60eb7e0081e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45721cf-79", "ovs_interfaceid": "b45721cf-794a-4cef-9660-816123b5b144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83485657-e133-49aa-baed-d67cb2fd1720', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590', 'attached_at': '', 'detached_at': '', 'volume_id': '83485657-e133-49aa-baed-d67cb2fd1720', 'serial': '83485657-e133-49aa-baed-d67cb2fd1720'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '563f7872-378e-4742-b417-5fc2435ccf2b', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:00:52.467448 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-540cb9fd-c65f-4d8f-ad2b-8d1034961277 req-e132013f-5743-48f7-99ab-19fb8f6e0faa service nova] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Received event network-vif-unplugged-fec718e7-b773-4907-abf5-60f374bd420a {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:52.468079 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-540cb9fd-c65f-4d8f-ad2b-8d1034961277 req-e132013f-5743-48f7-99ab-19fb8f6e0faa service nova] Acquiring lock "c9416092-d229-4f59-aaf3-3b0b692e7924-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:52.469118 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-540cb9fd-c65f-4d8f-ad2b-8d1034961277 req-e132013f-5743-48f7-99ab-19fb8f6e0faa service nova] Lock "c9416092-d229-4f59-aaf3-3b0b692e7924-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:52.470423 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-540cb9fd-c65f-4d8f-ad2b-8d1034961277 req-e132013f-5743-48f7-99ab-19fb8f6e0faa service nova] Lock "c9416092-d229-4f59-aaf3-3b0b692e7924-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:52.470423 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-540cb9fd-c65f-4d8f-ad2b-8d1034961277 req-e132013f-5743-48f7-99ab-19fb8f6e0faa service nova] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] No waiting events found dispatching network-vif-unplugged-fec718e7-b773-4907-abf5-60f374bd420a {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:00:52.470423 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-540cb9fd-c65f-4d8f-ad2b-8d1034961277 req-e132013f-5743-48f7-99ab-19fb8f6e0faa service nova] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Received event network-vif-unplugged-fec718e7-b773-4907-abf5-60f374bd420a for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:00:52.470545 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-540cb9fd-c65f-4d8f-ad2b-8d1034961277 req-e132013f-5743-48f7-99ab-19fb8f6e0faa service nova] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Received event network-vif-unplugged-fec718e7-b773-4907-abf5-60f374bd420a {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:52.471082 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-540cb9fd-c65f-4d8f-ad2b-8d1034961277 req-e132013f-5743-48f7-99ab-19fb8f6e0faa service nova] Acquiring lock "c9416092-d229-4f59-aaf3-3b0b692e7924-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:52.473893 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-540cb9fd-c65f-4d8f-ad2b-8d1034961277 req-e132013f-5743-48f7-99ab-19fb8f6e0faa service nova] Lock "c9416092-d229-4f59-aaf3-3b0b692e7924-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:52.473893 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-540cb9fd-c65f-4d8f-ad2b-8d1034961277 req-e132013f-5743-48f7-99ab-19fb8f6e0faa service nova] Lock "c9416092-d229-4f59-aaf3-3b0b692e7924-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:52.473893 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-540cb9fd-c65f-4d8f-ad2b-8d1034961277 req-e132013f-5743-48f7-99ab-19fb8f6e0faa service nova] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] No waiting events found dispatching network-vif-unplugged-fec718e7-b773-4907-abf5-60f374bd420a {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:00:52.473893 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-540cb9fd-c65f-4d8f-ad2b-8d1034961277 req-e132013f-5743-48f7-99ab-19fb8f6e0faa service nova] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Received event network-vif-unplugged-fec718e7-b773-4907-abf5-60f374bd420a for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:00:52.473893 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-540cb9fd-c65f-4d8f-ad2b-8d1034961277 req-e132013f-5743-48f7-99ab-19fb8f6e0faa service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Received event network-vif-unplugged-9d6ec393-b62a-4342-a355-3cf8291ec2fe {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:52.473893 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-540cb9fd-c65f-4d8f-ad2b-8d1034961277 req-e132013f-5743-48f7-99ab-19fb8f6e0faa service nova] Acquiring lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:52.473893 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-540cb9fd-c65f-4d8f-ad2b-8d1034961277 req-e132013f-5743-48f7-99ab-19fb8f6e0faa service nova] Lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:52.473893 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-540cb9fd-c65f-4d8f-ad2b-8d1034961277 req-e132013f-5743-48f7-99ab-19fb8f6e0faa service nova] Lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:52.473893 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-540cb9fd-c65f-4d8f-ad2b-8d1034961277 req-e132013f-5743-48f7-99ab-19fb8f6e0faa service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] No waiting events found dispatching network-vif-unplugged-9d6ec393-b62a-4342-a355-3cf8291ec2fe {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:00:52.473893 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-540cb9fd-c65f-4d8f-ad2b-8d1034961277 req-e132013f-5743-48f7-99ab-19fb8f6e0faa service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Received event network-vif-unplugged-9d6ec393-b62a-4342-a355-3cf8291ec2fe for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:00:52.473893 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-540cb9fd-c65f-4d8f-ad2b-8d1034961277 req-e132013f-5743-48f7-99ab-19fb8f6e0faa service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Received event network-vif-unplugged-9d6ec393-b62a-4342-a355-3cf8291ec2fe {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:52.473893 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-540cb9fd-c65f-4d8f-ad2b-8d1034961277 req-e132013f-5743-48f7-99ab-19fb8f6e0faa service nova] Acquiring lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:52.473893 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-540cb9fd-c65f-4d8f-ad2b-8d1034961277 req-e132013f-5743-48f7-99ab-19fb8f6e0faa service nova] Lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:52.473893 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-540cb9fd-c65f-4d8f-ad2b-8d1034961277 req-e132013f-5743-48f7-99ab-19fb8f6e0faa service nova] Lock "57d353b6-133e-4354-a4f4-7bcec543d586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:52.473893 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-540cb9fd-c65f-4d8f-ad2b-8d1034961277 req-e132013f-5743-48f7-99ab-19fb8f6e0faa service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] No waiting events found dispatching network-vif-unplugged-9d6ec393-b62a-4342-a355-3cf8291ec2fe {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:00:52.473893 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-540cb9fd-c65f-4d8f-ad2b-8d1034961277 req-e132013f-5743-48f7-99ab-19fb8f6e0faa service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Received event network-vif-unplugged-9d6ec393-b62a-4342-a355-3cf8291ec2fe for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:00:52.475806 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:00:52.478059 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsV293TestJSON-server-1963844026', uuid='9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590'), owner=OwnerMeta(userid='321e041ada2b405e821acd703457ddcb', username='tempest-ServerActionsV293TestJSON-1376389954-project-member', projectid='2b4cc0430ca14757a829b60eb7e0081e', projectname='tempest-ServerActionsV293TestJSON-1376389954'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b45721cf-794a-4cef-9660-816123b5b144", "address": "fa:16:3e:15:41:54", "network": {"id": "a546cd76-74b1-4628-b9bf-c80f6b8f1bec", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1194909584-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2b4cc0430ca14757a829b60eb7e0081e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45721cf-79", "ovs_interfaceid": "b45721cf-794a-4cef-9660-816123b5b144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962452.4766753) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:00:52.484314 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:00:52.484314 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:00:52.492453 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:00:52.492701 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:00:52.495673 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:00:52.501228 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:00:52.501228 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:00:52.501228 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:00:52.501228 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:00:52.501228 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:00:52.501228 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:00:52.501228 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:00:52.501228 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:00:52.501228 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:00:52.501228 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:00:52.501228 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:00:52.514903 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:00:52.515246 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83485657-e133-49aa-baed-d67cb2fd1720', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:00:52.516276 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:00:52.516276 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:00:52.516276 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83485657-e133-49aa-baed-d67cb2fd1720', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:00:52.524149 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:52.531740 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:00:52.532216 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:00:52.532351 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:00:52.533390 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:00:52.534356 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:52.536695 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:00:52.537447 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:00:52.538758 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9fd8989-d182-47e4-9409-266a1440bf58/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:52.539225 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9fd8989-d182-47e4-9409-266a1440bf58/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:52.577789 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:00:52.577789 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:52.579676 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:00:52.579676 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:52.603478 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720] added
May 28 10:00:52.603478 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:00:52.603478 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:00:52.603478 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:00:52.603478 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:00:52.603478 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:00:52.603478 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:52.603478 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:00:52.603478 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0701(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:00:52.603478 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:00:52.618247 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720] added
May 28 10:00:52.618247 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:00:52.618247 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:00:52.618247 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:00:52.618247 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:00:52.618247 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:00:52.618247 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:52.619308 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:00:52.619308 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0819(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:00:52.619308 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:00:52.692726 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9fd8989-d182-47e4-9409-266a1440bf58/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:52.703196 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:00:52.703196 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:52.731220 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-92cf5b30-6407-4307-972f-a2f78b059fe6 req-b8d79119-d90c-4bde-a191-4635fbfcdd13 service nova] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Updated VIF entry in instance network info cache for port 285e920e-6acb-4c37-ab27-552538efb652. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:00:52.732342 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-92cf5b30-6407-4307-972f-a2f78b059fe6 req-b8d79119-d90c-4bde-a191-4635fbfcdd13 service nova] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Updating instance_info_cache with network_info: [{"id": "285e920e-6acb-4c37-ab27-552538efb652", "address": "fa:16:3e:db:10:77", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap285e920e-6a", "ovs_interfaceid": "285e920e-6acb-4c37-ab27-552538efb652", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:00:52.751871 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "env LANG=C uptime" returned: 0 in 0.050s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:52.752471 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Hypervisor/Node resource view: name=np0000001613 free_ram=12102MB free_disk=74.37798309326172GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 10:00:52.753875 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:52.786474 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Creating config drive at /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk.config
May 28 10:00:52.798210 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpyk4rixo3 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:52.852514 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpyk4rixo3" returned: 0 in 0.055s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:52.930176 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-de9d678a-dbcf-4991-b489-aaf2275ceaf7 req-7b1675d8-5b26-4a6c-a72c-c472d4ccbb58 service nova] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Received event network-vif-plugged-f58856d7-37d0-48f5-8883-32267e5b73bc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:52.931033 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-de9d678a-dbcf-4991-b489-aaf2275ceaf7 req-7b1675d8-5b26-4a6c-a72c-c472d4ccbb58 service nova] Acquiring lock "d2e043b6-afe6-4afb-92d6-7d8b33545f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:52.934290 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-de9d678a-dbcf-4991-b489-aaf2275ceaf7 req-7b1675d8-5b26-4a6c-a72c-c472d4ccbb58 service nova] Lock "d2e043b6-afe6-4afb-92d6-7d8b33545f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:52.934290 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-de9d678a-dbcf-4991-b489-aaf2275ceaf7 req-7b1675d8-5b26-4a6c-a72c-c472d4ccbb58 service nova] Lock "d2e043b6-afe6-4afb-92d6-7d8b33545f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:52.934290 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-de9d678a-dbcf-4991-b489-aaf2275ceaf7 req-7b1675d8-5b26-4a6c-a72c-c472d4ccbb58 service nova] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] No waiting events found dispatching network-vif-plugged-f58856d7-37d0-48f5-8883-32267e5b73bc {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:00:52.934290 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-de9d678a-dbcf-4991-b489-aaf2275ceaf7 req-7b1675d8-5b26-4a6c-a72c-c472d4ccbb58 service nova] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Received unexpected event network-vif-plugged-f58856d7-37d0-48f5-8883-32267e5b73bc for instance with vm_state active and task_state rescuing.
May 28 10:00:52.934525 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Took 2.09 seconds to destroy the instance on the hypervisor.
May 28 10:00:52.937670 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:00:52.939954 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:00:52.940144 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:00:52.940580 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:53.080356 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:53.124754 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:00:53.225058 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:53.241856 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-92cf5b30-6407-4307-972f-a2f78b059fe6 req-b8d79119-d90c-4bde-a191-4635fbfcdd13 service nova] Releasing lock "refresh_cache-b50eced2-71bf-4448-b2e1-f9657509f34c" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:00:53.457230 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:53.487367 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:53.492291 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:53.583650 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Removed pending STOPPED event for d2e043b6-afe6-4afb-92d6-7d8b33545f19 due to new event <LifecycleEvent: 1779962453.5815997, d2e043b6-afe6-4afb-92d6-7d8b33545f19 => Resumed> {{(pid=98321) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 10:00:53.583650 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962453.5815997, d2e043b6-afe6-4afb-92d6-7d8b33545f19 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:00:53.583650 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] VM Resumed (Lifecycle Event)
May 28 10:00:53.591277 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-0fc24dc0-3756-40b6-a127-96db986d85a3 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:53.603426 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:00:53.621961 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:00:53.632434 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:00:53.632434 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:53.638810 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Took 1.85 seconds to deallocate network for instance.
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:00:53.659214 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:53.659214 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:53.661849 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:53.688229 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:53.688229 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:53.688229 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:00:53.688229 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:53.688229 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:53.688229 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:00:53.699358 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:53.729111 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:53.729111 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:53.729111 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:00:53.729111 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:00:53.729111 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:53.729111 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:53.729111 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:00:53.729111 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:00:53.734801 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720, portal: 192.168.40.100,3260]
May 28 10:00:53.734801 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720, portal: 192.168.40.100,3260] successful.
May 28 10:00:53.734801 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:53.741106 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:00:53.741833 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:00:53.760184 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:53.769671 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720, portal: 192.168.50.100,3260]
May 28 10:00:53.769671 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720, portal: 192.168.50.100,3260] successful.
May 28 10:00:53.769671 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:53.784901 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:53.784901 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:53.784901 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:00:53.784901 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:00:53.784901 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:00:53.795402 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:53.795402 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:53.795402 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:00:53.795402 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:00:53.795402 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:00:53.797364 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.264s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:00:53.797364 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:00:53.797364 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:00:53.809783 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] HCTL ('7', '-', '-', 0) found on session 33 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:00:53.809981 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:00:53.829400 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:53.829400 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:53.829400 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:00:53.829400 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:00:53.829400 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:00:53.831089 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:53.831089 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:00:53.831089 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:00:53.831089 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:00:53.831089 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:00:53.831089 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.294s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:00:53.831089 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:00:53.831297 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] HCTL ('8', '-', '-', 0) found on session 34 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:00:53.833173 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:00:53.846726 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Searching for a device in session 33 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:00:53.846726 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83485657-e133-49aa-baed-d67cb2fd1720', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:00:53.862758 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Searching for a device in session 34 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:00:53.862758 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '83485657-e133-49aa-baed-d67cb2fd1720', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:00:53.910835 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5845b79b-2f28-4c50-9ad5-0037d09f5320 req-f2c88257-d748-44c5-927e-08074f1bc85f service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Received event network-vif-deleted-9d6ec393-b62a-4342-a355-3cf8291ec2fe {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:53.910835 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-5845b79b-2f28-4c50-9ad5-0037d09f5320 req-f2c88257-d748-44c5-927e-08074f1bc85f service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Neutron deleted interface 9d6ec393-b62a-4342-a355-3cf8291ec2fe; detaching it from the instance and deleting it from the info cache
May 28 10:00:53.912146 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5845b79b-2f28-4c50-9ad5-0037d09f5320 req-f2c88257-d748-44c5-927e-08074f1bc85f service nova] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Detach interface failed, port_id=9d6ec393-b62a-4342-a355-3cf8291ec2fe, reason: Instance 57d353b6-133e-4354-a4f4-7bcec543d586 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:00:54.075328 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:54.078139 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:54.087272 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:54.096081 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:54.100286 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:00:54.113140 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:54.164117 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f3b34456-e103-456a-9721-00d0177ce8d8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:54.265907 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:00:54.288127 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:54.308531 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:00:54.535347 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:00:54.587144 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-0cd07011-b365-4640-88a4-eb447a0fc384 req-66fbcde2-8fcd-4ed6-8c77-352f6742bb0e service nova] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Received event network-vif-deleted-fec718e7-b773-4907-abf5-60f374bd420a {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:54.588709 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-0cd07011-b365-4640-88a4-eb447a0fc384 req-66fbcde2-8fcd-4ed6-8c77-352f6742bb0e service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Received event network-vif-plugged-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:54.588709 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0cd07011-b365-4640-88a4-eb447a0fc384 req-66fbcde2-8fcd-4ed6-8c77-352f6742bb0e service nova] Acquiring lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:54.588709 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0cd07011-b365-4640-88a4-eb447a0fc384 req-66fbcde2-8fcd-4ed6-8c77-352f6742bb0e service nova] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:54.588709 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0cd07011-b365-4640-88a4-eb447a0fc384 req-66fbcde2-8fcd-4ed6-8c77-352f6742bb0e service nova] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:54.588709 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-0cd07011-b365-4640-88a4-eb447a0fc384 req-66fbcde2-8fcd-4ed6-8c77-352f6742bb0e service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Processing event network-vif-plugged-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:00:54.588709 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-0cd07011-b365-4640-88a4-eb447a0fc384 req-66fbcde2-8fcd-4ed6-8c77-352f6742bb0e service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Received event network-vif-plugged-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:54.588929 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0cd07011-b365-4640-88a4-eb447a0fc384 req-66fbcde2-8fcd-4ed6-8c77-352f6742bb0e service nova] Acquiring lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:54.589452 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0cd07011-b365-4640-88a4-eb447a0fc384 req-66fbcde2-8fcd-4ed6-8c77-352f6742bb0e service nova] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:54.590000 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0cd07011-b365-4640-88a4-eb447a0fc384 req-66fbcde2-8fcd-4ed6-8c77-352f6742bb0e service nova] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:54.590209 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-0cd07011-b365-4640-88a4-eb447a0fc384 req-66fbcde2-8fcd-4ed6-8c77-352f6742bb0e service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] No waiting events found dispatching network-vif-plugged-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:00:54.590496 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-0cd07011-b365-4640-88a4-eb447a0fc384 req-66fbcde2-8fcd-4ed6-8c77-352f6742bb0e service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Received unexpected event network-vif-plugged-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 for instance with vm_state building and task_state spawning.
May 28 10:00:54.604856 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962454.6032426, d2e043b6-afe6-4afb-92d6-7d8b33545f19 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:00:54.604856 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] VM Started (Lifecycle Event)
May 28 10:00:54.688537 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:00:54.690992 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:00:54.692873 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Instance spawned successfully.
May 28 10:00:54.693186 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:00:54.776307 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.262s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:54.776835 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:00:54.780212 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 2.026s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:54.811685 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Took 1.87 seconds to deallocate network for instance.
May 28 10:00:55.055843 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-dec277a5-fc9b-4cf2-ab0f-a3703cf06a44 req-a926ca6b-e08c-40af-8565-86b7ee123f84 service nova] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Received event network-vif-plugged-f58856d7-37d0-48f5-8883-32267e5b73bc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:55.055843 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-dec277a5-fc9b-4cf2-ab0f-a3703cf06a44 req-a926ca6b-e08c-40af-8565-86b7ee123f84 service nova] Acquiring lock "d2e043b6-afe6-4afb-92d6-7d8b33545f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:55.055843 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-dec277a5-fc9b-4cf2-ab0f-a3703cf06a44 req-a926ca6b-e08c-40af-8565-86b7ee123f84 service nova] Lock "d2e043b6-afe6-4afb-92d6-7d8b33545f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:55.055843 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-dec277a5-fc9b-4cf2-ab0f-a3703cf06a44 req-a926ca6b-e08c-40af-8565-86b7ee123f84 service nova] Lock "d2e043b6-afe6-4afb-92d6-7d8b33545f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:55.055843 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-dec277a5-fc9b-4cf2-ab0f-a3703cf06a44 req-a926ca6b-e08c-40af-8565-86b7ee123f84 service nova] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] No waiting events found dispatching network-vif-plugged-f58856d7-37d0-48f5-8883-32267e5b73bc {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:00:55.055843 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-dec277a5-fc9b-4cf2-ab0f-a3703cf06a44 req-a926ca6b-e08c-40af-8565-86b7ee123f84 service nova] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Received unexpected event network-vif-plugged-f58856d7-37d0-48f5-8883-32267e5b73bc for instance with vm_state rescued and task_state None.
May 28 10:00:55.108989 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:55.116439 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:00:55.204720 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:55.204857 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:55.205245 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:55.205570 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:55.205925 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:55.206292 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:00:55.285043 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:00:55.295946 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:00:55.295946 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:55.299252 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:55.391801 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Took 0.58 seconds to detach 1 volumes for instance.
May 28 10:00:55.400327 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13481913e22d4bf1a94e1a9a270f5494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3403b533910644d2b254922fb84b1ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:00:55.403283 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Deleting volume: d1dfc5cc-6703-445f-9daa-05afb78f89f0 {{(pid=98321) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 10:00:55.571674 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Found WWN 3300000005fd58f27 for multipath device dm-0 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:00:55.571674 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:00:55.571674 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] <== connect_volume: return (3042ms) {'type': 'block', 'scsi_wwn': '3300000005fd58f27', 'path': '/dev/dm-0', 'multipath_id': '3300000005fd58f27'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:00:55.571674 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005fd58f27', 'path': '/dev/dm-0', 'multipath_id': '3300000005fd58f27'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:00:55.618915 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962455.6185439, b90b1ecd-e640-4f4e-bd02-fb74021db82b => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:00:55.619321 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] VM Started (Lifecycle Event)
May 28 10:00:55.713972 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Took 9.47 seconds to spawn the instance on the hypervisor.
May 28 10:00:55.717720 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:55.808208 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:00:55.884329 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 289e2914-2be4-4f46-92e0-fa623f8db861 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:00:55.885217 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:00:55.888183 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 57d353b6-133e-4354-a4f4-7bcec543d586 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:00:55.888183 np0000001613 nova-compute[98321]: WARNING nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance c9416092-d229-4f59-aaf3-3b0b692e7924 is not being actively managed by this compute host but has allocations referencing this compute host: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. Skipping heal of allocation because we do not know what to do.
May 28 10:00:55.888183 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 6895009a-024f-4919-9d25-a52905eac818 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:00:55.888183 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance f9fd8989-d182-47e4-9409-266a1440bf58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:00:55.888183 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 87f6620a-fa87-4d27-8512-74215ef4fe34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:00:55.888183 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance d2e043b6-afe6-4afb-92d6-7d8b33545f19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:00:55.888183 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance b50eced2-71bf-4448-b2e1-f9657509f34c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:00:55.888183 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance b90b1ecd-e640-4f4e-bd02-fb74021db82b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:00:55.888183 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:00:55.888183 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 3edc00a8-2c60-4c44-acb8-6f4d02114bf0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:00:55.888183 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 10:00:55.888183 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Final resource view: name=np0000001613 phys_ram=24030MB used_ram=2624MB phys_disk=95GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 10:00:52 up 33 min,  2 users,  load average: 9.44, 5.51, 2.58\n', 'num_instances': '11', 'num_vm_active': '7', 'num_task_None': '8', 'num_os_type_None': '11', 'num_proj_a9d04b105229456d9ab53df1886fdb37': '2', 'io_workload': '3', 'num_proj_cb3a501b4f4041ef875ef4d2b4167044': '1', 'num_task_deleting': '1', 'num_proj_3403b533910644d2b254922fb84b1ac0': '3', 'num_proj_9a85ba31f98b45b6974118c6560bbc53': '1', 'num_proj_f5fc8bc5d1984c1c839a3ef7e30b9d36': '2', 'num_vm_rescued': '1', 'num_vm_building': '3', 'num_task_spawning': '2', 'num_proj_11e1727c7fbc44459c6972d182fc25b1': '1', 'num_proj_2b4cc0430ca14757a829b60eb7e0081e': '1'} {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 10:00:55.967795 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:56.087800 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:00:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1963844026',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serveractionsv293testjson-server-1963844026',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAMk9iSLwMbw4Ei6MHI0esC/55Rcy6sQ2tiWuKsyMq8m3KvVeicKJFpNeMJUkrZC2YauMY8UtCiYY/mGIoDtQfJzjOysD9ZOhrfUaZ1uCfXpLOQ02ek21gk2Qq+Gwmp7g==',key_name='tempest-keypair-1857006641',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b4cc0430ca14757a829b60eb7e0081e',ramdisk_id='',reservation_id='r-i2a86n6f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1376389954',owner_user_name='tempest-ServerActionsV293TestJSON-1376389954-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:00:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='321e041ada2b405e821acd703457ddcb',uuid=9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b45721cf-794a-4cef-9660-816123b5b144", "address": "fa:16:3e:15:41:54", "network": {"id": "a546cd76-74b1-4628-b9bf-c80f6b8f1bec", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1194909584-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2b4cc0430ca14757a829b60eb7e0081e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45721cf-79", "ovs_interfaceid": "b45721cf-794a-4cef-9660-816123b5b144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:00:56.088044 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Converting VIF {"id": "b45721cf-794a-4cef-9660-816123b5b144", "address": "fa:16:3e:15:41:54", "network": {"id": "a546cd76-74b1-4628-b9bf-c80f6b8f1bec", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1194909584-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2b4cc0430ca14757a829b60eb7e0081e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45721cf-79", "ovs_interfaceid": "b45721cf-794a-4cef-9660-816123b5b144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:00:56.088807 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:41:54,bridge_name='br-int',has_traffic_filtering=True,id=b45721cf-794a-4cef-9660-816123b5b144,network=Network(a546cd76-74b1-4628-b9bf-c80f6b8f1bec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb45721cf-79') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:00:56.094521 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:00:56.126474 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:56.129551 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:00:56.162374 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Successfully created port: dc94f5df-ac70-45ed-b3e3-795fc10af261 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:00:56.233728 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Took 15.48 seconds to build instance.
May 28 10:00:56.314447 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:00:56.604198 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] End _get_guest_xml xml=<domain type="qemu">
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:   <uuid>9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590</uuid>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:   <name>instance-00000017</name>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1963844026</nova:name>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:00:52</nova:creationTime>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:       <nova:image uuid="">
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:         <nova:user uuid="321e041ada2b405e821acd703457ddcb">tempest-ServerActionsV293TestJSON-1376389954-project-member</nova:user>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:         <nova:project uuid="2b4cc0430ca14757a829b60eb7e0081e">tempest-ServerActionsV293TestJSON-1376389954</nova:project>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:       <nova:root type="volume" uuid=""/>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:         <nova:port uuid="b45721cf-794a-4cef-9660-816123b5b144">
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:     <system>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:       <entry name="serial">9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590</entry>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:       <entry name="uuid">9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590</entry>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:     </system>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:   <os>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:   </os>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:   <features>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:   </features>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:   <devices>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590/disk.config"/>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:     </disk>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:       <alias name="ua-83485657-e133-49aa-baed-d67cb2fd1720"/>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-0"/>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:       <serial>83485657-e133-49aa-baed-d67cb2fd1720</serial>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:     </disk>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:15:41:54"/>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:       <target dev="tapb45721cf-79"/>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:     </interface>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590/console.log" append="off"/>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:     </serial>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:     <video>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:     </video>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:     </rng>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:   </devices>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]: </domain>
May 28 10:00:56.604198 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:00:56.604198 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Preparing to wait for external event network-vif-plugged-b45721cf-794a-4cef-9660-816123b5b144 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:00:56.604198 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Acquiring lock "9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:56.604198 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lock "9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:56.604198 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lock "9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:56.607630 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:00:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1963844026',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serveractionsv293testjson-server-1963844026',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAMk9iSLwMbw4Ei6MHI0esC/55Rcy6sQ2tiWuKsyMq8m3KvVeicKJFpNeMJUkrZC2YauMY8UtCiYY/mGIoDtQfJzjOysD9ZOhrfUaZ1uCfXpLOQ02ek21gk2Qq+Gwmp7g==',key_name='tempest-keypair-1857006641',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b4cc0430ca14757a829b60eb7e0081e',ramdisk_id='',reservation_id='r-i2a86n6f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1376389954',owner_user_name='tempest-ServerActionsV293TestJSON-1376389954-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:00:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='321e041ada2b405e821acd703457ddcb',uuid=9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b45721cf-794a-4cef-9660-816123b5b144", "address": "fa:16:3e:15:41:54", "network": {"id": "a546cd76-74b1-4628-b9bf-c80f6b8f1bec", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1194909584-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2b4cc0430ca14757a829b60eb7e0081e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45721cf-79", "ovs_interfaceid": "b45721cf-794a-4cef-9660-816123b5b144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:00:56.607630 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Converting VIF {"id": "b45721cf-794a-4cef-9660-816123b5b144", "address": "fa:16:3e:15:41:54", "network": {"id": "a546cd76-74b1-4628-b9bf-c80f6b8f1bec", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1194909584-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2b4cc0430ca14757a829b60eb7e0081e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45721cf-79", "ovs_interfaceid": "b45721cf-794a-4cef-9660-816123b5b144", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:00:56.607630 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:41:54,bridge_name='br-int',has_traffic_filtering=True,id=b45721cf-794a-4cef-9660-816123b5b144,network=Network(a546cd76-74b1-4628-b9bf-c80f6b8f1bec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb45721cf-79') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:00:56.607630 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:41:54,bridge_name='br-int',has_traffic_filtering=True,id=b45721cf-794a-4cef-9660-816123b5b144,network=Network(a546cd76-74b1-4628-b9bf-c80f6b8f1bec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb45721cf-79') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:00:56.614303 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:56.614364 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:56.614572 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:00:56.617290 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:56.617290 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1995c9ab-9422-5186-818f-278b0725e488', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:56.618604 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:56.621241 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:00:56.623855 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:56.623855 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb45721cf-79, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:56.623855 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb45721cf-79, col_values=(('qos', UUID('a3350a3d-3d19-4563-89ad-17fc65ddab49')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:56.623855 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb45721cf-79, col_values=(('external_ids', {'iface-id': 'b45721cf-794a-4cef-9660-816123b5b144', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:41:54', 'vm-uuid': '9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:00:56.629217 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:56.630676 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:00:56.635395 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962456.6345, b90b1ecd-e640-4f4e-bd02-fb74021db82b => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:00:56.635395 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] VM Paused (Lifecycle Event)
May 28 10:00:56.636914 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:56.638593 np0000001613 nova-compute[98321]: INFO os_vif [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:41:54,bridge_name='br-int',has_traffic_filtering=True,id=b45721cf-794a-4cef-9660-816123b5b144,network=Network(a546cd76-74b1-4628-b9bf-c80f6b8f1bec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb45721cf-79')
May 28 10:00:56.724018 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:00:56.724381 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:00:56.735464 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.990s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:56.927563 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Successfully updated port: dc94f5df-ac70-45ed-b3e3-795fc10af261 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:00:56.988545 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8f789fcf-1f25-473d-8802-b7e1390f104e req-297c9b40-f7dc-48de-9008-19a8fe12fe58 service nova] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Received event network-changed-dc94f5df-ac70-45ed-b3e3-795fc10af261 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:56.988745 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8f789fcf-1f25-473d-8802-b7e1390f104e req-297c9b40-f7dc-48de-9008-19a8fe12fe58 service nova] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Refreshing instance network info cache due to event network-changed-dc94f5df-ac70-45ed-b3e3-795fc10af261. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:00:56.988792 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8f789fcf-1f25-473d-8802-b7e1390f104e req-297c9b40-f7dc-48de-9008-19a8fe12fe58 service nova] Acquiring lock "refresh_cache-3edc00a8-2c60-4c44-acb8-6f4d02114bf0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:00:56.988956 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8f789fcf-1f25-473d-8802-b7e1390f104e req-297c9b40-f7dc-48de-9008-19a8fe12fe58 service nova] Acquired lock "refresh_cache-3edc00a8-2c60-4c44-acb8-6f4d02114bf0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:00:56.989154 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-8f789fcf-1f25-473d-8802-b7e1390f104e req-297c9b40-f7dc-48de-9008-19a8fe12fe58 service nova] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Refreshing network info cache for port dc94f5df-ac70-45ed-b3e3-795fc10af261 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:00:57.029929 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Rescuing
May 28 10:00:57.030187 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "refresh_cache-87f6620a-fa87-4d27-8512-74215ef4fe34" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:00:57.030278 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquired lock "refresh_cache-87f6620a-fa87-4d27-8512-74215ef4fe34" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:00:57.030344 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:00:57.143655 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:57.147523 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962457.1456914, b90b1ecd-e640-4f4e-bd02-fb74021db82b => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:00:57.147523 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] VM Resumed (Lifecycle Event)
May 28 10:00:57.228212 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:00:57.334532 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:00:57.335614 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:00:57.335897 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Creating image(s)
May 28 10:00:57.336946 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "/opt/stack/data/nova/instances/3edc00a8-2c60-4c44-acb8-6f4d02114bf0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:57.337130 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "/opt/stack/data/nova/instances/3edc00a8-2c60-4c44-acb8-6f4d02114bf0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:57.337753 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "/opt/stack/data/nova/instances/3edc00a8-2c60-4c44-acb8-6f4d02114bf0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:57.342122 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:00:57.347214 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:00:57.348632 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:57.436926 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "refresh_cache-3edc00a8-2c60-4c44-acb8-6f4d02114bf0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:00:57.462008 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.112s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:57.462008 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:57.463898 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:57.464818 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:00:57.469490 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:00:57.469978 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:57.496816 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-8f789fcf-1f25-473d-8802-b7e1390f104e req-297c9b40-f7dc-48de-9008-19a8fe12fe58 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:57.535244 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:57.535547 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:57.598910 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-8f789fcf-1f25-473d-8802-b7e1390f104e req-297c9b40-f7dc-48de-9008-19a8fe12fe58 service nova] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:00:57.612849 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0008358439999938128 future=<Future at 0x73c1f41c30b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:57.614078 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Emitting event <LifecycleEvent: 1779962442.6118746, ceb9e572-ba71-4a8c-b415-44c9e7ebec51 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:00:57.614370 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:57.614818 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.144s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:57.615059 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] VM Stopped (Lifecycle Event)
May 28 10:00:57.617288 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=3.1429858030001014 future=<Future at 0x73c1f41b5c40 state=cancelled>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:57.617496 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=3.1427524079999785 future=<Future at 0x73c1f41b5c40 state=cancelled>) was cancelled while queued, skipping {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:57.617606 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:57.617781 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=7.998621383999989 future=<Future at 0x73c1f4239e20 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:57.617869 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=7.99852481400012 future=<Future at 0x73c1f4239e20 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:00:57.623495 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/3edc00a8-2c60-4c44-acb8-6f4d02114bf0/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:57.662015 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:57.673283 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:00:57.685254 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/3edc00a8-2c60-4c44-acb8-6f4d02114bf0/disk 1073741824" returned: 0 in 0.068s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:57.686224 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:57.686613 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:57.743983 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Compute_service record updated for np0000001613:np0000001613 {{(pid=98321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 10:00:57.747120 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.967s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:57.749475 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f3b34456-e103-456a-9721-00d0177ce8d8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 3.584s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:57.750103 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:00:57.753289 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f3b34456-e103-456a-9721-00d0177ce8d8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:57.755106 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.787s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:57.791106 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.104s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:57.794268 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3edc00a8-2c60-4c44-acb8-6f4d02114bf0/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:00:57.794268 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3edc00a8-2c60-4c44-acb8-6f4d02114bf0/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:57.911991 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-f3b34456-e103-456a-9721-00d0177ce8d8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Deleted allocations for instance c9416092-d229-4f59-aaf3-3b0b692e7924
May 28 10:00:58.135121 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-9f250db8-c468-4241-a94e-f5871429cd02 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: ceb9e572-ba71-4a8c-b415-44c9e7ebec51] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:00:58.158897 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-8f789fcf-1f25-473d-8802-b7e1390f104e req-297c9b40-f7dc-48de-9008-19a8fe12fe58 service nova] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:00:58.171313 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3edc00a8-2c60-4c44-acb8-6f4d02114bf0/disk --force-share --output=json" returned: 0 in 0.379s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:58.172953 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Cannot resize image /opt/stack/data/nova/instances/3edc00a8-2c60-4c44-acb8-6f4d02114bf0/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:00:58.172953 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:00:58.172953 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Ensure instance console log exists: /opt/stack/data/nova/instances/3edc00a8-2c60-4c44-acb8-6f4d02114bf0/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:00:58.173275 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:58.174643 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:58.174643 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:58.180375 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:00:58.181057 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:00:58.182018 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] No VIF found with MAC fa:16:3e:15:41:54, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:00:58.183498 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Using config drive
May 28 10:00:58.359992 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:58.629152 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Updating instance_info_cache with network_info: [{"id": "6ac6cb03-1362-4f61-8f2d-3ae856d28f49", "address": "fa:16:3e:86:60:4b", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac6cb03-13", "ovs_interfaceid": "6ac6cb03-1362-4f61-8f2d-3ae856d28f49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:00:58.680836 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8f789fcf-1f25-473d-8802-b7e1390f104e req-297c9b40-f7dc-48de-9008-19a8fe12fe58 service nova] Releasing lock "refresh_cache-3edc00a8-2c60-4c44-acb8-6f4d02114bf0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:00:58.681379 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquired lock "refresh_cache-3edc00a8-2c60-4c44-acb8-6f4d02114bf0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:00:58.681811 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:00:58.698199 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:58.742312 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:00:58.742856 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:00:58.742856 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:00:58.743103 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 10:00:58.744059 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.05 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:00:58.951538 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Creating config drive at /opt/stack/data/nova/instances/9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590/disk.config
May 28 10:00:58.962206 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfvewhmbq {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:00:59.032130 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfvewhmbq" returned: 0 in 0.070s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:00:59.052204 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:00:59.053099 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:00:59.094249 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-fdee1b3a-c2fe-44da-a3e6-3d43ae58ae2b req-d1b33477-9519-44e8-a11f-a8721cb67bcc service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Received event network-changed-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:59.094400 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-fdee1b3a-c2fe-44da-a3e6-3d43ae58ae2b req-d1b33477-9519-44e8-a11f-a8721cb67bcc service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Refreshing instance network info cache due to event network-changed-11a01cd4-8a62-4e25-b303-ac907a1aa4c3. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:00:59.094594 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-fdee1b3a-c2fe-44da-a3e6-3d43ae58ae2b req-d1b33477-9519-44e8-a11f-a8721cb67bcc service nova] Acquiring lock "refresh_cache-b90b1ecd-e640-4f4e-bd02-fb74021db82b" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:00:59.094740 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-fdee1b3a-c2fe-44da-a3e6-3d43ae58ae2b req-d1b33477-9519-44e8-a11f-a8721cb67bcc service nova] Acquired lock "refresh_cache-b90b1ecd-e640-4f4e-bd02-fb74021db82b" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:00:59.094897 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-fdee1b3a-c2fe-44da-a3e6-3d43ae58ae2b req-d1b33477-9519-44e8-a11f-a8721cb67bcc service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Refreshing network info cache for port 11a01cd4-8a62-4e25-b303-ac907a1aa4c3 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:00:59.131606 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Releasing lock "refresh_cache-87f6620a-fa87-4d27-8512-74215ef4fe34" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:00:59.167004 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f3b34456-e103-456a-9721-00d0177ce8d8 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "c9416092-d229-4f59-aaf3-3b0b692e7924" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.443s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:59.262924 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:00:59.297199 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:59.491446 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:59.556809 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:00:59.577220 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:59.602740 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-fdee1b3a-c2fe-44da-a3e6-3d43ae58ae2b req-d1b33477-9519-44e8-a11f-a8721cb67bcc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:00:59.620891 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:59.630143 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:59.760537 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:00:59.801258 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Updating instance_info_cache with network_info: [{"id": "dc94f5df-ac70-45ed-b3e3-795fc10af261", "address": "fa:16:3e:3c:b7:e1", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc94f5df-ac", "ovs_interfaceid": "dc94f5df-ac70-45ed-b3e3-795fc10af261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:00:59.917808 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-52382294-c94a-4c5f-85e9-45f5f55824ba req-72d71ad1-483d-4927-bb49-443bfb38e05b service nova] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Received event network-vif-plugged-b45721cf-794a-4cef-9660-816123b5b144 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:00:59.918090 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-52382294-c94a-4c5f-85e9-45f5f55824ba req-72d71ad1-483d-4927-bb49-443bfb38e05b service nova] Acquiring lock "9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:00:59.918342 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-52382294-c94a-4c5f-85e9-45f5f55824ba req-72d71ad1-483d-4927-bb49-443bfb38e05b service nova] Lock "9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:00:59.918535 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-52382294-c94a-4c5f-85e9-45f5f55824ba req-72d71ad1-483d-4927-bb49-443bfb38e05b service nova] Lock "9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:00:59.918731 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-52382294-c94a-4c5f-85e9-45f5f55824ba req-72d71ad1-483d-4927-bb49-443bfb38e05b service nova] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Processing event network-vif-plugged-b45721cf-794a-4cef-9660-816123b5b144 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:01:00.065507 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.310s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:00.089811 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:00.097422 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:00.127789 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:00.183304 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Deleted allocations for instance 57d353b6-133e-4354-a4f4-7bcec543d586
May 28 10:01:00.277850 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:00.302996 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-fdee1b3a-c2fe-44da-a3e6-3d43ae58ae2b req-d1b33477-9519-44e8-a11f-a8721cb67bcc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:00.309460 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Releasing lock "refresh_cache-3edc00a8-2c60-4c44-acb8-6f4d02114bf0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:01:00.309460 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Instance network_info: |[{"id": "dc94f5df-ac70-45ed-b3e3-795fc10af261", "address": "fa:16:3e:3c:b7:e1", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc94f5df-ac", "ovs_interfaceid": "dc94f5df-ac70-45ed-b3e3-795fc10af261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:01:00.314920 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Start _get_guest_xml network_info=[{"id": "dc94f5df-ac70-45ed-b3e3-795fc10af261", "address": "fa:16:3e:3c:b7:e1", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc94f5df-ac", "ovs_interfaceid": "dc94f5df-ac70-45ed-b3e3-795fc10af261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:01:00.327664 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:01:00.329355 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='3edc00a8-2c60-4c44-acb8-6f4d02114bf0'), owner=OwnerMeta(userid='13481913e22d4bf1a94e1a9a270f5494', username='tempest-AttachVolumeMultiAttachTest-1052626787-project-member', projectid='3403b533910644d2b254922fb84b1ac0', projectname='tempest-AttachVolumeMultiAttachTest-1052626787'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "dc94f5df-ac70-45ed-b3e3-795fc10af261", "address": "fa:16:3e:3c:b7:e1", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc94f5df-ac", "ovs_interfaceid": "dc94f5df-ac70-45ed-b3e3-795fc10af261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962460.3289046) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:01:00.331508 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:01:00.331972 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:01:00.336418 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:01:00.336733 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:01:00.338376 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:01:00.338776 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:01:00.338957 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:01:00.339098 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:01:00.339571 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:01:00.341181 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:01:00.341181 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:01:00.341181 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:01:00.341181 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:01:00.341181 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:01:00.341181 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:01:00.341181 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:01:00.376975 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:00:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='multiattach-server-1',id=24,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrmebBJn1C7uIkB9JjrF4yuEuto77kf4SaBedfdmOdQwZzJyqrVQd0Wq/SA1eDV6FpWwBB4BKjLBcFgkvBrXSx4LeKHMUic/tPGA5px/F625klLXypbV+9p49FvQ4XImQ==',key_name='tempest-keypair-2082049331',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3403b533910644d2b254922fb84b1ac0',ramdisk_id='',reservation_id='r-0bufnik2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1052626787',owner_user_name='tempest-AttachVolumeMultiAttachTest-1052626787-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:00:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13481913e22d4bf1a94e1a9a270f5494',uuid=3edc00a8-2c60-4c44-acb8-6f4d02114bf0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc94f5df-ac70-45ed-b3e3-795fc10af261", "address": "fa:16:3e:3c:b7:e1", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc94f5df-ac", "ovs_interfaceid": "dc94f5df-ac70-45ed-b3e3-795fc10af261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:01:00.378891 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converting VIF {"id": "dc94f5df-ac70-45ed-b3e3-795fc10af261", "address": "fa:16:3e:3c:b7:e1", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc94f5df-ac", "ovs_interfaceid": "dc94f5df-ac70-45ed-b3e3-795fc10af261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:01:00.381751 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:b7:e1,bridge_name='br-int',has_traffic_filtering=True,id=dc94f5df-ac70-45ed-b3e3-795fc10af261,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc94f5df-ac') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:01:00.382551 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lazy-loading 'pci_devices' on Instance uuid 3edc00a8-2c60-4c44-acb8-6f4d02114bf0 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:01:00.541190 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-fdee1b3a-c2fe-44da-a3e6-3d43ae58ae2b req-d1b33477-9519-44e8-a11f-a8721cb67bcc service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Updated VIF entry in instance network info cache for port 11a01cd4-8a62-4e25-b303-ac907a1aa4c3. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:01:00.542580 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-fdee1b3a-c2fe-44da-a3e6-3d43ae58ae2b req-d1b33477-9519-44e8-a11f-a8721cb67bcc service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Updating instance_info_cache with network_info: [{"id": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "address": "fa:16:3e:b1:88:d2", "network": {"id": "9d46c174-21e3-464e-83c9-e8db18f486a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-151012625-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e1727c7fbc44459c6972d182fc25b1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a01cd4-8a", "ovs_interfaceid": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:01:00.744148 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:01:00.744729 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962460.744257, 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:01:00.744729 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] VM Started (Lifecycle Event)
May 28 10:01:00.748752 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:01:00.753640 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Instance spawned successfully.
May 28 10:01:00.754575 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:01:00.845930 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:00.848593 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:00.874651 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:00.887825 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] End _get_guest_xml xml=<domain type="qemu">
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:   <uuid>3edc00a8-2c60-4c44-acb8-6f4d02114bf0</uuid>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:   <name>instance-00000018</name>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:       <nova:name>multiattach-server-1</nova:name>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:01:00</nova:creationTime>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:         <nova:user uuid="13481913e22d4bf1a94e1a9a270f5494">tempest-AttachVolumeMultiAttachTest-1052626787-project-member</nova:user>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:         <nova:project uuid="3403b533910644d2b254922fb84b1ac0">tempest-AttachVolumeMultiAttachTest-1052626787</nova:project>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:         <nova:port uuid="dc94f5df-ac70-45ed-b3e3-795fc10af261">
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:     <system>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:       <entry name="serial">3edc00a8-2c60-4c44-acb8-6f4d02114bf0</entry>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:       <entry name="uuid">3edc00a8-2c60-4c44-acb8-6f4d02114bf0</entry>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:     </system>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:   <os>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:   </os>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:   <features>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:   </features>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:   <devices>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/3edc00a8-2c60-4c44-acb8-6f4d02114bf0/disk"/>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:     </disk>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/3edc00a8-2c60-4c44-acb8-6f4d02114bf0/disk.config"/>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:     </disk>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:3c:b7:e1"/>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:       <target dev="tapdc94f5df-ac"/>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:     </interface>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/3edc00a8-2c60-4c44-acb8-6f4d02114bf0/console.log" append="off"/>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:     </serial>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:     <video>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:     </video>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:     </rng>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:   </devices>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]: </domain>
May 28 10:01:00.887825 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:01:00.890513 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Preparing to wait for external event network-vif-plugged-dc94f5df-ac70-45ed-b3e3-795fc10af261 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:01:00.890513 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "3edc00a8-2c60-4c44-acb8-6f4d02114bf0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:00.890790 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "3edc00a8-2c60-4c44-acb8-6f4d02114bf0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:00.891015 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "3edc00a8-2c60-4c44-acb8-6f4d02114bf0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:00.891798 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:00:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='multiattach-server-1',id=24,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrmebBJn1C7uIkB9JjrF4yuEuto77kf4SaBedfdmOdQwZzJyqrVQd0Wq/SA1eDV6FpWwBB4BKjLBcFgkvBrXSx4LeKHMUic/tPGA5px/F625klLXypbV+9p49FvQ4XImQ==',key_name='tempest-keypair-2082049331',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3403b533910644d2b254922fb84b1ac0',ramdisk_id='',reservation_id='r-0bufnik2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1052626787',owner_user_name='tempest-AttachVolumeMultiAttachTest-1052626787-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:00:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13481913e22d4bf1a94e1a9a270f5494',uuid=3edc00a8-2c60-4c44-acb8-6f4d02114bf0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc94f5df-ac70-45ed-b3e3-795fc10af261", "address": "fa:16:3e:3c:b7:e1", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc94f5df-ac", "ovs_interfaceid": "dc94f5df-ac70-45ed-b3e3-795fc10af261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:01:00.892034 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converting VIF {"id": "dc94f5df-ac70-45ed-b3e3-795fc10af261", "address": "fa:16:3e:3c:b7:e1", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc94f5df-ac", "ovs_interfaceid": "dc94f5df-ac70-45ed-b3e3-795fc10af261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:01:00.892561 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:b7:e1,bridge_name='br-int',has_traffic_filtering=True,id=dc94f5df-ac70-45ed-b3e3-795fc10af261,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc94f5df-ac') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:01:00.892834 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:b7:e1,bridge_name='br-int',has_traffic_filtering=True,id=dc94f5df-ac70-45ed-b3e3-795fc10af261,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc94f5df-ac') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:01:00.893676 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:00.894002 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:00.894294 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:01:00.895206 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:00.895341 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '33eb2b87-0803-5b02-97bd-481b10c7c54b', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:00.897254 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:01:00.902768 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:00.906804 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:00.906876 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc94f5df-ac, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:00.907504 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdc94f5df-ac, col_values=(('qos', UUID('ee4b26d0-ccf9-489d-846a-b053bb89a550')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:00.908527 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdc94f5df-ac, col_values=(('external_ids', {'iface-id': 'dc94f5df-ac70-45ed-b3e3-795fc10af261', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:b7:e1', 'vm-uuid': '3edc00a8-2c60-4c44-acb8-6f4d02114bf0'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:00.910772 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:00.912328 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:01:00.929055 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:00.930515 np0000001613 nova-compute[98321]: INFO os_vif [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:b7:e1,bridge_name='br-int',has_traffic_filtering=True,id=dc94f5df-ac70-45ed-b3e3-795fc10af261,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc94f5df-ac')
May 28 10:01:01.045239 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-fdee1b3a-c2fe-44da-a3e6-3d43ae58ae2b req-d1b33477-9519-44e8-a11f-a8721cb67bcc service nova] Releasing lock "refresh_cache-b90b1ecd-e640-4f4e-bd02-fb74021db82b" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:01:01.066091 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:01.087614 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:01.182767 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Instance destroyed successfully.
May 28 10:01:01.183779 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lazy-loading 'numa_topology' on Instance uuid 87f6620a-fa87-4d27-8512-74215ef4fe34 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:01:01.201740 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7e57d6e1-c2d6-49a7-8412-325699bd1e23 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "57d353b6-133e-4354-a4f4-7bcec543d586" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.887s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:01.213102 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-27074e57-1759-4dc6-8f78-08ad7f5e6b1e req-4793c315-3952-425d-896e-af793126907e service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Received event network-vif-unplugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:01.213102 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-27074e57-1759-4dc6-8f78-08ad7f5e6b1e req-4793c315-3952-425d-896e-af793126907e service nova] Acquiring lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:01.213102 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-27074e57-1759-4dc6-8f78-08ad7f5e6b1e req-4793c315-3952-425d-896e-af793126907e service nova] Lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:01.223926 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-27074e57-1759-4dc6-8f78-08ad7f5e6b1e req-4793c315-3952-425d-896e-af793126907e service nova] Lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:01.232714 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-27074e57-1759-4dc6-8f78-08ad7f5e6b1e req-4793c315-3952-425d-896e-af793126907e service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] No waiting events found dispatching network-vif-unplugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:01:01.232714 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-27074e57-1759-4dc6-8f78-08ad7f5e6b1e req-4793c315-3952-425d-896e-af793126907e service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Received unexpected event network-vif-unplugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 for instance with vm_state active and task_state rescuing.
May 28 10:01:01.251439 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:01:01.258225 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:01:01.267329 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:01:01.267787 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:01:01.268321 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:01:01.268778 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:01:01.270247 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:01:01.270247 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:01:01.693297 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Attempting rescue
May 28 10:01:01.693750 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98321) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 28 10:01:01.706773 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Instance directory exists: not creating {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 10:01:01.706931 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Creating image(s)
May 28 10:01:01.707793 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "/opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:01.707929 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "/opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:01.710996 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "/opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:01.710996 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lazy-loading 'trusted_certs' on Instance uuid 87f6620a-fa87-4d27-8512-74215ef4fe34 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:01:01.763193 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:01:01.763692 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962461.7633016, 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:01:01.764047 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] VM Paused (Lifecycle Event)
May 28 10:01:01.779548 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Took 10.84 seconds to spawn the instance on the hypervisor.
May 28 10:01:01.779976 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:01:02.009718 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-14007151-69f5-4589-a3e5-95557fa133eb req-1d7311d3-bf28-4643-b468-968b078ffd9c service nova] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Received event network-vif-plugged-b45721cf-794a-4cef-9660-816123b5b144 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:02.010002 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-14007151-69f5-4589-a3e5-95557fa133eb req-1d7311d3-bf28-4643-b468-968b078ffd9c service nova] Acquiring lock "9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:02.010378 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-14007151-69f5-4589-a3e5-95557fa133eb req-1d7311d3-bf28-4643-b468-968b078ffd9c service nova] Lock "9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:02.010594 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-14007151-69f5-4589-a3e5-95557fa133eb req-1d7311d3-bf28-4643-b468-968b078ffd9c service nova] Lock "9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:02.011411 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-14007151-69f5-4589-a3e5-95557fa133eb req-1d7311d3-bf28-4643-b468-968b078ffd9c service nova] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] No waiting events found dispatching network-vif-plugged-b45721cf-794a-4cef-9660-816123b5b144 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:01:02.011509 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-14007151-69f5-4589-a3e5-95557fa133eb req-1d7311d3-bf28-4643-b468-968b078ffd9c service nova] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Received unexpected event network-vif-plugged-b45721cf-794a-4cef-9660-816123b5b144 for instance with vm_state active and task_state None.
May 28 10:01:02.215712 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Object Instance<87f6620a-fa87-4d27-8512-74215ef4fe34> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:01:02.216437 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:01:02.223361 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:01:02.224681 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:02.225110 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:02.225490 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:01:02.229912 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:01:02.230379 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:02.272270 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:01:02.277599 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962462.276741, 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:01:02.277599 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] VM Resumed (Lifecycle Event)
May 28 10:01:02.304415 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Took 20.35 seconds to build instance.
May 28 10:01:02.345424 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.115s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:02.346380 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34/disk.rescue {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:02.401968 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34/disk.rescue" returned: 0 in 0.055s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:02.403906 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.178s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:02.403906 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lazy-loading 'migration_context' on Instance uuid 87f6620a-fa87-4d27-8512-74215ef4fe34 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:01:02.468188 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:01:02.468546 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:01:02.468800 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No VIF found with MAC fa:16:3e:3c:b7:e1, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:01:02.469473 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Using config drive
May 28 10:01:02.785215 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:01:02.786705 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:01:02.805958 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ddedc839-82bd-49e7-8c79-028a06617d85 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lock "9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.856s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:02.846014 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8062489d-d3e5-4e9a-a381-5225ecb57aa7 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "289e2914-2be4-4f46-92e0-fa623f8db861" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:02.846014 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8062489d-d3e5-4e9a-a381-5225ecb57aa7 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "289e2914-2be4-4f46-92e0-fa623f8db861" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:02.846014 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8062489d-d3e5-4e9a-a381-5225ecb57aa7 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "289e2914-2be4-4f46-92e0-fa623f8db861-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:02.846014 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8062489d-d3e5-4e9a-a381-5225ecb57aa7 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "289e2914-2be4-4f46-92e0-fa623f8db861-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:02.846014 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8062489d-d3e5-4e9a-a381-5225ecb57aa7 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "289e2914-2be4-4f46-92e0-fa623f8db861-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:02.848252 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-8062489d-d3e5-4e9a-a381-5225ecb57aa7 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Terminating instance
May 28 10:01:02.906938 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Object Instance<87f6620a-fa87-4d27-8512-74215ef4fe34> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:01:02.907308 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:01:02.907960 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Start _get_guest_xml network_info=[{"id": "6ac6cb03-1362-4f61-8f2d-3ae856d28f49", "address": "fa:16:3e:86:60:4b", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "vif_mac": "fa:16:3e:86:60:4b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac6cb03-13", "ovs_interfaceid": "6ac6cb03-1362-4f61-8f2d-3ae856d28f49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:01:02.908176 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lazy-loading 'resources' on Instance uuid 87f6620a-fa87-4d27-8512-74215ef4fe34 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:01:02.976959 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:03.134677 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Creating config drive at /opt/stack/data/nova/instances/3edc00a8-2c60-4c44-acb8-6f4d02114bf0/disk.config
May 28 10:01:03.140606 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3edc00a8-2c60-4c44-acb8-6f4d02114bf0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpypw9cea0 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:03.211986 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3edc00a8-2c60-4c44-acb8-6f4d02114bf0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpypw9cea0" returned: 0 in 0.071s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:03.290387 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999594415000047 future=<Future at 0x73c1f41b8e30 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:01:03.345321 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-1aac0acf-f61d-4f82-a8f7-f7a2ccd61d42 req-2353f400-9b9c-4d00-9811-7f4bd80e6148 service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Received event network-vif-unplugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:03.345603 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1aac0acf-f61d-4f82-a8f7-f7a2ccd61d42 req-2353f400-9b9c-4d00-9811-7f4bd80e6148 service nova] Acquiring lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:03.345829 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1aac0acf-f61d-4f82-a8f7-f7a2ccd61d42 req-2353f400-9b9c-4d00-9811-7f4bd80e6148 service nova] Lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:03.346057 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1aac0acf-f61d-4f82-a8f7-f7a2ccd61d42 req-2353f400-9b9c-4d00-9811-7f4bd80e6148 service nova] Lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:03.346202 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-1aac0acf-f61d-4f82-a8f7-f7a2ccd61d42 req-2353f400-9b9c-4d00-9811-7f4bd80e6148 service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] No waiting events found dispatching network-vif-unplugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:01:03.346350 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-1aac0acf-f61d-4f82-a8f7-f7a2ccd61d42 req-2353f400-9b9c-4d00-9811-7f4bd80e6148 service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Received unexpected event network-vif-unplugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 for instance with vm_state active and task_state rescuing.
May 28 10:01:03.351994 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8062489d-d3e5-4e9a-a381-5225ecb57aa7 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:01:03.397239 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:03.404239 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:03.412122 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Object Instance<87f6620a-fa87-4d27-8512-74215ef4fe34> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:01:03.422335 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:01:03.423643 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1834037810', uuid='87f6620a-fa87-4d27-8512-74215ef4fe34'), owner=OwnerMeta(userid='45c67299cd204090b9ebf7e0eb873e37', username='tempest-ServerRescueNegativeTestJSON-1286552851-project-member', projectid='f5fc8bc5d1984c1c839a3ef7e30b9d36', projectname='tempest-ServerRescueNegativeTestJSON-1286552851'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6ac6cb03-1362-4f61-8f2d-3ae856d28f49", "address": "fa:16:3e:86:60:4b", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "vif_mac": "fa:16:3e:86:60:4b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac6cb03-13", "ovs_interfaceid": "6ac6cb03-1362-4f61-8f2d-3ae856d28f49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962463.4232838) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:01:03.426246 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:03.433654 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:01:03.434154 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:01:03.437748 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:03.439278 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:01:03.439278 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:01:03.442152 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:01:03.442152 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:01:03.442152 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:01:03.442478 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:01:03.442602 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:01:03.442602 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:01:03.442889 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:01:03.443049 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:01:03.443178 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:01:03.443355 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:01:03.443463 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:01:03.443575 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:01:03.443734 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lazy-loading 'vcpu_model' on Instance uuid 87f6620a-fa87-4d27-8512-74215ef4fe34 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:01:03.474056 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:03.480978 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:03.907419 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999709348999886 future=<Future at 0x73c1f41fdd30 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:01:03.921008 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Instance destroyed successfully.
May 28 10:01:03.921944 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-8062489d-d3e5-4e9a-a381-5225ecb57aa7 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lazy-loading 'resources' on Instance uuid 289e2914-2be4-4f46-92e0-fa623f8db861 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:01:03.925451 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:03.946433 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Object Instance<87f6620a-fa87-4d27-8512-74215ef4fe34> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:01:03.975177 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:00:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1834037810',display_name='tempest-ServerRescueNegativeTestJSON-server-1834037810',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serverrescuenegativetestjson-server-1834037810',id=19,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:00:42Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f5fc8bc5d1984c1c839a3ef7e30b9d36',ramdisk_id='',reservation_id='r-ieli90wk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1286552851',owner_user_name='tempest-ServerRescueNegativeTestJSON-1286552851-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:00:43Z,user_data=None,user_id='45c67299cd204090b9ebf7e0eb873e37',uuid=87f6620a-fa87-4d27-8512-74215ef4fe34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ac6cb03-1362-4f61-8f2d-3ae856d28f49", "address": "fa:16:3e:86:60:4b", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "vif_mac": "fa:16:3e:86:60:4b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac6cb03-13", "ovs_interfaceid": "6ac6cb03-1362-4f61-8f2d-3ae856d28f49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:01:03.975474 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:03.978117 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Converting VIF {"id": "6ac6cb03-1362-4f61-8f2d-3ae856d28f49", "address": "fa:16:3e:86:60:4b", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "vif_mac": "fa:16:3e:86:60:4b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac6cb03-13", "ovs_interfaceid": "6ac6cb03-1362-4f61-8f2d-3ae856d28f49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:01:03.978117 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:60:4b,bridge_name='br-int',has_traffic_filtering=True,id=6ac6cb03-1362-4f61-8f2d-3ae856d28f49,network=Network(729946be-b963-4dfb-ad38-335762a8666c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ac6cb03-13') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:01:03.979082 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lazy-loading 'pci_devices' on Instance uuid 87f6620a-fa87-4d27-8512-74215ef4fe34 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:01:04.096252 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:04.107877 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5b798bcf-7dec-4cbd-b8da-c06bf5c8a832 req-39269c1d-7cac-42df-adfd-6ecebde7c84a service nova] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Received event network-changed-b45721cf-794a-4cef-9660-816123b5b144 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:04.108331 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5b798bcf-7dec-4cbd-b8da-c06bf5c8a832 req-39269c1d-7cac-42df-adfd-6ecebde7c84a service nova] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Refreshing instance network info cache due to event network-changed-b45721cf-794a-4cef-9660-816123b5b144. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:01:04.108331 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5b798bcf-7dec-4cbd-b8da-c06bf5c8a832 req-39269c1d-7cac-42df-adfd-6ecebde7c84a service nova] Acquiring lock "refresh_cache-9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:01:04.108452 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5b798bcf-7dec-4cbd-b8da-c06bf5c8a832 req-39269c1d-7cac-42df-adfd-6ecebde7c84a service nova] Acquired lock "refresh_cache-9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:01:04.109183 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-5b798bcf-7dec-4cbd-b8da-c06bf5c8a832 req-39269c1d-7cac-42df-adfd-6ecebde7c84a service nova] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Refreshing network info cache for port b45721cf-794a-4cef-9660-816123b5b144 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:01:04.126039 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:04.138655 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:04.301218 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:04.404080 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:04.404547 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:04.427818 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-8062489d-d3e5-4e9a-a381-5225ecb57aa7 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:57:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1280721083',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serverbootfromvolumestablerescuetest-server-1280721083',id=1,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T09:57:55Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9d04b105229456d9ab53df1886fdb37',ramdisk_id='',reservation_id='r-3a0ld0bo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-283762505',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T09:58:08Z,user_data=None,user_id='51981c995f2246588f2d58f35be5848a',uuid=289e2914-2be4-4f46-92e0-fa623f8db861,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1aadd54c-ea47-43c1-86e2-da7dc2eb0a49", "address": "fa:16:3e:95:8b:d3", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aadd54c-ea", "ovs_interfaceid": "1aadd54c-ea47-43c1-86e2-da7dc2eb0a49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:01:04.428006 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-8062489d-d3e5-4e9a-a381-5225ecb57aa7 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Converting VIF {"id": "1aadd54c-ea47-43c1-86e2-da7dc2eb0a49", "address": "fa:16:3e:95:8b:d3", "network": {"id": "e5543f88-c716-4e02-82e9-2cb7570bf25e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-93991069-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9d04b105229456d9ab53df1886fdb37", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aadd54c-ea", "ovs_interfaceid": "1aadd54c-ea47-43c1-86e2-da7dc2eb0a49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:01:04.428839 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-8062489d-d3e5-4e9a-a381-5225ecb57aa7 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:8b:d3,bridge_name='br-int',has_traffic_filtering=True,id=1aadd54c-ea47-43c1-86e2-da7dc2eb0a49,network=Network(e5543f88-c716-4e02-82e9-2cb7570bf25e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aadd54c-ea') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:01:04.429243 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-8062489d-d3e5-4e9a-a381-5225ecb57aa7 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:8b:d3,bridge_name='br-int',has_traffic_filtering=True,id=1aadd54c-ea47-43c1-86e2-da7dc2eb0a49,network=Network(e5543f88-c716-4e02-82e9-2cb7570bf25e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aadd54c-ea') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:01:04.432324 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:04.432690 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1aadd54c-ea, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:04.436095 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:01:04.441750 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:04.443581 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:04.444029 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c522fe46-d8cd-4e93-bd66-9a9852741ba8) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:04.445028 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:04.446520 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:01:04.454186 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:04.457906 np0000001613 nova-compute[98321]: INFO os_vif [None req-8062489d-d3e5-4e9a-a381-5225ecb57aa7 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:8b:d3,bridge_name='br-int',has_traffic_filtering=True,id=1aadd54c-ea47-43c1-86e2-da7dc2eb0a49,network=Network(e5543f88-c716-4e02-82e9-2cb7570bf25e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aadd54c-ea')
May 28 10:01:04.457906 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-8062489d-d3e5-4e9a-a381-5225ecb57aa7 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Deleting instance files /opt/stack/data/nova/instances/289e2914-2be4-4f46-92e0-fa623f8db861_del
May 28 10:01:04.458924 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-8062489d-d3e5-4e9a-a381-5225ecb57aa7 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Deletion of /opt/stack/data/nova/instances/289e2914-2be4-4f46-92e0-fa623f8db861_del complete
May 28 10:01:04.486442 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Object Instance<87f6620a-fa87-4d27-8512-74215ef4fe34> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:01:04.487134 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] End _get_guest_xml xml=<domain type="qemu">
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:   <uuid>87f6620a-fa87-4d27-8512-74215ef4fe34</uuid>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:   <name>instance-00000013</name>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1834037810</nova:name>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:01:03</nova:creationTime>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:         <nova:user uuid="45c67299cd204090b9ebf7e0eb873e37">tempest-ServerRescueNegativeTestJSON-1286552851-project-member</nova:user>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:         <nova:project uuid="f5fc8bc5d1984c1c839a3ef7e30b9d36">tempest-ServerRescueNegativeTestJSON-1286552851</nova:project>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:         <nova:port uuid="6ac6cb03-1362-4f61-8f2d-3ae856d28f49">
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:     <system>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:       <entry name="serial">87f6620a-fa87-4d27-8512-74215ef4fe34</entry>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:       <entry name="uuid">87f6620a-fa87-4d27-8512-74215ef4fe34</entry>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:     </system>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:   <os>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:   </os>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:   <features>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:   </features>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:   <devices>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34/disk.rescue"/>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:     </disk>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34/disk"/>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:       <target dev="vdb" bus="virtio"/>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:     </disk>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34/disk.config.rescue"/>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:     </disk>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:86:60:4b"/>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:       <target dev="tap6ac6cb03-13"/>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:     </interface>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34/console.log" append="off"/>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:     </serial>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:     <video>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:     </video>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:     </rng>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:   </devices>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]: </domain>
May 28 10:01:04.487134 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:01:04.495894 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Instance destroyed successfully.
May 28 10:01:04.614489 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-5b798bcf-7dec-4cbd-b8da-c06bf5c8a832 req-39269c1d-7cac-42df-adfd-6ecebde7c84a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:04.907254 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:01:04.949071 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962464.9476602, 3edc00a8-2c60-4c44-acb8-6f4d02114bf0 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:01:04.949523 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] VM Started (Lifecycle Event)
May 28 10:01:04.968909 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-8062489d-d3e5-4e9a-a381-5225ecb57aa7 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Took 1.62 seconds to destroy the instance on the hypervisor.
May 28 10:01:04.969573 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-8062489d-d3e5-4e9a-a381-5225ecb57aa7 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:01:04.970536 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:01:04.970705 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:01:04.970989 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:05.040474 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-5b798bcf-7dec-4cbd-b8da-c06bf5c8a832 req-39269c1d-7cac-42df-adfd-6ecebde7c84a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:05.120743 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:05.243250 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-5b798bcf-7dec-4cbd-b8da-c06bf5c8a832 req-39269c1d-7cac-42df-adfd-6ecebde7c84a service nova] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Updated VIF entry in instance network info cache for port b45721cf-794a-4cef-9660-816123b5b144. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:01:05.244767 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-5b798bcf-7dec-4cbd-b8da-c06bf5c8a832 req-39269c1d-7cac-42df-adfd-6ecebde7c84a service nova] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Updating instance_info_cache with network_info: [{"id": "b45721cf-794a-4cef-9660-816123b5b144", "address": "fa:16:3e:15:41:54", "network": {"id": "a546cd76-74b1-4628-b9bf-c80f6b8f1bec", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1194909584-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2b4cc0430ca14757a829b60eb7e0081e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45721cf-79", "ovs_interfaceid": "b45721cf-794a-4cef-9660-816123b5b144", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:01:05.264742 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:05.456681 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:01:05.459425 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962465.4591372, 3edc00a8-2c60-4c44-acb8-6f4d02114bf0 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:01:05.459753 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] VM Paused (Lifecycle Event)
May 28 10:01:05.486326 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:05.486691 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:05.490298 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:01:05.490488 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Claim successful on node np0000001613
May 28 10:01:05.620570 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.004125685999952111 future=<Future at 0x73c1f4239e20 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:01:05.621082 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] Emitting event <LifecycleEvent: 1779962450.616288, c9416092-d229-4f59-aaf3-3b0b692e7924 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:01:05.621308 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:01:05.621556 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] VM Stopped (Lifecycle Event)
May 28 10:01:05.622682 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=0.7111224029999903 future=<Future at 0x73c1f4045640 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:01:05.623047 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=0.7108263120001084 future=<Future at 0x73c1f4045640 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:01:05.748050 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5b798bcf-7dec-4cbd-b8da-c06bf5c8a832 req-39269c1d-7cac-42df-adfd-6ecebde7c84a service nova] Releasing lock "refresh_cache-9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:01:05.938288 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:01:05.963086 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:01:05.965317 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:01:06.031987 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:01:06.034190 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:01:06.034190 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:01:06.034190 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] No VIF found with MAC fa:16:3e:86:60:4b, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:01:06.034190 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Using config drive
May 28 10:01:06.124336 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a2f23faa-ecee-487a-b7e5-386010e8ef28 tempest-VolumesAdminNegativeTest-1478180913 tempest-VolumesAdminNegativeTest-1478180913-project-member] [instance: c9416092-d229-4f59-aaf3-3b0b692e7924] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:01:06.190590 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5f2334eb-b463-4f43-883a-ff52bfcdb07b req-6ee9e279-4491-464f-990d-4e707a7eae51 service nova] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Received event network-vif-deleted-1aadd54c-ea47-43c1-86e2-da7dc2eb0a49 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:06.334200 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.00039266899989343074 future=<Future at 0x73c1f4045640 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:01:06.334298 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:01:06.334405 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=11.955537223999954 future=<Future at 0x73c1f41b8e30 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:01:06.334611 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=11.95545211600006 future=<Future at 0x73c1f41b8e30 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:01:06.334764 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Emitting event <LifecycleEvent: 1779962451.3336587, 57d353b6-133e-4354-a4f4-7bcec543d586 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:01:06.334904 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] VM Stopped (Lifecycle Event)
May 28 10:01:06.444974 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Took 1.47 seconds to deallocate network for instance.
May 28 10:01:06.469774 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:01:06.538750 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lazy-loading 'ec2_ids' on Instance uuid 87f6620a-fa87-4d27-8512-74215ef4fe34 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:01:06.837532 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a9047d7d-c985-4658-bce3-15955ba2e725 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: 57d353b6-133e-4354-a4f4-7bcec543d586] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:01:06.951785 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-45f93a87-0299-4b55-9924-239ee919cd10 req-7d7383e7-a084-42ad-854c-16fe0e2b7eef service nova] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Received event network-vif-plugged-dc94f5df-ac70-45ed-b3e3-795fc10af261 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:06.952255 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-45f93a87-0299-4b55-9924-239ee919cd10 req-7d7383e7-a084-42ad-854c-16fe0e2b7eef service nova] Acquiring lock "3edc00a8-2c60-4c44-acb8-6f4d02114bf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:06.952877 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-45f93a87-0299-4b55-9924-239ee919cd10 req-7d7383e7-a084-42ad-854c-16fe0e2b7eef service nova] Lock "3edc00a8-2c60-4c44-acb8-6f4d02114bf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:06.953037 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-45f93a87-0299-4b55-9924-239ee919cd10 req-7d7383e7-a084-42ad-854c-16fe0e2b7eef service nova] Lock "3edc00a8-2c60-4c44-acb8-6f4d02114bf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:06.953190 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-45f93a87-0299-4b55-9924-239ee919cd10 req-7d7383e7-a084-42ad-854c-16fe0e2b7eef service nova] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Processing event network-vif-plugged-dc94f5df-ac70-45ed-b3e3-795fc10af261 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:01:06.955069 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8062489d-d3e5-4e9a-a381-5225ecb57aa7 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:06.955803 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:01:06.967398 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:01:06.969051 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962466.9674134, 3edc00a8-2c60-4c44-acb8-6f4d02114bf0 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:01:06.970184 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] VM Resumed (Lifecycle Event)
May 28 10:01:06.976471 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Instance spawned successfully.
May 28 10:01:06.976949 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:01:07.044340 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Object Instance<87f6620a-fa87-4d27-8512-74215ef4fe34> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:01:07.044491 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lazy-loading 'keypairs' on Instance uuid 87f6620a-fa87-4d27-8512-74215ef4fe34 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:01:07.229718 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:01:07.229967 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:01:07.474401 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:01:07.477517 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:01:07.493957 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:01:07.494207 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:01:07.494716 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:01:07.494974 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:01:07.495323 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:01:07.495631 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:01:07.549814 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Object Instance<87f6620a-fa87-4d27-8512-74215ef4fe34> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:01:07.557516 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:07.733276 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:01:07.784761 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Creating config drive at /opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34/disk.config.rescue
May 28 10:01:07.789669 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmph9vntrg0 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:07.843902 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmph9vntrg0" returned: 0 in 0.053s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:07.980873 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:01:08.013839 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Took 10.68 seconds to spawn the instance on the hypervisor.
May 28 10:01:08.014960 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:01:08.245243 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.758s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:08.246823 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8062489d-d3e5-4e9a-a381-5225ecb57aa7 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.290s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:08.247048 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:01:08.432499 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:08.482383 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:08.534070 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Took 17.12 seconds to build instance.
May 28 10:01:08.624728 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:08.749016 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:08.751064 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:08.758637 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:01:08.758728 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:01:08.761355 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:08.763844 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:08.815932 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-fabfda9b-1109-431d-88d7-c01596bd3300 req-5187fdb7-c4ed-43b1-bc8b-2bbe6190136a service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Received event network-vif-plugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:08.816411 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-fabfda9b-1109-431d-88d7-c01596bd3300 req-5187fdb7-c4ed-43b1-bc8b-2bbe6190136a service nova] Acquiring lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:08.817066 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-fabfda9b-1109-431d-88d7-c01596bd3300 req-5187fdb7-c4ed-43b1-bc8b-2bbe6190136a service nova] Lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:08.817323 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-fabfda9b-1109-431d-88d7-c01596bd3300 req-5187fdb7-c4ed-43b1-bc8b-2bbe6190136a service nova] Lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:08.817485 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-fabfda9b-1109-431d-88d7-c01596bd3300 req-5187fdb7-c4ed-43b1-bc8b-2bbe6190136a service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] No waiting events found dispatching network-vif-plugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:01:08.818001 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-fabfda9b-1109-431d-88d7-c01596bd3300 req-5187fdb7-c4ed-43b1-bc8b-2bbe6190136a service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Received unexpected event network-vif-plugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 for instance with vm_state active and task_state rescuing.
May 28 10:01:08.925537 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '62efa57da85f458790f3ceeebcc777a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3a501b4f4041ef875ef4d2b4167044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:01:09.036989 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4a73cc8b-da02-4d7c-8c25-53a625b18d70 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "3edc00a8-2c60-4c44-acb8-6f4d02114bf0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.640s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:09.057206 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8403a305-ffdd-4608-8b78-1c1fbd34e702 req-54d93f01-0a4d-4df1-80f6-fdd66d1b08a2 service nova] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Received event network-vif-plugged-dc94f5df-ac70-45ed-b3e3-795fc10af261 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:09.058731 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8403a305-ffdd-4608-8b78-1c1fbd34e702 req-54d93f01-0a4d-4df1-80f6-fdd66d1b08a2 service nova] Acquiring lock "3edc00a8-2c60-4c44-acb8-6f4d02114bf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:09.058815 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8403a305-ffdd-4608-8b78-1c1fbd34e702 req-54d93f01-0a4d-4df1-80f6-fdd66d1b08a2 service nova] Lock "3edc00a8-2c60-4c44-acb8-6f4d02114bf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:09.059121 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8403a305-ffdd-4608-8b78-1c1fbd34e702 req-54d93f01-0a4d-4df1-80f6-fdd66d1b08a2 service nova] Lock "3edc00a8-2c60-4c44-acb8-6f4d02114bf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:09.059349 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8403a305-ffdd-4608-8b78-1c1fbd34e702 req-54d93f01-0a4d-4df1-80f6-fdd66d1b08a2 service nova] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] No waiting events found dispatching network-vif-plugged-dc94f5df-ac70-45ed-b3e3-795fc10af261 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:01:09.059503 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-8403a305-ffdd-4608-8b78-1c1fbd34e702 req-54d93f01-0a4d-4df1-80f6-fdd66d1b08a2 service nova] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Received unexpected event network-vif-plugged-dc94f5df-ac70-45ed-b3e3-795fc10af261 for instance with vm_state active and task_state None.
May 28 10:01:09.159507 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8062489d-d3e5-4e9a-a381-5225ecb57aa7 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:01:09.159702 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-8062489d-d3e5-4e9a-a381-5225ecb57aa7 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:01:09.221519 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:01:09.274203 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:01:09.304711 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:09.445743 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:09.662543 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-8062489d-d3e5-4e9a-a381-5225ecb57aa7 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:01:09.678542 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Removed pending STOPPED event for 87f6620a-fa87-4d27-8512-74215ef4fe34 due to new event <LifecycleEvent: 1779962469.6781557, 87f6620a-fa87-4d27-8512-74215ef4fe34 => Resumed> {{(pid=98321) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 10:01:09.681980 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962469.6781557, 87f6620a-fa87-4d27-8512-74215ef4fe34 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:01:09.681980 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] VM Resumed (Lifecycle Event)
May 28 10:01:09.684932 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-916a5b73-acfa-467a-bed7-10050dcbe8af tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:01:09.692026 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Successfully created port: 55556967-1d07-4f3b-bc07-6692ef9de17b {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:01:09.778934 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:01:10.183638 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8062489d-d3e5-4e9a-a381-5225ecb57aa7 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.938s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:10.186380 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:01:10.191401 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:01:10.275037 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-8062489d-d3e5-4e9a-a381-5225ecb57aa7 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Deleted allocations for instance 289e2914-2be4-4f46-92e0-fa623f8db861
May 28 10:01:10.291231 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Booting with volume c1f00235-beec-448a-ae55-17b46aa31e9b at /dev/vda
May 28 10:01:10.378292 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:01:10.400196 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:01:10.451421 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:10.501330 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:01:10.502345 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:01:10.516023 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:01:10.516023 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe2d:94a4', 'fe80::2844:59ff:feec:5d21', 'fe80::fc16:3eff:fefd:30e7', 'fe80::e4df:c0ff:fe86:6341', 'fe80::fc16:3eff:fe0f:9f68', 'fe80::44e2:31ff:fe81:8771', 'fe80::ce2:7bff:fe0e:d096', 'fe80::fc16:3eff:fedb:1077', 'fe80::fc16:3eff:fee0:9ccd', 'fe80::fc16:3eff:feb1:88d2', 'fe80::843b:b2ff:fe26:76a', 'fe80::fc16:3eff:fe15:4154', 'fe80::605f:aaff:fe8d:fcdd', 'fe80::fc16:3eff:fe3c:b7e1', 'fe80::fc16:3eff:fe86:604b'] 
May 28 10:01:10.516023 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:01:10.516467 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:01:10.516901 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:01:10.517358 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Updating existing volume attachment record: aec33a70-15ab-433d-9c20-d1eb20df1c16 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:01:10.642711 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Successfully updated port: 55556967-1d07-4f3b-bc07-6692ef9de17b {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:01:10.695394 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962470.6948454, 87f6620a-fa87-4d27-8512-74215ef4fe34 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:01:10.695541 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] VM Started (Lifecycle Event)
May 28 10:01:10.934448 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d0180c36-f2e8-4c96-b73f-67e8a8b53883 req-eed28469-7e65-4284-8db8-34666be76a18 service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Received event network-vif-plugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:10.934763 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d0180c36-f2e8-4c96-b73f-67e8a8b53883 req-eed28469-7e65-4284-8db8-34666be76a18 service nova] Acquiring lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:10.935139 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d0180c36-f2e8-4c96-b73f-67e8a8b53883 req-eed28469-7e65-4284-8db8-34666be76a18 service nova] Lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:10.935139 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d0180c36-f2e8-4c96-b73f-67e8a8b53883 req-eed28469-7e65-4284-8db8-34666be76a18 service nova] Lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:10.936083 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d0180c36-f2e8-4c96-b73f-67e8a8b53883 req-eed28469-7e65-4284-8db8-34666be76a18 service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] No waiting events found dispatching network-vif-plugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:01:10.936083 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-d0180c36-f2e8-4c96-b73f-67e8a8b53883 req-eed28469-7e65-4284-8db8-34666be76a18 service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Received unexpected event network-vif-plugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 for instance with vm_state rescued and task_state None.
May 28 10:01:10.936189 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d0180c36-f2e8-4c96-b73f-67e8a8b53883 req-eed28469-7e65-4284-8db8-34666be76a18 service nova] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Received event network-changed-285e920e-6acb-4c37-ab27-552538efb652 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:10.936394 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d0180c36-f2e8-4c96-b73f-67e8a8b53883 req-eed28469-7e65-4284-8db8-34666be76a18 service nova] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Refreshing instance network info cache due to event network-changed-285e920e-6acb-4c37-ab27-552538efb652. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:01:10.936452 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d0180c36-f2e8-4c96-b73f-67e8a8b53883 req-eed28469-7e65-4284-8db8-34666be76a18 service nova] Acquiring lock "refresh_cache-b50eced2-71bf-4448-b2e1-f9657509f34c" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:01:10.936585 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d0180c36-f2e8-4c96-b73f-67e8a8b53883 req-eed28469-7e65-4284-8db8-34666be76a18 service nova] Acquired lock "refresh_cache-b50eced2-71bf-4448-b2e1-f9657509f34c" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:01:10.936700 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-d0180c36-f2e8-4c96-b73f-67e8a8b53883 req-eed28469-7e65-4284-8db8-34666be76a18 service nova] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Refreshing network info cache for port 285e920e-6acb-4c37-ab27-552538efb652 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:01:11.144940 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "refresh_cache-49f53c82-6f7e-4d09-a471-26bd4fdc02e7" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:01:11.146717 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquired lock "refresh_cache-49f53c82-6f7e-4d09-a471-26bd4fdc02e7" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:01:11.146717 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:01:11.199980 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:01:11.202518 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:01:11.289341 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8062489d-d3e5-4e9a-a381-5225ecb57aa7 tempest-ServerBootFromVolumeStableRescueTest-283762505 tempest-ServerBootFromVolumeStableRescueTest-283762505-project-member] Lock "289e2914-2be4-4f46-92e0-fa623f8db861" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.444s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:11.424199 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-aa35de7b-2101-4065-bac1-ad4ccb53fa3e req-bcf67561-0c33-4ed0-a466-6fe8506408b4 service nova] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Received event network-changed-55556967-1d07-4f3b-bc07-6692ef9de17b {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:11.425050 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-aa35de7b-2101-4065-bac1-ad4ccb53fa3e req-bcf67561-0c33-4ed0-a466-6fe8506408b4 service nova] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Refreshing instance network info cache due to event network-changed-55556967-1d07-4f3b-bc07-6692ef9de17b. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:01:11.425050 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-aa35de7b-2101-4065-bac1-ad4ccb53fa3e req-bcf67561-0c33-4ed0-a466-6fe8506408b4 service nova] Acquiring lock "refresh_cache-49f53c82-6f7e-4d09-a471-26bd4fdc02e7" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:01:11.439402 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-d0180c36-f2e8-4c96-b73f-67e8a8b53883 req-eed28469-7e65-4284-8db8-34666be76a18 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:11.815415 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:01:12.069159 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-d0180c36-f2e8-4c96-b73f-67e8a8b53883 req-eed28469-7e65-4284-8db8-34666be76a18 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:12.092986 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:12.191597 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-39c71b8b-cc89-4f17-ab52-44960f9e680b tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Unrescuing
May 28 10:01:12.191890 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-39c71b8b-cc89-4f17-ab52-44960f9e680b tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "refresh_cache-87f6620a-fa87-4d27-8512-74215ef4fe34" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:01:12.192290 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-39c71b8b-cc89-4f17-ab52-44960f9e680b tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquired lock "refresh_cache-87f6620a-fa87-4d27-8512-74215ef4fe34" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:01:12.192452 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-39c71b8b-cc89-4f17-ab52-44960f9e680b tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:01:12.299109 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-d0180c36-f2e8-4c96-b73f-67e8a8b53883 req-eed28469-7e65-4284-8db8-34666be76a18 service nova] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Updated VIF entry in instance network info cache for port 285e920e-6acb-4c37-ab27-552538efb652. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:01:12.299637 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-d0180c36-f2e8-4c96-b73f-67e8a8b53883 req-eed28469-7e65-4284-8db8-34666be76a18 service nova] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Updating instance_info_cache with network_info: [{"id": "285e920e-6acb-4c37-ab27-552538efb652", "address": "fa:16:3e:db:10:77", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap285e920e-6a", "ovs_interfaceid": "285e920e-6acb-4c37-ab27-552538efb652", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:01:12.344229 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Updating instance_info_cache with network_info: [{"id": "55556967-1d07-4f3b-bc07-6692ef9de17b", "address": "fa:16:3e:d2:27:b6", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55556967-1d", "ovs_interfaceid": "55556967-1d07-4f3b-bc07-6692ef9de17b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:01:12.676121 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:01:12.681060 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:01:12.681060 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Creating image(s)
May 28 10:01:12.681060 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Did not create local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 10:01:12.681060 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Ensure instance console log exists: /opt/stack/data/nova/instances/49f53c82-6f7e-4d09-a471-26bd4fdc02e7/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:01:12.681060 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:12.681060 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:12.681060 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:12.698900 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-39c71b8b-cc89-4f17-ab52-44960f9e680b tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:12.804780 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d0180c36-f2e8-4c96-b73f-67e8a8b53883 req-eed28469-7e65-4284-8db8-34666be76a18 service nova] Releasing lock "refresh_cache-b50eced2-71bf-4448-b2e1-f9657509f34c" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:01:12.805189 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d0180c36-f2e8-4c96-b73f-67e8a8b53883 req-eed28469-7e65-4284-8db8-34666be76a18 service nova] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Received event network-changed-dc94f5df-ac70-45ed-b3e3-795fc10af261 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:12.805278 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d0180c36-f2e8-4c96-b73f-67e8a8b53883 req-eed28469-7e65-4284-8db8-34666be76a18 service nova] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Refreshing instance network info cache due to event network-changed-dc94f5df-ac70-45ed-b3e3-795fc10af261. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:01:12.805510 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d0180c36-f2e8-4c96-b73f-67e8a8b53883 req-eed28469-7e65-4284-8db8-34666be76a18 service nova] Acquiring lock "refresh_cache-3edc00a8-2c60-4c44-acb8-6f4d02114bf0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:01:12.805597 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d0180c36-f2e8-4c96-b73f-67e8a8b53883 req-eed28469-7e65-4284-8db8-34666be76a18 service nova] Acquired lock "refresh_cache-3edc00a8-2c60-4c44-acb8-6f4d02114bf0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:01:12.805771 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-d0180c36-f2e8-4c96-b73f-67e8a8b53883 req-eed28469-7e65-4284-8db8-34666be76a18 service nova] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Refreshing network info cache for port dc94f5df-ac70-45ed-b3e3-795fc10af261 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:01:12.846361 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Releasing lock "refresh_cache-49f53c82-6f7e-4d09-a471-26bd4fdc02e7" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:01:12.846864 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Instance network_info: |[{"id": "55556967-1d07-4f3b-bc07-6692ef9de17b", "address": "fa:16:3e:d2:27:b6", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55556967-1d", "ovs_interfaceid": "55556967-1d07-4f3b-bc07-6692ef9de17b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:01:12.848969 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Start _get_guest_xml network_info=[{"id": "55556967-1d07-4f3b-bc07-6692ef9de17b", "address": "fa:16:3e:d2:27:b6", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55556967-1d", "ovs_interfaceid": "55556967-1d07-4f3b-bc07-6692ef9de17b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c1f00235-beec-448a-ae55-17b46aa31e9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '49f53c82-6f7e-4d09-a471-26bd4fdc02e7', 'attached_at': '', 'detached_at': '', 'volume_id': 'c1f00235-beec-448a-ae55-17b46aa31e9b', 'serial': 'c1f00235-beec-448a-ae55-17b46aa31e9b'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'aec33a70-15ab-433d-9c20-d1eb20df1c16', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:01:12.850817 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-aa35de7b-2101-4065-bac1-ad4ccb53fa3e req-bcf67561-0c33-4ed0-a466-6fe8506408b4 service nova] Acquired lock "refresh_cache-49f53c82-6f7e-4d09-a471-26bd4fdc02e7" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:01:12.850817 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-aa35de7b-2101-4065-bac1-ad4ccb53fa3e req-bcf67561-0c33-4ed0-a466-6fe8506408b4 service nova] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Refreshing network info cache for port 55556967-1d07-4f3b-bc07-6692ef9de17b {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:01:12.860803 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:01:12.862755 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-1421682824', uuid='49f53c82-6f7e-4d09-a471-26bd4fdc02e7'), owner=OwnerMeta(userid='62efa57da85f458790f3ceeebcc777a7', username='tempest-ServerActionsTestOtherA-1557455944-project-member', projectid='cb3a501b4f4041ef875ef4d2b4167044', projectname='tempest-ServerActionsTestOtherA-1557455944'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "55556967-1d07-4f3b-bc07-6692ef9de17b", "address": "fa:16:3e:d2:27:b6", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55556967-1d", "ovs_interfaceid": "55556967-1d07-4f3b-bc07-6692ef9de17b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962472.8620968) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:01:12.866358 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:01:12.866842 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:01:12.868762 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:01:12.869745 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:01:12.870534 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:01:12.870534 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:01:12.870714 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:01:12.870872 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:01:12.871536 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:01:12.871784 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:01:12.872197 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:01:12.872518 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:01:12.872753 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:01:12.872981 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:01:12.873309 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:01:12.873725 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:01:12.893884 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:01:12.894419 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c1f00235-beec-448a-ae55-17b46aa31e9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:01:12.894522 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:01:12.896237 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:01:12.896237 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c1f00235-beec-448a-ae55-17b46aa31e9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:01:12.917476 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:01:12.918300 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:01:12.918524 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:01:12.919141 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:01:12.919870 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:01:12.920410 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:01:12.941246 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:01:12.941246 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:12.951125 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:01:12.951125 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:12.956269 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "b50eced2-71bf-4448-b2e1-f9657509f34c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:12.966255 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b] added
May 28 10:01:12.966255 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:01:12.966255 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:01:12.966255 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:01:12.966255 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:01:12.966255 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:01:12.966255 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:12.966899 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:01:12.967287 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0486(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:01:12.967660 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:01:12.969508 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "b50eced2-71bf-4448-b2e1-f9657509f34c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.008s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:12.970870 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b] added
May 28 10:01:12.970870 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:01:12.970870 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:01:12.970870 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:01:12.970870 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:01:12.970870 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:01:12.970870 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:12.971467 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:01:12.971467 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.051(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:01:12.971553 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:01:13.178125 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-39c71b8b-cc89-4f17-ab52-44960f9e680b tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:13.314070 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-d0180c36-f2e8-4c96-b73f-67e8a8b53883 req-eed28469-7e65-4284-8db8-34666be76a18 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:13.359694 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-aa35de7b-2101-4065-bac1-ad4ccb53fa3e req-bcf67561-0c33-4ed0-a466-6fe8506408b4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:13.425054 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-39c71b8b-cc89-4f17-ab52-44960f9e680b tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Updating instance_info_cache with network_info: [{"id": "6ac6cb03-1362-4f61-8f2d-3ae856d28f49", "address": "fa:16:3e:86:60:4b", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac6cb03-13", "ovs_interfaceid": "6ac6cb03-1362-4f61-8f2d-3ae856d28f49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:01:13.479189 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lazy-loading 'flavor' on Instance uuid b50eced2-71bf-4448-b2e1-f9657509f34c {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:01:13.701539 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:13.797210 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "f9fd8989-d182-47e4-9409-266a1440bf58" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:13.797442 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "f9fd8989-d182-47e4-9409-266a1440bf58" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:13.863412 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-d0180c36-f2e8-4c96-b73f-67e8a8b53883 req-eed28469-7e65-4284-8db8-34666be76a18 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:13.911809 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-aa35de7b-2101-4065-bac1-ad4ccb53fa3e req-bcf67561-0c33-4ed0-a466-6fe8506408b4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:13.932072 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-39c71b8b-cc89-4f17-ab52-44960f9e680b tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Releasing lock "refresh_cache-87f6620a-fa87-4d27-8512-74215ef4fe34" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:01:13.932638 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-39c71b8b-cc89-4f17-ab52-44960f9e680b tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lazy-loading 'flavor' on Instance uuid 87f6620a-fa87-4d27-8512-74215ef4fe34 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:01:13.968419 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:01:13.974849 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:01:13.994504 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:01:13.994504 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:01:14.006374 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:01:14.006374 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:14.021205 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:14.034934 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:14.053199 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:14.053199 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:14.053199 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:14.053199 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:14.053199 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:01:14.053199 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:14.053199 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:14.053199 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:14.053199 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:14.053199 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:01:14.063786 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:14.063786 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:14.063786 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:14.063786 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:14.063786 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:01:14.064007 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:14.064007 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:14.064007 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:14.064007 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:14.064007 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:01:14.097597 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b, portal: 192.168.40.100,3260]
May 28 10:01:14.097597 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b, portal: 192.168.40.100,3260] successful.
May 28 10:01:14.097597 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:14.115278 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:14.117741 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b, portal: 192.168.50.100,3260]
May 28 10:01:14.117741 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b, portal: 192.168.50.100,3260] successful.
May 28 10:01:14.117741 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:14.129191 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-d0180c36-f2e8-4c96-b73f-67e8a8b53883 req-eed28469-7e65-4284-8db8-34666be76a18 service nova] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Updated VIF entry in instance network info cache for port dc94f5df-ac70-45ed-b3e3-795fc10af261. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:01:14.132893 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-d0180c36-f2e8-4c96-b73f-67e8a8b53883 req-eed28469-7e65-4284-8db8-34666be76a18 service nova] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Updating instance_info_cache with network_info: [{"id": "dc94f5df-ac70-45ed-b3e3-795fc10af261", "address": "fa:16:3e:3c:b7:e1", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc94f5df-ac", "ovs_interfaceid": "dc94f5df-ac70-45ed-b3e3-795fc10af261", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:01:14.138054 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:14.141193 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:14.141193 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:14.141193 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:14.141193 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:14.141193 np0000001613 nova-compute[98321]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:14.141193 np0000001613 nova-compute[98321]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:14.141193 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:01:14.141193 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:14.141193 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:14.141193 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:14.141193 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:14.141193 np0000001613 nova-compute[98321]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:14.141193 np0000001613 nova-compute[98321]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:14.141193 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:01:14.141193 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.221s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:01:14.141193 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:01:14.141193 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] HCTL ('9', '-', '-', 0) found on session 35 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:01:14.141193 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:01:14.195072 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Searching for a device in session 35 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:01:14.195072 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c1f00235-beec-448a-ae55-17b46aa31e9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:01:14.205078 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:14.205078 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:14.205078 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:14.205078 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:14.205078 np0000001613 nova-compute[98321]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:14.205078 np0000001613 nova-compute[98321]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:14.205078 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:01:14.205078 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:14.205078 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:14.205078 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:14.205078 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:14.205078 np0000001613 nova-compute[98321]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:14.205078 np0000001613 nova-compute[98321]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:14.205078 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:01:14.205078 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.284s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:01:14.205078 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:01:14.205078 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] HCTL ('10', '-', '-', 0) found on session 36 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:01:14.205857 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:01:14.240036 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Searching for a device in session 36 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:01:14.240238 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c1f00235-beec-448a-ae55-17b46aa31e9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:01:14.252150 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-aa35de7b-2101-4065-bac1-ad4ccb53fa3e req-bcf67561-0c33-4ed0-a466-6fe8506408b4 service nova] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Updated VIF entry in instance network info cache for port 55556967-1d07-4f3b-bc07-6692ef9de17b. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:01:14.256101 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-aa35de7b-2101-4065-bac1-ad4ccb53fa3e req-bcf67561-0c33-4ed0-a466-6fe8506408b4 service nova] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Updating instance_info_cache with network_info: [{"id": "55556967-1d07-4f3b-bc07-6692ef9de17b", "address": "fa:16:3e:d2:27:b6", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55556967-1d", "ovs_interfaceid": "55556967-1d07-4f3b-bc07-6692ef9de17b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:01:14.304211 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lazy-loading 'flavor' on Instance uuid f9fd8989-d182-47e4-9409-266a1440bf58 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:01:14.307893 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:14.446519 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:14.473596 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:14.483106 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:14.491459 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "b50eced2-71bf-4448-b2e1-f9657509f34c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.526s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:14.511308 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:14.640272 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d0180c36-f2e8-4c96-b73f-67e8a8b53883 req-eed28469-7e65-4284-8db8-34666be76a18 service nova] Releasing lock "refresh_cache-3edc00a8-2c60-4c44-acb8-6f4d02114bf0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:01:14.698936 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:14.703118 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:14.759517 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-aa35de7b-2101-4065-bac1-ad4ccb53fa3e req-bcf67561-0c33-4ed0-a466-6fe8506408b4 service nova] Releasing lock "refresh_cache-49f53c82-6f7e-4d09-a471-26bd4fdc02e7" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:01:14.823430 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999603392999916 future=<Future at 0x73c1f41c27b0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:01:14.824850 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Instance destroyed successfully.
May 28 10:01:14.826546 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-39c71b8b-cc89-4f17-ab52-44960f9e680b tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lazy-loading 'numa_topology' on Instance uuid 87f6620a-fa87-4d27-8512-74215ef4fe34 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:01:14.921442 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:01:15.315123 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "f9fd8989-d182-47e4-9409-266a1440bf58" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.517s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:15.329234 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-39c71b8b-cc89-4f17-ab52-44960f9e680b tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Object Instance<87f6620a-fa87-4d27-8512-74215ef4fe34> lazy-loaded attributes: flavor,numa_topology {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:01:15.589858 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "b50eced2-71bf-4448-b2e1-f9657509f34c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:15.593253 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "b50eced2-71bf-4448-b2e1-f9657509f34c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:15.593253 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Attaching volume 3c045f01-4b5a-4f0c-86a0-8fc564914ff4 to /dev/vdb
May 28 10:01:15.648941 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:01:15.664708 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:01:15.697198 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:15.741916 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:01:15.742278 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:01:15.752838 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:01:15.757122 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe2d:94a4', 'fe80::2844:59ff:feec:5d21', 'fe80::fc16:3eff:fefd:30e7', 'fe80::e4df:c0ff:fe86:6341', 'fe80::fc16:3eff:fe0f:9f68', 'fe80::44e2:31ff:fe81:8771', 'fe80::ce2:7bff:fe0e:d096', 'fe80::fc16:3eff:fedb:1077', 'fe80::fc16:3eff:fee0:9ccd', 'fe80::fc16:3eff:feb1:88d2', 'fe80::843b:b2ff:fe26:76a', 'fe80::fc16:3eff:fe15:4154', 'fe80::605f:aaff:fe8d:fcdd', 'fe80::fc16:3eff:fe3c:b7e1'] 
May 28 10:01:15.757122 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:01:15.757122 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:01:15.757122 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:01:15.757122 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Updating existing volume attachment record: 0f465f0c-36e5-46a2-9860-811ec987569a {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:01:15.766025 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d91238b9-1994-45c9-864c-ba80424d8882 req-3de1ce92-cde9-4dc1-a064-c62dd51ebc88 service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Received event network-vif-unplugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:15.767103 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d91238b9-1994-45c9-864c-ba80424d8882 req-3de1ce92-cde9-4dc1-a064-c62dd51ebc88 service nova] Acquiring lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:15.767391 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d91238b9-1994-45c9-864c-ba80424d8882 req-3de1ce92-cde9-4dc1-a064-c62dd51ebc88 service nova] Lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:15.767540 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d91238b9-1994-45c9-864c-ba80424d8882 req-3de1ce92-cde9-4dc1-a064-c62dd51ebc88 service nova] Lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:15.767723 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d91238b9-1994-45c9-864c-ba80424d8882 req-3de1ce92-cde9-4dc1-a064-c62dd51ebc88 service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] No waiting events found dispatching network-vif-unplugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:01:15.767889 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-d91238b9-1994-45c9-864c-ba80424d8882 req-3de1ce92-cde9-4dc1-a064-c62dd51ebc88 service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Received unexpected event network-vif-unplugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 for instance with vm_state rescued and task_state unrescuing.
May 28 10:01:15.892473 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:15.950109 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:15.950109 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:15.973647 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Found WWN 3300000001cad31b7 for multipath device dm-3 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:01:15.974634 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.080s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:01:15.976588 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] <== connect_volume: return (3080ms) {'type': 'block', 'scsi_wwn': '3300000001cad31b7', 'path': '/dev/dm-3', 'multipath_id': '3300000001cad31b7'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:01:15.977014 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001cad31b7', 'path': '/dev/dm-3', 'multipath_id': '3300000001cad31b7'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:01:16.056938 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:16.132974 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:16.134219 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:16.348221 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:01:16.348592 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4', 'iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3c045f01-4b5a-4f0c-86a0-8fc564914ff4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:01:16.348780 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:01:16.349886 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:01:16.349886 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4', 'iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3c045f01-4b5a-4f0c-86a0-8fc564914ff4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:01:16.365905 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:01:16.366456 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:01:16.366707 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:01:16.367342 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:01:16.367835 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:01:16.368013 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:01:16.385662 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:01:16.385662 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:16.396442 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:01:16.396442 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:16.407700 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4] added
May 28 10:01:16.407700 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:01:16.407700 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:01:16.407700 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:01:16.407700 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:01:16.407700 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:01:16.407700 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:16.407976 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:01:16.410277 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.04(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:01:16.410277 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:01:16.416593 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4] added
May 28 10:01:16.416593 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:01:16.416593 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:01:16.416593 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:01:16.416593 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:01:16.416593 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:01:16.416593 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:16.416593 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:01:16.416593 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0497(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:01:16.416593 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:01:16.448964 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "f9fd8989-d182-47e4-9409-266a1440bf58" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:16.449193 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "f9fd8989-d182-47e4-9409-266a1440bf58" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:16.449509 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Attaching volume 32eb9856-1f28-4715-b18d-f2182d96db99 to /dev/vdb
May 28 10:01:16.493791 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:01:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1421682824',display_name='tempest-ServerActionsTestOtherA-server-1421682824',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serveractionstestothera-server-1421682824',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLNPaTs6CM9Wbie8XPRW8vQPbkYzxhmauw/kdujNoZe8MNOaDeh6K3tCu7L1IAoOGDytj5meJ0gvP/71uSisLwWlqhLyhBtEZHSZo7u74E1cepcGRGEWdNqJct6TYM6oQ==',key_name='tempest-keypair-320562480',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb3a501b4f4041ef875ef4d2b4167044',ramdisk_id='',reservation_id='r-a0c5gebp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1557455944',owner_user_name='tempest-ServerActionsTestOtherA-1557455944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:01:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62efa57da85f458790f3ceeebcc777a7',uuid=49f53c82-6f7e-4d09-a471-26bd4fdc02e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55556967-1d07-4f3b-bc07-6692ef9de17b", "address": "fa:16:3e:d2:27:b6", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55556967-1d", "ovs_interfaceid": "55556967-1d07-4f3b-bc07-6692ef9de17b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:01:16.494036 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Converting VIF {"id": "55556967-1d07-4f3b-bc07-6692ef9de17b", "address": "fa:16:3e:d2:27:b6", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55556967-1d", "ovs_interfaceid": "55556967-1d07-4f3b-bc07-6692ef9de17b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:01:16.494760 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:27:b6,bridge_name='br-int',has_traffic_filtering=True,id=55556967-1d07-4f3b-bc07-6692ef9de17b,network=Network(2ae47a43-582b-442f-922d-fe7138b431a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55556967-1d') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:01:16.495915 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lazy-loading 'pci_devices' on Instance uuid 49f53c82-6f7e-4d09-a471-26bd4fdc02e7 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:01:16.520682 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:01:16.537268 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:01:16.567277 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:16.609082 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:01:16.617687 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:01:16.619529 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:01:16.623216 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe2d:94a4', 'fe80::2844:59ff:feec:5d21', 'fe80::fc16:3eff:fefd:30e7', 'fe80::e4df:c0ff:fe86:6341', 'fe80::fc16:3eff:fe0f:9f68', 'fe80::44e2:31ff:fe81:8771', 'fe80::ce2:7bff:fe0e:d096', 'fe80::fc16:3eff:fedb:1077', 'fe80::fc16:3eff:fee0:9ccd', 'fe80::fc16:3eff:feb1:88d2', 'fe80::843b:b2ff:fe26:76a', 'fe80::fc16:3eff:fe15:4154', 'fe80::605f:aaff:fe8d:fcdd', 'fe80::fc16:3eff:fe3c:b7e1', 'fe80::fc16:3eff:fe86:604b'] 
May 28 10:01:16.623593 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:01:16.623836 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:01:16.624224 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:01:16.624564 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Updating existing volume attachment record: 786902ad-3e79-4f1e-97e6-05fb137cca0f {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:01:16.854439 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Acquiring lock "03313f66-d1dd-4269-b2e9-3b0796217299" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:16.854703 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "03313f66-d1dd-4269-b2e9-3b0796217299" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:17.000188 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] End _get_guest_xml xml=<domain type="qemu">
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:   <uuid>49f53c82-6f7e-4d09-a471-26bd4fdc02e7</uuid>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:   <name>instance-00000019</name>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:       <nova:name>tempest-ServerActionsTestOtherA-server-1421682824</nova:name>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:01:12</nova:creationTime>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:       <nova:image uuid="">
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:         <nova:user uuid="62efa57da85f458790f3ceeebcc777a7">tempest-ServerActionsTestOtherA-1557455944-project-member</nova:user>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:         <nova:project uuid="cb3a501b4f4041ef875ef4d2b4167044">tempest-ServerActionsTestOtherA-1557455944</nova:project>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:       <nova:root type="volume" uuid=""/>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:         <nova:port uuid="55556967-1d07-4f3b-bc07-6692ef9de17b">
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:     <system>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:       <entry name="serial">49f53c82-6f7e-4d09-a471-26bd4fdc02e7</entry>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:       <entry name="uuid">49f53c82-6f7e-4d09-a471-26bd4fdc02e7</entry>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:     </system>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:   <os>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:   </os>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:   <features>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:   </features>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:   <devices>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/49f53c82-6f7e-4d09-a471-26bd4fdc02e7/disk.config"/>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:     </disk>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:       <alias name="ua-c1f00235-beec-448a-ae55-17b46aa31e9b"/>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-3"/>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:       <serial>c1f00235-beec-448a-ae55-17b46aa31e9b</serial>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:     </disk>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:d2:27:b6"/>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:       <target dev="tap55556967-1d"/>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:     </interface>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/49f53c82-6f7e-4d09-a471-26bd4fdc02e7/console.log" append="off"/>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:     </serial>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:     <video>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:     </video>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:     </rng>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:   </devices>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]: </domain>
May 28 10:01:17.000188 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:01:17.003954 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Preparing to wait for external event network-vif-plugged-55556967-1d07-4f3b-bc07-6692ef9de17b {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:01:17.003954 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:17.003954 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:17.003954 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:17.003954 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:01:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1421682824',display_name='tempest-ServerActionsTestOtherA-server-1421682824',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serveractionstestothera-server-1421682824',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLNPaTs6CM9Wbie8XPRW8vQPbkYzxhmauw/kdujNoZe8MNOaDeh6K3tCu7L1IAoOGDytj5meJ0gvP/71uSisLwWlqhLyhBtEZHSZo7u74E1cepcGRGEWdNqJct6TYM6oQ==',key_name='tempest-keypair-320562480',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb3a501b4f4041ef875ef4d2b4167044',ramdisk_id='',reservation_id='r-a0c5gebp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1557455944',owner_user_name='tempest-ServerActionsTestOtherA-1557455944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:01:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62efa57da85f458790f3ceeebcc777a7',uuid=49f53c82-6f7e-4d09-a471-26bd4fdc02e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55556967-1d07-4f3b-bc07-6692ef9de17b", "address": "fa:16:3e:d2:27:b6", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55556967-1d", "ovs_interfaceid": "55556967-1d07-4f3b-bc07-6692ef9de17b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:01:17.003954 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Converting VIF {"id": "55556967-1d07-4f3b-bc07-6692ef9de17b", "address": "fa:16:3e:d2:27:b6", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55556967-1d", "ovs_interfaceid": "55556967-1d07-4f3b-bc07-6692ef9de17b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:01:17.003954 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:27:b6,bridge_name='br-int',has_traffic_filtering=True,id=55556967-1d07-4f3b-bc07-6692ef9de17b,network=Network(2ae47a43-582b-442f-922d-fe7138b431a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55556967-1d') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:01:17.003954 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:27:b6,bridge_name='br-int',has_traffic_filtering=True,id=55556967-1d07-4f3b-bc07-6692ef9de17b,network=Network(2ae47a43-582b-442f-922d-fe7138b431a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55556967-1d') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:01:17.008014 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:17.008014 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:17.008014 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:01:17.009264 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:17.009576 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9d4dcea8-641d-5353-a8e1-5fc6e9bfd9ed', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:17.012121 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:17.012121 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:01:17.015284 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:17.015495 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap55556967-1d, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:17.017011 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap55556967-1d, col_values=(('qos', UUID('73116af2-5340-4e75-b4cf-2be8a054fa13')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:17.017011 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap55556967-1d, col_values=(('external_ids', {'iface-id': '55556967-1d07-4f3b-bc07-6692ef9de17b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:27:b6', 'vm-uuid': '49f53c82-6f7e-4d09-a471-26bd4fdc02e7'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:17.019259 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:01:17.025175 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:17.027074 np0000001613 nova-compute[98321]: INFO os_vif [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:27:b6,bridge_name='br-int',has_traffic_filtering=True,id=55556967-1d07-4f3b-bc07-6692ef9de17b,network=Network(2ae47a43-582b-442f-922d-fe7138b431a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55556967-1d')
May 28 10:01:17.035228 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Removed pending STOPPED event for 87f6620a-fa87-4d27-8512-74215ef4fe34 due to new event <LifecycleEvent: 1779962477.034704, 87f6620a-fa87-4d27-8512-74215ef4fe34 => Resumed> {{(pid=98321) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 10:01:17.035770 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962477.034704, 87f6620a-fa87-4d27-8512-74215ef4fe34 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:01:17.035770 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] VM Resumed (Lifecycle Event)
May 28 10:01:17.043103 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-39c71b8b-cc89-4f17-ab52-44960f9e680b tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:01:17.189524 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:01:17.189908 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99', 'iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '32eb9856-1f28-4715-b18d-f2182d96db99', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:01:17.190183 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:01:17.359341 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:01:17.408712 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:01:17.416945 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:01:17.424316 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:01:17.424316 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:01:17.431750 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:01:17.431750 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:17.439241 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:17.448772 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:17.458828 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:17.458828 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:17.458828 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:17.458828 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:17.458828 np0000001613 nova-compute[98321]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:17.458828 np0000001613 nova-compute[98321]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:17.458828 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:01:17.459114 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:17.459114 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:17.459114 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:17.459114 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:17.459114 np0000001613 nova-compute[98321]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:17.459114 np0000001613 nova-compute[98321]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:17.459114 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:01:17.467187 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:17.467187 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:17.467187 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:17.467187 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:17.467187 np0000001613 nova-compute[98321]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:17.467187 np0000001613 nova-compute[98321]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:17.467187 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:01:17.467443 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:17.467443 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:17.467443 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:17.467443 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:17.467443 np0000001613 nova-compute[98321]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:17.467443 np0000001613 nova-compute[98321]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:17.467443 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:01:17.510850 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4, portal: 192.168.50.100,3260]
May 28 10:01:17.510850 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4, portal: 192.168.50.100,3260] successful.
May 28 10:01:17.510850 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:17.517145 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4, portal: 192.168.40.100,3260]
May 28 10:01:17.517145 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4, portal: 192.168.40.100,3260] successful.
May 28 10:01:17.517145 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:17.524290 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:17.528761 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:17.538816 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:01:17.541833 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:17.541833 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:17.541833 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:17.541833 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:17.541833 np0000001613 nova-compute[98321]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:17.541833 np0000001613 nova-compute[98321]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:17.541833 np0000001613 nova-compute[98321]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:17.541833 np0000001613 nova-compute[98321]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:17.541833 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:01:17.542123 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:17.542123 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:17.542123 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:17.542123 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:17.542123 np0000001613 nova-compute[98321]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:17.542123 np0000001613 nova-compute[98321]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:17.542123 np0000001613 nova-compute[98321]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:17.542123 np0000001613 nova-compute[98321]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:17.542123 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:01:17.542619 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.175s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:01:17.542777 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:01:17.543711 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] HCTL ('11', '-', '-', 0) found on session 37 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:01:17.543831 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:01:17.544216 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:01:17.557800 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:17.557800 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:17.557800 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:17.557800 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:17.557800 np0000001613 nova-compute[98321]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:17.557800 np0000001613 nova-compute[98321]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:17.557800 np0000001613 nova-compute[98321]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:17.557800 np0000001613 nova-compute[98321]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:17.557800 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:01:17.558407 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:17.558407 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:17.558407 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:17.558407 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:17.558407 np0000001613 nova-compute[98321]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:17.558407 np0000001613 nova-compute[98321]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:17.558407 np0000001613 nova-compute[98321]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:17.558407 np0000001613 nova-compute[98321]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:17.558407 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:01:17.558407 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.192s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:01:17.558819 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:01:17.559507 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] HCTL ('12', '-', '-', 0) found on session 38 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:01:17.559636 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:01:17.571895 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Searching for a device in session 37 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:01:17.572256 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3c045f01-4b5a-4f0c-86a0-8fc564914ff4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:01:17.579093 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Searching for a device in session 38 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:01:17.579527 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3c045f01-4b5a-4f0c-86a0-8fc564914ff4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:01:17.851996 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7bee950c-9638-4b9e-b12e-da9df00e7816 req-b1be3715-b880-4fa2-b89c-767e309c2aac service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Received event network-vif-unplugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:17.854040 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7bee950c-9638-4b9e-b12e-da9df00e7816 req-b1be3715-b880-4fa2-b89c-767e309c2aac service nova] Acquiring lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:17.854040 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7bee950c-9638-4b9e-b12e-da9df00e7816 req-b1be3715-b880-4fa2-b89c-767e309c2aac service nova] Lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:17.857668 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7bee950c-9638-4b9e-b12e-da9df00e7816 req-b1be3715-b880-4fa2-b89c-767e309c2aac service nova] Lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:17.858146 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7bee950c-9638-4b9e-b12e-da9df00e7816 req-b1be3715-b880-4fa2-b89c-767e309c2aac service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] No waiting events found dispatching network-vif-unplugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:01:17.858471 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-7bee950c-9638-4b9e-b12e-da9df00e7816 req-b1be3715-b880-4fa2-b89c-767e309c2aac service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Received unexpected event network-vif-unplugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 for instance with vm_state active and task_state None.
May 28 10:01:17.859235 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7bee950c-9638-4b9e-b12e-da9df00e7816 req-b1be3715-b880-4fa2-b89c-767e309c2aac service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Received event network-vif-plugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:17.859235 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7bee950c-9638-4b9e-b12e-da9df00e7816 req-b1be3715-b880-4fa2-b89c-767e309c2aac service nova] Acquiring lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:17.859235 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7bee950c-9638-4b9e-b12e-da9df00e7816 req-b1be3715-b880-4fa2-b89c-767e309c2aac service nova] Lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:17.859516 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7bee950c-9638-4b9e-b12e-da9df00e7816 req-b1be3715-b880-4fa2-b89c-767e309c2aac service nova] Lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:17.860124 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7bee950c-9638-4b9e-b12e-da9df00e7816 req-b1be3715-b880-4fa2-b89c-767e309c2aac service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] No waiting events found dispatching network-vif-plugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:01:17.860465 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-7bee950c-9638-4b9e-b12e-da9df00e7816 req-b1be3715-b880-4fa2-b89c-767e309c2aac service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Received unexpected event network-vif-plugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 for instance with vm_state active and task_state None.
May 28 10:01:17.860528 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7bee950c-9638-4b9e-b12e-da9df00e7816 req-b1be3715-b880-4fa2-b89c-767e309c2aac service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Received event network-vif-plugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:17.861491 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7bee950c-9638-4b9e-b12e-da9df00e7816 req-b1be3715-b880-4fa2-b89c-767e309c2aac service nova] Acquiring lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:17.861491 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7bee950c-9638-4b9e-b12e-da9df00e7816 req-b1be3715-b880-4fa2-b89c-767e309c2aac service nova] Lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:17.861491 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7bee950c-9638-4b9e-b12e-da9df00e7816 req-b1be3715-b880-4fa2-b89c-767e309c2aac service nova] Lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:17.861491 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7bee950c-9638-4b9e-b12e-da9df00e7816 req-b1be3715-b880-4fa2-b89c-767e309c2aac service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] No waiting events found dispatching network-vif-plugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:01:17.861491 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-7bee950c-9638-4b9e-b12e-da9df00e7816 req-b1be3715-b880-4fa2-b89c-767e309c2aac service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Received unexpected event network-vif-plugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 for instance with vm_state active and task_state None.
May 28 10:01:17.931486 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:17.931486 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:17.934324 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:01:17.934738 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Claim successful on node np0000001613
May 28 10:01:18.046836 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962478.0465107, 87f6620a-fa87-4d27-8512-74215ef4fe34 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:01:18.047032 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] VM Started (Lifecycle Event)
May 28 10:01:18.290373 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.000383609999971668 future=<Future at 0x73c1f41b8e30 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:01:18.290535 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:01:18.290644 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=0.616478288999815 future=<Future at 0x73c1f41fdd30 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:01:18.290819 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=0.616337306999867 future=<Future at 0x73c1f41fdd30 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:01:18.368509 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:01:18.549811 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:01:18.551666 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:01:18.563358 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:01:18.563502 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:01:18.563649 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] No VIF found with MAC fa:16:3e:d2:27:b6, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:01:18.564135 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Using config drive
May 28 10:01:18.907951 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0003586630000427249 future=<Future at 0x73c1f41fdd30 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:01:18.911380 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:01:18.911380 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=10.914806275999808 future=<Future at 0x73c1f41c27b0 state=cancelled>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:01:18.911380 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=10.914708063000035 future=<Future at 0x73c1f41c27b0 state=cancelled>) was cancelled while queued, skipping {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:01:18.911380 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:01:18.911380 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Emitting event <LifecycleEvent: 1779962463.9070446, 289e2914-2be4-4f46-92e0-fa623f8db861 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:01:18.911380 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] VM Stopped (Lifecycle Event)
May 28 10:01:19.073142 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:19.277136 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Creating config drive at /opt/stack/data/nova/instances/49f53c82-6f7e-4d09-a471-26bd4fdc02e7/disk.config
May 28 10:01:19.284323 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/49f53c82-6f7e-4d09-a471-26bd4fdc02e7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpm_vv8wke {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:19.324921 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:19.348206 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/49f53c82-6f7e-4d09-a471-26bd4fdc02e7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpm_vv8wke" returned: 0 in 0.064s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:19.391436 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Found WWN 3300000009c0f9088 for multipath device dm-9 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:01:19.392006 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.043s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:01:19.392301 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] <== connect_volume: return (3043ms) {'type': 'block', 'scsi_wwn': '3300000009c0f9088', 'path': '/dev/dm-9', 'multipath_id': '3300000009c0f9088'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:01:19.393555 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009c0f9088', 'path': '/dev/dm-9', 'multipath_id': '3300000009c0f9088'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:01:19.394679 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.204s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:01:19.395295 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99', 'iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '32eb9856-1f28-4715-b18d-f2182d96db99', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:01:19.398685 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lazy-loading 'flavor' on Instance uuid b50eced2-71bf-4448-b2e1-f9657509f34c {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:01:19.413102 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:01:19.414029 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:01:19.417331 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:01:19.419056 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:01:19.419056 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-9cc3dbdb-3825-4002-94f2-ac1f2df290c3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 289e2914-2be4-4f46-92e0-fa623f8db861] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:01:19.422634 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.008s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:01:19.422982 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:01:19.438732 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:01:19.438732 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:19.449723 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:01:19.449723 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:19.463853 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99] added
May 28 10:01:19.463853 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:01:19.463853 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:01:19.463853 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:01:19.463853 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:01:19.463853 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:01:19.463853 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:19.464097 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:01:19.464528 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0467(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:01:19.464798 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:01:19.475598 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99] added
May 28 10:01:19.475598 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:01:19.475598 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:01:19.475598 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:01:19.475598 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:01:19.475598 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:01:19.475598 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:19.476786 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:01:19.476786 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0537(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:01:19.476931 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:01:19.778493 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:01:19.780041 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:01:19.903685 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Attempting to attach volume 3c045f01-4b5a-4f0c-86a0-8fc564914ff4 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 10:01:19.914223 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] attach device xml: <disk type="block" device="disk">
May 28 10:01:19.914223 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:01:19.914223 np0000001613 nova-compute[98321]:   <alias name="ua-3c045f01-4b5a-4f0c-86a0-8fc564914ff4"/>
May 28 10:01:19.914223 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-9"/>
May 28 10:01:19.914223 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:01:19.914223 np0000001613 nova-compute[98321]:   <serial>3c045f01-4b5a-4f0c-86a0-8fc564914ff4</serial>
May 28 10:01:19.914223 np0000001613 nova-compute[98321]:   <shareable/>
May 28 10:01:19.914223 np0000001613 nova-compute[98321]: </disk>
May 28 10:01:19.914223 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 10:01:20.105082 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:20.139731 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:20.151394 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:20.250680 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:20.282296 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:01:20.345032 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:20.345886 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:20.361852 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-200369db-7e94-4396-adfb-6e6fde8b34a5 req-56145163-ec39-43dd-8390-c60bb3affe6e service nova] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Received event network-vif-plugged-55556967-1d07-4f3b-bc07-6692ef9de17b {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:20.362029 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-200369db-7e94-4396-adfb-6e6fde8b34a5 req-56145163-ec39-43dd-8390-c60bb3affe6e service nova] Acquiring lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:20.365477 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-200369db-7e94-4396-adfb-6e6fde8b34a5 req-56145163-ec39-43dd-8390-c60bb3affe6e service nova] Lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:20.365477 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-200369db-7e94-4396-adfb-6e6fde8b34a5 req-56145163-ec39-43dd-8390-c60bb3affe6e service nova] Lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:20.365477 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-200369db-7e94-4396-adfb-6e6fde8b34a5 req-56145163-ec39-43dd-8390-c60bb3affe6e service nova] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Processing event network-vif-plugged-55556967-1d07-4f3b-bc07-6692ef9de17b {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:01:20.465622 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:01:20.478241 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:01:20.495391 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:01:20.495391 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:01:20.506367 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:01:20.506367 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:20.518143 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:20.531432 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:20.554998 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:20.554998 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:20.554998 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:20.554998 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:20.554998 np0000001613 nova-compute[98321]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:20.554998 np0000001613 nova-compute[98321]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:20.554998 np0000001613 nova-compute[98321]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:20.554998 np0000001613 nova-compute[98321]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:20.554998 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:01:20.556141 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:20.556141 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:20.556141 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:20.556141 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:20.556141 np0000001613 nova-compute[98321]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:20.556141 np0000001613 nova-compute[98321]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:20.556141 np0000001613 nova-compute[98321]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:20.556141 np0000001613 nova-compute[98321]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:20.556141 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:01:20.565262 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:20.565262 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:20.565262 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:20.565262 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:20.565262 np0000001613 nova-compute[98321]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:20.565262 np0000001613 nova-compute[98321]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:20.565262 np0000001613 nova-compute[98321]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:20.565262 np0000001613 nova-compute[98321]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:20.565262 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:01:20.565262 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:20.565262 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:20.565262 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:20.565262 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:20.565262 np0000001613 nova-compute[98321]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:20.565262 np0000001613 nova-compute[98321]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:20.565262 np0000001613 nova-compute[98321]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:20.565262 np0000001613 nova-compute[98321]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:20.565262 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:01:20.646997 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99, portal: 192.168.40.100,3260]
May 28 10:01:20.646997 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99, portal: 192.168.40.100,3260] successful.
May 28 10:01:20.646997 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:20.663023 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99, portal: 192.168.50.100,3260]
May 28 10:01:20.663023 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99, portal: 192.168.50.100,3260] successful.
May 28 10:01:20.663023 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:20.664041 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:20.684714 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:20.699397 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:20.699397 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:20.699397 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:20.699397 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:20.699397 np0000001613 nova-compute[98321]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:20.699397 np0000001613 nova-compute[98321]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:20.699397 np0000001613 nova-compute[98321]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:20.699397 np0000001613 nova-compute[98321]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:20.699397 np0000001613 nova-compute[98321]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99 (non-flash)
May 28 10:01:20.699397 np0000001613 nova-compute[98321]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99 (non-flash)
May 28 10:01:20.699397 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:01:20.699397 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:20.699397 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:20.699397 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:20.699397 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:20.699397 np0000001613 nova-compute[98321]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:20.699397 np0000001613 nova-compute[98321]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:20.699397 np0000001613 nova-compute[98321]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:20.699397 np0000001613 nova-compute[98321]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:20.699397 np0000001613 nova-compute[98321]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99 (non-flash)
May 28 10:01:20.699397 np0000001613 nova-compute[98321]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99 (non-flash)
May 28 10:01:20.699397 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:01:20.700211 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.283s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:01:20.700211 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:01:20.702183 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] HCTL ('15', '-', '-', 0) found on session 39 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:01:20.702183 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:01:20.712771 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:20.712771 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:20.712771 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:20.712771 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:20.712771 np0000001613 nova-compute[98321]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:20.712771 np0000001613 nova-compute[98321]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:20.712771 np0000001613 nova-compute[98321]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:20.712771 np0000001613 nova-compute[98321]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:20.712771 np0000001613 nova-compute[98321]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99 (non-flash)
May 28 10:01:20.712771 np0000001613 nova-compute[98321]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99 (non-flash)
May 28 10:01:20.712771 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:01:20.713295 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:20.713295 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:20.713295 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:20.713295 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:20.713295 np0000001613 nova-compute[98321]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:20.713295 np0000001613 nova-compute[98321]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:20.713295 np0000001613 nova-compute[98321]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:20.713295 np0000001613 nova-compute[98321]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:20.713295 np0000001613 nova-compute[98321]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99 (non-flash)
May 28 10:01:20.713295 np0000001613 nova-compute[98321]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99 (non-flash)
May 28 10:01:20.713295 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:01:20.713790 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.291s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:01:20.713883 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:01:20.715969 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] HCTL ('16', '-', '-', 0) found on session 40 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:01:20.715969 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:01:20.732233 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Searching for a device in session 39 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:01:20.732429 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '32eb9856-1f28-4715-b18d-f2182d96db99', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:01:20.769888 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Searching for a device in session 40 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:01:20.769888 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '32eb9856-1f28-4715-b18d-f2182d96db99', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:01:20.797371 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.866s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:20.797970 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:01:21.306762 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:01:21.307315 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:01:21.307481 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:21.307837 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:21.415691 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:01:21.470142 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962481.469668, 49f53c82-6f7e-4d09-a471-26bd4fdc02e7 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:01:21.470778 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] VM Started (Lifecycle Event)
May 28 10:01:21.471889 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:01:21.479424 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:01:21.481212 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Instance spawned successfully.
May 28 10:01:21.486284 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:01:21.680921 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:01:21.680921 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:01:21.680921 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:01:21.680921 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No VIF found with MAC fa:16:3e:db:10:77, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:01:21.814233 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:01:21.973977 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:01:21.980255 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:01:21.998510 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4253d01a8baa41978a589f90a58d945d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5bac5cd317420ab74fc9f416a80e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:01:22.002266 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:01:22.002738 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:01:22.003328 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:01:22.004019 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:01:22.004019 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:01:22.004330 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:01:22.019036 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:22.205999 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:22.441467 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Found WWN 33000000062b5f015 for multipath device dm-10 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:01:22.441883 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.047s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:01:22.441883 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] <== connect_volume: return (5252ms) {'type': 'block', 'scsi_wwn': '33000000062b5f015', 'path': '/dev/dm-10', 'multipath_id': '33000000062b5f015'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:01:22.442016 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000062b5f015', 'path': '/dev/dm-10', 'multipath_id': '33000000062b5f015'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:01:22.446433 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lazy-loading 'flavor' on Instance uuid f9fd8989-d182-47e4-9409-266a1440bf58 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:01:22.462512 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-43e7bd47-5d8d-4d2b-b304-c8e402a08301 req-0e639d8d-9eb1-49a1-a49b-9cc6e429fd26 service nova] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Received event network-vif-plugged-55556967-1d07-4f3b-bc07-6692ef9de17b {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:22.462512 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-43e7bd47-5d8d-4d2b-b304-c8e402a08301 req-0e639d8d-9eb1-49a1-a49b-9cc6e429fd26 service nova] Acquiring lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:22.462512 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-43e7bd47-5d8d-4d2b-b304-c8e402a08301 req-0e639d8d-9eb1-49a1-a49b-9cc6e429fd26 service nova] Lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:22.462512 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-43e7bd47-5d8d-4d2b-b304-c8e402a08301 req-0e639d8d-9eb1-49a1-a49b-9cc6e429fd26 service nova] Lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:22.462512 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-43e7bd47-5d8d-4d2b-b304-c8e402a08301 req-0e639d8d-9eb1-49a1-a49b-9cc6e429fd26 service nova] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] No waiting events found dispatching network-vif-plugged-55556967-1d07-4f3b-bc07-6692ef9de17b {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:01:22.462512 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-43e7bd47-5d8d-4d2b-b304-c8e402a08301 req-0e639d8d-9eb1-49a1-a49b-9cc6e429fd26 service nova] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Received unexpected event network-vif-plugged-55556967-1d07-4f3b-bc07-6692ef9de17b for instance with vm_state building and task_state spawning.
May 28 10:01:22.483401 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:01:22.483401 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962482.4831562, 49f53c82-6f7e-4d09-a471-26bd4fdc02e7 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:01:22.483767 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] VM Paused (Lifecycle Event)
May 28 10:01:22.509766 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Took 9.83 seconds to spawn the instance on the hypervisor.
May 28 10:01:22.511294 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:01:22.950082 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Attempting to attach volume 32eb9856-1f28-4715-b18d-f2182d96db99 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 10:01:22.953742 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] attach device xml: <disk type="block" device="disk">
May 28 10:01:22.953742 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:01:22.953742 np0000001613 nova-compute[98321]:   <alias name="ua-32eb9856-1f28-4715-b18d-f2182d96db99"/>
May 28 10:01:22.953742 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-10"/>
May 28 10:01:22.953742 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:01:22.953742 np0000001613 nova-compute[98321]:   <serial>32eb9856-1f28-4715-b18d-f2182d96db99</serial>
May 28 10:01:22.953742 np0000001613 nova-compute[98321]: </disk>
May 28 10:01:22.953742 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 10:01:22.988230 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:01:22.997865 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962482.9974334, 49f53c82-6f7e-4d09-a471-26bd4fdc02e7 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:01:22.998284 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] VM Resumed (Lifecycle Event)
May 28 10:01:23.029604 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Took 17.62 seconds to build instance.
May 28 10:01:23.171896 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "3edc00a8-2c60-4c44-acb8-6f4d02114bf0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:23.173893 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "3edc00a8-2c60-4c44-acb8-6f4d02114bf0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:23.277904 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7eb098ac-c01e-4996-a69e-db6d5f2a40f7 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "b50eced2-71bf-4448-b2e1-f9657509f34c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.688s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:23.332733 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:01:23.412306 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Successfully created port: 12bb71f4-467b-4cc8-b164-f795401a0117 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:01:23.507058 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:01:23.513307 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:01:23.537736 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2e00c9f0-57e3-4eae-b0b8-58111c7fa91d tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.133s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:23.684699 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lazy-loading 'flavor' on Instance uuid 3edc00a8-2c60-4c44-acb8-6f4d02114bf0 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:01:23.841634 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Booting with volume b8249ce3-d570-41ff-bcb4-97559f72c488 at /dev/vda
May 28 10:01:23.912811 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:01:23.928626 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:01:23.959481 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:24.012628 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:01:24.013005 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:01:24.025869 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:01:24.028854 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe2d:94a4', 'fe80::2844:59ff:feec:5d21', 'fe80::fc16:3eff:fefd:30e7', 'fe80::e4df:c0ff:fe86:6341', 'fe80::fc16:3eff:fe0f:9f68', 'fe80::44e2:31ff:fe81:8771', 'fe80::ce2:7bff:fe0e:d096', 'fe80::fc16:3eff:fedb:1077', 'fe80::fc16:3eff:fee0:9ccd', 'fe80::fc16:3eff:feb1:88d2', 'fe80::843b:b2ff:fe26:76a', 'fe80::fc16:3eff:fe15:4154', 'fe80::605f:aaff:fe8d:fcdd', 'fe80::fc16:3eff:fe3c:b7e1', 'fe80::fc16:3eff:fe86:604b', 'fe80::fc16:3eff:fed2:27b6'] 
May 28 10:01:24.029043 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:01:24.029348 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:01:24.029461 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:01:24.029720 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Updating existing volume attachment record: 261bafc4-81a4-4650-8909-83f8c6812129 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:01:24.170391 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:24.170605 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:24.326001 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:24.680479 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:01:24.705281 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "3edc00a8-2c60-4c44-acb8-6f4d02114bf0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.531s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:24.714208 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:01:24.717622 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:01:24.717795 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:01:24.717947 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] No VIF found with MAC fa:16:3e:0f:9f:68, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:01:24.762916 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Successfully created port: d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:01:24.924085 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f0c71347-28dd-4c2b-8fac-f4bc70e0868e req-c5ca1f18-23e1-4afa-9683-866df6b1de02 service nova] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Received event network-changed-0ed2dfa0-2fb5-4493-91e8-597b70a39c6b {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:24.924085 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f0c71347-28dd-4c2b-8fac-f4bc70e0868e req-c5ca1f18-23e1-4afa-9683-866df6b1de02 service nova] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Refreshing instance network info cache due to event network-changed-0ed2dfa0-2fb5-4493-91e8-597b70a39c6b. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:01:24.924085 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f0c71347-28dd-4c2b-8fac-f4bc70e0868e req-c5ca1f18-23e1-4afa-9683-866df6b1de02 service nova] Acquiring lock "refresh_cache-e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:01:24.924085 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f0c71347-28dd-4c2b-8fac-f4bc70e0868e req-c5ca1f18-23e1-4afa-9683-866df6b1de02 service nova] Acquired lock "refresh_cache-e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:01:24.924085 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-f0c71347-28dd-4c2b-8fac-f4bc70e0868e req-c5ca1f18-23e1-4afa-9683-866df6b1de02 service nova] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Refreshing network info cache for port 0ed2dfa0-2fb5-4493-91e8-597b70a39c6b {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:01:25.287265 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:25.287265 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:25.292179 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:01:25.294190 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Claim successful on node np0000001613
May 28 10:01:25.361235 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Successfully created port: fd18fd3a-9dc5-4433-a638-72e5586eeb9c {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:01:25.432180 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-f0c71347-28dd-4c2b-8fac-f4bc70e0868e req-c5ca1f18-23e1-4afa-9683-866df6b1de02 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:25.724227 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Booting with volume 45364262-cab4-45b7-8f81-d8ccf73c75b0 at /dev/vdb
May 28 10:01:25.804809 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:01:25.835019 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:01:25.865650 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "3edc00a8-2c60-4c44-acb8-6f4d02114bf0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:25.865650 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "3edc00a8-2c60-4c44-acb8-6f4d02114bf0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:25.865650 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Attaching volume 3c045f01-4b5a-4f0c-86a0-8fc564914ff4 to /dev/vdb
May 28 10:01:25.881525 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:25.944263 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:01:25.944263 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:01:25.957157 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:01:25.961369 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe2d:94a4', 'fe80::2844:59ff:feec:5d21', 'fe80::fc16:3eff:fefd:30e7', 'fe80::e4df:c0ff:fe86:6341', 'fe80::fc16:3eff:fe0f:9f68', 'fe80::44e2:31ff:fe81:8771', 'fe80::ce2:7bff:fe0e:d096', 'fe80::fc16:3eff:fedb:1077', 'fe80::fc16:3eff:fee0:9ccd', 'fe80::fc16:3eff:feb1:88d2', 'fe80::843b:b2ff:fe26:76a', 'fe80::fc16:3eff:fe15:4154', 'fe80::605f:aaff:fe8d:fcdd', 'fe80::fc16:3eff:fe3c:b7e1', 'fe80::fc16:3eff:fe86:604b', 'fe80::fc16:3eff:fed2:27b6'] 
May 28 10:01:25.962143 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:01:25.962357 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:01:25.962716 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:01:25.963197 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Updating existing volume attachment record: 93f46bb6-b78d-4e87-9e40-16e844fc019a {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:01:25.977465 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-f0c71347-28dd-4c2b-8fac-f4bc70e0868e req-c5ca1f18-23e1-4afa-9683-866df6b1de02 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:26.000960 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:01:26.025941 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:01:26.069972 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:26.145346 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:01:26.145657 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:01:26.161454 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:01:26.163443 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe2d:94a4', 'fe80::2844:59ff:feec:5d21', 'fe80::fc16:3eff:fefd:30e7', 'fe80::e4df:c0ff:fe86:6341', 'fe80::fc16:3eff:fe0f:9f68', 'fe80::44e2:31ff:fe81:8771', 'fe80::ce2:7bff:fe0e:d096', 'fe80::fc16:3eff:fedb:1077', 'fe80::fc16:3eff:fee0:9ccd', 'fe80::fc16:3eff:feb1:88d2', 'fe80::843b:b2ff:fe26:76a', 'fe80::fc16:3eff:fe15:4154', 'fe80::605f:aaff:fe8d:fcdd', 'fe80::fc16:3eff:fe3c:b7e1', 'fe80::fc16:3eff:fe86:604b', 'fe80::fc16:3eff:fed2:27b6'] 
May 28 10:01:26.163626 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:01:26.163807 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:01:26.164146 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:01:26.168922 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Updating existing volume attachment record: e219b673-9945-4e8d-8ee7-5dcf04a9957e {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:01:26.249328 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Successfully created port: bc674202-2354-4a2d-bdcf-3faf31e8cc7d {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:01:26.348626 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3ee31ee9-3461-47cd-8cd2-385bf3b2439b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "f9fd8989-d182-47e4-9409-266a1440bf58" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.897s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:26.381180 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-f0c71347-28dd-4c2b-8fac-f4bc70e0868e req-c5ca1f18-23e1-4afa-9683-866df6b1de02 service nova] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Updated VIF entry in instance network info cache for port 0ed2dfa0-2fb5-4493-91e8-597b70a39c6b. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:01:26.381322 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-f0c71347-28dd-4c2b-8fac-f4bc70e0868e req-c5ca1f18-23e1-4afa-9683-866df6b1de02 service nova] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Updating instance_info_cache with network_info: [{"id": "0ed2dfa0-2fb5-4493-91e8-597b70a39c6b", "address": "fa:16:3e:2d:94:a4", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed2dfa0-2f", "ovs_interfaceid": "0ed2dfa0-2fb5-4493-91e8-597b70a39c6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:01:26.808763 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:01:26.809192 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4', 'iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3c045f01-4b5a-4f0c-86a0-8fc564914ff4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:01:26.809290 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:01:26.809747 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:01:26.810009 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4', 'iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3c045f01-4b5a-4f0c-86a0-8fc564914ff4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:01:26.829927 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:01:26.831723 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:01:26.831723 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:01:26.832837 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:01:26.833364 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:01:26.833713 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.startup = automatic
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.session.scan = manual
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:01:26.851530 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:01:26.851530 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:26.868225 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.startup = automatic
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.session.scan = manual
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:01:26.879177 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:01:26.879177 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:26.885792 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f0c71347-28dd-4c2b-8fac-f4bc70e0868e req-c5ca1f18-23e1-4afa-9683-866df6b1de02 service nova] Releasing lock "refresh_cache-e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:01:26.893602 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:26.893602 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:26.893602 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:26.893602 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:26.893602 np0000001613 nova-compute[98321]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:26.893602 np0000001613 nova-compute[98321]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:26.893602 np0000001613 nova-compute[98321]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:26.893602 np0000001613 nova-compute[98321]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:26.893602 np0000001613 nova-compute[98321]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99 (non-flash)
May 28 10:01:26.893602 np0000001613 nova-compute[98321]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99 (non-flash)
May 28 10:01:26.893602 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:01:26.893947 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:26.893947 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:26.893947 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:26.893947 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:26.893947 np0000001613 nova-compute[98321]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:26.893947 np0000001613 nova-compute[98321]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:26.893947 np0000001613 nova-compute[98321]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:26.893947 np0000001613 nova-compute[98321]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:26.893947 np0000001613 nova-compute[98321]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99 (non-flash)
May 28 10:01:26.893947 np0000001613 nova-compute[98321]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99 (non-flash)
May 28 10:01:26.893947 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:01:26.897748 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.067s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:01:26.897950 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:01:26.898896 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] HCTL ('12', '0', '0', 0) found on session 38 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:01:26.899045 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Scanning host 12 c: 0, t: 0, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:01:26.903616 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:26.915822 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Searching for a device in session 38 and hctl ('12', '0', '0', 0) yield: sdg {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:01:26.915935 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3c045f01-4b5a-4f0c-86a0-8fc564914ff4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:01:26.927008 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:26.927008 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:26.927008 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:26.927008 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:26.927008 np0000001613 nova-compute[98321]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:26.927008 np0000001613 nova-compute[98321]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:26.927008 np0000001613 nova-compute[98321]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:26.927008 np0000001613 nova-compute[98321]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:26.927008 np0000001613 nova-compute[98321]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99 (non-flash)
May 28 10:01:26.927008 np0000001613 nova-compute[98321]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99 (non-flash)
May 28 10:01:26.927008 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:01:26.927467 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:26.927467 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:26.927467 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:26.927467 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:26.927467 np0000001613 nova-compute[98321]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:26.927467 np0000001613 nova-compute[98321]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:26.927467 np0000001613 nova-compute[98321]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:26.927467 np0000001613 nova-compute[98321]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:26.927467 np0000001613 nova-compute[98321]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99 (non-flash)
May 28 10:01:26.927467 np0000001613 nova-compute[98321]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99 (non-flash)
May 28 10:01:26.927467 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:01:26.927467 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.094s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:01:26.927876 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:01:26.928137 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] HCTL ('11', '0', '0', 0) found on session 37 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:01:26.928276 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Scanning host 11 c: 0, t: 0, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:01:26.940054 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Searching for a device in session 37 and hctl ('11', '0', '0', 0) yield: sdf {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:01:26.940403 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3c045f01-4b5a-4f0c-86a0-8fc564914ff4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:01:26.966933 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Successfully created port: d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:01:27.021836 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-efbfc43b-e83c-4be0-bb86-6e6fb0d34621 req-38e893f4-b321-4120-a14c-c21a7099c221 service nova] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Received event network-changed-55556967-1d07-4f3b-bc07-6692ef9de17b {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:27.021836 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-efbfc43b-e83c-4be0-bb86-6e6fb0d34621 req-38e893f4-b321-4120-a14c-c21a7099c221 service nova] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Refreshing instance network info cache due to event network-changed-55556967-1d07-4f3b-bc07-6692ef9de17b. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:01:27.021836 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-efbfc43b-e83c-4be0-bb86-6e6fb0d34621 req-38e893f4-b321-4120-a14c-c21a7099c221 service nova] Acquiring lock "refresh_cache-49f53c82-6f7e-4d09-a471-26bd4fdc02e7" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:01:27.021836 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-efbfc43b-e83c-4be0-bb86-6e6fb0d34621 req-38e893f4-b321-4120-a14c-c21a7099c221 service nova] Acquired lock "refresh_cache-49f53c82-6f7e-4d09-a471-26bd4fdc02e7" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:01:27.021836 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-efbfc43b-e83c-4be0-bb86-6e6fb0d34621 req-38e893f4-b321-4120-a14c-c21a7099c221 service nova] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Refreshing network info cache for port 55556967-1d07-4f3b-bc07-6692ef9de17b {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:01:27.023306 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:27.245153 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:01:27.245406 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:01:27.310774 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Acquiring lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:27.310920 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:27.327907 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "f9fd8989-d182-47e4-9409-266a1440bf58" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:27.328151 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "f9fd8989-d182-47e4-9409-266a1440bf58" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:27.527180 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-efbfc43b-e83c-4be0-bb86-6e6fb0d34621 req-38e893f4-b321-4120-a14c-c21a7099c221 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:27.659245 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Booting with volume 714453c0-1620-406b-ae4c-f244696a4a04 at /dev/vdc
May 28 10:01:27.724320 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:01:27.736877 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:01:27.747989 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:01:27.775779 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:27.818358 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:01:27.831215 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Detaching volume 32eb9856-1f28-4715-b18d-f2182d96db99
May 28 10:01:27.838179 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:01:27.840493 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:01:27.842799 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:01:27.867560 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:01:27.870101 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe2d:94a4', 'fe80::2844:59ff:feec:5d21', 'fe80::fc16:3eff:fefd:30e7', 'fe80::e4df:c0ff:fe86:6341', 'fe80::fc16:3eff:fe0f:9f68', 'fe80::44e2:31ff:fe81:8771', 'fe80::ce2:7bff:fe0e:d096', 'fe80::fc16:3eff:fedb:1077', 'fe80::fc16:3eff:fee0:9ccd', 'fe80::fc16:3eff:feb1:88d2', 'fe80::843b:b2ff:fe26:76a', 'fe80::fc16:3eff:fe15:4154', 'fe80::605f:aaff:fe8d:fcdd', 'fe80::fc16:3eff:fe3c:b7e1', 'fe80::fc16:3eff:fe86:604b', 'fe80::fc16:3eff:fed2:27b6'] 
May 28 10:01:27.870273 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:01:27.870332 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:01:27.870536 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:01:27.870745 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Updating existing volume attachment record: 0c2221c6-ee87-42ce-8e58-2dd542ba4f94 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:01:27.919293 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Attempting to driver detach volume 32eb9856-1f28-4715-b18d-f2182d96db99 from mountpoint /dev/vdb
May 28 10:01:27.931107 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Found disk vdb by alias ua-32eb9856-1f28-4715-b18d-f2182d96db99 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:01:27.936861 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Found disk vdb by alias ua-32eb9856-1f28-4715-b18d-f2182d96db99 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:01:27.937968 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Attempting to detach device vdb from instance f9fd8989-d182-47e4-9409-266a1440bf58 from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 10:01:27.937968 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:01:27.937968 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:01:27.937968 np0000001613 nova-compute[98321]:   <alias name="ua-32eb9856-1f28-4715-b18d-f2182d96db99"/>
May 28 10:01:27.937968 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-10"/>
May 28 10:01:27.937968 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:01:27.937968 np0000001613 nova-compute[98321]:   <serial>32eb9856-1f28-4715-b18d-f2182d96db99</serial>
May 28 10:01:27.937968 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:01:27.937968 np0000001613 nova-compute[98321]: </disk>
May 28 10:01:27.937968 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:01:27.951105 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Successfully detached device vdb from instance f9fd8989-d182-47e4-9409-266a1440bf58 from the persistent domain config.
May 28 10:01:27.951105 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] (1/8): Attempting to detach device vdb with device alias ua-32eb9856-1f28-4715-b18d-f2182d96db99 from instance f9fd8989-d182-47e4-9409-266a1440bf58 from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 10:01:27.951105 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:01:27.951105 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:01:27.951105 np0000001613 nova-compute[98321]:   <alias name="ua-32eb9856-1f28-4715-b18d-f2182d96db99"/>
May 28 10:01:27.951105 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-10"/>
May 28 10:01:27.951105 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:01:27.951105 np0000001613 nova-compute[98321]:   <serial>32eb9856-1f28-4715-b18d-f2182d96db99</serial>
May 28 10:01:27.951105 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:01:27.951105 np0000001613 nova-compute[98321]: </disk>
May 28 10:01:27.951105 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:01:27.986545 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Successfully updated port: 12bb71f4-467b-4cc8-b164-f795401a0117 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:01:28.027813 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a9724982-03a1-44be-b0ee-6753e921f57f req-3a4edcea-c4fc-4607-9bd9-33ae26eb91e7 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-vif-unplugged-12bb71f4-467b-4cc8-b164-f795401a0117 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:28.029979 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a9724982-03a1-44be-b0ee-6753e921f57f req-3a4edcea-c4fc-4607-9bd9-33ae26eb91e7 service nova] Acquiring lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:28.030306 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a9724982-03a1-44be-b0ee-6753e921f57f req-3a4edcea-c4fc-4607-9bd9-33ae26eb91e7 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:28.031134 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a9724982-03a1-44be-b0ee-6753e921f57f req-3a4edcea-c4fc-4607-9bd9-33ae26eb91e7 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:28.031134 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a9724982-03a1-44be-b0ee-6753e921f57f req-3a4edcea-c4fc-4607-9bd9-33ae26eb91e7 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] No waiting events found dispatching network-vif-unplugged-12bb71f4-467b-4cc8-b164-f795401a0117 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:01:28.031362 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-a9724982-03a1-44be-b0ee-6753e921f57f req-3a4edcea-c4fc-4607-9bd9-33ae26eb91e7 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received unexpected event network-vif-unplugged-12bb71f4-467b-4cc8-b164-f795401a0117 for instance with vm_state building and task_state block_device_mapping.
May 28 10:01:28.058715 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-efbfc43b-e83c-4be0-bb86-6e6fb0d34621 req-38e893f4-b321-4120-a14c-c21a7099c221 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:28.168652 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Stashing vm_state: active {{(pid=98321) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 28 10:01:28.226506 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-efbfc43b-e83c-4be0-bb86-6e6fb0d34621 req-38e893f4-b321-4120-a14c-c21a7099c221 service nova] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Updated VIF entry in instance network info cache for port 55556967-1d07-4f3b-bc07-6692ef9de17b. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:01:28.226973 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-efbfc43b-e83c-4be0-bb86-6e6fb0d34621 req-38e893f4-b321-4120-a14c-c21a7099c221 service nova] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Updating instance_info_cache with network_info: [{"id": "55556967-1d07-4f3b-bc07-6692ef9de17b", "address": "fa:16:3e:d2:27:b6", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55556967-1d", "ovs_interfaceid": "55556967-1d07-4f3b-bc07-6692ef9de17b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:01:28.262896 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.975s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:28.263694 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:01:28.401029 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:28.401549 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:28.405311 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:01:28.405457 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Claim successful on node np0000001613
May 28 10:01:28.586654 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-32eb9856-1f28-4715-b18d-f2182d96db99 for instance f9fd8989-d182-47e4-9409-266a1440bf58 {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 10:01:28.587620 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779962488.5872977, f9fd8989-d182-47e4-9409-266a1440bf58 => ua-32eb9856-1f28-4715-b18d-f2182d96db99> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 10:01:28.594298 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Successfully detached device vdb from instance f9fd8989-d182-47e4-9409-266a1440bf58 from the live domain config.
May 28 10:01:28.595508 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:01:28.595914 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99', 'iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '32eb9856-1f28-4715-b18d-f2182d96db99', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:01:28.596205 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:01:28.729047 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-efbfc43b-e83c-4be0-bb86-6e6fb0d34621 req-38e893f4-b321-4120-a14c-c21a7099c221 service nova] Releasing lock "refresh_cache-49f53c82-6f7e-4d09-a471-26bd4fdc02e7" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:01:28.743758 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:28.770914 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:01:28.771153 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:01:28.771484 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:28.772396 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:28.858694 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '45c67299cd204090b9ebf7e0eb873e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5fc8bc5d1984c1c839a3ef7e30b9d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:01:28.863886 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Found WWN 3300000009c0f9088 for multipath device dm-9 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:01:28.865974 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.055s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:01:28.865974 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] <== connect_volume: return (2055ms) {'type': 'block', 'scsi_wwn': '3300000009c0f9088', 'path': '/dev/dm-9', 'multipath_id': '3300000009c0f9088'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:01:28.865974 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009c0f9088', 'path': '/dev/dm-9', 'multipath_id': '3300000009c0f9088'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:01:28.866491 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.270s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:01:28.866491 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99', 'iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '32eb9856-1f28-4715-b18d-f2182d96db99', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:01:28.866596 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:01:28.868736 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lazy-loading 'flavor' on Instance uuid 3edc00a8-2c60-4c44-acb8-6f4d02114bf0 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:01:28.905671 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:28.905671 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:28.905671 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:28.905671 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:28.905671 np0000001613 nova-compute[98321]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:28.905671 np0000001613 nova-compute[98321]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:28.905671 np0000001613 nova-compute[98321]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:28.905671 np0000001613 nova-compute[98321]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:28.905671 np0000001613 nova-compute[98321]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99 (non-flash)
May 28 10:01:28.905671 np0000001613 nova-compute[98321]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99 (non-flash)
May 28 10:01:28.905671 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:01:28.906949 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:28.906949 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:28.906949 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:28.906949 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:28.906949 np0000001613 nova-compute[98321]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:28.906949 np0000001613 nova-compute[98321]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:28.906949 np0000001613 nova-compute[98321]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:28.906949 np0000001613 nova-compute[98321]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:28.906949 np0000001613 nova-compute[98321]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99 (non-flash)
May 28 10:01:28.906949 np0000001613 nova-compute[98321]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99 (non-flash)
May 28 10:01:28.906949 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:01:28.906949 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', '36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99', '40')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:01:28.911054 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99', '39')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:01:28.915814 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99', '40')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:01:28.919637 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc2e3b00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99'): ({'sdk'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:01:28.924418 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Removing multipathed devices sdj, sdk {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:01:28.925314 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Flush multipath device 33000000062b5f015 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:01:28.968506 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:01:29.018623 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:01:29.057714 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:01:29.057831 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:01:29.059128 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:01:29.080001 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:01:29.080261 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:01:29.100802 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:29.145770 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99, portal: 192.168.40.100,3260]
May 28 10:01:29.145770 np0000001613 nova-compute[98321]: Logout of [sid: 39, target: iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99, portal: 192.168.40.100,3260] successful.
May 28 10:01:29.145770 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:29.176718 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:29.193005 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:29.230836 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99, portal: 192.168.50.100,3260]
May 28 10:01:29.230836 np0000001613 nova-compute[98321]: Logout of [sid: 40, target: iqn.2023-03.storpool.com:os--volume-32eb9856-1f28-4715-b18d-f2182d96db99, portal: 192.168.50.100,3260] successful.
May 28 10:01:29.230836 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:29.262914 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:29.262914 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:01:29.262914 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] <== disconnect_volume: return (666ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:01:29.262914 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:01:29.275822 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:01:29.312764 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Successfully updated port: 9f218cf2-d351-42a5-8b44-3e7ee9417bbd {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:01:29.328864 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:29.372823 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Attempting to attach volume 3c045f01-4b5a-4f0c-86a0-8fc564914ff4 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 10:01:29.376402 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] attach device xml: <disk type="block" device="disk">
May 28 10:01:29.376402 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:01:29.376402 np0000001613 nova-compute[98321]:   <alias name="ua-3c045f01-4b5a-4f0c-86a0-8fc564914ff4"/>
May 28 10:01:29.376402 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-9"/>
May 28 10:01:29.376402 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:01:29.376402 np0000001613 nova-compute[98321]:   <serial>3c045f01-4b5a-4f0c-86a0-8fc564914ff4</serial>
May 28 10:01:29.376402 np0000001613 nova-compute[98321]:   <shareable/>
May 28 10:01:29.376402 np0000001613 nova-compute[98321]: </disk>
May 28 10:01:29.376402 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 10:01:29.380487 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3d06f479-b62e-4d1c-8826-13a6efd5acf5 req-1614933d-82bf-46b9-bfff-c48d85608971 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-changed-9f218cf2-d351-42a5-8b44-3e7ee9417bbd {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:29.381076 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3d06f479-b62e-4d1c-8826-13a6efd5acf5 req-1614933d-82bf-46b9-bfff-c48d85608971 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Refreshing instance network info cache due to event network-changed-9f218cf2-d351-42a5-8b44-3e7ee9417bbd. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:01:29.381462 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3d06f479-b62e-4d1c-8826-13a6efd5acf5 req-1614933d-82bf-46b9-bfff-c48d85608971 service nova] Acquiring lock "refresh_cache-03313f66-d1dd-4269-b2e9-3b0796217299" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:01:29.381462 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3d06f479-b62e-4d1c-8826-13a6efd5acf5 req-1614933d-82bf-46b9-bfff-c48d85608971 service nova] Acquired lock "refresh_cache-03313f66-d1dd-4269-b2e9-3b0796217299" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:01:29.381649 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-3d06f479-b62e-4d1c-8826-13a6efd5acf5 req-1614933d-82bf-46b9-bfff-c48d85608971 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Refreshing network info cache for port 9f218cf2-d351-42a5-8b44-3e7ee9417bbd {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:01:29.742506 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Successfully created port: 4edd294f-7bb5-46ec-9cdc-c8683088408c {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:01:29.780891 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:01:29.850358 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lazy-loading 'flavor' on Instance uuid f9fd8989-d182-47e4-9409-266a1440bf58 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:01:29.885021 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-3d06f479-b62e-4d1c-8826-13a6efd5acf5 req-1614933d-82bf-46b9-bfff-c48d85608971 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:30.065746 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:01:30.069302 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:01:30.074248 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Creating image(s)
May 28 10:01:30.074761 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Did not create local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 10:01:30.074937 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Ensure instance console log exists: /opt/stack/data/nova/instances/03313f66-d1dd-4269-b2e9-3b0796217299/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:01:30.075233 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:30.075434 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:30.075608 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:30.101151 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-3d06f479-b62e-4d1c-8826-13a6efd5acf5 req-1614933d-82bf-46b9-bfff-c48d85608971 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:01:30.134852 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-1cdc8778-4b33-4826-b6a3-ef67e7657822 req-4ad89362-a394-4b24-bb4a-73a2da2e344c service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-changed-12bb71f4-467b-4cc8-b164-f795401a0117 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:30.136798 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-1cdc8778-4b33-4826-b6a3-ef67e7657822 req-4ad89362-a394-4b24-bb4a-73a2da2e344c service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Refreshing instance network info cache due to event network-changed-12bb71f4-467b-4cc8-b164-f795401a0117. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:01:30.137026 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1cdc8778-4b33-4826-b6a3-ef67e7657822 req-4ad89362-a394-4b24-bb4a-73a2da2e344c service nova] Acquiring lock "refresh_cache-03313f66-d1dd-4269-b2e9-3b0796217299" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:01:30.370787 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-3d06f479-b62e-4d1c-8826-13a6efd5acf5 req-1614933d-82bf-46b9-bfff-c48d85608971 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:01:30.493741 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:01:30.493741 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:01:30.596535 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Successfully updated port: 4edd294f-7bb5-46ec-9cdc-c8683088408c {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:01:30.614733 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Successfully updated port: c2c9fb75-0a9e-47cb-a561-effaa19b4156 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:01:30.666200 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a209689e-0663-402a-874a-b89ff0c54b0d req-cddcd76e-4008-4413-a642-fb2fcc2af85e service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Received event network-changed-4edd294f-7bb5-46ec-9cdc-c8683088408c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:30.666200 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a209689e-0663-402a-874a-b89ff0c54b0d req-cddcd76e-4008-4413-a642-fb2fcc2af85e service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Refreshing instance network info cache due to event network-changed-4edd294f-7bb5-46ec-9cdc-c8683088408c. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:01:30.666200 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a209689e-0663-402a-874a-b89ff0c54b0d req-cddcd76e-4008-4413-a642-fb2fcc2af85e service nova] Acquiring lock "refresh_cache-2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:01:30.666200 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a209689e-0663-402a-874a-b89ff0c54b0d req-cddcd76e-4008-4413-a642-fb2fcc2af85e service nova] Acquired lock "refresh_cache-2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:01:30.666735 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-a209689e-0663-402a-874a-b89ff0c54b0d req-cddcd76e-4008-4413-a642-fb2fcc2af85e service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Refreshing network info cache for port 4edd294f-7bb5-46ec-9cdc-c8683088408c {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:01:30.794652 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:01:30.797851 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:01:30.798169 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Creating image(s)
May 28 10:01:30.798842 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "/opt/stack/data/nova/instances/2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:30.799063 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "/opt/stack/data/nova/instances/2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:30.799709 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "/opt/stack/data/nova/instances/2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:30.801476 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:01:30.806861 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:01:30.809053 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:30.873457 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-774f2062-5197-44d7-8437-df8eb7c2a4ae tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "f9fd8989-d182-47e4-9409-266a1440bf58" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.545s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:30.875847 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3d06f479-b62e-4d1c-8826-13a6efd5acf5 req-1614933d-82bf-46b9-bfff-c48d85608971 service nova] Releasing lock "refresh_cache-03313f66-d1dd-4269-b2e9-3b0796217299" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:01:30.877572 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1cdc8778-4b33-4826-b6a3-ef67e7657822 req-4ad89362-a394-4b24-bb4a-73a2da2e344c service nova] Acquired lock "refresh_cache-03313f66-d1dd-4269-b2e9-3b0796217299" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:01:30.877572 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-1cdc8778-4b33-4826-b6a3-ef67e7657822 req-4ad89362-a394-4b24-bb4a-73a2da2e344c service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Refreshing network info cache for port 12bb71f4-467b-4cc8-b164-f795401a0117 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:01:30.902159 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.093s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:30.902705 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:30.903128 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:30.903633 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:01:30.906202 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:01:30.906564 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:30.997660 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:01:31.013945 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.107s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:31.014544 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:31.066407 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:01:31.066407 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:01:31.066613 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:01:31.066796 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No VIF found with MAC fa:16:3e:3c:b7:e1, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:01:31.074203 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f/disk 1073741824" returned: 0 in 0.059s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:31.074405 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.171s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:31.075680 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:31.107766 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "refresh_cache-2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:01:31.173429 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-a209689e-0663-402a-874a-b89ff0c54b0d req-cddcd76e-4008-4413-a642-fb2fcc2af85e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:31.184242 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.109s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:31.186419 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:01:31.187222 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:31.295267 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:31.297226 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Cannot resize image /opt/stack/data/nova/instances/2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:01:31.297820 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:01:31.298151 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Ensure instance console log exists: /opt/stack/data/nova/instances/2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:01:31.298562 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:31.299643 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:31.299643 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:31.314342 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-a209689e-0663-402a-874a-b89ff0c54b0d req-cddcd76e-4008-4413-a642-fb2fcc2af85e service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:01:31.380859 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-1cdc8778-4b33-4826-b6a3-ef67e7657822 req-4ad89362-a394-4b24-bb4a-73a2da2e344c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:31.503418 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d319baf8-1715-4681-a86b-20bc02a12d3f req-23d662c5-edc5-434a-9c6f-342200d5f97b service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-changed-c2c9fb75-0a9e-47cb-a561-effaa19b4156 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:31.504802 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d319baf8-1715-4681-a86b-20bc02a12d3f req-23d662c5-edc5-434a-9c6f-342200d5f97b service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Refreshing instance network info cache due to event network-changed-c2c9fb75-0a9e-47cb-a561-effaa19b4156. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:01:31.504993 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d319baf8-1715-4681-a86b-20bc02a12d3f req-23d662c5-edc5-434a-9c6f-342200d5f97b service nova] Acquiring lock "refresh_cache-03313f66-d1dd-4269-b2e9-3b0796217299" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:01:31.508543 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.107s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:31.510067 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:01:31.513922 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 2.766s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:31.536284 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-1cdc8778-4b33-4826-b6a3-ef67e7657822 req-4ad89362-a394-4b24-bb4a-73a2da2e344c service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:01:31.546207 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-a209689e-0663-402a-874a-b89ff0c54b0d req-cddcd76e-4008-4413-a642-fb2fcc2af85e service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:01:31.799398 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc7ac689-18bc-43f0-9ae1-df0310253d07 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "f9fd8989-d182-47e4-9409-266a1440bf58" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:31.802272 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc7ac689-18bc-43f0-9ae1-df0310253d07 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "f9fd8989-d182-47e4-9409-266a1440bf58" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:31.802272 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc7ac689-18bc-43f0-9ae1-df0310253d07 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "f9fd8989-d182-47e4-9409-266a1440bf58-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:31.805304 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-1cdc8778-4b33-4826-b6a3-ef67e7657822 req-4ad89362-a394-4b24-bb4a-73a2da2e344c service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:01:31.806516 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc7ac689-18bc-43f0-9ae1-df0310253d07 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "f9fd8989-d182-47e4-9409-266a1440bf58-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.004s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:31.806777 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc7ac689-18bc-43f0-9ae1-df0310253d07 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "f9fd8989-d182-47e4-9409-266a1440bf58-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:31.813114 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-bc7ac689-18bc-43f0-9ae1-df0310253d07 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Terminating instance
May 28 10:01:31.909392 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Successfully updated port: d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:01:32.026821 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:01:32.027693 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Claim successful on node np0000001613
May 28 10:01:32.030449 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:32.033778 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:01:32.034611 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:01:32.034611 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:32.035020 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:32.051500 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a209689e-0663-402a-874a-b89ff0c54b0d req-cddcd76e-4008-4413-a642-fb2fcc2af85e service nova] Releasing lock "refresh_cache-2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:01:32.055193 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquired lock "refresh_cache-2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:01:32.055193 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:01:32.122413 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f33df1d85634228ba269922d1f23be0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4f42e155347e4a2055b151f04390a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:01:32.315557 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1cdc8778-4b33-4826-b6a3-ef67e7657822 req-4ad89362-a394-4b24-bb4a-73a2da2e344c service nova] Releasing lock "refresh_cache-03313f66-d1dd-4269-b2e9-3b0796217299" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:01:32.315989 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d319baf8-1715-4681-a86b-20bc02a12d3f req-23d662c5-edc5-434a-9c6f-342200d5f97b service nova] Acquired lock "refresh_cache-03313f66-d1dd-4269-b2e9-3b0796217299" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:01:32.316268 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-d319baf8-1715-4681-a86b-20bc02a12d3f req-23d662c5-edc5-434a-9c6f-342200d5f97b service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Refreshing network info cache for port c2c9fb75-0a9e-47cb-a561-effaa19b4156 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:01:32.320628 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bc7ac689-18bc-43f0-9ae1-df0310253d07 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:01:32.350492 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:32.381015 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:32.383505 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:32.410332 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:32.534473 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:01:32.538482 np0000001613 nova-compute[98321]: INFO nova.compute.resource_tracker [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Updating resource usage from migration 24fe5c6e-268a-4ec1-90eb-21775d843fda
May 28 10:01:32.642238 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ca557df2-51f0-4efb-b7e3-16d45ea323e6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "3edc00a8-2c60-4c44-acb8-6f4d02114bf0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.778s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:32.681958 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:32.692535 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:32.719002 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999599035000074 future=<Future at 0x73c1f43966f0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:01:32.720277 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.998287294999955 future=<Future at 0x73c1f43966f0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:01:32.722245 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.9965321520001 future=<Future at 0x73c1f43966f0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:01:32.724549 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Instance destroyed successfully.
May 28 10:01:32.724965 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-bc7ac689-18bc-43f0-9ae1-df0310253d07 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lazy-loading 'resources' on Instance uuid f9fd8989-d182-47e4-9409-266a1440bf58 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:01:32.751799 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Successfully created port: a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:01:32.821136 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-d319baf8-1715-4681-a86b-20bc02a12d3f req-23d662c5-edc5-434a-9c6f-342200d5f97b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:32.861089 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:01:32.955788 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-1ca17991-ba8c-407a-b7e8-230c61d074db req-a60c27d2-c451-4a1e-87bc-6463055c8569 service nova] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Received event network-vif-unplugged-b5ee2b20-4839-4467-aa06-cd09a19252bf {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:32.957862 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1ca17991-ba8c-407a-b7e8-230c61d074db req-a60c27d2-c451-4a1e-87bc-6463055c8569 service nova] Acquiring lock "f9fd8989-d182-47e4-9409-266a1440bf58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:32.957862 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1ca17991-ba8c-407a-b7e8-230c61d074db req-a60c27d2-c451-4a1e-87bc-6463055c8569 service nova] Lock "f9fd8989-d182-47e4-9409-266a1440bf58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:32.957862 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1ca17991-ba8c-407a-b7e8-230c61d074db req-a60c27d2-c451-4a1e-87bc-6463055c8569 service nova] Lock "f9fd8989-d182-47e4-9409-266a1440bf58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:32.957862 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-1ca17991-ba8c-407a-b7e8-230c61d074db req-a60c27d2-c451-4a1e-87bc-6463055c8569 service nova] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] No waiting events found dispatching network-vif-unplugged-b5ee2b20-4839-4467-aa06-cd09a19252bf {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:01:32.957862 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-1ca17991-ba8c-407a-b7e8-230c61d074db req-a60c27d2-c451-4a1e-87bc-6463055c8569 service nova] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Received event network-vif-unplugged-b5ee2b20-4839-4467-aa06-cd09a19252bf for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:01:33.044206 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:01:33.055590 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-d319baf8-1715-4681-a86b-20bc02a12d3f req-23d662c5-edc5-434a-9c6f-342200d5f97b service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:01:33.230051 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-bc7ac689-18bc-43f0-9ae1-df0310253d07 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:00:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-86745832',display_name='tempest-AttachVolumeNegativeTest-server-86745832',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumenegativetest-server-86745832',id=18,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjr7/2MSqqVwrs28eG/a+bcR/VwOiSGqWlrHCYSfji/7M/g+Mfwk1esX+OfaMVPgHZBUmBkKY2bBrwCeGZl+UC4ih0v0XxSxYAHy82LELkL6DJA+t0CZOdRTnQGOQXb9g==',key_name='tempest-keypair-728059437',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:00:32Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a85ba31f98b45b6974118c6560bbc53',ramdisk_id='',reservation_id='r-a0o556d4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-775348461',owner_user_name='tempest-AttachVolumeNegativeTest-775348461-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:00:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9297977bbf334232a4a74bd6808b863b',uuid=f9fd8989-d182-47e4-9409-266a1440bf58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5ee2b20-4839-4467-aa06-cd09a19252bf", "address": "fa:16:3e:0f:9f:68", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ee2b20-48", "ovs_interfaceid": "b5ee2b20-4839-4467-aa06-cd09a19252bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:01:33.230299 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-bc7ac689-18bc-43f0-9ae1-df0310253d07 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Converting VIF {"id": "b5ee2b20-4839-4467-aa06-cd09a19252bf", "address": "fa:16:3e:0f:9f:68", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ee2b20-48", "ovs_interfaceid": "b5ee2b20-4839-4467-aa06-cd09a19252bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:01:33.231101 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-bc7ac689-18bc-43f0-9ae1-df0310253d07 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:9f:68,bridge_name='br-int',has_traffic_filtering=True,id=b5ee2b20-4839-4467-aa06-cd09a19252bf,network=Network(bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5ee2b20-48') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:01:33.231420 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-bc7ac689-18bc-43f0-9ae1-df0310253d07 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:9f:68,bridge_name='br-int',has_traffic_filtering=True,id=b5ee2b20-4839-4467-aa06-cd09a19252bf,network=Network(bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5ee2b20-48') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:01:33.235517 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:33.235673 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5ee2b20-48, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:33.240203 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:33.240203 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:01:33.240203 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:33.240414 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:33.240553 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fbcdf85b-34af-464f-823b-6e0ca2ea3e5b) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:33.241369 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:33.241873 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:01:33.242971 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:33.250336 np0000001613 nova-compute[98321]: INFO os_vif [None req-bc7ac689-18bc-43f0-9ae1-df0310253d07 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:9f:68,bridge_name='br-int',has_traffic_filtering=True,id=b5ee2b20-4839-4467-aa06-cd09a19252bf,network=Network(bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5ee2b20-48')
May 28 10:01:33.250615 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-bc7ac689-18bc-43f0-9ae1-df0310253d07 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Deleting instance files /opt/stack/data/nova/instances/f9fd8989-d182-47e4-9409-266a1440bf58_del
May 28 10:01:33.252134 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-bc7ac689-18bc-43f0-9ae1-df0310253d07 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Deletion of /opt/stack/data/nova/instances/f9fd8989-d182-47e4-9409-266a1440bf58_del complete
May 28 10:01:33.325433 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Successfully updated port: fd18fd3a-9dc5-4433-a638-72e5586eeb9c {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:01:33.383519 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:33.398852 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-d319baf8-1715-4681-a86b-20bc02a12d3f req-23d662c5-edc5-434a-9c6f-342200d5f97b service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:01:33.517158 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Successfully updated port: a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:01:33.586193 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-86dc4c0a-573e-43ac-8410-5130cc8ff6f5 req-42ef8629-9608-4c89-ad81-3446fe28aee1 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Received event network-changed-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:33.586441 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-86dc4c0a-573e-43ac-8410-5130cc8ff6f5 req-42ef8629-9608-4c89-ad81-3446fe28aee1 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Refreshing instance network info cache due to event network-changed-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:01:33.587240 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-86dc4c0a-573e-43ac-8410-5130cc8ff6f5 req-42ef8629-9608-4c89-ad81-3446fe28aee1 service nova] Acquiring lock "refresh_cache-4baa35bb-b237-42be-aa8b-d9eeed7e41a0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:01:33.587896 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-86dc4c0a-573e-43ac-8410-5130cc8ff6f5 req-42ef8629-9608-4c89-ad81-3446fe28aee1 service nova] Acquired lock "refresh_cache-4baa35bb-b237-42be-aa8b-d9eeed7e41a0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:01:33.590357 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-86dc4c0a-573e-43ac-8410-5130cc8ff6f5 req-42ef8629-9608-4c89-ad81-3446fe28aee1 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Refreshing network info cache for port a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:01:33.592354 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Updating instance_info_cache with network_info: [{"id": "4edd294f-7bb5-46ec-9cdc-c8683088408c", "address": "fa:16:3e:44:0a:72", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4edd294f-7b", "ovs_interfaceid": "4edd294f-7bb5-46ec-9cdc-c8683088408c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:01:33.613416 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-92cf8e3e-7ea9-4425-a643-723676e4256a req-790ae658-bafc-4721-9d07-44f0faf49539 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-changed-d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:33.613877 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-92cf8e3e-7ea9-4425-a643-723676e4256a req-790ae658-bafc-4721-9d07-44f0faf49539 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Refreshing instance network info cache due to event network-changed-d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:01:33.614132 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-92cf8e3e-7ea9-4425-a643-723676e4256a req-790ae658-bafc-4721-9d07-44f0faf49539 service nova] Acquiring lock "refresh_cache-03313f66-d1dd-4269-b2e9-3b0796217299" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:01:33.625465 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:01:33.626033 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:01:33.759745 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-bc7ac689-18bc-43f0-9ae1-df0310253d07 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Took 1.44 seconds to destroy the instance on the hypervisor.
May 28 10:01:33.760232 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-bc7ac689-18bc-43f0-9ae1-df0310253d07 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:01:33.760726 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:01:33.760826 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:01:33.761130 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:33.864675 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:33.909141 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d319baf8-1715-4681-a86b-20bc02a12d3f req-23d662c5-edc5-434a-9c6f-342200d5f97b service nova] Releasing lock "refresh_cache-03313f66-d1dd-4269-b2e9-3b0796217299" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:01:33.909141 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-92cf8e3e-7ea9-4425-a643-723676e4256a req-790ae658-bafc-4721-9d07-44f0faf49539 service nova] Acquired lock "refresh_cache-03313f66-d1dd-4269-b2e9-3b0796217299" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:01:33.909141 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-92cf8e3e-7ea9-4425-a643-723676e4256a req-790ae658-bafc-4721-9d07-44f0faf49539 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Refreshing network info cache for port d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:01:34.022282 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Acquiring lock "refresh_cache-4baa35bb-b237-42be-aa8b-d9eeed7e41a0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:01:34.055519 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:01:34.056852 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:01:34.057156 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Creating image(s)
May 28 10:01:34.057787 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Acquiring lock "/opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:34.058032 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "/opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:34.058662 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "/opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:34.059310 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:01:34.063737 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:01:34.065038 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:34.096727 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-86dc4c0a-573e-43ac-8410-5130cc8ff6f5 req-42ef8629-9608-4c89-ad81-3446fe28aee1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:34.099524 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Releasing lock "refresh_cache-2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:01:34.099890 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Instance network_info: |[{"id": "4edd294f-7bb5-46ec-9cdc-c8683088408c", "address": "fa:16:3e:44:0a:72", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4edd294f-7b", "ovs_interfaceid": "4edd294f-7bb5-46ec-9cdc-c8683088408c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:01:34.106360 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Start _get_guest_xml network_info=[{"id": "4edd294f-7bb5-46ec-9cdc-c8683088408c", "address": "fa:16:3e:44:0a:72", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4edd294f-7b", "ovs_interfaceid": "4edd294f-7bb5-46ec-9cdc-c8683088408c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:01:34.117496 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:01:34.120359 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8ae71c91-4c81-4769-adcc-b6d17566fc7b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "b50eced2-71bf-4448-b2e1-f9657509f34c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:34.120620 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8ae71c91-4c81-4769-adcc-b6d17566fc7b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "b50eced2-71bf-4448-b2e1-f9657509f34c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:34.130202 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1240965804', uuid='2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f'), owner=OwnerMeta(userid='45c67299cd204090b9ebf7e0eb873e37', username='tempest-ServerRescueNegativeTestJSON-1286552851-project-member', projectid='f5fc8bc5d1984c1c839a3ef7e30b9d36', projectname='tempest-ServerRescueNegativeTestJSON-1286552851'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4edd294f-7bb5-46ec-9cdc-c8683088408c", "address": "fa:16:3e:44:0a:72", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4edd294f-7b", "ovs_interfaceid": "4edd294f-7bb5-46ec-9cdc-c8683088408c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962494.1198323) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:01:34.133891 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:01:34.149182 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:01:34.158453 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:01:34.160589 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.095s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:34.160859 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:01:34.161206 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:01:34.162410 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:01:34.162982 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:01:34.163731 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:34.164138 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:34.165280 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:01:34.168024 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:01:34.168024 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:01:34.168024 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:01:34.168131 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:01:34.168498 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:01:34.168498 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:01:34.168646 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:01:34.168646 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:01:34.168781 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:01:34.169904 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:01:34.181016 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:01:34.185921 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:34.207227 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:01:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1240965804',display_name='tempest-ServerRescueNegativeTestJSON-server-1240965804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serverrescuenegativetestjson-server-1240965804',id=27,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4cGw7X+Q2nx15R5jh2EKJ3VR+oUGPb5WmFwZPLNWg5EFnojPDhCKqU015r+n4sVEHS6gVIGvoSAjxxWq0zAUAI8n+AO14k3HGl23rDCNVGMYgSQsH9e+S27cmLpZ/MSQ==',key_name='tempest-keypair-501617819',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5fc8bc5d1984c1c839a3ef7e30b9d36',ramdisk_id='',reservation_id='r-c3zv0nco',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1286552851',owner_user_name='tempest-ServerRescueNegativeTestJSON-1286552851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:01:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45c67299cd204090b9ebf7e0eb873e37',uuid=2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4edd294f-7bb5-46ec-9cdc-c8683088408c", "address": "fa:16:3e:44:0a:72", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4edd294f-7b", "ovs_interfaceid": "4edd294f-7bb5-46ec-9cdc-c8683088408c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:01:34.208791 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Converting VIF {"id": "4edd294f-7bb5-46ec-9cdc-c8683088408c", "address": "fa:16:3e:44:0a:72", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4edd294f-7b", "ovs_interfaceid": "4edd294f-7bb5-46ec-9cdc-c8683088408c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:01:34.209027 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:0a:72,bridge_name='br-int',has_traffic_filtering=True,id=4edd294f-7bb5-46ec-9cdc-c8683088408c,network=Network(729946be-b963-4dfb-ad38-335762a8666c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4edd294f-7b') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:01:34.211265 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:01:34.236046 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-86dc4c0a-573e-43ac-8410-5130cc8ff6f5 req-42ef8629-9608-4c89-ad81-3446fe28aee1 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:01:34.292822 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.107s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:34.294477 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:34.331737 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:34.348477 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk 1073741824" returned: 0 in 0.054s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:34.349419 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:34.350819 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:34.412154 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-92cf8e3e-7ea9-4425-a643-723676e4256a req-790ae658-bafc-4721-9d07-44f0faf49539 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:34.469372 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.119s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:34.469942 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:01:34.470743 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:34.502072 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-86dc4c0a-573e-43ac-8410-5130cc8ff6f5 req-42ef8629-9608-4c89-ad81-3446fe28aee1 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:01:34.546890 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Successfully updated port: bc674202-2354-4a2d-bdcf-3faf31e8cc7d {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:01:34.552221 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-92cf8e3e-7ea9-4425-a643-723676e4256a req-790ae658-bafc-4721-9d07-44f0faf49539 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:01:34.588636 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:34.589126 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Cannot resize image /opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:01:34.589403 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:01:34.589627 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Ensure instance console log exists: /opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:01:34.589945 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:34.590180 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:34.590362 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:34.656939 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-8ae71c91-4c81-4769-adcc-b6d17566fc7b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Detaching volume 3c045f01-4b5a-4f0c-86a0-8fc564914ff4
May 28 10:01:34.659695 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 3.151s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:34.659981 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Migrating
May 28 10:01:34.660061 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:01:34.660197 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquired lock "compute-rpcapi-router" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:01:34.720650 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] End _get_guest_xml xml=<domain type="qemu">
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:   <uuid>2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f</uuid>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:   <name>instance-0000001b</name>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1240965804</nova:name>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:01:34</nova:creationTime>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:         <nova:user uuid="45c67299cd204090b9ebf7e0eb873e37">tempest-ServerRescueNegativeTestJSON-1286552851-project-member</nova:user>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:         <nova:project uuid="f5fc8bc5d1984c1c839a3ef7e30b9d36">tempest-ServerRescueNegativeTestJSON-1286552851</nova:project>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:         <nova:port uuid="4edd294f-7bb5-46ec-9cdc-c8683088408c">
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:     <system>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:       <entry name="serial">2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f</entry>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:       <entry name="uuid">2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f</entry>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:     </system>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:   <os>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:   </os>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:   <features>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:   </features>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:   <devices>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f/disk"/>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:     </disk>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f/disk.config"/>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:     </disk>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:44:0a:72"/>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:       <target dev="tap4edd294f-7b"/>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:     </interface>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f/console.log" append="off"/>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:     </serial>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:     <video>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:     </video>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:     </rng>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:   </devices>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]: </domain>
May 28 10:01:34.720650 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:01:34.725032 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Preparing to wait for external event network-vif-plugged-4edd294f-7bb5-46ec-9cdc-c8683088408c {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:01:34.725032 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:34.725032 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:34.725032 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:34.725032 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:01:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1240965804',display_name='tempest-ServerRescueNegativeTestJSON-server-1240965804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serverrescuenegativetestjson-server-1240965804',id=27,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4cGw7X+Q2nx15R5jh2EKJ3VR+oUGPb5WmFwZPLNWg5EFnojPDhCKqU015r+n4sVEHS6gVIGvoSAjxxWq0zAUAI8n+AO14k3HGl23rDCNVGMYgSQsH9e+S27cmLpZ/MSQ==',key_name='tempest-keypair-501617819',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5fc8bc5d1984c1c839a3ef7e30b9d36',ramdisk_id='',reservation_id='r-c3zv0nco',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1286552851',owner_user_name='tempest-ServerRescueNegativeTestJSON-1286552851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:01:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45c67299cd204090b9ebf7e0eb873e37',uuid=2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4edd294f-7bb5-46ec-9cdc-c8683088408c", "address": "fa:16:3e:44:0a:72", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4edd294f-7b", "ovs_interfaceid": "4edd294f-7bb5-46ec-9cdc-c8683088408c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:01:34.725032 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Converting VIF {"id": "4edd294f-7bb5-46ec-9cdc-c8683088408c", "address": "fa:16:3e:44:0a:72", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4edd294f-7b", "ovs_interfaceid": "4edd294f-7bb5-46ec-9cdc-c8683088408c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:01:34.725032 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:0a:72,bridge_name='br-int',has_traffic_filtering=True,id=4edd294f-7bb5-46ec-9cdc-c8683088408c,network=Network(729946be-b963-4dfb-ad38-335762a8666c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4edd294f-7b') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:01:34.726738 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:0a:72,bridge_name='br-int',has_traffic_filtering=True,id=4edd294f-7bb5-46ec-9cdc-c8683088408c,network=Network(729946be-b963-4dfb-ad38-335762a8666c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4edd294f-7b') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:01:34.729931 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:34.730375 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:34.731732 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:01:34.733464 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-92cf8e3e-7ea9-4425-a643-723676e4256a req-790ae658-bafc-4721-9d07-44f0faf49539 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:01:34.736806 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:34.738179 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-8ae71c91-4c81-4769-adcc-b6d17566fc7b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Attempting to driver detach volume 3c045f01-4b5a-4f0c-86a0-8fc564914ff4 from mountpoint /dev/vdb
May 28 10:01:34.739098 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '12d4cd08-c267-5337-b621-ea7719261e33', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:34.740098 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:34.741078 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:01:34.743461 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:34.747645 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:34.747774 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4edd294f-7b, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:34.748133 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4edd294f-7b, col_values=(('qos', UUID('c274c212-dace-4443-b391-8bd546b819db')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:34.748715 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4edd294f-7b, col_values=(('external_ids', {'iface-id': '4edd294f-7bb5-46ec-9cdc-c8683088408c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:0a:72', 'vm-uuid': '2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:34.749934 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:34.750778 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8ae71c91-4c81-4769-adcc-b6d17566fc7b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Found disk vdb by alias ua-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:01:34.752617 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:01:34.754302 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8ae71c91-4c81-4769-adcc-b6d17566fc7b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Found disk vdb by alias ua-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:01:34.754450 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8ae71c91-4c81-4769-adcc-b6d17566fc7b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Attempting to detach device vdb from instance b50eced2-71bf-4448-b2e1-f9657509f34c from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 10:01:34.754742 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-8ae71c91-4c81-4769-adcc-b6d17566fc7b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:01:34.754742 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:01:34.754742 np0000001613 nova-compute[98321]:   <alias name="ua-3c045f01-4b5a-4f0c-86a0-8fc564914ff4"/>
May 28 10:01:34.754742 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-9"/>
May 28 10:01:34.754742 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:01:34.754742 np0000001613 nova-compute[98321]:   <serial>3c045f01-4b5a-4f0c-86a0-8fc564914ff4</serial>
May 28 10:01:34.754742 np0000001613 nova-compute[98321]:   <shareable/>
May 28 10:01:34.754742 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:01:34.754742 np0000001613 nova-compute[98321]: </disk>
May 28 10:01:34.754742 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:01:34.758455 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:34.758455 np0000001613 nova-compute[98321]: INFO os_vif [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:0a:72,bridge_name='br-int',has_traffic_filtering=True,id=4edd294f-7bb5-46ec-9cdc-c8683088408c,network=Network(729946be-b963-4dfb-ad38-335762a8666c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4edd294f-7b')
May 28 10:01:34.766836 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-8ae71c91-4c81-4769-adcc-b6d17566fc7b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Successfully detached device vdb from instance b50eced2-71bf-4448-b2e1-f9657509f34c from the persistent domain config.
May 28 10:01:34.767034 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8ae71c91-4c81-4769-adcc-b6d17566fc7b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] (1/8): Attempting to detach device vdb with device alias ua-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 from instance b50eced2-71bf-4448-b2e1-f9657509f34c from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 10:01:34.767425 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-8ae71c91-4c81-4769-adcc-b6d17566fc7b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:01:34.767425 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:01:34.767425 np0000001613 nova-compute[98321]:   <alias name="ua-3c045f01-4b5a-4f0c-86a0-8fc564914ff4"/>
May 28 10:01:34.767425 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-9"/>
May 28 10:01:34.767425 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:01:34.767425 np0000001613 nova-compute[98321]:   <serial>3c045f01-4b5a-4f0c-86a0-8fc564914ff4</serial>
May 28 10:01:34.767425 np0000001613 nova-compute[98321]:   <shareable/>
May 28 10:01:34.767425 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:01:34.767425 np0000001613 nova-compute[98321]: </disk>
May 28 10:01:34.767425 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:01:34.947899 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:01:35.008702 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-86dc4c0a-573e-43ac-8410-5130cc8ff6f5 req-42ef8629-9608-4c89-ad81-3446fe28aee1 service nova] Releasing lock "refresh_cache-4baa35bb-b237-42be-aa8b-d9eeed7e41a0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:01:35.009319 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Acquired lock "refresh_cache-4baa35bb-b237-42be-aa8b-d9eeed7e41a0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:01:35.009525 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:01:35.041561 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b0b9df43-b531-40dc-bc6a-868ef5215bf1 req-15f420dd-a62e-4b88-8ad4-666fffa9f403 service nova] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Received event network-vif-unplugged-b5ee2b20-4839-4467-aa06-cd09a19252bf {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:35.042329 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b0b9df43-b531-40dc-bc6a-868ef5215bf1 req-15f420dd-a62e-4b88-8ad4-666fffa9f403 service nova] Acquiring lock "f9fd8989-d182-47e4-9409-266a1440bf58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:35.042568 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b0b9df43-b531-40dc-bc6a-868ef5215bf1 req-15f420dd-a62e-4b88-8ad4-666fffa9f403 service nova] Lock "f9fd8989-d182-47e4-9409-266a1440bf58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:35.042770 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b0b9df43-b531-40dc-bc6a-868ef5215bf1 req-15f420dd-a62e-4b88-8ad4-666fffa9f403 service nova] Lock "f9fd8989-d182-47e4-9409-266a1440bf58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:35.042937 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b0b9df43-b531-40dc-bc6a-868ef5215bf1 req-15f420dd-a62e-4b88-8ad4-666fffa9f403 service nova] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] No waiting events found dispatching network-vif-unplugged-b5ee2b20-4839-4467-aa06-cd09a19252bf {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:01:35.043176 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b0b9df43-b531-40dc-bc6a-868ef5215bf1 req-15f420dd-a62e-4b88-8ad4-666fffa9f403 service nova] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Received event network-vif-unplugged-b5ee2b20-4839-4467-aa06-cd09a19252bf for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:01:35.043220 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b0b9df43-b531-40dc-bc6a-868ef5215bf1 req-15f420dd-a62e-4b88-8ad4-666fffa9f403 service nova] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Received event network-vif-deleted-b5ee2b20-4839-4467-aa06-cd09a19252bf {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:35.163242 np0000001613 nova-compute[98321]: INFO nova.compute.rpcapi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Automatically selected compute RPC version 6.5 from minimum service version 72
May 28 10:01:35.163915 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Releasing lock "compute-rpcapi-router" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:01:35.164122 np0000001613 nova-compute[98321]: DEBUG nova.compute.rpcapi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98321) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 10:01:35.238619 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-92cf8e3e-7ea9-4425-a643-723676e4256a req-790ae658-bafc-4721-9d07-44f0faf49539 service nova] Releasing lock "refresh_cache-03313f66-d1dd-4269-b2e9-3b0796217299" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:01:35.239018 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-92cf8e3e-7ea9-4425-a643-723676e4256a req-790ae658-bafc-4721-9d07-44f0faf49539 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-changed-fd18fd3a-9dc5-4433-a638-72e5586eeb9c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:35.239199 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-92cf8e3e-7ea9-4425-a643-723676e4256a req-790ae658-bafc-4721-9d07-44f0faf49539 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Refreshing instance network info cache due to event network-changed-fd18fd3a-9dc5-4433-a638-72e5586eeb9c. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:01:35.239396 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-92cf8e3e-7ea9-4425-a643-723676e4256a req-790ae658-bafc-4721-9d07-44f0faf49539 service nova] Acquiring lock "refresh_cache-03313f66-d1dd-4269-b2e9-3b0796217299" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:01:35.239536 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-92cf8e3e-7ea9-4425-a643-723676e4256a req-790ae658-bafc-4721-9d07-44f0faf49539 service nova] Acquired lock "refresh_cache-03313f66-d1dd-4269-b2e9-3b0796217299" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:01:35.239716 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-92cf8e3e-7ea9-4425-a643-723676e4256a req-790ae658-bafc-4721-9d07-44f0faf49539 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Refreshing network info cache for port fd18fd3a-9dc5-4433-a638-72e5586eeb9c {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:01:35.442990 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779962495.4426508, b50eced2-71bf-4448-b2e1-f9657509f34c => ua-3c045f01-4b5a-4f0c-86a0-8fc564914ff4> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 10:01:35.444308 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8ae71c91-4c81-4769-adcc-b6d17566fc7b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 for instance b50eced2-71bf-4448-b2e1-f9657509f34c {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 10:01:35.447967 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-8ae71c91-4c81-4769-adcc-b6d17566fc7b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Successfully detached device vdb from instance b50eced2-71bf-4448-b2e1-f9657509f34c from the live domain config.
May 28 10:01:35.450728 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Took 1.69 seconds to deallocate network for instance.
May 28 10:01:35.648175 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:01:35.667318 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d5fde12a-c9e6-43ea-99b2-b0c76170071c req-aee8a142-dd45-4039-a2cc-67e3080c650d service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-changed-bc674202-2354-4a2d-bdcf-3faf31e8cc7d {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:35.667515 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d5fde12a-c9e6-43ea-99b2-b0c76170071c req-aee8a142-dd45-4039-a2cc-67e3080c650d service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Refreshing instance network info cache due to event network-changed-bc674202-2354-4a2d-bdcf-3faf31e8cc7d. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:01:35.667681 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d5fde12a-c9e6-43ea-99b2-b0c76170071c req-aee8a142-dd45-4039-a2cc-67e3080c650d service nova] Acquiring lock "refresh_cache-03313f66-d1dd-4269-b2e9-3b0796217299" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:01:35.679841 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Successfully updated port: d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:01:35.681208 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "refresh_cache-49f53c82-6f7e-4d09-a471-26bd4fdc02e7" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:01:35.681469 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquired lock "refresh_cache-49f53c82-6f7e-4d09-a471-26bd4fdc02e7" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:01:35.681710 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:01:35.742213 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-92cf8e3e-7ea9-4425-a643-723676e4256a req-790ae658-bafc-4721-9d07-44f0faf49539 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:35.826254 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-92cf8e3e-7ea9-4425-a643-723676e4256a req-790ae658-bafc-4721-9d07-44f0faf49539 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:01:35.839539 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:35.963008 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc7ac689-18bc-43f0-9ae1-df0310253d07 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:35.963240 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc7ac689-18bc-43f0-9ae1-df0310253d07 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:35.997623 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-8ae71c91-4c81-4769-adcc-b6d17566fc7b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Detected multiple connections on this host for volume: 3c045f01-4b5a-4f0c-86a0-8fc564914ff4, skipping target disconnect.
May 28 10:01:36.039205 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Updating instance_info_cache with network_info: [{"id": "a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39", "address": "fa:16:3e:05:9e:a2", "network": {"id": "2b7ff7fb-07d6-4791-9553-cb0a7a073e10", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2104350241-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12b4f42e155347e4a2055b151f04390a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f414a0-04", "ovs_interfaceid": "a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:01:36.055827 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-92cf8e3e-7ea9-4425-a643-723676e4256a req-790ae658-bafc-4721-9d07-44f0faf49539 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:01:36.183554 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Acquiring lock "refresh_cache-03313f66-d1dd-4269-b2e9-3b0796217299" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:01:36.188305 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:36.278913 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:01:36.279111 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:01:36.279317 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] No VIF found with MAC fa:16:3e:44:0a:72, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:01:36.281309 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Using config drive
May 28 10:01:36.425233 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Acquiring lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:36.425371 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:36.545117 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Releasing lock "refresh_cache-4baa35bb-b237-42be-aa8b-d9eeed7e41a0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:01:36.546195 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Instance network_info: |[{"id": "a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39", "address": "fa:16:3e:05:9e:a2", "network": {"id": "2b7ff7fb-07d6-4791-9553-cb0a7a073e10", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2104350241-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12b4f42e155347e4a2055b151f04390a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f414a0-04", "ovs_interfaceid": "a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:01:36.551410 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Start _get_guest_xml network_info=[{"id": "a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39", "address": "fa:16:3e:05:9e:a2", "network": {"id": "2b7ff7fb-07d6-4791-9553-cb0a7a073e10", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2104350241-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12b4f42e155347e4a2055b151f04390a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f414a0-04", "ovs_interfaceid": "a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:01:36.559812 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:01:36.561446 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-445999024', uuid='4baa35bb-b237-42be-aa8b-d9eeed7e41a0'), owner=OwnerMeta(userid='8f33df1d85634228ba269922d1f23be0', username='tempest-ServerStableDeviceRescueTest-2062770061-project-member', projectid='12b4f42e155347e4a2055b151f04390a', projectname='tempest-ServerStableDeviceRescueTest-2062770061'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39", "address": "fa:16:3e:05:9e:a2", "network": {"id": "2b7ff7fb-07d6-4791-9553-cb0a7a073e10", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2104350241-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12b4f42e155347e4a2055b151f04390a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f414a0-04", "ovs_interfaceid": "a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962496.5609207) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:01:36.563699 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-92cf8e3e-7ea9-4425-a643-723676e4256a req-790ae658-bafc-4721-9d07-44f0faf49539 service nova] Releasing lock "refresh_cache-03313f66-d1dd-4269-b2e9-3b0796217299" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:01:36.564515 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d5fde12a-c9e6-43ea-99b2-b0c76170071c req-aee8a142-dd45-4039-a2cc-67e3080c650d service nova] Acquired lock "refresh_cache-03313f66-d1dd-4269-b2e9-3b0796217299" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:01:36.564515 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-d5fde12a-c9e6-43ea-99b2-b0c76170071c req-aee8a142-dd45-4039-a2cc-67e3080c650d service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Refreshing network info cache for port bc674202-2354-4a2d-bdcf-3faf31e8cc7d {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:01:36.567540 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:01:36.568891 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:01:36.573831 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:01:36.575017 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:01:36.575460 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:01:36.576398 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:01:36.576398 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:01:36.576398 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:01:36.576398 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:01:36.576718 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:01:36.576718 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:01:36.576940 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:01:36.576940 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:01:36.577023 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:01:36.577236 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:01:36.578748 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:01:36.591545 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-8ae71c91-4c81-4769-adcc-b6d17566fc7b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lazy-loading 'flavor' on Instance uuid b50eced2-71bf-4448-b2e1-f9657509f34c {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:01:36.617356 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:01:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-445999024',display_name='tempest-ServerStableDeviceRescueTest-server-445999024',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serverstabledevicerescuetest-server-445999024',id=28,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHYEtJPZFtEAxWytQRE0q9ojBtsXp8sLSsdVhH0fWy0OH7NIWqXHiL4IKGra0wQLgHSM0O03o37kQJrxR0gIvqWp6aM3ftiLSmbak4otJmNefvORIwdb0k3Y0ZFuCp+DA==',key_name='tempest-keypair-325561194',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12b4f42e155347e4a2055b151f04390a',ramdisk_id='',reservation_id='r-acgw6178',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2062770061',owner_user_name='tempest-ServerStableDeviceRescueTest-2062770061-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:01:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f33df1d85634228ba269922d1f23be0',uuid=4baa35bb-b237-42be-aa8b-d9eeed7e41a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39", "address": "fa:16:3e:05:9e:a2", "network": {"id": "2b7ff7fb-07d6-4791-9553-cb0a7a073e10", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2104350241-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12b4f42e155347e4a2055b151f04390a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f414a0-04", "ovs_interfaceid": "a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:01:36.617646 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Converting VIF {"id": "a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39", "address": "fa:16:3e:05:9e:a2", "network": {"id": "2b7ff7fb-07d6-4791-9553-cb0a7a073e10", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2104350241-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12b4f42e155347e4a2055b151f04390a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f414a0-04", "ovs_interfaceid": "a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:01:36.618373 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:9e:a2,bridge_name='br-int',has_traffic_filtering=True,id=a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39,network=Network(2b7ff7fb-07d6-4791-9553-cb0a7a073e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4f414a0-04') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:01:36.621765 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lazy-loading 'pci_devices' on Instance uuid 4baa35bb-b237-42be-aa8b-d9eeed7e41a0 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:01:36.691584 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:36.790976 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:36.925896 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Updating instance_info_cache with network_info: [{"id": "55556967-1d07-4f3b-bc07-6692ef9de17b", "address": "fa:16:3e:d2:27:b6", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55556967-1d", "ovs_interfaceid": "55556967-1d07-4f3b-bc07-6692ef9de17b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:01:36.935525 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lazy-loading 'flavor' on Instance uuid b90b1ecd-e640-4f4e-bd02-fb74021db82b {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:01:36.994602 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bc7ac689-18bc-43f0-9ae1-df0310253d07 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:01:36.995058 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-bc7ac689-18bc-43f0-9ae1-df0310253d07 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:01:37.021416 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Creating config drive at /opt/stack/data/nova/instances/2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f/disk.config
May 28 10:01:37.026971 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwzq5g72v {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:37.068971 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-d5fde12a-c9e6-43ea-99b2-b0c76170071c req-aee8a142-dd45-4039-a2cc-67e3080c650d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:37.078251 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwzq5g72v" returned: 0 in 0.049s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:37.133316 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] End _get_guest_xml xml=<domain type="qemu">
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:   <uuid>4baa35bb-b237-42be-aa8b-d9eeed7e41a0</uuid>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:   <name>instance-0000001c</name>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-445999024</nova:name>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:01:36</nova:creationTime>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:         <nova:user uuid="8f33df1d85634228ba269922d1f23be0">tempest-ServerStableDeviceRescueTest-2062770061-project-member</nova:user>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:         <nova:project uuid="12b4f42e155347e4a2055b151f04390a">tempest-ServerStableDeviceRescueTest-2062770061</nova:project>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:         <nova:port uuid="a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39">
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:     <system>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:       <entry name="serial">4baa35bb-b237-42be-aa8b-d9eeed7e41a0</entry>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:       <entry name="uuid">4baa35bb-b237-42be-aa8b-d9eeed7e41a0</entry>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:     </system>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:   <os>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:   </os>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:   <features>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:   </features>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:   <devices>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk"/>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:     </disk>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk.config"/>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:     </disk>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:05:9e:a2"/>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:       <target dev="tapa4f414a0-04"/>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:     </interface>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/console.log" append="off"/>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:     </serial>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:     <video>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:     </video>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:     </rng>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:   </devices>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]: </domain>
May 28 10:01:37.133316 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:01:37.146881 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Preparing to wait for external event network-vif-plugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:01:37.146881 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Acquiring lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:37.146881 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:37.147148 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:37.148752 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:01:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-445999024',display_name='tempest-ServerStableDeviceRescueTest-server-445999024',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serverstabledevicerescuetest-server-445999024',id=28,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHYEtJPZFtEAxWytQRE0q9ojBtsXp8sLSsdVhH0fWy0OH7NIWqXHiL4IKGra0wQLgHSM0O03o37kQJrxR0gIvqWp6aM3ftiLSmbak4otJmNefvORIwdb0k3Y0ZFuCp+DA==',key_name='tempest-keypair-325561194',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12b4f42e155347e4a2055b151f04390a',ramdisk_id='',reservation_id='r-acgw6178',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2062770061',owner_user_name='tempest-ServerStableDeviceRescueTest-2062770061-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:01:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f33df1d85634228ba269922d1f23be0',uuid=4baa35bb-b237-42be-aa8b-d9eeed7e41a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39", "address": "fa:16:3e:05:9e:a2", "network": {"id": "2b7ff7fb-07d6-4791-9553-cb0a7a073e10", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2104350241-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12b4f42e155347e4a2055b151f04390a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f414a0-04", "ovs_interfaceid": "a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:01:37.148940 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Converting VIF {"id": "a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39", "address": "fa:16:3e:05:9e:a2", "network": {"id": "2b7ff7fb-07d6-4791-9553-cb0a7a073e10", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2104350241-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12b4f42e155347e4a2055b151f04390a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f414a0-04", "ovs_interfaceid": "a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:01:37.151958 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:9e:a2,bridge_name='br-int',has_traffic_filtering=True,id=a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39,network=Network(2b7ff7fb-07d6-4791-9553-cb0a7a073e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4f414a0-04') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:01:37.153394 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:9e:a2,bridge_name='br-int',has_traffic_filtering=True,id=a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39,network=Network(2b7ff7fb-07d6-4791-9553-cb0a7a073e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4f414a0-04') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:01:37.155363 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:37.155363 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:37.156384 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:01:37.159088 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:37.159351 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ccf9c897-bde8-5d92-abf5-2c60d61d68d9', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:37.164205 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:01:37.168321 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:37.171204 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:37.171204 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4f414a0-04, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:37.171880 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa4f414a0-04, col_values=(('qos', UUID('0d2f012a-acea-4f0b-a7e8-d7a5c1d797c5')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:37.172096 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa4f414a0-04, col_values=(('external_ids', {'iface-id': 'a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:9e:a2', 'vm-uuid': '4baa35bb-b237-42be-aa8b-d9eeed7e41a0'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:37.174698 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:37.174698 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:01:37.186877 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:37.187521 np0000001613 nova-compute[98321]: INFO os_vif [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:9e:a2,bridge_name='br-int',has_traffic_filtering=True,id=a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39,network=Network(2b7ff7fb-07d6-4791-9553-cb0a7a073e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4f414a0-04')
May 28 10:01:37.205315 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-d5fde12a-c9e6-43ea-99b2-b0c76170071c req-aee8a142-dd45-4039-a2cc-67e3080c650d service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:01:37.413805 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-d5fde12a-c9e6-43ea-99b2-b0c76170071c req-aee8a142-dd45-4039-a2cc-67e3080c650d service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:01:37.427969 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Releasing lock "refresh_cache-49f53c82-6f7e-4d09-a471-26bd4fdc02e7" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:01:37.498389 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-bc7ac689-18bc-43f0-9ae1-df0310253d07 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:01:37.614755 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:37.644112 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8ae71c91-4c81-4769-adcc-b6d17566fc7b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "b50eced2-71bf-4448-b2e1-f9657509f34c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.521s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:37.658342 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:37.759840 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:37.763671 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-155b9d68-d894-406a-bfc8-c6757dd83a33 req-76c9342a-1f0a-4bbf-97d4-795dc7fb9cb8 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-changed-d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:37.763671 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-155b9d68-d894-406a-bfc8-c6757dd83a33 req-76c9342a-1f0a-4bbf-97d4-795dc7fb9cb8 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Refreshing instance network info cache due to event network-changed-d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:01:37.763671 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-155b9d68-d894-406a-bfc8-c6757dd83a33 req-76c9342a-1f0a-4bbf-97d4-795dc7fb9cb8 service nova] Acquiring lock "refresh_cache-03313f66-d1dd-4269-b2e9-3b0796217299" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:01:37.763671 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "3edc00a8-2c60-4c44-acb8-6f4d02114bf0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:37.763859 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "3edc00a8-2c60-4c44-acb8-6f4d02114bf0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:37.823473 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:37.830441 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:37.917645 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d5fde12a-c9e6-43ea-99b2-b0c76170071c req-aee8a142-dd45-4039-a2cc-67e3080c650d service nova] Releasing lock "refresh_cache-03313f66-d1dd-4269-b2e9-3b0796217299" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:01:37.917645 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Acquired lock "refresh_cache-03313f66-d1dd-4269-b2e9-3b0796217299" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:01:37.917645 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:01:37.945130 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.520s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:38.006101 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc7ac689-18bc-43f0-9ae1-df0310253d07 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.043s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:38.097887 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-bc7ac689-18bc-43f0-9ae1-df0310253d07 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Deleted allocations for instance f9fd8989-d182-47e4-9409-266a1440bf58
May 28 10:01:38.269150 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Detaching volume 3c045f01-4b5a-4f0c-86a0-8fc564914ff4
May 28 10:01:38.324320 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Attempting to driver detach volume 3c045f01-4b5a-4f0c-86a0-8fc564914ff4 from mountpoint /dev/vdb
May 28 10:01:38.333539 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Found disk vdb by alias ua-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:01:38.335527 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Found disk vdb by alias ua-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:01:38.335728 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Attempting to detach device vdb from instance 3edc00a8-2c60-4c44-acb8-6f4d02114bf0 from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 10:01:38.337769 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:01:38.337769 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:01:38.337769 np0000001613 nova-compute[98321]:   <alias name="ua-3c045f01-4b5a-4f0c-86a0-8fc564914ff4"/>
May 28 10:01:38.337769 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-9"/>
May 28 10:01:38.337769 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:01:38.337769 np0000001613 nova-compute[98321]:   <serial>3c045f01-4b5a-4f0c-86a0-8fc564914ff4</serial>
May 28 10:01:38.337769 np0000001613 nova-compute[98321]:   <shareable/>
May 28 10:01:38.337769 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:01:38.337769 np0000001613 nova-compute[98321]: </disk>
May 28 10:01:38.337769 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:01:38.350064 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Successfully detached device vdb from instance 3edc00a8-2c60-4c44-acb8-6f4d02114bf0 from the persistent domain config.
May 28 10:01:38.350379 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] (1/8): Attempting to detach device vdb with device alias ua-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 from instance 3edc00a8-2c60-4c44-acb8-6f4d02114bf0 from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 10:01:38.350811 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:01:38.350811 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:01:38.350811 np0000001613 nova-compute[98321]:   <alias name="ua-3c045f01-4b5a-4f0c-86a0-8fc564914ff4"/>
May 28 10:01:38.350811 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-9"/>
May 28 10:01:38.350811 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:01:38.350811 np0000001613 nova-compute[98321]:   <serial>3c045f01-4b5a-4f0c-86a0-8fc564914ff4</serial>
May 28 10:01:38.350811 np0000001613 nova-compute[98321]:   <shareable/>
May 28 10:01:38.350811 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:01:38.350811 np0000001613 nova-compute[98321]: </disk>
May 28 10:01:38.350811 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:01:38.524908 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:01:38.622772 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962498.6223402, 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:01:38.623048 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] VM Started (Lifecycle Event)
May 28 10:01:38.711918 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:01:38.712079 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:01:38.712230 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] No VIF found with MAC fa:16:3e:05:9e:a2, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:01:38.712812 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Using config drive
May 28 10:01:38.766064 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:38.953192 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Starting migrate_disk_and_power_off {{(pid=98321) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 28 10:01:38.982045 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:38.988279 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:39.008379 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:39.032809 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Acquiring lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:39.033077 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:39.034423 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Attaching volume 305d8623-c6f8-456c-83ed-46d06c6de0ea to /dev/vdb
May 28 10:01:39.100681 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:01:39.111766 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc7ac689-18bc-43f0-9ae1-df0310253d07 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "f9fd8989-d182-47e4-9409-266a1440bf58" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.312s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:39.113037 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:01:39.126365 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:01:39.133135 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962499.1327724, 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:01:39.133366 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] VM Paused (Lifecycle Event)
May 28 10:01:39.144784 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:39.178193 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:39.184339 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:39.189394 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:39.198674 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:01:39.198976 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:01:39.212614 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:01:39.214248 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe2d:94a4', 'fe80::2844:59ff:feec:5d21', 'fe80::fc16:3eff:fefd:30e7', 'fe80::e4df:c0ff:fe86:6341', 'fe80::ce2:7bff:fe0e:d096', 'fe80::fc16:3eff:fedb:1077', 'fe80::fc16:3eff:fee0:9ccd', 'fe80::fc16:3eff:feb1:88d2', 'fe80::843b:b2ff:fe26:76a', 'fe80::fc16:3eff:fe15:4154', 'fe80::605f:aaff:fe8d:fcdd', 'fe80::fc16:3eff:fe3c:b7e1', 'fe80::fc16:3eff:fe86:604b', 'fe80::fc16:3eff:fe44:a72'] 
May 28 10:01:39.214665 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:01:39.214665 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:01:39.214851 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:01:39.216186 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Updating existing volume attachment record: 58179798-856a-487e-923a-b75ead14d816 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:01:39.227723 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:39.262018 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2153d7a5-589e-462d-8b21-7fdcf5119aff req-a53ddea0-8bad-4503-a126-826db9e90535 service nova] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Received event network-vif-unplugged-55556967-1d07-4f3b-bc07-6692ef9de17b {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:39.262018 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2153d7a5-589e-462d-8b21-7fdcf5119aff req-a53ddea0-8bad-4503-a126-826db9e90535 service nova] Acquiring lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:39.263736 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2153d7a5-589e-462d-8b21-7fdcf5119aff req-a53ddea0-8bad-4503-a126-826db9e90535 service nova] Lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:39.263736 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2153d7a5-589e-462d-8b21-7fdcf5119aff req-a53ddea0-8bad-4503-a126-826db9e90535 service nova] Lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:39.263736 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2153d7a5-589e-462d-8b21-7fdcf5119aff req-a53ddea0-8bad-4503-a126-826db9e90535 service nova] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] No waiting events found dispatching network-vif-unplugged-55556967-1d07-4f3b-bc07-6692ef9de17b {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:01:39.263736 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-2153d7a5-589e-462d-8b21-7fdcf5119aff req-a53ddea0-8bad-4503-a126-826db9e90535 service nova] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Received unexpected event network-vif-unplugged-55556967-1d07-4f3b-bc07-6692ef9de17b for instance with vm_state active and task_state resize_migrating.
May 28 10:01:39.320141 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Instance destroyed successfully.
May 28 10:01:39.322212 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:01:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1421682824',display_name='tempest-ServerActionsTestOtherA-server-1421682824',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serveractionstestothera-server-1421682824',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLNPaTs6CM9Wbie8XPRW8vQPbkYzxhmauw/kdujNoZe8MNOaDeh6K3tCu7L1IAoOGDytj5meJ0gvP/71uSisLwWlqhLyhBtEZHSZo7u74E1cepcGRGEWdNqJct6TYM6oQ==',key_name='tempest-keypair-320562480',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:01:22Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cb3a501b4f4041ef875ef4d2b4167044',ramdisk_id='',reservation_id='r-a0c5gebp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1557455944',owner_user_name='tempest-ServerActionsTestOtherA-1557455944-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:01:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62efa57da85f458790f3ceeebcc777a7',uuid=49f53c82-6f7e-4d09-a471-26bd4fdc02e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55556967-1d07-4f3b-bc07-6692ef9de17b", "address": "fa:16:3e:d2:27:b6", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1771401192-network", "vif_mac": "fa:16:3e:d2:27:b6"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55556967-1d", "ovs_interfaceid": "55556967-1d07-4f3b-bc07-6692ef9de17b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:01:39.322212 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Converting VIF {"id": "55556967-1d07-4f3b-bc07-6692ef9de17b", "address": "fa:16:3e:d2:27:b6", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1771401192-network", "vif_mac": "fa:16:3e:d2:27:b6"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55556967-1d", "ovs_interfaceid": "55556967-1d07-4f3b-bc07-6692ef9de17b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:01:39.322599 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:27:b6,bridge_name='br-int',has_traffic_filtering=True,id=55556967-1d07-4f3b-bc07-6692ef9de17b,network=Network(2ae47a43-582b-442f-922d-fe7138b431a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55556967-1d') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:01:39.323037 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:27:b6,bridge_name='br-int',has_traffic_filtering=True,id=55556967-1d07-4f3b-bc07-6692ef9de17b,network=Network(2ae47a43-582b-442f-922d-fe7138b431a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55556967-1d') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:01:39.328200 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:39.328652 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap55556967-1d, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:39.336474 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:01:39.343662 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:39.351187 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:39.351187 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=73116af2-5340-4e75-b4cf-2be8a054fa13) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:39.351187 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:39.351187 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:01:39.356009 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:39.359684 np0000001613 nova-compute[98321]: INFO os_vif [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:27:b6,bridge_name='br-int',has_traffic_filtering=True,id=55556967-1d07-4f3b-bc07-6692ef9de17b,network=Network(2ae47a43-582b-442f-922d-fe7138b431a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55556967-1d')
May 28 10:01:39.365517 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:01:39.367241 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c1f00235-beec-448a-ae55-17b46aa31e9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:01:39.368051 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:01:39.368692 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:01:39.369093 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c1f00235-beec-448a-ae55-17b46aa31e9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:01:39.369272 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:01:39.413201 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:39.413201 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:39.413201 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:39.413201 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:39.413201 np0000001613 nova-compute[98321]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:39.413201 np0000001613 nova-compute[98321]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:39.413201 np0000001613 nova-compute[98321]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:39.413201 np0000001613 nova-compute[98321]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:39.413201 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:01:39.413201 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:39.413201 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:39.413201 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:39.413201 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:39.413201 np0000001613 nova-compute[98321]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:39.413201 np0000001613 nova-compute[98321]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:39.413201 np0000001613 nova-compute[98321]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:39.413201 np0000001613 nova-compute[98321]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:39.413201 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:01:39.413201 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', '36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4', '38')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:01:39.416218 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', '35')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:01:39.416218 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', '36')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:01:39.416457 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc342020>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b'): ({'sde'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:01:39.416675 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Removing multipathed devices sdd, sde {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:01:39.416871 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Flush multipath device 3300000001cad31b7 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:01:39.467438 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:01:39.495862 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Creating config drive at /opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk.config
May 28 10:01:39.503942 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjw3zi2am {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:39.525351 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:01:39.564740 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjw3zi2am" returned: 0 in 0.061s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:39.586536 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:01:39.586832 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:01:39.588481 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:01:39.599282 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:01:39.599731 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:01:39.620098 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:39.639041 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:01:39.643538 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:01:39.654687 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:39.658493 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b, portal: 192.168.40.100,3260]
May 28 10:01:39.658493 np0000001613 nova-compute[98321]: Logout of [sid: 35, target: iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b, portal: 192.168.40.100,3260] successful.
May 28 10:01:39.658493 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:39.680554 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:39.697578 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:39.734607 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b, portal: 192.168.50.100,3260]
May 28 10:01:39.734607 np0000001613 nova-compute[98321]: Logout of [sid: 36, target: iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b, portal: 192.168.50.100,3260] successful.
May 28 10:01:39.734607 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:39.750947 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:39.751363 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:01:39.751648 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] <== disconnect_volume: return (383ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:01:39.751832 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:01:39.759868 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:01:39.760334 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/49f53c82-6f7e-4d09-a471-26bd4fdc02e7_resize/disk.config /opt/stack/data/nova/instances/49f53c82-6f7e-4d09-a471-26bd4fdc02e7/disk.config {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:39.805591 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] CMD "cp -r /opt/stack/data/nova/instances/49f53c82-6f7e-4d09-a471-26bd4fdc02e7_resize/disk.config /opt/stack/data/nova/instances/49f53c82-6f7e-4d09-a471-26bd4fdc02e7/disk.config" returned: 0 in 0.045s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:39.808806 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:01:39.809429 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '305d8623-c6f8-456c-83ed-46d06c6de0ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:01:39.809677 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:01:39.812177 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:01:39.812516 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '305d8623-c6f8-456c-83ed-46d06c6de0ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:01:39.828752 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:01:39.830092 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:01:39.833548 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:01:39.835541 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:01:39.835541 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:01:39.835541 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:01:39.847414 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:01:39.847414 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:39.854403 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:01:39.854403 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:39.863067 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6bf904e0-29e7-4f88-ac7c-4d8da662ef50 req-f700f3cd-522a-4410-a74d-280313bad8b3 service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Received event network-vif-plugged-4edd294f-7bb5-46ec-9cdc-c8683088408c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:39.863338 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6bf904e0-29e7-4f88-ac7c-4d8da662ef50 req-f700f3cd-522a-4410-a74d-280313bad8b3 service nova] Acquiring lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:39.863544 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6bf904e0-29e7-4f88-ac7c-4d8da662ef50 req-f700f3cd-522a-4410-a74d-280313bad8b3 service nova] Lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:39.863761 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6bf904e0-29e7-4f88-ac7c-4d8da662ef50 req-f700f3cd-522a-4410-a74d-280313bad8b3 service nova] Lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:39.863901 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6bf904e0-29e7-4f88-ac7c-4d8da662ef50 req-f700f3cd-522a-4410-a74d-280313bad8b3 service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Processing event network-vif-plugged-4edd294f-7bb5-46ec-9cdc-c8683088408c {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:01:39.864079 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6bf904e0-29e7-4f88-ac7c-4d8da662ef50 req-f700f3cd-522a-4410-a74d-280313bad8b3 service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Received event network-vif-plugged-4edd294f-7bb5-46ec-9cdc-c8683088408c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:39.864283 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6bf904e0-29e7-4f88-ac7c-4d8da662ef50 req-f700f3cd-522a-4410-a74d-280313bad8b3 service nova] Acquiring lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:39.864918 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea] added
May 28 10:01:39.864918 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:01:39.864918 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:01:39.864918 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:01:39.864918 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:01:39.864918 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:01:39.864918 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:39.866125 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6bf904e0-29e7-4f88-ac7c-4d8da662ef50 req-f700f3cd-522a-4410-a74d-280313bad8b3 service nova] Lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:39.866125 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6bf904e0-29e7-4f88-ac7c-4d8da662ef50 req-f700f3cd-522a-4410-a74d-280313bad8b3 service nova] Lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:39.866596 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:01:39.868604 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea] added
May 28 10:01:39.868604 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:01:39.868604 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:01:39.868604 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:01:39.868604 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:01:39.868604 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:01:39.868604 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:39.868828 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:01:39.869122 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6bf904e0-29e7-4f88-ac7c-4d8da662ef50 req-f700f3cd-522a-4410-a74d-280313bad8b3 service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] No waiting events found dispatching network-vif-plugged-4edd294f-7bb5-46ec-9cdc-c8683088408c {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:01:39.869391 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0328(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:01:39.869713 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:01:39.870008 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:01:39.870540 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-6bf904e0-29e7-4f88-ac7c-4d8da662ef50 req-f700f3cd-522a-4410-a74d-280313bad8b3 service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Received unexpected event network-vif-plugged-4edd294f-7bb5-46ec-9cdc-c8683088408c for instance with vm_state building and task_state spawning.
May 28 10:01:39.870868 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0342(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:01:39.871091 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:01:39.877779 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:01:39.883281 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Instance spawned successfully.
May 28 10:01:39.883719 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:01:40.035633 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:40.095191 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:40.130846 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:40.134723 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:40.147331 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:01:40.151451 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.998833390999835 future=<Future at 0x73c205a67290 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:01:40.151901 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962500.1516182, 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:01:40.152254 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] VM Resumed (Lifecycle Event)
May 28 10:01:40.219361 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:40.393465 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:01:40.393596 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:01:40.393895 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:01:40.394147 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:01:40.394408 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:01:40.394677 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:01:40.490361 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:40.497253 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:40.499759 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:40.506725 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:40.527615 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:40.655485 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:01:40.662427 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:01:40.870271 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:01:40.871907 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:01:40.886262 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:01:40.886262 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:01:40.894632 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:01:40.894632 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:40.899375 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:40.901738 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:40.907536 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Took 10.11 seconds to spawn the instance on the hypervisor.
May 28 10:01:40.912383 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:40.913835 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:01:40.925197 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:40.925197 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:40.925197 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:40.925197 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:40.925197 np0000001613 nova-compute[98321]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:40.925197 np0000001613 nova-compute[98321]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:40.925197 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:01:40.925482 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:40.925482 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:40.925482 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:40.925482 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:40.925482 np0000001613 nova-compute[98321]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:40.925482 np0000001613 nova-compute[98321]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:40.925482 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:01:40.935739 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:40.935739 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:40.935739 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:40.935739 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:40.935739 np0000001613 nova-compute[98321]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:40.935739 np0000001613 nova-compute[98321]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:40.935739 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:01:40.940116 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:40.940116 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:40.940116 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:40.940116 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:40.940116 np0000001613 nova-compute[98321]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:40.940116 np0000001613 nova-compute[98321]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:40.940116 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:01:40.975019 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea, portal: 192.168.40.100,3260]
May 28 10:01:40.975019 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea, portal: 192.168.40.100,3260] successful.
May 28 10:01:40.975019 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:40.989610 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:40.994200 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:40.994337 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:40.999031 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea, portal: 192.168.50.100,3260]
May 28 10:01:40.999031 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea, portal: 192.168.50.100,3260] successful.
May 28 10:01:40.999031 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:41.016174 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:41.016174 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:41.016174 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:41.016174 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:41.016174 np0000001613 nova-compute[98321]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:41.016174 np0000001613 nova-compute[98321]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:41.016174 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:41.016174 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:41.016174 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:01:41.017090 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:41.017700 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:41.017700 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:41.017700 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:41.017700 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:41.017700 np0000001613 nova-compute[98321]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:41.017700 np0000001613 nova-compute[98321]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:41.017700 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:41.017700 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:41.017700 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:01:41.018412 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.185s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:01:41.019423 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:01:41.020300 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] HCTL ('9', '-', '-', 0) found on session 41 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:01:41.021668 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:01:41.044418 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Searching for a device in session 41 and hctl ['9', '*', '*', 0] yield: None {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:01:41.044418 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:41.044418 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:41.044418 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:41.044418 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:41.044418 np0000001613 nova-compute[98321]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:41.044418 np0000001613 nova-compute[98321]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:41.044418 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:41.044418 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:41.044418 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:01:41.044418 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:41.044418 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:41.044418 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:41.044418 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:41.044418 np0000001613 nova-compute[98321]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:41.044418 np0000001613 nova-compute[98321]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:41.044418 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:41.044418 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:41.044418 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:01:41.044418 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.209s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:01:41.044418 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:01:41.045623 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] HCTL ('10', '-', '-', 0) found on session 42 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:01:41.045789 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:01:41.064286 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Searching for a device in session 42 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:01:41.064286 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '305d8623-c6f8-456c-83ed-46d06c6de0ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:01:41.084942 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Port 55556967-1d07-4f3b-bc07-6692ef9de17b binding to destination host np0000001613 is already ACTIVE {{(pid=98321) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 28 10:01:41.167306 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:01:41.167306 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962501.166739, 4baa35bb-b237-42be-aa8b-d9eeed7e41a0 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:01:41.167306 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] VM Started (Lifecycle Event)
May 28 10:01:41.318397 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 for instance 3edc00a8-2c60-4c44-acb8-6f4d02114bf0 {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 10:01:41.330457 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:41.376584 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-13b49e7e-4d0b-4640-b28f-1458768d0c18 req-0065912b-c5aa-4bee-bfbd-413596318917 service nova] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Received event network-vif-unplugged-55556967-1d07-4f3b-bc07-6692ef9de17b {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:41.378062 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-13b49e7e-4d0b-4640-b28f-1458768d0c18 req-0065912b-c5aa-4bee-bfbd-413596318917 service nova] Acquiring lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:41.378312 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-13b49e7e-4d0b-4640-b28f-1458768d0c18 req-0065912b-c5aa-4bee-bfbd-413596318917 service nova] Lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:41.378527 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-13b49e7e-4d0b-4640-b28f-1458768d0c18 req-0065912b-c5aa-4bee-bfbd-413596318917 service nova] Lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:41.378715 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-13b49e7e-4d0b-4640-b28f-1458768d0c18 req-0065912b-c5aa-4bee-bfbd-413596318917 service nova] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] No waiting events found dispatching network-vif-unplugged-55556967-1d07-4f3b-bc07-6692ef9de17b {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:01:41.378935 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-13b49e7e-4d0b-4640-b28f-1458768d0c18 req-0065912b-c5aa-4bee-bfbd-413596318917 service nova] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Received unexpected event network-vif-unplugged-55556967-1d07-4f3b-bc07-6692ef9de17b for instance with vm_state active and task_state resize_migrating.
May 28 10:01:41.379025 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-13b49e7e-4d0b-4640-b28f-1458768d0c18 req-0065912b-c5aa-4bee-bfbd-413596318917 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Received event network-vif-plugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:41.379221 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-13b49e7e-4d0b-4640-b28f-1458768d0c18 req-0065912b-c5aa-4bee-bfbd-413596318917 service nova] Acquiring lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:41.379421 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-13b49e7e-4d0b-4640-b28f-1458768d0c18 req-0065912b-c5aa-4bee-bfbd-413596318917 service nova] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:41.379599 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-13b49e7e-4d0b-4640-b28f-1458768d0c18 req-0065912b-c5aa-4bee-bfbd-413596318917 service nova] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:41.379760 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-13b49e7e-4d0b-4640-b28f-1458768d0c18 req-0065912b-c5aa-4bee-bfbd-413596318917 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Processing event network-vif-plugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:01:41.379924 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-13b49e7e-4d0b-4640-b28f-1458768d0c18 req-0065912b-c5aa-4bee-bfbd-413596318917 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Received event network-vif-plugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:41.380087 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-13b49e7e-4d0b-4640-b28f-1458768d0c18 req-0065912b-c5aa-4bee-bfbd-413596318917 service nova] Acquiring lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:41.380273 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-13b49e7e-4d0b-4640-b28f-1458768d0c18 req-0065912b-c5aa-4bee-bfbd-413596318917 service nova] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:41.380417 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-13b49e7e-4d0b-4640-b28f-1458768d0c18 req-0065912b-c5aa-4bee-bfbd-413596318917 service nova] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:41.380574 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-13b49e7e-4d0b-4640-b28f-1458768d0c18 req-0065912b-c5aa-4bee-bfbd-413596318917 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] No waiting events found dispatching network-vif-plugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:01:41.380729 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-13b49e7e-4d0b-4640-b28f-1458768d0c18 req-0065912b-c5aa-4bee-bfbd-413596318917 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Received unexpected event network-vif-plugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 for instance with vm_state building and task_state spawning.
May 28 10:01:41.381630 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:01:41.385539 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:01:41.391374 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Instance spawned successfully.
May 28 10:01:41.391374 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:01:41.434953 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Took 16.25 seconds to build instance.
May 28 10:01:41.498624 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Updating instance_info_cache with network_info: [{"id": "12bb71f4-467b-4cc8-b164-f795401a0117", "address": "fa:16:3e:af:c7:36", "network": {"id": "1008534f-5c0f-4968-962e-d7e533fcc852", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1379747783-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12bb71f4-46", "ovs_interfaceid": "12bb71f4-467b-4cc8-b164-f795401a0117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f218cf2-d351-42a5-8b44-3e7ee9417bbd", "address": "fa:16:3e:24:b3:6a", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f218cf2-d3", "ovs_interfaceid": "9f218cf2-d351-42a5-8b44-3e7ee9417bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c2c9fb75-0a9e-47cb-a561-effaa19b4156", "address": "fa:16:3e:5d:f9:89", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c9fb75-0a", "ovs_interfaceid": "c2c9fb75-0a9e-47cb-a561-effaa19b4156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5", "address": "fa:16:3e:a3:f3:65", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7db2f4e-c4", "ovs_interfaceid": "d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd18fd3a-9dc5-4433-a638-72e5586eeb9c", "address": "fa:16:3e:e5:b9:aa", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd18fd3a-9d", "ovs_interfaceid": "fd18fd3a-9dc5-4433-a638-72e5586eeb9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bc674202-2354-4a2d-bdcf-3faf31e8cc7d", "address": "fa:16:3e:eb:2b:41", "network": {"id": "da83acc7-b5da-4d42-bd74-8a3a51d2f657", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377824470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc674202-23", "ovs_interfaceid": "bc674202-2354-4a2d-bdcf-3faf31e8cc7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44", "address": "fa:16:3e:d0:5a:e8", "network": {"id": "da83acc7-b5da-4d42-bd74-8a3a51d2f657", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377824470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd184f1f0-b1", "ovs_interfaceid": "d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:01:41.675701 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:01:41.679329 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:01:41.898053 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:01:41.898461 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:01:41.899026 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:01:41.899412 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:01:41.899855 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:01:41.900272 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:01:41.940881 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-98c0eb7e-8939-433e-afc5-74b3c13c6878 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.769s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:42.003027 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Releasing lock "refresh_cache-03313f66-d1dd-4269-b2e9-3b0796217299" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:01:42.003484 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Instance network_info: |[{"id": "12bb71f4-467b-4cc8-b164-f795401a0117", "address": "fa:16:3e:af:c7:36", "network": {"id": "1008534f-5c0f-4968-962e-d7e533fcc852", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1379747783-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12bb71f4-46", "ovs_interfaceid": "12bb71f4-467b-4cc8-b164-f795401a0117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f218cf2-d351-42a5-8b44-3e7ee9417bbd", "address": "fa:16:3e:24:b3:6a", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f218cf2-d3", "ovs_interfaceid": "9f218cf2-d351-42a5-8b44-3e7ee9417bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c2c9fb75-0a9e-47cb-a561-effaa19b4156", "address": "fa:16:3e:5d:f9:89", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c9fb75-0a", "ovs_interfaceid": "c2c9fb75-0a9e-47cb-a561-effaa19b4156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5", "address": "fa:16:3e:a3:f3:65", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7db2f4e-c4", "ovs_interfaceid": "d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd18fd3a-9dc5-4433-a638-72e5586eeb9c", "address": "fa:16:3e:e5:b9:aa", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd18fd3a-9d", "ovs_interfaceid": "fd18fd3a-9dc5-4433-a638-72e5586eeb9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bc674202-2354-4a2d-bdcf-3faf31e8cc7d", "address": "fa:16:3e:eb:2b:41", "network": {"id": "da83acc7-b5da-4d42-bd74-8a3a51d2f657", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377824470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc674202-23", "ovs_interfaceid": "bc674202-2354-4a2d-bdcf-3faf31e8cc7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44", "address": "fa:16:3e:d0:5a:e8", "network": {"id": "da83acc7-b5da-4d42-bd74-8a3a51d2f657", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377824470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd184f1f0-b1", "ovs_interfaceid": "d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:01:42.004049 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-155b9d68-d894-406a-bfc8-c6757dd83a33 req-76c9342a-1f0a-4bbf-97d4-795dc7fb9cb8 service nova] Acquired lock "refresh_cache-03313f66-d1dd-4269-b2e9-3b0796217299" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:01:42.004275 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-155b9d68-d894-406a-bfc8-c6757dd83a33 req-76c9342a-1f0a-4bbf-97d4-795dc7fb9cb8 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Refreshing network info cache for port d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:01:42.006948 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Start _get_guest_xml network_info=[{"id": "12bb71f4-467b-4cc8-b164-f795401a0117", "address": "fa:16:3e:af:c7:36", "network": {"id": "1008534f-5c0f-4968-962e-d7e533fcc852", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1379747783-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12bb71f4-46", "ovs_interfaceid": "12bb71f4-467b-4cc8-b164-f795401a0117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f218cf2-d351-42a5-8b44-3e7ee9417bbd", "address": "fa:16:3e:24:b3:6a", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f218cf2-d3", "ovs_interfaceid": "9f218cf2-d351-42a5-8b44-3e7ee9417bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c2c9fb75-0a9e-47cb-a561-effaa19b4156", "address": "fa:16:3e:5d:f9:89", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c9fb75-0a", "ovs_interfaceid": "c2c9fb75-0a9e-47cb-a561-effaa19b4156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5", "address": "fa:16:3e:a3:f3:65", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7db2f4e-c4", "ovs_interfaceid": "d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd18fd3a-9dc5-4433-a638-72e5586eeb9c", "address": "fa:16:3e:e5:b9:aa", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd18fd3a-9d", "ovs_interfaceid": "fd18fd3a-9dc5-4433-a638-72e5586eeb9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bc674202-2354-4a2d-bdcf-3faf31e8cc7d", "address": "fa:16:3e:eb:2b:41", "network": {"id": "da83acc7-b5da-4d42-bd74-8a3a51d2f657", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377824470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc674202-23", "ovs_interfaceid": "bc674202-2354-4a2d-bdcf-3faf31e8cc7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44", "address": "fa:16:3e:d0:5a:e8", "network": {"id": "da83acc7-b5da-4d42-bd74-8a3a51d2f657", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377824470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd184f1f0-b1", "ovs_interfaceid": "d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488', 'iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b8249ce3-d570-41ff-bcb4-97559f72c488', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '03313f66-d1dd-4269-b2e9-3b0796217299', 'attached_at': '', 'detached_at': '', 'volume_id': 'b8249ce3-d570-41ff-bcb4-97559f72c488', 'serial': 'b8249ce3-d570-41ff-bcb4-97559f72c488'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '261bafc4-81a4-4650-8909-83f8c6812129', 'guest_format': None, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0', 'iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '45364262-cab4-45b7-8f81-d8ccf73c75b0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '03313f66-d1dd-4269-b2e9-3b0796217299', 'attached_at': '', 'detached_at': '', 'volume_id': '45364262-cab4-45b7-8f81-d8ccf73c75b0', 'serial': '45364262-cab4-45b7-8f81-d8ccf73c75b0'}, 'boot_index': 1, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': '93f46bb6-b78d-4e87-9e40-16e844fc019a', 'guest_format': None, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04', 'iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '714453c0-1620-406b-ae4c-f244696a4a04', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '03313f66-d1dd-4269-b2e9-3b0796217299', 'attached_at': '', 'detached_at': '', 'volume_id': '714453c0-1620-406b-ae4c-f244696a4a04', 'serial': '714453c0-1620-406b-ae4c-f244696a4a04'}, 'boot_index': 2, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'attachment_id': '0c2221c6-ee87-42ce-8e58-2dd542ba4f94', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:01:42.015919 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:01:42.019296 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-733955908', uuid='03313f66-d1dd-4269-b2e9-3b0796217299'), owner=OwnerMeta(userid='4253d01a8baa41978a589f90a58d945d', username='tempest-TaggedBootDevicesTest-1732945749-project-member', projectid='eb5bac5cd317420ab74fc9f416a80e59', projectname='tempest-TaggedBootDevicesTest-1732945749'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "12bb71f4-467b-4cc8-b164-f795401a0117", "address": "fa:16:3e:af:c7:36", "network": {"id": "1008534f-5c0f-4968-962e-d7e533fcc852", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1379747783-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12bb71f4-46", "ovs_interfaceid": "12bb71f4-467b-4cc8-b164-f795401a0117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f218cf2-d351-42a5-8b44-3e7ee9417bbd", "address": "fa:16:3e:24:b3:6a", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f218cf2-d3", "ovs_interfaceid": "9f218cf2-d351-42a5-8b44-3e7ee9417bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c2c9fb75-0a9e-47cb-a561-effaa19b4156", "address": "fa:16:3e:5d:f9:89", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c9fb75-0a", "ovs_interfaceid": "c2c9fb75-0a9e-47cb-a561-effaa19b4156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5", "address": "fa:16:3e:a3:f3:65", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7db2f4e-c4", "ovs_interfaceid": "d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd18fd3a-9dc5-4433-a638-72e5586eeb9c", "address": "fa:16:3e:e5:b9:aa", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd18fd3a-9d", "ovs_interfaceid": "fd18fd3a-9dc5-4433-a638-72e5586eeb9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bc674202-2354-4a2d-bdcf-3faf31e8cc7d", "address": "fa:16:3e:eb:2b:41", "network": {"id": "da83acc7-b5da-4d42-bd74-8a3a51d2f657", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377824470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc674202-23", "ovs_interfaceid": "bc674202-2354-4a2d-bdcf-3faf31e8cc7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44", "address": "fa:16:3e:d0:5a:e8", "network": {"id": "da83acc7-b5da-4d42-bd74-8a3a51d2f657", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377824470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd184f1f0-b1", "ovs_interfaceid": "d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962502.0170898) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:01:42.021447 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:01:42.021764 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:01:42.022781 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:01:42.023025 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:01:42.024021 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:01:42.024402 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:01:42.024580 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:01:42.024953 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:01:42.025198 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:01:42.027182 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:01:42.027182 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:01:42.027182 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:01:42.027182 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:01:42.027182 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:01:42.027182 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:01:42.027182 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:01:42.038035 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:01:42.038404 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488', 'iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b8249ce3-d570-41ff-bcb4-97559f72c488', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:01:42.038600 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:01:42.043900 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Searching for a device in session 41 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:01:42.044138 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '305d8623-c6f8-456c-83ed-46d06c6de0ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:01:42.099194 np0000001613 nova-compute[98321]: DEBUG nova.compute.rpcapi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98321) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 10:01:42.113269 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:42.113507 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:42.113604 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:42.187202 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:01:42.187202 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962502.1840925, 4baa35bb-b237-42be-aa8b-d9eeed7e41a0 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:01:42.187202 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] VM Paused (Lifecycle Event)
May 28 10:01:42.406044 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Took 8.35 seconds to spawn the instance on the hypervisor.
May 28 10:01:42.406225 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:01:42.508462 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-155b9d68-d894-406a-bfc8-c6757dd83a33 req-76c9342a-1f0a-4bbf-97d4-795dc7fb9cb8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:42.687635 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:01:42.689625 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779962502.689286, 3edc00a8-2c60-4c44-acb8-6f4d02114bf0 => ua-3c045f01-4b5a-4f0c-86a0-8fc564914ff4> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 10:01:42.690159 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962502.6898172, 4baa35bb-b237-42be-aa8b-d9eeed7e41a0 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:01:42.690314 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] VM Resumed (Lifecycle Event)
May 28 10:01:42.693457 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Successfully detached device vdb from instance 3edc00a8-2c60-4c44-acb8-6f4d02114bf0 from the live domain config.
May 28 10:01:42.735382 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:01:42.735675 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4', 'iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3c045f01-4b5a-4f0c-86a0-8fc564914ff4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:01:42.735797 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:01:42.782848 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "be4a8d87-07fc-4c56-a68d-c95e98e99184" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:42.783377 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "be4a8d87-07fc-4c56-a68d-c95e98e99184" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:42.851980 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Found WWN 330000000352d9acf for multipath device dm-3 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:01:42.852293 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:01:42.852471 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] <== connect_volume: return (3042ms) {'type': 'block', 'scsi_wwn': '330000000352d9acf', 'path': '/dev/dm-3', 'multipath_id': '330000000352d9acf'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:01:42.852660 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000352d9acf', 'path': '/dev/dm-3', 'multipath_id': '330000000352d9acf'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:01:42.853201 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.815s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:01:42.853439 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488', 'iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b8249ce3-d570-41ff-bcb4-97559f72c488', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:01:42.857765 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lazy-loading 'flavor' on Instance uuid b90b1ecd-e640-4f4e-bd02-fb74021db82b {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:01:42.865922 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:01:42.866451 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:01:42.867051 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:01:42.867269 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:01:42.867476 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:01:42.867703 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:01:42.882060 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:01:42.882060 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:42.886490 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:01:42.886490 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:42.897149 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488] added
May 28 10:01:42.897149 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:01:42.897149 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:01:42.897149 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:01:42.897149 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:01:42.897149 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:01:42.897149 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:42.897393 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:01:42.897425 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0302(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:01:42.897596 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:01:42.898598 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488] added
May 28 10:01:42.898598 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:01:42.898598 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:01:42.898598 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:01:42.898598 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:01:42.898598 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:01:42.898598 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:42.898777 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:01:42.898857 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0314(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:01:42.899318 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:01:42.901493 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-155b9d68-d894-406a-bfc8-c6757dd83a33 req-76c9342a-1f0a-4bbf-97d4-795dc7fb9cb8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:42.923562 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Took 14.59 seconds to build instance.
May 28 10:01:43.057964 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-155b9d68-d894-406a-bfc8-c6757dd83a33 req-76c9342a-1f0a-4bbf-97d4-795dc7fb9cb8 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Updated VIF entry in instance network info cache for port d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:01:43.057964 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-155b9d68-d894-406a-bfc8-c6757dd83a33 req-76c9342a-1f0a-4bbf-97d4-795dc7fb9cb8 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Updating instance_info_cache with network_info: [{"id": "12bb71f4-467b-4cc8-b164-f795401a0117", "address": "fa:16:3e:af:c7:36", "network": {"id": "1008534f-5c0f-4968-962e-d7e533fcc852", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1379747783-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12bb71f4-46", "ovs_interfaceid": "12bb71f4-467b-4cc8-b164-f795401a0117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f218cf2-d351-42a5-8b44-3e7ee9417bbd", "address": "fa:16:3e:24:b3:6a", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f218cf2-d3", "ovs_interfaceid": "9f218cf2-d351-42a5-8b44-3e7ee9417bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c2c9fb75-0a9e-47cb-a561-effaa19b4156", "address": "fa:16:3e:5d:f9:89", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c9fb75-0a", "ovs_interfaceid": "c2c9fb75-0a9e-47cb-a561-effaa19b4156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5", "address": "fa:16:3e:a3:f3:65", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7db2f4e-c4", "ovs_interfaceid": "d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd18fd3a-9dc5-4433-a638-72e5586eeb9c", "address": "fa:16:3e:e5:b9:aa", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd18fd3a-9d", "ovs_interfaceid": "fd18fd3a-9dc5-4433-a638-72e5586eeb9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bc674202-2354-4a2d-bdcf-3faf31e8cc7d", "address": "fa:16:3e:eb:2b:41", "network": {"id": "da83acc7-b5da-4d42-bd74-8a3a51d2f657", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377824470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc674202-23", "ovs_interfaceid": "bc674202-2354-4a2d-bdcf-3faf31e8cc7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44", "address": "fa:16:3e:d0:5a:e8", "network": {"id": "da83acc7-b5da-4d42-bd74-8a3a51d2f657", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377824470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd184f1f0-b1", "ovs_interfaceid": "d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:01:43.127340 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:43.197173 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:01:43.199628 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:01:43.256274 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "refresh_cache-49f53c82-6f7e-4d09-a471-26bd4fdc02e7" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:01:43.256274 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquired lock "refresh_cache-49f53c82-6f7e-4d09-a471-26bd4fdc02e7" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:01:43.256353 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:01:43.287175 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:01:43.359982 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Attempting to attach volume 305d8623-c6f8-456c-83ed-46d06c6de0ea with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 10:01:43.362680 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] attach device xml: <disk type="block" device="disk">
May 28 10:01:43.362680 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:01:43.362680 np0000001613 nova-compute[98321]:   <alias name="ua-305d8623-c6f8-456c-83ed-46d06c6de0ea"/>
May 28 10:01:43.362680 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-3"/>
May 28 10:01:43.362680 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:01:43.362680 np0000001613 nova-compute[98321]:   <serial>305d8623-c6f8-456c-83ed-46d06c6de0ea</serial>
May 28 10:01:43.362680 np0000001613 nova-compute[98321]: </disk>
May 28 10:01:43.362680 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 10:01:43.426241 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3d44505f-1b4d-4a45-81fb-6450ffb7b835 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.114s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:43.562440 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-155b9d68-d894-406a-bfc8-c6757dd83a33 req-76c9342a-1f0a-4bbf-97d4-795dc7fb9cb8 service nova] Releasing lock "refresh_cache-03313f66-d1dd-4269-b2e9-3b0796217299" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:01:43.573678 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-22f8ebac-342e-42ed-9e4a-600a7f1107af req-41ee3873-0d99-49c9-b752-971f439aa9ce service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Received event network-changed-4edd294f-7bb5-46ec-9cdc-c8683088408c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:43.573678 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-22f8ebac-342e-42ed-9e4a-600a7f1107af req-41ee3873-0d99-49c9-b752-971f439aa9ce service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Refreshing instance network info cache due to event network-changed-4edd294f-7bb5-46ec-9cdc-c8683088408c. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:01:43.573678 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-22f8ebac-342e-42ed-9e4a-600a7f1107af req-41ee3873-0d99-49c9-b752-971f439aa9ce service nova] Acquiring lock "refresh_cache-2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:01:43.573678 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-22f8ebac-342e-42ed-9e4a-600a7f1107af req-41ee3873-0d99-49c9-b752-971f439aa9ce service nova] Acquired lock "refresh_cache-2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:01:43.573678 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-22f8ebac-342e-42ed-9e4a-600a7f1107af req-41ee3873-0d99-49c9-b752-971f439aa9ce service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Refreshing network info cache for port 4edd294f-7bb5-46ec-9cdc-c8683088408c {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:01:43.762814 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:43.855298 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:43.859631 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:43.871671 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:01:43.872619 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Claim successful on node np0000001613
May 28 10:01:43.898286 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:01:43.899764 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:01:43.917039 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:01:43.917039 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:01:43.921751 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:01:43.921751 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:43.934084 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:43.943926 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:43.959752 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:43.959752 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:43.959752 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:43.959752 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:43.959752 np0000001613 nova-compute[98321]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:43.959752 np0000001613 nova-compute[98321]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:43.959752 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:43.959752 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:43.959752 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:01:43.960123 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:43.960123 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:43.960123 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:43.960123 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:43.960123 np0000001613 nova-compute[98321]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:43.960123 np0000001613 nova-compute[98321]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:43.960123 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:43.960123 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:43.960123 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:01:43.966878 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:43.966878 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:43.966878 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:43.966878 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:43.966878 np0000001613 nova-compute[98321]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:43.966878 np0000001613 nova-compute[98321]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:43.966878 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:43.966878 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:43.966878 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:01:43.966878 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:43.966878 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:43.966878 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:43.966878 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:43.966878 np0000001613 nova-compute[98321]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:43.966878 np0000001613 nova-compute[98321]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:43.966878 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:43.966878 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:43.966878 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:01:44.016858 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488, portal: 192.168.50.100,3260]
May 28 10:01:44.016858 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488, portal: 192.168.50.100,3260] successful.
May 28 10:01:44.016858 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:44.026469 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488, portal: 192.168.40.100,3260]
May 28 10:01:44.026469 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488, portal: 192.168.40.100,3260] successful.
May 28 10:01:44.026469 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:44.037219 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:44.045984 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:44.065099 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:44.065099 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:44.065099 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:44.065099 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:44.065099 np0000001613 nova-compute[98321]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:44.065099 np0000001613 nova-compute[98321]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:44.065099 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:44.065099 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:44.065099 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:44.065099 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:44.065099 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:01:44.065434 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:44.065434 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:44.065434 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:44.065434 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:44.065434 np0000001613 nova-compute[98321]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:44.065434 np0000001613 nova-compute[98321]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:44.065434 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:44.065434 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:44.065434 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:44.065434 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:44.065434 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:01:44.065792 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.199s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:01:44.065792 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:01:44.066895 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] HCTL ('15', '-', '-', 0) found on session 43 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:01:44.067007 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:01:44.077012 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-22f8ebac-342e-42ed-9e4a-600a7f1107af req-41ee3873-0d99-49c9-b752-971f439aa9ce service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:44.079813 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:44.079813 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:44.079813 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:44.079813 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:44.079813 np0000001613 nova-compute[98321]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:44.079813 np0000001613 nova-compute[98321]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:44.079813 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:44.079813 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:44.079813 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:44.079813 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:44.079813 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:01:44.080243 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:44.080243 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:44.080243 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:44.080243 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:44.080243 np0000001613 nova-compute[98321]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:44.080243 np0000001613 nova-compute[98321]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:44.080243 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:44.080243 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:44.080243 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:44.080243 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:44.080243 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:01:44.081421 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.214s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:01:44.081421 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:01:44.086612 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] HCTL ('16', '-', '-', 0) found on session 44 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:01:44.086612 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:01:44.098061 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Searching for a device in session 43 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:01:44.098061 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b8249ce3-d570-41ff-bcb4-97559f72c488', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:01:44.110988 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Searching for a device in session 44 and hctl ['16', '*', '*', 0] yield: None {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:01:44.345525 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:44.349287 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:44.525503 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Updating instance_info_cache with network_info: [{"id": "55556967-1d07-4f3b-bc07-6692ef9de17b", "address": "fa:16:3e:d2:27:b6", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55556967-1d", "ovs_interfaceid": "55556967-1d07-4f3b-bc07-6692ef9de17b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:01:44.575140 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-22f8ebac-342e-42ed-9e4a-600a7f1107af req-41ee3873-0d99-49c9-b752-971f439aa9ce service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:44.679096 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Rebuilding instance
May 28 10:01:44.766298 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-22f8ebac-342e-42ed-9e4a-600a7f1107af req-41ee3873-0d99-49c9-b752-971f439aa9ce service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Updated VIF entry in instance network info cache for port 4edd294f-7bb5-46ec-9cdc-c8683088408c. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:01:44.766552 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-22f8ebac-342e-42ed-9e4a-600a7f1107af req-41ee3873-0d99-49c9-b752-971f439aa9ce service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Updating instance_info_cache with network_info: [{"id": "4edd294f-7bb5-46ec-9cdc-c8683088408c", "address": "fa:16:3e:44:0a:72", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4edd294f-7b", "ovs_interfaceid": "4edd294f-7bb5-46ec-9cdc-c8683088408c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:01:44.847449 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:01:45.028777 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Releasing lock "refresh_cache-49f53c82-6f7e-4d09-a471-26bd4fdc02e7" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:01:45.039824 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:01:45.042210 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:01:45.042210 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:01:45.042210 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] No VIF found with MAC fa:16:3e:b1:88:d2, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:01:45.107261 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Searching for a device in session 44 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:01:45.107261 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b8249ce3-d570-41ff-bcb4-97559f72c488', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:01:45.268379 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-22f8ebac-342e-42ed-9e4a-600a7f1107af req-41ee3873-0d99-49c9-b752-971f439aa9ce service nova] Releasing lock "refresh_cache-2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:01:45.538417 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:01:45.560199 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:01:45.592861 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:45.636367 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:01:45.637418 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:01:45.649921 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:01:45.652447 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe2d:94a4', 'fe80::2844:59ff:feec:5d21', 'fe80::fc16:3eff:fefd:30e7', 'fe80::e4df:c0ff:fe86:6341', 'fe80::ce2:7bff:fe0e:d096', 'fe80::fc16:3eff:fedb:1077', 'fe80::fc16:3eff:fee0:9ccd', 'fe80::fc16:3eff:feb1:88d2', 'fe80::843b:b2ff:fe26:76a', 'fe80::fc16:3eff:fe15:4154', 'fe80::605f:aaff:fe8d:fcdd', 'fe80::fc16:3eff:fe3c:b7e1', 'fe80::fc16:3eff:fe86:604b', 'fe80::fc16:3eff:fe44:a72', 'fe80::fc16:3eff:fe05:9ea2', 'fe80::3037:7fff:fec8:89ce'] 
May 28 10:01:45.652665 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:01:45.652796 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:01:45.653046 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:01:45.682262 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-087419d8-166b-4de4-ac51-29c35ef36f5d req-960b6d20-2330-450b-b3ab-70e23c2aa6ed service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Received event network-changed-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:45.685831 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-087419d8-166b-4de4-ac51-29c35ef36f5d req-960b6d20-2330-450b-b3ab-70e23c2aa6ed service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Refreshing instance network info cache due to event network-changed-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:01:45.686221 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-087419d8-166b-4de4-ac51-29c35ef36f5d req-960b6d20-2330-450b-b3ab-70e23c2aa6ed service nova] Acquiring lock "refresh_cache-4baa35bb-b237-42be-aa8b-d9eeed7e41a0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:01:45.686433 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-087419d8-166b-4de4-ac51-29c35ef36f5d req-960b6d20-2330-450b-b3ab-70e23c2aa6ed service nova] Acquired lock "refresh_cache-4baa35bb-b237-42be-aa8b-d9eeed7e41a0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:01:45.686722 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-087419d8-166b-4de4-ac51-29c35ef36f5d req-960b6d20-2330-450b-b3ab-70e23c2aa6ed service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Refreshing network info cache for port a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:01:45.766086 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:01:45.766335 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:01:45.884202 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:45.887501 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:45.896657 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Found WWN 3300000007ce8b511 for multipath device dm-4 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:01:45.897227 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.044s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:01:45.897496 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] <== connect_volume: return (3858ms) {'type': 'block', 'scsi_wwn': '3300000007ce8b511', 'path': '/dev/dm-4', 'multipath_id': '3300000007ce8b511'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:01:45.897836 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007ce8b511', 'path': '/dev/dm-4', 'multipath_id': '3300000007ce8b511'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:01:45.898474 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 3.163s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:01:45.899178 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4', 'iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3c045f01-4b5a-4f0c-86a0-8fc564914ff4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:01:45.899361 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:01:45.918280 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:45.921986 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:45.946130 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:45.946130 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:45.946130 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:45.946130 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:45.946130 np0000001613 nova-compute[98321]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:45.946130 np0000001613 nova-compute[98321]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:45.946130 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:45.946130 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:45.946130 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:45.946130 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:45.946130 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:01:45.946130 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:45.946130 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:45.946130 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:45.946130 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:45.946130 np0000001613 nova-compute[98321]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:45.946130 np0000001613 nova-compute[98321]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4 (non-flash)
May 28 10:01:45.946130 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:45.946130 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:45.946130 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:45.946130 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:45.946130 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:01:45.946798 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', '42'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488', '44')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:01:45.946798 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4', '38')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:01:45.947150 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:45.949978 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4', '37')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:01:45.951201 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1f403d260>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4'): ({'sdf'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:01:45.951461 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Removing multipathed devices sdg, sdf {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:01:45.952057 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Flush multipath device 3300000009c0f9088 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:01:45.981964 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:01:46.024416 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:01:46.067955 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:01:46.068151 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:01:46.069488 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:01:46.075442 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b158dfde-7c40-47d1-96c0-678a771f9598 req-db2197a1-fa88-4de7-8557-837e6be7225e service nova] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Received event network-vif-unplugged-b45721cf-794a-4cef-9660-816123b5b144 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:46.075442 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b158dfde-7c40-47d1-96c0-678a771f9598 req-db2197a1-fa88-4de7-8557-837e6be7225e service nova] Acquiring lock "9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:46.075442 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b158dfde-7c40-47d1-96c0-678a771f9598 req-db2197a1-fa88-4de7-8557-837e6be7225e service nova] Lock "9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:46.075442 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b158dfde-7c40-47d1-96c0-678a771f9598 req-db2197a1-fa88-4de7-8557-837e6be7225e service nova] Lock "9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:46.075442 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b158dfde-7c40-47d1-96c0-678a771f9598 req-db2197a1-fa88-4de7-8557-837e6be7225e service nova] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] No waiting events found dispatching network-vif-unplugged-b45721cf-794a-4cef-9660-816123b5b144 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:01:46.075702 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-b158dfde-7c40-47d1-96c0-678a771f9598 req-db2197a1-fa88-4de7-8557-837e6be7225e service nova] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Received unexpected event network-vif-unplugged-b45721cf-794a-4cef-9660-816123b5b144 for instance with vm_state active and task_state rebuilding.
May 28 10:01:46.086428 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:01:46.086674 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:01:46.103785 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:46.141647 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4, portal: 192.168.40.100,3260]
May 28 10:01:46.141647 np0000001613 nova-compute[98321]: Logout of [sid: 38, target: iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4, portal: 192.168.40.100,3260] successful.
May 28 10:01:46.141647 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:46.166626 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:46.181615 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:46.190740 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-087419d8-166b-4de4-ac51-29c35ef36f5d req-960b6d20-2330-450b-b3ab-70e23c2aa6ed service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:46.204765 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999682610000264 future=<Future at 0x73c1f470cbc0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:01:46.207396 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Instance destroyed successfully.
May 28 10:01:46.211491 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Instance destroyed successfully.
May 28 10:01:46.212757 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:00:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1145093383',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serveractionsv293testjson-server-1963844026',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAMk9iSLwMbw4Ei6MHI0esC/55Rcy6sQ2tiWuKsyMq8m3KvVeicKJFpNeMJUkrZC2YauMY8UtCiYY/mGIoDtQfJzjOysD9ZOhrfUaZ1uCfXpLOQ02ek21gk2Qq+Gwmp7g==',key_name='tempest-keypair-1857006641',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:01:01Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2b4cc0430ca14757a829b60eb7e0081e',ramdisk_id='',reservation_id='r-i2a86n6f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3427ea11-12a6-4b25-8c73-769d29819fe0',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1376389954',owner_user_name='tempest-ServerActionsV293TestJSON-1376389954-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:01:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='321e041ada2b405e821acd703457ddcb',uuid=9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b45721cf-794a-4cef-9660-816123b5b144", "address": "fa:16:3e:15:41:54", "network": {"id": "a546cd76-74b1-4628-b9bf-c80f6b8f1bec", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1194909584-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2b4cc0430ca14757a829b60eb7e0081e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45721cf-79", "ovs_interfaceid": "b45721cf-794a-4cef-9660-816123b5b144", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:01:46.212961 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Converting VIF {"id": "b45721cf-794a-4cef-9660-816123b5b144", "address": "fa:16:3e:15:41:54", "network": {"id": "a546cd76-74b1-4628-b9bf-c80f6b8f1bec", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1194909584-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2b4cc0430ca14757a829b60eb7e0081e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45721cf-79", "ovs_interfaceid": "b45721cf-794a-4cef-9660-816123b5b144", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:01:46.213747 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:41:54,bridge_name='br-int',has_traffic_filtering=True,id=b45721cf-794a-4cef-9660-816123b5b144,network=Network(a546cd76-74b1-4628-b9bf-c80f6b8f1bec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb45721cf-79') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:01:46.214009 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:41:54,bridge_name='br-int',has_traffic_filtering=True,id=b45721cf-794a-4cef-9660-816123b5b144,network=Network(a546cd76-74b1-4628-b9bf-c80f6b8f1bec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb45721cf-79') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:01:46.215550 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:46.215915 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb45721cf-79, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:46.217855 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:46.218195 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:01:46.220258 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:46.220599 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a3350a3d-3d19-4563-89ad-17fc65ddab49) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:46.221290 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:46.221899 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:01:46.222810 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:46.224326 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4, portal: 192.168.50.100,3260]
May 28 10:01:46.224326 np0000001613 nova-compute[98321]: Logout of [sid: 37, target: iqn.2023-03.storpool.com:os--volume-3c045f01-4b5a-4f0c-86a0-8fc564914ff4, portal: 192.168.50.100,3260] successful.
May 28 10:01:46.224326 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:46.227144 np0000001613 nova-compute[98321]: INFO os_vif [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:41:54,bridge_name='br-int',has_traffic_filtering=True,id=b45721cf-794a-4cef-9660-816123b5b144,network=Network(a546cd76-74b1-4628-b9bf-c80f6b8f1bec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb45721cf-79')
May 28 10:01:46.228701 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:01:46.229244 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83485657-e133-49aa-baed-d67cb2fd1720', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:01:46.229450 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:01:46.248387 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:46.248830 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:01:46.249120 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] <== disconnect_volume: return (3513ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:01:46.249955 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.020s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:01:46.250360 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:01:46.250545 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83485657-e133-49aa-baed-d67cb2fd1720', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:01:46.253682 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:01:46.270413 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:01:46.284435 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:46.284435 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:46.284435 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:46.284435 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:46.284435 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:46.284435 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:46.284435 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:46.284435 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:46.284435 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:01:46.284813 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:46.284813 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:46.284813 np0000001613 nova-compute[98321]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:46.284813 np0000001613 nova-compute[98321]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:46.284813 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:46.284813 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:46.284813 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:46.284813 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:46.284813 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:01:46.284813 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', '42'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488', '44')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:01:46.285157 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', '33')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:01:46.286208 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', '34')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:01:46.287056 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1f47513a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720'): ({'sdc'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:01:46.287387 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Removing multipathed devices sdb, sdc {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:01:46.287614 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Flush multipath device 3300000005fd58f27 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:01:46.344255 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:01:46.390396 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:01:46.415382 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:01:46.415600 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0', 'iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '45364262-cab4-45b7-8f81-d8ccf73c75b0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:01:46.415805 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:01:46.435531 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:01:46.435738 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:01:46.436805 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:01:46.452116 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:01:46.452348 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:01:46.464021 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:46.496722 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720, portal: 192.168.40.100,3260]
May 28 10:01:46.496722 np0000001613 nova-compute[98321]: Logout of [sid: 33, target: iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720, portal: 192.168.40.100,3260] successful.
May 28 10:01:46.496722 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:46.514073 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:46.527129 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:46.564624 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720, portal: 192.168.50.100,3260]
May 28 10:01:46.564624 np0000001613 nova-compute[98321]: Logout of [sid: 34, target: iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720, portal: 192.168.50.100,3260] successful.
May 28 10:01:46.564624 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:46.581563 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-087419d8-166b-4de4-ac51-29c35ef36f5d req-960b6d20-2330-450b-b3ab-70e23c2aa6ed service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:46.584429 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:46.584767 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:01:46.585113 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] <== disconnect_volume: return (355ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:01:46.585281 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:01:46.585662 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.170s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:01:46.585845 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0', 'iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '45364262-cab4-45b7-8f81-d8ccf73c75b0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:01:46.586306 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Deleting instance files /opt/stack/data/nova/instances/9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590_del
May 28 10:01:46.586924 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Deletion of /opt/stack/data/nova/instances/9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590_del complete
May 28 10:01:46.598825 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:01:46.599906 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:01:46.600222 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:01:46.601475 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:01:46.601475 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:01:46.601475 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:01:46.615429 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:01:46.615429 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:46.623774 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ef7df81b-4a26-41b6-8fab-e9174dfca000 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.589s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:46.625636 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:01:46.625636 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:46.638366 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0] added
May 28 10:01:46.638366 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:01:46.638366 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:01:46.638366 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:01:46.638366 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:01:46.638366 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:01:46.638366 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:46.638607 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:01:46.638779 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0383(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:01:46.638995 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:01:46.642104 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0] added
May 28 10:01:46.642104 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:01:46.642104 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:01:46.642104 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:01:46.642104 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:01:46.642104 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:01:46.642104 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:46.642973 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:01:46.642973 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0415(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:01:46.642973 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:01:46.776511 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-087419d8-166b-4de4-ac51-29c35ef36f5d req-960b6d20-2330-450b-b3ab-70e23c2aa6ed service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Updated VIF entry in instance network info cache for port a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:01:46.777079 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-087419d8-166b-4de4-ac51-29c35ef36f5d req-960b6d20-2330-450b-b3ab-70e23c2aa6ed service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Updating instance_info_cache with network_info: [{"id": "a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39", "address": "fa:16:3e:05:9e:a2", "network": {"id": "2b7ff7fb-07d6-4791-9553-cb0a7a073e10", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2104350241-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12b4f42e155347e4a2055b151f04390a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f414a0-04", "ovs_interfaceid": "a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:01:46.780679 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.921s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:46.781548 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:01:46.866468 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lazy-loading 'flavor' on Instance uuid 3edc00a8-2c60-4c44-acb8-6f4d02114bf0 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:01:46.879380 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Starting finish_migration {{(pid=98321) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 28 10:01:46.885626 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Instance directory exists: not creating {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 10:01:46.885626 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Creating image(s)
May 28 10:01:46.885988 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Did not create local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 10:01:46.885988 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Ensure instance console log exists: /opt/stack/data/nova/instances/49f53c82-6f7e-4d09-a471-26bd4fdc02e7/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:01:46.890599 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:46.890599 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:46.890599 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:46.890914 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Start _get_guest_xml network_info=[{"id": "55556967-1d07-4f3b-bc07-6692ef9de17b", "address": "fa:16:3e:d2:27:b6", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1771401192-network", "vif_mac": "fa:16:3e:d2:27:b6"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55556967-1d", "ovs_interfaceid": "55556967-1d07-4f3b-bc07-6692ef9de17b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c1f00235-beec-448a-ae55-17b46aa31e9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '49f53c82-6f7e-4d09-a471-26bd4fdc02e7', 'attached_at': '2026-05-28T10:01:46.000000', 'detached_at': '', 'volume_id': 'c1f00235-beec-448a-ae55-17b46aa31e9b', 'serial': 'c1f00235-beec-448a-ae55-17b46aa31e9b'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '4b035983-3fef-4274-8809-7092a8c114dc', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:01:46.897937 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:01:46.899772 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-1421682824', uuid='49f53c82-6f7e-4d09-a471-26bd4fdc02e7'), owner=OwnerMeta(userid='62efa57da85f458790f3ceeebcc777a7', username='tempest-ServerActionsTestOtherA-1557455944-project-member', projectid='cb3a501b4f4041ef875ef4d2b4167044', projectname='tempest-ServerActionsTestOtherA-1557455944'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "55556967-1d07-4f3b-bc07-6692ef9de17b", "address": "fa:16:3e:d2:27:b6", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1771401192-network", "vif_mac": "fa:16:3e:d2:27:b6"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55556967-1d", "ovs_interfaceid": "55556967-1d07-4f3b-bc07-6692ef9de17b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962506.899177) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:01:46.902412 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:01:46.902787 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:01:46.904324 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:01:46.904484 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:01:46.906382 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:01:46.906736 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:01:46.906943 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:01:46.907058 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:01:46.907900 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:01:46.908036 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:01:46.908185 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:01:46.908600 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:01:46.908600 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:01:46.908679 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:01:46.908934 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:01:46.909021 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:01:46.927185 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49f53c82-6f7e-4d09-a471-26bd4fdc02e7/disk.config --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:47.022102 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49f53c82-6f7e-4d09-a471-26bd4fdc02e7/disk.config --force-share --output=json" returned: 0 in 0.094s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:47.022767 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "/opt/stack/data/nova/instances/49f53c82-6f7e-4d09-a471-26bd4fdc02e7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:47.023106 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "/opt/stack/data/nova/instances/49f53c82-6f7e-4d09-a471-26bd4fdc02e7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:47.023834 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "/opt/stack/data/nova/instances/49f53c82-6f7e-4d09-a471-26bd4fdc02e7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:47.024337 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:01:47.024868 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c1f00235-beec-448a-ae55-17b46aa31e9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:01:47.025058 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:01:47.177137 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590 could not be found.
May 28 10:01:47.178155 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:01:47.178506 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83485657-e133-49aa-baed-d67cb2fd1720', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:01:47.178675 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:01:47.294702 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-087419d8-166b-4de4-ac51-29c35ef36f5d req-960b6d20-2330-450b-b3ab-70e23c2aa6ed service nova] Releasing lock "refresh_cache-4baa35bb-b237-42be-aa8b-d9eeed7e41a0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:01:47.298213 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:01:47.298739 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:01:47.299049 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:47.299321 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:47.388945 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9297977bbf334232a4a74bd6808b863b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a85ba31f98b45b6974118c6560bbc53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:01:47.639591 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:01:47.643784 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:01:47.656194 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:01:47.656194 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:01:47.663435 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:01:47.663435 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:47.670940 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:47.684389 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:47.695617 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:47.695617 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:47.695617 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:47.695617 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:47.695617 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:47.695617 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:47.695617 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:01:47.695869 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:47.695869 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:47.695869 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:47.695869 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:47.695869 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:47.695869 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:47.695869 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:01:47.702953 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:47.702953 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:47.702953 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:47.702953 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:47.702953 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:47.702953 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:47.702953 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:01:47.703122 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:47.703122 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:47.703122 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:47.703122 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:47.703122 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:47.703122 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:47.703122 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:01:47.719110 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0005015799999910087 future=<Future at 0x73c1f43966f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:01:47.719695 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:01:47.719695 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=7.430908291999913 future=<Future at 0x73c205a67290 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:01:47.719695 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=7.4308187059998545 future=<Future at 0x73c205a67290 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:01:47.719909 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Emitting event <LifecycleEvent: 1779962492.7184803, f9fd8989-d182-47e4-9409-266a1440bf58 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:01:47.720069 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] VM Stopped (Lifecycle Event)
May 28 10:01:47.738306 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0, portal: 192.168.50.100,3260]
May 28 10:01:47.738306 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0, portal: 192.168.50.100,3260] successful.
May 28 10:01:47.738306 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:47.744006 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0, portal: 192.168.40.100,3260]
May 28 10:01:47.744006 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0, portal: 192.168.40.100,3260] successful.
May 28 10:01:47.744006 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:47.753572 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:47.759200 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:47.770438 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:47.770438 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:47.770438 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:47.770438 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:47.770438 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:47.770438 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:47.770438 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:47.770438 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:47.770438 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:01:47.770438 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:47.770438 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:47.770438 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:47.770438 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:47.770438 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:47.770438 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:47.770438 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:47.770438 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:47.770438 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:01:47.771071 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.170s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:01:47.771071 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:01:47.771413 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] HCTL ('7', '-', '-', 0) found on session 45 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:01:47.771527 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:01:47.782105 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:47.782105 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:47.782105 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:47.782105 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:47.782105 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:47.782105 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:47.782105 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:47.782105 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:47.782105 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:01:47.782531 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:47.782531 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:47.782531 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:47.782531 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:47.782531 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:47.782531 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:47.782531 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:47.782531 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:47.782531 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:01:47.782810 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:01:47.782810 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:01:47.783967 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] HCTL ('8', '-', '-', 0) found on session 46 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:01:47.784118 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:01:47.792016 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Searching for a device in session 45 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:01:47.792016 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '45364262-cab4-45b7-8f81-d8ccf73c75b0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:01:47.793805 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:01:47.794443 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:01:47.802396 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Searching for a device in session 46 and hctl ['8', '*', '*', 0] yield: None {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:01:47.802396 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:01:47.879096 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-5be73364-fdfc-47f7-9378-7ce8a36d7ac9 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "3edc00a8-2c60-4c44-acb8-6f4d02114bf0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 10.115s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:48.084418 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Successfully created port: 1ea26412-1950-4e22-bbb1-1973617d8031 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:01:48.222774 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: f9fd8989-d182-47e4-9409-266a1440bf58] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:01:48.307343 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:01:48.316101 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-1455d5a1-fa1e-4dba-83e2-4126d1db937f req-ed04f9fd-a07d-4c4e-962a-1bd0c1a3833e service nova] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Received event network-vif-unplugged-b45721cf-794a-4cef-9660-816123b5b144 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:48.316474 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1455d5a1-fa1e-4dba-83e2-4126d1db937f req-ed04f9fd-a07d-4c4e-962a-1bd0c1a3833e service nova] Acquiring lock "9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:48.316474 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1455d5a1-fa1e-4dba-83e2-4126d1db937f req-ed04f9fd-a07d-4c4e-962a-1bd0c1a3833e service nova] Lock "9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:48.316831 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1455d5a1-fa1e-4dba-83e2-4126d1db937f req-ed04f9fd-a07d-4c4e-962a-1bd0c1a3833e service nova] Lock "9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:48.316831 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-1455d5a1-fa1e-4dba-83e2-4126d1db937f req-ed04f9fd-a07d-4c4e-962a-1bd0c1a3833e service nova] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] No waiting events found dispatching network-vif-unplugged-b45721cf-794a-4cef-9660-816123b5b144 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:01:48.316831 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-1455d5a1-fa1e-4dba-83e2-4126d1db937f req-ed04f9fd-a07d-4c4e-962a-1bd0c1a3833e service nova] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Received unexpected event network-vif-unplugged-b45721cf-794a-4cef-9660-816123b5b144 for instance with vm_state active and task_state rebuilding.
May 28 10:01:48.385652 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Stashing vm_state: active {{(pid=98321) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 28 10:01:48.735099 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Successfully updated port: 1ea26412-1950-4e22-bbb1-1973617d8031 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:01:48.791836 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:01:48.792300 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:01:48.800591 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Searching for a device in session 46 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:01:48.800591 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '45364262-cab4-45b7-8f81-d8ccf73c75b0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:01:48.934093 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:48.934357 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:49.238901 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "refresh_cache-be4a8d87-07fc-4c56-a68d-c95e98e99184" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:01:49.239067 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquired lock "refresh_cache-be4a8d87-07fc-4c56-a68d-c95e98e99184" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:01:49.239284 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:01:49.317358 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:01:49.319691 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:01:49.319981 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Creating image(s)
May 28 10:01:49.320541 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "/opt/stack/data/nova/instances/be4a8d87-07fc-4c56-a68d-c95e98e99184/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:49.320759 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "/opt/stack/data/nova/instances/be4a8d87-07fc-4c56-a68d-c95e98e99184/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:49.328091 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "/opt/stack/data/nova/instances/be4a8d87-07fc-4c56-a68d-c95e98e99184/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:49.328091 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:01:49.336021 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:01:49.338157 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:49.355422 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:49.442500 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:01:49.443210 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Claim successful on node np0000001613
May 28 10:01:49.448172 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.110s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:49.449043 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:49.449742 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:49.451397 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:01:49.456379 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:01:49.456622 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:49.565975 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.109s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:49.569186 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/be4a8d87-07fc-4c56-a68d-c95e98e99184/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:49.617904 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/be4a8d87-07fc-4c56-a68d-c95e98e99184/disk 1073741824" returned: 0 in 0.051s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:49.618963 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.169s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:49.621977 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:49.639215 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Found WWN 33000000001195308 for multipath device dm-0 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:01:49.640329 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.054s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:01:49.640614 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] <== connect_volume: return (3224ms) {'type': 'block', 'scsi_wwn': '33000000001195308', 'path': '/dev/dm-0', 'multipath_id': '33000000001195308'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:01:49.640894 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000001195308', 'path': '/dev/dm-0', 'multipath_id': '33000000001195308'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:01:49.644930 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.620s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:01:49.645393 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c1f00235-beec-448a-ae55-17b46aa31e9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:01:49.660378 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:01:49.661433 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:01:49.661715 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:01:49.662127 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:01:49.662412 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:01:49.662963 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:01:49.678674 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:01:49.678674 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:49.686007 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:01:49.686007 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:49.695183 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b] added
May 28 10:01:49.695183 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:01:49.695183 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:01:49.695183 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:01:49.695183 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:01:49.695183 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:01:49.695183 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:49.695183 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:01:49.695183 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.033(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:01:49.695183 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:01:49.698921 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b] added
May 28 10:01:49.698921 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:01:49.698921 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:01:49.698921 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:01:49.698921 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:01:49.698921 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:01:49.698921 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:49.699451 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:01:49.699451 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0364(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:01:49.699523 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:01:49.714384 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.095s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:49.714876 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Checking if we can resize image /opt/stack/data/nova/instances/be4a8d87-07fc-4c56-a68d-c95e98e99184/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:01:49.715194 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4a8d87-07fc-4c56-a68d-c95e98e99184/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:49.757736 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "36fde791-779f-42a8-9aef-87eafbbe0370" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:49.760225 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "36fde791-779f-42a8-9aef-87eafbbe0370" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:49.787988 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:01:49.788832 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:01:49.791621 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:01:49.791955 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:01:49.812122 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:01:49.815235 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4a8d87-07fc-4c56-a68d-c95e98e99184/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:49.816932 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Cannot resize image /opt/stack/data/nova/instances/be4a8d87-07fc-4c56-a68d-c95e98e99184/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:01:49.816932 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:01:49.816932 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Ensure instance console log exists: /opt/stack/data/nova/instances/be4a8d87-07fc-4c56-a68d-c95e98e99184/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:01:49.816932 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:49.816932 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:49.816932 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:49.954110 np0000001613 nova-compute[98321]: INFO nova.compute.resource_tracker [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Updating resource usage from migration e6f68f41-c513-4350-8921-ddbbfd127fae
May 28 10:01:49.986027 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:50.155725 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:01:50.156238 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04', 'iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '714453c0-1620-406b-ae4c-f244696a4a04', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:01:50.156481 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:01:50.208853 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Updating instance_info_cache with network_info: [{"id": "1ea26412-1950-4e22-bbb1-1973617d8031", "address": "fa:16:3e:a8:9a:37", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ea26412-19", "ovs_interfaceid": "1ea26412-1950-4e22-bbb1-1973617d8031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:01:50.261191 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:01:50.298889 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:50.385578 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4ebc762b-a10f-487d-96b9-9d2fb6e43860 req-2c264d4b-35e8-42be-8b54-52d10528e62d service nova] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Received event network-changed-1ea26412-1950-4e22-bbb1-1973617d8031 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:50.385578 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4ebc762b-a10f-487d-96b9-9d2fb6e43860 req-2c264d4b-35e8-42be-8b54-52d10528e62d service nova] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Refreshing instance network info cache due to event network-changed-1ea26412-1950-4e22-bbb1-1973617d8031. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:01:50.386927 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4ebc762b-a10f-487d-96b9-9d2fb6e43860 req-2c264d4b-35e8-42be-8b54-52d10528e62d service nova] Acquiring lock "refresh_cache-be4a8d87-07fc-4c56-a68d-c95e98e99184" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:01:50.696455 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:01:50.699951 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:01:50.711220 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Releasing lock "refresh_cache-be4a8d87-07fc-4c56-a68d-c95e98e99184" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:01:50.711491 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Instance network_info: |[{"id": "1ea26412-1950-4e22-bbb1-1973617d8031", "address": "fa:16:3e:a8:9a:37", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ea26412-19", "ovs_interfaceid": "1ea26412-1950-4e22-bbb1-1973617d8031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:01:50.713095 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4ebc762b-a10f-487d-96b9-9d2fb6e43860 req-2c264d4b-35e8-42be-8b54-52d10528e62d service nova] Acquired lock "refresh_cache-be4a8d87-07fc-4c56-a68d-c95e98e99184" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:01:50.713095 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-4ebc762b-a10f-487d-96b9-9d2fb6e43860 req-2c264d4b-35e8-42be-8b54-52d10528e62d service nova] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Refreshing network info cache for port 1ea26412-1950-4e22-bbb1-1973617d8031 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:01:50.715538 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Start _get_guest_xml network_info=[{"id": "1ea26412-1950-4e22-bbb1-1973617d8031", "address": "fa:16:3e:a8:9a:37", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ea26412-19", "ovs_interfaceid": "1ea26412-1950-4e22-bbb1-1973617d8031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:01:50.717211 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:01:50.717211 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:01:50.722032 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:01:50.722032 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:50.728312 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:01:50.728312 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-1917823640', uuid='be4a8d87-07fc-4c56-a68d-c95e98e99184'), owner=OwnerMeta(userid='9297977bbf334232a4a74bd6808b863b', username='tempest-AttachVolumeNegativeTest-775348461-project-member', projectid='9a85ba31f98b45b6974118c6560bbc53', projectname='tempest-AttachVolumeNegativeTest-775348461'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1ea26412-1950-4e22-bbb1-1973617d8031", "address": "fa:16:3e:a8:9a:37", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ea26412-19", "ovs_interfaceid": "1ea26412-1950-4e22-bbb1-1973617d8031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962510.7273922) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:01:50.729800 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:01:50.733294 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:01:50.738188 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:50.740454 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:50.746920 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:01:50.747799 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:01:50.751622 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:01:50.752103 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:01:50.752371 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:01:50.752611 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:01:50.752749 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:01:50.752868 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:01:50.753004 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:01:50.753396 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:01:50.753586 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:01:50.753764 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:01:50.753919 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:01:50.754091 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:01:50.772842 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:50.772842 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:50.772842 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:50.772842 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:50.772842 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:50.772842 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:50.772842 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:50.772842 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:50.772842 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:01:50.773415 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:50.773415 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:50.773415 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:50.773415 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:50.773415 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:50.773415 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:50.773415 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:50.773415 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:50.773415 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:01:50.775015 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:50.775015 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:50.775015 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:50.775015 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:50.775015 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:50.775015 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:50.775015 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:50.775015 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:50.775015 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:01:50.775015 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:50.775015 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:50.775015 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:50.775015 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:50.775015 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:50.775015 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:50.775015 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:50.775015 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:50.775015 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:01:50.788148 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1917823640',display_name='tempest-AttachVolumeNegativeTest-server-1917823640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumenegativetest-server-1917823640',id=29,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB6c+QCw/AdOf+ZOgKO6yIV552TVvTkOSaB9WPqx5hvwrQIbdotDEw/LD/omU6NVAEAhSrCIDNsYD/OY2ax4OJVHjPLtIdFYcMC6ZhGSh8+zNtXWNXjQbUVBOSp/A0mGOA==',key_name='tempest-keypair-1974157475',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a85ba31f98b45b6974118c6560bbc53',ramdisk_id='',reservation_id='r-qv0l4o4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-775348461',owner_user_name='tempest-AttachVolumeNegativeTest-775348461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:01:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9297977bbf334232a4a74bd6808b863b',uuid=be4a8d87-07fc-4c56-a68d-c95e98e99184,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ea26412-1950-4e22-bbb1-1973617d8031", "address": "fa:16:3e:a8:9a:37", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ea26412-19", "ovs_interfaceid": "1ea26412-1950-4e22-bbb1-1973617d8031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:01:50.788713 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Converting VIF {"id": "1ea26412-1950-4e22-bbb1-1973617d8031", "address": "fa:16:3e:a8:9a:37", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ea26412-19", "ovs_interfaceid": "1ea26412-1950-4e22-bbb1-1973617d8031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:01:50.789566 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:9a:37,bridge_name='br-int',has_traffic_filtering=True,id=1ea26412-1950-4e22-bbb1-1973617d8031,network=Network(bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ea26412-19') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:01:50.790445 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lazy-loading 'pci_devices' on Instance uuid be4a8d87-07fc-4c56-a68d-c95e98e99184 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:01:50.822776 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b, portal: 192.168.40.100,3260]
May 28 10:01:50.822776 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b, portal: 192.168.40.100,3260] successful.
May 28 10:01:50.822776 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:50.836775 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b, portal: 192.168.50.100,3260]
May 28 10:01:50.836775 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b, portal: 192.168.50.100,3260] successful.
May 28 10:01:50.836775 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:50.838406 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:50.853719 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:50.856116 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:50.868561 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:50.868561 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:50.868561 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:50.868561 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:50.868561 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:50.868561 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:50.868561 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:50.868561 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:50.868561 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:50.868561 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:50.868561 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:01:50.868985 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:50.868985 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:50.868985 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:50.868985 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:50.868985 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:50.868985 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:50.868985 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:50.868985 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:50.868985 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:50.868985 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:50.868985 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:01:50.869310 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.208s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:01:50.869310 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:01:50.871516 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] HCTL ('11', '-', '-', 0) found on session 47 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:01:50.871736 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:01:50.883847 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:50.883847 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:50.883847 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:50.883847 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:50.883847 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:50.883847 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:50.883847 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:50.883847 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:50.883847 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:50.883847 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:50.883847 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:01:50.884264 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:50.884264 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:50.884264 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:50.884264 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:50.884264 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:50.884264 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:50.884264 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:50.884264 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:50.884264 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:50.884264 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:50.884264 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:01:50.884542 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.222s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:01:50.884542 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:01:50.885555 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] HCTL ('12', '-', '-', 0) found on session 48 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:01:50.885845 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:01:50.899178 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Searching for a device in session 47 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:01:50.899408 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c1f00235-beec-448a-ae55-17b46aa31e9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:01:50.907774 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Searching for a device in session 48 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:01:50.907774 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c1f00235-beec-448a-ae55-17b46aa31e9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:01:50.956249 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:01:50.956249 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:01:51.217254 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-4ebc762b-a10f-487d-96b9-9d2fb6e43860 req-2c264d4b-35e8-42be-8b54-52d10528e62d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:51.221028 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:51.295660 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] End _get_guest_xml xml=<domain type="qemu">
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:   <uuid>be4a8d87-07fc-4c56-a68d-c95e98e99184</uuid>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:   <name>instance-0000001d</name>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1917823640</nova:name>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:01:50</nova:creationTime>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:         <nova:user uuid="9297977bbf334232a4a74bd6808b863b">tempest-AttachVolumeNegativeTest-775348461-project-member</nova:user>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:         <nova:project uuid="9a85ba31f98b45b6974118c6560bbc53">tempest-AttachVolumeNegativeTest-775348461</nova:project>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:         <nova:port uuid="1ea26412-1950-4e22-bbb1-1973617d8031">
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:     <system>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:       <entry name="serial">be4a8d87-07fc-4c56-a68d-c95e98e99184</entry>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:       <entry name="uuid">be4a8d87-07fc-4c56-a68d-c95e98e99184</entry>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:     </system>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:   <os>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:   </os>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:   <features>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:   </features>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:   <devices>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/be4a8d87-07fc-4c56-a68d-c95e98e99184/disk"/>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:     </disk>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/be4a8d87-07fc-4c56-a68d-c95e98e99184/disk.config"/>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:     </disk>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:a8:9a:37"/>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:       <target dev="tap1ea26412-19"/>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:     </interface>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/be4a8d87-07fc-4c56-a68d-c95e98e99184/console.log" append="off"/>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:     </serial>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:     <video>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:     </video>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:     </rng>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:   </devices>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]: </domain>
May 28 10:01:51.295660 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:01:51.298939 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Preparing to wait for external event network-vif-plugged-1ea26412-1950-4e22-bbb1-1973617d8031 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:01:51.298939 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "be4a8d87-07fc-4c56-a68d-c95e98e99184-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:51.298939 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "be4a8d87-07fc-4c56-a68d-c95e98e99184-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:51.298939 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "be4a8d87-07fc-4c56-a68d-c95e98e99184-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:51.298939 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1917823640',display_name='tempest-AttachVolumeNegativeTest-server-1917823640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumenegativetest-server-1917823640',id=29,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB6c+QCw/AdOf+ZOgKO6yIV552TVvTkOSaB9WPqx5hvwrQIbdotDEw/LD/omU6NVAEAhSrCIDNsYD/OY2ax4OJVHjPLtIdFYcMC6ZhGSh8+zNtXWNXjQbUVBOSp/A0mGOA==',key_name='tempest-keypair-1974157475',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a85ba31f98b45b6974118c6560bbc53',ramdisk_id='',reservation_id='r-qv0l4o4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-775348461',owner_user_name='tempest-AttachVolumeNegativeTest-775348461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:01:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9297977bbf334232a4a74bd6808b863b',uuid=be4a8d87-07fc-4c56-a68d-c95e98e99184,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ea26412-1950-4e22-bbb1-1973617d8031", "address": "fa:16:3e:a8:9a:37", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ea26412-19", "ovs_interfaceid": "1ea26412-1950-4e22-bbb1-1973617d8031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:01:51.298939 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Converting VIF {"id": "1ea26412-1950-4e22-bbb1-1973617d8031", "address": "fa:16:3e:a8:9a:37", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ea26412-19", "ovs_interfaceid": "1ea26412-1950-4e22-bbb1-1973617d8031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:01:51.298939 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:9a:37,bridge_name='br-int',has_traffic_filtering=True,id=1ea26412-1950-4e22-bbb1-1973617d8031,network=Network(bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ea26412-19') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:01:51.299614 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:9a:37,bridge_name='br-int',has_traffic_filtering=True,id=1ea26412-1950-4e22-bbb1-1973617d8031,network=Network(bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ea26412-19') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:01:51.300061 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:51.300375 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:51.300719 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:01:51.301679 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:51.301939 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e6fd82d3-cf90-5c98-85c8-5046fda40ee5', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:51.302888 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:51.305774 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:01:51.307905 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:51.308235 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ea26412-19, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:51.308655 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1ea26412-19, col_values=(('qos', UUID('ee67141c-1156-4e8d-adb8-e16c8c70f3d5')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:51.308916 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1ea26412-19, col_values=(('external_ids', {'iface-id': '1ea26412-1950-4e22-bbb1-1973617d8031', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:9a:37', 'vm-uuid': 'be4a8d87-07fc-4c56-a68d-c95e98e99184'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:51.309820 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:51.312488 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:01:51.317938 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:51.319284 np0000001613 nova-compute[98321]: INFO os_vif [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:9a:37,bridge_name='br-int',has_traffic_filtering=True,id=1ea26412-1950-4e22-bbb1-1973617d8031,network=Network(bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ea26412-19')
May 28 10:01:51.461070 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:01:51.552921 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-4ebc762b-a10f-487d-96b9-9d2fb6e43860 req-2c264d4b-35e8-42be-8b54-52d10528e62d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:51.663185 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:01:51.709356 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-4ebc762b-a10f-487d-96b9-9d2fb6e43860 req-2c264d4b-35e8-42be-8b54-52d10528e62d service nova] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Updated VIF entry in instance network info cache for port 1ea26412-1950-4e22-bbb1-1973617d8031. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:01:51.709656 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-4ebc762b-a10f-487d-96b9-9d2fb6e43860 req-2c264d4b-35e8-42be-8b54-52d10528e62d service nova] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Updating instance_info_cache with network_info: [{"id": "1ea26412-1950-4e22-bbb1-1973617d8031", "address": "fa:16:3e:a8:9a:37", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ea26412-19", "ovs_interfaceid": "1ea26412-1950-4e22-bbb1-1973617d8031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:01:51.970275 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 3.036s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:51.971374 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Migrating
May 28 10:01:51.971784 np0000001613 nova-compute[98321]: DEBUG nova.compute.rpcapi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98321) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 10:01:51.979602 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.673s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:51.980260 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.009s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:51.980602 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Auditing locally available compute resources for np0000001613 (node: np0000001613) {{(pid=98321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 10:01:51.983865 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.128s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:51.990325 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:01:51.990539 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Claim successful on node np0000001613
May 28 10:01:52.213697 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4ebc762b-a10f-487d-96b9-9d2fb6e43860 req-2c264d4b-35e8-42be-8b54-52d10528e62d service nova] Releasing lock "refresh_cache-be4a8d87-07fc-4c56-a68d-c95e98e99184" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:01:52.508194 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Acquiring lock "refresh_cache-b90b1ecd-e640-4f4e-bd02-fb74021db82b" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:01:52.508194 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Acquired lock "refresh_cache-b90b1ecd-e640-4f4e-bd02-fb74021db82b" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:01:52.508194 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:01:52.682862 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Found WWN 3300000001cad31b7 for multipath device dm-1 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:01:52.683237 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:01:52.683469 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] <== connect_volume: return (5658ms) {'type': 'block', 'scsi_wwn': '3300000001cad31b7', 'path': '/dev/dm-1', 'multipath_id': '3300000001cad31b7'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:01:52.683664 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001cad31b7', 'path': '/dev/dm-1', 'multipath_id': '3300000001cad31b7'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:01:52.684602 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 5.506s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:01:52.685255 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83485657-e133-49aa-baed-d67cb2fd1720', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:01:52.685532 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:01:52.714613 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:52.714613 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:52.714613 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:52.714613 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:52.714613 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:52.714613 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:52.714613 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:52.714613 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:52.714613 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:52.714613 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:52.714613 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:01:52.714613 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:52.714613 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:52.714613 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:52.714613 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:52.714613 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:52.714613 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:52.714613 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:52.714613 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:52.714613 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:52.714613 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:52.714613 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:01:52.714613 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', '42'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0', '45'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', '47'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', '48')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:01:52.714613 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720, 0): [] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:01:52.715468 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720') {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 10:01:52.715468 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720, 0): [] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:01:52.715468 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720') {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 10:01:52.715468 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc7cad40>, {}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:01:52.715953 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Disconnecting from: [] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:01:52.716247 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.032s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:01:52.716596 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] <== disconnect_volume: return (5537ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:01:52.716740 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:01:52.720657 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.561s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:01:52.720977 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04', 'iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '714453c0-1620-406b-ae4c-f244696a4a04', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:01:52.736112 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:01:52.737154 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:01:52.737488 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:01:52.737738 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:01:52.738221 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:01:52.738416 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:01:52.752187 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:01:52.752187 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:52.762634 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:01:52.762634 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:52.767623 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04] added
May 28 10:01:52.767623 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:01:52.767623 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:01:52.767623 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:01:52.767623 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:01:52.767623 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:01:52.767623 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:52.767934 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:01:52.768018 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0295(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:01:52.768158 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:01:52.776381 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04] added
May 28 10:01:52.776381 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:01:52.776381 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:01:52.776381 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:01:52.776381 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:01:52.776381 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:01:52.776381 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:52.776678 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:01:52.776722 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.039(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:01:52.776971 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:01:52.837636 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:01:52.837798 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:01:52.837987 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] No VIF found with MAC fa:16:3e:a8:9a:37, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:01:52.838849 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Using config drive
May 28 10:01:53.008832 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:53.043275 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:53.143609 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:53.144294 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:53.191232 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:01:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1421682824',display_name='tempest-ServerActionsTestOtherA-server-1421682824',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001613',hostname='tempest-serveractionstestothera-server-1421682824',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLNPaTs6CM9Wbie8XPRW8vQPbkYzxhmauw/kdujNoZe8MNOaDeh6K3tCu7L1IAoOGDytj5meJ0gvP/71uSisLwWlqhLyhBtEZHSZo7u74E1cepcGRGEWdNqJct6TYM6oQ==',key_name='tempest-keypair-320562480',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:01:22Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001613',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cb3a501b4f4041ef875ef4d2b4167044',ramdisk_id='',reservation_id='r-a0c5gebp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1557455944',owner_user_name='tempest-ServerActionsTestOtherA-1557455944-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:01:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62efa57da85f458790f3ceeebcc777a7',uuid=49f53c82-6f7e-4d09-a471-26bd4fdc02e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55556967-1d07-4f3b-bc07-6692ef9de17b", "address": "fa:16:3e:d2:27:b6", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1771401192-network", "vif_mac": "fa:16:3e:d2:27:b6"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55556967-1d", "ovs_interfaceid": "55556967-1d07-4f3b-bc07-6692ef9de17b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:01:53.191697 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Converting VIF {"id": "55556967-1d07-4f3b-bc07-6692ef9de17b", "address": "fa:16:3e:d2:27:b6", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1771401192-network", "vif_mac": "fa:16:3e:d2:27:b6"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55556967-1d", "ovs_interfaceid": "55556967-1d07-4f3b-bc07-6692ef9de17b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:01:53.192633 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:27:b6,bridge_name='br-int',has_traffic_filtering=True,id=55556967-1d07-4f3b-bc07-6692ef9de17b,network=Network(2ae47a43-582b-442f-922d-fe7138b431a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55556967-1d') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:01:53.196770 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] End _get_guest_xml xml=<domain type="qemu">
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:   <uuid>49f53c82-6f7e-4d09-a471-26bd4fdc02e7</uuid>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:   <name>instance-00000019</name>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:   <memory>262144</memory>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:       <nova:name>tempest-ServerActionsTestOtherA-server-1421682824</nova:name>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:01:46</nova:creationTime>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.micro" id="84">
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:         <nova:memory>256</nova:memory>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:       <nova:image uuid="">
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:         <nova:user uuid="62efa57da85f458790f3ceeebcc777a7">tempest-ServerActionsTestOtherA-1557455944-project-member</nova:user>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:         <nova:project uuid="cb3a501b4f4041ef875ef4d2b4167044">tempest-ServerActionsTestOtherA-1557455944</nova:project>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:       <nova:root type="volume" uuid=""/>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:         <nova:port uuid="55556967-1d07-4f3b-bc07-6692ef9de17b">
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:     <system>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:       <entry name="serial">49f53c82-6f7e-4d09-a471-26bd4fdc02e7</entry>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:       <entry name="uuid">49f53c82-6f7e-4d09-a471-26bd4fdc02e7</entry>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:     </system>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:   <os>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:   </os>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:   <features>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:   </features>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:   <devices>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/49f53c82-6f7e-4d09-a471-26bd4fdc02e7/disk.config"/>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:     </disk>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:       <alias name="ua-c1f00235-beec-448a-ae55-17b46aa31e9b"/>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-1"/>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:       <serial>c1f00235-beec-448a-ae55-17b46aa31e9b</serial>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:     </disk>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:d2:27:b6"/>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:       <target dev="tap55556967-1d"/>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:     </interface>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/49f53c82-6f7e-4d09-a471-26bd4fdc02e7/console.log" append="off"/>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:     </serial>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:     <video>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:     </video>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:     </rng>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:   </devices>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]: </domain>
May 28 10:01:53.196770 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:01:53.196770 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:01:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1421682824',display_name='tempest-ServerActionsTestOtherA-server-1421682824',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001613',hostname='tempest-serveractionstestothera-server-1421682824',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLNPaTs6CM9Wbie8XPRW8vQPbkYzxhmauw/kdujNoZe8MNOaDeh6K3tCu7L1IAoOGDytj5meJ0gvP/71uSisLwWlqhLyhBtEZHSZo7u74E1cepcGRGEWdNqJct6TYM6oQ==',key_name='tempest-keypair-320562480',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:01:22Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001613',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cb3a501b4f4041ef875ef4d2b4167044',ramdisk_id='',reservation_id='r-a0c5gebp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1557455944',owner_user_name='tempest-ServerActionsTestOtherA-1557455944-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:01:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62efa57da85f458790f3ceeebcc777a7',uuid=49f53c82-6f7e-4d09-a471-26bd4fdc02e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55556967-1d07-4f3b-bc07-6692ef9de17b", "address": "fa:16:3e:d2:27:b6", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1771401192-network", "vif_mac": "fa:16:3e:d2:27:b6"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55556967-1d", "ovs_interfaceid": "55556967-1d07-4f3b-bc07-6692ef9de17b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:01:53.196770 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Converting VIF {"id": "55556967-1d07-4f3b-bc07-6692ef9de17b", "address": "fa:16:3e:d2:27:b6", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1771401192-network", "vif_mac": "fa:16:3e:d2:27:b6"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55556967-1d", "ovs_interfaceid": "55556967-1d07-4f3b-bc07-6692ef9de17b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:01:53.196770 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:27:b6,bridge_name='br-int',has_traffic_filtering=True,id=55556967-1d07-4f3b-bc07-6692ef9de17b,network=Network(2ae47a43-582b-442f-922d-fe7138b431a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55556967-1d') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:01:53.196770 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:27:b6,bridge_name='br-int',has_traffic_filtering=True,id=55556967-1d07-4f3b-bc07-6692ef9de17b,network=Network(2ae47a43-582b-442f-922d-fe7138b431a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55556967-1d') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:01:53.196770 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:53.196770 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:53.203901 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:01:53.203901 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:53.203901 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9d4dcea8-641d-5353-a8e1-5fc6e9bfd9ed', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:53.203901 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:53.203901 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:01:53.209249 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:53.216189 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:53.216189 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap55556967-1d, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:53.216189 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap55556967-1d, col_values=(('qos', UUID('ce4cb929-1e59-43d4-ab32-26c348a2dd40')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:53.216189 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap55556967-1d, col_values=(('external_ids', {'iface-id': '55556967-1d07-4f3b-bc07-6692ef9de17b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:27:b6', 'vm-uuid': '49f53c82-6f7e-4d09-a471-26bd4fdc02e7'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:53.216189 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:53.216189 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:01:53.227526 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:53.236280 np0000001613 nova-compute[98321]: INFO os_vif [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:27:b6,bridge_name='br-int',has_traffic_filtering=True,id=55556967-1d07-4f3b-bc07-6692ef9de17b,network=Network(2ae47a43-582b-442f-922d-fe7138b431a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55556967-1d')
May 28 10:01:53.247370 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:53.250666 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-3 (vdb) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:01:53.255380 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3edc00a8-2c60-4c44-acb8-6f4d02114bf0/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:53.347798 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:53.369296 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3edc00a8-2c60-4c44-acb8-6f4d02114bf0/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:53.369837 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3edc00a8-2c60-4c44-acb8-6f4d02114bf0/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:53.484518 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3edc00a8-2c60-4c44-acb8-6f4d02114bf0/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:53.490677 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:53.575835 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Creating config drive at /opt/stack/data/nova/instances/be4a8d87-07fc-4c56-a68d-c95e98e99184/disk.config
May 28 10:01:53.584664 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/be4a8d87-07fc-4c56-a68d-c95e98e99184/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzrk16j5o {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:53.603202 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:53.603202 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:53.630559 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:53.649930 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/be4a8d87-07fc-4c56-a68d-c95e98e99184/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzrk16j5o" returned: 0 in 0.066s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:53.733213 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:53.743490 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:01:53.749849 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk.rescue --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:53.776277 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:01:53.800352 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:01:53.820142 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:01:53.820142 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:01:53.832375 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:01:53.832375 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:53.851371 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:53.853461 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:53.876512 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:53.876512 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:53.876512 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:53.876512 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:53.876512 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:53.876512 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:53.876512 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:53.876512 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:53.876512 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:53.876512 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:53.876512 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:01:53.877020 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:53.877020 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:53.877020 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:53.877020 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:53.877020 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:53.877020 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:53.877020 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:53.877020 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:53.877020 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:53.877020 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:53.877020 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:01:53.879807 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:53.881271 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk.rescue --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:53.903328 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:53.903328 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:53.903328 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:53.903328 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:53.903328 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:53.903328 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:53.903328 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:53.903328 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:53.903328 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:53.903328 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:53.903328 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:01:53.903896 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:53.903896 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:53.903896 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:53.903896 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:53.903896 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:53.903896 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:53.903896 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:53.903896 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:53.903896 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:53.903896 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:53.903896 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:01:53.930012 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04, portal: 192.168.50.100,3260]
May 28 10:01:53.930012 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04, portal: 192.168.50.100,3260] successful.
May 28 10:01:53.930012 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:53.945795 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Updating instance_info_cache with network_info: [{"id": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "address": "fa:16:3e:b1:88:d2", "network": {"id": "9d46c174-21e3-464e-83c9-e8db18f486a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-151012625-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e1727c7fbc44459c6972d182fc25b1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a01cd4-8a", "ovs_interfaceid": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:01:53.958227 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:53.961593 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04, portal: 192.168.40.100,3260]
May 28 10:01:53.961593 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04, portal: 192.168.40.100,3260] successful.
May 28 10:01:53.961593 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:53.982917 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:53.984108 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:53.984108 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:53.984108 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:53.984108 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:53.984108 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:53.984108 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:53.984108 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:53.984108 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:53.984108 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:53.984108 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:53.984108 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:01:53.984108 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:01:53.984108 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:01:53.984108 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:53.984108 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:53.984108 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:53.984108 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:53.984108 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:53.984108 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:53.984108 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:53.984108 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:53.984108 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:53.984108 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:53.984108 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:01:53.984108 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:01:53.984108 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:01:53.984108 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.246s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:01:53.984959 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:01:53.987198 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] HCTL ('17', '-', '-', 0) found on session 49 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:01:53.987198 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:01:53.999142 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk.rescue --force-share --output=json" returned: 0 in 0.118s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:54.000947 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:54.030272 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Searching for a device in session 49 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:01:54.030272 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '714453c0-1620-406b-ae4c-f244696a4a04', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:01:54.030272 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:54.030272 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:54.030272 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:54.030272 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:54.030272 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:54.030272 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:54.030272 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:54.030272 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:54.030272 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:54.030272 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:54.030272 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:01:54.030272 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:01:54.030272 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:01:54.030272 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:54.030272 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:54.030272 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:54.030272 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:54.030272 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:54.030272 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:54.030272 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:54.030272 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:54.030272 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:54.030272 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:54.030272 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:01:54.030272 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:01:54.030272 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:01:54.030272 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.292s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:01:54.030272 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:01:54.031043 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] HCTL ('18', '-', '-', 0) found on session 50 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:01:54.031043 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:01:54.052137 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Preparing to wait for external event volume-reimaged-83485657-e133-49aa-baed-d67cb2fd1720 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:01:54.054827 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Acquiring lock "9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:54.054827 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lock "9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:54.054827 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lock "9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:54.066710 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Searching for a device in session 50 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:01:54.066894 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '714453c0-1620-406b-ae4c-f244696a4a04', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:01:54.125081 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk --force-share --output=json" returned: 0 in 0.125s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:54.125703 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:54.259917 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:54.262844 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:54.271745 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-5 (vda) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:01:54.309028 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:54.345416 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:54.435343 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:54.455639 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Releasing lock "refresh_cache-b90b1ecd-e640-4f4e-bd02-fb74021db82b" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:01:54.515683 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4a8d87-07fc-4c56-a68d-c95e98e99184/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:54.535061 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:01:54.536953 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:01:54.546189 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-da81a395-dcc5-4c30-ac02-2a2313849b97 req-f1e9ae98-c912-4d1f-bb94-7e9258a962e0 service nova] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Received event network-vif-plugged-1ea26412-1950-4e22-bbb1-1973617d8031 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:54.546330 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-da81a395-dcc5-4c30-ac02-2a2313849b97 req-f1e9ae98-c912-4d1f-bb94-7e9258a962e0 service nova] Acquiring lock "be4a8d87-07fc-4c56-a68d-c95e98e99184-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:54.546681 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-da81a395-dcc5-4c30-ac02-2a2313849b97 req-f1e9ae98-c912-4d1f-bb94-7e9258a962e0 service nova] Lock "be4a8d87-07fc-4c56-a68d-c95e98e99184-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:54.546950 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-da81a395-dcc5-4c30-ac02-2a2313849b97 req-f1e9ae98-c912-4d1f-bb94-7e9258a962e0 service nova] Lock "be4a8d87-07fc-4c56-a68d-c95e98e99184-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:54.547217 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-da81a395-dcc5-4c30-ac02-2a2313849b97 req-f1e9ae98-c912-4d1f-bb94-7e9258a962e0 service nova] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Processing event network-vif-plugged-1ea26412-1950-4e22-bbb1-1973617d8031 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:01:54.618123 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4a8d87-07fc-4c56-a68d-c95e98e99184/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:54.619835 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4a8d87-07fc-4c56-a68d-c95e98e99184/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:54.718394 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:54.720961 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4a8d87-07fc-4c56-a68d-c95e98e99184/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:54.727187 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:54.743805 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:54.750944 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:01:54.770082 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:54.779240 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:54.823290 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:01:54.826692 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:01:54.828758 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:54.828897 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] No VIF found with MAC fa:16:3e:d2:27:b6, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:01:54.829924 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:54.831511 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Using config drive
May 28 10:01:54.920596 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:54.923688 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:55.020931 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:55.021431 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:55.047282 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:01:55.128718 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:55.132803 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:55.153731 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0033133090000774246 future=<Future at 0x73c205a67290 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:01:55.155792 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1779962500.1475759, 49f53c82-6f7e-4d09-a471-26bd4fdc02e7 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:01:55.156239 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:01:55.156468 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=6.047924276000231 future=<Future at 0x73c1f470cbc0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:01:55.156622 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=6.047756986000195 future=<Future at 0x73c1f470cbc0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:01:55.157318 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] VM Stopped (Lifecycle Event)
May 28 10:01:55.229980 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:55.230378 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:55.311105 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962515.3104916, be4a8d87-07fc-4c56-a68d-c95e98e99184 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:01:55.311323 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] VM Started (Lifecycle Event)
May 28 10:01:55.314367 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:01:55.316563 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:55.321301 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:55.321301 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:01:55.346685 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:55.354199 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Instance spawned successfully.
May 28 10:01:55.354807 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:01:55.371242 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:55.429322 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:55.429995 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:55.482311 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:55.528738 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:55.542571 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:01:55.543986 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:55.560783 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:55.567089 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.582s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:55.567397 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:01:55.585342 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6cfbacaf-fd76-4b96-978a-15ebf070fbbc req-55321eed-b856-4a86-88ca-d7368fc66adb service nova] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Received event network-vif-plugged-55556967-1d07-4f3b-bc07-6692ef9de17b {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:55.585342 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6cfbacaf-fd76-4b96-978a-15ebf070fbbc req-55321eed-b856-4a86-88ca-d7368fc66adb service nova] Acquiring lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:55.585440 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6cfbacaf-fd76-4b96-978a-15ebf070fbbc req-55321eed-b856-4a86-88ca-d7368fc66adb service nova] Lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:55.585594 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6cfbacaf-fd76-4b96-978a-15ebf070fbbc req-55321eed-b856-4a86-88ca-d7368fc66adb service nova] Lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:55.585777 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6cfbacaf-fd76-4b96-978a-15ebf070fbbc req-55321eed-b856-4a86-88ca-d7368fc66adb service nova] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] No waiting events found dispatching network-vif-plugged-55556967-1d07-4f3b-bc07-6692ef9de17b {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:01:55.585929 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-6cfbacaf-fd76-4b96-978a-15ebf070fbbc req-55321eed-b856-4a86-88ca-d7368fc66adb service nova] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Received unexpected event network-vif-plugged-55556967-1d07-4f3b-bc07-6692ef9de17b for instance with vm_state active and task_state resize_finish.
May 28 10:01:55.587128 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "env LANG=C uptime" returned: 0 in 0.043s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:55.587305 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Hypervisor/Node resource view: name=np0000001613 free_ram=11190MB free_disk=74.2896499633789GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 10:01:55.587625 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:55.587801 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:55.664647 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-4ebe5eac-5fbf-4b5d-b47d-693e5a8cdb01 None None] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:01:55.774869 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Found WWN 3300000001f9fa0ab for multipath device dm-11 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:01:55.774869 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.058s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:01:55.774869 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] <== connect_volume: return (5618ms) {'type': 'block', 'scsi_wwn': '3300000001f9fa0ab', 'path': '/dev/dm-11', 'multipath_id': '3300000001f9fa0ab'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:01:55.776605 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001f9fa0ab', 'path': '/dev/dm-11', 'multipath_id': '3300000001f9fa0ab'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:01:55.820656 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:01:55.829405 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:01:55.867502 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:01:55.867502 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:01:55.867502 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:01:55.867502 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:01:55.868511 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:01:55.868511 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:01:55.983644 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Starting migrate_disk_and_power_off {{(pid=98321) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 28 10:01:56.013370 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:56.019998 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:56.044158 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:56.076926 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:01:56.077363 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:01:56.077825 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:56.077877 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:56.081641 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:56.193720 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13481913e22d4bf1a94e1a9a270f5494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3403b533910644d2b254922fb84b1ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:01:56.254960 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-135ea56b-2d60-4f2e-ae5b-5a2e4b3a576a req-f5ec4fed-dc41-43c2-9b44-4368997935d9 service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Received event network-vif-unplugged-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:56.256060 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-135ea56b-2d60-4f2e-ae5b-5a2e4b3a576a req-f5ec4fed-dc41-43c2-9b44-4368997935d9 service nova] Acquiring lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:56.256557 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-135ea56b-2d60-4f2e-ae5b-5a2e4b3a576a req-f5ec4fed-dc41-43c2-9b44-4368997935d9 service nova] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:56.256746 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-135ea56b-2d60-4f2e-ae5b-5a2e4b3a576a req-f5ec4fed-dc41-43c2-9b44-4368997935d9 service nova] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:56.256915 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-135ea56b-2d60-4f2e-ae5b-5a2e4b3a576a req-f5ec4fed-dc41-43c2-9b44-4368997935d9 service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] No waiting events found dispatching network-vif-unplugged-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:01:56.257786 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-135ea56b-2d60-4f2e-ae5b-5a2e4b3a576a req-f5ec4fed-dc41-43c2-9b44-4368997935d9 service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Received unexpected event network-vif-unplugged-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 for instance with vm_state active and task_state resize_migrating.
May 28 10:01:56.287979 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:01:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733955908',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-733955908',id=26,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDXMJyVhJWTJeHgrZbBiUGgXmjuhwbUVd2Kr7gMNTj4c2UOOPJTFYxL/+LAZETaDNBqelxft20PeTjvHZIXg32AtTWPekPM83zplKnShpnzBc89MemVKDq6yaEiiy5EMA==',key_name='tempest-keypair-328174998',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb5bac5cd317420ab74fc9f416a80e59',ramdisk_id='',reservation_id='r-mwck76pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1732945749',owner_user_name='tempest-TaggedBootDevicesTest-1732945749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:01:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4253d01a8baa41978a589f90a58d945d',uuid=03313f66-d1dd-4269-b2e9-3b0796217299,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12bb71f4-467b-4cc8-b164-f795401a0117", "address": "fa:16:3e:af:c7:36", "network": {"id": "1008534f-5c0f-4968-962e-d7e533fcc852", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1379747783-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12bb71f4-46", "ovs_interfaceid": "12bb71f4-467b-4cc8-b164-f795401a0117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:01:56.288484 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converting VIF {"id": "12bb71f4-467b-4cc8-b164-f795401a0117", "address": "fa:16:3e:af:c7:36", "network": {"id": "1008534f-5c0f-4968-962e-d7e533fcc852", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1379747783-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12bb71f4-46", "ovs_interfaceid": "12bb71f4-467b-4cc8-b164-f795401a0117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:01:56.292415 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:c7:36,bridge_name='br-int',has_traffic_filtering=True,id=12bb71f4-467b-4cc8-b164-f795401a0117,network=Network(1008534f-5c0f-4968-962e-d7e533fcc852),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12bb71f4-46') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:01:56.293935 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:01:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733955908',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-733955908',id=26,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDXMJyVhJWTJeHgrZbBiUGgXmjuhwbUVd2Kr7gMNTj4c2UOOPJTFYxL/+LAZETaDNBqelxft20PeTjvHZIXg32AtTWPekPM83zplKnShpnzBc89MemVKDq6yaEiiy5EMA==',key_name='tempest-keypair-328174998',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb5bac5cd317420ab74fc9f416a80e59',ramdisk_id='',reservation_id='r-mwck76pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1732945749',owner_user_name='tempest-TaggedBootDevicesTest-1732945749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:01:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4253d01a8baa41978a589f90a58d945d',uuid=03313f66-d1dd-4269-b2e9-3b0796217299,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f218cf2-d351-42a5-8b44-3e7ee9417bbd", "address": "fa:16:3e:24:b3:6a", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f218cf2-d3", "ovs_interfaceid": "9f218cf2-d351-42a5-8b44-3e7ee9417bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:01:56.294305 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converting VIF {"id": "9f218cf2-d351-42a5-8b44-3e7ee9417bbd", "address": "fa:16:3e:24:b3:6a", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f218cf2-d3", "ovs_interfaceid": "9f218cf2-d351-42a5-8b44-3e7ee9417bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:01:56.294933 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:b3:6a,bridge_name='br-int',has_traffic_filtering=True,id=9f218cf2-d351-42a5-8b44-3e7ee9417bbd,network=Network(7c6d76e7-89ec-4a10-a21c-11c44b491f29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9f218cf2-d3') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:01:56.300323 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:01:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733955908',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-733955908',id=26,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDXMJyVhJWTJeHgrZbBiUGgXmjuhwbUVd2Kr7gMNTj4c2UOOPJTFYxL/+LAZETaDNBqelxft20PeTjvHZIXg32AtTWPekPM83zplKnShpnzBc89MemVKDq6yaEiiy5EMA==',key_name='tempest-keypair-328174998',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb5bac5cd317420ab74fc9f416a80e59',ramdisk_id='',reservation_id='r-mwck76pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1732945749',owner_user_name='tempest-TaggedBootDevicesTest-1732945749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:01:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4253d01a8baa41978a589f90a58d945d',uuid=03313f66-d1dd-4269-b2e9-3b0796217299,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2c9fb75-0a9e-47cb-a561-effaa19b4156", "address": "fa:16:3e:5d:f9:89", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c9fb75-0a", "ovs_interfaceid": "c2c9fb75-0a9e-47cb-a561-effaa19b4156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:01:56.300323 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converting VIF {"id": "c2c9fb75-0a9e-47cb-a561-effaa19b4156", "address": "fa:16:3e:5d:f9:89", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c9fb75-0a", "ovs_interfaceid": "c2c9fb75-0a9e-47cb-a561-effaa19b4156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:01:56.300794 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:f9:89,bridge_name='br-int',has_traffic_filtering=True,id=c2c9fb75-0a9e-47cb-a561-effaa19b4156,network=Network(7c6d76e7-89ec-4a10-a21c-11c44b491f29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc2c9fb75-0a') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:01:56.302763 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:01:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733955908',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-733955908',id=26,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDXMJyVhJWTJeHgrZbBiUGgXmjuhwbUVd2Kr7gMNTj4c2UOOPJTFYxL/+LAZETaDNBqelxft20PeTjvHZIXg32AtTWPekPM83zplKnShpnzBc89MemVKDq6yaEiiy5EMA==',key_name='tempest-keypair-328174998',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb5bac5cd317420ab74fc9f416a80e59',ramdisk_id='',reservation_id='r-mwck76pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1732945749',owner_user_name='tempest-TaggedBootDevicesTest-1732945749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:01:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4253d01a8baa41978a589f90a58d945d',uuid=03313f66-d1dd-4269-b2e9-3b0796217299,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5", "address": "fa:16:3e:a3:f3:65", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7db2f4e-c4", "ovs_interfaceid": "d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:01:56.303752 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converting VIF {"id": "d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5", "address": "fa:16:3e:a3:f3:65", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7db2f4e-c4", "ovs_interfaceid": "d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:01:56.304490 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:f3:65,bridge_name='br-int',has_traffic_filtering=True,id=d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5,network=Network(7c6d76e7-89ec-4a10-a21c-11c44b491f29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7db2f4e-c4') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:01:56.306118 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:01:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733955908',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-733955908',id=26,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDXMJyVhJWTJeHgrZbBiUGgXmjuhwbUVd2Kr7gMNTj4c2UOOPJTFYxL/+LAZETaDNBqelxft20PeTjvHZIXg32AtTWPekPM83zplKnShpnzBc89MemVKDq6yaEiiy5EMA==',key_name='tempest-keypair-328174998',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb5bac5cd317420ab74fc9f416a80e59',ramdisk_id='',reservation_id='r-mwck76pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1732945749',owner_user_name='tempest-TaggedBootDevicesTest-1732945749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:01:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4253d01a8baa41978a589f90a58d945d',uuid=03313f66-d1dd-4269-b2e9-3b0796217299,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd18fd3a-9dc5-4433-a638-72e5586eeb9c", "address": "fa:16:3e:e5:b9:aa", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd18fd3a-9d", "ovs_interfaceid": "fd18fd3a-9dc5-4433-a638-72e5586eeb9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:01:56.306118 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converting VIF {"id": "fd18fd3a-9dc5-4433-a638-72e5586eeb9c", "address": "fa:16:3e:e5:b9:aa", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd18fd3a-9d", "ovs_interfaceid": "fd18fd3a-9dc5-4433-a638-72e5586eeb9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:01:56.306654 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:b9:aa,bridge_name='br-int',has_traffic_filtering=True,id=fd18fd3a-9dc5-4433-a638-72e5586eeb9c,network=Network(7c6d76e7-89ec-4a10-a21c-11c44b491f29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd18fd3a-9d') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:01:56.311122 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:01:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733955908',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-733955908',id=26,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDXMJyVhJWTJeHgrZbBiUGgXmjuhwbUVd2Kr7gMNTj4c2UOOPJTFYxL/+LAZETaDNBqelxft20PeTjvHZIXg32AtTWPekPM83zplKnShpnzBc89MemVKDq6yaEiiy5EMA==',key_name='tempest-keypair-328174998',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb5bac5cd317420ab74fc9f416a80e59',ramdisk_id='',reservation_id='r-mwck76pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1732945749',owner_user_name='tempest-TaggedBootDevicesTest-1732945749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:01:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4253d01a8baa41978a589f90a58d945d',uuid=03313f66-d1dd-4269-b2e9-3b0796217299,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc674202-2354-4a2d-bdcf-3faf31e8cc7d", "address": "fa:16:3e:eb:2b:41", "network": {"id": "da83acc7-b5da-4d42-bd74-8a3a51d2f657", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377824470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc674202-23", "ovs_interfaceid": "bc674202-2354-4a2d-bdcf-3faf31e8cc7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:01:56.311122 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:56.311388 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converting VIF {"id": "bc674202-2354-4a2d-bdcf-3faf31e8cc7d", "address": "fa:16:3e:eb:2b:41", "network": {"id": "da83acc7-b5da-4d42-bd74-8a3a51d2f657", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377824470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc674202-23", "ovs_interfaceid": "bc674202-2354-4a2d-bdcf-3faf31e8cc7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:01:56.311946 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:2b:41,bridge_name='br-int',has_traffic_filtering=True,id=bc674202-2354-4a2d-bdcf-3faf31e8cc7d,network=Network(da83acc7-b5da-4d42-bd74-8a3a51d2f657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc674202-23') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:01:56.312924 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:01:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733955908',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-733955908',id=26,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDXMJyVhJWTJeHgrZbBiUGgXmjuhwbUVd2Kr7gMNTj4c2UOOPJTFYxL/+LAZETaDNBqelxft20PeTjvHZIXg32AtTWPekPM83zplKnShpnzBc89MemVKDq6yaEiiy5EMA==',key_name='tempest-keypair-328174998',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb5bac5cd317420ab74fc9f416a80e59',ramdisk_id='',reservation_id='r-mwck76pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1732945749',owner_user_name='tempest-TaggedBootDevicesTest-1732945749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:01:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4253d01a8baa41978a589f90a58d945d',uuid=03313f66-d1dd-4269-b2e9-3b0796217299,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44", "address": "fa:16:3e:d0:5a:e8", "network": {"id": "da83acc7-b5da-4d42-bd74-8a3a51d2f657", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377824470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd184f1f0-b1", "ovs_interfaceid": "d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:01:56.315031 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converting VIF {"id": "d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44", "address": "fa:16:3e:d0:5a:e8", "network": {"id": "da83acc7-b5da-4d42-bd74-8a3a51d2f657", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377824470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd184f1f0-b1", "ovs_interfaceid": "d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:01:56.315031 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:5a:e8,bridge_name='br-int',has_traffic_filtering=True,id=d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44,network=Network(da83acc7-b5da-4d42-bd74-8a3a51d2f657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd184f1f0-b1') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:01:56.315031 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lazy-loading 'pci_devices' on Instance uuid 03313f66-d1dd-4269-b2e9-3b0796217299 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:01:56.334117 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:01:56.334117 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962516.3329227, be4a8d87-07fc-4c56-a68d-c95e98e99184 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:01:56.334117 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] VM Paused (Lifecycle Event)
May 28 10:01:56.348878 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:56.369952 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Instance destroyed successfully.
May 28 10:01:56.371288 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:00:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1921152164',display_name='tempest-ServerActionsTestOtherB-server-1921152164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serveractionstestotherb-server-1921152164',id=22,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGxE2KIr85UjQ+BCoXx5lmchxbSom5hESV9GE6OjN6uhpkJJULrQoc25hFxuYqlX95IN2Z2yCPiXDLbNxuH0vzgNuyZ6PJzEAoF/ugoalqeMA/O7CY5J9Uu00S0irELsQ==',key_name='tempest-keypair-993221961',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:00:55Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='11e1727c7fbc44459c6972d182fc25b1',ramdisk_id='',reservation_id='r-v5rhfg8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-634969206',owner_user_name='tempest-ServerActionsTestOtherB-634969206-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:01:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11b9cab1ceef4e4b8cba521b61ad3f55',uuid=b90b1ecd-e640-4f4e-bd02-fb74021db82b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "address": "fa:16:3e:b1:88:d2", "network": {"id": "9d46c174-21e3-464e-83c9-e8db18f486a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-151012625-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.13", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-151012625-network", "vif_mac": "fa:16:3e:b1:88:d2"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e1727c7fbc44459c6972d182fc25b1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a01cd4-8a", "ovs_interfaceid": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:01:56.371511 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Converting VIF {"id": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "address": "fa:16:3e:b1:88:d2", "network": {"id": "9d46c174-21e3-464e-83c9-e8db18f486a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-151012625-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.13", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-151012625-network", "vif_mac": "fa:16:3e:b1:88:d2"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e1727c7fbc44459c6972d182fc25b1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a01cd4-8a", "ovs_interfaceid": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:01:56.372146 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:88:d2,bridge_name='br-int',has_traffic_filtering=True,id=11a01cd4-8a62-4e25-b303-ac907a1aa4c3,network=Network(9d46c174-21e3-464e-83c9-e8db18f486a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a01cd4-8a') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:01:56.372421 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:88:d2,bridge_name='br-int',has_traffic_filtering=True,id=11a01cd4-8a62-4e25-b303-ac907a1aa4c3,network=Network(9d46c174-21e3-464e-83c9-e8db18f486a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a01cd4-8a') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:01:56.374263 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:56.380471 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Took 7.06 seconds to spawn the instance on the hypervisor.
May 28 10:01:56.380773 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11a01cd4-8a, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:56.381836 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:01:56.395437 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:56.397251 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:01:56.398889 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:56.399069 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6a1393fc-9685-4718-b665-4c337cf1a6a1) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:56.408924 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:01:56.410690 np0000001613 nova-compute[98321]: INFO os_vif [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:88:d2,bridge_name='br-int',has_traffic_filtering=True,id=11a01cd4-8a62-4e25-b303-ac907a1aa4c3,network=Network(9d46c174-21e3-464e-83c9-e8db18f486a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a01cd4-8a')
May 28 10:01:56.415070 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:01:56.415379 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '305d8623-c6f8-456c-83ed-46d06c6de0ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:01:56.415576 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:01:56.566191 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Instance event wait completed in 0 seconds for  {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:01:56.570711 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Instance running successfully.
May 28 10:01:56.574311 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Failed to set time: agent not configured {{(pid=98321) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 28 10:01:56.574311 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ebe4ce51-6405-4b79-8ed6-4060e8854b18 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] finish_migration finished successfully. {{(pid=98321) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 28 10:01:56.582645 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:01:56.608449 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Applying migration context for instance 49f53c82-6f7e-4d09-a471-26bd4fdc02e7 as it has an incoming, in-progress migration 24fe5c6e-268a-4ec1-90eb-21775d843fda. Migration status is post-migrating {{(pid=98321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
May 28 10:01:56.608688 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Applying migration context for instance b90b1ecd-e640-4f4e-bd02-fb74021db82b as it has an incoming, in-progress migration e6f68f41-c513-4350-8921-ddbbfd127fae. Migration status is migrating {{(pid=98321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
May 28 10:01:56.610169 np0000001613 nova-compute[98321]: INFO nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Updating resource usage from migration 24fe5c6e-268a-4ec1-90eb-21775d843fda
May 28 10:01:56.611106 np0000001613 nova-compute[98321]: INFO nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Updating resource usage from migration e6f68f41-c513-4350-8921-ddbbfd127fae
May 28 10:01:56.620829 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3d44adc8-f7c3-4623-bcfe-3bc95aeb3d14 req-b63a08b9-7bf3-4eb7-8e12-ebb8b5ea252b service nova] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Received event network-vif-plugged-1ea26412-1950-4e22-bbb1-1973617d8031 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:56.623744 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3d44adc8-f7c3-4623-bcfe-3bc95aeb3d14 req-b63a08b9-7bf3-4eb7-8e12-ebb8b5ea252b service nova] Acquiring lock "be4a8d87-07fc-4c56-a68d-c95e98e99184-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:56.623744 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3d44adc8-f7c3-4623-bcfe-3bc95aeb3d14 req-b63a08b9-7bf3-4eb7-8e12-ebb8b5ea252b service nova] Lock "be4a8d87-07fc-4c56-a68d-c95e98e99184-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:56.623923 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3d44adc8-f7c3-4623-bcfe-3bc95aeb3d14 req-b63a08b9-7bf3-4eb7-8e12-ebb8b5ea252b service nova] Lock "be4a8d87-07fc-4c56-a68d-c95e98e99184-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:56.624085 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3d44adc8-f7c3-4623-bcfe-3bc95aeb3d14 req-b63a08b9-7bf3-4eb7-8e12-ebb8b5ea252b service nova] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] No waiting events found dispatching network-vif-plugged-1ea26412-1950-4e22-bbb1-1973617d8031 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:01:56.624298 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-3d44adc8-f7c3-4623-bcfe-3bc95aeb3d14 req-b63a08b9-7bf3-4eb7-8e12-ebb8b5ea252b service nova] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Received unexpected event network-vif-plugged-1ea26412-1950-4e22-bbb1-1973617d8031 for instance with vm_state active and task_state None.
May 28 10:01:56.693091 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:01:56.694043 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 6895009a-024f-4919-9d25-a52905eac818 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:01:56.694215 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 87f6620a-fa87-4d27-8512-74215ef4fe34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:01:56.694364 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance d2e043b6-afe6-4afb-92d6-7d8b33545f19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:01:56.694549 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance b50eced2-71bf-4448-b2e1-f9657509f34c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:01:56.695319 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:01:56.695319 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 3edc00a8-2c60-4c44-acb8-6f4d02114bf0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:01:56.695425 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 03313f66-d1dd-4269-b2e9-3b0796217299 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:01:56.695498 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:01:56.695656 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 4baa35bb-b237-42be-aa8b-d9eeed7e41a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:01:56.695750 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Migration 24fe5c6e-268a-4ec1-90eb-21775d843fda is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 28 10:01:56.695866 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 49f53c82-6f7e-4d09-a471-26bd4fdc02e7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:01:56.695966 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance be4a8d87-07fc-4c56-a68d-c95e98e99184 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:01:56.696062 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Migration e6f68f41-c513-4350-8921-ddbbfd127fae is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 28 10:01:56.696175 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance b90b1ecd-e640-4f4e-bd02-fb74021db82b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:01:56.696301 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 36fde791-779f-42a8-9aef-87eafbbe0370 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:01:56.696517 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Total usable vcpus: 12, total allocated vcpus: 16 {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 10:01:56.696783 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Final resource view: name=np0000001613 phys_ram=24030MB used_ram=3712MB phys_disk=95GB used_disk=11GB total_vcpus=12 used_vcpus=16 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 10:01:55 up 34 min,  2 users,  load average: 11.44, 6.96, 3.28\n', 'num_instances': '14', 'num_vm_active': '10', 'num_task_None': '9', 'num_os_type_None': '14', 'num_proj_cb3a501b4f4041ef875ef4d2b4167044': '2', 'io_workload': '5', 'num_proj_3403b533910644d2b254922fb84b1ac0': '4', 'num_proj_f5fc8bc5d1984c1c839a3ef7e30b9d36': '3', 'num_vm_rescued': '1', 'num_task_resize_migrating': '1', 'num_proj_11e1727c7fbc44459c6972d182fc25b1': '1', 'num_task_rebuilding': '1', 'num_proj_2b4cc0430ca14757a829b60eb7e0081e': '1', 'num_task_resize_finish': '1', 'num_vm_building': '3', 'num_task_spawning': '2', 'num_proj_eb5bac5cd317420ab74fc9f416a80e59': '1', 'num_proj_12b4f42e155347e4a2055b151f04390a': '1', 'num_proj_9a85ba31f98b45b6974118c6560bbc53': '1'} {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 10:01:56.792460 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:56.795836 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:56.800022 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:56.819335 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] End _get_guest_xml xml=<domain type="qemu">
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:   <uuid>03313f66-d1dd-4269-b2e9-3b0796217299</uuid>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:   <name>instance-0000001a</name>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <nova:name>tempest-device-tagging-server-733955908</nova:name>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:01:42</nova:creationTime>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:         <nova:user uuid="4253d01a8baa41978a589f90a58d945d">tempest-TaggedBootDevicesTest-1732945749-project-member</nova:user>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:         <nova:project uuid="eb5bac5cd317420ab74fc9f416a80e59">tempest-TaggedBootDevicesTest-1732945749</nova:project>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:         <nova:port uuid="12bb71f4-467b-4cc8-b164-f795401a0117">
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:         <nova:port uuid="9f218cf2-d351-42a5-8b44-3e7ee9417bbd">
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.1.215" ipVersion="4"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:         <nova:port uuid="c2c9fb75-0a9e-47cb-a561-effaa19b4156">
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.1.188" ipVersion="4"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:         <nova:port uuid="d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5">
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.1.204" ipVersion="4"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:         <nova:port uuid="fd18fd3a-9dc5-4433-a638-72e5586eeb9c">
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.1.156" ipVersion="4"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:         <nova:port uuid="bc674202-2354-4a2d-bdcf-3faf31e8cc7d">
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:         <nova:port uuid="d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44">
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     <system>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <entry name="serial">03313f66-d1dd-4269-b2e9-3b0796217299</entry>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <entry name="uuid">03313f66-d1dd-4269-b2e9-3b0796217299</entry>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     </system>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:   <os>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:   </os>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:   <features>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:   </features>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:   <devices>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/03313f66-d1dd-4269-b2e9-3b0796217299/disk.config"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     </disk>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <alias name="ua-b8249ce3-d570-41ff-bcb4-97559f72c488"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-4"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <serial>b8249ce3-d570-41ff-bcb4-97559f72c488</serial>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     </disk>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <alias name="ua-45364262-cab4-45b7-8f81-d8ccf73c75b0"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-0"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <target dev="vdb" bus="virtio"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <serial>45364262-cab4-45b7-8f81-d8ccf73c75b0</serial>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     </disk>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <alias name="ua-714453c0-1620-406b-ae4c-f244696a4a04"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-11"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <target dev="vdc" bus="virtio"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <serial>714453c0-1620-406b-ae4c-f244696a4a04</serial>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     </disk>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:af:c7:36"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <target dev="tap12bb71f4-46"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     </interface>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:24:b3:6a"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <target dev="tap9f218cf2-d3"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     </interface>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:5d:f9:89"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <target dev="tapc2c9fb75-0a"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     </interface>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:a3:f3:65"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <target dev="tapd7db2f4e-c4"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     </interface>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:e5:b9:aa"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <target dev="tapfd18fd3a-9d"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     </interface>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:eb:2b:41"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <target dev="tapbc674202-23"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     </interface>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:d0:5a:e8"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <target dev="tapd184f1f0-b1"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     </interface>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/03313f66-d1dd-4269-b2e9-3b0796217299/console.log" append="off"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     </serial>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     <video>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     </video>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     </rng>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:   </devices>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]: </domain>
May 28 10:01:56.819335 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:01:56.829287 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Preparing to wait for external event network-vif-plugged-12bb71f4-467b-4cc8-b164-f795401a0117 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:01:56.829287 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Acquiring lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:56.829287 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:56.829287 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:56.829287 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Preparing to wait for external event network-vif-plugged-9f218cf2-d351-42a5-8b44-3e7ee9417bbd {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:01:56.829287 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Acquiring lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:56.829287 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:56.829287 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:56.829287 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Preparing to wait for external event network-vif-plugged-c2c9fb75-0a9e-47cb-a561-effaa19b4156 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:01:56.829287 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Acquiring lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:56.829287 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:56.829287 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:56.829287 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Preparing to wait for external event network-vif-plugged-d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:01:56.829287 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Acquiring lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:56.833385 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:56.833385 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:56.833385 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Preparing to wait for external event network-vif-plugged-fd18fd3a-9dc5-4433-a638-72e5586eeb9c {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:01:56.833385 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Acquiring lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:56.833385 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:56.833385 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:56.833385 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Preparing to wait for external event network-vif-plugged-bc674202-2354-4a2d-bdcf-3faf31e8cc7d {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:01:56.835809 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Acquiring lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:56.835809 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:56.835809 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:56.836761 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Preparing to wait for external event network-vif-plugged-d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:01:56.836761 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Acquiring lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:56.836761 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:56.839581 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:56.850268 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:01:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733955908',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-733955908',id=26,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDXMJyVhJWTJeHgrZbBiUGgXmjuhwbUVd2Kr7gMNTj4c2UOOPJTFYxL/+LAZETaDNBqelxft20PeTjvHZIXg32AtTWPekPM83zplKnShpnzBc89MemVKDq6yaEiiy5EMA==',key_name='tempest-keypair-328174998',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb5bac5cd317420ab74fc9f416a80e59',ramdisk_id='',reservation_id='r-mwck76pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1732945749',owner_user_name='tempest-TaggedBootDevicesTest-1732945749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:01:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4253d01a8baa41978a589f90a58d945d',uuid=03313f66-d1dd-4269-b2e9-3b0796217299,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12bb71f4-467b-4cc8-b164-f795401a0117", "address": "fa:16:3e:af:c7:36", "network": {"id": "1008534f-5c0f-4968-962e-d7e533fcc852", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1379747783-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12bb71f4-46", "ovs_interfaceid": "12bb71f4-467b-4cc8-b164-f795401a0117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:01:56.850268 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converting VIF {"id": "12bb71f4-467b-4cc8-b164-f795401a0117", "address": "fa:16:3e:af:c7:36", "network": {"id": "1008534f-5c0f-4968-962e-d7e533fcc852", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1379747783-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12bb71f4-46", "ovs_interfaceid": "12bb71f4-467b-4cc8-b164-f795401a0117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:01:56.855208 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:c7:36,bridge_name='br-int',has_traffic_filtering=True,id=12bb71f4-467b-4cc8-b164-f795401a0117,network=Network(1008534f-5c0f-4968-962e-d7e533fcc852),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12bb71f4-46') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:01:56.855208 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:c7:36,bridge_name='br-int',has_traffic_filtering=True,id=12bb71f4-467b-4cc8-b164-f795401a0117,network=Network(1008534f-5c0f-4968-962e-d7e533fcc852),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12bb71f4-46') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:01:56.855208 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:01:56.855208 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:56.859045 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:56.859045 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:01:56.860887 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:56.861323 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '615a509a-5738-587c-8201-bfa298b65209', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:56.862291 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:56.864308 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:56.866586 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962516.8654509, be4a8d87-07fc-4c56-a68d-c95e98e99184 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:01:56.868593 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] VM Resumed (Lifecycle Event)
May 28 10:01:56.880933 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:56.880933 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap12bb71f4-46, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:56.880933 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap12bb71f4-46, col_values=(('qos', UUID('95715f00-567d-4c53-92c1-363de7e74572')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:56.880933 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap12bb71f4-46, col_values=(('external_ids', {'iface-id': '12bb71f4-467b-4cc8-b164-f795401a0117', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:c7:36', 'vm-uuid': '03313f66-d1dd-4269-b2e9-3b0796217299'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:56.891757 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:01:56.895207 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:56.897261 np0000001613 nova-compute[98321]: INFO os_vif [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:c7:36,bridge_name='br-int',has_traffic_filtering=True,id=12bb71f4-467b-4cc8-b164-f795401a0117,network=Network(1008534f-5c0f-4968-962e-d7e533fcc852),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12bb71f4-46')
May 28 10:01:56.898877 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:01:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733955908',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-733955908',id=26,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDXMJyVhJWTJeHgrZbBiUGgXmjuhwbUVd2Kr7gMNTj4c2UOOPJTFYxL/+LAZETaDNBqelxft20PeTjvHZIXg32AtTWPekPM83zplKnShpnzBc89MemVKDq6yaEiiy5EMA==',key_name='tempest-keypair-328174998',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb5bac5cd317420ab74fc9f416a80e59',ramdisk_id='',reservation_id='r-mwck76pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1732945749',owner_user_name='tempest-TaggedBootDevicesTest-1732945749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:01:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4253d01a8baa41978a589f90a58d945d',uuid=03313f66-d1dd-4269-b2e9-3b0796217299,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f218cf2-d351-42a5-8b44-3e7ee9417bbd", "address": "fa:16:3e:24:b3:6a", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f218cf2-d3", "ovs_interfaceid": "9f218cf2-d351-42a5-8b44-3e7ee9417bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:01:56.901015 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converting VIF {"id": "9f218cf2-d351-42a5-8b44-3e7ee9417bbd", "address": "fa:16:3e:24:b3:6a", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f218cf2-d3", "ovs_interfaceid": "9f218cf2-d351-42a5-8b44-3e7ee9417bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:01:56.901015 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:b3:6a,bridge_name='br-int',has_traffic_filtering=True,id=9f218cf2-d351-42a5-8b44-3e7ee9417bbd,network=Network(7c6d76e7-89ec-4a10-a21c-11c44b491f29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9f218cf2-d3') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:01:56.901015 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:b3:6a,bridge_name='br-int',has_traffic_filtering=True,id=9f218cf2-d351-42a5-8b44-3e7ee9417bbd,network=Network(7c6d76e7-89ec-4a10-a21c-11c44b491f29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9f218cf2-d3') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:01:56.901293 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:56.901625 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:56.902518 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:01:56.905313 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:56.905313 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c678c4bd-6424-58cf-8301-09db4c75588b', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:56.920783 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:01:56.920783 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Took 13.13 seconds to build instance.
May 28 10:01:56.924008 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:56.925663 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f218cf2-d3, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:56.925663 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9f218cf2-d3, col_values=(('qos', UUID('b8d62d80-53eb-4411-a6bc-7885ffb9cf1d')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:56.925663 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9f218cf2-d3, col_values=(('external_ids', {'iface-id': '9f218cf2-d351-42a5-8b44-3e7ee9417bbd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:b3:6a', 'vm-uuid': '03313f66-d1dd-4269-b2e9-3b0796217299'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:56.926273 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:56.928246 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:01:56.939283 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:56.941497 np0000001613 nova-compute[98321]: INFO os_vif [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:b3:6a,bridge_name='br-int',has_traffic_filtering=True,id=9f218cf2-d351-42a5-8b44-3e7ee9417bbd,network=Network(7c6d76e7-89ec-4a10-a21c-11c44b491f29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9f218cf2-d3')
May 28 10:01:56.942250 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:01:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733955908',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-733955908',id=26,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDXMJyVhJWTJeHgrZbBiUGgXmjuhwbUVd2Kr7gMNTj4c2UOOPJTFYxL/+LAZETaDNBqelxft20PeTjvHZIXg32AtTWPekPM83zplKnShpnzBc89MemVKDq6yaEiiy5EMA==',key_name='tempest-keypair-328174998',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb5bac5cd317420ab74fc9f416a80e59',ramdisk_id='',reservation_id='r-mwck76pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1732945749',owner_user_name='tempest-TaggedBootDevicesTest-1732945749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:01:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4253d01a8baa41978a589f90a58d945d',uuid=03313f66-d1dd-4269-b2e9-3b0796217299,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2c9fb75-0a9e-47cb-a561-effaa19b4156", "address": "fa:16:3e:5d:f9:89", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c9fb75-0a", "ovs_interfaceid": "c2c9fb75-0a9e-47cb-a561-effaa19b4156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:01:56.942426 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converting VIF {"id": "c2c9fb75-0a9e-47cb-a561-effaa19b4156", "address": "fa:16:3e:5d:f9:89", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c9fb75-0a", "ovs_interfaceid": "c2c9fb75-0a9e-47cb-a561-effaa19b4156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:01:56.943644 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:f9:89,bridge_name='br-int',has_traffic_filtering=True,id=c2c9fb75-0a9e-47cb-a561-effaa19b4156,network=Network(7c6d76e7-89ec-4a10-a21c-11c44b491f29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc2c9fb75-0a') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:01:56.943644 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:f9:89,bridge_name='br-int',has_traffic_filtering=True,id=c2c9fb75-0a9e-47cb-a561-effaa19b4156,network=Network(7c6d76e7-89ec-4a10-a21c-11c44b491f29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc2c9fb75-0a') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:01:56.944404 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:56.944813 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:56.945637 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:01:56.948839 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:56.950010 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3f64b060-2fbc-5865-967e-09a065dab2fe', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:56.950314 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:56.951859 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:01:56.971147 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:56.987026 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:56.987687 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2c9fb75-0a, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:56.989107 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2c9fb75-0a, col_values=(('qos', UUID('ea1c2fc7-90d3-451e-937f-d0a2d4ddf449')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:56.989107 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2c9fb75-0a, col_values=(('external_ids', {'iface-id': 'c2c9fb75-0a9e-47cb-a561-effaa19b4156', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:f9:89', 'vm-uuid': '03313f66-d1dd-4269-b2e9-3b0796217299'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:56.989675 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:56.992947 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:01:57.011091 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:57.014434 np0000001613 nova-compute[98321]: INFO os_vif [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:f9:89,bridge_name='br-int',has_traffic_filtering=True,id=c2c9fb75-0a9e-47cb-a561-effaa19b4156,network=Network(7c6d76e7-89ec-4a10-a21c-11c44b491f29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc2c9fb75-0a')
May 28 10:01:57.014434 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:01:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733955908',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-733955908',id=26,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDXMJyVhJWTJeHgrZbBiUGgXmjuhwbUVd2Kr7gMNTj4c2UOOPJTFYxL/+LAZETaDNBqelxft20PeTjvHZIXg32AtTWPekPM83zplKnShpnzBc89MemVKDq6yaEiiy5EMA==',key_name='tempest-keypair-328174998',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb5bac5cd317420ab74fc9f416a80e59',ramdisk_id='',reservation_id='r-mwck76pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1732945749',owner_user_name='tempest-TaggedBootDevicesTest-1732945749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:01:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4253d01a8baa41978a589f90a58d945d',uuid=03313f66-d1dd-4269-b2e9-3b0796217299,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5", "address": "fa:16:3e:a3:f3:65", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7db2f4e-c4", "ovs_interfaceid": "d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:01:57.016081 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converting VIF {"id": "d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5", "address": "fa:16:3e:a3:f3:65", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7db2f4e-c4", "ovs_interfaceid": "d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:01:57.016081 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:f3:65,bridge_name='br-int',has_traffic_filtering=True,id=d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5,network=Network(7c6d76e7-89ec-4a10-a21c-11c44b491f29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7db2f4e-c4') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:01:57.016081 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:f3:65,bridge_name='br-int',has_traffic_filtering=True,id=d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5,network=Network(7c6d76e7-89ec-4a10-a21c-11c44b491f29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7db2f4e-c4') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:01:57.017428 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:57.019034 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:57.019668 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:01:57.021057 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:57.021334 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '96273678-5d9d-5838-9135-39e56ec209cb', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:57.022228 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:57.023217 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:01:57.058313 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:57.060519 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:57.081846 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:57.091186 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:01:57.129350 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:57.129350 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd7db2f4e-c4, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:57.129350 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd7db2f4e-c4, col_values=(('qos', UUID('2730f843-e942-46bd-b91b-a5cd2a26680e')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:57.129350 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd7db2f4e-c4, col_values=(('external_ids', {'iface-id': 'd7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:f3:65', 'vm-uuid': '03313f66-d1dd-4269-b2e9-3b0796217299'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:57.129350 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:01:57.158431 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:57.158915 np0000001613 nova-compute[98321]: INFO os_vif [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:f3:65,bridge_name='br-int',has_traffic_filtering=True,id=d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5,network=Network(7c6d76e7-89ec-4a10-a21c-11c44b491f29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7db2f4e-c4')
May 28 10:01:57.159847 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:01:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733955908',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-733955908',id=26,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDXMJyVhJWTJeHgrZbBiUGgXmjuhwbUVd2Kr7gMNTj4c2UOOPJTFYxL/+LAZETaDNBqelxft20PeTjvHZIXg32AtTWPekPM83zplKnShpnzBc89MemVKDq6yaEiiy5EMA==',key_name='tempest-keypair-328174998',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb5bac5cd317420ab74fc9f416a80e59',ramdisk_id='',reservation_id='r-mwck76pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1732945749',owner_user_name='tempest-TaggedBootDevicesTest-1732945749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:01:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4253d01a8baa41978a589f90a58d945d',uuid=03313f66-d1dd-4269-b2e9-3b0796217299,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd18fd3a-9dc5-4433-a638-72e5586eeb9c", "address": "fa:16:3e:e5:b9:aa", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd18fd3a-9d", "ovs_interfaceid": "fd18fd3a-9dc5-4433-a638-72e5586eeb9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:01:57.160277 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converting VIF {"id": "fd18fd3a-9dc5-4433-a638-72e5586eeb9c", "address": "fa:16:3e:e5:b9:aa", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd18fd3a-9d", "ovs_interfaceid": "fd18fd3a-9dc5-4433-a638-72e5586eeb9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:01:57.161379 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:b9:aa,bridge_name='br-int',has_traffic_filtering=True,id=fd18fd3a-9dc5-4433-a638-72e5586eeb9c,network=Network(7c6d76e7-89ec-4a10-a21c-11c44b491f29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd18fd3a-9d') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:01:57.161379 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:b9:aa,bridge_name='br-int',has_traffic_filtering=True,id=fd18fd3a-9dc5-4433-a638-72e5586eeb9c,network=Network(7c6d76e7-89ec-4a10-a21c-11c44b491f29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd18fd3a-9d') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:01:57.162769 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:57.162769 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:57.162769 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:01:57.174372 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:57.175172 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2c1566ce-b8e4-51f2-bf22-4ac96641f3c6', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:57.179521 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:57.181386 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:01:57.186415 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Successfully created port: 0e857900-174b-46cf-bfa1-ce7f2f8ffdb1 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:01:57.212193 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:57.221647 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:57.221902 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd18fd3a-9d, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:57.222359 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfd18fd3a-9d, col_values=(('qos', UUID('61f27860-5982-421b-b3f2-6b7ff1e62509')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:57.222731 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfd18fd3a-9d, col_values=(('external_ids', {'iface-id': 'fd18fd3a-9dc5-4433-a638-72e5586eeb9c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:b9:aa', 'vm-uuid': '03313f66-d1dd-4269-b2e9-3b0796217299'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:57.241299 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:01:57.269076 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:57.272926 np0000001613 nova-compute[98321]: INFO os_vif [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:b9:aa,bridge_name='br-int',has_traffic_filtering=True,id=fd18fd3a-9dc5-4433-a638-72e5586eeb9c,network=Network(7c6d76e7-89ec-4a10-a21c-11c44b491f29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd18fd3a-9d')
May 28 10:01:57.272926 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:01:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733955908',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-733955908',id=26,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDXMJyVhJWTJeHgrZbBiUGgXmjuhwbUVd2Kr7gMNTj4c2UOOPJTFYxL/+LAZETaDNBqelxft20PeTjvHZIXg32AtTWPekPM83zplKnShpnzBc89MemVKDq6yaEiiy5EMA==',key_name='tempest-keypair-328174998',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb5bac5cd317420ab74fc9f416a80e59',ramdisk_id='',reservation_id='r-mwck76pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1732945749',owner_user_name='tempest-TaggedBootDevicesTest-1732945749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:01:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4253d01a8baa41978a589f90a58d945d',uuid=03313f66-d1dd-4269-b2e9-3b0796217299,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc674202-2354-4a2d-bdcf-3faf31e8cc7d", "address": "fa:16:3e:eb:2b:41", "network": {"id": "da83acc7-b5da-4d42-bd74-8a3a51d2f657", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377824470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc674202-23", "ovs_interfaceid": "bc674202-2354-4a2d-bdcf-3faf31e8cc7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:01:57.272926 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converting VIF {"id": "bc674202-2354-4a2d-bdcf-3faf31e8cc7d", "address": "fa:16:3e:eb:2b:41", "network": {"id": "da83acc7-b5da-4d42-bd74-8a3a51d2f657", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377824470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc674202-23", "ovs_interfaceid": "bc674202-2354-4a2d-bdcf-3faf31e8cc7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:01:57.273754 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:2b:41,bridge_name='br-int',has_traffic_filtering=True,id=bc674202-2354-4a2d-bdcf-3faf31e8cc7d,network=Network(da83acc7-b5da-4d42-bd74-8a3a51d2f657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc674202-23') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:01:57.274921 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:2b:41,bridge_name='br-int',has_traffic_filtering=True,id=bc674202-2354-4a2d-bdcf-3faf31e8cc7d,network=Network(da83acc7-b5da-4d42-bd74-8a3a51d2f657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc674202-23') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:01:57.276551 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:57.277762 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:57.277762 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:01:57.280666 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:57.282723 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f0bb2b7c-7a77-5f5a-8dcc-8e11cbc42251', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:57.284642 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:57.292122 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:01:57.318106 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:57.324377 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:57.326191 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc674202-23, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:57.330207 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbc674202-23, col_values=(('qos', UUID('87c2ee83-afcb-4d75-be40-81ec7a1a7160')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:57.330207 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbc674202-23, col_values=(('external_ids', {'iface-id': 'bc674202-2354-4a2d-bdcf-3faf31e8cc7d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:2b:41', 'vm-uuid': '03313f66-d1dd-4269-b2e9-3b0796217299'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:57.330207 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:57.330731 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:01:57.372265 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:57.373756 np0000001613 nova-compute[98321]: INFO os_vif [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:2b:41,bridge_name='br-int',has_traffic_filtering=True,id=bc674202-2354-4a2d-bdcf-3faf31e8cc7d,network=Network(da83acc7-b5da-4d42-bd74-8a3a51d2f657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc674202-23')
May 28 10:01:57.374695 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:01:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733955908',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-733955908',id=26,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDXMJyVhJWTJeHgrZbBiUGgXmjuhwbUVd2Kr7gMNTj4c2UOOPJTFYxL/+LAZETaDNBqelxft20PeTjvHZIXg32AtTWPekPM83zplKnShpnzBc89MemVKDq6yaEiiy5EMA==',key_name='tempest-keypair-328174998',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb5bac5cd317420ab74fc9f416a80e59',ramdisk_id='',reservation_id='r-mwck76pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1732945749',owner_user_name='tempest-TaggedBootDevicesTest-1732945749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:01:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4253d01a8baa41978a589f90a58d945d',uuid=03313f66-d1dd-4269-b2e9-3b0796217299,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44", "address": "fa:16:3e:d0:5a:e8", "network": {"id": "da83acc7-b5da-4d42-bd74-8a3a51d2f657", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377824470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd184f1f0-b1", "ovs_interfaceid": "d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:01:57.374895 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converting VIF {"id": "d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44", "address": "fa:16:3e:d0:5a:e8", "network": {"id": "da83acc7-b5da-4d42-bd74-8a3a51d2f657", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377824470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd184f1f0-b1", "ovs_interfaceid": "d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:01:57.376038 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:5a:e8,bridge_name='br-int',has_traffic_filtering=True,id=d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44,network=Network(da83acc7-b5da-4d42-bd74-8a3a51d2f657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd184f1f0-b1') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:01:57.376038 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:5a:e8,bridge_name='br-int',has_traffic_filtering=True,id=d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44,network=Network(da83acc7-b5da-4d42-bd74-8a3a51d2f657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd184f1f0-b1') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:01:57.377229 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:57.377349 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:57.377592 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:01:57.383230 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:57.385918 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f871e945-67ff-5a07-8cc3-86cd7bdc025c', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:57.385918 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:57.385918 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:01:57.387359 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:01:57.394465 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:01:57.426895 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "be4a8d87-07fc-4c56-a68d-c95e98e99184" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.641s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:57.431003 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:57.440659 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:57.440869 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd184f1f0-b1, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:57.441290 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd184f1f0-b1, col_values=(('qos', UUID('4acc2ae0-ce3f-4831-a3ad-88c3747f4978')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:57.441444 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd184f1f0-b1, col_values=(('external_ids', {'iface-id': 'd184f1f0-b1f9-4c6f-a8d6-8e128f05bb44', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:5a:e8', 'vm-uuid': '03313f66-d1dd-4269-b2e9-3b0796217299'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:01:57.445711 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:57.446802 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:01:57.498955 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:57.501020 np0000001613 nova-compute[98321]: INFO os_vif [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:5a:e8,bridge_name='br-int',has_traffic_filtering=True,id=d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44,network=Network(da83acc7-b5da-4d42-bd74-8a3a51d2f657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd184f1f0-b1')
May 28 10:01:57.721953 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d115402c-d6c6-4d21-9963-c494ecb73ca3 req-5732a5bf-e86d-4aa5-88f0-35ac02b38b1b service nova] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Received event network-vif-plugged-55556967-1d07-4f3b-bc07-6692ef9de17b {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:57.722621 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d115402c-d6c6-4d21-9963-c494ecb73ca3 req-5732a5bf-e86d-4aa5-88f0-35ac02b38b1b service nova] Acquiring lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:57.723264 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d115402c-d6c6-4d21-9963-c494ecb73ca3 req-5732a5bf-e86d-4aa5-88f0-35ac02b38b1b service nova] Lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:57.723640 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d115402c-d6c6-4d21-9963-c494ecb73ca3 req-5732a5bf-e86d-4aa5-88f0-35ac02b38b1b service nova] Lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:57.724320 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d115402c-d6c6-4d21-9963-c494ecb73ca3 req-5732a5bf-e86d-4aa5-88f0-35ac02b38b1b service nova] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] No waiting events found dispatching network-vif-plugged-55556967-1d07-4f3b-bc07-6692ef9de17b {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:01:57.725159 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-d115402c-d6c6-4d21-9963-c494ecb73ca3 req-5732a5bf-e86d-4aa5-88f0-35ac02b38b1b service nova] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Received unexpected event network-vif-plugged-55556967-1d07-4f3b-bc07-6692ef9de17b for instance with vm_state resized and task_state None.
May 28 10:01:57.902473 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.99963019200004 future=<Future at 0x73c1fc16b650 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:01:57.902752 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962517.9025183, 49f53c82-6f7e-4d09-a471-26bd4fdc02e7 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:01:57.904441 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] VM Resumed (Lifecycle Event)
May 28 10:01:58.055744 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:01:58.056044 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:01:58.074493 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Successfully updated port: 0e857900-174b-46cf-bfa1-ce7f2f8ffdb1 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:01:58.110370 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:01:58.111562 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:01:58.111864 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Creating image(s)
May 28 10:01:58.112996 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "/opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:58.112996 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "/opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:58.113831 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "/opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:58.114792 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:01:58.120100 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:01:58.122379 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:58.234343 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.112s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:58.234923 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:58.236349 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:58.236349 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:01:58.243712 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:01:58.244389 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:58.358328 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.112s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:58.358328 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:58.389626 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6884e709-a0d9-4d1c-b745-ec3fdb6f02fa req-50484c0c-5376-4916-849b-5aa212958282 service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Received event network-vif-unplugged-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:58.390270 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6884e709-a0d9-4d1c-b745-ec3fdb6f02fa req-50484c0c-5376-4916-849b-5aa212958282 service nova] Acquiring lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:58.390581 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6884e709-a0d9-4d1c-b745-ec3fdb6f02fa req-50484c0c-5376-4916-849b-5aa212958282 service nova] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:58.390768 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6884e709-a0d9-4d1c-b745-ec3fdb6f02fa req-50484c0c-5376-4916-849b-5aa212958282 service nova] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:58.390963 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6884e709-a0d9-4d1c-b745-ec3fdb6f02fa req-50484c0c-5376-4916-849b-5aa212958282 service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] No waiting events found dispatching network-vif-unplugged-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:01:58.391176 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-6884e709-a0d9-4d1c-b745-ec3fdb6f02fa req-50484c0c-5376-4916-849b-5aa212958282 service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Received unexpected event network-vif-unplugged-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 for instance with vm_state active and task_state resize_migrating.
May 28 10:01:58.423180 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-05fad6ae-5ba0-49fd-90ac-ea2b20131e60 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:58.425385 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:01:58.427047 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-05fad6ae-5ba0-49fd-90ac-ea2b20131e60 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:58.427285 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-05fad6ae-5ba0-49fd-90ac-ea2b20131e60 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Going to confirm migration 1 {{(pid=98321) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 28 10:01:58.433254 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:01:58.446594 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk 1073741824" returned: 0 in 0.089s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:58.448209 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:58.448209 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:58.532710 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.084s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:58.533247 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Checking if we can resize image /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:01:58.533627 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:58.561870 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:01:58.576809 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "refresh_cache-36fde791-779f-42a8-9aef-87eafbbe0370" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:01:58.578631 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquired lock "refresh_cache-36fde791-779f-42a8-9aef-87eafbbe0370" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:01:58.578631 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:01:58.631714 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:58.633318 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Cannot resize image /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:01:58.633318 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:01:58.633318 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Ensure instance console log exists: /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:01:58.633318 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:01:58.633318 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:01:58.633318 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:58.688195 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-08599e76-6674-477c-9044-bc81ba9995c9 req-1f36d5e4-ecaf-4a87-a9df-ab920034df31 service nova] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Received event network-changed-1ea26412-1950-4e22-bbb1-1973617d8031 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:58.688645 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-08599e76-6674-477c-9044-bc81ba9995c9 req-1f36d5e4-ecaf-4a87-a9df-ab920034df31 service nova] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Refreshing instance network info cache due to event network-changed-1ea26412-1950-4e22-bbb1-1973617d8031. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:01:58.688645 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-08599e76-6674-477c-9044-bc81ba9995c9 req-1f36d5e4-ecaf-4a87-a9df-ab920034df31 service nova] Acquiring lock "refresh_cache-be4a8d87-07fc-4c56-a68d-c95e98e99184" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:01:58.688645 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-08599e76-6674-477c-9044-bc81ba9995c9 req-1f36d5e4-ecaf-4a87-a9df-ab920034df31 service nova] Acquired lock "refresh_cache-be4a8d87-07fc-4c56-a68d-c95e98e99184" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:01:58.688753 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-08599e76-6674-477c-9044-bc81ba9995c9 req-1f36d5e4-ecaf-4a87-a9df-ab920034df31 service nova] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Refreshing network info cache for port 1ea26412-1950-4e22-bbb1-1973617d8031 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:01:58.894997 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.479s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:01:58.896196 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '305d8623-c6f8-456c-83ed-46d06c6de0ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:01:58.896196 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:01:58.937018 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-05fad6ae-5ba0-49fd-90ac-ea2b20131e60 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:58.938141 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:58.938141 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:58.938141 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:58.938141 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:58.938141 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:58.938141 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:58.938141 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:58.938141 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:58.938141 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:58.938141 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:58.938141 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:01:58.938141 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:01:58.938141 np0000001613 nova-compute[98321]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:58.938141 np0000001613 nova-compute[98321]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:58.938141 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:01:58.944735 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962518.9394486, 49f53c82-6f7e-4d09-a471-26bd4fdc02e7 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:01:58.945819 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:58.945819 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:01:58.945819 np0000001613 nova-compute[98321]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:58.945819 np0000001613 nova-compute[98321]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:01:58.945819 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:58.945819 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:01:58.945819 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:58.945819 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:01:58.945819 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:58.945819 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:01:58.945819 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:01:58.945819 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:01:58.945819 np0000001613 nova-compute[98321]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:58.945819 np0000001613 nova-compute[98321]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:01:58.945819 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:01:58.945819 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', '42'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0', '45'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', '47'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', '48'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04', '49'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', '51'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', '52')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:01:58.946386 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] VM Started (Lifecycle Event)
May 28 10:01:58.948208 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', '41')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:01:58.951210 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', '42')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:01:58.952975 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1f403ed40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea'): ({'sde'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:01:58.952975 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Removing multipathed devices sdd, sde {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:01:58.952975 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Flush multipath device 330000000352d9acf {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:01:59.005251 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:01:59.038216 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:01:59.038464 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:01:59.038614 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] No VIF found with MAC fa:16:3e:af:c7:36, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:01:59.042214 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] No VIF found with MAC fa:16:3e:e5:b9:aa, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:01:59.042214 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Using config drive
May 28 10:01:59.055229 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:01:59.076431 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Compute_service record updated for np0000001613:np0000001613 {{(pid=98321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 10:01:59.076573 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.489s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:01:59.077125 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:01:59.095949 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:01:59.096209 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:01:59.099488 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:01:59.107105 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-05fad6ae-5ba0-49fd-90ac-ea2b20131e60 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:59.107452 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-05fad6ae-5ba0-49fd-90ac-ea2b20131e60 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "refresh_cache-49f53c82-6f7e-4d09-a471-26bd4fdc02e7" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:01:59.107666 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-05fad6ae-5ba0-49fd-90ac-ea2b20131e60 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquired lock "refresh_cache-49f53c82-6f7e-4d09-a471-26bd4fdc02e7" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:01:59.107855 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-05fad6ae-5ba0-49fd-90ac-ea2b20131e60 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:01:59.108070 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-05fad6ae-5ba0-49fd-90ac-ea2b20131e60 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lazy-loading 'info_cache' on Instance uuid 49f53c82-6f7e-4d09-a471-26bd4fdc02e7 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:01:59.116266 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:01:59.116266 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:01:59.131708 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:59.163627 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:01:59.183494 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea, portal: 192.168.40.100,3260]
May 28 10:01:59.183494 np0000001613 nova-compute[98321]: Logout of [sid: 41, target: iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea, portal: 192.168.40.100,3260] successful.
May 28 10:01:59.183494 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:59.191613 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-08599e76-6674-477c-9044-bc81ba9995c9 req-1f36d5e4-ecaf-4a87-a9df-ab920034df31 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:59.207635 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:59.224291 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:59.283963 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea, portal: 192.168.50.100,3260]
May 28 10:01:59.283963 np0000001613 nova-compute[98321]: Logout of [sid: 42, target: iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea, portal: 192.168.50.100,3260] successful.
May 28 10:01:59.283963 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:59.320336 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:01:59.320336 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.425s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:01:59.320336 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] <== disconnect_volume: return (2904ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:01:59.320558 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:01:59.327628 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:59.354112 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:01:59.431377 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:59.442800 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:59.443453 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:59.476037 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:01:59.487932 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:01:59.556217 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:59.559898 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:59.561633 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] skipping disk /dev/dm-3 (vdb) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:01:59.561633 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b_resize/disk /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:59.717153 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] CMD "cp -r /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b_resize/disk /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk" returned: 0 in 0.156s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:59.718583 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b_resize/disk.config /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk.config {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:59.766811 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Updating instance_info_cache with network_info: [{"id": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "address": "fa:16:3e:e1:06:59", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e857900-17", "ovs_interfaceid": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:01:59.780223 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] CMD "cp -r /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b_resize/disk.config /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk.config" returned: 0 in 0.062s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:59.781038 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b_resize/disk.info /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk.info {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:59.826055 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] CMD "cp -r /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b_resize/disk.info /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk.info" returned: 0 in 0.045s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:01:59.833851 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f99b23f0-865e-4181-b329-1e52a526b79a req-c1baaf90-995c-4c2b-8eab-0998a6861378 service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Received event network-changed-0e857900-174b-46cf-bfa1-ce7f2f8ffdb1 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:01:59.834026 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f99b23f0-865e-4181-b329-1e52a526b79a req-c1baaf90-995c-4c2b-8eab-0998a6861378 service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Refreshing instance network info cache due to event network-changed-0e857900-174b-46cf-bfa1-ce7f2f8ffdb1. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:01:59.834286 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f99b23f0-865e-4181-b329-1e52a526b79a req-c1baaf90-995c-4c2b-8eab-0998a6861378 service nova] Acquiring lock "refresh_cache-36fde791-779f-42a8-9aef-87eafbbe0370" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:01:59.878203 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-08599e76-6674-477c-9044-bc81ba9995c9 req-1f36d5e4-ecaf-4a87-a9df-ab920034df31 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:01:59.889919 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Creating config drive at /opt/stack/data/nova/instances/03313f66-d1dd-4269-b2e9-3b0796217299/disk.config
May 28 10:01:59.895698 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/03313f66-d1dd-4269-b2e9-3b0796217299/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_t7ld_z8 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:01:59.974194 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/03313f66-d1dd-4269-b2e9-3b0796217299/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_t7ld_z8" returned: 0 in 0.077s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:00.076893 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:02:00.077727 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:02:00.079675 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:02:00.079675 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 10:02:00.079675 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 48.71 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:02:00.105372 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-08599e76-6674-477c-9044-bc81ba9995c9 req-1f36d5e4-ecaf-4a87-a9df-ab920034df31 service nova] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Updated VIF entry in instance network info cache for port 1ea26412-1950-4e22-bbb1-1973617d8031. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:02:00.106145 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-08599e76-6674-477c-9044-bc81ba9995c9 req-1f36d5e4-ecaf-4a87-a9df-ab920034df31 service nova] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Updating instance_info_cache with network_info: [{"id": "1ea26412-1950-4e22-bbb1-1973617d8031", "address": "fa:16:3e:a8:9a:37", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ea26412-19", "ovs_interfaceid": "1ea26412-1950-4e22-bbb1-1973617d8031", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:02:00.128281 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-05fad6ae-5ba0-49fd-90ac-ea2b20131e60 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:00.278320 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Releasing lock "refresh_cache-36fde791-779f-42a8-9aef-87eafbbe0370" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:02:00.278320 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Instance network_info: |[{"id": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "address": "fa:16:3e:e1:06:59", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e857900-17", "ovs_interfaceid": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:02:00.279973 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Start _get_guest_xml network_info=[{"id": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "address": "fa:16:3e:e1:06:59", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e857900-17", "ovs_interfaceid": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:02:00.281511 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f99b23f0-865e-4181-b329-1e52a526b79a req-c1baaf90-995c-4c2b-8eab-0998a6861378 service nova] Acquired lock "refresh_cache-36fde791-779f-42a8-9aef-87eafbbe0370" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:02:00.281793 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-f99b23f0-865e-4181-b329-1e52a526b79a req-c1baaf90-995c-4c2b-8eab-0998a6861378 service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Refreshing network info cache for port 0e857900-174b-46cf-bfa1-ce7f2f8ffdb1 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:02:00.284661 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:02:00.286157 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='36fde791-779f-42a8-9aef-87eafbbe0370'), owner=OwnerMeta(userid='13481913e22d4bf1a94e1a9a270f5494', username='tempest-AttachVolumeMultiAttachTest-1052626787-project-member', projectid='3403b533910644d2b254922fb84b1ac0', projectname='tempest-AttachVolumeMultiAttachTest-1052626787'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "address": "fa:16:3e:e1:06:59", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e857900-17", "ovs_interfaceid": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962520.2856216) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:02:00.290197 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:02:00.290197 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:02:00.292438 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:02:00.292438 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:02:00.292438 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:02:00.292438 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:02:00.292438 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:02:00.292438 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:02:00.292683 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:02:00.292683 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:02:00.292683 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:02:00.295945 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:02:00.295945 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:02:00.295945 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:02:00.295945 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:02:00.295945 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:02:00.309178 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:01:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='multiattach-server-0',id=30,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrmebBJn1C7uIkB9JjrF4yuEuto77kf4SaBedfdmOdQwZzJyqrVQd0Wq/SA1eDV6FpWwBB4BKjLBcFgkvBrXSx4LeKHMUic/tPGA5px/F625klLXypbV+9p49FvQ4XImQ==',key_name='tempest-keypair-2082049331',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3403b533910644d2b254922fb84b1ac0',ramdisk_id='',reservation_id='r-apelrt3z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1052626787',owner_user_name='tempest-AttachVolumeMultiAttachTest-1052626787-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:01:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13481913e22d4bf1a94e1a9a270f5494',uuid=36fde791-779f-42a8-9aef-87eafbbe0370,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "address": "fa:16:3e:e1:06:59", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e857900-17", "ovs_interfaceid": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:02:00.309418 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converting VIF {"id": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "address": "fa:16:3e:e1:06:59", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e857900-17", "ovs_interfaceid": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:02:00.310366 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:06:59,bridge_name='br-int',has_traffic_filtering=True,id=0e857900-174b-46cf-bfa1-ce7f2f8ffdb1,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e857900-17') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:02:00.311054 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lazy-loading 'pci_devices' on Instance uuid 36fde791-779f-42a8-9aef-87eafbbe0370 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:00.550976 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:00.572417 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-05fad6ae-5ba0-49fd-90ac-ea2b20131e60 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:00.614194 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-08599e76-6674-477c-9044-bc81ba9995c9 req-1f36d5e4-ecaf-4a87-a9df-ab920034df31 service nova] Releasing lock "refresh_cache-be4a8d87-07fc-4c56-a68d-c95e98e99184" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:02:00.629451 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:00.724739 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:00.762378 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:00.788637 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-f99b23f0-865e-4181-b329-1e52a526b79a req-c1baaf90-995c-4c2b-8eab-0998a6861378 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:00.815758 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] End _get_guest_xml xml=<domain type="qemu">
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:   <uuid>36fde791-779f-42a8-9aef-87eafbbe0370</uuid>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:   <name>instance-0000001e</name>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:       <nova:name>multiattach-server-0</nova:name>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:02:00</nova:creationTime>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:         <nova:user uuid="13481913e22d4bf1a94e1a9a270f5494">tempest-AttachVolumeMultiAttachTest-1052626787-project-member</nova:user>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:         <nova:project uuid="3403b533910644d2b254922fb84b1ac0">tempest-AttachVolumeMultiAttachTest-1052626787</nova:project>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:         <nova:port uuid="0e857900-174b-46cf-bfa1-ce7f2f8ffdb1">
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:     <system>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:       <entry name="serial">36fde791-779f-42a8-9aef-87eafbbe0370</entry>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:       <entry name="uuid">36fde791-779f-42a8-9aef-87eafbbe0370</entry>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:     </system>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:   <os>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:   </os>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:   <features>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:   </features>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:   <devices>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk"/>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:     </disk>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk.config"/>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:     </disk>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:e1:06:59"/>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:       <target dev="tap0e857900-17"/>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:     </interface>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/console.log" append="off"/>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:     </serial>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:     <video>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:     </video>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:     </rng>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:   </devices>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]: </domain>
May 28 10:02:00.815758 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:02:00.817789 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Preparing to wait for external event network-vif-plugged-0e857900-174b-46cf-bfa1-ce7f2f8ffdb1 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:02:00.817789 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "36fde791-779f-42a8-9aef-87eafbbe0370-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:00.817789 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "36fde791-779f-42a8-9aef-87eafbbe0370-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:00.817789 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "36fde791-779f-42a8-9aef-87eafbbe0370-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:00.822238 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:01:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='multiattach-server-0',id=30,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrmebBJn1C7uIkB9JjrF4yuEuto77kf4SaBedfdmOdQwZzJyqrVQd0Wq/SA1eDV6FpWwBB4BKjLBcFgkvBrXSx4LeKHMUic/tPGA5px/F625klLXypbV+9p49FvQ4XImQ==',key_name='tempest-keypair-2082049331',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3403b533910644d2b254922fb84b1ac0',ramdisk_id='',reservation_id='r-apelrt3z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1052626787',owner_user_name='tempest-AttachVolumeMultiAttachTest-1052626787-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:01:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13481913e22d4bf1a94e1a9a270f5494',uuid=36fde791-779f-42a8-9aef-87eafbbe0370,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "address": "fa:16:3e:e1:06:59", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e857900-17", "ovs_interfaceid": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:02:00.822238 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converting VIF {"id": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "address": "fa:16:3e:e1:06:59", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e857900-17", "ovs_interfaceid": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:02:00.822238 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:06:59,bridge_name='br-int',has_traffic_filtering=True,id=0e857900-174b-46cf-bfa1-ce7f2f8ffdb1,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e857900-17') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:02:00.822238 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:06:59,bridge_name='br-int',has_traffic_filtering=True,id=0e857900-174b-46cf-bfa1-ce7f2f8ffdb1,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e857900-17') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:02:00.822238 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:00.822238 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:02:00.822238 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:02:00.825047 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:00.825312 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9b623a54-333d-5518-aa63-9967e370aac2', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:02:00.826290 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:00.827145 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:02:00.866782 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:00.905540 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:00.911715 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:00.914794 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:00.914794 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e857900-17, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:02:00.915425 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0e857900-17, col_values=(('qos', UUID('326392d8-fa46-4d23-b0c1-9dd0fae1fe8a')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:02:00.916197 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0e857900-17, col_values=(('external_ids', {'iface-id': '0e857900-174b-46cf-bfa1-ce7f2f8ffdb1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:06:59', 'vm-uuid': '36fde791-779f-42a8-9aef-87eafbbe0370'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:02:00.918514 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:00.920774 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:02:00.941482 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:00.963985 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:00.973769 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-546e046a-aedd-4f5a-bfa0-9b627cc5834f req-61ef6300-b6a2-4a80-a373-74ac6c11df27 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-vif-plugged-12bb71f4-467b-4cc8-b164-f795401a0117 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:00.974652 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-546e046a-aedd-4f5a-bfa0-9b627cc5834f req-61ef6300-b6a2-4a80-a373-74ac6c11df27 service nova] Acquiring lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:00.974935 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-546e046a-aedd-4f5a-bfa0-9b627cc5834f req-61ef6300-b6a2-4a80-a373-74ac6c11df27 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:00.975140 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-546e046a-aedd-4f5a-bfa0-9b627cc5834f req-61ef6300-b6a2-4a80-a373-74ac6c11df27 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:00.975381 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-546e046a-aedd-4f5a-bfa0-9b627cc5834f req-61ef6300-b6a2-4a80-a373-74ac6c11df27 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Processing event network-vif-plugged-12bb71f4-467b-4cc8-b164-f795401a0117 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:02:01.002688 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:01.002688 np0000001613 nova-compute[98321]: INFO os_vif [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:06:59,bridge_name='br-int',has_traffic_filtering=True,id=0e857900-174b-46cf-bfa1-ce7f2f8ffdb1,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e857900-17')
May 28 10:02:01.034117 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-05fad6ae-5ba0-49fd-90ac-ea2b20131e60 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Updating instance_info_cache with network_info: [{"id": "55556967-1d07-4f3b-bc07-6692ef9de17b", "address": "fa:16:3e:d2:27:b6", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55556967-1d", "ovs_interfaceid": "55556967-1d07-4f3b-bc07-6692ef9de17b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:02:01.085019 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:01.096304 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:01.096304 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:01.104789 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:01.157613 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:01.168871 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:01.206557 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0014566419995389879 future=<Future at 0x73c1f470cbc0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:02:01.206557 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:02:01.206557 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=11.695932968999841 future=<Future at 0x73c1fc16b650 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:02:01.206557 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=11.695801534000111 future=<Future at 0x73c1fc16b650 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:02:01.211207 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Emitting event <LifecycleEvent: 1779962506.2043047, 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:02:01.211774 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] VM Stopped (Lifecycle Event)
May 28 10:02:01.215191 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:01.245511 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:01.282367 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Port 11a01cd4-8a62-4e25-b303-ac907a1aa4c3 binding to destination host np0000001613 is already ACTIVE {{(pid=98321) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 28 10:02:01.312923 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:01.368336 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:01.519934 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:01.541593 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-05fad6ae-5ba0-49fd-90ac-ea2b20131e60 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Releasing lock "refresh_cache-49f53c82-6f7e-4d09-a471-26bd4fdc02e7" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:02:01.541874 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-05fad6ae-5ba0-49fd-90ac-ea2b20131e60 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lazy-loading 'migration_context' on Instance uuid 49f53c82-6f7e-4d09-a471-26bd4fdc02e7 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:01.543423 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:01.602135 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-f99b23f0-865e-4181-b329-1e52a526b79a req-c1baaf90-995c-4c2b-8eab-0998a6861378 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:01.618258 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f0e40271-e4c4-4a9b-a435-e40aa382dd63 req-bd08a69e-8ce7-44c6-9fe9-66d50fe0d72e service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-vif-plugged-c2c9fb75-0a9e-47cb-a561-effaa19b4156 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:01.620994 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f0e40271-e4c4-4a9b-a435-e40aa382dd63 req-bd08a69e-8ce7-44c6-9fe9-66d50fe0d72e service nova] Acquiring lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:01.624349 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f0e40271-e4c4-4a9b-a435-e40aa382dd63 req-bd08a69e-8ce7-44c6-9fe9-66d50fe0d72e service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:01.625104 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f0e40271-e4c4-4a9b-a435-e40aa382dd63 req-bd08a69e-8ce7-44c6-9fe9-66d50fe0d72e service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:01.625261 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f0e40271-e4c4-4a9b-a435-e40aa382dd63 req-bd08a69e-8ce7-44c6-9fe9-66d50fe0d72e service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Processing event network-vif-plugged-c2c9fb75-0a9e-47cb-a561-effaa19b4156 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:02:01.665343 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:01.717664 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-638c2180-db85-4da7-b643-cfc81ec09041 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:02:01.729668 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:01.742568 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:01.775813 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:01.906573 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:01.939791 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-f99b23f0-865e-4181-b329-1e52a526b79a req-c1baaf90-995c-4c2b-8eab-0998a6861378 service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Updated VIF entry in instance network info cache for port 0e857900-174b-46cf-bfa1-ce7f2f8ffdb1. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:02:01.939916 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-f99b23f0-865e-4181-b329-1e52a526b79a req-c1baaf90-995c-4c2b-8eab-0998a6861378 service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Updating instance_info_cache with network_info: [{"id": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "address": "fa:16:3e:e1:06:59", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e857900-17", "ovs_interfaceid": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:02:01.982407 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:02.003467 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:02.029231 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:02.034256 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:02.048026 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-05fad6ae-5ba0-49fd-90ac-ea2b20131e60 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Object Instance<49f53c82-6f7e-4d09-a471-26bd4fdc02e7> lazy-loaded attributes: info_cache,migration_context {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:02:02.049248 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-05fad6ae-5ba0-49fd-90ac-ea2b20131e60 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:02.049939 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-05fad6ae-5ba0-49fd-90ac-ea2b20131e60 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:02.305267 np0000001613 nova-compute[98321]: DEBUG nova.compute.rpcapi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98321) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 10:02:02.323098 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Acquiring lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:02.323098 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:02.323098 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:02.364822 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:02.370079 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:02.444300 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f99b23f0-865e-4181-b329-1e52a526b79a req-c1baaf90-995c-4c2b-8eab-0998a6861378 service nova] Releasing lock "refresh_cache-36fde791-779f-42a8-9aef-87eafbbe0370" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:02:02.562250 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:02:02.565430 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:02:02.565430 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No VIF found with MAC fa:16:3e:e1:06:59, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:02:02.565430 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Using config drive
May 28 10:02:02.588472 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:02.596554 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:02.845836 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:02.857536 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:03.076304 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:03.145821 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5adb718d-7dc2-465b-905d-a484db3694df req-6e153272-dfd0-4e47-8285-a6a834ebbc22 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-vif-plugged-12bb71f4-467b-4cc8-b164-f795401a0117 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:03.145821 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5adb718d-7dc2-465b-905d-a484db3694df req-6e153272-dfd0-4e47-8285-a6a834ebbc22 service nova] Acquiring lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:03.145821 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5adb718d-7dc2-465b-905d-a484db3694df req-6e153272-dfd0-4e47-8285-a6a834ebbc22 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:03.145821 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5adb718d-7dc2-465b-905d-a484db3694df req-6e153272-dfd0-4e47-8285-a6a834ebbc22 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:03.145821 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5adb718d-7dc2-465b-905d-a484db3694df req-6e153272-dfd0-4e47-8285-a6a834ebbc22 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] No event matching network-vif-plugged-12bb71f4-467b-4cc8-b164-f795401a0117 in dict_keys([('network-vif-plugged', '9f218cf2-d351-42a5-8b44-3e7ee9417bbd'), ('network-vif-plugged', 'd7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5'), ('network-vif-plugged', 'fd18fd3a-9dc5-4433-a638-72e5586eeb9c'), ('network-vif-plugged', 'bc674202-2354-4a2d-bdcf-3faf31e8cc7d'), ('network-vif-plugged', 'd184f1f0-b1f9-4c6f-a8d6-8e128f05bb44')]) {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 10:02:03.145821 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-5adb718d-7dc2-465b-905d-a484db3694df req-6e153272-dfd0-4e47-8285-a6a834ebbc22 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received unexpected event network-vif-plugged-12bb71f4-467b-4cc8-b164-f795401a0117 for instance with vm_state building and task_state spawning.
May 28 10:02:03.145821 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5adb718d-7dc2-465b-905d-a484db3694df req-6e153272-dfd0-4e47-8285-a6a834ebbc22 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-vif-plugged-9f218cf2-d351-42a5-8b44-3e7ee9417bbd {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:03.145821 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5adb718d-7dc2-465b-905d-a484db3694df req-6e153272-dfd0-4e47-8285-a6a834ebbc22 service nova] Acquiring lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:03.148014 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5adb718d-7dc2-465b-905d-a484db3694df req-6e153272-dfd0-4e47-8285-a6a834ebbc22 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:03.148014 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5adb718d-7dc2-465b-905d-a484db3694df req-6e153272-dfd0-4e47-8285-a6a834ebbc22 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:03.148014 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5adb718d-7dc2-465b-905d-a484db3694df req-6e153272-dfd0-4e47-8285-a6a834ebbc22 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Processing event network-vif-plugged-9f218cf2-d351-42a5-8b44-3e7ee9417bbd {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:02:03.148293 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5adb718d-7dc2-465b-905d-a484db3694df req-6e153272-dfd0-4e47-8285-a6a834ebbc22 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-vif-plugged-9f218cf2-d351-42a5-8b44-3e7ee9417bbd {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:03.148814 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5adb718d-7dc2-465b-905d-a484db3694df req-6e153272-dfd0-4e47-8285-a6a834ebbc22 service nova] Acquiring lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:03.149028 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5adb718d-7dc2-465b-905d-a484db3694df req-6e153272-dfd0-4e47-8285-a6a834ebbc22 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:03.149189 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5adb718d-7dc2-465b-905d-a484db3694df req-6e153272-dfd0-4e47-8285-a6a834ebbc22 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:03.149382 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5adb718d-7dc2-465b-905d-a484db3694df req-6e153272-dfd0-4e47-8285-a6a834ebbc22 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] No event matching network-vif-plugged-9f218cf2-d351-42a5-8b44-3e7ee9417bbd in dict_keys([('network-vif-plugged', 'd7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5'), ('network-vif-plugged', 'fd18fd3a-9dc5-4433-a638-72e5586eeb9c'), ('network-vif-plugged', 'bc674202-2354-4a2d-bdcf-3faf31e8cc7d'), ('network-vif-plugged', 'd184f1f0-b1f9-4c6f-a8d6-8e128f05bb44')]) {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 10:02:03.149570 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-5adb718d-7dc2-465b-905d-a484db3694df req-6e153272-dfd0-4e47-8285-a6a834ebbc22 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received unexpected event network-vif-plugged-9f218cf2-d351-42a5-8b44-3e7ee9417bbd for instance with vm_state building and task_state spawning.
May 28 10:02:03.151183 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5adb718d-7dc2-465b-905d-a484db3694df req-6e153272-dfd0-4e47-8285-a6a834ebbc22 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-vif-plugged-d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:03.151183 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5adb718d-7dc2-465b-905d-a484db3694df req-6e153272-dfd0-4e47-8285-a6a834ebbc22 service nova] Acquiring lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:03.151183 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5adb718d-7dc2-465b-905d-a484db3694df req-6e153272-dfd0-4e47-8285-a6a834ebbc22 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:03.151183 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5adb718d-7dc2-465b-905d-a484db3694df req-6e153272-dfd0-4e47-8285-a6a834ebbc22 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:03.151183 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5adb718d-7dc2-465b-905d-a484db3694df req-6e153272-dfd0-4e47-8285-a6a834ebbc22 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Processing event network-vif-plugged-d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:02:03.151183 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5adb718d-7dc2-465b-905d-a484db3694df req-6e153272-dfd0-4e47-8285-a6a834ebbc22 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-vif-plugged-d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:03.151183 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5adb718d-7dc2-465b-905d-a484db3694df req-6e153272-dfd0-4e47-8285-a6a834ebbc22 service nova] Acquiring lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:03.151183 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5adb718d-7dc2-465b-905d-a484db3694df req-6e153272-dfd0-4e47-8285-a6a834ebbc22 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:03.151183 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5adb718d-7dc2-465b-905d-a484db3694df req-6e153272-dfd0-4e47-8285-a6a834ebbc22 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:03.151183 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5adb718d-7dc2-465b-905d-a484db3694df req-6e153272-dfd0-4e47-8285-a6a834ebbc22 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] No event matching network-vif-plugged-d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5 in dict_keys([('network-vif-plugged', 'fd18fd3a-9dc5-4433-a638-72e5586eeb9c'), ('network-vif-plugged', 'bc674202-2354-4a2d-bdcf-3faf31e8cc7d'), ('network-vif-plugged', 'd184f1f0-b1f9-4c6f-a8d6-8e128f05bb44')]) {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 10:02:03.157871 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-5adb718d-7dc2-465b-905d-a484db3694df req-6e153272-dfd0-4e47-8285-a6a834ebbc22 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received unexpected event network-vif-plugged-d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5 for instance with vm_state building and task_state spawning.
May 28 10:02:03.157871 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5adb718d-7dc2-465b-905d-a484db3694df req-6e153272-dfd0-4e47-8285-a6a834ebbc22 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-vif-plugged-fd18fd3a-9dc5-4433-a638-72e5586eeb9c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:03.157871 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5adb718d-7dc2-465b-905d-a484db3694df req-6e153272-dfd0-4e47-8285-a6a834ebbc22 service nova] Acquiring lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:03.157871 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5adb718d-7dc2-465b-905d-a484db3694df req-6e153272-dfd0-4e47-8285-a6a834ebbc22 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:03.157871 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5adb718d-7dc2-465b-905d-a484db3694df req-6e153272-dfd0-4e47-8285-a6a834ebbc22 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:03.157871 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5adb718d-7dc2-465b-905d-a484db3694df req-6e153272-dfd0-4e47-8285-a6a834ebbc22 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Processing event network-vif-plugged-fd18fd3a-9dc5-4433-a638-72e5586eeb9c {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:02:03.267117 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962523.26672, 03313f66-d1dd-4269-b2e9-3b0796217299 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:02:03.267341 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] VM Started (Lifecycle Event)
May 28 10:02:03.334628 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Creating config drive at /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk.config
May 28 10:02:03.339821 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptlqc3cm7 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:03.356629 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:03.372299 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:03.389881 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:03.396854 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:03.403745 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptlqc3cm7" returned: 0 in 0.064s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:03.475248 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Acquiring lock "refresh_cache-b90b1ecd-e640-4f4e-bd02-fb74021db82b" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:02:03.475493 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Acquired lock "refresh_cache-b90b1ecd-e640-4f4e-bd02-fb74021db82b" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:02:03.475749 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:02:03.697915 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:03.705603 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ed5a827a-7917-4f36-bb30-17b0c8ee7086 req-67623ca6-2d5e-4e0f-837b-804b415fe1c8 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-vif-plugged-c2c9fb75-0a9e-47cb-a561-effaa19b4156 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:03.706082 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ed5a827a-7917-4f36-bb30-17b0c8ee7086 req-67623ca6-2d5e-4e0f-837b-804b415fe1c8 service nova] Acquiring lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:03.706739 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ed5a827a-7917-4f36-bb30-17b0c8ee7086 req-67623ca6-2d5e-4e0f-837b-804b415fe1c8 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:03.710617 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:03.713528 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ed5a827a-7917-4f36-bb30-17b0c8ee7086 req-67623ca6-2d5e-4e0f-837b-804b415fe1c8 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:03.713528 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ed5a827a-7917-4f36-bb30-17b0c8ee7086 req-67623ca6-2d5e-4e0f-837b-804b415fe1c8 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] No event matching network-vif-plugged-c2c9fb75-0a9e-47cb-a561-effaa19b4156 in dict_keys([('network-vif-plugged', 'bc674202-2354-4a2d-bdcf-3faf31e8cc7d'), ('network-vif-plugged', 'd184f1f0-b1f9-4c6f-a8d6-8e128f05bb44')]) {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 10:02:03.713528 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-ed5a827a-7917-4f36-bb30-17b0c8ee7086 req-67623ca6-2d5e-4e0f-837b-804b415fe1c8 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received unexpected event network-vif-plugged-c2c9fb75-0a9e-47cb-a561-effaa19b4156 for instance with vm_state building and task_state spawning.
May 28 10:02:03.713528 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ed5a827a-7917-4f36-bb30-17b0c8ee7086 req-67623ca6-2d5e-4e0f-837b-804b415fe1c8 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-vif-plugged-bc674202-2354-4a2d-bdcf-3faf31e8cc7d {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:03.713528 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ed5a827a-7917-4f36-bb30-17b0c8ee7086 req-67623ca6-2d5e-4e0f-837b-804b415fe1c8 service nova] Acquiring lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:03.713528 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ed5a827a-7917-4f36-bb30-17b0c8ee7086 req-67623ca6-2d5e-4e0f-837b-804b415fe1c8 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:03.713528 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ed5a827a-7917-4f36-bb30-17b0c8ee7086 req-67623ca6-2d5e-4e0f-837b-804b415fe1c8 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:03.713528 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ed5a827a-7917-4f36-bb30-17b0c8ee7086 req-67623ca6-2d5e-4e0f-837b-804b415fe1c8 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Processing event network-vif-plugged-bc674202-2354-4a2d-bdcf-3faf31e8cc7d {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:02:03.714586 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ed5a827a-7917-4f36-bb30-17b0c8ee7086 req-67623ca6-2d5e-4e0f-837b-804b415fe1c8 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-vif-plugged-bc674202-2354-4a2d-bdcf-3faf31e8cc7d {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:03.715281 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ed5a827a-7917-4f36-bb30-17b0c8ee7086 req-67623ca6-2d5e-4e0f-837b-804b415fe1c8 service nova] Acquiring lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:03.721720 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ed5a827a-7917-4f36-bb30-17b0c8ee7086 req-67623ca6-2d5e-4e0f-837b-804b415fe1c8 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:03.722221 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ed5a827a-7917-4f36-bb30-17b0c8ee7086 req-67623ca6-2d5e-4e0f-837b-804b415fe1c8 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:03.723109 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ed5a827a-7917-4f36-bb30-17b0c8ee7086 req-67623ca6-2d5e-4e0f-837b-804b415fe1c8 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] No event matching network-vif-plugged-bc674202-2354-4a2d-bdcf-3faf31e8cc7d in dict_keys([('network-vif-plugged', 'd184f1f0-b1f9-4c6f-a8d6-8e128f05bb44')]) {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 10:02:03.723422 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-ed5a827a-7917-4f36-bb30-17b0c8ee7086 req-67623ca6-2d5e-4e0f-837b-804b415fe1c8 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received unexpected event network-vif-plugged-bc674202-2354-4a2d-bdcf-3faf31e8cc7d for instance with vm_state building and task_state spawning.
May 28 10:02:03.724219 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ed5a827a-7917-4f36-bb30-17b0c8ee7086 req-67623ca6-2d5e-4e0f-837b-804b415fe1c8 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-vif-plugged-d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:03.724219 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ed5a827a-7917-4f36-bb30-17b0c8ee7086 req-67623ca6-2d5e-4e0f-837b-804b415fe1c8 service nova] Acquiring lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:03.724428 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ed5a827a-7917-4f36-bb30-17b0c8ee7086 req-67623ca6-2d5e-4e0f-837b-804b415fe1c8 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:03.724930 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ed5a827a-7917-4f36-bb30-17b0c8ee7086 req-67623ca6-2d5e-4e0f-837b-804b415fe1c8 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:03.724930 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ed5a827a-7917-4f36-bb30-17b0c8ee7086 req-67623ca6-2d5e-4e0f-837b-804b415fe1c8 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Processing event network-vif-plugged-d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:02:03.724930 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ed5a827a-7917-4f36-bb30-17b0c8ee7086 req-67623ca6-2d5e-4e0f-837b-804b415fe1c8 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-vif-plugged-d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:03.725082 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ed5a827a-7917-4f36-bb30-17b0c8ee7086 req-67623ca6-2d5e-4e0f-837b-804b415fe1c8 service nova] Acquiring lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:03.725283 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ed5a827a-7917-4f36-bb30-17b0c8ee7086 req-67623ca6-2d5e-4e0f-837b-804b415fe1c8 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:03.725427 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ed5a827a-7917-4f36-bb30-17b0c8ee7086 req-67623ca6-2d5e-4e0f-837b-804b415fe1c8 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:03.725594 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ed5a827a-7917-4f36-bb30-17b0c8ee7086 req-67623ca6-2d5e-4e0f-837b-804b415fe1c8 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] No waiting events found dispatching network-vif-plugged-d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:02:03.725745 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-ed5a827a-7917-4f36-bb30-17b0c8ee7086 req-67623ca6-2d5e-4e0f-837b-804b415fe1c8 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received unexpected event network-vif-plugged-d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44 for instance with vm_state building and task_state spawning.
May 28 10:02:03.729980 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Instance event wait completed in 0 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:02:03.739975 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:02:03.748075 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Instance spawned successfully.
May 28 10:02:03.748864 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:02:03.772668 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:02:03.779619 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:02:03.911181 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-05fad6ae-5ba0-49fd-90ac-ea2b20131e60 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:02:03.911501 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-05fad6ae-5ba0-49fd-90ac-ea2b20131e60 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:02:03.957904 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:03.979702 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:03.992055 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:03.996402 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:04.099330 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:04.103944 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-65288f3e-72c0-457f-955e-51fae0dabd28 req-97fef9a1-3b5d-4354-be61-8a3670352390 service nova] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Received event volume-reimaged-83485657-e133-49aa-baed-d67cb2fd1720 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:04.103944 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-65288f3e-72c0-457f-955e-51fae0dabd28 req-97fef9a1-3b5d-4354-be61-8a3670352390 service nova] Acquiring lock "9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:04.103944 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-65288f3e-72c0-457f-955e-51fae0dabd28 req-97fef9a1-3b5d-4354-be61-8a3670352390 service nova] Lock "9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:04.103944 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-65288f3e-72c0-457f-955e-51fae0dabd28 req-97fef9a1-3b5d-4354-be61-8a3670352390 service nova] Lock "9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:04.103944 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-65288f3e-72c0-457f-955e-51fae0dabd28 req-97fef9a1-3b5d-4354-be61-8a3670352390 service nova] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Processing event volume-reimaged-83485657-e133-49aa-baed-d67cb2fd1720 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:02:04.104601 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Instance event wait completed in 9 seconds for volume-reimaged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:02:04.192066 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:04.269116 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:02:04.269397 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:02:04.269811 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:02:04.270180 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:02:04.270631 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:02:04.270979 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:02:04.284118 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:02:04.284519 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962524.2842543, 03313f66-d1dd-4269-b2e9-3b0796217299 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:02:04.284822 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] VM Paused (Lifecycle Event)
May 28 10:02:04.352433 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:04.416194 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-05fad6ae-5ba0-49fd-90ac-ea2b20131e60 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:02:04.496583 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:04.619115 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Booting with volume 83485657-e133-49aa-baed-d67cb2fd1720 at /dev/vda
May 28 10:02:04.673542 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Updating instance_info_cache with network_info: [{"id": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "address": "fa:16:3e:b1:88:d2", "network": {"id": "9d46c174-21e3-464e-83c9-e8db18f486a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-151012625-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e1727c7fbc44459c6972d182fc25b1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a01cd4-8a", "ovs_interfaceid": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:02:04.692663 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:02:04.709639 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:02:04.739803 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:04.790341 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:02:04.791574 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:02:04.791877 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:02:04.793464 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Took 34.73 seconds to spawn the instance on the hypervisor.
May 28 10:02:04.794227 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:02:04.804301 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962524.8038423, 03313f66-d1dd-4269-b2e9-3b0796217299 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:02:04.804496 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] VM Resumed (Lifecycle Event)
May 28 10:02:04.811720 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:02:04.814740 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe2d:94a4', 'fe80::2844:59ff:feec:5d21', 'fe80::fc16:3eff:fefd:30e7', 'fe80::e4df:c0ff:fe86:6341', 'fe80::ce2:7bff:fe0e:d096', 'fe80::fc16:3eff:fedb:1077', 'fe80::fc16:3eff:fee0:9ccd', 'fe80::fc16:3eff:fe3c:b7e1', 'fe80::fc16:3eff:fe86:604b', 'fe80::fc16:3eff:fe44:a72', 'fe80::fc16:3eff:fe05:9ea2', 'fe80::3037:7fff:fec8:89ce', 'fe80::fc16:3eff:fea8:9a37', 'fe80::44e2:31ff:fe81:8771', 'fe80::fc16:3eff:fed2:27b6', 'fe80::fc16:3eff:feaf:c736', 'fe80::24a6:e6ff:febf:f93c', 'fe80::fc16:3eff:fe24:b36a', 'fe80::fc16:3eff:fe5d:f989', 'fe80::fc16:3eff:fea3:f365', 'fe80::fc16:3eff:fee5:b9aa', 'fe80::fc16:3eff:feeb:2b41', 'fe80::8038:a7ff:fe21:5b5c', 'fe80::fc16:3eff:fed0:5ae8', 'fe80::7c9a:d6ff:fe01:2456', 'fe80::fc16:3eff:fee1:659'] 
May 28 10:02:04.816311 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:02:04.816501 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:02:04.816858 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:02:04.817149 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Updating existing volume attachment record: 86c3c05f-d7cb-4d74-a62a-e86ed22c6ef6 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:02:05.177616 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Releasing lock "refresh_cache-b90b1ecd-e640-4f4e-bd02-fb74021db82b" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:02:05.220286 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8bc5ab4d-099a-4717-8076-7e450d2406d8 req-3d8230af-4676-4446-b8f2-d512b7e8893f service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-vif-plugged-fd18fd3a-9dc5-4433-a638-72e5586eeb9c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:05.220364 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8bc5ab4d-099a-4717-8076-7e450d2406d8 req-3d8230af-4676-4446-b8f2-d512b7e8893f service nova] Acquiring lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:05.220588 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8bc5ab4d-099a-4717-8076-7e450d2406d8 req-3d8230af-4676-4446-b8f2-d512b7e8893f service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:05.220775 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8bc5ab4d-099a-4717-8076-7e450d2406d8 req-3d8230af-4676-4446-b8f2-d512b7e8893f service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:05.220895 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8bc5ab4d-099a-4717-8076-7e450d2406d8 req-3d8230af-4676-4446-b8f2-d512b7e8893f service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] No waiting events found dispatching network-vif-plugged-fd18fd3a-9dc5-4433-a638-72e5586eeb9c {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:02:05.221018 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-8bc5ab4d-099a-4717-8076-7e450d2406d8 req-3d8230af-4676-4446-b8f2-d512b7e8893f service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received unexpected event network-vif-plugged-fd18fd3a-9dc5-4433-a638-72e5586eeb9c for instance with vm_state active and task_state None.
May 28 10:02:05.314309 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:02:05.314944 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Took 47.45 seconds to build instance.
May 28 10:02:05.316725 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:02:05.431118 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-05fad6ae-5ba0-49fd-90ac-ea2b20131e60 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 3.381s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:05.690155 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:02:05.700583 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:02:05.721294 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:05.770280 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:02:05.770856 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:02:05.783543 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:02:05.786188 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe2d:94a4', 'fe80::2844:59ff:feec:5d21', 'fe80::fc16:3eff:fefd:30e7', 'fe80::e4df:c0ff:fe86:6341', 'fe80::ce2:7bff:fe0e:d096', 'fe80::fc16:3eff:fedb:1077', 'fe80::fc16:3eff:fee0:9ccd', 'fe80::fc16:3eff:fe3c:b7e1', 'fe80::fc16:3eff:fe86:604b', 'fe80::fc16:3eff:fe44:a72', 'fe80::fc16:3eff:fe05:9ea2', 'fe80::3037:7fff:fec8:89ce', 'fe80::fc16:3eff:fea8:9a37', 'fe80::44e2:31ff:fe81:8771', 'fe80::fc16:3eff:fed2:27b6', 'fe80::fc16:3eff:feaf:c736', 'fe80::24a6:e6ff:febf:f93c', 'fe80::fc16:3eff:fe24:b36a', 'fe80::fc16:3eff:fe5d:f989', 'fe80::fc16:3eff:fea3:f365', 'fe80::fc16:3eff:fee5:b9aa', 'fe80::fc16:3eff:feeb:2b41', 'fe80::8038:a7ff:fe21:5b5c', 'fe80::fc16:3eff:fed0:5ae8', 'fe80::7c9a:d6ff:fe01:2456', 'fe80::fc16:3eff:fee1:659'] 
May 28 10:02:05.786803 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:02:05.786980 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:02:05.787354 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:02:05.795384 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cda980d6-9804-42cc-abc1-111cd3898375 req-2dcb886a-5ef6-4ec3-b937-1c62cb556fb1 service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Received event network-vif-plugged-0e857900-174b-46cf-bfa1-ce7f2f8ffdb1 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:05.797199 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cda980d6-9804-42cc-abc1-111cd3898375 req-2dcb886a-5ef6-4ec3-b937-1c62cb556fb1 service nova] Acquiring lock "36fde791-779f-42a8-9aef-87eafbbe0370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:05.797199 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cda980d6-9804-42cc-abc1-111cd3898375 req-2dcb886a-5ef6-4ec3-b937-1c62cb556fb1 service nova] Lock "36fde791-779f-42a8-9aef-87eafbbe0370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:05.797568 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cda980d6-9804-42cc-abc1-111cd3898375 req-2dcb886a-5ef6-4ec3-b937-1c62cb556fb1 service nova] Lock "36fde791-779f-42a8-9aef-87eafbbe0370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:05.797568 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cda980d6-9804-42cc-abc1-111cd3898375 req-2dcb886a-5ef6-4ec3-b937-1c62cb556fb1 service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Processing event network-vif-plugged-0e857900-174b-46cf-bfa1-ce7f2f8ffdb1 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:02:05.797756 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cda980d6-9804-42cc-abc1-111cd3898375 req-2dcb886a-5ef6-4ec3-b937-1c62cb556fb1 service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Received event network-vif-plugged-0e857900-174b-46cf-bfa1-ce7f2f8ffdb1 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:05.798067 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cda980d6-9804-42cc-abc1-111cd3898375 req-2dcb886a-5ef6-4ec3-b937-1c62cb556fb1 service nova] Acquiring lock "36fde791-779f-42a8-9aef-87eafbbe0370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:05.798586 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cda980d6-9804-42cc-abc1-111cd3898375 req-2dcb886a-5ef6-4ec3-b937-1c62cb556fb1 service nova] Lock "36fde791-779f-42a8-9aef-87eafbbe0370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:05.798747 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cda980d6-9804-42cc-abc1-111cd3898375 req-2dcb886a-5ef6-4ec3-b937-1c62cb556fb1 service nova] Lock "36fde791-779f-42a8-9aef-87eafbbe0370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:05.798921 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cda980d6-9804-42cc-abc1-111cd3898375 req-2dcb886a-5ef6-4ec3-b937-1c62cb556fb1 service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] No waiting events found dispatching network-vif-plugged-0e857900-174b-46cf-bfa1-ce7f2f8ffdb1 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:02:05.799082 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-cda980d6-9804-42cc-abc1-111cd3898375 req-2dcb886a-5ef6-4ec3-b937-1c62cb556fb1 service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Received unexpected event network-vif-plugged-0e857900-174b-46cf-bfa1-ce7f2f8ffdb1 for instance with vm_state building and task_state spawning.
May 28 10:02:05.801223 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:02:05.805367 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:02:05.808603 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Instance spawned successfully.
May 28 10:02:05.809417 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:02:05.816798 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "03313f66-d1dd-4269-b2e9-3b0796217299" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 48.962s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:05.820609 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962525.8202791, 36fde791-779f-42a8-9aef-87eafbbe0370 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:02:05.820748 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] VM Started (Lifecycle Event)
May 28 10:02:05.921390 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:06.099664 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-05fad6ae-5ba0-49fd-90ac-ea2b20131e60 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Deleted allocation for migration 24fe5c6e-268a-4ec1-90eb-21775d843fda
May 28 10:02:06.317907 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:02:06.317907 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:02:06.318387 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:02:06.318771 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:02:06.319228 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:02:06.319571 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:02:06.331516 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:02:06.342790 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:02:06.608626 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-05fad6ae-5ba0-49fd-90ac-ea2b20131e60 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 8.183s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:06.615581 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-cbf95cf6-9855-4757-b061-057806940088 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Get console output
May 28 10:02:06.716614 np0000001613 nova-compute[98321]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
May 28 10:02:06.825779 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Took 8.71 seconds to spawn the instance on the hypervisor.
May 28 10:02:06.826053 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:02:06.845332 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:02:06.845656 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962526.8453915, 36fde791-779f-42a8-9aef-87eafbbe0370 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:02:06.845816 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] VM Paused (Lifecycle Event)
May 28 10:02:06.948021 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Starting finish_migration {{(pid=98321) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 28 10:02:06.949440 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Instance directory exists: not creating {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 10:02:06.949574 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Creating image(s)
May 28 10:02:06.950273 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:06.984529 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:02:06.984964 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Creating image(s)
May 28 10:02:06.985251 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Did not create local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 10:02:06.985401 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Ensure instance console log exists: /opt/stack/data/nova/instances/9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:02:06.985779 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:06.986055 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:06.986352 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:06.987121 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Start _get_guest_xml network_info=[{"id": "b45721cf-794a-4cef-9660-816123b5b144", "address": "fa:16:3e:15:41:54", "network": {"id": "a546cd76-74b1-4628-b9bf-c80f6b8f1bec", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1194909584-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2b4cc0430ca14757a829b60eb7e0081e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45721cf-79", "ovs_interfaceid": "b45721cf-794a-4cef-9660-816123b5b144", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-28T09:55:05Z,direct_url=<?>,disk_format='qcow2',id=3427ea11-12a6-4b25-8c73-769d29819fe0,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-28T09:55:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83485657-e133-49aa-baed-d67cb2fd1720', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590', 'attached_at': '', 'detached_at': '', 'volume_id': '83485657-e133-49aa-baed-d67cb2fd1720', 'serial': '83485657-e133-49aa-baed-d67cb2fd1720'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '86c3c05f-d7cb-4d74-a62a-e86ed22c6ef6', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:02:06.994305 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
May 28 10:02:06.996350 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='3427ea11-12a6-4b25-8c73-769d29819fe0', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsV293TestJSON-server-1145093383', uuid='9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590'), owner=OwnerMeta(userid='321e041ada2b405e821acd703457ddcb', username='tempest-ServerActionsV293TestJSON-1376389954-project-member', projectid='2b4cc0430ca14757a829b60eb7e0081e', projectname='tempest-ServerActionsV293TestJSON-1376389954'), image=ImageMeta(id='', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b45721cf-794a-4cef-9660-816123b5b144", "address": "fa:16:3e:15:41:54", "network": {"id": "a546cd76-74b1-4628-b9bf-c80f6b8f1bec", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1194909584-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2b4cc0430ca14757a829b60eb7e0081e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45721cf-79", "ovs_interfaceid": "b45721cf-794a-4cef-9660-816123b5b144", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962526.995802) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:02:06.998413 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:02:07.001084 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:02:07.004050 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c806c35d-a850-4f28-878a-89f0658945ce req-7065b2ba-4cf1-4685-b616-96283475b42e service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-changed-12bb71f4-467b-4cc8-b164-f795401a0117 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:07.004672 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c806c35d-a850-4f28-878a-89f0658945ce req-7065b2ba-4cf1-4685-b616-96283475b42e service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Refreshing instance network info cache due to event network-changed-12bb71f4-467b-4cc8-b164-f795401a0117. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:02:07.004672 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c806c35d-a850-4f28-878a-89f0658945ce req-7065b2ba-4cf1-4685-b616-96283475b42e service nova] Acquiring lock "refresh_cache-03313f66-d1dd-4269-b2e9-3b0796217299" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:02:07.005177 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:02:07.006631 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c806c35d-a850-4f28-878a-89f0658945ce req-7065b2ba-4cf1-4685-b616-96283475b42e service nova] Acquired lock "refresh_cache-03313f66-d1dd-4269-b2e9-3b0796217299" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:02:07.006631 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-c806c35d-a850-4f28-878a-89f0658945ce req-7065b2ba-4cf1-4685-b616-96283475b42e service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Refreshing network info cache for port 12bb71f4-467b-4cc8-b164-f795401a0117 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:02:07.008832 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:02:07.010623 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:02:07.010893 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-28T09:55:05Z,direct_url=<?>,disk_format='qcow2',id=3427ea11-12a6-4b25-8c73-769d29819fe0,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-28T09:55:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:02:07.011111 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:02:07.011271 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:02:07.012069 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:02:07.012069 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:02:07.012069 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:02:07.012069 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:02:07.012297 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:02:07.013607 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:02:07.014335 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:02:07.014533 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:02:07.014933 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:07.041400 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.091s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:07.041818 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:02:07.042078 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:07.156314 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:07.156862 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Cannot resize image /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:02:07.341229 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Took 16.57 seconds to build instance.
May 28 10:02:07.349233 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:02:07.355654 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962527.3550234, 36fde791-779f-42a8-9aef-87eafbbe0370 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:02:07.355654 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] VM Resumed (Lifecycle Event)
May 28 10:02:07.508703 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-c806c35d-a850-4f28-878a-89f0658945ce req-7065b2ba-4cf1-4685-b616-96283475b42e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:07.531398 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:02:07.531625 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83485657-e133-49aa-baed-d67cb2fd1720', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:02:07.531864 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:02:07.532243 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:02:07.532386 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83485657-e133-49aa-baed-d67cb2fd1720', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:02:07.549286 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:02:07.549771 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:02:07.550031 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:02:07.550736 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:02:07.551091 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:02:07.552112 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:02:07.570433 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:02:07.570433 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:07.571142 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:02:07.571142 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:07.587026 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720] added
May 28 10:02:07.587026 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:02:07.587026 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:02:07.587026 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:02:07.587026 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:02:07.587026 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:02:07.587026 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:07.588383 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:02:07.588383 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0358(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:02:07.588383 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:02:07.590541 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720] added
May 28 10:02:07.590541 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:02:07.590541 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:02:07.590541 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:02:07.590541 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:02:07.590541 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:02:07.590541 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:07.590541 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:02:07.590959 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0406(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:02:07.590959 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:02:07.660322 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Did not create local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 10:02:07.660797 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Ensure instance console log exists: /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:02:07.661388 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:07.661388 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:07.661617 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:07.665553 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Start _get_guest_xml network_info=[{"id": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "address": "fa:16:3e:b1:88:d2", "network": {"id": "9d46c174-21e3-464e-83c9-e8db18f486a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-151012625-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.13", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-151012625-network", "vif_mac": "fa:16:3e:b1:88:d2"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e1727c7fbc44459c6972d182fc25b1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a01cd4-8a", "ovs_interfaceid": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '305d8623-c6f8-456c-83ed-46d06c6de0ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'b90b1ecd-e640-4f4e-bd02-fb74021db82b', 'attached_at': '2026-05-28T10:02:06.000000', 'detached_at': '', 'volume_id': '305d8623-c6f8-456c-83ed-46d06c6de0ea', 'serial': '305d8623-c6f8-456c-83ed-46d06c6de0ea'}, 'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': '0bf33087-354c-4da2-ba1b-ddc712bbb660', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:02:07.671887 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:02:07.675191 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-1921152164', uuid='b90b1ecd-e640-4f4e-bd02-fb74021db82b'), owner=OwnerMeta(userid='11b9cab1ceef4e4b8cba521b61ad3f55', username='tempest-ServerActionsTestOtherB-634969206-project-member', projectid='11e1727c7fbc44459c6972d182fc25b1', projectname='tempest-ServerActionsTestOtherB-634969206'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "address": "fa:16:3e:b1:88:d2", "network": {"id": "9d46c174-21e3-464e-83c9-e8db18f486a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-151012625-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.13", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-151012625-network", "vif_mac": "fa:16:3e:b1:88:d2"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e1727c7fbc44459c6972d182fc25b1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a01cd4-8a", "ovs_interfaceid": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962527.67289) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:02:07.676761 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:02:07.677141 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:02:07.679015 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:02:07.679015 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:02:07.679899 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:02:07.680254 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:02:07.680467 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:02:07.680688 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:02:07.680837 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:02:07.680926 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:02:07.681015 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:02:07.681276 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:02:07.681417 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:02:07.681593 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:02:07.681698 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:02:07.681813 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:02:07.694856 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk.config --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:07.797588 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk.config --force-share --output=json" returned: 0 in 0.102s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:07.802436 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Acquiring lock "/opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:07.802887 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "/opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:07.804184 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "/opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:07.805600 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:02:07.805600 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '305d8623-c6f8-456c-83ed-46d06c6de0ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:02:07.806552 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:02:07.843931 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "36fde791-779f-42a8-9aef-87eafbbe0370" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.085s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:07.858874 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:02:07.862739 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:02:08.032445 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-c806c35d-a850-4f28-878a-89f0658945ce req-7065b2ba-4cf1-4685-b616-96283475b42e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:08.342049 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-c806c35d-a850-4f28-878a-89f0658945ce req-7065b2ba-4cf1-4685-b616-96283475b42e service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Updated VIF entry in instance network info cache for port 12bb71f4-467b-4cc8-b164-f795401a0117. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:02:08.342824 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-c806c35d-a850-4f28-878a-89f0658945ce req-7065b2ba-4cf1-4685-b616-96283475b42e service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Updating instance_info_cache with network_info: [{"id": "12bb71f4-467b-4cc8-b164-f795401a0117", "address": "fa:16:3e:af:c7:36", "network": {"id": "1008534f-5c0f-4968-962e-d7e533fcc852", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1379747783-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12bb71f4-46", "ovs_interfaceid": "12bb71f4-467b-4cc8-b164-f795401a0117", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f218cf2-d351-42a5-8b44-3e7ee9417bbd", "address": "fa:16:3e:24:b3:6a", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f218cf2-d3", "ovs_interfaceid": "9f218cf2-d351-42a5-8b44-3e7ee9417bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c2c9fb75-0a9e-47cb-a561-effaa19b4156", "address": "fa:16:3e:5d:f9:89", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c9fb75-0a", "ovs_interfaceid": "c2c9fb75-0a9e-47cb-a561-effaa19b4156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5", "address": "fa:16:3e:a3:f3:65", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7db2f4e-c4", "ovs_interfaceid": "d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd18fd3a-9dc5-4433-a638-72e5586eeb9c", "address": "fa:16:3e:e5:b9:aa", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd18fd3a-9d", "ovs_interfaceid": "fd18fd3a-9dc5-4433-a638-72e5586eeb9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bc674202-2354-4a2d-bdcf-3faf31e8cc7d", "address": "fa:16:3e:eb:2b:41", "network": {"id": "da83acc7-b5da-4d42-bd74-8a3a51d2f657", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377824470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc674202-23", "ovs_interfaceid": "bc674202-2354-4a2d-bdcf-3faf31e8cc7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44", "address": "fa:16:3e:d0:5a:e8", "network": {"id": "da83acc7-b5da-4d42-bd74-8a3a51d2f657", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377824470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd184f1f0-b1", "ovs_interfaceid": "d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:02:08.412871 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-9a939900-3631-47bc-9b6e-c109b079b6a2 req-f3a1bf8a-8899-41a6-b3e2-2a906e36bd51 service nova] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Received event network-changed-dc94f5df-ac70-45ed-b3e3-795fc10af261 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:08.413532 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-9a939900-3631-47bc-9b6e-c109b079b6a2 req-f3a1bf8a-8899-41a6-b3e2-2a906e36bd51 service nova] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Refreshing instance network info cache due to event network-changed-dc94f5df-ac70-45ed-b3e3-795fc10af261. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:02:08.413850 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9a939900-3631-47bc-9b6e-c109b079b6a2 req-f3a1bf8a-8899-41a6-b3e2-2a906e36bd51 service nova] Acquiring lock "refresh_cache-3edc00a8-2c60-4c44-acb8-6f4d02114bf0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:02:08.413927 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9a939900-3631-47bc-9b6e-c109b079b6a2 req-f3a1bf8a-8899-41a6-b3e2-2a906e36bd51 service nova] Acquired lock "refresh_cache-3edc00a8-2c60-4c44-acb8-6f4d02114bf0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:02:08.414103 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-9a939900-3631-47bc-9b6e-c109b079b6a2 req-f3a1bf8a-8899-41a6-b3e2-2a906e36bd51 service nova] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Refreshing network info cache for port dc94f5df-ac70-45ed-b3e3-795fc10af261 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:02:08.588576 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:02:08.591441 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:02:08.605710 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:02:08.605710 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:02:08.612659 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:02:08.612659 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:08.621142 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:08.631007 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:08.644136 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:08.644136 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:08.644136 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:08.644136 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:08.644136 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:08.644136 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:08.644136 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:08.644136 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:08.644136 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:08.644136 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:08.644136 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:02:08.644434 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:08.644434 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:08.644434 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:08.644434 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:08.644434 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:08.644434 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:08.644434 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:08.644434 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:08.644434 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:08.644434 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:08.644434 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:02:08.655611 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:08.655611 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:08.655611 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:08.655611 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:08.655611 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:08.655611 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:08.655611 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:08.655611 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:08.655611 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:08.655611 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:08.655611 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:02:08.656129 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:08.656129 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:08.656129 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:08.656129 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:08.656129 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:08.656129 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:08.656129 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:08.656129 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:08.656129 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:08.656129 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:08.656129 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:02:08.707583 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720, portal: 192.168.50.100,3260]
May 28 10:02:08.707583 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720, portal: 192.168.50.100,3260] successful.
May 28 10:02:08.707583 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:08.720668 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720, portal: 192.168.40.100,3260]
May 28 10:02:08.720668 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720, portal: 192.168.40.100,3260] successful.
May 28 10:02:08.720668 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:08.727093 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:08.736836 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:08.755144 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:08.755144 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:08.755144 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:08.755144 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:08.755144 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:08.755144 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:08.755144 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:08.755144 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:08.755144 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:08.755144 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:08.755144 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:08.755144 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:08.755144 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:02:08.755597 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:08.755597 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:08.755597 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:08.755597 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:08.755597 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:08.755597 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:08.755597 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:08.755597 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:08.755597 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:08.755597 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:08.755597 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:08.755597 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:08.755597 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:02:08.756243 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.205s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:02:08.756243 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:02:08.758289 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] HCTL ('9', '-', '-', 0) found on session 53 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:02:08.758416 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:02:08.763790 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:08.763790 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:08.763790 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:08.763790 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:08.763790 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:08.763790 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:08.763790 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:08.763790 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:08.763790 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:08.763790 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:08.763790 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:08.763790 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:08.763790 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:02:08.764300 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:08.764300 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:08.764300 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:08.764300 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:08.764300 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:08.764300 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:08.764300 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:08.764300 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:08.764300 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:08.764300 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:08.764300 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:08.764300 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:08.764300 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:02:08.764528 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.215s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:02:08.764528 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:02:08.766014 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] HCTL ('10', '-', '-', 0) found on session 54 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:02:08.766194 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:02:08.772422 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Searching for a device in session 53 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:02:08.772422 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '83485657-e133-49aa-baed-d67cb2fd1720', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:02:08.786227 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Searching for a device in session 54 and hctl ['10', '*', '*', 0] yield: None {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:02:08.848020 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c806c35d-a850-4f28-878a-89f0658945ce req-7065b2ba-4cf1-4685-b616-96283475b42e service nova] Releasing lock "refresh_cache-03313f66-d1dd-4269-b2e9-3b0796217299" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:02:08.917541 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-9a939900-3631-47bc-9b6e-c109b079b6a2 req-f3a1bf8a-8899-41a6-b3e2-2a906e36bd51 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:09.355682 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:09.373191 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-9a939900-3631-47bc-9b6e-c109b079b6a2 req-f3a1bf8a-8899-41a6-b3e2-2a906e36bd51 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:09.560094 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-9a939900-3631-47bc-9b6e-c109b079b6a2 req-f3a1bf8a-8899-41a6-b3e2-2a906e36bd51 service nova] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Updated VIF entry in instance network info cache for port dc94f5df-ac70-45ed-b3e3-795fc10af261. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:02:09.560423 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-9a939900-3631-47bc-9b6e-c109b079b6a2 req-f3a1bf8a-8899-41a6-b3e2-2a906e36bd51 service nova] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Updating instance_info_cache with network_info: [{"id": "dc94f5df-ac70-45ed-b3e3-795fc10af261", "address": "fa:16:3e:3c:b7:e1", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc94f5df-ac", "ovs_interfaceid": "dc94f5df-ac70-45ed-b3e3-795fc10af261", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:02:09.786757 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Searching for a device in session 54 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:02:09.787233 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83485657-e133-49aa-baed-d67cb2fd1720', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:02:09.850914 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "de9742b9-43db-40a6-b635-81d9244fd5e0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:09.851264 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "de9742b9-43db-40a6-b635-81d9244fd5e0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:10.062569 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9a939900-3631-47bc-9b6e-c109b079b6a2 req-f3a1bf8a-8899-41a6-b3e2-2a906e36bd51 service nova] Releasing lock "refresh_cache-3edc00a8-2c60-4c44-acb8-6f4d02114bf0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:02:10.355751 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:02:10.505196 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a1f3e47b-86cc-487f-84ad-84fa2c94a9dd req-2448c758-aad5-4df3-81ce-01f244a6533f service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Received event network-changed-0e857900-174b-46cf-bfa1-ce7f2f8ffdb1 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:10.505196 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a1f3e47b-86cc-487f-84ad-84fa2c94a9dd req-2448c758-aad5-4df3-81ce-01f244a6533f service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Refreshing instance network info cache due to event network-changed-0e857900-174b-46cf-bfa1-ce7f2f8ffdb1. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:02:10.505376 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a1f3e47b-86cc-487f-84ad-84fa2c94a9dd req-2448c758-aad5-4df3-81ce-01f244a6533f service nova] Acquiring lock "refresh_cache-36fde791-779f-42a8-9aef-87eafbbe0370" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:02:10.505376 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a1f3e47b-86cc-487f-84ad-84fa2c94a9dd req-2448c758-aad5-4df3-81ce-01f244a6533f service nova] Acquired lock "refresh_cache-36fde791-779f-42a8-9aef-87eafbbe0370" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:02:10.506191 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-a1f3e47b-86cc-487f-84ad-84fa2c94a9dd req-2448c758-aad5-4df3-81ce-01f244a6533f service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Refreshing network info cache for port 0e857900-174b-46cf-bfa1-ce7f2f8ffdb1 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:02:10.576151 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Found WWN 3300000005fd58f27 for multipath device dm-3 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:02:10.576631 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.044s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:02:10.577652 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.771s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:02:10.578744 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] <== connect_volume: return (3045ms) {'type': 'block', 'scsi_wwn': '3300000005fd58f27', 'path': '/dev/dm-3', 'multipath_id': '3300000005fd58f27'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:02:10.578744 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005fd58f27', 'path': '/dev/dm-3', 'multipath_id': '3300000005fd58f27'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:02:10.578744 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '305d8623-c6f8-456c-83ed-46d06c6de0ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:02:10.594466 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:02:10.595404 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:02:10.595757 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:02:10.596640 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:02:10.597467 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:02:10.597708 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:02:10.609892 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:02:10.609892 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:10.617628 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:02:10.617628 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:10.625060 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea] added
May 28 10:02:10.625060 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:02:10.625060 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:02:10.625060 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:02:10.625060 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:02:10.625060 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:02:10.625060 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:10.625465 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:02:10.625598 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0298(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:02:10.625699 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:02:10.636474 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea] added
May 28 10:02:10.636474 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:02:10.636474 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:02:10.636474 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:02:10.636474 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:02:10.636474 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:02:10.636474 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:10.636814 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:02:10.636883 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0392(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:02:10.637086 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:02:10.922890 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:10.936721 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:10.937123 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:10.941527 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:02:10.941752 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Claim successful on node np0000001613
May 28 10:02:11.012040 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-a1f3e47b-86cc-487f-84ad-84fa2c94a9dd req-2448c758-aad5-4df3-81ce-01f244a6533f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:11.086383 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T10:00:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1145093383',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serveractionsv293testjson-server-1963844026',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAMk9iSLwMbw4Ei6MHI0esC/55Rcy6sQ2tiWuKsyMq8m3KvVeicKJFpNeMJUkrZC2YauMY8UtCiYY/mGIoDtQfJzjOysD9ZOhrfUaZ1uCfXpLOQ02ek21gk2Qq+Gwmp7g==',key_name='tempest-keypair-1857006641',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:01:01Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2b4cc0430ca14757a829b60eb7e0081e',ramdisk_id='',reservation_id='r-i2a86n6f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3427ea11-12a6-4b25-8c73-769d29819fe0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1376389954',owner_user_name='tempest-ServerActionsV293TestJSON-1376389954-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:02:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='321e041ada2b405e821acd703457ddcb',uuid=9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b45721cf-794a-4cef-9660-816123b5b144", "address": "fa:16:3e:15:41:54", "network": {"id": "a546cd76-74b1-4628-b9bf-c80f6b8f1bec", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1194909584-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2b4cc0430ca14757a829b60eb7e0081e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45721cf-79", "ovs_interfaceid": "b45721cf-794a-4cef-9660-816123b5b144", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:02:11.087261 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Converting VIF {"id": "b45721cf-794a-4cef-9660-816123b5b144", "address": "fa:16:3e:15:41:54", "network": {"id": "a546cd76-74b1-4628-b9bf-c80f6b8f1bec", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1194909584-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2b4cc0430ca14757a829b60eb7e0081e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45721cf-79", "ovs_interfaceid": "b45721cf-794a-4cef-9660-816123b5b144", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:02:11.092529 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:41:54,bridge_name='br-int',has_traffic_filtering=True,id=b45721cf-794a-4cef-9660-816123b5b144,network=Network(a546cd76-74b1-4628-b9bf-c80f6b8f1bec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb45721cf-79') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:02:11.094723 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] End _get_guest_xml xml=<domain type="qemu">
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:   <uuid>9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590</uuid>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:   <name>instance-00000017</name>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1145093383</nova:name>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:02:06</nova:creationTime>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:       <nova:image uuid="3427ea11-12a6-4b25-8c73-769d29819fe0">
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:         <nova:user uuid="321e041ada2b405e821acd703457ddcb">tempest-ServerActionsV293TestJSON-1376389954-project-member</nova:user>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:         <nova:project uuid="2b4cc0430ca14757a829b60eb7e0081e">tempest-ServerActionsV293TestJSON-1376389954</nova:project>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:       <nova:root type="volume" uuid="3427ea11-12a6-4b25-8c73-769d29819fe0"/>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:         <nova:port uuid="b45721cf-794a-4cef-9660-816123b5b144">
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:     <system>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:       <entry name="serial">9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590</entry>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:       <entry name="uuid">9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590</entry>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:     </system>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:   <os>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:   </os>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:   <features>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:   </features>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:   <devices>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590/disk.config"/>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:     </disk>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:       <alias name="ua-83485657-e133-49aa-baed-d67cb2fd1720"/>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-3"/>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:       <serial>83485657-e133-49aa-baed-d67cb2fd1720</serial>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:     </disk>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:15:41:54"/>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:       <target dev="tapb45721cf-79"/>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:     </interface>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590/console.log" append="off"/>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:     </serial>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:     <video>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:     </video>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:     </rng>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:   </devices>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]: </domain>
May 28 10:02:11.094723 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:02:11.097627 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T10:00:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1145093383',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serveractionsv293testjson-server-1963844026',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAMk9iSLwMbw4Ei6MHI0esC/55Rcy6sQ2tiWuKsyMq8m3KvVeicKJFpNeMJUkrZC2YauMY8UtCiYY/mGIoDtQfJzjOysD9ZOhrfUaZ1uCfXpLOQ02ek21gk2Qq+Gwmp7g==',key_name='tempest-keypair-1857006641',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:01:01Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2b4cc0430ca14757a829b60eb7e0081e',ramdisk_id='',reservation_id='r-i2a86n6f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3427ea11-12a6-4b25-8c73-769d29819fe0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1376389954',owner_user_name='tempest-ServerActionsV293TestJSON-1376389954-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:02:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='321e041ada2b405e821acd703457ddcb',uuid=9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b45721cf-794a-4cef-9660-816123b5b144", "address": "fa:16:3e:15:41:54", "network": {"id": "a546cd76-74b1-4628-b9bf-c80f6b8f1bec", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1194909584-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2b4cc0430ca14757a829b60eb7e0081e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45721cf-79", "ovs_interfaceid": "b45721cf-794a-4cef-9660-816123b5b144", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:02:11.099074 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Converting VIF {"id": "b45721cf-794a-4cef-9660-816123b5b144", "address": "fa:16:3e:15:41:54", "network": {"id": "a546cd76-74b1-4628-b9bf-c80f6b8f1bec", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1194909584-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2b4cc0430ca14757a829b60eb7e0081e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45721cf-79", "ovs_interfaceid": "b45721cf-794a-4cef-9660-816123b5b144", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:02:11.099074 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:41:54,bridge_name='br-int',has_traffic_filtering=True,id=b45721cf-794a-4cef-9660-816123b5b144,network=Network(a546cd76-74b1-4628-b9bf-c80f6b8f1bec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb45721cf-79') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:02:11.099074 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:41:54,bridge_name='br-int',has_traffic_filtering=True,id=b45721cf-794a-4cef-9660-816123b5b144,network=Network(a546cd76-74b1-4628-b9bf-c80f6b8f1bec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb45721cf-79') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:02:11.099416 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:11.099928 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:02:11.100702 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:02:11.102073 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:11.102554 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1995c9ab-9422-5186-818f-278b0725e488', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:02:11.106712 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:11.109223 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:02:11.114045 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:11.114286 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb45721cf-79, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:02:11.114877 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb45721cf-79, col_values=(('qos', UUID('1921c03a-6d0e-4a6d-90c7-dee148f73453')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:02:11.115219 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb45721cf-79, col_values=(('external_ids', {'iface-id': 'b45721cf-794a-4cef-9660-816123b5b144', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:41:54', 'vm-uuid': '9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:02:11.116463 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:11.119934 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:02:11.127086 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:11.129201 np0000001613 nova-compute[98321]: INFO os_vif [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:41:54,bridge_name='br-int',has_traffic_filtering=True,id=b45721cf-794a-4cef-9660-816123b5b144,network=Network(a546cd76-74b1-4628-b9bf-c80f6b8f1bec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb45721cf-79')
May 28 10:02:11.416774 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-a1f3e47b-86cc-487f-84ad-84fa2c94a9dd req-2448c758-aad5-4df3-81ce-01f244a6533f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:11.618856 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-a1f3e47b-86cc-487f-84ad-84fa2c94a9dd req-2448c758-aad5-4df3-81ce-01f244a6533f service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Updated VIF entry in instance network info cache for port 0e857900-174b-46cf-bfa1-ce7f2f8ffdb1. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:02:11.619245 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-a1f3e47b-86cc-487f-84ad-84fa2c94a9dd req-2448c758-aad5-4df3-81ce-01f244a6533f service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Updating instance_info_cache with network_info: [{"id": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "address": "fa:16:3e:e1:06:59", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e857900-17", "ovs_interfaceid": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:02:11.626918 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:02:11.637412 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:02:11.640091 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:02:11.640091 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:02:11.654895 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:02:11.654895 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:11.666632 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:11.672692 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:11.692446 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:11.692446 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:11.692446 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:11.692446 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:11.692446 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:11.692446 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:11.692446 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:11.692446 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:11.692446 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:11.692446 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:11.692446 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:11.692446 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:11.692446 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:02:11.693031 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:11.693031 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:11.693031 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:11.693031 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:11.693031 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:11.693031 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:11.693031 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:11.693031 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:11.693031 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:11.693031 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:11.693031 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:11.693031 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:11.693031 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:02:11.693514 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:11.693514 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:11.693514 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:11.693514 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:11.693514 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:11.693514 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:11.693514 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:11.693514 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:11.693514 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:11.693514 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:11.693514 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:11.693514 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:11.693514 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:02:11.693812 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:11.693812 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:11.693812 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:11.693812 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:11.693812 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:11.693812 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:11.693812 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:11.693812 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:11.693812 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:11.693812 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:11.693812 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:11.693812 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:11.693812 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:02:11.755411 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea, portal: 192.168.50.100,3260]
May 28 10:02:11.755411 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea, portal: 192.168.50.100,3260] successful.
May 28 10:02:11.755411 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:11.769915 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea, portal: 192.168.40.100,3260]
May 28 10:02:11.769915 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea, portal: 192.168.40.100,3260] successful.
May 28 10:02:11.769915 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:11.772358 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:11.788856 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:11.799835 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:11.799835 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:11.799835 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:11.799835 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:11.799835 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:11.799835 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:11.799835 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:11.799835 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:11.799835 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:11.799835 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:11.799835 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:11.799835 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:11.799835 np0000001613 nova-compute[98321]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:11.799835 np0000001613 nova-compute[98321]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:11.799835 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:02:11.800472 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:11.800472 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:11.800472 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:11.800472 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:11.800472 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:11.800472 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:11.800472 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:11.800472 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:11.800472 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:11.800472 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:11.800472 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:11.800472 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:11.800472 np0000001613 nova-compute[98321]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:11.800472 np0000001613 nova-compute[98321]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:11.800472 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:02:11.800472 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.203s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:02:11.800962 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:02:11.802850 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] HCTL ('19', '-', '-', 0) found on session 55 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:02:11.803023 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:02:11.812070 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:11.812070 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:11.812070 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:11.812070 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:11.812070 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:11.812070 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:11.812070 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:11.812070 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:11.812070 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:11.812070 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:11.812070 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:11.812070 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:11.812070 np0000001613 nova-compute[98321]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:11.812070 np0000001613 nova-compute[98321]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:11.812070 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:02:11.812070 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:11.812070 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:11.812070 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:11.812070 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:11.812070 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:11.812070 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:11.812070 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:11.812070 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:11.812070 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:11.812070 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:11.812070 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:11.812070 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:11.812070 np0000001613 nova-compute[98321]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:11.812070 np0000001613 nova-compute[98321]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:11.812070 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:02:11.812070 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.217s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:02:11.813261 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:02:11.814154 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] HCTL ('20', '-', '-', 0) found on session 56 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:02:11.814371 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:02:11.827514 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Searching for a device in session 55 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:02:11.827514 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '305d8623-c6f8-456c-83ed-46d06c6de0ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:02:11.833334 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Searching for a device in session 56 and hctl ['20', '*', '*', 0] yield: None {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:02:12.125457 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a1f3e47b-86cc-487f-84ad-84fa2c94a9dd req-2448c758-aad5-4df3-81ce-01f244a6533f service nova] Releasing lock "refresh_cache-36fde791-779f-42a8-9aef-87eafbbe0370" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:02:12.663334 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:02:12.663561 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:02:12.663718 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] No VIF found with MAC fa:16:3e:15:41:54, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:02:12.665997 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Using config drive
May 28 10:02:12.833365 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Searching for a device in session 56 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:02:12.833692 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '305d8623-c6f8-456c-83ed-46d06c6de0ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:02:12.902695 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0005709609999939858 future=<Future at 0x73c1fc16b650 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:02:12.903571 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] Emitting event <LifecycleEvent: 1779962517.9019856, b90b1ecd-e640-4f4e-bd02-fb74021db82b => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:02:12.903972 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:02:12.904253 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] VM Stopped (Lifecycle Event)
May 28 10:02:12.938111 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:02:12.938336 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:02:13.172357 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lazy-loading 'ec2_ids' on Instance uuid 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:13.408520 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:02:13.413312 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:02:13.441339 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:02:13.619727 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Found WWN 330000000352d9acf for multipath device dm-14 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:02:13.621403 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.043s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:02:13.621403 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] <== connect_volume: return (5814ms) {'type': 'block', 'scsi_wwn': '330000000352d9acf', 'path': '/dev/dm-14', 'multipath_id': '330000000352d9acf'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:02:13.621403 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000352d9acf', 'path': '/dev/dm-14', 'multipath_id': '330000000352d9acf'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:02:13.676718 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Object Instance<9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590> lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:02:13.677054 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lazy-loading 'keypairs' on Instance uuid 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:13.916418 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-075f07b4-dc5b-414c-bc1a-ff625f1224ca tempest-DeleteServersTestJSON-152188913 tempest-DeleteServersTestJSON-152188913-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 28 10:02:13.952630 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.015s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:13.953092 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:02:14.129708 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:00:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1921152164',display_name='tempest-ServerActionsTestOtherB-server-1921152164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001613',hostname='tempest-serveractionstestotherb-server-1921152164',id=22,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGxE2KIr85UjQ+BCoXx5lmchxbSom5hESV9GE6OjN6uhpkJJULrQoc25hFxuYqlX95IN2Z2yCPiXDLbNxuH0vzgNuyZ6PJzEAoF/ugoalqeMA/O7CY5J9Uu00S0irELsQ==',key_name='tempest-keypair-993221961',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:00:55Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001613',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='11e1727c7fbc44459c6972d182fc25b1',ramdisk_id='',reservation_id='r-v5rhfg8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-634969206',owner_user_name='tempest-ServerActionsTestOtherB-634969206-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:02:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11b9cab1ceef4e4b8cba521b61ad3f55',uuid=b90b1ecd-e640-4f4e-bd02-fb74021db82b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "address": "fa:16:3e:b1:88:d2", "network": {"id": "9d46c174-21e3-464e-83c9-e8db18f486a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-151012625-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.13", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-151012625-network", "vif_mac": "fa:16:3e:b1:88:d2"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e1727c7fbc44459c6972d182fc25b1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a01cd4-8a", "ovs_interfaceid": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:02:14.130712 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Converting VIF {"id": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "address": "fa:16:3e:b1:88:d2", "network": {"id": "9d46c174-21e3-464e-83c9-e8db18f486a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-151012625-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.13", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-151012625-network", "vif_mac": "fa:16:3e:b1:88:d2"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e1727c7fbc44459c6972d182fc25b1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a01cd4-8a", "ovs_interfaceid": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:02:14.131545 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:88:d2,bridge_name='br-int',has_traffic_filtering=True,id=11a01cd4-8a62-4e25-b303-ac907a1aa4c3,network=Network(9d46c174-21e3-464e-83c9-e8db18f486a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a01cd4-8a') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:02:14.133568 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] End _get_guest_xml xml=<domain type="qemu">
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:   <uuid>b90b1ecd-e640-4f4e-bd02-fb74021db82b</uuid>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:   <name>instance-00000016</name>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:   <memory>262144</memory>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:       <nova:name>tempest-ServerActionsTestOtherB-server-1921152164</nova:name>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:02:07</nova:creationTime>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.micro" id="84">
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:         <nova:memory>256</nova:memory>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:         <nova:user uuid="11b9cab1ceef4e4b8cba521b61ad3f55">tempest-ServerActionsTestOtherB-634969206-project-member</nova:user>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:         <nova:project uuid="11e1727c7fbc44459c6972d182fc25b1">tempest-ServerActionsTestOtherB-634969206</nova:project>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:         <nova:port uuid="11a01cd4-8a62-4e25-b303-ac907a1aa4c3">
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:     <system>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:       <entry name="serial">b90b1ecd-e640-4f4e-bd02-fb74021db82b</entry>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:       <entry name="uuid">b90b1ecd-e640-4f4e-bd02-fb74021db82b</entry>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:     </system>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:   <os>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:   </os>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:   <features>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:   </features>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:   <devices>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk"/>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:     </disk>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk.config"/>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:     </disk>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:       <alias name="ua-305d8623-c6f8-456c-83ed-46d06c6de0ea"/>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-14"/>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:       <target dev="vdb" bus="virtio"/>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:       <serial>305d8623-c6f8-456c-83ed-46d06c6de0ea</serial>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:     </disk>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:b1:88:d2"/>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:       <target dev="tap11a01cd4-8a"/>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:     </interface>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/console.log" append="off"/>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:     </serial>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:     <video>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:     </video>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:     </rng>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:   </devices>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]: </domain>
May 28 10:02:14.133568 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:02:14.140056 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:00:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1921152164',display_name='tempest-ServerActionsTestOtherB-server-1921152164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001613',hostname='tempest-serveractionstestotherb-server-1921152164',id=22,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGxE2KIr85UjQ+BCoXx5lmchxbSom5hESV9GE6OjN6uhpkJJULrQoc25hFxuYqlX95IN2Z2yCPiXDLbNxuH0vzgNuyZ6PJzEAoF/ugoalqeMA/O7CY5J9Uu00S0irELsQ==',key_name='tempest-keypair-993221961',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:00:55Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001613',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='11e1727c7fbc44459c6972d182fc25b1',ramdisk_id='',reservation_id='r-v5rhfg8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-634969206',owner_user_name='tempest-ServerActionsTestOtherB-634969206-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:02:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11b9cab1ceef4e4b8cba521b61ad3f55',uuid=b90b1ecd-e640-4f4e-bd02-fb74021db82b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "address": "fa:16:3e:b1:88:d2", "network": {"id": "9d46c174-21e3-464e-83c9-e8db18f486a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-151012625-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.13", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-151012625-network", "vif_mac": "fa:16:3e:b1:88:d2"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e1727c7fbc44459c6972d182fc25b1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a01cd4-8a", "ovs_interfaceid": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:02:14.140056 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Converting VIF {"id": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "address": "fa:16:3e:b1:88:d2", "network": {"id": "9d46c174-21e3-464e-83c9-e8db18f486a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-151012625-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.13", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-151012625-network", "vif_mac": "fa:16:3e:b1:88:d2"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e1727c7fbc44459c6972d182fc25b1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a01cd4-8a", "ovs_interfaceid": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:02:14.140056 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:88:d2,bridge_name='br-int',has_traffic_filtering=True,id=11a01cd4-8a62-4e25-b303-ac907a1aa4c3,network=Network(9d46c174-21e3-464e-83c9-e8db18f486a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a01cd4-8a') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:02:14.140056 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:88:d2,bridge_name='br-int',has_traffic_filtering=True,id=11a01cd4-8a62-4e25-b303-ac907a1aa4c3,network=Network(9d46c174-21e3-464e-83c9-e8db18f486a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a01cd4-8a') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:02:14.140056 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:14.140056 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:02:14.140056 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:02:14.142611 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:14.142611 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e920fbcb-3653-5b58-894a-5da8e2591c0d', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:02:14.152078 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:14.152078 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:02:14.161658 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:14.164012 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:14.165594 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11a01cd4-8a, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:02:14.165594 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap11a01cd4-8a, col_values=(('qos', UUID('369e9f3f-b696-4280-8be0-323f6f5114fb')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:02:14.165594 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap11a01cd4-8a, col_values=(('external_ids', {'iface-id': '11a01cd4-8a62-4e25-b303-ac907a1aa4c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:88:d2', 'vm-uuid': 'b90b1ecd-e640-4f4e-bd02-fb74021db82b'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:02:14.166530 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:14.168331 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:02:14.180371 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Object Instance<9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590> lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:02:14.183063 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError
May 28 10:02:14.184582 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:14.185960 np0000001613 nova-compute[98321]: INFO os_vif [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:88:d2,bridge_name='br-int',has_traffic_filtering=True,id=11a01cd4-8a62-4e25-b303-ac907a1aa4c3,network=Network(9d46c174-21e3-464e-83c9-e8db18f486a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a01cd4-8a')
May 28 10:02:14.304700 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Creating config drive at /opt/stack/data/nova/instances/9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590/disk.config
May 28 10:02:14.308971 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_n85s8w7 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:14.356872 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:14.367644 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_n85s8w7" returned: 0 in 0.058s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:14.461146 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:02:14.461437 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:02:14.462052 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:14.463429 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:14.580883 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13481913e22d4bf1a94e1a9a270f5494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3403b533910644d2b254922fb84b1ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:02:14.952355 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:14.968010 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:02:14.998078 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:15.136027 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:15.228617 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:15.395204 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c2d6a5ac-89b7-42e7-913e-7fefc6f0a05f req-f46785fb-13b8-44cb-9150-ff6450e23d71 service nova] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Received event network-vif-plugged-b45721cf-794a-4cef-9660-816123b5b144 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:15.396062 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c2d6a5ac-89b7-42e7-913e-7fefc6f0a05f req-f46785fb-13b8-44cb-9150-ff6450e23d71 service nova] Acquiring lock "9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:15.396366 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c2d6a5ac-89b7-42e7-913e-7fefc6f0a05f req-f46785fb-13b8-44cb-9150-ff6450e23d71 service nova] Lock "9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:15.396598 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c2d6a5ac-89b7-42e7-913e-7fefc6f0a05f req-f46785fb-13b8-44cb-9150-ff6450e23d71 service nova] Lock "9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:15.397367 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c2d6a5ac-89b7-42e7-913e-7fefc6f0a05f req-f46785fb-13b8-44cb-9150-ff6450e23d71 service nova] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] No waiting events found dispatching network-vif-plugged-b45721cf-794a-4cef-9660-816123b5b144 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:02:15.397367 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-c2d6a5ac-89b7-42e7-913e-7fefc6f0a05f req-f46785fb-13b8-44cb-9150-ff6450e23d71 service nova] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Received unexpected event network-vif-plugged-b45721cf-794a-4cef-9660-816123b5b144 for instance with vm_state active and task_state rebuild_spawning.
May 28 10:02:15.455789 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:15.466967 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:15.469537 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:15.474097 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:02:15.511317 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:15.513189 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:15.640396 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Successfully created port: 9df7e969-a155-41f1-9e30-c42f172029e4 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:02:15.719355 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:02:15.719648 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:02:15.719868 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:02:15.719958 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] No VIF found with MAC fa:16:3e:b1:88:d2, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:02:15.720618 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Using config drive
May 28 10:02:16.279296 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962536.2787867, 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:02:16.279842 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] VM Resumed (Lifecycle Event)
May 28 10:02:16.281966 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Instance event wait completed in 0 seconds for  {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:02:16.283864 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:02:16.295338 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Instance spawned successfully.
May 28 10:02:16.296036 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:02:16.327500 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:16.365651 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:16.373039 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:16.466038 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Successfully updated port: 9df7e969-a155-41f1-9e30-c42f172029e4 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:02:16.483525 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:16.497129 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:02:16.498584 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:02:16.498680 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Creating image(s)
May 28 10:02:16.502199 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "/opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:16.503295 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "/opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.004s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:16.503929 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "/opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:16.504690 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:02:16.514408 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:02:16.520400 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:16.619390 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d5d55c05-d2a2-4cd8-8576-31dc51963049 req-751f7c3f-22ea-4913-9bfe-9de3e9af15eb service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Received event network-changed-9df7e969-a155-41f1-9e30-c42f172029e4 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:16.619603 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d5d55c05-d2a2-4cd8-8576-31dc51963049 req-751f7c3f-22ea-4913-9bfe-9de3e9af15eb service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Refreshing instance network info cache due to event network-changed-9df7e969-a155-41f1-9e30-c42f172029e4. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:02:16.620271 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d5d55c05-d2a2-4cd8-8576-31dc51963049 req-751f7c3f-22ea-4913-9bfe-9de3e9af15eb service nova] Acquiring lock "refresh_cache-de9742b9-43db-40a6-b635-81d9244fd5e0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:02:16.620271 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d5d55c05-d2a2-4cd8-8576-31dc51963049 req-751f7c3f-22ea-4913-9bfe-9de3e9af15eb service nova] Acquired lock "refresh_cache-de9742b9-43db-40a6-b635-81d9244fd5e0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:02:16.620271 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-d5d55c05-d2a2-4cd8-8576-31dc51963049 req-751f7c3f-22ea-4913-9bfe-9de3e9af15eb service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Refreshing network info cache for port 9df7e969-a155-41f1-9e30-c42f172029e4 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:02:16.691290 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.172s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:16.691290 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:16.694962 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:16.696528 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:02:16.701954 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:02:16.702767 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:16.786412 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:02:16.796862 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:02:16.808697 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.106s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:16.809515 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:16.843973 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:02:16.845406 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:02:16.845595 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:02:16.845981 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:02:16.846540 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:02:16.846970 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:02:16.878370 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk 1073741824" returned: 0 in 0.069s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:16.880130 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:16.880690 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:16.905497 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:16.916295 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:16.953783 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:16.974232 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "refresh_cache-de9742b9-43db-40a6-b635-81d9244fd5e0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:02:17.018153 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.137s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:17.018153 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:02:17.018153 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:17.127419 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-d5d55c05-d2a2-4cd8-8576-31dc51963049 req-751f7c3f-22ea-4913-9bfe-9de3e9af15eb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:17.134564 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:17.135236 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Cannot resize image /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:02:17.135981 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:02:17.136230 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Ensure instance console log exists: /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:02:17.136824 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:17.137071 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:17.137414 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:17.227598 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-d5d55c05-d2a2-4cd8-8576-31dc51963049 req-751f7c3f-22ea-4913-9bfe-9de3e9af15eb service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:02:17.311459 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
May 28 10:02:17.312414 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962537.311654, 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:02:17.312414 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] VM Started (Lifecycle Event)
May 28 10:02:17.366910 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:02:17.450906 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-d5d55c05-d2a2-4cd8-8576-31dc51963049 req-751f7c3f-22ea-4913-9bfe-9de3e9af15eb service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:02:17.502896 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-98097dcb-3569-4ba5-84cb-98c28c33b8c8 req-c83f081e-8f46-4a16-b8e7-2ec9aaf6db39 service nova] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Received event network-vif-plugged-b45721cf-794a-4cef-9660-816123b5b144 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:17.503031 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-98097dcb-3569-4ba5-84cb-98c28c33b8c8 req-c83f081e-8f46-4a16-b8e7-2ec9aaf6db39 service nova] Acquiring lock "9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:17.503321 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-98097dcb-3569-4ba5-84cb-98c28c33b8c8 req-c83f081e-8f46-4a16-b8e7-2ec9aaf6db39 service nova] Lock "9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:17.503485 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-98097dcb-3569-4ba5-84cb-98c28c33b8c8 req-c83f081e-8f46-4a16-b8e7-2ec9aaf6db39 service nova] Lock "9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:17.505271 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-98097dcb-3569-4ba5-84cb-98c28c33b8c8 req-c83f081e-8f46-4a16-b8e7-2ec9aaf6db39 service nova] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] No waiting events found dispatching network-vif-plugged-b45721cf-794a-4cef-9660-816123b5b144 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:02:17.506729 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-98097dcb-3569-4ba5-84cb-98c28c33b8c8 req-c83f081e-8f46-4a16-b8e7-2ec9aaf6db39 service nova] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Received unexpected event network-vif-plugged-b45721cf-794a-4cef-9660-816123b5b144 for instance with vm_state active and task_state None.
May 28 10:02:17.651801 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Instance event wait completed in 0 seconds for  {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:02:17.658068 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Instance running successfully.
May 28 10:02:17.660992 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Failed to set time: agent not configured {{(pid=98321) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 28 10:02:17.661153 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ec4aa90c-3ced-4ead-9052-939a51703d80 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] finish_migration finished successfully. {{(pid=98321) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 28 10:02:17.816050 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:02:17.817922 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:02:17.888637 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:17.888956 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:17.891184 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Trying to apply a migration context that does not seem to be set for this instance {{(pid=98321) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}}
May 28 10:02:17.955735 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d5d55c05-d2a2-4cd8-8576-31dc51963049 req-751f7c3f-22ea-4913-9bfe-9de3e9af15eb service nova] Releasing lock "refresh_cache-de9742b9-43db-40a6-b635-81d9244fd5e0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:02:17.956648 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquired lock "refresh_cache-de9742b9-43db-40a6-b635-81d9244fd5e0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:02:17.956892 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:02:18.321209 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962538.3208232, b90b1ecd-e640-4f4e-bd02-fb74021db82b => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:02:18.321751 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] VM Resumed (Lifecycle Event)
May 28 10:02:18.565508 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:02:18.731271 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8b8bec7c-6c85-4edc-b004-08f99d642fcb req-3bf1cfd9-0fc3-4e71-91c7-d4afe723dbdc service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Received event network-vif-plugged-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:18.731392 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8b8bec7c-6c85-4edc-b004-08f99d642fcb req-3bf1cfd9-0fc3-4e71-91c7-d4afe723dbdc service nova] Acquiring lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:18.731677 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8b8bec7c-6c85-4edc-b004-08f99d642fcb req-3bf1cfd9-0fc3-4e71-91c7-d4afe723dbdc service nova] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:18.731790 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8b8bec7c-6c85-4edc-b004-08f99d642fcb req-3bf1cfd9-0fc3-4e71-91c7-d4afe723dbdc service nova] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:18.732126 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8b8bec7c-6c85-4edc-b004-08f99d642fcb req-3bf1cfd9-0fc3-4e71-91c7-d4afe723dbdc service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] No waiting events found dispatching network-vif-plugged-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:02:18.732126 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-8b8bec7c-6c85-4edc-b004-08f99d642fcb req-3bf1cfd9-0fc3-4e71-91c7-d4afe723dbdc service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Received unexpected event network-vif-plugged-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 for instance with vm_state resized and task_state None.
May 28 10:02:18.734416 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8b8bec7c-6c85-4edc-b004-08f99d642fcb req-3bf1cfd9-0fc3-4e71-91c7-d4afe723dbdc service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Received event network-vif-plugged-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:18.734666 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8b8bec7c-6c85-4edc-b004-08f99d642fcb req-3bf1cfd9-0fc3-4e71-91c7-d4afe723dbdc service nova] Acquiring lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:18.735181 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8b8bec7c-6c85-4edc-b004-08f99d642fcb req-3bf1cfd9-0fc3-4e71-91c7-d4afe723dbdc service nova] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:18.735329 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8b8bec7c-6c85-4edc-b004-08f99d642fcb req-3bf1cfd9-0fc3-4e71-91c7-d4afe723dbdc service nova] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:18.735542 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8b8bec7c-6c85-4edc-b004-08f99d642fcb req-3bf1cfd9-0fc3-4e71-91c7-d4afe723dbdc service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] No waiting events found dispatching network-vif-plugged-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:02:18.735660 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-8b8bec7c-6c85-4edc-b004-08f99d642fcb req-3bf1cfd9-0fc3-4e71-91c7-d4afe723dbdc service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Received unexpected event network-vif-plugged-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 for instance with vm_state resized and task_state None.
May 28 10:02:18.806213 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:18.824854 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:02:18.827217 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:02:18.902115 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-65288f3e-72c0-457f-955e-51fae0dabd28 tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.011s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:19.075639 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Updating instance_info_cache with network_info: [{"id": "9df7e969-a155-41f1-9e30-c42f172029e4", "address": "fa:16:3e:9e:26:24", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df7e969-a1", "ovs_interfaceid": "9df7e969-a155-41f1-9e30-c42f172029e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:02:19.176063 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:19.331472 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962539.3311403, b90b1ecd-e640-4f4e-bd02-fb74021db82b => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:02:19.331966 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] VM Started (Lifecycle Event)
May 28 10:02:19.361312 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:19.581147 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:19.583121 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Releasing lock "refresh_cache-de9742b9-43db-40a6-b635-81d9244fd5e0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:02:19.584073 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Instance network_info: |[{"id": "9df7e969-a155-41f1-9e30-c42f172029e4", "address": "fa:16:3e:9e:26:24", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df7e969-a1", "ovs_interfaceid": "9df7e969-a155-41f1-9e30-c42f172029e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:02:19.586406 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Start _get_guest_xml network_info=[{"id": "9df7e969-a155-41f1-9e30-c42f172029e4", "address": "fa:16:3e:9e:26:24", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df7e969-a1", "ovs_interfaceid": "9df7e969-a155-41f1-9e30-c42f172029e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:02:19.590567 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:02:19.591429 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='de9742b9-43db-40a6-b635-81d9244fd5e0'), owner=OwnerMeta(userid='13481913e22d4bf1a94e1a9a270f5494', username='tempest-AttachVolumeMultiAttachTest-1052626787-project-member', projectid='3403b533910644d2b254922fb84b1ac0', projectname='tempest-AttachVolumeMultiAttachTest-1052626787'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9df7e969-a155-41f1-9e30-c42f172029e4", "address": "fa:16:3e:9e:26:24", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df7e969-a1", "ovs_interfaceid": "9df7e969-a155-41f1-9e30-c42f172029e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962539.5908294) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:02:19.592512 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:02:19.593869 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:02:19.593869 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:02:19.594094 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:02:19.594979 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:02:19.595325 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:02:19.595432 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:02:19.595687 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:02:19.595687 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:02:19.595804 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:02:19.595840 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:02:19.595985 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:02:19.596086 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:02:19.596260 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:02:19.597296 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:02:19.597296 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:02:19.609509 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:02:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='multiattach-server-1',id=31,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrmebBJn1C7uIkB9JjrF4yuEuto77kf4SaBedfdmOdQwZzJyqrVQd0Wq/SA1eDV6FpWwBB4BKjLBcFgkvBrXSx4LeKHMUic/tPGA5px/F625klLXypbV+9p49FvQ4XImQ==',key_name='tempest-keypair-2082049331',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3403b533910644d2b254922fb84b1ac0',ramdisk_id='',reservation_id='r-d0jzlqs3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1052626787',owner_user_name='tempest-AttachVolumeMultiAttachTest-1052626787-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:02:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13481913e22d4bf1a94e1a9a270f5494',uuid=de9742b9-43db-40a6-b635-81d9244fd5e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9df7e969-a155-41f1-9e30-c42f172029e4", "address": "fa:16:3e:9e:26:24", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df7e969-a1", "ovs_interfaceid": "9df7e969-a155-41f1-9e30-c42f172029e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:02:19.609785 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converting VIF {"id": "9df7e969-a155-41f1-9e30-c42f172029e4", "address": "fa:16:3e:9e:26:24", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df7e969-a1", "ovs_interfaceid": "9df7e969-a155-41f1-9e30-c42f172029e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:02:19.610255 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:26:24,bridge_name='br-int',has_traffic_filtering=True,id=9df7e969-a155-41f1-9e30-c42f172029e4,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df7e969-a1') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:02:19.610796 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lazy-loading 'pci_devices' on Instance uuid de9742b9-43db-40a6-b635-81d9244fd5e0 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:19.722381 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:19.724376 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:19.724376 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:19.833798 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Port 11a01cd4-8a62-4e25-b303-ac907a1aa4c3 binding to destination host np0000001613 is already ACTIVE {{(pid=98321) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 28 10:02:19.834055 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Acquiring lock "refresh_cache-b90b1ecd-e640-4f4e-bd02-fb74021db82b" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:02:19.835512 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Acquired lock "refresh_cache-b90b1ecd-e640-4f4e-bd02-fb74021db82b" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:02:19.835512 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:02:19.837786 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:02:19.844962 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:02:19.908074 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:19.908074 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:20.113831 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] End _get_guest_xml xml=<domain type="qemu">
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:   <uuid>de9742b9-43db-40a6-b635-81d9244fd5e0</uuid>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:   <name>instance-0000001f</name>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:       <nova:name>multiattach-server-1</nova:name>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:02:19</nova:creationTime>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:         <nova:user uuid="13481913e22d4bf1a94e1a9a270f5494">tempest-AttachVolumeMultiAttachTest-1052626787-project-member</nova:user>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:         <nova:project uuid="3403b533910644d2b254922fb84b1ac0">tempest-AttachVolumeMultiAttachTest-1052626787</nova:project>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:         <nova:port uuid="9df7e969-a155-41f1-9e30-c42f172029e4">
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:     <system>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:       <entry name="serial">de9742b9-43db-40a6-b635-81d9244fd5e0</entry>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:       <entry name="uuid">de9742b9-43db-40a6-b635-81d9244fd5e0</entry>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:     </system>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:   <os>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:   </os>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:   <features>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:   </features>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:   <devices>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk"/>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:     </disk>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk.config"/>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:     </disk>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:9e:26:24"/>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:       <target dev="tap9df7e969-a1"/>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:     </interface>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/console.log" append="off"/>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:     </serial>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:     <video>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:     </video>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:     </rng>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:   </devices>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]: </domain>
May 28 10:02:20.113831 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:02:20.117300 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Preparing to wait for external event network-vif-plugged-9df7e969-a155-41f1-9e30-c42f172029e4 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:02:20.117300 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "de9742b9-43db-40a6-b635-81d9244fd5e0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:20.117300 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "de9742b9-43db-40a6-b635-81d9244fd5e0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:20.117300 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "de9742b9-43db-40a6-b635-81d9244fd5e0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:20.117300 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:02:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='multiattach-server-1',id=31,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrmebBJn1C7uIkB9JjrF4yuEuto77kf4SaBedfdmOdQwZzJyqrVQd0Wq/SA1eDV6FpWwBB4BKjLBcFgkvBrXSx4LeKHMUic/tPGA5px/F625klLXypbV+9p49FvQ4XImQ==',key_name='tempest-keypair-2082049331',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3403b533910644d2b254922fb84b1ac0',ramdisk_id='',reservation_id='r-d0jzlqs3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1052626787',owner_user_name='tempest-AttachVolumeMultiAttachTest-1052626787-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:02:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13481913e22d4bf1a94e1a9a270f5494',uuid=de9742b9-43db-40a6-b635-81d9244fd5e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9df7e969-a155-41f1-9e30-c42f172029e4", "address": "fa:16:3e:9e:26:24", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df7e969-a1", "ovs_interfaceid": "9df7e969-a155-41f1-9e30-c42f172029e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:02:20.117300 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converting VIF {"id": "9df7e969-a155-41f1-9e30-c42f172029e4", "address": "fa:16:3e:9e:26:24", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df7e969-a1", "ovs_interfaceid": "9df7e969-a155-41f1-9e30-c42f172029e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:02:20.117300 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:26:24,bridge_name='br-int',has_traffic_filtering=True,id=9df7e969-a155-41f1-9e30-c42f172029e4,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df7e969-a1') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:02:20.117300 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:26:24,bridge_name='br-int',has_traffic_filtering=True,id=9df7e969-a155-41f1-9e30-c42f172029e4,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df7e969-a1') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:02:20.117300 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:20.117851 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:02:20.117851 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:02:20.119320 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:20.119595 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a5953926-2dba-5bea-94ee-1b207200f9c5', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:02:20.120620 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:20.121840 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:02:20.122338 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:20.127347 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:20.127715 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9df7e969-a1, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:02:20.128185 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9df7e969-a1, col_values=(('qos', UUID('5d78d97e-4ce5-4fee-833b-5a737d02fa0a')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:02:20.128875 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9df7e969-a1, col_values=(('external_ids', {'iface-id': '9df7e969-a155-41f1-9e30-c42f172029e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:26:24', 'vm-uuid': 'de9742b9-43db-40a6-b635-81d9244fd5e0'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:02:20.130104 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:20.132721 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:02:20.138499 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:20.140098 np0000001613 nova-compute[98321]: INFO os_vif [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:26:24,bridge_name='br-int',has_traffic_filtering=True,id=9df7e969-a155-41f1-9e30-c42f172029e4,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df7e969-a1')
May 28 10:02:20.339172 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:20.353190 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] During sync_power_state the instance has a pending task (resize_reverting). Skip.
May 28 10:02:20.422782 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lazy-loading 'flavor' on Instance uuid 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:20.776853 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:20.969495 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Updating instance_info_cache with network_info: [{"id": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "address": "fa:16:3e:b1:88:d2", "network": {"id": "9d46c174-21e3-464e-83c9-e8db18f486a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-151012625-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e1727c7fbc44459c6972d182fc25b1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a01cd4-8a", "ovs_interfaceid": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:02:21.431811 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.524s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:21.473950 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Releasing lock "refresh_cache-b90b1ecd-e640-4f4e-bd02-fb74021db82b" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:02:21.661830 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:02:21.662041 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:02:21.662312 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No VIF found with MAC fa:16:3e:9e:26:24, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:02:21.662732 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Using config drive
May 28 10:02:21.978404 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Creating tmpfile /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/tmpzr331u_n to verify with other compute node that the instance is on the same shared storage. {{(pid=98321) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:10552}}
May 28 10:02:21.978707 np0000001613 nova-compute[98321]: DEBUG nova.compute.rpcapi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98321) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 10:02:22.169334 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:22.289273 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-408d6f53-3683-4e49-bebe-95d081e45a36 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:02:22.333354 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Creating config drive at /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk.config
May 28 10:02:22.340550 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptez07lk3 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:22.390606 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptez07lk3" returned: 0 in 0.051s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:22.520306 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:22.525366 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:22.533569 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:22.533569 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:22.533569 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Attaching volume 0535b5b5-fe9b-46f2-b850-07e27f9b75ec to /dev/vdb
May 28 10:02:22.542836 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:22.555810 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:22.591396 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:22.613492 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:02:22.634738 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:02:22.660041 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:22.702109 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:02:22.702454 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:02:22.719299 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:02:22.721309 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe2d:94a4', 'fe80::2844:59ff:feec:5d21', 'fe80::fc16:3eff:fefd:30e7', 'fe80::e4df:c0ff:fe86:6341', 'fe80::ce2:7bff:fe0e:d096', 'fe80::fc16:3eff:fedb:1077', 'fe80::fc16:3eff:fee0:9ccd', 'fe80::fc16:3eff:fe3c:b7e1', 'fe80::fc16:3eff:fe86:604b', 'fe80::fc16:3eff:fe44:a72', 'fe80::fc16:3eff:fe05:9ea2', 'fe80::3037:7fff:fec8:89ce', 'fe80::fc16:3eff:fea8:9a37', 'fe80::44e2:31ff:fe81:8771', 'fe80::fc16:3eff:fed2:27b6', 'fe80::fc16:3eff:feaf:c736', 'fe80::24a6:e6ff:febf:f93c', 'fe80::fc16:3eff:fe24:b36a', 'fe80::fc16:3eff:fe5d:f989', 'fe80::fc16:3eff:fea3:f365', 'fe80::fc16:3eff:fee5:b9aa', 'fe80::fc16:3eff:feeb:2b41', 'fe80::8038:a7ff:fe21:5b5c', 'fe80::fc16:3eff:fed0:5ae8', 'fe80::7c9a:d6ff:fe01:2456', 'fe80::fc16:3eff:fee1:659', 'fe80::fc16:3eff:fe15:4154', 'fe80::605f:aaff:fe8d:fcdd'] 
May 28 10:02:22.721458 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:02:22.721563 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:02:22.721780 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:02:22.722008 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Updating existing volume attachment record: 144de57a-0d80-4d2d-a5ae-2568012fbf1b {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:02:22.725723 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-52313fc8-0a68-4062-9bdf-4539bdc07d01 req-025e1b78-ec00-4b6f-b1bd-37ccc0264a2b service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Received event network-vif-unplugged-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:22.727230 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-52313fc8-0a68-4062-9bdf-4539bdc07d01 req-025e1b78-ec00-4b6f-b1bd-37ccc0264a2b service nova] Acquiring lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:22.728606 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-52313fc8-0a68-4062-9bdf-4539bdc07d01 req-025e1b78-ec00-4b6f-b1bd-37ccc0264a2b service nova] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:22.728606 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-52313fc8-0a68-4062-9bdf-4539bdc07d01 req-025e1b78-ec00-4b6f-b1bd-37ccc0264a2b service nova] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:22.728606 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-52313fc8-0a68-4062-9bdf-4539bdc07d01 req-025e1b78-ec00-4b6f-b1bd-37ccc0264a2b service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] No waiting events found dispatching network-vif-unplugged-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:02:22.728606 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-52313fc8-0a68-4062-9bdf-4539bdc07d01 req-025e1b78-ec00-4b6f-b1bd-37ccc0264a2b service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Received unexpected event network-vif-unplugged-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 for instance with vm_state resized and task_state resize_reverting.
May 28 10:02:22.799220 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-408d6f53-3683-4e49-bebe-95d081e45a36 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] instance snapshotting
May 28 10:02:22.844755 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:22.865067 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:22.927836 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-408d6f53-3683-4e49-bebe-95d081e45a36 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Beginning live snapshot process
May 28 10:02:22.992487 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:23.002570 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999483941000108 future=<Future at 0x73c1f43e23f0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:02:23.002949 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999072165000143 future=<Future at 0x73c1f43e23f0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:02:23.003189 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.998890997999752 future=<Future at 0x73c1f43e23f0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:02:23.011614 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Instance destroyed successfully.
May 28 10:02:23.012240 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lazy-loading 'resources' on Instance uuid b90b1ecd-e640-4f4e-bd02-fb74021db82b {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:23.026925 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:23.030823 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:23.130124 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:23.183858 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:23.190579 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:23.255557 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5c96ef3a-e465-4ccb-a7c1-a1989f3286d6 req-a1d90de4-9bc2-4724-83ea-a83f4c40a97f service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Received event network-vif-plugged-9df7e969-a155-41f1-9e30-c42f172029e4 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:23.255638 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5c96ef3a-e465-4ccb-a7c1-a1989f3286d6 req-a1d90de4-9bc2-4724-83ea-a83f4c40a97f service nova] Acquiring lock "de9742b9-43db-40a6-b635-81d9244fd5e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:23.255849 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5c96ef3a-e465-4ccb-a7c1-a1989f3286d6 req-a1d90de4-9bc2-4724-83ea-a83f4c40a97f service nova] Lock "de9742b9-43db-40a6-b635-81d9244fd5e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:23.256279 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5c96ef3a-e465-4ccb-a7c1-a1989f3286d6 req-a1d90de4-9bc2-4724-83ea-a83f4c40a97f service nova] Lock "de9742b9-43db-40a6-b635-81d9244fd5e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:23.256279 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5c96ef3a-e465-4ccb-a7c1-a1989f3286d6 req-a1d90de4-9bc2-4724-83ea-a83f4c40a97f service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Processing event network-vif-plugged-9df7e969-a155-41f1-9e30-c42f172029e4 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:02:23.298039 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:02:23.298495 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec', 'iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0535b5b5-fe9b-46f2-b850-07e27f9b75ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:02:23.298657 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:02:23.299009 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:02:23.299236 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec', 'iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0535b5b5-fe9b-46f2-b850-07e27f9b75ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:02:23.314429 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:02:23.315813 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:02:23.316375 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:02:23.316653 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:02:23.317260 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:02:23.317863 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:02:23.332027 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:02:23.332027 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:23.338761 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:02:23.338761 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:23.349650 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec] added
May 28 10:02:23.349650 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:02:23.349650 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:02:23.349650 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:02:23.349650 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:02:23.349650 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:02:23.349650 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:23.349996 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:02:23.350045 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0334(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:02:23.350223 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:02:23.353592 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec] added
May 28 10:02:23.353592 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:02:23.353592 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:02:23.353592 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:02:23.353592 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:02:23.353592 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:02:23.353592 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:23.353592 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:02:23.353592 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0358(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:02:23.353592 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:02:23.517852 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:00:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1921152164',display_name='tempest-ServerActionsTestOtherB-server-1921152164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001613',hostname='tempest-serveractionstestotherb-server-1921152164',id=22,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGxE2KIr85UjQ+BCoXx5lmchxbSom5hESV9GE6OjN6uhpkJJULrQoc25hFxuYqlX95IN2Z2yCPiXDLbNxuH0vzgNuyZ6PJzEAoF/ugoalqeMA/O7CY5J9Uu00S0irELsQ==',key_name='tempest-keypair-993221961',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:02:18Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=Flavor(12),node='np0000001613',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11e1727c7fbc44459c6972d182fc25b1',ramdisk_id='',reservation_id='r-v5rhfg8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-634969206',owner_user_name='tempest-ServerActionsTestOtherB-634969206-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:02:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11b9cab1ceef4e4b8cba521b61ad3f55',uuid=b90b1ecd-e640-4f4e-bd02-fb74021db82b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "address": "fa:16:3e:b1:88:d2", "network": {"id": "9d46c174-21e3-464e-83c9-e8db18f486a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-151012625-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e1727c7fbc44459c6972d182fc25b1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a01cd4-8a", "ovs_interfaceid": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:02:23.518089 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Converting VIF {"id": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "address": "fa:16:3e:b1:88:d2", "network": {"id": "9d46c174-21e3-464e-83c9-e8db18f486a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-151012625-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e1727c7fbc44459c6972d182fc25b1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a01cd4-8a", "ovs_interfaceid": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:02:23.519048 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:88:d2,bridge_name='br-int',has_traffic_filtering=True,id=11a01cd4-8a62-4e25-b303-ac907a1aa4c3,network=Network(9d46c174-21e3-464e-83c9-e8db18f486a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a01cd4-8a') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:02:23.519246 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:88:d2,bridge_name='br-int',has_traffic_filtering=True,id=11a01cd4-8a62-4e25-b303-ac907a1aa4c3,network=Network(9d46c174-21e3-464e-83c9-e8db18f486a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a01cd4-8a') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:02:23.520856 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:23.521288 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11a01cd4-8a, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:02:23.523052 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:23.524066 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:02:23.526366 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:23.527858 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:23.527967 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=369e9f3f-b696-4280-8be0-323f6f5114fb) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:02:23.528648 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:23.529536 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:02:23.531794 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:23.533656 np0000001613 nova-compute[98321]: INFO os_vif [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:88:d2,bridge_name='br-int',has_traffic_filtering=True,id=11a01cd4-8a62-4e25-b303-ac907a1aa4c3,network=Network(9d46c174-21e3-464e-83c9-e8db18f486a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a01cd4-8a')
May 28 10:02:23.538326 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:02:23.538648 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '305d8623-c6f8-456c-83ed-46d06c6de0ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:02:23.538772 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:02:23.866139 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962543.8655365, de9742b9-43db-40a6-b635-81d9244fd5e0 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:02:23.866707 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:02:23.868344 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] VM Started (Lifecycle Event)
May 28 10:02:23.873452 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:02:23.876268 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Instance spawned successfully.
May 28 10:02:23.876651 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:02:24.350719 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:02:24.354455 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:02:24.364345 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:02:24.364345 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:24.366966 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:24.370145 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:02:24.371646 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:02:24.374288 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:02:24.374288 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:24.387998 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:24.388214 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:02:24.388551 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:02:24.389037 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:02:24.389348 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:02:24.390462 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:02:24.390462 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:02:24.395019 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:24.410819 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:24.410819 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:24.410819 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:24.410819 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:24.410819 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:24.410819 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:24.410819 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:24.410819 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:24.410819 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:24.410819 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:24.410819 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:24.410819 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:24.410819 np0000001613 nova-compute[98321]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:24.410819 np0000001613 nova-compute[98321]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:24.410819 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:02:24.412623 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:24.412623 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:24.412623 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:24.412623 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:24.412623 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:24.412623 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:24.412623 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:24.412623 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:24.412623 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:24.412623 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:24.412623 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:24.412623 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:24.412623 np0000001613 nova-compute[98321]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:24.412623 np0000001613 nova-compute[98321]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:24.412623 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:02:24.418827 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:24.418827 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:24.418827 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:24.418827 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:24.418827 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:24.418827 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:24.418827 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:24.418827 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:24.418827 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:24.418827 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:24.418827 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:24.418827 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:24.418827 np0000001613 nova-compute[98321]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:24.418827 np0000001613 nova-compute[98321]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:24.418827 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:02:24.420010 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:24.420010 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:24.420010 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:24.420010 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:24.420010 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:24.420010 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:24.420010 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:24.420010 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:24.420010 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:24.420010 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:24.420010 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:24.420010 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:24.420010 np0000001613 nova-compute[98321]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:24.420010 np0000001613 nova-compute[98321]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:24.420010 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:02:24.460544 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-408d6f53-3683-4e49-bebe-95d081e45a36 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk --force-share --output=json -f qcow2 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:24.491560 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec, portal: 192.168.40.100,3260]
May 28 10:02:24.491560 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec, portal: 192.168.40.100,3260] successful.
May 28 10:02:24.491560 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:24.502993 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec, portal: 192.168.50.100,3260]
May 28 10:02:24.502993 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec, portal: 192.168.50.100,3260] successful.
May 28 10:02:24.502993 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:24.508629 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:24.522217 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:24.539149 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:24.539149 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:24.539149 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:24.539149 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:24.539149 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:24.539149 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:24.539149 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:24.539149 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:24.539149 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:24.539149 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:24.539149 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:24.539149 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:24.539149 np0000001613 nova-compute[98321]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:24.539149 np0000001613 nova-compute[98321]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:24.539149 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:24.539149 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:24.539149 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:02:24.539748 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:24.539748 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:24.539748 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:24.539748 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:24.539748 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:24.539748 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:24.539748 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:24.539748 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:24.539748 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:24.539748 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:24.539748 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:24.539748 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:24.539748 np0000001613 nova-compute[98321]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:24.539748 np0000001613 nova-compute[98321]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:24.539748 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:24.539748 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:24.539748 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:02:24.540420 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.224s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:02:24.540420 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:02:24.541846 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] HCTL ('21', '-', '-', 0) found on session 57 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:02:24.542020 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Scanning host 21 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:02:24.552398 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:24.552398 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:24.552398 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:24.552398 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:24.552398 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:24.552398 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:24.552398 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:24.552398 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:24.552398 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:24.552398 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:24.552398 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:24.552398 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:24.552398 np0000001613 nova-compute[98321]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:24.552398 np0000001613 nova-compute[98321]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:24.552398 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:24.552398 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:24.552398 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:02:24.552398 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:24.552398 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:24.552398 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:24.552398 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:24.552398 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:24.552398 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:24.552398 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:24.552398 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:24.552398 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:24.552398 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:24.552398 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:24.552398 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:24.552398 np0000001613 nova-compute[98321]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:24.552398 np0000001613 nova-compute[98321]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:24.552398 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:24.552398 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:24.552398 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:02:24.552398 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.234s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:02:24.552398 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:02:24.553331 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] HCTL ('22', '-', '-', 0) found on session 58 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:02:24.553331 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Scanning host 22 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:02:24.565404 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Searching for a device in session 57 and hctl ['21', '*', '*', 0] yield: sdp {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:02:24.565696 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0535b5b5-fe9b-46f2-b850-07e27f9b75ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:02:24.573567 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Searching for a device in session 58 and hctl ['22', '*', '*', 0] yield: sdq {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:02:24.573567 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Connected to sdq using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0535b5b5-fe9b-46f2-b850-07e27f9b75ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:02:24.584034 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-408d6f53-3683-4e49-bebe-95d081e45a36 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk --force-share --output=json -f qcow2" returned: 0 in 0.129s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:24.584304 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-408d6f53-3683-4e49-bebe-95d081e45a36 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk --force-share --output=json -f qcow2 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:24.704814 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-408d6f53-3683-4e49-bebe-95d081e45a36 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk --force-share --output=json -f qcow2" returned: 0 in 0.120s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:24.707043 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-408d6f53-3683-4e49-bebe-95d081e45a36 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:02:24.712289 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-408d6f53-3683-4e49-bebe-95d081e45a36 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:02:24.712571 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-408d6f53-3683-4e49-bebe-95d081e45a36 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:24.835148 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-1f632f5b-408a-4538-b9da-386dfa337867 req-cf8f0dce-10cf-4ff6-bb22-9788d9ecb6ac service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Received event network-vif-unplugged-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:24.835845 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1f632f5b-408a-4538-b9da-386dfa337867 req-cf8f0dce-10cf-4ff6-bb22-9788d9ecb6ac service nova] Acquiring lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:24.836517 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1f632f5b-408a-4538-b9da-386dfa337867 req-cf8f0dce-10cf-4ff6-bb22-9788d9ecb6ac service nova] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:24.836717 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1f632f5b-408a-4538-b9da-386dfa337867 req-cf8f0dce-10cf-4ff6-bb22-9788d9ecb6ac service nova] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:24.836922 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-1f632f5b-408a-4538-b9da-386dfa337867 req-cf8f0dce-10cf-4ff6-bb22-9788d9ecb6ac service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] No waiting events found dispatching network-vif-unplugged-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:02:24.837107 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-1f632f5b-408a-4538-b9da-386dfa337867 req-cf8f0dce-10cf-4ff6-bb22-9788d9ecb6ac service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Received unexpected event network-vif-unplugged-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 for instance with vm_state resized and task_state resize_reverting.
May 28 10:02:24.841329 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-408d6f53-3683-4e49-bebe-95d081e45a36 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.129s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:24.842072 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-408d6f53-3683-4e49-bebe-95d081e45a36 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp6kpns222/c0103ae39fbc425c90a0cc409ef3c9b2.delta 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:24.875355 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:02:24.876065 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962544.8757408, de9742b9-43db-40a6-b635-81d9244fd5e0 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:02:24.877276 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] VM Paused (Lifecycle Event)
May 28 10:02:24.898617 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Took 8.40 seconds to spawn the instance on the hypervisor.
May 28 10:02:24.898921 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:02:24.914314 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-408d6f53-3683-4e49-bebe-95d081e45a36 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp6kpns222/c0103ae39fbc425c90a0cc409ef3c9b2.delta 1073741824" returned: 0 in 0.070s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:24.914314 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-408d6f53-3683-4e49-bebe-95d081e45a36 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Quiescing instance not available: QEMU guest agent is not enabled.
May 28 10:02:25.210340 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-408d6f53-3683-4e49-bebe-95d081e45a36 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] COPY block job progress, current cursor: 0 final cursor: 77004800 {{(pid=98321) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 28 10:02:25.318785 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:02:25.355402 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c07dd599-1cb8-4bd3-acb9-bf09298546b6 req-2acc47f5-5e9e-432a-ad8f-6c886695f2ae service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Received event network-vif-plugged-9df7e969-a155-41f1-9e30-c42f172029e4 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:25.355402 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c07dd599-1cb8-4bd3-acb9-bf09298546b6 req-2acc47f5-5e9e-432a-ad8f-6c886695f2ae service nova] Acquiring lock "de9742b9-43db-40a6-b635-81d9244fd5e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:25.355623 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c07dd599-1cb8-4bd3-acb9-bf09298546b6 req-2acc47f5-5e9e-432a-ad8f-6c886695f2ae service nova] Lock "de9742b9-43db-40a6-b635-81d9244fd5e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:25.355795 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c07dd599-1cb8-4bd3-acb9-bf09298546b6 req-2acc47f5-5e9e-432a-ad8f-6c886695f2ae service nova] Lock "de9742b9-43db-40a6-b635-81d9244fd5e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:25.355926 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c07dd599-1cb8-4bd3-acb9-bf09298546b6 req-2acc47f5-5e9e-432a-ad8f-6c886695f2ae service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] No waiting events found dispatching network-vif-plugged-9df7e969-a155-41f1-9e30-c42f172029e4 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:02:25.356150 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-c07dd599-1cb8-4bd3-acb9-bf09298546b6 req-2acc47f5-5e9e-432a-ad8f-6c886695f2ae service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Received unexpected event network-vif-plugged-9df7e969-a155-41f1-9e30-c42f172029e4 for instance with vm_state active and task_state None.
May 28 10:02:25.382733 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:02:25.385112 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962545.3846717, de9742b9-43db-40a6-b635-81d9244fd5e0 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:02:25.385262 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] VM Resumed (Lifecycle Event)
May 28 10:02:25.415530 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Took 14.56 seconds to build instance.
May 28 10:02:25.714325 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-408d6f53-3683-4e49-bebe-95d081e45a36 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] COPY block job progress, current cursor: 77004800 final cursor: 77004800 {{(pid=98321) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 28 10:02:25.715989 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-408d6f53-3683-4e49-bebe-95d081e45a36 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Skipping quiescing instance: QEMU guest agent is not enabled.
May 28 10:02:25.775109 np0000001613 nova-compute[98321]: DEBUG nova.privsep.utils [None req-408d6f53-3683-4e49-bebe-95d081e45a36 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98321) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 10:02:25.775479 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-408d6f53-3683-4e49-bebe-95d081e45a36 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp6kpns222/c0103ae39fbc425c90a0cc409ef3c9b2.delta /opt/stack/data/nova/instances/snapshots/tmp6kpns222/c0103ae39fbc425c90a0cc409ef3c9b2 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:25.897090 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:02:25.905153 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:02:25.919119 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "de9742b9-43db-40a6-b635-81d9244fd5e0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.068s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:26.066800 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-408d6f53-3683-4e49-bebe-95d081e45a36 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp6kpns222/c0103ae39fbc425c90a0cc409ef3c9b2.delta /opt/stack/data/nova/instances/snapshots/tmp6kpns222/c0103ae39fbc425c90a0cc409ef3c9b2" returned: 0 in 0.291s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:26.071852 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-408d6f53-3683-4e49-bebe-95d081e45a36 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Snapshot extracted, beginning image upload
May 28 10:02:26.335652 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Found WWN 3300000007f2a93cb for multipath device dm-15 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:02:26.336285 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:02:26.336597 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '3300000007f2a93cb', 'path': '/dev/dm-15', 'multipath_id': '3300000007f2a93cb'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:02:26.336867 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007f2a93cb', 'path': '/dev/dm-15', 'multipath_id': '3300000007f2a93cb'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:02:26.337683 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.799s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:02:26.338199 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '305d8623-c6f8-456c-83ed-46d06c6de0ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:02:26.338580 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:02:26.341239 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lazy-loading 'flavor' on Instance uuid 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:26.371468 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:26.371468 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:26.371468 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:26.371468 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:26.371468 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:26.371468 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:26.371468 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:26.371468 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:26.371468 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:26.371468 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:26.371468 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:26.371468 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:26.371468 np0000001613 nova-compute[98321]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:26.371468 np0000001613 nova-compute[98321]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:26.371468 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:26.371468 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:26.371468 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:02:26.372097 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:26.372097 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:26.372097 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:26.372097 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:26.372097 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:26.372097 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:26.372097 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:26.372097 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:26.372097 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:26.372097 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:26.372097 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:26.372097 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:26.372097 np0000001613 nova-compute[98321]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:26.372097 np0000001613 nova-compute[98321]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:26.372097 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:26.372097 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:26.372097 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:02:26.372097 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0', '45'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', '47'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', '48'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04', '49'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', '53'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', '54'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', '55'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', '56'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec', '58')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:02:26.372739 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', '56')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:02:26.373599 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', '55')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:02:26.374833 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1f4716840>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea'): ({'sdo'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea'): ({'sdn'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:02:26.375054 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Removing multipathed devices sdn, sdo {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:02:26.375321 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Flush multipath device 330000000352d9acf {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:02:26.405834 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:02:26.450483 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:02:26.493086 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Checking to see if SCSI volumes sdn, sdo have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:02:26.493268 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] SCSI volumes sdn, sdo have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:02:26.495060 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Checking to see if device paths {'sdn', 'sdo'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:02:26.508803 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Device paths {'sdn', 'sdo'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:02:26.509144 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:02:26.524268 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:26.567526 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea, portal: 192.168.40.100,3260]
May 28 10:02:26.567526 np0000001613 nova-compute[98321]: Logout of [sid: 56, target: iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea, portal: 192.168.40.100,3260] successful.
May 28 10:02:26.567526 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:26.596907 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:26.617318 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:26.666925 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea, portal: 192.168.50.100,3260]
May 28 10:02:26.666925 np0000001613 nova-compute[98321]: Logout of [sid: 55, target: iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea, portal: 192.168.50.100,3260] successful.
May 28 10:02:26.666925 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:26.696205 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:26.696494 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:02:26.696660 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] <== disconnect_volume: return (3157ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:02:26.696788 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:02:26.844789 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Attempting to attach volume 0535b5b5-fe9b-46f2-b850-07e27f9b75ec with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 10:02:26.847204 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] attach device xml: <disk type="block" device="disk">
May 28 10:02:26.847204 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:02:26.847204 np0000001613 nova-compute[98321]:   <alias name="ua-0535b5b5-fe9b-46f2-b850-07e27f9b75ec"/>
May 28 10:02:26.847204 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-15"/>
May 28 10:02:26.847204 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:02:26.847204 np0000001613 nova-compute[98321]:   <serial>0535b5b5-fe9b-46f2-b850-07e27f9b75ec</serial>
May 28 10:02:26.847204 np0000001613 nova-compute[98321]: </disk>
May 28 10:02:26.847204 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 10:02:27.277501 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8d66a010-c92b-4d84-865e-c9666d49545a req-4b3ec2d1-b0bd-4e98-a1fc-44183ebe9be5 service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Received event network-changed-0e857900-174b-46cf-bfa1-ce7f2f8ffdb1 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:27.277501 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8d66a010-c92b-4d84-865e-c9666d49545a req-4b3ec2d1-b0bd-4e98-a1fc-44183ebe9be5 service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Refreshing instance network info cache due to event network-changed-0e857900-174b-46cf-bfa1-ce7f2f8ffdb1. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:02:27.277501 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8d66a010-c92b-4d84-865e-c9666d49545a req-4b3ec2d1-b0bd-4e98-a1fc-44183ebe9be5 service nova] Acquiring lock "refresh_cache-36fde791-779f-42a8-9aef-87eafbbe0370" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:02:27.277941 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8d66a010-c92b-4d84-865e-c9666d49545a req-4b3ec2d1-b0bd-4e98-a1fc-44183ebe9be5 service nova] Acquired lock "refresh_cache-36fde791-779f-42a8-9aef-87eafbbe0370" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:02:27.277941 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-8d66a010-c92b-4d84-865e-c9666d49545a req-4b3ec2d1-b0bd-4e98-a1fc-44183ebe9be5 service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Refreshing network info cache for port 0e857900-174b-46cf-bfa1-ce7f2f8ffdb1 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:02:27.782245 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-8d66a010-c92b-4d84-865e-c9666d49545a req-4b3ec2d1-b0bd-4e98-a1fc-44183ebe9be5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:27.864764 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:27.865206 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:28.235417 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-8d66a010-c92b-4d84-865e-c9666d49545a req-4b3ec2d1-b0bd-4e98-a1fc-44183ebe9be5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:28.369046 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lazy-loading 'migration_context' on Instance uuid b90b1ecd-e640-4f4e-bd02-fb74021db82b {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:28.441869 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-8d66a010-c92b-4d84-865e-c9666d49545a req-4b3ec2d1-b0bd-4e98-a1fc-44183ebe9be5 service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Updated VIF entry in instance network info cache for port 0e857900-174b-46cf-bfa1-ce7f2f8ffdb1. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:02:28.442703 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-8d66a010-c92b-4d84-865e-c9666d49545a req-4b3ec2d1-b0bd-4e98-a1fc-44183ebe9be5 service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Updating instance_info_cache with network_info: [{"id": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "address": "fa:16:3e:e1:06:59", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e857900-17", "ovs_interfaceid": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:02:28.529522 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:28.552352 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:02:28.552714 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:02:28.552832 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:02:28.552942 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] No VIF found with MAC fa:16:3e:44:0a:72, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:02:28.874703 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Object Instance<b90b1ecd-e640-4f4e-bd02-fb74021db82b> lazy-loaded attributes: resources,migration_context {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:02:28.945095 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8d66a010-c92b-4d84-865e-c9666d49545a req-4b3ec2d1-b0bd-4e98-a1fc-44183ebe9be5 service nova] Releasing lock "refresh_cache-36fde791-779f-42a8-9aef-87eafbbe0370" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:02:29.293208 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "36fde791-779f-42a8-9aef-87eafbbe0370" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:29.294600 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "36fde791-779f-42a8-9aef-87eafbbe0370" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:29.356925 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-57149c4b-b277-44ee-9c1c-31deead692d4 req-26df03fd-bb51-4539-9ff2-d17b908ce5af service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Received event network-changed-9df7e969-a155-41f1-9e30-c42f172029e4 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:29.357786 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-57149c4b-b277-44ee-9c1c-31deead692d4 req-26df03fd-bb51-4539-9ff2-d17b908ce5af service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Refreshing instance network info cache due to event network-changed-9df7e969-a155-41f1-9e30-c42f172029e4. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:02:29.358509 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-57149c4b-b277-44ee-9c1c-31deead692d4 req-26df03fd-bb51-4539-9ff2-d17b908ce5af service nova] Acquiring lock "refresh_cache-de9742b9-43db-40a6-b635-81d9244fd5e0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:02:29.358946 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-57149c4b-b277-44ee-9c1c-31deead692d4 req-26df03fd-bb51-4539-9ff2-d17b908ce5af service nova] Acquired lock "refresh_cache-de9742b9-43db-40a6-b635-81d9244fd5e0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:02:29.358946 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-57149c4b-b277-44ee-9c1c-31deead692d4 req-26df03fd-bb51-4539-9ff2-d17b908ce5af service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Refreshing network info cache for port 9df7e969-a155-41f1-9e30-c42f172029e4 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:02:29.367275 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:29.397133 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-408d6f53-3683-4e49-bebe-95d081e45a36 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Snapshot image upload complete
May 28 10:02:29.397639 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-408d6f53-3683-4e49-bebe-95d081e45a36 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Took 6.60 seconds to snapshot the instance on the hypervisor.
May 28 10:02:29.800295 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lazy-loading 'flavor' on Instance uuid 36fde791-779f-42a8-9aef-87eafbbe0370 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:29.863841 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-57149c4b-b277-44ee-9c1c-31deead692d4 req-26df03fd-bb51-4539-9ff2-d17b908ce5af service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:30.118314 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:02:30.118792 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:02:30.145459 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-64ab337b-ae42-4f66-8605-35ded827dc15 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.612s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:30.393736 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-57149c4b-b277-44ee-9c1c-31deead692d4 req-26df03fd-bb51-4539-9ff2-d17b908ce5af service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:30.587007 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-57149c4b-b277-44ee-9c1c-31deead692d4 req-26df03fd-bb51-4539-9ff2-d17b908ce5af service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Updated VIF entry in instance network info cache for port 9df7e969-a155-41f1-9e30-c42f172029e4. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:02:30.587342 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-57149c4b-b277-44ee-9c1c-31deead692d4 req-26df03fd-bb51-4539-9ff2-d17b908ce5af service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Updating instance_info_cache with network_info: [{"id": "9df7e969-a155-41f1-9e30-c42f172029e4", "address": "fa:16:3e:9e:26:24", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df7e969-a1", "ovs_interfaceid": "9df7e969-a155-41f1-9e30-c42f172029e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:02:30.623222 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:02:30.696519 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Rescuing
May 28 10:02:30.698030 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "refresh_cache-2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:02:30.698030 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquired lock "refresh_cache-2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:02:30.698030 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:02:30.717001 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:30.717204 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:30.717508 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:30.717688 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:30.717831 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:30.720527 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Terminating instance
May 28 10:02:30.816019 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "36fde791-779f-42a8-9aef-87eafbbe0370" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.521s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:30.960978 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Acquiring lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:30.961951 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:31.089428 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-57149c4b-b277-44ee-9c1c-31deead692d4 req-26df03fd-bb51-4539-9ff2-d17b908ce5af service nova] Releasing lock "refresh_cache-de9742b9-43db-40a6-b635-81d9244fd5e0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:02:31.199544 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:31.225979 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:02:31.259001 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:31.262227 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:31.286755 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:31.475082 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lazy-loading 'flavor' on Instance uuid 4baa35bb-b237-42be-aa8b-d9eeed7e41a0 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:31.483694 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:31.565559 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:31.587211 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:31.592624 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999594877000163 future=<Future at 0x73c1f470d670 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:02:31.595483 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Instance destroyed successfully.
May 28 10:02:31.596212 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lazy-loading 'resources' on Instance uuid 49f53c82-6f7e-4d09-a471-26bd4fdc02e7 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:31.639879 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 3.774s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:31.639879 np0000001613 nova-compute[98321]: DEBUG nova.compute.rpcapi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98321) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 10:02:31.701063 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:31.820711 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-894ace38-163d-4f8c-9264-83cf4085dd11 req-9d2abfcd-315a-4a5b-9c27-49c4ccc6dd0f service nova] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Received event network-vif-unplugged-55556967-1d07-4f3b-bc07-6692ef9de17b {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:31.823006 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-894ace38-163d-4f8c-9264-83cf4085dd11 req-9d2abfcd-315a-4a5b-9c27-49c4ccc6dd0f service nova] Acquiring lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:31.823285 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-894ace38-163d-4f8c-9264-83cf4085dd11 req-9d2abfcd-315a-4a5b-9c27-49c4ccc6dd0f service nova] Lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:31.823446 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-894ace38-163d-4f8c-9264-83cf4085dd11 req-9d2abfcd-315a-4a5b-9c27-49c4ccc6dd0f service nova] Lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:31.823639 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-894ace38-163d-4f8c-9264-83cf4085dd11 req-9d2abfcd-315a-4a5b-9c27-49c4ccc6dd0f service nova] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] No waiting events found dispatching network-vif-unplugged-55556967-1d07-4f3b-bc07-6692ef9de17b {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:02:31.823862 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-894ace38-163d-4f8c-9264-83cf4085dd11 req-9d2abfcd-315a-4a5b-9c27-49c4ccc6dd0f service nova] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Received event network-vif-unplugged-55556967-1d07-4f3b-bc07-6692ef9de17b for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:02:31.918240 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Updating instance_info_cache with network_info: [{"id": "4edd294f-7bb5-46ec-9cdc-c8683088408c", "address": "fa:16:3e:44:0a:72", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4edd294f-7b", "ovs_interfaceid": "4edd294f-7bb5-46ec-9cdc-c8683088408c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:02:31.944304 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "36fde791-779f-42a8-9aef-87eafbbe0370" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:31.944713 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "36fde791-779f-42a8-9aef-87eafbbe0370" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:31.944845 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Attaching volume e8aeb4ed-7738-4054-b253-74e118c84fab to /dev/vdb
May 28 10:02:32.008528 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:02:32.023864 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:02:32.053780 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:32.100042 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:01:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1421682824',display_name='tempest-ServerActionsTestOtherA-server-1421682824',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001613',hostname='tempest-serveractionstestothera-server-1421682824',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLNPaTs6CM9Wbie8XPRW8vQPbkYzxhmauw/kdujNoZe8MNOaDeh6K3tCu7L1IAoOGDytj5meJ0gvP/71uSisLwWlqhLyhBtEZHSZo7u74E1cepcGRGEWdNqJct6TYM6oQ==',key_name='tempest-keypair-320562480',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:01:57Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb3a501b4f4041ef875ef4d2b4167044',ramdisk_id='',reservation_id='r-a0c5gebp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1557455944',owner_user_name='tempest-ServerActionsTestOtherA-1557455944-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:02:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62efa57da85f458790f3ceeebcc777a7',uuid=49f53c82-6f7e-4d09-a471-26bd4fdc02e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55556967-1d07-4f3b-bc07-6692ef9de17b", "address": "fa:16:3e:d2:27:b6", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55556967-1d", "ovs_interfaceid": "55556967-1d07-4f3b-bc07-6692ef9de17b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:02:32.100670 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Converting VIF {"id": "55556967-1d07-4f3b-bc07-6692ef9de17b", "address": "fa:16:3e:d2:27:b6", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55556967-1d", "ovs_interfaceid": "55556967-1d07-4f3b-bc07-6692ef9de17b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:02:32.102236 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:27:b6,bridge_name='br-int',has_traffic_filtering=True,id=55556967-1d07-4f3b-bc07-6692ef9de17b,network=Network(2ae47a43-582b-442f-922d-fe7138b431a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55556967-1d') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:02:32.102713 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:27:b6,bridge_name='br-int',has_traffic_filtering=True,id=55556967-1d07-4f3b-bc07-6692ef9de17b,network=Network(2ae47a43-582b-442f-922d-fe7138b431a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55556967-1d') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:02:32.106493 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:32.107148 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap55556967-1d, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:02:32.110269 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:02:32.110660 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:02:32.113967 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:02:32.115241 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:32.115469 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ce4cb929-1e59-43d4-ab32-26c348a2dd40) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:02:32.117892 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:02:32.122591 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:02:32.125965 np0000001613 nova-compute[98321]: INFO os_vif [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:27:b6,bridge_name='br-int',has_traffic_filtering=True,id=55556967-1d07-4f3b-bc07-6692ef9de17b,network=Network(2ae47a43-582b-442f-922d-fe7138b431a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55556967-1d')
May 28 10:02:32.126478 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe2d:94a4', 'fe80::2844:59ff:feec:5d21', 'fe80::fc16:3eff:fefd:30e7', 'fe80::e4df:c0ff:fe86:6341', 'fe80::ce2:7bff:fe0e:d096', 'fe80::fc16:3eff:fedb:1077', 'fe80::fc16:3eff:fee0:9ccd', 'fe80::fc16:3eff:fe3c:b7e1', 'fe80::fc16:3eff:fe86:604b', 'fe80::fc16:3eff:fe44:a72', 'fe80::fc16:3eff:fe05:9ea2', 'fe80::3037:7fff:fec8:89ce', 'fe80::fc16:3eff:fea8:9a37', 'fe80::44e2:31ff:fe81:8771', 'fe80::fc16:3eff:feaf:c736', 'fe80::24a6:e6ff:febf:f93c', 'fe80::fc16:3eff:fe24:b36a', 'fe80::fc16:3eff:fe5d:f989', 'fe80::fc16:3eff:fea3:f365', 'fe80::fc16:3eff:fee5:b9aa', 'fe80::fc16:3eff:feeb:2b41', 'fe80::8038:a7ff:fe21:5b5c', 'fe80::fc16:3eff:fed0:5ae8', 'fe80::7c9a:d6ff:fe01:2456', 'fe80::fc16:3eff:fee1:659', 'fe80::fc16:3eff:fe15:4154', 'fe80::605f:aaff:fe8d:fcdd', 'fe80::fc16:3eff:fe9e:2624'] 
May 28 10:02:32.126698 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:02:32.126934 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:02:32.127308 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:02:32.127600 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Updating existing volume attachment record: b2a78452-fa9d-49e4-bd5d-396cd23e03fa {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:02:32.130525 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:02:32.130983 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c1f00235-beec-448a-ae55-17b46aa31e9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:02:32.131191 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:02:32.131744 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:02:32.132093 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c1f00235-beec-448a-ae55-17b46aa31e9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:02:32.132259 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:02:32.173262 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:32.173262 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:32.173262 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:32.173262 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:32.173262 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:32.173262 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:32.173262 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:32.173262 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:32.173262 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:32.173262 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:32.173262 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:32.173262 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:32.173262 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:32.173262 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:32.173262 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:02:32.173805 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:32.173805 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:32.173805 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:32.173805 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:32.173805 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:32.173805 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:32.173805 np0000001613 nova-compute[98321]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:32.173805 np0000001613 nova-compute[98321]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b (non-flash)
May 28 10:02:32.173805 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:32.173805 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:32.173805 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:32.173805 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:32.173805 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:32.173805 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:32.173805 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:02:32.174286 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0', '45'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', '47'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', '48'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04', '49'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', '53'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', '54'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec', '58')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:02:32.174286 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', '47')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:02:32.176883 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b', '48')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:02:32.178597 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc325da0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b'): ({'sdg'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:02:32.178923 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Removing multipathed devices sdf, sdg {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:02:32.179245 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Flush multipath device 3300000001cad31b7 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:02:32.232965 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:02:32.276058 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:02:32.330798 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:02:32.330988 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:02:32.332904 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:02:32.346396 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:02:32.346952 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:02:32.358950 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:32.399435 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b, portal: 192.168.40.100,3260]
May 28 10:02:32.399435 np0000001613 nova-compute[98321]: Logout of [sid: 47, target: iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b, portal: 192.168.40.100,3260] successful.
May 28 10:02:32.399435 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:32.420552 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Releasing lock "refresh_cache-2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:02:32.428891 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:32.441149 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:32.478426 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b, portal: 192.168.50.100,3260]
May 28 10:02:32.478426 np0000001613 nova-compute[98321]: Logout of [sid: 48, target: iqn.2023-03.storpool.com:os--volume-c1f00235-beec-448a-ae55-17b46aa31e9b, portal: 192.168.50.100,3260] successful.
May 28 10:02:32.478426 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:32.491589 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.529s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:32.504259 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:32.504568 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:02:32.504866 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] <== disconnect_volume: return (374ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:02:32.505066 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:02:32.505507 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Deleting instance files /opt/stack/data/nova/instances/49f53c82-6f7e-4d09-a471-26bd4fdc02e7_del
May 28 10:02:32.506341 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Deletion of /opt/stack/data/nova/instances/49f53c82-6f7e-4d09-a471-26bd4fdc02e7_del complete
May 28 10:02:32.704260 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:02:32.704851 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e8aeb4ed-7738-4054-b253-74e118c84fab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:02:32.705028 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:02:32.705386 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:02:32.705561 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e8aeb4ed-7738-4054-b253-74e118c84fab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:02:32.718616 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:02:32.719388 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:02:32.720072 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:02:32.720615 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:02:32.720970 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:02:32.721358 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:02:32.736558 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:02:32.736558 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:32.742828 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:02:32.742828 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:32.751747 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab] added
May 28 10:02:32.751747 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:02:32.751747 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:02:32.751747 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:02:32.751747 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:02:32.751747 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:02:32.751747 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:32.752103 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:02:32.752103 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0316(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:02:32.752296 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:02:32.754734 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab] added
May 28 10:02:32.754734 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:02:32.754734 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:02:32.754734 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:02:32.754734 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:02:32.754734 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:02:32.754734 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:32.755053 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:02:32.755150 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0342(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:02:32.755360 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:02:33.012468 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Took 1.79 seconds to destroy the instance on the hypervisor.
May 28 10:02:33.013247 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:02:33.013459 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:02:33.013575 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:02:33.013839 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:33.136898 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:33.221320 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Swapping old allocation on dict_keys(['ad4de091-3626-4008-ac9a-3e83de44a510']) held by migration e6f68f41-c513-4350-8921-ddbbfd127fae for instance
May 28 10:02:33.357821 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Overwriting current allocation {'allocations': {'ad4de091-3626-4008-ac9a-3e83de44a510': {'resources': {'VCPU': 1, 'MEMORY_MB': 256, 'DISK_GB': 1}, 'generation': 38}}, 'project_id': '11e1727c7fbc44459c6972d182fc25b1', 'user_id': '11b9cab1ceef4e4b8cba521b61ad3f55', 'consumer_generation': 1} on consumer b90b1ecd-e640-4f4e-bd02-fb74021db82b {{(pid=98321) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2036}}
May 28 10:02:33.477428 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:33.563468 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Acquiring lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:33.563812 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:33.564080 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Attaching volume 3177d27e-24bf-418b-97a0-c324d705954d to /dev/vdb
May 28 10:02:33.611997 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:02:33.619209 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Acquiring lock "refresh_cache-b90b1ecd-e640-4f4e-bd02-fb74021db82b" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:02:33.619434 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Acquired lock "refresh_cache-b90b1ecd-e640-4f4e-bd02-fb74021db82b" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:02:33.619641 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:02:33.626105 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:02:33.648591 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:33.699917 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:02:33.700251 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:02:33.716068 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:02:33.719049 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe2d:94a4', 'fe80::2844:59ff:feec:5d21', 'fe80::fc16:3eff:fefd:30e7', 'fe80::e4df:c0ff:fe86:6341', 'fe80::ce2:7bff:fe0e:d096', 'fe80::fc16:3eff:fedb:1077', 'fe80::fc16:3eff:fee0:9ccd', 'fe80::fc16:3eff:fe3c:b7e1', 'fe80::fc16:3eff:fe86:604b', 'fe80::fc16:3eff:fe44:a72', 'fe80::fc16:3eff:fe05:9ea2', 'fe80::3037:7fff:fec8:89ce', 'fe80::fc16:3eff:fea8:9a37', 'fe80::44e2:31ff:fe81:8771', 'fe80::fc16:3eff:feaf:c736', 'fe80::24a6:e6ff:febf:f93c', 'fe80::fc16:3eff:fe24:b36a', 'fe80::fc16:3eff:fe5d:f989', 'fe80::fc16:3eff:fea3:f365', 'fe80::fc16:3eff:fee5:b9aa', 'fe80::fc16:3eff:feeb:2b41', 'fe80::8038:a7ff:fe21:5b5c', 'fe80::fc16:3eff:fed0:5ae8', 'fe80::7c9a:d6ff:fe01:2456', 'fe80::fc16:3eff:fee1:659', 'fe80::fc16:3eff:fe15:4154', 'fe80::605f:aaff:fe8d:fcdd', 'fe80::fc16:3eff:fe9e:2624'] 
May 28 10:02:33.719598 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:02:33.719789 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:02:33.720024 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:02:33.720308 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Updating existing volume attachment record: ba68fe9d-c4e7-415a-8543-825f40c11f37 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:02:33.753022 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:02:33.755952 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:02:33.767933 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:02:33.767933 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:33.777888 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-89ef9611-4c08-46fd-a10e-5b66b6fd90ff req-918ea99e-4d12-4af1-8b8a-fc8b0a85f448 service nova] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Received event network-vif-deleted-55556967-1d07-4f3b-bc07-6692ef9de17b {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:33.778095 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-89ef9611-4c08-46fd-a10e-5b66b6fd90ff req-918ea99e-4d12-4af1-8b8a-fc8b0a85f448 service nova] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Neutron deleted interface 55556967-1d07-4f3b-bc07-6692ef9de17b; detaching it from the instance and deleting it from the info cache
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:02:33.780056 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:02:33.780056 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:33.786100 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-89ef9611-4c08-46fd-a10e-5b66b6fd90ff req-918ea99e-4d12-4af1-8b8a-fc8b0a85f448 service nova] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Detach interface failed, port_id=55556967-1d07-4f3b-bc07-6692ef9de17b, reason: Instance 49f53c82-6f7e-4d09-a471-26bd4fdc02e7 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:02:33.786352 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:33.795224 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:33.807323 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:33.807323 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:33.807323 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:33.807323 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:33.807323 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:33.807323 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:33.807323 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:33.807323 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:33.807323 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:33.807323 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:33.807323 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:33.807323 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:33.807323 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:02:33.807707 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:33.807707 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:33.807707 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:33.807707 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:33.807707 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:33.807707 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:33.807707 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:33.807707 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:33.807707 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:33.807707 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:33.807707 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:33.807707 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:33.807707 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:02:33.822225 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:33.822225 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:33.822225 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:33.822225 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:33.822225 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:33.822225 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:33.822225 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:33.822225 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:33.822225 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:33.822225 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:33.822225 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:33.822225 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:33.822225 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:02:33.822574 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:33.822574 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:33.822574 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:33.822574 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:33.822574 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:33.822574 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:33.822574 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:33.822574 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:33.822574 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:33.822574 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:33.822574 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:33.822574 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:33.822574 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:02:33.870147 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab, portal: 192.168.40.100,3260]
May 28 10:02:33.870147 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab, portal: 192.168.40.100,3260] successful.
May 28 10:02:33.870147 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:33.882090 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab, portal: 192.168.50.100,3260]
May 28 10:02:33.882090 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab, portal: 192.168.50.100,3260] successful.
May 28 10:02:33.882090 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:33.888319 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:33.902725 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:33.911703 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:33.911703 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:33.911703 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:33.911703 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:33.911703 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:33.911703 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:33.911703 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:33.911703 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:33.911703 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:33.911703 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:33.911703 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:33.911703 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:33.911703 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:33.911703 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:33.911703 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:02:33.912143 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:33.912143 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:33.912143 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:33.912143 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:33.912143 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:33.912143 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:33.912143 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:33.912143 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:33.912143 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:33.912143 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:33.912143 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:33.912143 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:33.912143 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:33.912143 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:33.912143 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:02:33.912539 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.193s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:02:33.912539 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:02:33.915450 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5e4a19f4-5118-4ddb-af26-040646fb8dd6 req-b0da5d84-047c-4e29-9901-fa862e71000f service nova] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Received event network-vif-unplugged-55556967-1d07-4f3b-bc07-6692ef9de17b {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:33.915739 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5e4a19f4-5118-4ddb-af26-040646fb8dd6 req-b0da5d84-047c-4e29-9901-fa862e71000f service nova] Acquiring lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:33.916146 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5e4a19f4-5118-4ddb-af26-040646fb8dd6 req-b0da5d84-047c-4e29-9901-fa862e71000f service nova] Lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:33.916287 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5e4a19f4-5118-4ddb-af26-040646fb8dd6 req-b0da5d84-047c-4e29-9901-fa862e71000f service nova] Lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:33.916406 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5e4a19f4-5118-4ddb-af26-040646fb8dd6 req-b0da5d84-047c-4e29-9901-fa862e71000f service nova] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] No waiting events found dispatching network-vif-unplugged-55556967-1d07-4f3b-bc07-6692ef9de17b {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:02:33.916538 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5e4a19f4-5118-4ddb-af26-040646fb8dd6 req-b0da5d84-047c-4e29-9901-fa862e71000f service nova] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Received event network-vif-unplugged-55556967-1d07-4f3b-bc07-6692ef9de17b for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:02:33.917842 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] HCTL ('11', '-', '-', 0) found on session 59 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:02:33.917951 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:02:33.933716 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Searching for a device in session 59 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:02:33.935253 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e8aeb4ed-7738-4054-b253-74e118c84fab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:02:33.935253 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:33.935253 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:33.935253 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:33.935253 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:33.935253 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:33.935253 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:33.935253 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:33.935253 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:33.935253 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:33.935253 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:33.935253 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:33.935253 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:33.935253 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:33.935253 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:33.935253 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:02:33.935253 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:33.935253 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:33.935253 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:33.935253 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:33.935253 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:33.935253 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:33.935253 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:33.935253 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:33.935253 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:33.935253 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:33.935253 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:33.935253 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:33.935253 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:33.935253 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:33.935253 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:02:33.937845 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.215s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:02:33.938356 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:02:33.940612 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] HCTL ('12', '-', '-', 0) found on session 60 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:02:33.940837 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:02:33.959098 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Searching for a device in session 60 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:02:33.959098 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e8aeb4ed-7738-4054-b253-74e118c84fab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:02:34.065520 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:34.070089 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:34.097978 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:34.122964 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:34.197271 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:02:34.240344 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:34.246351 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:34.302236 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:02:34.302733 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d', 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3177d27e-24bf-418b-97a0-c324d705954d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:02:34.303041 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:02:34.377523 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:34.397225 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.99962666600004 future=<Future at 0x73c1fc13dd90 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:02:34.399509 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Instance destroyed successfully.
May 28 10:02:34.400279 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lazy-loading 'numa_topology' on Instance uuid 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:34.537520 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:34.699681 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Took 1.69 seconds to deallocate network for instance.
May 28 10:02:34.709099 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Updating instance_info_cache with network_info: [{"id": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "address": "fa:16:3e:b1:88:d2", "network": {"id": "9d46c174-21e3-464e-83c9-e8db18f486a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-151012625-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e1727c7fbc44459c6972d182fc25b1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a01cd4-8a", "ovs_interfaceid": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:02:34.724687 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:02:34.909535 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Attempting rescue
May 28 10:02:34.910748 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98321) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 28 10:02:34.917449 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Instance directory exists: not creating {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 10:02:34.917615 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Creating image(s)
May 28 10:02:34.918355 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "/opt/stack/data/nova/instances/2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:34.918584 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "/opt/stack/data/nova/instances/2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:34.919320 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "/opt/stack/data/nova/instances/2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:34.919557 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:35.212200 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Releasing lock "refresh_cache-b90b1ecd-e640-4f4e-bd02-fb74021db82b" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:02:35.212645 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:02:35.222767 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:02:35.242395 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:35.270463 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Took 0.57 seconds to detach 1 volumes for instance.
May 28 10:02:35.275396 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Deleting volume: c1f00235-beec-448a-ae55-17b46aa31e9b {{(pid=98321) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 10:02:35.286356 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:02:35.286690 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:02:35.295069 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:02:35.297757 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe2d:94a4', 'fe80::2844:59ff:feec:5d21', 'fe80::fc16:3eff:fefd:30e7', 'fe80::e4df:c0ff:fe86:6341', 'fe80::ce2:7bff:fe0e:d096', 'fe80::fc16:3eff:fedb:1077', 'fe80::fc16:3eff:fee0:9ccd', 'fe80::fc16:3eff:fe3c:b7e1', 'fe80::fc16:3eff:fe86:604b', 'fe80::fc16:3eff:fe05:9ea2', 'fe80::3037:7fff:fec8:89ce', 'fe80::fc16:3eff:fea8:9a37', 'fe80::44e2:31ff:fe81:8771', 'fe80::fc16:3eff:feaf:c736', 'fe80::24a6:e6ff:febf:f93c', 'fe80::fc16:3eff:fe24:b36a', 'fe80::fc16:3eff:fe5d:f989', 'fe80::fc16:3eff:fea3:f365', 'fe80::fc16:3eff:fee5:b9aa', 'fe80::fc16:3eff:feeb:2b41', 'fe80::8038:a7ff:fe21:5b5c', 'fe80::fc16:3eff:fed0:5ae8', 'fe80::7c9a:d6ff:fe01:2456', 'fe80::fc16:3eff:fee1:659', 'fe80::fc16:3eff:fe15:4154', 'fe80::605f:aaff:fe8d:fcdd', 'fe80::fc16:3eff:fe9e:2624'] 
May 28 10:02:35.297997 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:02:35.298205 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:02:35.298582 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] <== get_connector_properties: return (85ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:02:35.421828 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Object Instance<2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:02:35.422651 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:02:35.425450 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:02:35.426899 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:35.427280 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:35.427524 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:02:35.430002 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:02:35.431183 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:35.514997 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.083s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:35.515399 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f/disk.rescue {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:35.567927 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f/disk.rescue" returned: 0 in 0.052s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:35.568535 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.141s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:35.568876 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lazy-loading 'migration_context' on Instance uuid 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:35.743922 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Found WWN 330000000a8b99648 for multipath device dm-1 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:02:35.744609 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:02:35.744814 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '330000000a8b99648', 'path': '/dev/dm-1', 'multipath_id': '330000000a8b99648'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:02:35.745012 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a8b99648', 'path': '/dev/dm-1', 'multipath_id': '330000000a8b99648'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:02:35.745815 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.443s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:02:35.746307 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d', 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3177d27e-24bf-418b-97a0-c324d705954d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:02:35.748925 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lazy-loading 'flavor' on Instance uuid 36fde791-779f-42a8-9aef-87eafbbe0370 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:35.766964 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:02:35.767568 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:02:35.768288 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:02:35.769515 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:02:35.769755 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:02:35.769994 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:02:35.784736 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:02:35.784736 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:35.793548 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:02:35.793548 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:35.798920 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d] added
May 28 10:02:35.798920 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:02:35.798920 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:02:35.798920 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:02:35.798920 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:02:35.798920 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:02:35.798920 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:35.799246 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:02:35.799246 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0298(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:02:35.799397 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:02:35.806188 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d] added
May 28 10:02:35.806188 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:02:35.806188 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:02:35.806188 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:02:35.806188 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:02:35.806188 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:02:35.806188 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:35.806419 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:02:35.806500 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0368(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:02:35.806627 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:02:35.830446 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:35.835713 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.005s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:35.837436 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:35.873269 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c8771380-de36-4431-baa0-29c9bd70c8ec req-c01e1496-2611-426e-8842-179309122f58 service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Received event network-vif-unplugged-4edd294f-7bb5-46ec-9cdc-c8683088408c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:35.873269 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c8771380-de36-4431-baa0-29c9bd70c8ec req-c01e1496-2611-426e-8842-179309122f58 service nova] Acquiring lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:35.873269 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c8771380-de36-4431-baa0-29c9bd70c8ec req-c01e1496-2611-426e-8842-179309122f58 service nova] Lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:35.873532 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c8771380-de36-4431-baa0-29c9bd70c8ec req-c01e1496-2611-426e-8842-179309122f58 service nova] Lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:35.873532 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c8771380-de36-4431-baa0-29c9bd70c8ec req-c01e1496-2611-426e-8842-179309122f58 service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] No waiting events found dispatching network-vif-unplugged-4edd294f-7bb5-46ec-9cdc-c8683088408c {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:02:35.873676 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-c8771380-de36-4431-baa0-29c9bd70c8ec req-c01e1496-2611-426e-8842-179309122f58 service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Received unexpected event network-vif-unplugged-4edd294f-7bb5-46ec-9cdc-c8683088408c for instance with vm_state active and task_state rescuing.
May 28 10:02:35.873796 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c8771380-de36-4431-baa0-29c9bd70c8ec req-c01e1496-2611-426e-8842-179309122f58 service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Received event network-vif-unplugged-4edd294f-7bb5-46ec-9cdc-c8683088408c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:35.874022 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c8771380-de36-4431-baa0-29c9bd70c8ec req-c01e1496-2611-426e-8842-179309122f58 service nova] Acquiring lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:35.874148 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c8771380-de36-4431-baa0-29c9bd70c8ec req-c01e1496-2611-426e-8842-179309122f58 service nova] Lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:35.874286 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c8771380-de36-4431-baa0-29c9bd70c8ec req-c01e1496-2611-426e-8842-179309122f58 service nova] Lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:35.874416 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c8771380-de36-4431-baa0-29c9bd70c8ec req-c01e1496-2611-426e-8842-179309122f58 service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] No waiting events found dispatching network-vif-unplugged-4edd294f-7bb5-46ec-9cdc-c8683088408c {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:02:35.874463 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-c8771380-de36-4431-baa0-29c9bd70c8ec req-c01e1496-2611-426e-8842-179309122f58 service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Received unexpected event network-vif-unplugged-4edd294f-7bb5-46ec-9cdc-c8683088408c for instance with vm_state active and task_state rescuing.
May 28 10:02:35.905957 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Deleted allocations for instance 49f53c82-6f7e-4d09-a471-26bd4fdc02e7
May 28 10:02:36.045305 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "be4a8d87-07fc-4c56-a68d-c95e98e99184" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:36.046346 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "be4a8d87-07fc-4c56-a68d-c95e98e99184" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:36.071570 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Object Instance<2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:02:36.071989 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:02:36.072292 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Start _get_guest_xml network_info=[{"id": "4edd294f-7bb5-46ec-9cdc-c8683088408c", "address": "fa:16:3e:44:0a:72", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.174", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "vif_mac": "fa:16:3e:44:0a:72"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4edd294f-7b", "ovs_interfaceid": "4edd294f-7bb5-46ec-9cdc-c8683088408c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:02:36.072522 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lazy-loading 'resources' on Instance uuid 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:36.252272 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Attempting to attach volume e8aeb4ed-7738-4054-b253-74e118c84fab with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 10:02:36.253847 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] attach device xml: <disk type="block" device="disk">
May 28 10:02:36.253847 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:02:36.253847 np0000001613 nova-compute[98321]:   <alias name="ua-e8aeb4ed-7738-4054-b253-74e118c84fab"/>
May 28 10:02:36.253847 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-1"/>
May 28 10:02:36.253847 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:02:36.253847 np0000001613 nova-compute[98321]:   <serial>e8aeb4ed-7738-4054-b253-74e118c84fab</serial>
May 28 10:02:36.253847 np0000001613 nova-compute[98321]:   <shareable/>
May 28 10:02:36.253847 np0000001613 nova-compute[98321]: </disk>
May 28 10:02:36.253847 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 10:02:36.399873 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Starting finish_revert_migration {{(pid=98321) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12932}}
May 28 10:02:36.418667 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Start _get_guest_xml network_info=[{"id": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "address": "fa:16:3e:b1:88:d2", "network": {"id": "9d46c174-21e3-464e-83c9-e8db18f486a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-151012625-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e1727c7fbc44459c6972d182fc25b1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a01cd4-8a", "ovs_interfaceid": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '305d8623-c6f8-456c-83ed-46d06c6de0ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'b90b1ecd-e640-4f4e-bd02-fb74021db82b', 'attached_at': '2026-05-28T10:02:35.000000', 'detached_at': '', 'volume_id': '305d8623-c6f8-456c-83ed-46d06c6de0ea', 'serial': '305d8623-c6f8-456c-83ed-46d06c6de0ea'}, 'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': 'd665c6f0-c3b4-4fb1-9b38-7dfdb8781e4f', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:02:36.420560 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:02:36.422465 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-1921152164', uuid='b90b1ecd-e640-4f4e-bd02-fb74021db82b'), owner=OwnerMeta(userid='11b9cab1ceef4e4b8cba521b61ad3f55', username='tempest-ServerActionsTestOtherB-634969206-project-member', projectid='11e1727c7fbc44459c6972d182fc25b1', projectname='tempest-ServerActionsTestOtherB-634969206'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "address": "fa:16:3e:b1:88:d2", "network": {"id": "9d46c174-21e3-464e-83c9-e8db18f486a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-151012625-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e1727c7fbc44459c6972d182fc25b1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a01cd4-8a", "ovs_interfaceid": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962556.4216197) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:02:36.423910 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:02:36.423910 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:02:36.424640 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:02:36.424640 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:02:36.425681 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:02:36.425979 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:02:36.426202 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:02:36.426261 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:02:36.426457 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:02:36.426548 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:02:36.426729 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:02:36.427370 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:02:36.427370 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:02:36.427370 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:02:36.427629 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:02:36.427817 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:02:36.428035 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lazy-loading 'vcpu_model' on Instance uuid b90b1ecd-e640-4f4e-bd02-fb74021db82b {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:36.549307 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lazy-loading 'flavor' on Instance uuid be4a8d87-07fc-4c56-a68d-c95e98e99184 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:36.574156 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Object Instance<2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:02:36.576000 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:02:36.577214 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1240965804', uuid='2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f'), owner=OwnerMeta(userid='45c67299cd204090b9ebf7e0eb873e37', username='tempest-ServerRescueNegativeTestJSON-1286552851-project-member', projectid='f5fc8bc5d1984c1c839a3ef7e30b9d36', projectname='tempest-ServerRescueNegativeTestJSON-1286552851'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4edd294f-7bb5-46ec-9cdc-c8683088408c", "address": "fa:16:3e:44:0a:72", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.174", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "vif_mac": "fa:16:3e:44:0a:72"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4edd294f-7b", "ovs_interfaceid": "4edd294f-7bb5-46ec-9cdc-c8683088408c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962556.5768785) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:02:36.578284 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:02:36.578688 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:02:36.579525 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:02:36.579710 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:02:36.580746 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:02:36.581099 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:02:36.581249 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:02:36.581334 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:02:36.581498 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:02:36.581610 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:02:36.581741 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:02:36.581926 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:02:36.582058 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:02:36.582225 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:02:36.582358 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:02:36.582514 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:02:36.582689 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:36.799975 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:02:36.807337 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:02:36.814193 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:02:36.814193 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:02:36.827803 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:02:36.827803 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:36.829733 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:36.845660 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:36.852097 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:36.852097 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:36.852097 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:36.852097 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:36.852097 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:36.852097 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:36.852097 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:36.852097 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:36.852097 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:36.852097 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:36.852097 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:36.852097 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:36.852097 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:36.852097 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:36.852097 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:02:36.852968 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:36.852968 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:36.852968 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:36.852968 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:36.852968 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:36.852968 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:36.852968 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:36.852968 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:36.852968 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:36.852968 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:36.852968 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:36.852968 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:36.852968 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:36.852968 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:36.852968 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:02:36.870665 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:36.870665 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:36.870665 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:36.870665 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:36.870665 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:36.870665 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:36.870665 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:36.870665 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:36.870665 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:36.870665 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:36.870665 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:36.870665 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:36.870665 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:36.870665 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:36.870665 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:02:36.871068 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:36.871068 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:36.871068 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:36.871068 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:36.871068 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:36.871068 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:36.871068 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:36.871068 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:36.871068 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:36.871068 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:36.871068 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:36.871068 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:36.871068 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:36.871068 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:36.871068 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:02:36.912198 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d, portal: 192.168.50.100,3260]
May 28 10:02:36.912198 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d, portal: 192.168.50.100,3260] successful.
May 28 10:02:36.912198 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:36.919127 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cd691fbc-c4a2-4841-ac0b-d23c3acd02d4 tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "49f53c82-6f7e-4d09-a471-26bd4fdc02e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.200s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:36.929921 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:36.944988 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d, portal: 192.168.40.100,3260]
May 28 10:02:36.944988 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d, portal: 192.168.40.100,3260] successful.
May 28 10:02:36.944988 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:36.951180 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk.config --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:36.967434 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:36.967434 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:36.967434 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:36.967434 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:36.967434 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:36.967434 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:36.967434 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:36.967434 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:36.967434 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:36.967434 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:36.967434 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:36.967434 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:36.967434 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:36.967434 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:36.967434 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:36.967434 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:36.967434 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:02:36.968139 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:36.968614 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:36.968614 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:36.968614 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:36.968614 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:36.968614 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:36.968614 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:36.968614 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:36.968614 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:36.968614 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:36.968614 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:36.968614 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:36.968614 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:36.968614 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:36.968614 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:36.968614 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:36.968614 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:36.968614 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:02:36.969522 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.201s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:02:36.969522 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:02:36.971311 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] HCTL ('19', '-', '-', 0) found on session 61 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:02:36.971479 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:02:36.997893 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:36.997893 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:36.997893 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:36.997893 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:36.997893 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:36.997893 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:36.997893 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:36.997893 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:36.997893 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:36.997893 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:36.997893 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:36.997893 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:36.997893 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:36.997893 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:36.997893 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:36.997893 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:36.997893 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:02:36.997893 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:36.997893 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:36.997893 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:36.997893 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:36.997893 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:36.997893 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:36.997893 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:36.997893 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:36.997893 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:36.997893 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:36.997893 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:36.997893 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:36.997893 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:36.997893 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:36.997893 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:36.997893 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:36.997893 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:02:36.997893 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.226s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:02:36.997893 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:02:36.998622 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] HCTL ('20', '-', '-', 0) found on session 62 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:02:36.998622 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:02:37.001728 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Searching for a device in session 61 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:02:37.001728 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3177d27e-24bf-418b-97a0-c324d705954d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:02:37.015292 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Searching for a device in session 62 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:02:37.015292 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3177d27e-24bf-418b-97a0-c324d705954d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:02:37.062832 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk.config --force-share --output=json" returned: 0 in 0.112s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:37.066465 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Acquiring lock "/opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:37.066465 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "/opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:37.067965 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "/opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:37.068478 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:02:37.070562 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '305d8623-c6f8-456c-83ed-46d06c6de0ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:02:37.070562 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:02:37.093353 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Object Instance<2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:02:37.115090 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:01:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1240965804',display_name='tempest-ServerRescueNegativeTestJSON-server-1240965804',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serverrescuenegativetestjson-server-1240965804',id=27,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4cGw7X+Q2nx15R5jh2EKJ3VR+oUGPb5WmFwZPLNWg5EFnojPDhCKqU015r+n4sVEHS6gVIGvoSAjxxWq0zAUAI8n+AO14k3HGl23rDCNVGMYgSQsH9e+S27cmLpZ/MSQ==',key_name='tempest-keypair-501617819',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:01:40Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f5fc8bc5d1984c1c839a3ef7e30b9d36',ramdisk_id='',reservation_id='r-c3zv0nco',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1286552851',owner_user_name='tempest-ServerRescueNegativeTestJSON-1286552851-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:01:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45c67299cd204090b9ebf7e0eb873e37',uuid=2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4edd294f-7bb5-46ec-9cdc-c8683088408c", "address": "fa:16:3e:44:0a:72", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.174", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "vif_mac": "fa:16:3e:44:0a:72"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4edd294f-7b", "ovs_interfaceid": "4edd294f-7bb5-46ec-9cdc-c8683088408c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:02:37.115376 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Converting VIF {"id": "4edd294f-7bb5-46ec-9cdc-c8683088408c", "address": "fa:16:3e:44:0a:72", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.174", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "vif_mac": "fa:16:3e:44:0a:72"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4edd294f-7b", "ovs_interfaceid": "4edd294f-7bb5-46ec-9cdc-c8683088408c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:02:37.116372 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:0a:72,bridge_name='br-int',has_traffic_filtering=True,id=4edd294f-7bb5-46ec-9cdc-c8683088408c,network=Network(729946be-b963-4dfb-ad38-335762a8666c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4edd294f-7b') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:02:37.117056 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:37.126096 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:37.557295 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "be4a8d87-07fc-4c56-a68d-c95e98e99184" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:37.627010 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Object Instance<2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:02:37.627902 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] End _get_guest_xml xml=<domain type="qemu">
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:   <uuid>2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f</uuid>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:   <name>instance-0000001b</name>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1240965804</nova:name>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:02:36</nova:creationTime>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:         <nova:user uuid="45c67299cd204090b9ebf7e0eb873e37">tempest-ServerRescueNegativeTestJSON-1286552851-project-member</nova:user>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:         <nova:project uuid="f5fc8bc5d1984c1c839a3ef7e30b9d36">tempest-ServerRescueNegativeTestJSON-1286552851</nova:project>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:         <nova:port uuid="4edd294f-7bb5-46ec-9cdc-c8683088408c">
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:     <system>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:       <entry name="serial">2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f</entry>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:       <entry name="uuid">2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f</entry>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:     </system>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:   <os>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:   </os>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:   <features>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:   </features>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:   <devices>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f/disk.rescue"/>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:     </disk>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f/disk"/>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:       <target dev="vdb" bus="virtio"/>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:     </disk>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f/disk.config.rescue"/>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:     </disk>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:44:0a:72"/>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:       <target dev="tap4edd294f-7b"/>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:     </interface>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f/console.log" append="off"/>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:     </serial>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:     <video>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:     </video>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:     </rng>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:   </devices>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]: </domain>
May 28 10:02:37.627902 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:02:37.632600 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Instance destroyed successfully.
May 28 10:02:37.770173 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:02:37.919243 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:02:37.919382 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:02:37.919382 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:02:37.919473 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No VIF found with MAC fa:16:3e:e1:06:59, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:02:38.002555 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.00038312200013024267 future=<Future at 0x73c1f43e23f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:02:38.002750 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Emitting event <LifecycleEvent: 1779962543.0018997, b90b1ecd-e640-4f4e-bd02-fb74021db82b => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:02:38.002950 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] VM Stopped (Lifecycle Event)
May 28 10:02:38.004065 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:02:38.004176 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=8.588001049000013 future=<Future at 0x73c1f470d670 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:02:38.004259 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=8.587900332000117 future=<Future at 0x73c1f470d670 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:02:38.505922 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:02:38.626360 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "be4a8d87-07fc-4c56-a68d-c95e98e99184" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:38.626784 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "be4a8d87-07fc-4c56-a68d-c95e98e99184" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:38.626817 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Attaching volume 1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19 to /dev/vdb
May 28 10:02:38.697518 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:02:38.712990 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:02:38.736227 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:38.787490 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:02:38.789828 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Found WWN 3300000006509bf9e for multipath device dm-2 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:02:38.790380 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.045s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:02:38.791175 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] <== connect_volume: return (4488ms) {'type': 'block', 'scsi_wwn': '3300000006509bf9e', 'path': '/dev/dm-2', 'multipath_id': '3300000006509bf9e'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:02:38.791414 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006509bf9e', 'path': '/dev/dm-2', 'multipath_id': '3300000006509bf9e'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:02:38.793461 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:02:38.794010 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.722s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:02:38.794389 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '305d8623-c6f8-456c-83ed-46d06c6de0ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:02:38.801888 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lazy-loading 'flavor' on Instance uuid 4baa35bb-b237-42be-aa8b-d9eeed7e41a0 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:38.809536 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:02:38.813849 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe2d:94a4', 'fe80::2844:59ff:feec:5d21', 'fe80::fc16:3eff:fefd:30e7', 'fe80::e4df:c0ff:fe86:6341', 'fe80::ce2:7bff:fe0e:d096', 'fe80::fc16:3eff:fedb:1077', 'fe80::fc16:3eff:fee0:9ccd', 'fe80::fc16:3eff:fe3c:b7e1', 'fe80::fc16:3eff:fe86:604b', 'fe80::fc16:3eff:fe05:9ea2', 'fe80::3037:7fff:fec8:89ce', 'fe80::fc16:3eff:fea8:9a37', 'fe80::44e2:31ff:fe81:8771', 'fe80::fc16:3eff:feaf:c736', 'fe80::24a6:e6ff:febf:f93c', 'fe80::fc16:3eff:fe24:b36a', 'fe80::fc16:3eff:fe5d:f989', 'fe80::fc16:3eff:fea3:f365', 'fe80::fc16:3eff:fee5:b9aa', 'fe80::fc16:3eff:feeb:2b41', 'fe80::8038:a7ff:fe21:5b5c', 'fe80::fc16:3eff:fed0:5ae8', 'fe80::7c9a:d6ff:fe01:2456', 'fe80::fc16:3eff:fee1:659', 'fe80::fc16:3eff:fe15:4154', 'fe80::605f:aaff:fe8d:fcdd', 'fe80::fc16:3eff:fe9e:2624'] 
May 28 10:02:38.814193 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:02:38.814344 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:02:38.814704 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:02:38.814895 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Updating existing volume attachment record: 21920d30-943e-408c-88e9-d8e0b5bf5672 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:02:38.818944 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:02:38.822390 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:02:38.822390 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:02:38.823347 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:02:38.825838 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:02:38.825838 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:02:38.835128 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:02:38.835128 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:38.841910 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:02:38.841910 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:38.849329 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea] added
May 28 10:02:38.849329 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:02:38.849329 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:02:38.849329 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:02:38.849329 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:02:38.849329 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:02:38.849329 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:38.850564 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:02:38.850564 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.028(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:02:38.850564 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:02:38.853570 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea] added
May 28 10:02:38.853570 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:02:38.853570 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:02:38.853570 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:02:38.853570 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:02:38.853570 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:02:38.853570 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:38.853893 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:02:38.853943 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0281(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:02:38.854090 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:02:39.150184 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:02:39.150307 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:02:39.150373 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:02:39.150522 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] No VIF found with MAC fa:16:3e:44:0a:72, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:02:39.150970 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Using config drive
May 28 10:02:39.168183 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b4d5af16-a0e0-4218-aba9-830d87a38e9f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:39.168339 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b4d5af16-a0e0-4218-aba9-830d87a38e9f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:39.168523 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b4d5af16-a0e0-4218-aba9-830d87a38e9f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:39.168639 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b4d5af16-a0e0-4218-aba9-830d87a38e9f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:39.168769 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b4d5af16-a0e0-4218-aba9-830d87a38e9f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:39.171041 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-b4d5af16-a0e0-4218-aba9-830d87a38e9f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Terminating instance
May 28 10:02:39.268648 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "de9742b9-43db-40a6-b635-81d9244fd5e0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:39.268804 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "de9742b9-43db-40a6-b635-81d9244fd5e0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:39.307353 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Attempting to attach volume 3177d27e-24bf-418b-97a0-c324d705954d with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 10:02:39.309094 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] attach device xml: <disk type="block" device="disk">
May 28 10:02:39.309094 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:02:39.309094 np0000001613 nova-compute[98321]:   <alias name="ua-3177d27e-24bf-418b-97a0-c324d705954d"/>
May 28 10:02:39.309094 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-2"/>
May 28 10:02:39.309094 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:02:39.309094 np0000001613 nova-compute[98321]:   <serial>3177d27e-24bf-418b-97a0-c324d705954d</serial>
May 28 10:02:39.309094 np0000001613 nova-compute[98321]: </disk>
May 28 10:02:39.309094 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 10:02:39.379756 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:02:39.381625 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19', 'iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:02:39.381818 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:02:39.390081 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:39.478875 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c917bfac-aa5c-48af-91cf-24e362fe89ea tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "36fde791-779f-42a8-9aef-87eafbbe0370" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.534s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:39.653690 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lazy-loading 'ec2_ids' on Instance uuid 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:39.673996 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-b4d5af16-a0e0-4218-aba9-830d87a38e9f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:02:39.712970 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:39.717826 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:39.740835 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:39.748139 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:39.772658 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lazy-loading 'flavor' on Instance uuid de9742b9-43db-40a6-b635-81d9244fd5e0 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:39.786472 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:39.850962 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:02:39.854549 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:02:39.867188 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:02:39.867188 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:02:39.876744 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:02:39.876744 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:39.886729 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:39.894005 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:39.913996 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:39.913996 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:39.913996 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:39.913996 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:39.913996 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:39.913996 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:39.913996 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:39.913996 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:39.913996 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:39.913996 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:39.913996 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:39.913996 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:39.913996 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:39.913996 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:39.913996 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:39.913996 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:39.913996 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:02:39.914619 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:39.914619 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:39.914619 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:39.914619 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:39.914619 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:39.914619 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:39.914619 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:39.914619 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:39.914619 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:39.914619 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:39.914619 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:39.914619 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:39.914619 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:39.914619 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:39.914619 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:39.914619 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:39.914619 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:02:39.921850 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:39.921850 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:39.921850 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:39.921850 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:39.921850 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:39.921850 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:39.921850 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:39.921850 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:39.921850 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:39.921850 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:39.921850 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:39.921850 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:39.921850 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:39.921850 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:39.921850 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:39.921850 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:39.921850 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:02:39.922517 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:39.922517 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:39.922517 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:39.922517 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:39.922517 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:39.922517 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:39.922517 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:39.922517 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:39.922517 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:39.922517 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:39.922517 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:39.922517 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:39.922517 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:39.922517 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:39.922517 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:39.922517 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:39.922517 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:02:39.936237 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8da23f80-44cb-44e2-ae5b-2772205fa025 req-b6e8d4e1-ed88-46ff-8218-2500598a3ef1 service nova] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Received event network-vif-unplugged-0ed2dfa0-2fb5-4493-91e8-597b70a39c6b {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:39.936775 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8da23f80-44cb-44e2-ae5b-2772205fa025 req-b6e8d4e1-ed88-46ff-8218-2500598a3ef1 service nova] Acquiring lock "e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:39.937265 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8da23f80-44cb-44e2-ae5b-2772205fa025 req-b6e8d4e1-ed88-46ff-8218-2500598a3ef1 service nova] Lock "e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:39.937498 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8da23f80-44cb-44e2-ae5b-2772205fa025 req-b6e8d4e1-ed88-46ff-8218-2500598a3ef1 service nova] Lock "e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:39.938319 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8da23f80-44cb-44e2-ae5b-2772205fa025 req-b6e8d4e1-ed88-46ff-8218-2500598a3ef1 service nova] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] No waiting events found dispatching network-vif-unplugged-0ed2dfa0-2fb5-4493-91e8-597b70a39c6b {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:02:39.938408 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8da23f80-44cb-44e2-ae5b-2772205fa025 req-b6e8d4e1-ed88-46ff-8218-2500598a3ef1 service nova] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Received event network-vif-unplugged-0ed2dfa0-2fb5-4493-91e8-597b70a39c6b for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:02:39.992797 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea, portal: 192.168.40.100,3260]
May 28 10:02:39.992797 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea, portal: 192.168.40.100,3260] successful.
May 28 10:02:39.992797 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:39.993193 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:40.006134 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea, portal: 192.168.50.100,3260]
May 28 10:02:40.006134 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea, portal: 192.168.50.100,3260] successful.
May 28 10:02:40.006134 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:40.009136 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:40.015803 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.99972069100022 future=<Future at 0x73c1f42130e0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:02:40.016272 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:40.018353 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Instance destroyed successfully.
May 28 10:02:40.019581 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-b4d5af16-a0e0-4218-aba9-830d87a38e9f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lazy-loading 'resources' on Instance uuid e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:40.029387 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:40.044625 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:40.044625 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:40.044625 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:40.044625 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:40.044625 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:40.044625 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:40.044625 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:40.044625 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:40.044625 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:40.044625 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:40.044625 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:40.044625 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:40.044625 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:40.044625 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:40.044625 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:40.044625 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:40.044625 np0000001613 nova-compute[98321]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:40.044625 np0000001613 nova-compute[98321]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:40.044625 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:02:40.045032 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:40.045032 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:40.045032 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:40.045032 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:40.045032 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:40.045032 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:40.045032 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:40.045032 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:40.045032 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:40.045032 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:40.045032 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:40.045032 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:40.045032 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:40.045032 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:40.045032 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:40.045032 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:40.045032 np0000001613 nova-compute[98321]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:40.045032 np0000001613 nova-compute[98321]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:40.045032 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:02:40.045349 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.223s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:02:40.045349 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:02:40.047404 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] HCTL ('23', '-', '-', 0) found on session 63 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:02:40.047404 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Scanning host 23 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:02:40.062418 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:40.062418 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:40.062418 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:40.062418 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:40.062418 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:40.062418 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:40.062418 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:40.062418 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:40.062418 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:40.062418 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:40.062418 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:40.062418 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:40.062418 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:40.062418 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:40.062418 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:40.062418 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:40.062418 np0000001613 nova-compute[98321]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:40.062418 np0000001613 nova-compute[98321]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:40.062418 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:02:40.062807 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:40.062807 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:40.062807 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:40.062807 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:40.062807 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:40.062807 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:40.062807 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:40.062807 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:40.062807 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:40.062807 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:40.062807 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:40.062807 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:40.062807 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:40.062807 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:40.062807 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:40.062807 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:40.062807 np0000001613 nova-compute[98321]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:40.062807 np0000001613 nova-compute[98321]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:40.062807 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:02:40.063148 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.237s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:02:40.063148 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:02:40.072940 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] HCTL ('24', '-', '-', 0) found on session 64 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:02:40.073148 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Scanning host 24 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:02:40.074107 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Searching for a device in session 63 and hctl ['23', '*', '*', 0] yield: sdr {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:02:40.074334 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Connected to sdr using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '305d8623-c6f8-456c-83ed-46d06c6de0ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:02:40.100485 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Searching for a device in session 64 and hctl ['24', '*', '*', 0] yield: sds {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:02:40.100621 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Connected to sds using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '305d8623-c6f8-456c-83ed-46d06c6de0ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:02:40.157939 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Object Instance<2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:02:40.158106 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lazy-loading 'keypairs' on Instance uuid 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:40.525327 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-b4d5af16-a0e0-4218-aba9-830d87a38e9f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:57:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2141670412',display_name='tempest-ServerActionsTestOtherA-server-2141670412',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serveractionstestothera-server-2141670412',id=2,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLNPaTs6CM9Wbie8XPRW8vQPbkYzxhmauw/kdujNoZe8MNOaDeh6K3tCu7L1IAoOGDytj5meJ0gvP/71uSisLwWlqhLyhBtEZHSZo7u74E1cepcGRGEWdNqJct6TYM6oQ==',key_name='tempest-keypair-320562480',keypairs=<?>,launch_index=0,launched_at=2026-05-28T09:57:55Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb3a501b4f4041ef875ef4d2b4167044',ramdisk_id='',reservation_id='r-ryp05ser',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1557455944',owner_user_name='tempest-ServerActionsTestOtherA-1557455944-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T09:57:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62efa57da85f458790f3ceeebcc777a7',uuid=e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ed2dfa0-2fb5-4493-91e8-597b70a39c6b", "address": "fa:16:3e:2d:94:a4", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed2dfa0-2f", "ovs_interfaceid": "0ed2dfa0-2fb5-4493-91e8-597b70a39c6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:02:40.525620 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-b4d5af16-a0e0-4218-aba9-830d87a38e9f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Converting VIF {"id": "0ed2dfa0-2fb5-4493-91e8-597b70a39c6b", "address": "fa:16:3e:2d:94:a4", "network": {"id": "2ae47a43-582b-442f-922d-fe7138b431a5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1771401192-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb3a501b4f4041ef875ef4d2b4167044", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed2dfa0-2f", "ovs_interfaceid": "0ed2dfa0-2fb5-4493-91e8-597b70a39c6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:02:40.526355 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-b4d5af16-a0e0-4218-aba9-830d87a38e9f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:94:a4,bridge_name='br-int',has_traffic_filtering=True,id=0ed2dfa0-2fb5-4493-91e8-597b70a39c6b,network=Network(2ae47a43-582b-442f-922d-fe7138b431a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed2dfa0-2f') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:02:40.527021 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-b4d5af16-a0e0-4218-aba9-830d87a38e9f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:94:a4,bridge_name='br-int',has_traffic_filtering=True,id=0ed2dfa0-2fb5-4493-91e8-597b70a39c6b,network=Network(2ae47a43-582b-442f-922d-fe7138b431a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed2dfa0-2f') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:02:40.530528 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:40.530822 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ed2dfa0-2f, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:02:40.533193 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:40.535601 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:02:40.539293 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:40.540769 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:40.540931 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=89cfd634-75a0-4ff6-8c12-b2d977c65cbc) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:02:40.542525 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:40.542525 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:02:40.548881 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:40.551597 np0000001613 nova-compute[98321]: INFO os_vif [None req-b4d5af16-a0e0-4218-aba9-830d87a38e9f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:94:a4,bridge_name='br-int',has_traffic_filtering=True,id=0ed2dfa0-2fb5-4493-91e8-597b70a39c6b,network=Network(2ae47a43-582b-442f-922d-fe7138b431a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed2dfa0-2f')
May 28 10:02:40.551909 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-b4d5af16-a0e0-4218-aba9-830d87a38e9f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Deleting instance files /opt/stack/data/nova/instances/e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047_del
May 28 10:02:40.552667 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-b4d5af16-a0e0-4218-aba9-830d87a38e9f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Deletion of /opt/stack/data/nova/instances/e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047_del complete
May 28 10:02:40.663057 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Object Instance<2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:02:40.666096 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:40.781301 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "de9742b9-43db-40a6-b635-81d9244fd5e0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:40.825828 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:02:40.861963 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Creating config drive at /opt/stack/data/nova/instances/2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f/disk.config.rescue
May 28 10:02:40.867183 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpg6te9b71 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:40.918557 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpg6te9b71" returned: 0 in 0.051s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:41.001974 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:02:41.001974 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:02:41.001974 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:02:41.001974 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] No VIF found with MAC fa:16:3e:05:9e:a2, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:02:41.061708 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-b4d5af16-a0e0-4218-aba9-830d87a38e9f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Took 1.39 seconds to destroy the instance on the hypervisor.
May 28 10:02:41.062345 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-b4d5af16-a0e0-4218-aba9-830d87a38e9f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:02:41.062754 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:02:41.062939 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:02:41.063464 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:41.214945 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:41.444208 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:41.486191 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:41.491138 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:41.561876 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d3cad8fd-d300-4139-b0f9-c81abeac026b req-d199b4b5-6491-4d73-8a47-069ca1761356 service nova] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Received event network-vif-deleted-0ed2dfa0-2fb5-4493-91e8-597b70a39c6b {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:41.561876 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-d3cad8fd-d300-4139-b0f9-c81abeac026b req-d199b4b5-6491-4d73-8a47-069ca1761356 service nova] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Neutron deleted interface 0ed2dfa0-2fb5-4493-91e8-597b70a39c6b; detaching it from the instance and deleting it from the info cache
May 28 10:02:41.565836 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d3cad8fd-d300-4139-b0f9-c81abeac026b req-d199b4b5-6491-4d73-8a47-069ca1761356 service nova] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Detach interface failed, port_id=0ed2dfa0-2fb5-4493-91e8-597b70a39c6b, reason: Instance e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:02:41.590653 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:41.642723 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:41.645144 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:41.849710 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Found WWN 330000000352d9acf for multipath device dm-9 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:02:41.850073 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.059s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:02:41.850267 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] <== connect_volume: return (4781ms) {'type': 'block', 'scsi_wwn': '330000000352d9acf', 'path': '/dev/dm-9', 'multipath_id': '330000000352d9acf'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:02:41.850924 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000352d9acf', 'path': '/dev/dm-9', 'multipath_id': '330000000352d9acf'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:02:41.851258 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.469s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:02:41.851655 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19', 'iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:02:41.872374 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:02:41.873443 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:02:41.874885 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:02:41.874885 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:02:41.875068 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:02:41.875379 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:02:41.880136 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "de9742b9-43db-40a6-b635-81d9244fd5e0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:41.880905 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "de9742b9-43db-40a6-b635-81d9244fd5e0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:41.881116 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Attaching volume e8aeb4ed-7738-4054-b253-74e118c84fab to /dev/vdb
May 28 10:02:41.894196 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:02:41.894196 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:41.901403 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:02:41.901403 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:41.911509 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19] added
May 28 10:02:41.911509 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:02:41.911509 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:02:41.911509 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:02:41.911509 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:02:41.911509 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:02:41.911509 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:41.911723 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:02:41.912011 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0373(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:02:41.912238 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:02:41.916917 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19] added
May 28 10:02:41.916917 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:02:41.916917 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:02:41.916917 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:02:41.916917 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:02:41.916917 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:02:41.916917 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:41.917145 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:02:41.917269 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.042(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:02:41.917447 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:02:41.942797 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:02:41.966952 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:02:41.967681 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:02:41.996982 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:42.046639 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:02:42.046848 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:02:42.059116 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:02:42.061337 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fefd:30e7', 'fe80::e4df:c0ff:fe86:6341', 'fe80::ce2:7bff:fe0e:d096', 'fe80::fc16:3eff:fedb:1077', 'fe80::fc16:3eff:fee0:9ccd', 'fe80::fc16:3eff:fe3c:b7e1', 'fe80::fc16:3eff:fe86:604b', 'fe80::fc16:3eff:fe05:9ea2', 'fe80::3037:7fff:fec8:89ce', 'fe80::fc16:3eff:fea8:9a37', 'fe80::44e2:31ff:fe81:8771', 'fe80::fc16:3eff:feaf:c736', 'fe80::24a6:e6ff:febf:f93c', 'fe80::fc16:3eff:fe24:b36a', 'fe80::fc16:3eff:fe5d:f989', 'fe80::fc16:3eff:fea3:f365', 'fe80::fc16:3eff:fee5:b9aa', 'fe80::fc16:3eff:feeb:2b41', 'fe80::8038:a7ff:fe21:5b5c', 'fe80::fc16:3eff:fed0:5ae8', 'fe80::7c9a:d6ff:fe01:2456', 'fe80::fc16:3eff:fee1:659', 'fe80::fc16:3eff:fe15:4154', 'fe80::605f:aaff:fe8d:fcdd', 'fe80::fc16:3eff:fe9e:2624', 'fe80::fc16:3eff:fe44:a72'] 
May 28 10:02:42.061553 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:02:42.061553 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:02:42.061762 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:02:42.063434 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Updating existing volume attachment record: 2fa6513e-7dc5-457b-b1be-92aac5d8c014 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:02:42.072824 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-9850fd54-89d5-437f-bfaf-87cfb372b17b req-1c6eb60c-6ab8-406b-876e-b104f22ed93e service nova] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Received event network-vif-unplugged-0ed2dfa0-2fb5-4493-91e8-597b70a39c6b {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:42.073097 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9850fd54-89d5-437f-bfaf-87cfb372b17b req-1c6eb60c-6ab8-406b-876e-b104f22ed93e service nova] Acquiring lock "e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:42.073371 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9850fd54-89d5-437f-bfaf-87cfb372b17b req-1c6eb60c-6ab8-406b-876e-b104f22ed93e service nova] Lock "e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:42.073517 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9850fd54-89d5-437f-bfaf-87cfb372b17b req-1c6eb60c-6ab8-406b-876e-b104f22ed93e service nova] Lock "e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:42.074436 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-9850fd54-89d5-437f-bfaf-87cfb372b17b req-1c6eb60c-6ab8-406b-876e-b104f22ed93e service nova] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] No waiting events found dispatching network-vif-unplugged-0ed2dfa0-2fb5-4493-91e8-597b70a39c6b {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:02:42.074436 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-9850fd54-89d5-437f-bfaf-87cfb372b17b req-1c6eb60c-6ab8-406b-876e-b104f22ed93e service nova] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Received event network-vif-unplugged-0ed2dfa0-2fb5-4493-91e8-597b70a39c6b for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:02:42.370347 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:00:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1921152164',display_name='tempest-ServerActionsTestOtherB-server-1921152164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serveractionstestotherb-server-1921152164',id=22,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGxE2KIr85UjQ+BCoXx5lmchxbSom5hESV9GE6OjN6uhpkJJULrQoc25hFxuYqlX95IN2Z2yCPiXDLbNxuH0vzgNuyZ6PJzEAoF/ugoalqeMA/O7CY5J9Uu00S0irELsQ==',key_name='tempest-keypair-993221961',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:02:18Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001613',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='11e1727c7fbc44459c6972d182fc25b1',ramdisk_id='',reservation_id='r-v5rhfg8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-634969206',owner_user_name='tempest-ServerActionsTestOtherB-634969206-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:02:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11b9cab1ceef4e4b8cba521b61ad3f55',uuid=b90b1ecd-e640-4f4e-bd02-fb74021db82b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "address": "fa:16:3e:b1:88:d2", "network": {"id": "9d46c174-21e3-464e-83c9-e8db18f486a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-151012625-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e1727c7fbc44459c6972d182fc25b1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a01cd4-8a", "ovs_interfaceid": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:02:42.370347 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Converting VIF {"id": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "address": "fa:16:3e:b1:88:d2", "network": {"id": "9d46c174-21e3-464e-83c9-e8db18f486a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-151012625-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e1727c7fbc44459c6972d182fc25b1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a01cd4-8a", "ovs_interfaceid": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:02:42.371478 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:88:d2,bridge_name='br-int',has_traffic_filtering=True,id=11a01cd4-8a62-4e25-b303-ac907a1aa4c3,network=Network(9d46c174-21e3-464e-83c9-e8db18f486a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a01cd4-8a') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:02:42.373371 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] End _get_guest_xml xml=<domain type="qemu">
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:   <uuid>b90b1ecd-e640-4f4e-bd02-fb74021db82b</uuid>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:   <name>instance-00000016</name>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:       <nova:name>tempest-ServerActionsTestOtherB-server-1921152164</nova:name>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:02:36</nova:creationTime>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:         <nova:user uuid="11b9cab1ceef4e4b8cba521b61ad3f55">tempest-ServerActionsTestOtherB-634969206-project-member</nova:user>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:         <nova:project uuid="11e1727c7fbc44459c6972d182fc25b1">tempest-ServerActionsTestOtherB-634969206</nova:project>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:         <nova:port uuid="11a01cd4-8a62-4e25-b303-ac907a1aa4c3">
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:     <system>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:       <entry name="serial">b90b1ecd-e640-4f4e-bd02-fb74021db82b</entry>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:       <entry name="uuid">b90b1ecd-e640-4f4e-bd02-fb74021db82b</entry>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:     </system>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:   <os>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:   </os>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:   <features>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:   </features>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:   <devices>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk"/>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:     </disk>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/disk.config"/>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:     </disk>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:       <alias name="ua-305d8623-c6f8-456c-83ed-46d06c6de0ea"/>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-9"/>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:       <target dev="vdb" bus="virtio"/>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:       <serial>305d8623-c6f8-456c-83ed-46d06c6de0ea</serial>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:     </disk>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:b1:88:d2"/>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:       <target dev="tap11a01cd4-8a"/>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:     </interface>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b/console.log" append="off"/>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:     </serial>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:     <video>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:     </video>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:     </rng>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:   </devices>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]: </domain>
May 28 10:02:42.373371 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:02:42.376151 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Preparing to wait for external event network-vif-plugged-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:02:42.376151 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Acquiring lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:42.376151 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:42.376151 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:42.376151 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:00:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1921152164',display_name='tempest-ServerActionsTestOtherB-server-1921152164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serveractionstestotherb-server-1921152164',id=22,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGxE2KIr85UjQ+BCoXx5lmchxbSom5hESV9GE6OjN6uhpkJJULrQoc25hFxuYqlX95IN2Z2yCPiXDLbNxuH0vzgNuyZ6PJzEAoF/ugoalqeMA/O7CY5J9Uu00S0irELsQ==',key_name='tempest-keypair-993221961',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:02:18Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001613',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='11e1727c7fbc44459c6972d182fc25b1',ramdisk_id='',reservation_id='r-v5rhfg8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-634969206',owner_user_name='tempest-ServerActionsTestOtherB-634969206-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:02:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11b9cab1ceef4e4b8cba521b61ad3f55',uuid=b90b1ecd-e640-4f4e-bd02-fb74021db82b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "address": "fa:16:3e:b1:88:d2", "network": {"id": "9d46c174-21e3-464e-83c9-e8db18f486a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-151012625-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e1727c7fbc44459c6972d182fc25b1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a01cd4-8a", "ovs_interfaceid": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:02:42.376151 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Converting VIF {"id": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "address": "fa:16:3e:b1:88:d2", "network": {"id": "9d46c174-21e3-464e-83c9-e8db18f486a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-151012625-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e1727c7fbc44459c6972d182fc25b1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a01cd4-8a", "ovs_interfaceid": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:02:42.376151 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:88:d2,bridge_name='br-int',has_traffic_filtering=True,id=11a01cd4-8a62-4e25-b303-ac907a1aa4c3,network=Network(9d46c174-21e3-464e-83c9-e8db18f486a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a01cd4-8a') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:02:42.376151 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:88:d2,bridge_name='br-int',has_traffic_filtering=True,id=11a01cd4-8a62-4e25-b303-ac907a1aa4c3,network=Network(9d46c174-21e3-464e-83c9-e8db18f486a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a01cd4-8a') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:02:42.377833 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:42.377833 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:02:42.377833 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:02:42.380092 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:42.380092 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e920fbcb-3653-5b58-894a-5da8e2591c0d', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:02:42.381756 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:42.381756 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:02:42.382748 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:42.386620 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:42.386620 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11a01cd4-8a, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:02:42.386620 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap11a01cd4-8a, col_values=(('qos', UUID('6eb1edd1-ea9f-4373-8077-7053d97dcc29')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:02:42.386620 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap11a01cd4-8a, col_values=(('external_ids', {'iface-id': '11a01cd4-8a62-4e25-b303-ac907a1aa4c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:88:d2', 'vm-uuid': 'b90b1ecd-e640-4f4e-bd02-fb74021db82b'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:02:42.389628 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:42.389628 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:02:42.397634 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:42.398125 np0000001613 nova-compute[98321]: INFO os_vif [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:88:d2,bridge_name='br-int',has_traffic_filtering=True,id=11a01cd4-8a62-4e25-b303-ac907a1aa4c3,network=Network(9d46c174-21e3-464e-83c9-e8db18f486a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a01cd4-8a')
May 28 10:02:42.402482 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Removed pending STOPPED event for 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f due to new event <LifecycleEvent: 1779962562.4020925, 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f => Resumed> {{(pid=98321) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 10:02:42.402671 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962562.4020925, 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:02:42.402822 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] VM Resumed (Lifecycle Event)
May 28 10:02:42.404810 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-cdf03986-3967-450f-ae52-443cd6ded78d tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:02:42.471341 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Took 1.41 seconds to deallocate network for instance.
May 28 10:02:42.592885 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-22ad4e27-5b9b-417d-bfad-623c337cd468 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.029s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:42.629132 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:02:42.629685 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e8aeb4ed-7738-4054-b253-74e118c84fab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:02:42.630129 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:02:42.908028 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:02:42.914713 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:02:42.919031 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:42.925907 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:02:42.944179 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:02:42.963119 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:02:42.963119 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:02:42.971420 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:02:42.971420 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:42.981399 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b4d5af16-a0e0-4218-aba9-830d87a38e9f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:42.987636 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b4d5af16-a0e0-4218-aba9-830d87a38e9f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:42.987636 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:43.006950 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:43.037502 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:43.037502 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:43.037502 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:43.037502 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:43.037502 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:43.037502 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:43.037502 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:43.037502 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:43.037502 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:43.037502 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:43.037502 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:43.037502 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:43.037502 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:43.037502 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:43.037502 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:43.037502 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:43.037502 np0000001613 nova-compute[98321]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:43.037502 np0000001613 nova-compute[98321]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:43.037502 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:02:43.037502 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:43.037502 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:43.037502 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:43.037502 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:43.037502 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:43.037502 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:43.037502 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:43.037502 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:43.037502 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:43.037502 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:43.037502 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:43.037502 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:43.037502 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:43.037502 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:43.037502 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:43.037502 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:43.037502 np0000001613 nova-compute[98321]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:43.037502 np0000001613 nova-compute[98321]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:43.037502 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:02:43.047006 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:43.047006 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:43.047006 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:43.047006 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:43.047006 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:43.047006 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:43.047006 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:43.047006 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:43.047006 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:43.047006 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:43.047006 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:43.047006 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:43.047006 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:43.047006 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:43.047006 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:43.047006 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:43.047006 np0000001613 nova-compute[98321]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:43.047006 np0000001613 nova-compute[98321]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:43.047006 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:02:43.047006 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:43.047006 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:43.047006 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:43.047006 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:43.047006 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:43.047006 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:43.047006 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:43.047006 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:43.047006 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:43.047006 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:43.047006 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:43.047006 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:43.047006 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:43.047006 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:43.047006 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:43.047006 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:43.047006 np0000001613 nova-compute[98321]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:43.047006 np0000001613 nova-compute[98321]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:43.047006 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:02:43.091214 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:43.154487 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19, portal: 192.168.40.100,3260]
May 28 10:02:43.154487 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19, portal: 192.168.40.100,3260] successful.
May 28 10:02:43.154487 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:43.169857 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19, portal: 192.168.50.100,3260]
May 28 10:02:43.169857 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19, portal: 192.168.50.100,3260] successful.
May 28 10:02:43.169857 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:43.184017 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:43.194745 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:43.223824 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:43.223824 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:43.223824 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:43.223824 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:43.223824 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:43.223824 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:43.223824 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:43.223824 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:43.223824 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:43.223824 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:43.223824 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:43.223824 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:43.223824 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:43.223824 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:43.223824 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:43.223824 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:43.223824 np0000001613 nova-compute[98321]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:43.223824 np0000001613 nova-compute[98321]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:43.223824 np0000001613 nova-compute[98321]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19 (non-flash)
May 28 10:02:43.223824 np0000001613 nova-compute[98321]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19 (non-flash)
May 28 10:02:43.223824 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:02:43.225004 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:43.225004 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:43.225004 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:43.225004 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:43.225004 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:43.225004 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:43.225004 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:43.225004 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:43.225004 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:43.225004 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:43.225004 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:43.225004 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:43.225004 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:43.225004 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:43.225004 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:43.225004 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:43.225004 np0000001613 nova-compute[98321]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:43.225004 np0000001613 nova-compute[98321]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:43.225004 np0000001613 nova-compute[98321]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19 (non-flash)
May 28 10:02:43.225004 np0000001613 nova-compute[98321]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19 (non-flash)
May 28 10:02:43.225004 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:02:43.225004 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.349s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:02:43.225004 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:02:43.231249 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:43.231249 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:43.231249 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:43.231249 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:43.231249 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:43.231249 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:43.231249 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:43.231249 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:43.231249 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:43.231249 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:43.231249 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:43.231249 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:43.231249 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:43.231249 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:43.231249 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:43.231249 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:43.231249 np0000001613 nova-compute[98321]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:43.231249 np0000001613 nova-compute[98321]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:43.231249 np0000001613 nova-compute[98321]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19 (non-flash)
May 28 10:02:43.231249 np0000001613 nova-compute[98321]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19 (non-flash)
May 28 10:02:43.231249 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:02:43.231249 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:43.231249 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:43.231249 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:43.231249 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:43.231249 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:43.231249 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:43.231249 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:43.231249 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:43.231249 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:43.231249 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:43.231249 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:43.231249 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:43.231249 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:43.231249 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:43.231249 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:43.231249 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:43.231249 np0000001613 nova-compute[98321]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:43.231249 np0000001613 nova-compute[98321]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:43.231249 np0000001613 nova-compute[98321]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19 (non-flash)
May 28 10:02:43.231249 np0000001613 nova-compute[98321]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19 (non-flash)
May 28 10:02:43.231249 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:02:43.231249 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.357s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:02:43.233431 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:02:43.233431 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] HCTL ('25', '-', '-', 0) found on session 65 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:02:43.233431 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Scanning host 25 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:02:43.235723 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] HCTL ('26', '-', '-', 0) found on session 66 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:02:43.236349 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Scanning host 26 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:02:43.280666 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Searching for a device in session 66 and hctl ['26', '*', '*', 0] yield: sdu {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:02:43.280666 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Connected to sdu using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:02:43.280666 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Searching for a device in session 65 and hctl ['25', '*', '*', 0] yield: sdt {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:02:43.280666 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Connected to sdt using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:02:43.466915 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962563.4649243, 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:02:43.466915 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] VM Started (Lifecycle Event)
May 28 10:02:43.483660 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:43.496682 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:43.525134 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:43.691293 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6e93a3de-8d9e-4f5c-b62f-4df45ebdf36c req-ae8d71bc-bd02-4bee-bae1-70284c302c7d service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Received event network-vif-plugged-4edd294f-7bb5-46ec-9cdc-c8683088408c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:43.692701 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6e93a3de-8d9e-4f5c-b62f-4df45ebdf36c req-ae8d71bc-bd02-4bee-bae1-70284c302c7d service nova] Acquiring lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:43.692901 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6e93a3de-8d9e-4f5c-b62f-4df45ebdf36c req-ae8d71bc-bd02-4bee-bae1-70284c302c7d service nova] Lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:43.693700 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6e93a3de-8d9e-4f5c-b62f-4df45ebdf36c req-ae8d71bc-bd02-4bee-bae1-70284c302c7d service nova] Lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:43.693802 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6e93a3de-8d9e-4f5c-b62f-4df45ebdf36c req-ae8d71bc-bd02-4bee-bae1-70284c302c7d service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] No waiting events found dispatching network-vif-plugged-4edd294f-7bb5-46ec-9cdc-c8683088408c {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:02:43.693917 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-6e93a3de-8d9e-4f5c-b62f-4df45ebdf36c req-ae8d71bc-bd02-4bee-bae1-70284c302c7d service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Received unexpected event network-vif-plugged-4edd294f-7bb5-46ec-9cdc-c8683088408c for instance with vm_state rescued and task_state None.
May 28 10:02:43.694513 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6e93a3de-8d9e-4f5c-b62f-4df45ebdf36c req-ae8d71bc-bd02-4bee-bae1-70284c302c7d service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Received event network-vif-plugged-4edd294f-7bb5-46ec-9cdc-c8683088408c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:43.694513 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6e93a3de-8d9e-4f5c-b62f-4df45ebdf36c req-ae8d71bc-bd02-4bee-bae1-70284c302c7d service nova] Acquiring lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:43.694513 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6e93a3de-8d9e-4f5c-b62f-4df45ebdf36c req-ae8d71bc-bd02-4bee-bae1-70284c302c7d service nova] Lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:43.699458 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6e93a3de-8d9e-4f5c-b62f-4df45ebdf36c req-ae8d71bc-bd02-4bee-bae1-70284c302c7d service nova] Lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:43.699458 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6e93a3de-8d9e-4f5c-b62f-4df45ebdf36c req-ae8d71bc-bd02-4bee-bae1-70284c302c7d service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] No waiting events found dispatching network-vif-plugged-4edd294f-7bb5-46ec-9cdc-c8683088408c {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:02:43.699458 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-6e93a3de-8d9e-4f5c-b62f-4df45ebdf36c req-ae8d71bc-bd02-4bee-bae1-70284c302c7d service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Received unexpected event network-vif-plugged-4edd294f-7bb5-46ec-9cdc-c8683088408c for instance with vm_state rescued and task_state None.
May 28 10:02:43.749606 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8511a430-aa7d-4723-a940-2a0105c97b38 req-43dc9aac-e8b0-4aa9-adcf-acd214e09370 service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Received event network-vif-plugged-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:43.749775 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8511a430-aa7d-4723-a940-2a0105c97b38 req-43dc9aac-e8b0-4aa9-adcf-acd214e09370 service nova] Acquiring lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:43.753600 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8511a430-aa7d-4723-a940-2a0105c97b38 req-43dc9aac-e8b0-4aa9-adcf-acd214e09370 service nova] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:43.753827 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8511a430-aa7d-4723-a940-2a0105c97b38 req-43dc9aac-e8b0-4aa9-adcf-acd214e09370 service nova] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:43.754014 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8511a430-aa7d-4723-a940-2a0105c97b38 req-43dc9aac-e8b0-4aa9-adcf-acd214e09370 service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Processing event network-vif-plugged-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:02:43.875156 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:02:43.973307 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:02:43.977016 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:02:44.111223 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b4d5af16-a0e0-4218-aba9-830d87a38e9f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:02:44.111689 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-b4d5af16-a0e0-4218-aba9-830d87a38e9f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:02:44.142638 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Rescuing
May 28 10:02:44.142638 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Acquiring lock "refresh_cache-4baa35bb-b237-42be-aa8b-d9eeed7e41a0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:02:44.142638 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Acquired lock "refresh_cache-4baa35bb-b237-42be-aa8b-d9eeed7e41a0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:02:44.142638 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:02:44.189492 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:02:44.193241 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Instance running successfully.
May 28 10:02:44.193564 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] finish_revert_migration finished successfully. {{(pid=98321) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12978}}
May 28 10:02:44.390644 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:44.478213 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-4e60ed6e-6ccf-466c-aafe-cf8d06142ad5 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Unrescuing
May 28 10:02:44.478432 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4e60ed6e-6ccf-466c-aafe-cf8d06142ad5 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "refresh_cache-2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:02:44.478607 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4e60ed6e-6ccf-466c-aafe-cf8d06142ad5 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquired lock "refresh_cache-2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:02:44.478783 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-4e60ed6e-6ccf-466c-aafe-cf8d06142ad5 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:02:44.480311 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 28 10:02:44.481189 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962564.480703, b90b1ecd-e640-4f4e-bd02-fb74021db82b => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:02:44.481189 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] VM Started (Lifecycle Event)
May 28 10:02:44.615229 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-b4d5af16-a0e0-4218-aba9-830d87a38e9f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:02:44.644103 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:44.895836 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Found WWN 3300000002aa2c815 for multipath device dm-14 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:02:44.896260 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.045s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:02:44.896383 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] <== connect_volume: return (5514ms) {'type': 'block', 'scsi_wwn': '3300000002aa2c815', 'path': '/dev/dm-14', 'multipath_id': '3300000002aa2c815'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:02:44.896604 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002aa2c815', 'path': '/dev/dm-14', 'multipath_id': '3300000002aa2c815'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:02:44.897630 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.267s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:02:44.897975 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e8aeb4ed-7738-4054-b253-74e118c84fab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:02:44.906304 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lazy-loading 'flavor' on Instance uuid be4a8d87-07fc-4c56-a68d-c95e98e99184 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:44.915370 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:02:44.915370 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:02:44.915637 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:02:44.915712 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:02:44.916611 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:02:44.916611 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.startup = automatic
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.session.scan = manual
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:02:44.933879 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:02:44.933879 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.startup = automatic
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.session.scan = manual
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:02:44.937640 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:02:44.937640 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:44.954698 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:44.962371 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:44.985334 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-4e60ed6e-6ccf-466c-aafe-cf8d06142ad5 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:44.988143 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:02:44.995346 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:44.995346 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:44.995346 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:44.995346 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:44.995346 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:44.995346 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:44.995346 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:44.995346 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:44.995346 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:44.995346 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:44.995346 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:44.995346 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:44.995346 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:44.995346 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:44.995346 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:44.995346 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:44.995346 np0000001613 nova-compute[98321]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:44.995346 np0000001613 nova-compute[98321]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:44.995346 np0000001613 nova-compute[98321]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19 (non-flash)
May 28 10:02:44.995346 np0000001613 nova-compute[98321]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19 (non-flash)
May 28 10:02:44.995346 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:02:44.997020 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:44.997020 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:44.997020 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:44.997020 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:44.997020 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:44.997020 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:44.997020 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:44.997020 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:44.997020 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:44.997020 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:44.997020 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:44.997020 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:44.997020 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:44.997020 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:44.997020 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:44.997020 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:44.997020 np0000001613 nova-compute[98321]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:44.997020 np0000001613 nova-compute[98321]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:44.997020 np0000001613 nova-compute[98321]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19 (non-flash)
May 28 10:02:44.997020 np0000001613 nova-compute[98321]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19 (non-flash)
May 28 10:02:44.997020 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:02:44.999050 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:02:45.005265 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.082s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19 (non-flash)
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19 (non-flash)
May 28 10:02:45.010236 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19 (non-flash)
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19 (non-flash)
May 28 10:02:45.010236 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.093s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] HCTL ('11', '0', '0', 0) found on session 59 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:02:45.010236 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Scanning host 11 c: 0, t: 0, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:02:45.014506 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:02:45.014506 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] HCTL ('12', '0', '0', 0) found on session 60 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:02:45.014506 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Scanning host 12 c: 0, t: 0, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:02:45.037273 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Searching for a device in session 59 and hctl ('11', '0', '0', 0) yield: sdf {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:02:45.037273 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e8aeb4ed-7738-4054-b253-74e118c84fab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:02:45.041583 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Searching for a device in session 60 and hctl ('12', '0', '0', 0) yield: sdg {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:02:45.041791 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e8aeb4ed-7738-4054-b253-74e118c84fab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:02:45.067219 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:45.121242 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b4d5af16-a0e0-4218-aba9-830d87a38e9f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.139s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:45.198784 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-b4d5af16-a0e0-4218-aba9-830d87a38e9f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Deleted allocations for instance e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047
May 28 10:02:45.268883 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-bc21693b-b1d5-4624-9945-8a1c3e99a343 tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Updating instance to original state: 'active'
May 28 10:02:45.280679 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Updating instance_info_cache with network_info: [{"id": "a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39", "address": "fa:16:3e:05:9e:a2", "network": {"id": "2b7ff7fb-07d6-4791-9553-cb0a7a073e10", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2104350241-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12b4f42e155347e4a2055b151f04390a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f414a0-04", "ovs_interfaceid": "a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:02:45.413867 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Attempting to attach volume 1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 10:02:45.415568 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] attach device xml: <disk type="block" device="disk">
May 28 10:02:45.415568 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:02:45.415568 np0000001613 nova-compute[98321]:   <alias name="ua-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19"/>
May 28 10:02:45.415568 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-14"/>
May 28 10:02:45.415568 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:02:45.415568 np0000001613 nova-compute[98321]:   <serial>1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19</serial>
May 28 10:02:45.415568 np0000001613 nova-compute[98321]: </disk>
May 28 10:02:45.415568 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 10:02:45.479679 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-4e60ed6e-6ccf-466c-aafe-cf8d06142ad5 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:45.508037 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] During sync_power_state the instance has a pending task (resize_reverting). Skip.
May 28 10:02:45.508316 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962565.5081158, b90b1ecd-e640-4f4e-bd02-fb74021db82b => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:02:45.508489 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] VM Paused (Lifecycle Event)
May 28 10:02:45.674300 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-4e60ed6e-6ccf-466c-aafe-cf8d06142ad5 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Updating instance_info_cache with network_info: [{"id": "4edd294f-7bb5-46ec-9cdc-c8683088408c", "address": "fa:16:3e:44:0a:72", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4edd294f-7b", "ovs_interfaceid": "4edd294f-7bb5-46ec-9cdc-c8683088408c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:02:45.786705 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Releasing lock "refresh_cache-4baa35bb-b237-42be-aa8b-d9eeed7e41a0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:02:45.834455 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b7cabd9f-7ab5-4e5a-bec2-b7c634fafa46 req-0b7c255b-31bf-4fc2-b12e-8c33b97b86d4 service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Received event network-vif-plugged-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:45.834455 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b7cabd9f-7ab5-4e5a-bec2-b7c634fafa46 req-0b7c255b-31bf-4fc2-b12e-8c33b97b86d4 service nova] Acquiring lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:45.834455 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b7cabd9f-7ab5-4e5a-bec2-b7c634fafa46 req-0b7c255b-31bf-4fc2-b12e-8c33b97b86d4 service nova] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:45.834455 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b7cabd9f-7ab5-4e5a-bec2-b7c634fafa46 req-0b7c255b-31bf-4fc2-b12e-8c33b97b86d4 service nova] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:45.834455 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b7cabd9f-7ab5-4e5a-bec2-b7c634fafa46 req-0b7c255b-31bf-4fc2-b12e-8c33b97b86d4 service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] No waiting events found dispatching network-vif-plugged-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:02:45.834455 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-b7cabd9f-7ab5-4e5a-bec2-b7c634fafa46 req-0b7c255b-31bf-4fc2-b12e-8c33b97b86d4 service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Received unexpected event network-vif-plugged-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 for instance with vm_state active and task_state None.
May 28 10:02:45.917170 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:02:46.010807 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:02:46.012699 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962566.0124676, b90b1ecd-e640-4f4e-bd02-fb74021db82b => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:02:46.012855 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] VM Resumed (Lifecycle Event)
May 28 10:02:46.176410 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4e60ed6e-6ccf-466c-aafe-cf8d06142ad5 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Releasing lock "refresh_cache-2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:02:46.177976 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-4e60ed6e-6ccf-466c-aafe-cf8d06142ad5 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lazy-loading 'flavor' on Instance uuid 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:46.210864 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b4d5af16-a0e0-4218-aba9-830d87a38e9f tempest-ServerActionsTestOtherA-1557455944 tempest-ServerActionsTestOtherA-1557455944-project-member] Lock "e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.042s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:46.519123 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:02:46.521088 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:02:46.592647 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.00042885199991360423 future=<Future at 0x73c1f470d670 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:02:46.592808 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:02:46.594215 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=2.803312515000016 future=<Future at 0x73c1fc13dd90 state=cancelled>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:02:46.594767 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=2.8017670610001915 future=<Future at 0x73c1fc13dd90 state=cancelled>) was cancelled while queued, skipping {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:02:46.595378 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Emitting event <LifecycleEvent: 1779962551.5921004, 49f53c82-6f7e-4d09-a471-26bd4fdc02e7 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:02:46.595632 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] VM Stopped (Lifecycle Event)
May 28 10:02:46.597300 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:02:46.600298 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=8.415217091000159 future=<Future at 0x73c1f42130e0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:02:46.600546 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=8.415081438000016 future=<Future at 0x73c1f42130e0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:02:46.720454 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:46.743398 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:46.912949 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:46.923038 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:46.937202 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Found WWN 330000000a8b99648 for multipath device dm-1 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:02:46.937202 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.040s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:02:46.938947 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] <== connect_volume: return (4308ms) {'type': 'block', 'scsi_wwn': '330000000a8b99648', 'path': '/dev/dm-1', 'multipath_id': '330000000a8b99648'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:02:46.938947 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a8b99648', 'path': '/dev/dm-1', 'multipath_id': '330000000a8b99648'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:02:46.945900 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lazy-loading 'flavor' on Instance uuid de9742b9-43db-40a6-b635-81d9244fd5e0 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:46.950568 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a176f0d7-aa79-4e53-b587-5ff789c7ba29 req-8519e307-15d9-4f1c-b4ca-1eef1f1c19ea service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Received event network-vif-unplugged-4edd294f-7bb5-46ec-9cdc-c8683088408c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:46.950725 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a176f0d7-aa79-4e53-b587-5ff789c7ba29 req-8519e307-15d9-4f1c-b4ca-1eef1f1c19ea service nova] Acquiring lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:46.952317 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a176f0d7-aa79-4e53-b587-5ff789c7ba29 req-8519e307-15d9-4f1c-b4ca-1eef1f1c19ea service nova] Lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:46.953050 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a176f0d7-aa79-4e53-b587-5ff789c7ba29 req-8519e307-15d9-4f1c-b4ca-1eef1f1c19ea service nova] Lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:46.955499 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a176f0d7-aa79-4e53-b587-5ff789c7ba29 req-8519e307-15d9-4f1c-b4ca-1eef1f1c19ea service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] No waiting events found dispatching network-vif-unplugged-4edd294f-7bb5-46ec-9cdc-c8683088408c {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:02:46.955696 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-a176f0d7-aa79-4e53-b587-5ff789c7ba29 req-8519e307-15d9-4f1c-b4ca-1eef1f1c19ea service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Received unexpected event network-vif-unplugged-4edd294f-7bb5-46ec-9cdc-c8683088408c for instance with vm_state rescued and task_state unrescuing.
May 28 10:02:47.032529 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:47.047663 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:47.077416 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999639169000147 future=<Future at 0x73c1fc5eff50 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:02:47.083881 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Instance destroyed successfully.
May 28 10:02:47.083966 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-4e60ed6e-6ccf-466c-aafe-cf8d06142ad5 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lazy-loading 'numa_topology' on Instance uuid 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:47.094266 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:02:47.094266 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:02:47.094266 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:02:47.094266 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] No VIF found with MAC fa:16:3e:a8:9a:37, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:02:47.101882 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 49f53c82-6f7e-4d09-a471-26bd4fdc02e7] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:02:47.387871 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:47.430704 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Acquiring lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:47.430704 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:47.430704 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Acquiring lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:47.430704 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:47.430704 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:47.432856 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Terminating instance
May 28 10:02:47.435663 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:47.443988 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:47.450818 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Attempting to attach volume e8aeb4ed-7738-4054-b253-74e118c84fab with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 10:02:47.458785 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] attach device xml: <disk type="block" device="disk">
May 28 10:02:47.458785 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:02:47.458785 np0000001613 nova-compute[98321]:   <alias name="ua-e8aeb4ed-7738-4054-b253-74e118c84fab"/>
May 28 10:02:47.458785 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-1"/>
May 28 10:02:47.458785 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:02:47.458785 np0000001613 nova-compute[98321]:   <serial>e8aeb4ed-7738-4054-b253-74e118c84fab</serial>
May 28 10:02:47.458785 np0000001613 nova-compute[98321]:   <shareable/>
May 28 10:02:47.458785 np0000001613 nova-compute[98321]: </disk>
May 28 10:02:47.458785 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 10:02:47.469074 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:47.503099 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:47.593060 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-4e60ed6e-6ccf-466c-aafe-cf8d06142ad5 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Object Instance<2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f> lazy-loaded attributes: flavor,numa_topology {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:02:47.740220 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:47.783259 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:47.793071 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:47.810912 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-dc32ef89-07cf-4162-8efd-25af79e548bc req-474ced74-d1c2-4a65-a0de-b4624dae9212 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Received event network-vif-unplugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:47.810912 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-dc32ef89-07cf-4162-8efd-25af79e548bc req-474ced74-d1c2-4a65-a0de-b4624dae9212 service nova] Acquiring lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:47.817692 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-dc32ef89-07cf-4162-8efd-25af79e548bc req-474ced74-d1c2-4a65-a0de-b4624dae9212 service nova] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:47.817692 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-dc32ef89-07cf-4162-8efd-25af79e548bc req-474ced74-d1c2-4a65-a0de-b4624dae9212 service nova] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:47.817692 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-dc32ef89-07cf-4162-8efd-25af79e548bc req-474ced74-d1c2-4a65-a0de-b4624dae9212 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] No waiting events found dispatching network-vif-unplugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:02:47.817692 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-dc32ef89-07cf-4162-8efd-25af79e548bc req-474ced74-d1c2-4a65-a0de-b4624dae9212 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Received unexpected event network-vif-unplugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 for instance with vm_state active and task_state rescuing.
May 28 10:02:47.817692 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:47.950099 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:02:47.997025 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:48.000622 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:48.023579 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:48.049191 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999672532000204 future=<Future at 0x73c1f4093b90 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:02:48.049191 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Instance destroyed successfully.
May 28 10:02:48.050134 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lazy-loading 'numa_topology' on Instance uuid 4baa35bb-b237-42be-aa8b-d9eeed7e41a0 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:48.215866 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e076c1f9-a775-4a9d-ade3-c3cf206a55b1 req-db727f40-ed8c-4a01-9241-39db1268e951 service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Received event network-vif-unplugged-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:48.216063 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e076c1f9-a775-4a9d-ade3-c3cf206a55b1 req-db727f40-ed8c-4a01-9241-39db1268e951 service nova] Acquiring lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:48.216235 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e076c1f9-a775-4a9d-ade3-c3cf206a55b1 req-db727f40-ed8c-4a01-9241-39db1268e951 service nova] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:48.216417 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e076c1f9-a775-4a9d-ade3-c3cf206a55b1 req-db727f40-ed8c-4a01-9241-39db1268e951 service nova] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:48.217295 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e076c1f9-a775-4a9d-ade3-c3cf206a55b1 req-db727f40-ed8c-4a01-9241-39db1268e951 service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] No waiting events found dispatching network-vif-unplugged-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:02:48.217514 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e076c1f9-a775-4a9d-ade3-c3cf206a55b1 req-db727f40-ed8c-4a01-9241-39db1268e951 service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Received event network-vif-unplugged-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:02:48.252126 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:48.270488 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:48.280125 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:48.324644 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:48.341592 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:48.443536 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.998531078999804 future=<Future at 0x73c1fc6ab4a0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:02:48.454150 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Instance destroyed successfully.
May 28 10:02:48.454670 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lazy-loading 'resources' on Instance uuid b90b1ecd-e640-4f4e-bd02-fb74021db82b {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:48.462225 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:48.503104 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:48.505949 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:48.561071 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:48.564843 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Attempting a stable device rescue
May 28 10:02:48.596677 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:48.627202 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:48.660898 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:48.661471 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:48.675932 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2814ec97-1059-4afe-b24a-a7279708a5d6 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "be4a8d87-07fc-4c56-a68d-c95e98e99184" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.049s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:48.700272 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=98321) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 28 10:02:48.713925 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Instance directory exists: not creating {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 10:02:48.714067 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Creating image(s)
May 28 10:02:48.715230 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Acquiring lock "/opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:48.715230 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "/opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:48.715528 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "/opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:48.715741 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4baa35bb-b237-42be-aa8b-d9eeed7e41a0 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:48.793221 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:02:48.794304 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:02:48.888855 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:48.898375 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:48.960324 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:00:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1921152164',display_name='tempest-ServerActionsTestOtherB-server-1921152164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serveractionstestotherb-server-1921152164',id=22,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGxE2KIr85UjQ+BCoXx5lmchxbSom5hESV9GE6OjN6uhpkJJULrQoc25hFxuYqlX95IN2Z2yCPiXDLbNxuH0vzgNuyZ6PJzEAoF/ugoalqeMA/O7CY5J9Uu00S0irELsQ==',key_name='tempest-keypair-993221961',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:02:44Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11e1727c7fbc44459c6972d182fc25b1',ramdisk_id='',reservation_id='r-v5rhfg8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-634969206',owner_user_name='tempest-ServerActionsTestOtherB-634969206-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:02:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11b9cab1ceef4e4b8cba521b61ad3f55',uuid=b90b1ecd-e640-4f4e-bd02-fb74021db82b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "address": "fa:16:3e:b1:88:d2", "network": {"id": "9d46c174-21e3-464e-83c9-e8db18f486a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-151012625-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e1727c7fbc44459c6972d182fc25b1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a01cd4-8a", "ovs_interfaceid": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:02:48.961312 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Converting VIF {"id": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "address": "fa:16:3e:b1:88:d2", "network": {"id": "9d46c174-21e3-464e-83c9-e8db18f486a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-151012625-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e1727c7fbc44459c6972d182fc25b1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a01cd4-8a", "ovs_interfaceid": "11a01cd4-8a62-4e25-b303-ac907a1aa4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:02:48.962513 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:88:d2,bridge_name='br-int',has_traffic_filtering=True,id=11a01cd4-8a62-4e25-b303-ac907a1aa4c3,network=Network(9d46c174-21e3-464e-83c9-e8db18f486a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a01cd4-8a') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:02:48.962674 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:88:d2,bridge_name='br-int',has_traffic_filtering=True,id=11a01cd4-8a62-4e25-b303-ac907a1aa4c3,network=Network(9d46c174-21e3-464e-83c9-e8db18f486a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a01cd4-8a') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:02:48.965008 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:48.965284 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11a01cd4-8a, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:02:48.966467 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:48.967248 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:02:48.975470 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:48.977827 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:48.978022 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6eb1edd1-ea9f-4373-8077-7053d97dcc29) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:02:48.978613 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:48.979241 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:02:48.987661 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:48.991415 np0000001613 nova-compute[98321]: INFO os_vif [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:88:d2,bridge_name='br-int',has_traffic_filtering=True,id=11a01cd4-8a62-4e25-b303-ac907a1aa4c3,network=Network(9d46c174-21e3-464e-83c9-e8db18f486a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a01cd4-8a')
May 28 10:02:48.997721 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:02:48.998124 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '305d8623-c6f8-456c-83ed-46d06c6de0ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:02:48.998470 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:02:48.998840 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:02:48.999196 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '305d8623-c6f8-456c-83ed-46d06c6de0ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:02:48.999382 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:02:49.032764 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-17927bf7-0f5b-455c-bbaa-5d3931bc1ca5 req-8ee84ba8-c080-425a-be18-45bb5082bdbe service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Received event network-vif-unplugged-4edd294f-7bb5-46ec-9cdc-c8683088408c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:49.033247 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-17927bf7-0f5b-455c-bbaa-5d3931bc1ca5 req-8ee84ba8-c080-425a-be18-45bb5082bdbe service nova] Acquiring lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:49.033432 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-17927bf7-0f5b-455c-bbaa-5d3931bc1ca5 req-8ee84ba8-c080-425a-be18-45bb5082bdbe service nova] Lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:49.033638 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-17927bf7-0f5b-455c-bbaa-5d3931bc1ca5 req-8ee84ba8-c080-425a-be18-45bb5082bdbe service nova] Lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:49.033761 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-17927bf7-0f5b-455c-bbaa-5d3931bc1ca5 req-8ee84ba8-c080-425a-be18-45bb5082bdbe service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] No waiting events found dispatching network-vif-unplugged-4edd294f-7bb5-46ec-9cdc-c8683088408c {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:02:49.033897 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-17927bf7-0f5b-455c-bbaa-5d3931bc1ca5 req-8ee84ba8-c080-425a-be18-45bb5082bdbe service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Received unexpected event network-vif-unplugged-4edd294f-7bb5-46ec-9cdc-c8683088408c for instance with vm_state rescued and task_state unrescuing.
May 28 10:02:49.034034 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-17927bf7-0f5b-455c-bbaa-5d3931bc1ca5 req-8ee84ba8-c080-425a-be18-45bb5082bdbe service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Received event network-vif-plugged-4edd294f-7bb5-46ec-9cdc-c8683088408c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:49.034186 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-17927bf7-0f5b-455c-bbaa-5d3931bc1ca5 req-8ee84ba8-c080-425a-be18-45bb5082bdbe service nova] Acquiring lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:49.034344 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-17927bf7-0f5b-455c-bbaa-5d3931bc1ca5 req-8ee84ba8-c080-425a-be18-45bb5082bdbe service nova] Lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:49.034478 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-17927bf7-0f5b-455c-bbaa-5d3931bc1ca5 req-8ee84ba8-c080-425a-be18-45bb5082bdbe service nova] Lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:49.034614 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-17927bf7-0f5b-455c-bbaa-5d3931bc1ca5 req-8ee84ba8-c080-425a-be18-45bb5082bdbe service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] No waiting events found dispatching network-vif-plugged-4edd294f-7bb5-46ec-9cdc-c8683088408c {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:02:49.034735 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-17927bf7-0f5b-455c-bbaa-5d3931bc1ca5 req-8ee84ba8-c080-425a-be18-45bb5082bdbe service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Received unexpected event network-vif-plugged-4edd294f-7bb5-46ec-9cdc-c8683088408c for instance with vm_state rescued and task_state unrescuing.
May 28 10:02:49.034869 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-17927bf7-0f5b-455c-bbaa-5d3931bc1ca5 req-8ee84ba8-c080-425a-be18-45bb5082bdbe service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Received event network-vif-plugged-4edd294f-7bb5-46ec-9cdc-c8683088408c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:49.034995 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-17927bf7-0f5b-455c-bbaa-5d3931bc1ca5 req-8ee84ba8-c080-425a-be18-45bb5082bdbe service nova] Acquiring lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:49.035320 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-17927bf7-0f5b-455c-bbaa-5d3931bc1ca5 req-8ee84ba8-c080-425a-be18-45bb5082bdbe service nova] Lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:49.035497 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-17927bf7-0f5b-455c-bbaa-5d3931bc1ca5 req-8ee84ba8-c080-425a-be18-45bb5082bdbe service nova] Lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:49.035624 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-17927bf7-0f5b-455c-bbaa-5d3931bc1ca5 req-8ee84ba8-c080-425a-be18-45bb5082bdbe service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] No waiting events found dispatching network-vif-plugged-4edd294f-7bb5-46ec-9cdc-c8683088408c {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:02:49.035789 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-17927bf7-0f5b-455c-bbaa-5d3931bc1ca5 req-8ee84ba8-c080-425a-be18-45bb5082bdbe service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Received unexpected event network-vif-plugged-4edd294f-7bb5-46ec-9cdc-c8683088408c for instance with vm_state rescued and task_state unrescuing.
May 28 10:02:49.041353 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:49.041353 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:49.041353 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:49.041353 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:49.041353 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:49.041353 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:49.041353 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:49.041353 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:49.041353 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:49.041353 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:49.041353 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:49.041353 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:49.041353 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:49.041353 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:49.041353 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:49.041353 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:49.041353 np0000001613 nova-compute[98321]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:49.041353 np0000001613 nova-compute[98321]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:49.041353 np0000001613 nova-compute[98321]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19 (non-flash)
May 28 10:02:49.041353 np0000001613 nova-compute[98321]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19 (non-flash)
May 28 10:02:49.041353 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:02:49.041986 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:49.041986 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:49.041986 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:49.041986 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:49.041986 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:49.041986 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:49.041986 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:49.041986 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:49.041986 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:49.041986 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:49.041986 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:49.041986 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:49.041986 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:49.041986 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:49.041986 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:49.041986 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:49.041986 np0000001613 nova-compute[98321]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:49.041986 np0000001613 nova-compute[98321]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea (non-flash)
May 28 10:02:49.041986 np0000001613 nova-compute[98321]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19 (non-flash)
May 28 10:02:49.041986 np0000001613 nova-compute[98321]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19 (non-flash)
May 28 10:02:49.041986 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:02:49.041986 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0', '45'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04', '49'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', '53'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', '54'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec', '58'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', '59'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', '60'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d', '61'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d', '62'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', '63'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', '64'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19', '65'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19', '66')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:02:49.041986 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', '63')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:02:49.043388 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea', '64')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:02:49.044755 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1f42054e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea'): ({'sdr'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea'): ({'sds'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:02:49.044977 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Removing multipathed devices sdr, sds {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:02:49.045248 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Flush multipath device 330000000352d9acf {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:02:49.087694 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Remove SCSI device /dev/sdr with /sys/block/sdr/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:02:49.138331 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Remove SCSI device /dev/sds with /sys/block/sds/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:02:49.191155 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Checking to see if SCSI volumes sdr, sds have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:02:49.191464 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] SCSI volumes sdr, sds have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:02:49.193423 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Checking to see if device paths {'sdr', 'sds'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:02:49.214220 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Device paths {'sdr', 'sds'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:02:49.216069 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:02:49.220856 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Object Instance<4baa35bb-b237-42be-aa8b-d9eeed7e41a0> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:02:49.220856 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Acquiring lock "60760083a9b1243a6306b57c40b376efd24f5555" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:49.225314 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "60760083a9b1243a6306b57c40b376efd24f5555" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:49.232950 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:49.280273 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea, portal: 192.168.40.100,3260]
May 28 10:02:49.280273 np0000001613 nova-compute[98321]: Logout of [sid: 63, target: iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea, portal: 192.168.40.100,3260] successful.
May 28 10:02:49.280273 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:49.318895 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:49.323682 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:02:49.323682 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:02:49.323682 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:02:49.323932 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No VIF found with MAC fa:16:3e:9e:26:24, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:02:49.342007 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:49.414880 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 64, target: iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea, portal: 192.168.50.100,3260]
May 28 10:02:49.414880 np0000001613 nova-compute[98321]: Logout of [sid: 64, target: iqn.2023-03.storpool.com:os--volume-305d8623-c6f8-456c-83ed-46d06c6de0ea, portal: 192.168.50.100,3260] successful.
May 28 10:02:49.414880 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:49.455061 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:49.455951 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.457s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:02:49.456124 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] <== disconnect_volume: return (457ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:02:49.456303 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:02:49.456577 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Deleting instance files /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b_del
May 28 10:02:49.459808 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:49.466527 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Deletion of /opt/stack/data/nova/instances/b90b1ecd-e640-4f4e-bd02-fb74021db82b_del complete
May 28 10:02:49.477007 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Removed pending STOPPED event for 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f due to new event <LifecycleEvent: 1779962569.4754477, 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f => Resumed> {{(pid=98321) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 10:02:49.477007 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962569.4754477, 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:02:49.477007 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] VM Resumed (Lifecycle Event)
May 28 10:02:49.484076 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-4e60ed6e-6ccf-466c-aafe-cf8d06142ad5 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:02:49.792655 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:02:49.792655 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:02:49.792655 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:02:49.901750 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c0547a82-440a-42b2-910e-6e3dc5ddd6ce req-bc79c831-7c54-480b-b59f-d51d1d3a39b5 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Received event network-vif-unplugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:49.902586 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c0547a82-440a-42b2-910e-6e3dc5ddd6ce req-bc79c831-7c54-480b-b59f-d51d1d3a39b5 service nova] Acquiring lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:49.902789 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c0547a82-440a-42b2-910e-6e3dc5ddd6ce req-bc79c831-7c54-480b-b59f-d51d1d3a39b5 service nova] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:49.902957 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c0547a82-440a-42b2-910e-6e3dc5ddd6ce req-bc79c831-7c54-480b-b59f-d51d1d3a39b5 service nova] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:49.903145 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c0547a82-440a-42b2-910e-6e3dc5ddd6ce req-bc79c831-7c54-480b-b59f-d51d1d3a39b5 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] No waiting events found dispatching network-vif-unplugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:02:49.903399 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-c0547a82-440a-42b2-910e-6e3dc5ddd6ce req-bc79c831-7c54-480b-b59f-d51d1d3a39b5 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Received unexpected event network-vif-unplugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 for instance with vm_state active and task_state rescuing.
May 28 10:02:49.903482 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c0547a82-440a-42b2-910e-6e3dc5ddd6ce req-bc79c831-7c54-480b-b59f-d51d1d3a39b5 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Received event network-vif-plugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:49.903623 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c0547a82-440a-42b2-910e-6e3dc5ddd6ce req-bc79c831-7c54-480b-b59f-d51d1d3a39b5 service nova] Acquiring lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:49.903767 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c0547a82-440a-42b2-910e-6e3dc5ddd6ce req-bc79c831-7c54-480b-b59f-d51d1d3a39b5 service nova] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:49.903905 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c0547a82-440a-42b2-910e-6e3dc5ddd6ce req-bc79c831-7c54-480b-b59f-d51d1d3a39b5 service nova] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:49.904065 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c0547a82-440a-42b2-910e-6e3dc5ddd6ce req-bc79c831-7c54-480b-b59f-d51d1d3a39b5 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] No waiting events found dispatching network-vif-plugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:02:49.906692 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-c0547a82-440a-42b2-910e-6e3dc5ddd6ce req-bc79c831-7c54-480b-b59f-d51d1d3a39b5 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Received unexpected event network-vif-plugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 for instance with vm_state active and task_state rescuing.
May 28 10:02:49.906692 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c0547a82-440a-42b2-910e-6e3dc5ddd6ce req-bc79c831-7c54-480b-b59f-d51d1d3a39b5 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Received event network-vif-plugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:49.906692 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c0547a82-440a-42b2-910e-6e3dc5ddd6ce req-bc79c831-7c54-480b-b59f-d51d1d3a39b5 service nova] Acquiring lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:49.907773 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c0547a82-440a-42b2-910e-6e3dc5ddd6ce req-bc79c831-7c54-480b-b59f-d51d1d3a39b5 service nova] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:49.907773 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c0547a82-440a-42b2-910e-6e3dc5ddd6ce req-bc79c831-7c54-480b-b59f-d51d1d3a39b5 service nova] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:49.907773 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c0547a82-440a-42b2-910e-6e3dc5ddd6ce req-bc79c831-7c54-480b-b59f-d51d1d3a39b5 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] No waiting events found dispatching network-vif-plugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:02:49.908838 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-c0547a82-440a-42b2-910e-6e3dc5ddd6ce req-bc79c831-7c54-480b-b59f-d51d1d3a39b5 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Received unexpected event network-vif-plugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 for instance with vm_state active and task_state rescuing.
May 28 10:02:49.908838 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c0547a82-440a-42b2-910e-6e3dc5ddd6ce req-bc79c831-7c54-480b-b59f-d51d1d3a39b5 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Received event network-vif-unplugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:49.908838 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c0547a82-440a-42b2-910e-6e3dc5ddd6ce req-bc79c831-7c54-480b-b59f-d51d1d3a39b5 service nova] Acquiring lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:49.908838 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c0547a82-440a-42b2-910e-6e3dc5ddd6ce req-bc79c831-7c54-480b-b59f-d51d1d3a39b5 service nova] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:49.908838 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c0547a82-440a-42b2-910e-6e3dc5ddd6ce req-bc79c831-7c54-480b-b59f-d51d1d3a39b5 service nova] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:49.908838 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c0547a82-440a-42b2-910e-6e3dc5ddd6ce req-bc79c831-7c54-480b-b59f-d51d1d3a39b5 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] No waiting events found dispatching network-vif-unplugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:02:49.908838 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-c0547a82-440a-42b2-910e-6e3dc5ddd6ce req-bc79c831-7c54-480b-b59f-d51d1d3a39b5 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Received unexpected event network-vif-unplugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 for instance with vm_state active and task_state rescuing.
May 28 10:02:49.908838 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c0547a82-440a-42b2-910e-6e3dc5ddd6ce req-bc79c831-7c54-480b-b59f-d51d1d3a39b5 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Received event network-vif-unplugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:49.909241 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c0547a82-440a-42b2-910e-6e3dc5ddd6ce req-bc79c831-7c54-480b-b59f-d51d1d3a39b5 service nova] Acquiring lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:49.909241 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c0547a82-440a-42b2-910e-6e3dc5ddd6ce req-bc79c831-7c54-480b-b59f-d51d1d3a39b5 service nova] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:49.909241 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c0547a82-440a-42b2-910e-6e3dc5ddd6ce req-bc79c831-7c54-480b-b59f-d51d1d3a39b5 service nova] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:49.909241 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c0547a82-440a-42b2-910e-6e3dc5ddd6ce req-bc79c831-7c54-480b-b59f-d51d1d3a39b5 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] No waiting events found dispatching network-vif-unplugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:02:49.909488 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-c0547a82-440a-42b2-910e-6e3dc5ddd6ce req-bc79c831-7c54-480b-b59f-d51d1d3a39b5 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Received unexpected event network-vif-unplugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 for instance with vm_state active and task_state rescuing.
May 28 10:02:49.979177 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:02:49.980429 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Took 2.03 seconds to destroy the instance on the hypervisor.
May 28 10:02:49.981389 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:02:49.981891 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:02:49.982031 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:02:49.982305 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:49.983923 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:02:50.003909 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "be4a8d87-07fc-4c56-a68d-c95e98e99184" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:50.004333 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "be4a8d87-07fc-4c56-a68d-c95e98e99184" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:50.103516 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:50.196444 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:02:50.199699 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:02:50.199805 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60760083a9b1243a6306b57c40b376efd24f5555.part --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:50.295733 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60760083a9b1243a6306b57c40b376efd24f5555.part --force-share --output=json" returned: 0 in 0.094s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:50.295733 np0000001613 nova-compute[98321]: DEBUG nova.virt.images [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] 2ec1b452-dc69-4a5f-903b-96b55ab5d5f9 was qcow2, converting to raw {{(pid=98321) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 10:02:50.295733 np0000001613 nova-compute[98321]: DEBUG nova.privsep.utils [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98321) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 10:02:50.296546 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/60760083a9b1243a6306b57c40b376efd24f5555.part /opt/stack/data/nova/instances/_base/60760083a9b1243a6306b57c40b376efd24f5555.converted {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:50.313460 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:50.313460 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:50.315945 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:50.319320 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Auditing locally available compute resources for np0000001613 (node: np0000001613) {{(pid=98321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 10:02:50.321808 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e9382d46-c383-42b4-bcad-d83888a1db3a req-0b75bf0c-8727-4a7c-a46e-30ce50985a40 service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Received event network-vif-unplugged-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:50.322763 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e9382d46-c383-42b4-bcad-d83888a1db3a req-0b75bf0c-8727-4a7c-a46e-30ce50985a40 service nova] Acquiring lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:50.323530 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e9382d46-c383-42b4-bcad-d83888a1db3a req-0b75bf0c-8727-4a7c-a46e-30ce50985a40 service nova] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:50.324082 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e9382d46-c383-42b4-bcad-d83888a1db3a req-0b75bf0c-8727-4a7c-a46e-30ce50985a40 service nova] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:50.324515 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e9382d46-c383-42b4-bcad-d83888a1db3a req-0b75bf0c-8727-4a7c-a46e-30ce50985a40 service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] No waiting events found dispatching network-vif-unplugged-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:02:50.325100 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e9382d46-c383-42b4-bcad-d83888a1db3a req-0b75bf0c-8727-4a7c-a46e-30ce50985a40 service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Received event network-vif-unplugged-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:02:50.489410 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962570.4889083, 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:02:50.489518 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] VM Started (Lifecycle Event)
May 28 10:02:50.507396 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Detaching volume 1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19
May 28 10:02:50.525292 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/60760083a9b1243a6306b57c40b376efd24f5555.part /opt/stack/data/nova/instances/_base/60760083a9b1243a6306b57c40b376efd24f5555.converted" returned: 0 in 0.229s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:50.544894 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60760083a9b1243a6306b57c40b376efd24f5555.converted --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:50.564695 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Attempting to driver detach volume 1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19 from mountpoint /dev/vdb
May 28 10:02:50.575486 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Found disk vdb by alias ua-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:02:50.577200 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Found disk vdb by alias ua-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:02:50.577200 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Attempting to detach device vdb from instance be4a8d87-07fc-4c56-a68d-c95e98e99184 from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 10:02:50.577200 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:02:50.577200 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:02:50.577200 np0000001613 nova-compute[98321]:   <alias name="ua-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19"/>
May 28 10:02:50.577200 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-14"/>
May 28 10:02:50.577200 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:02:50.577200 np0000001613 nova-compute[98321]:   <serial>1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19</serial>
May 28 10:02:50.577200 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:02:50.577200 np0000001613 nova-compute[98321]: </disk>
May 28 10:02:50.577200 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:02:50.586499 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Successfully detached device vdb from instance be4a8d87-07fc-4c56-a68d-c95e98e99184 from the persistent domain config.
May 28 10:02:50.586499 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] (1/8): Attempting to detach device vdb with device alias ua-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19 from instance be4a8d87-07fc-4c56-a68d-c95e98e99184 from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 10:02:50.587016 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:02:50.587016 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:02:50.587016 np0000001613 nova-compute[98321]:   <alias name="ua-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19"/>
May 28 10:02:50.587016 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-14"/>
May 28 10:02:50.587016 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:02:50.587016 np0000001613 nova-compute[98321]:   <serial>1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19</serial>
May 28 10:02:50.587016 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:02:50.587016 np0000001613 nova-compute[98321]: </disk>
May 28 10:02:50.587016 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:02:50.652640 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60760083a9b1243a6306b57c40b376efd24f5555.converted --force-share --output=json" returned: 0 in 0.107s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:50.653863 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "60760083a9b1243a6306b57c40b376efd24f5555" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.431s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:50.654799 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:02:50.663925 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:02:50.665974 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Acquiring lock "60760083a9b1243a6306b57c40b376efd24f5555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:50.666612 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "60760083a9b1243a6306b57c40b376efd24f5555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:50.667180 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:02:50.673644 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:02:50.674240 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60760083a9b1243a6306b57c40b376efd24f5555 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:50.781610 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60760083a9b1243a6306b57c40b376efd24f5555 --force-share --output=json" returned: 0 in 0.107s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:50.784194 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60760083a9b1243a6306b57c40b376efd24f5555,backing_fmt=raw /opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk.rescue {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:50.848859 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60760083a9b1243a6306b57c40b376efd24f5555,backing_fmt=raw /opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk.rescue" returned: 0 in 0.065s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:50.848859 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "60760083a9b1243a6306b57c40b376efd24f5555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.182s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:50.849051 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lazy-loading 'migration_context' on Instance uuid 4baa35bb-b237-42be-aa8b-d9eeed7e41a0 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:50.925908 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7890a875-f1d1-400e-b960-703b49a928e0 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "de9742b9-43db-40a6-b635-81d9244fd5e0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.045s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:50.993260 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:02:50.997957 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:02:51.110477 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-fa113971-fdcb-42fd-88f4-45759b42a72c req-3d2ec5f8-09f8-4643-9a82-fc5c37825fe8 service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Received event network-vif-deleted-11a01cd4-8a62-4e25-b303-ac907a1aa4c3 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:51.110477 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-fa113971-fdcb-42fd-88f4-45759b42a72c req-3d2ec5f8-09f8-4643-9a82-fc5c37825fe8 service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Neutron deleted interface 11a01cd4-8a62-4e25-b303-ac907a1aa4c3; detaching it from the instance and deleting it from the info cache
May 28 10:02:51.112749 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-fa113971-fdcb-42fd-88f4-45759b42a72c req-3d2ec5f8-09f8-4643-9a82-fc5c37825fe8 service nova] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Detach interface failed, port_id=11a01cd4-8a62-4e25-b303-ac907a1aa4c3, reason: Instance b90b1ecd-e640-4f4e-bd02-fb74021db82b could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:02:51.164534 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:02:51.211001 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19 for instance be4a8d87-07fc-4c56-a68d-c95e98e99184 {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 10:02:51.352658 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Object Instance<4baa35bb-b237-42be-aa8b-d9eeed7e41a0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:02:51.352658 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:02:51.358022 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Start _get_guest_xml network_info=[{"id": "a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39", "address": "fa:16:3e:05:9e:a2", "network": {"id": "2b7ff7fb-07d6-4791-9553-cb0a7a073e10", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2104350241-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.44", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2104350241-network", "vif_mac": "fa:16:3e:05:9e:a2"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12b4f42e155347e4a2055b151f04390a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f414a0-04", "ovs_interfaceid": "a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '2ec1b452-dc69-4a5f-903b-96b55ab5d5f9', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d', 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3177d27e-24bf-418b-97a0-c324d705954d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, 'status': 'reserved', 'instance': '4baa35bb-b237-42be-aa8b-d9eeed7e41a0', 'attached_at': '', 'detached_at': '', 'volume_id': '3177d27e-24bf-418b-97a0-c324d705954d', 'serial': '3177d27e-24bf-418b-97a0-c324d705954d'}, 'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': 'ba68fe9d-c4e7-415a-8543-825f40c11f37', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:02:51.358022 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lazy-loading 'resources' on Instance uuid 4baa35bb-b237-42be-aa8b-d9eeed7e41a0 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:51.389889 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:02:51.390308 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:02:51.390680 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-11 (vdc) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:02:51.394489 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:51.502861 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779962571.501952, be4a8d87-07fc-4c56-a68d-c95e98e99184 => ua-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 10:02:51.509113 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:51.509730 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:51.533489 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Successfully detached device vdb from instance be4a8d87-07fc-4c56-a68d-c95e98e99184 from the live domain config.
May 28 10:02:51.535316 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:02:51.536214 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19', 'iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:02:51.536699 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:02:51.537635 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:02:51.538151 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19', 'iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:02:51.538462 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:02:51.591663 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:51.591663 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:51.591663 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:51.591663 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:51.591663 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:51.591663 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:51.591663 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:51.591663 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:51.591663 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:51.591663 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:51.591663 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:51.591663 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:51.591663 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:51.591663 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:51.591663 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:51.591663 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:51.591663 np0000001613 nova-compute[98321]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19 (non-flash)
May 28 10:02:51.591663 np0000001613 nova-compute[98321]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19 (non-flash)
May 28 10:02:51.591663 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:02:51.592200 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:51.592200 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:51.592200 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:51.592200 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:51.592200 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:51.592200 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:51.592200 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:51.592200 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:51.592200 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:51.592200 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:51.592200 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:51.592200 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:51.592200 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:51.592200 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:51.592200 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:51.592200 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:51.592200 np0000001613 nova-compute[98321]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19 (non-flash)
May 28 10:02:51.592200 np0000001613 nova-compute[98321]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19 (non-flash)
May 28 10:02:51.592200 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:02:51.592520 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0', '45'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04', '49'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', '53'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', '54'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec', '58'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', '59'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', '60'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d', '61'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d', '62'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19', '65'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19', '66')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:02:51.592520 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19', '65')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:02:51.593990 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19', '66')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:02:51.597398 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc2a91c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19'): ({'sdt'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19'): ({'sdu'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:02:51.597630 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Removing multipathed devices sdt, sdu {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:02:51.597928 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Flush multipath device 3300000002aa2c815 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:02:51.618641 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:51.621214 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-15 (vdb) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:02:51.624575 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:51.655187 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Remove SCSI device /dev/sdt with /sys/block/sdt/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:02:51.671617 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Took 1.69 seconds to deallocate network for instance.
May 28 10:02:51.712522 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Remove SCSI device /dev/sdu with /sys/block/sdu/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:02:51.745637 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk --force-share --output=json" returned: 0 in 0.121s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:51.747298 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:51.766468 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Checking to see if SCSI volumes sdt, sdu have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:02:51.766468 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] SCSI volumes sdt, sdu have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:02:51.770834 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Checking to see if device paths {'sdt', 'sdu'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:02:51.786286 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Device paths {'sdt', 'sdu'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:02:51.786772 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:02:51.804502 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:51.852172 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 65, target: iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19, portal: 192.168.40.100,3260]
May 28 10:02:51.852172 np0000001613 nova-compute[98321]: Logout of [sid: 65, target: iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19, portal: 192.168.40.100,3260] successful.
May 28 10:02:51.852172 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:51.859647 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Object Instance<4baa35bb-b237-42be-aa8b-d9eeed7e41a0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:02:51.861965 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:51.862465 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:02:51.872051 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:51.891637 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:51.895832 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:02:51.899918 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-445999024', uuid='4baa35bb-b237-42be-aa8b-d9eeed7e41a0'), owner=OwnerMeta(userid='8f33df1d85634228ba269922d1f23be0', username='tempest-ServerStableDeviceRescueTest-2062770061-project-member', projectid='12b4f42e155347e4a2055b151f04390a', projectname='tempest-ServerStableDeviceRescueTest-2062770061'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39", "address": "fa:16:3e:05:9e:a2", "network": {"id": "2b7ff7fb-07d6-4791-9553-cb0a7a073e10", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2104350241-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.44", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2104350241-network", "vif_mac": "fa:16:3e:05:9e:a2"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12b4f42e155347e4a2055b151f04390a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f414a0-04", "ovs_interfaceid": "a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962571.8985393) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:02:51.901723 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:02:51.902617 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:02:51.903726 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:02:51.904117 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:02:51.905894 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:02:51.906706 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:02:51.907055 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:02:51.907055 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:02:51.907262 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:02:51.907639 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:02:51.907800 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:02:51.908107 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:02:51.908300 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:02:51.908587 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:02:51.908947 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:02:51.909134 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:02:51.909384 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4baa35bb-b237-42be-aa8b-d9eeed7e41a0 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:51.911451 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:51.959901 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 66, target: iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19, portal: 192.168.50.100,3260]
May 28 10:02:51.959901 np0000001613 nova-compute[98321]: Logout of [sid: 66, target: iqn.2023-03.storpool.com:os--volume-1bb3f81a-cd94-4cc0-8b3a-fc56a22b7a19, portal: 192.168.50.100,3260] successful.
May 28 10:02:51.959901 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:51.977485 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:51.978544 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:52.000945 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:52.002148 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.464s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:02:52.003129 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] <== disconnect_volume: return (466ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:02:52.003477 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:02:52.020435 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5e4f586a-502e-418e-b776-1e685321bffb req-41bbbb9b-b413-47d7-84f8-06bb1b17c4b7 service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Received event network-changed-4edd294f-7bb5-46ec-9cdc-c8683088408c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:52.023828 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5e4f586a-502e-418e-b776-1e685321bffb req-41bbbb9b-b413-47d7-84f8-06bb1b17c4b7 service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Refreshing instance network info cache due to event network-changed-4edd294f-7bb5-46ec-9cdc-c8683088408c. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:02:52.023828 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5e4f586a-502e-418e-b776-1e685321bffb req-41bbbb9b-b413-47d7-84f8-06bb1b17c4b7 service nova] Acquiring lock "refresh_cache-2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:02:52.023828 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5e4f586a-502e-418e-b776-1e685321bffb req-41bbbb9b-b413-47d7-84f8-06bb1b17c4b7 service nova] Acquired lock "refresh_cache-2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:02:52.023828 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-5e4f586a-502e-418e-b776-1e685321bffb req-41bbbb9b-b413-47d7-84f8-06bb1b17c4b7 service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Refreshing network info cache for port 4edd294f-7bb5-46ec-9cdc-c8683088408c {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:02:52.103099 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:52.103813 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-2 (vdb) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:02:52.108546 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:02:52.110830 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4a8d87-07fc-4c56-a68d-c95e98e99184/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:52.210588 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4a8d87-07fc-4c56-a68d-c95e98e99184/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:52.211216 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4a8d87-07fc-4c56-a68d-c95e98e99184/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:52.259024 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Took 0.58 seconds to detach 1 volumes for instance.
May 28 10:02:52.321856 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be4a8d87-07fc-4c56-a68d-c95e98e99184/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:52.329887 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:52.414477 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Object Instance<4baa35bb-b237-42be-aa8b-d9eeed7e41a0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:02:52.434480 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:52.435151 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:52.469361 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk.config --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:52.528331 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-5e4f586a-502e-418e-b776-1e685321bffb req-41bbbb9b-b413-47d7-84f8-06bb1b17c4b7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:52.556617 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34/disk --force-share --output=json" returned: 0 in 0.121s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:52.565456 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-5 (vda) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:02:52.569858 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk.rescue --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:52.587726 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk.config --force-share --output=json" returned: 0 in 0.118s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:52.589192 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Acquiring lock "/opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:52.589600 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "/opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:52.590459 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "/opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:52.591292 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:02:52.592798 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d', 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3177d27e-24bf-418b-97a0-c324d705954d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:02:52.592798 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:02:52.593291 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:02:52.593919 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d', 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3177d27e-24bf-418b-97a0-c324d705954d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:02:52.613184 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lazy-loading 'flavor' on Instance uuid be4a8d87-07fc-4c56-a68d-c95e98e99184 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:52.620606 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:02:52.621451 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:02:52.622082 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:02:52.622939 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:02:52.630305 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.007s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:02:52.630565 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.startup = automatic
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.session.scan = manual
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:02:52.641549 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:02:52.641549 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.startup = automatic
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.session.scan = manual
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:02:52.653245 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:02:52.653245 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:52.666253 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:52.673074 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:52.679647 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk.rescue --force-share --output=json" returned: 0 in 0.109s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:52.679647 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk.rescue --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:52.701955 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:52.701955 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:52.701955 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:52.701955 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:52.701955 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:52.701955 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:52.701955 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:52.701955 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:52.701955 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:52.701955 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:52.701955 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:52.701955 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:52.701955 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:52.701955 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:52.701955 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:52.701955 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:52.701955 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:02:52.703014 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:52.703014 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:52.703014 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:52.703014 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:52.703014 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:52.703014 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:52.703014 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:52.703014 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:52.703014 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:52.703014 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:52.703014 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:52.703014 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:52.703014 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:52.703014 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:52.703014 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:52.703014 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:52.703014 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:02:52.704073 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.074s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:02:52.704504 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:02:52.705011 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:52.705011 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:52.705011 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:52.705011 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:52.705011 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:52.705011 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:52.705011 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:52.705011 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:52.705011 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:52.705011 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:52.705011 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:52.705011 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:52.705011 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:52.705011 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:52.705011 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:52.705011 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:52.705011 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:02:52.705462 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:52.705462 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:52.705462 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:52.705462 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:52.705462 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:52.705462 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:52.705462 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:52.705462 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:52.705462 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:52.705462 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:52.705462 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:52.705462 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:52.705462 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:52.705462 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:52.705462 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:52.705462 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:52.705462 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:02:52.705946 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.084s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:02:52.706194 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:02:52.707442 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] HCTL ('20', '0', '0', 0) found on session 62 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:02:52.707667 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Scanning host 20 c: 0, t: 0, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:02:52.715013 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] HCTL ('19', '0', '0', 0) found on session 61 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:02:52.715199 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Scanning host 19 c: 0, t: 0, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:02:52.728420 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Searching for a device in session 62 and hctl ('20', '0', '0', 0) yield: sdo {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:02:52.729744 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3177d27e-24bf-418b-97a0-c324d705954d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:02:52.732194 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Searching for a device in session 61 and hctl ('19', '0', '0', 0) yield: sdn {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:02:52.733630 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3177d27e-24bf-418b-97a0-c324d705954d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:02:52.779782 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:52.779782 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:52.781739 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.008s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:52.806210 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk.rescue --force-share --output=json" returned: 0 in 0.126s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:52.809225 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:52.886715 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Deleted allocations for instance b90b1ecd-e640-4f4e-bd02-fb74021db82b
May 28 10:02:52.927206 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:52.927771 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:53.019682 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-5e4f586a-502e-418e-b776-1e685321bffb req-41bbbb9b-b413-47d7-84f8-06bb1b17c4b7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:53.046413 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:53.058527 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:53.189980 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:53.194250 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:53.235187 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-5e4f586a-502e-418e-b776-1e685321bffb req-41bbbb9b-b413-47d7-84f8-06bb1b17c4b7 service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Updated VIF entry in instance network info cache for port 4edd294f-7bb5-46ec-9cdc-c8683088408c. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:02:53.236065 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-5e4f586a-502e-418e-b776-1e685321bffb req-41bbbb9b-b413-47d7-84f8-06bb1b17c4b7 service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Updating instance_info_cache with network_info: [{"id": "4edd294f-7bb5-46ec-9cdc-c8683088408c", "address": "fa:16:3e:44:0a:72", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4edd294f-7b", "ovs_interfaceid": "4edd294f-7bb5-46ec-9cdc-c8683088408c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:02:53.291682 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:53.293892 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:02:53.295587 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3edc00a8-2c60-4c44-acb8-6f4d02114bf0/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:53.382654 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3edc00a8-2c60-4c44-acb8-6f4d02114bf0/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:53.386237 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3edc00a8-2c60-4c44-acb8-6f4d02114bf0/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:53.512010 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3edc00a8-2c60-4c44-acb8-6f4d02114bf0/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:53.514941 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:53.605652 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:53.606826 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:53.631276 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:02:53.648985 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-51ebe7fe-97ad-4453-9bf8-4e84e6d87b2d tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "be4a8d87-07fc-4c56-a68d-c95e98e99184" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.645s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:53.706416 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:53.710953 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:02:53.712499 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:53.742014 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5e4f586a-502e-418e-b776-1e685321bffb req-41bbbb9b-b413-47d7-84f8-06bb1b17c4b7 service nova] Releasing lock "refresh_cache-2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:02:53.742996 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5e4f586a-502e-418e-b776-1e685321bffb req-41bbbb9b-b413-47d7-84f8-06bb1b17c4b7 service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Received event network-changed-4edd294f-7bb5-46ec-9cdc-c8683088408c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:53.743226 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5e4f586a-502e-418e-b776-1e685321bffb req-41bbbb9b-b413-47d7-84f8-06bb1b17c4b7 service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Refreshing instance network info cache due to event network-changed-4edd294f-7bb5-46ec-9cdc-c8683088408c. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:02:53.743583 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5e4f586a-502e-418e-b776-1e685321bffb req-41bbbb9b-b413-47d7-84f8-06bb1b17c4b7 service nova] Acquiring lock "refresh_cache-2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:02:53.743732 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5e4f586a-502e-418e-b776-1e685321bffb req-41bbbb9b-b413-47d7-84f8-06bb1b17c4b7 service nova] Acquired lock "refresh_cache-2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:02:53.743992 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-5e4f586a-502e-418e-b776-1e685321bffb req-41bbbb9b-b413-47d7-84f8-06bb1b17c4b7 service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Refreshing network info cache for port 4edd294f-7bb5-46ec-9cdc-c8683088408c {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:02:53.761444 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "env LANG=C uptime" returned: 0 in 0.049s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:53.761839 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Hypervisor/Node resource view: name=np0000001613 free_ram=10731MB free_disk=74.025634765625GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 10:02:53.762002 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:53.762251 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:53.905243 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-79393bdd-2955-470c-9449-ae77f09eb6db tempest-ServerActionsTestOtherB-634969206 tempest-ServerActionsTestOtherB-634969206-project-member] Lock "b90b1ecd-e640-4f4e-bd02-fb74021db82b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.476s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:53.929726 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Stashing vm_state: active {{(pid=98321) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 28 10:02:53.980303 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:54.248639 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-5e4f586a-502e-418e-b776-1e685321bffb req-41bbbb9b-b413-47d7-84f8-06bb1b17c4b7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:54.272502 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:54.438248 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8d8c82ff-755c-40a8-98b3-25db79cb662b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "be4a8d87-07fc-4c56-a68d-c95e98e99184" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:54.438414 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8d8c82ff-755c-40a8-98b3-25db79cb662b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "be4a8d87-07fc-4c56-a68d-c95e98e99184" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:54.438540 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8d8c82ff-755c-40a8-98b3-25db79cb662b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "be4a8d87-07fc-4c56-a68d-c95e98e99184-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:54.438692 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8d8c82ff-755c-40a8-98b3-25db79cb662b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "be4a8d87-07fc-4c56-a68d-c95e98e99184-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:54.439375 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8d8c82ff-755c-40a8-98b3-25db79cb662b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "be4a8d87-07fc-4c56-a68d-c95e98e99184-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:54.450856 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-8d8c82ff-755c-40a8-98b3-25db79cb662b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Terminating instance
May 28 10:02:54.466845 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:54.513560 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:54.653076 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Found WWN 3300000006509bf9e for multipath device dm-2 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:02:54.653076 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.059s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:02:54.653076 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] <== connect_volume: return (2059ms) {'type': 'block', 'scsi_wwn': '3300000006509bf9e', 'path': '/dev/dm-2', 'multipath_id': '3300000006509bf9e'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:02:54.653076 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006509bf9e', 'path': '/dev/dm-2', 'multipath_id': '3300000006509bf9e'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:02:54.724054 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-5e4f586a-502e-418e-b776-1e685321bffb req-41bbbb9b-b413-47d7-84f8-06bb1b17c4b7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:54.787626 np0000001613 nova-compute[98321]: INFO nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Updating resource usage from migration 11e98384-9dcd-4e80-abe8-766b265a4310
May 28 10:02:54.850186 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 6895009a-024f-4919-9d25-a52905eac818 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:02:54.850186 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 87f6620a-fa87-4d27-8512-74215ef4fe34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:02:54.850186 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance d2e043b6-afe6-4afb-92d6-7d8b33545f19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:02:54.850186 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance b50eced2-71bf-4448-b2e1-f9657509f34c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:02:54.850186 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:02:54.850186 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 3edc00a8-2c60-4c44-acb8-6f4d02114bf0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:02:54.850186 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 03313f66-d1dd-4269-b2e9-3b0796217299 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:02:54.850786 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:02:54.851022 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 4baa35bb-b237-42be-aa8b-d9eeed7e41a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:02:54.851314 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance be4a8d87-07fc-4c56-a68d-c95e98e99184 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:02:54.851546 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance de9742b9-43db-40a6-b635-81d9244fd5e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:02:54.857187 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Migration 11e98384-9dcd-4e80-abe8-766b265a4310 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 28 10:02:54.857187 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 36fde791-779f-42a8-9aef-87eafbbe0370 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:02:54.857187 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 10:02:54.857187 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Final resource view: name=np0000001613 phys_ram=24030MB used_ram=2816MB phys_disk=95GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 10:02:53 up 35 min,  2 users,  load average: 10.41, 7.47, 3.67\n', 'num_instances': '12', 'num_vm_active': '11', 'num_task_None': '10', 'num_os_type_None': '12', 'num_proj_3403b533910644d2b254922fb84b1ac0': '5', 'io_workload': '2', 'num_proj_f5fc8bc5d1984c1c839a3ef7e30b9d36': '3', 'num_vm_rescued': '1', 'num_proj_2b4cc0430ca14757a829b60eb7e0081e': '1', 'num_proj_eb5bac5cd317420ab74fc9f416a80e59': '1', 'num_task_rescuing': '1', 'num_proj_12b4f42e155347e4a2055b151f04390a': '1', 'num_proj_9a85ba31f98b45b6974118c6560bbc53': '1', 'num_task_resize_prep': '1'} {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 10:02:54.972435 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8d8c82ff-755c-40a8-98b3-25db79cb662b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:02:54.988965 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-5e4f586a-502e-418e-b776-1e685321bffb req-41bbbb9b-b413-47d7-84f8-06bb1b17c4b7 service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Updated VIF entry in instance network info cache for port 4edd294f-7bb5-46ec-9cdc-c8683088408c. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:02:54.990338 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-5e4f586a-502e-418e-b776-1e685321bffb req-41bbbb9b-b413-47d7-84f8-06bb1b17c4b7 service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Updating instance_info_cache with network_info: [{"id": "4edd294f-7bb5-46ec-9cdc-c8683088408c", "address": "fa:16:3e:44:0a:72", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4edd294f-7b", "ovs_interfaceid": "4edd294f-7bb5-46ec-9cdc-c8683088408c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:02:55.016627 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0005630189998555579 future=<Future at 0x73c1f42130e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:02:55.016627 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:02:55.016627 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=7.060665645999961 future=<Future at 0x73c1fc5eff50 state=cancelled>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:02:55.016627 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=7.060572382000373 future=<Future at 0x73c1fc5eff50 state=cancelled>) was cancelled while queued, skipping {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:02:55.016627 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:02:55.016627 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=8.031122146000143 future=<Future at 0x73c1f4093b90 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:02:55.016627 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=8.031056344000262 future=<Future at 0x73c1f4093b90 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:02:55.019502 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Emitting event <LifecycleEvent: 1779962560.0154183, e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:02:55.019502 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] VM Stopped (Lifecycle Event)
May 28 10:02:55.020236 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:55.023960 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:55.047361 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:55.055832 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:55.087717 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:55.164206 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:01:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-445999024',display_name='tempest-ServerStableDeviceRescueTest-server-445999024',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serverstabledevicerescuetest-server-445999024',id=28,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHYEtJPZFtEAxWytQRE0q9ojBtsXp8sLSsdVhH0fWy0OH7NIWqXHiL4IKGra0wQLgHSM0O03o37kQJrxR0gIvqWp6aM3ftiLSmbak4otJmNefvORIwdb0k3Y0ZFuCp+DA==',key_name='tempest-keypair-325561194',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:01:42Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12b4f42e155347e4a2055b151f04390a',ramdisk_id='',reservation_id='r-acgw6178',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2062770061',owner_user_name='tempest-ServerStableDeviceRescueTest-2062770061-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:02:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f33df1d85634228ba269922d1f23be0',uuid=4baa35bb-b237-42be-aa8b-d9eeed7e41a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39", "address": "fa:16:3e:05:9e:a2", "network": {"id": "2b7ff7fb-07d6-4791-9553-cb0a7a073e10", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2104350241-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.44", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2104350241-network", "vif_mac": "fa:16:3e:05:9e:a2"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12b4f42e155347e4a2055b151f04390a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f414a0-04", "ovs_interfaceid": "a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:02:55.164206 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Converting VIF {"id": "a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39", "address": "fa:16:3e:05:9e:a2", "network": {"id": "2b7ff7fb-07d6-4791-9553-cb0a7a073e10", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2104350241-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.44", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2104350241-network", "vif_mac": "fa:16:3e:05:9e:a2"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12b4f42e155347e4a2055b151f04390a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f414a0-04", "ovs_interfaceid": "a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:02:55.164206 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:9e:a2,bridge_name='br-int',has_traffic_filtering=True,id=a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39,network=Network(2b7ff7fb-07d6-4791-9553-cb0a7a073e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4f414a0-04') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:02:55.164206 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lazy-loading 'pci_devices' on Instance uuid 4baa35bb-b237-42be-aa8b-d9eeed7e41a0 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:55.327000 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999661269000171 future=<Future at 0x73c1f41b5520 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:02:55.328964 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Instance destroyed successfully.
May 28 10:02:55.332563 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-8d8c82ff-755c-40a8-98b3-25db79cb662b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lazy-loading 'resources' on Instance uuid be4a8d87-07fc-4c56-a68d-c95e98e99184 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:55.497864 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5e4f586a-502e-418e-b776-1e685321bffb req-41bbbb9b-b413-47d7-84f8-06bb1b17c4b7 service nova] Releasing lock "refresh_cache-2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:02:55.524375 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: e28c78d0-ce98-4e6c-a3e8-46d4fe4b9047] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:02:55.665908 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Object Instance<4baa35bb-b237-42be-aa8b-d9eeed7e41a0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:02:55.667558 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] End _get_guest_xml xml=<domain type="qemu">
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:   <uuid>4baa35bb-b237-42be-aa8b-d9eeed7e41a0</uuid>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:   <name>instance-0000001c</name>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-445999024</nova:name>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:02:51</nova:creationTime>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:         <nova:user uuid="8f33df1d85634228ba269922d1f23be0">tempest-ServerStableDeviceRescueTest-2062770061-project-member</nova:user>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:         <nova:project uuid="12b4f42e155347e4a2055b151f04390a">tempest-ServerStableDeviceRescueTest-2062770061</nova:project>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:         <nova:port uuid="a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39">
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:     <system>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       <entry name="serial">4baa35bb-b237-42be-aa8b-d9eeed7e41a0</entry>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       <entry name="uuid">4baa35bb-b237-42be-aa8b-d9eeed7e41a0</entry>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:     </system>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:   <os>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:   </os>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:   <features>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:   </features>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:   <devices>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk"/>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:     </disk>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk.config"/>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:     </disk>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       <alias name="ua-3177d27e-24bf-418b-97a0-c324d705954d"/>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-2"/>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       <target dev="vdb" bus="virtio"/>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       <serial>3177d27e-24bf-418b-97a0-c324d705954d</serial>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:     </disk>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk.rescue"/>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       <target dev="vdc" bus="virtio"/>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       <boot order="1"/>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:     </disk>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:05:9e:a2"/>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       <target dev="tapa4f414a0-04"/>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:     </interface>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/console.log" append="off"/>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:     </serial>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:     <video>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:     </video>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:     </rng>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:   </devices>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]: </domain>
May 28 10:02:55.667558 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:02:55.681406 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Instance destroyed successfully.
May 28 10:02:55.725244 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:02:55.725678 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:02:55.835178 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-8d8c82ff-755c-40a8-98b3-25db79cb662b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1917823640',display_name='tempest-AttachVolumeNegativeTest-server-1917823640',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumenegativetest-server-1917823640',id=29,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB6c+QCw/AdOf+ZOgKO6yIV552TVvTkOSaB9WPqx5hvwrQIbdotDEw/LD/omU6NVAEAhSrCIDNsYD/OY2ax4OJVHjPLtIdFYcMC6ZhGSh8+zNtXWNXjQbUVBOSp/A0mGOA==',key_name='tempest-keypair-1974157475',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:01:56Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a85ba31f98b45b6974118c6560bbc53',ramdisk_id='',reservation_id='r-qv0l4o4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-775348461',owner_user_name='tempest-AttachVolumeNegativeTest-775348461-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:01:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9297977bbf334232a4a74bd6808b863b',uuid=be4a8d87-07fc-4c56-a68d-c95e98e99184,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ea26412-1950-4e22-bbb1-1973617d8031", "address": "fa:16:3e:a8:9a:37", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ea26412-19", "ovs_interfaceid": "1ea26412-1950-4e22-bbb1-1973617d8031", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:02:55.835488 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-8d8c82ff-755c-40a8-98b3-25db79cb662b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Converting VIF {"id": "1ea26412-1950-4e22-bbb1-1973617d8031", "address": "fa:16:3e:a8:9a:37", "network": {"id": "bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1735807991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a85ba31f98b45b6974118c6560bbc53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ea26412-19", "ovs_interfaceid": "1ea26412-1950-4e22-bbb1-1973617d8031", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:02:55.835901 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-8d8c82ff-755c-40a8-98b3-25db79cb662b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:9a:37,bridge_name='br-int',has_traffic_filtering=True,id=1ea26412-1950-4e22-bbb1-1973617d8031,network=Network(bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ea26412-19') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:02:55.836121 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-8d8c82ff-755c-40a8-98b3-25db79cb662b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:9a:37,bridge_name='br-int',has_traffic_filtering=True,id=1ea26412-1950-4e22-bbb1-1973617d8031,network=Network(bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ea26412-19') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:02:55.839515 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:55.839706 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ea26412-19, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:02:55.840896 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:55.844035 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:02:55.848893 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:55.850475 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:55.850659 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ee67141c-1156-4e8d-adb8-e16c8c70f3d5) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:02:55.851227 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:55.851830 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:02:55.858210 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Acquiring lock "9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:55.858210 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lock "9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:55.858210 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Acquiring lock "9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:55.858210 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lock "9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:55.858210 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lock "9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:55.862734 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:55.864120 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Terminating instance
May 28 10:02:55.866828 np0000001613 nova-compute[98321]: INFO os_vif [None req-8d8c82ff-755c-40a8-98b3-25db79cb662b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:9a:37,bridge_name='br-int',has_traffic_filtering=True,id=1ea26412-1950-4e22-bbb1-1973617d8031,network=Network(bec34d5c-7d8b-4ec4-859f-1f7f3b0dce83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ea26412-19')
May 28 10:02:55.867511 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-8d8c82ff-755c-40a8-98b3-25db79cb662b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Deleting instance files /opt/stack/data/nova/instances/be4a8d87-07fc-4c56-a68d-c95e98e99184_del
May 28 10:02:55.870266 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-8d8c82ff-755c-40a8-98b3-25db79cb662b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Deletion of /opt/stack/data/nova/instances/be4a8d87-07fc-4c56-a68d-c95e98e99184_del complete
May 28 10:02:56.228939 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:02:56.283263 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:56.373827 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:02:56.378365 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-8d8c82ff-755c-40a8-98b3-25db79cb662b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Took 1.41 seconds to destroy the instance on the hypervisor.
May 28 10:02:56.379495 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-8d8c82ff-755c-40a8-98b3-25db79cb662b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:02:56.379691 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:02:56.379918 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:02:56.380567 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:56.408803 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:56.414112 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:56.437127 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:56.443809 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:56.478200 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:56.479476 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:56.529153 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:56.706332 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999669585999982 future=<Future at 0x73c1f41b8950 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:02:56.707822 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Instance destroyed successfully.
May 28 10:02:56.709318 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lazy-loading 'resources' on Instance uuid 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:56.747807 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Compute_service record updated for np0000001613:np0000001613 {{(pid=98321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 10:02:56.747951 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.986s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:56.750200 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 2.236s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:56.750995 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:02:57.208614 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:02:57.208907 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:02:57.209068 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:02:57.209187 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:02:57.209328 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] No VIF found with MAC fa:16:3e:05:9e:a2, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:02:57.209996 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Using config drive
May 28 10:02:57.215518 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T10:00:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1145093383',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serveractionsv293testjson-server-1963844026',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAMk9iSLwMbw4Ei6MHI0esC/55Rcy6sQ2tiWuKsyMq8m3KvVeicKJFpNeMJUkrZC2YauMY8UtCiYY/mGIoDtQfJzjOysD9ZOhrfUaZ1uCfXpLOQ02ek21gk2Qq+Gwmp7g==',key_name='tempest-keypair-1857006641',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:02:17Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b4cc0430ca14757a829b60eb7e0081e',ramdisk_id='',reservation_id='r-i2a86n6f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='3427ea11-12a6-4b25-8c73-769d29819fe0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1376389954',owner_user_name='tempest-ServerActionsV293TestJSON-1376389954-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:02:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='321e041ada2b405e821acd703457ddcb',uuid=9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b45721cf-794a-4cef-9660-816123b5b144", "address": "fa:16:3e:15:41:54", "network": {"id": "a546cd76-74b1-4628-b9bf-c80f6b8f1bec", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1194909584-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2b4cc0430ca14757a829b60eb7e0081e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45721cf-79", "ovs_interfaceid": "b45721cf-794a-4cef-9660-816123b5b144", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:02:57.215749 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Converting VIF {"id": "b45721cf-794a-4cef-9660-816123b5b144", "address": "fa:16:3e:15:41:54", "network": {"id": "a546cd76-74b1-4628-b9bf-c80f6b8f1bec", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1194909584-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2b4cc0430ca14757a829b60eb7e0081e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45721cf-79", "ovs_interfaceid": "b45721cf-794a-4cef-9660-816123b5b144", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:02:57.216519 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:41:54,bridge_name='br-int',has_traffic_filtering=True,id=b45721cf-794a-4cef-9660-816123b5b144,network=Network(a546cd76-74b1-4628-b9bf-c80f6b8f1bec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb45721cf-79') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:02:57.216883 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:41:54,bridge_name='br-int',has_traffic_filtering=True,id=b45721cf-794a-4cef-9660-816123b5b144,network=Network(a546cd76-74b1-4628-b9bf-c80f6b8f1bec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb45721cf-79') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:02:57.219572 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:57.221925 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb45721cf-79, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:02:57.221925 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:57.222877 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:02:57.231504 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:57.233913 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:57.233992 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1921c03a-6d0e-4a6d-90c7-dee148f73453) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:02:57.234598 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:57.235226 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:02:57.246402 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:57.252307 np0000001613 nova-compute[98321]: INFO os_vif [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:41:54,bridge_name='br-int',has_traffic_filtering=True,id=b45721cf-794a-4cef-9660-816123b5b144,network=Network(a546cd76-74b1-4628-b9bf-c80f6b8f1bec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb45721cf-79')
May 28 10:02:57.252557 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:02:57.252959 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83485657-e133-49aa-baed-d67cb2fd1720', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:02:57.253099 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:02:57.253832 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:02:57.254844 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83485657-e133-49aa-baed-d67cb2fd1720', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:02:57.254844 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:02:57.259749 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:02:57.259949 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Claim successful on node np0000001613
May 28 10:02:57.291789 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7b41dd5d-401e-4065-8fc5-b0e0b49dc841 req-b03eccc8-0e2e-492a-9826-8ff6a5e55f2e service nova] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Received event network-vif-deleted-1ea26412-1950-4e22-bbb1-1973617d8031 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:57.291924 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-7b41dd5d-401e-4065-8fc5-b0e0b49dc841 req-b03eccc8-0e2e-492a-9826-8ff6a5e55f2e service nova] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Neutron deleted interface 1ea26412-1950-4e22-bbb1-1973617d8031; detaching it from the instance and deleting it from the info cache
May 28 10:02:57.296266 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7b41dd5d-401e-4065-8fc5-b0e0b49dc841 req-b03eccc8-0e2e-492a-9826-8ff6a5e55f2e service nova] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Detach interface failed, port_id=1ea26412-1950-4e22-bbb1-1973617d8031, reason: Instance be4a8d87-07fc-4c56-a68d-c95e98e99184 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:02:57.297972 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:57.297972 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:57.297972 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:57.297972 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:57.297972 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:57.297972 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:57.297972 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:57.297972 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:57.297972 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:57.297972 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:57.297972 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:57.297972 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:57.297972 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:57.297972 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:57.297972 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:57.297972 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:57.297972 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:02:57.298479 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:57.298479 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:02:57.298479 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:57.298479 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:02:57.298479 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:57.298479 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:02:57.298479 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:57.298479 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:02:57.298479 np0000001613 nova-compute[98321]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:57.298479 np0000001613 nova-compute[98321]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720 (non-flash)
May 28 10:02:57.298479 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:57.298479 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:02:57.298479 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:57.298479 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:02:57.298479 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:57.298479 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:02:57.298479 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:02:57.298479 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0', '45'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04', '49'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', '53'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', '54'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec', '58'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', '59'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', '60'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d', '61'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d', '62')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:02:57.298970 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', '54')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:02:57.300925 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720', '53')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:02:57.302078 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc2219e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720'): ({'sdd'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:02:57.302496 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Removing multipathed devices sdd, sde {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:02:57.302934 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Flush multipath device 3300000005fd58f27 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:02:57.361521 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:02:57.411292 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:02:57.458879 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:02:57.459124 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:02:57.461076 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:02:57.477594 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:02:57.477807 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:02:57.492001 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:57.536611 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720, portal: 192.168.40.100,3260]
May 28 10:02:57.536611 np0000001613 nova-compute[98321]: Logout of [sid: 54, target: iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720, portal: 192.168.40.100,3260] successful.
May 28 10:02:57.536611 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:57.569055 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:57.581872 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:57.630017 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720, portal: 192.168.50.100,3260]
May 28 10:02:57.630017 np0000001613 nova-compute[98321]: Logout of [sid: 53, target: iqn.2023-03.storpool.com:os--volume-83485657-e133-49aa-baed-d67cb2fd1720, portal: 192.168.50.100,3260] successful.
May 28 10:02:57.630017 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:57.656198 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:02:57.656463 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:02:57.656612 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] <== disconnect_volume: return (403ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:02:57.656733 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:02:57.657011 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Deleting instance files /opt/stack/data/nova/instances/9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590_del
May 28 10:02:57.657609 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Deletion of /opt/stack/data/nova/instances/9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590_del complete
May 28 10:02:57.676083 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:02:57.715305 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lazy-loading 'ec2_ids' on Instance uuid 4baa35bb-b237-42be-aa8b-d9eeed7e41a0 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:57.750568 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:02:57.751628 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:02:57.752437 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:02:57.752648 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:02:57.752896 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:02:57.753069 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 10:02:57.753344 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 52.04 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:02:57.768552 np0000001613 nova-compute[98321]: INFO nova.compute.resource_tracker [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Updating resource usage from migration 11e98384-9dcd-4e80-abe8-766b265a4310
May 28 10:02:58.168760 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Took 1.79 seconds to destroy the instance on the hypervisor.
May 28 10:02:58.169701 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:02:58.170053 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:02:58.170192 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:02:58.170505 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:58.177599 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Took 1.80 seconds to deallocate network for instance.
May 28 10:02:58.224863 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Object Instance<4baa35bb-b237-42be-aa8b-d9eeed7e41a0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:02:58.224863 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lazy-loading 'keypairs' on Instance uuid 4baa35bb-b237-42be-aa8b-d9eeed7e41a0 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:02:58.275752 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:58.578294 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:02:58.579908 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:02:58.655272 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:58.687534 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8d8c82ff-755c-40a8-98b3-25db79cb662b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:58.727768 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Object Instance<4baa35bb-b237-42be-aa8b-d9eeed7e41a0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:02:58.733988 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:02:58.830837 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e3bd7beb-72b9-4349-a970-b51285dbb223 req-fe67b435-f5c4-415c-b949-83edae78e234 service nova] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Received event network-vif-deleted-b45721cf-794a-4cef-9660-816123b5b144 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:58.831975 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-e3bd7beb-72b9-4349-a970-b51285dbb223 req-fe67b435-f5c4-415c-b949-83edae78e234 service nova] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Neutron deleted interface b45721cf-794a-4cef-9660-816123b5b144; detaching it from the instance and deleting it from the info cache
May 28 10:02:58.845420 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e3bd7beb-72b9-4349-a970-b51285dbb223 req-fe67b435-f5c4-415c-b949-83edae78e234 service nova] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Detach interface failed, port_id=b45721cf-794a-4cef-9660-816123b5b144, reason: Instance 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:02:58.939613 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Creating config drive at /opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk.config.rescue
May 28 10:02:58.943600 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8m42u8uj {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:02:59.001254 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8m42u8uj" returned: 0 in 0.057s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:02:59.083134 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:02:59.268791 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:02:59.469672 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:59.564522 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:59.594865 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.845s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:59.594865 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Migrating
May 28 10:02:59.594865 np0000001613 nova-compute[98321]: DEBUG nova.compute.rpcapi [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98321) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 10:02:59.602403 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:59.605337 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8d8c82ff-755c-40a8-98b3-25db79cb662b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.915s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:59.691347 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:59.772341 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Took 1.60 seconds to deallocate network for instance.
May 28 10:02:59.866247 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f6074fcf-5b34-43b8-95c5-7cedf992e0d1 req-b3d88e5b-fdef-450b-8794-243753a5d557 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Received event network-vif-plugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:02:59.866487 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f6074fcf-5b34-43b8-95c5-7cedf992e0d1 req-b3d88e5b-fdef-450b-8794-243753a5d557 service nova] Acquiring lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:59.866654 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f6074fcf-5b34-43b8-95c5-7cedf992e0d1 req-b3d88e5b-fdef-450b-8794-243753a5d557 service nova] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:59.866770 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f6074fcf-5b34-43b8-95c5-7cedf992e0d1 req-b3d88e5b-fdef-450b-8794-243753a5d557 service nova] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:02:59.866886 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f6074fcf-5b34-43b8-95c5-7cedf992e0d1 req-b3d88e5b-fdef-450b-8794-243753a5d557 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] No waiting events found dispatching network-vif-plugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:02:59.867007 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-f6074fcf-5b34-43b8-95c5-7cedf992e0d1 req-b3d88e5b-fdef-450b-8794-243753a5d557 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Received unexpected event network-vif-plugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 for instance with vm_state active and task_state rescuing.
May 28 10:02:59.965548 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:59.972363 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:02:59.986614 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:02:59.986915 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:02:59.998192 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:00.131757 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "refresh_cache-36fde791-779f-42a8-9aef-87eafbbe0370" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:03:00.133458 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquired lock "refresh_cache-36fde791-779f-42a8-9aef-87eafbbe0370" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:03:00.133655 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:03:00.345880 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Took 0.57 seconds to detach 1 volumes for instance.
May 28 10:03:00.348569 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Deleting volume: 83485657-e133-49aa-baed-d67cb2fd1720 {{(pid=98321) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 10:03:00.495672 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:03:00.541504 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Removed pending STOPPED event for 4baa35bb-b237-42be-aa8b-d9eeed7e41a0 due to new event <LifecycleEvent: 1779962580.5411189, 4baa35bb-b237-42be-aa8b-d9eeed7e41a0 => Resumed> {{(pid=98321) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 10:03:00.541704 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962580.5411189, 4baa35bb-b237-42be-aa8b-d9eeed7e41a0 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:03:00.541837 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] VM Resumed (Lifecycle Event)
May 28 10:03:00.548273 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7ac5ad3a-82f8-48bb-a4e0-e17781abf839 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:03:00.570569 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8d8c82ff-755c-40a8-98b3-25db79cb662b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:03:00.570569 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-8d8c82ff-755c-40a8-98b3-25db79cb662b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:03:00.642882 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:00.907053 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:01.047083 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:03:01.050423 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:03:01.064985 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:01.073893 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-8d8c82ff-755c-40a8-98b3-25db79cb662b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:03:01.088001 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:01.239768 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Updating instance_info_cache with network_info: [{"id": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "address": "fa:16:3e:e1:06:59", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e857900-17", "ovs_interfaceid": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:03:01.553475 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962581.553124, 4baa35bb-b237-42be-aa8b-d9eeed7e41a0 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:03:01.553616 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] VM Started (Lifecycle Event)
May 28 10:03:01.585018 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8d8c82ff-755c-40a8-98b3-25db79cb662b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.983s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:01.590317 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.683s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:01.694283 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-8d8c82ff-755c-40a8-98b3-25db79cb662b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Deleted allocations for instance be4a8d87-07fc-4c56-a68d-c95e98e99184
May 28 10:03:01.742572 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Releasing lock "refresh_cache-36fde791-779f-42a8-9aef-87eafbbe0370" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:03:01.956143 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a42ca23a-705a-4d5e-aaf2-df369893d68d req-204b506c-83ac-4480-8c37-fc3d51981d76 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Received event network-vif-plugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:01.956143 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a42ca23a-705a-4d5e-aaf2-df369893d68d req-204b506c-83ac-4480-8c37-fc3d51981d76 service nova] Acquiring lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:01.956143 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a42ca23a-705a-4d5e-aaf2-df369893d68d req-204b506c-83ac-4480-8c37-fc3d51981d76 service nova] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:01.956436 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a42ca23a-705a-4d5e-aaf2-df369893d68d req-204b506c-83ac-4480-8c37-fc3d51981d76 service nova] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:01.956638 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a42ca23a-705a-4d5e-aaf2-df369893d68d req-204b506c-83ac-4480-8c37-fc3d51981d76 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] No waiting events found dispatching network-vif-plugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:03:01.956737 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-a42ca23a-705a-4d5e-aaf2-df369893d68d req-204b506c-83ac-4480-8c37-fc3d51981d76 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Received unexpected event network-vif-plugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 for instance with vm_state rescued and task_state unrescuing.
May 28 10:03:02.052536 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-69c56951-1873-4546-94c5-e0eb5a84932d tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Unrescuing
May 28 10:03:02.052651 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-69c56951-1873-4546-94c5-e0eb5a84932d tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Acquiring lock "refresh_cache-4baa35bb-b237-42be-aa8b-d9eeed7e41a0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:03:02.052797 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-69c56951-1873-4546-94c5-e0eb5a84932d tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Acquired lock "refresh_cache-4baa35bb-b237-42be-aa8b-d9eeed7e41a0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:03:02.052877 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-69c56951-1873-4546-94c5-e0eb5a84932d tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:03:02.057830 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:03:02.065813 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:03:02.243491 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:02.537378 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:03:02.537586 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:03:02.560229 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-69c56951-1873-4546-94c5-e0eb5a84932d tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:02.569119 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 28 10:03:02.683666 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4bc1bf0a-edc5-42ec-9f3c-762c698783f1 req-51a720d5-3929-46d9-853c-7be89df904ff service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Received event network-changed-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:02.683927 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4bc1bf0a-edc5-42ec-9f3c-762c698783f1 req-51a720d5-3929-46d9-853c-7be89df904ff service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Refreshing instance network info cache due to event network-changed-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:03:02.684291 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4bc1bf0a-edc5-42ec-9f3c-762c698783f1 req-51a720d5-3929-46d9-853c-7be89df904ff service nova] Acquiring lock "refresh_cache-4baa35bb-b237-42be-aa8b-d9eeed7e41a0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:03:02.709567 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8d8c82ff-755c-40a8-98b3-25db79cb662b tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Lock "be4a8d87-07fc-4c56-a68d-c95e98e99184" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.269s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:02.992202 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-69c56951-1873-4546-94c5-e0eb5a84932d tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:03.041521 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:03:03.050687 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.002650915999765857 future=<Future at 0x73c1f4093b90 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:03.050687 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:03.050687 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=0.3914148630001364 future=<Future at 0x73c1fc6ab4a0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:03.050687 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=0.39134404200012796 future=<Future at 0x73c1fc6ab4a0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:03.227661 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-69c56951-1873-4546-94c5-e0eb5a84932d tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Updating instance_info_cache with network_info: [{"id": "a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39", "address": "fa:16:3e:05:9e:a2", "network": {"id": "2b7ff7fb-07d6-4791-9553-cb0a7a073e10", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2104350241-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12b4f42e155347e4a2055b151f04390a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f414a0-04", "ovs_interfaceid": "a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:03:03.258633 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Starting migrate_disk_and_power_off {{(pid=98321) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 28 10:03:03.295896 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:03.301661 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:03.321449 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:03.442663 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0004241649999130459 future=<Future at 0x73c1fc6ab4a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:03.442663 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:03.442663 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=6.8836426759999085 future=<Future at 0x73c1f41b5520 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:03.445514 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=6.883534374000192 future=<Future at 0x73c1f41b5520 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:03.445514 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Emitting event <LifecycleEvent: 1779962568.4419627, b90b1ecd-e640-4f4e-bd02-fb74021db82b => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:03:03.445514 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] VM Stopped (Lifecycle Event)
May 28 10:03:03.535375 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:03.546474 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:03.553027 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.963s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:03.554219 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.466s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:03.562564 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:03:03.563240 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Claim successful on node np0000001613
May 28 10:03:03.653251 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999564960999578 future=<Future at 0x73c1fc62d610 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:03.655258 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Instance destroyed successfully.
May 28 10:03:03.657097 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Deleted allocations for instance 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590
May 28 10:03:03.658993 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:01:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='multiattach-server-0',id=30,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrmebBJn1C7uIkB9JjrF4yuEuto77kf4SaBedfdmOdQwZzJyqrVQd0Wq/SA1eDV6FpWwBB4BKjLBcFgkvBrXSx4LeKHMUic/tPGA5px/F625klLXypbV+9p49FvQ4XImQ==',key_name='tempest-keypair-2082049331',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:02:06Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3403b533910644d2b254922fb84b1ac0',ramdisk_id='',reservation_id='r-apelrt3z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1052626787',owner_user_name='tempest-AttachVolumeMultiAttachTest-1052626787-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:02:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13481913e22d4bf1a94e1a9a270f5494',uuid=36fde791-779f-42a8-9aef-87eafbbe0370,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "address": "fa:16:3e:e1:06:59", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "vif_mac": "fa:16:3e:e1:06:59"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e857900-17", "ovs_interfaceid": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:03:03.659609 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converting VIF {"id": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "address": "fa:16:3e:e1:06:59", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "vif_mac": "fa:16:3e:e1:06:59"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e857900-17", "ovs_interfaceid": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:03:03.659969 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:06:59,bridge_name='br-int',has_traffic_filtering=True,id=0e857900-174b-46cf-bfa1-ce7f2f8ffdb1,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e857900-17') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:03:03.660215 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:06:59,bridge_name='br-int',has_traffic_filtering=True,id=0e857900-174b-46cf-bfa1-ce7f2f8ffdb1,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e857900-17') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:03:03.661480 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:03.662046 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e857900-17, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:03.665344 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:03.668491 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:03:03.679946 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:03.681147 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:03.681833 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=326392d8-fa46-4d23-b0c1-9dd0fae1fe8a) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:03.686145 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:03.687438 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:03:03.691539 np0000001613 nova-compute[98321]: INFO os_vif [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:06:59,bridge_name='br-int',has_traffic_filtering=True,id=0e857900-174b-46cf-bfa1-ce7f2f8ffdb1,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e857900-17')
May 28 10:03:03.730035 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-69c56951-1873-4546-94c5-e0eb5a84932d tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Releasing lock "refresh_cache-4baa35bb-b237-42be-aa8b-d9eeed7e41a0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:03:03.731325 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-69c56951-1873-4546-94c5-e0eb5a84932d tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lazy-loading 'flavor' on Instance uuid 4baa35bb-b237-42be-aa8b-d9eeed7e41a0 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:03:03.733105 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4bc1bf0a-edc5-42ec-9f3c-762c698783f1 req-51a720d5-3929-46d9-853c-7be89df904ff service nova] Acquired lock "refresh_cache-4baa35bb-b237-42be-aa8b-d9eeed7e41a0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:03:03.735042 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-4bc1bf0a-edc5-42ec-9f3c-762c698783f1 req-51a720d5-3929-46d9-853c-7be89df904ff service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Refreshing network info cache for port a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:03:03.948564 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-01de8efe-e0a4-4f21-b2e2-fb8d79b7e225 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b90b1ecd-e640-4f4e-bd02-fb74021db82b] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:03:04.238179 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-4bc1bf0a-edc5-42ec-9f3c-762c698783f1 req-51a720d5-3929-46d9-853c-7be89df904ff service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:04.258637 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Detected multiple connections on this host for volume: e8aeb4ed-7738-4054-b253-74e118c84fab, skipping target disconnect.
May 28 10:03:04.261759 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:04.295191 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:04.303416 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:04.315944 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:04.355150 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:04.356652 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:04.357292 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:04.446733 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e9351635-7fb2-4b14-981e-1d10fd7ef028 req-e64f2fa1-70bc-41e0-8002-0b2aa9c0f17f service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Received event network-vif-unplugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:04.447078 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e9351635-7fb2-4b14-981e-1d10fd7ef028 req-e64f2fa1-70bc-41e0-8002-0b2aa9c0f17f service nova] Acquiring lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:04.447684 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e9351635-7fb2-4b14-981e-1d10fd7ef028 req-e64f2fa1-70bc-41e0-8002-0b2aa9c0f17f service nova] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:04.447684 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e9351635-7fb2-4b14-981e-1d10fd7ef028 req-e64f2fa1-70bc-41e0-8002-0b2aa9c0f17f service nova] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:04.448234 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e9351635-7fb2-4b14-981e-1d10fd7ef028 req-e64f2fa1-70bc-41e0-8002-0b2aa9c0f17f service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] No waiting events found dispatching network-vif-unplugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:03:04.448468 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-e9351635-7fb2-4b14-981e-1d10fd7ef028 req-e64f2fa1-70bc-41e0-8002-0b2aa9c0f17f service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Received unexpected event network-vif-unplugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 for instance with vm_state rescued and task_state unrescuing.
May 28 10:03:04.470244 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:04.477584 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:04.477963 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:03:04.478940 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370_resize/disk /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:04.595841 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "cp -r /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370_resize/disk /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk" returned: 0 in 0.117s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:04.596433 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370_resize/disk.config /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk.config {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:04.637422 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999071303000164 future=<Future at 0x73c1f40d3770 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:04.654019 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Instance destroyed successfully.
May 28 10:03:04.655247 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-69c56951-1873-4546-94c5-e0eb5a84932d tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lazy-loading 'numa_topology' on Instance uuid 4baa35bb-b237-42be-aa8b-d9eeed7e41a0 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:03:04.671342 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "cp -r /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370_resize/disk.config /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk.config" returned: 0 in 0.075s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:04.671907 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370_resize/disk.info /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk.info {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:04.697022 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e8ab600c-d61f-4bf1-aaf3-354877a7704e tempest-ServerActionsV293TestJSON-1376389954 tempest-ServerActionsV293TestJSON-1376389954-project-member] Lock "9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.838s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:04.724073 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "cp -r /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370_resize/disk.info /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk.info" returned: 0 in 0.052s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:04.785566 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ef57bbd0-bc2f-4adf-a797-009616a0f84c req-b8e97045-43cd-4281-8e41-8653e7fc89d7 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Received event network-changed-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:04.786084 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ef57bbd0-bc2f-4adf-a797-009616a0f84c req-b8e97045-43cd-4281-8e41-8653e7fc89d7 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Refreshing instance network info cache due to event network-changed-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:03:04.786084 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ef57bbd0-bc2f-4adf-a797-009616a0f84c req-b8e97045-43cd-4281-8e41-8653e7fc89d7 service nova] Acquiring lock "refresh_cache-4baa35bb-b237-42be-aa8b-d9eeed7e41a0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:03:04.833295 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-4bc1bf0a-edc5-42ec-9f3c-762c698783f1 req-51a720d5-3929-46d9-853c-7be89df904ff service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:05.103340 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-4bc1bf0a-edc5-42ec-9f3c-762c698783f1 req-51a720d5-3929-46d9-853c-7be89df904ff service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Updated VIF entry in instance network info cache for port a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:03:05.103672 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-4bc1bf0a-edc5-42ec-9f3c-762c698783f1 req-51a720d5-3929-46d9-853c-7be89df904ff service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Updating instance_info_cache with network_info: [{"id": "a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39", "address": "fa:16:3e:05:9e:a2", "network": {"id": "2b7ff7fb-07d6-4791-9553-cb0a7a073e10", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2104350241-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12b4f42e155347e4a2055b151f04390a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f414a0-04", "ovs_interfaceid": "a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:03:05.162555 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-69c56951-1873-4546-94c5-e0eb5a84932d tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Object Instance<4baa35bb-b237-42be-aa8b-d9eeed7e41a0> lazy-loaded attributes: flavor,numa_topology {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:03:05.402998 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:03:05.403517 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:03:05.606747 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4bc1bf0a-edc5-42ec-9f3c-762c698783f1 req-51a720d5-3929-46d9-853c-7be89df904ff service nova] Releasing lock "refresh_cache-4baa35bb-b237-42be-aa8b-d9eeed7e41a0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:03:05.607384 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ef57bbd0-bc2f-4adf-a797-009616a0f84c req-b8e97045-43cd-4281-8e41-8653e7fc89d7 service nova] Acquired lock "refresh_cache-4baa35bb-b237-42be-aa8b-d9eeed7e41a0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:03:05.607819 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-ef57bbd0-bc2f-4adf-a797-009616a0f84c req-b8e97045-43cd-4281-8e41-8653e7fc89d7 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Refreshing network info cache for port a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:03:05.680918 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:05.710658 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:05.714261 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:05.804399 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:05.908648 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:03:05.949294 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:05.949664 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:06.091679 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Port 0e857900-174b-46cf-bfa1-ce7f2f8ffdb1 binding to destination host np0000001613 is already ACTIVE {{(pid=98321) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 28 10:03:06.110837 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-ef57bbd0-bc2f-4adf-a797-009616a0f84c req-b8e97045-43cd-4281-8e41-8653e7fc89d7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:06.116374 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:06.121440 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:06.125051 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:06.152396 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:06.427452 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.873s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:06.428176 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:03:06.535127 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-ef57bbd0-bc2f-4adf-a797-009616a0f84c req-b8e97045-43cd-4281-8e41-8653e7fc89d7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:06.539233 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cd5d7ce9-d7e9-4848-b0ca-1b6f3fdda1b0 req-b2e31777-5757-429d-8125-6e77d1ae6b89 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Received event network-vif-unplugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:06.539805 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cd5d7ce9-d7e9-4848-b0ca-1b6f3fdda1b0 req-b2e31777-5757-429d-8125-6e77d1ae6b89 service nova] Acquiring lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:06.540038 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cd5d7ce9-d7e9-4848-b0ca-1b6f3fdda1b0 req-b2e31777-5757-429d-8125-6e77d1ae6b89 service nova] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:06.540185 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cd5d7ce9-d7e9-4848-b0ca-1b6f3fdda1b0 req-b2e31777-5757-429d-8125-6e77d1ae6b89 service nova] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:06.540738 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cd5d7ce9-d7e9-4848-b0ca-1b6f3fdda1b0 req-b2e31777-5757-429d-8125-6e77d1ae6b89 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] No waiting events found dispatching network-vif-unplugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:03:06.540907 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-cd5d7ce9-d7e9-4848-b0ca-1b6f3fdda1b0 req-b2e31777-5757-429d-8125-6e77d1ae6b89 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Received unexpected event network-vif-unplugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 for instance with vm_state rescued and task_state unrescuing.
May 28 10:03:06.541085 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cd5d7ce9-d7e9-4848-b0ca-1b6f3fdda1b0 req-b2e31777-5757-429d-8125-6e77d1ae6b89 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Received event network-vif-plugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:06.544344 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cd5d7ce9-d7e9-4848-b0ca-1b6f3fdda1b0 req-b2e31777-5757-429d-8125-6e77d1ae6b89 service nova] Acquiring lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:06.544344 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cd5d7ce9-d7e9-4848-b0ca-1b6f3fdda1b0 req-b2e31777-5757-429d-8125-6e77d1ae6b89 service nova] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:06.544344 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cd5d7ce9-d7e9-4848-b0ca-1b6f3fdda1b0 req-b2e31777-5757-429d-8125-6e77d1ae6b89 service nova] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:06.544344 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cd5d7ce9-d7e9-4848-b0ca-1b6f3fdda1b0 req-b2e31777-5757-429d-8125-6e77d1ae6b89 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] No waiting events found dispatching network-vif-plugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:03:06.544344 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-cd5d7ce9-d7e9-4848-b0ca-1b6f3fdda1b0 req-b2e31777-5757-429d-8125-6e77d1ae6b89 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Received unexpected event network-vif-plugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 for instance with vm_state rescued and task_state unrescuing.
May 28 10:03:06.544344 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cd5d7ce9-d7e9-4848-b0ca-1b6f3fdda1b0 req-b2e31777-5757-429d-8125-6e77d1ae6b89 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Received event network-vif-plugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:06.544344 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cd5d7ce9-d7e9-4848-b0ca-1b6f3fdda1b0 req-b2e31777-5757-429d-8125-6e77d1ae6b89 service nova] Acquiring lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:06.544344 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cd5d7ce9-d7e9-4848-b0ca-1b6f3fdda1b0 req-b2e31777-5757-429d-8125-6e77d1ae6b89 service nova] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:06.544344 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cd5d7ce9-d7e9-4848-b0ca-1b6f3fdda1b0 req-b2e31777-5757-429d-8125-6e77d1ae6b89 service nova] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:06.544344 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cd5d7ce9-d7e9-4848-b0ca-1b6f3fdda1b0 req-b2e31777-5757-429d-8125-6e77d1ae6b89 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] No waiting events found dispatching network-vif-plugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:03:06.545405 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-cd5d7ce9-d7e9-4848-b0ca-1b6f3fdda1b0 req-b2e31777-5757-429d-8125-6e77d1ae6b89 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Received unexpected event network-vif-plugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 for instance with vm_state rescued and task_state unrescuing.
May 28 10:03:06.711533 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-ef57bbd0-bc2f-4adf-a797-009616a0f84c req-b8e97045-43cd-4281-8e41-8653e7fc89d7 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Updated VIF entry in instance network info cache for port a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:03:06.711847 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-ef57bbd0-bc2f-4adf-a797-009616a0f84c req-b8e97045-43cd-4281-8e41-8653e7fc89d7 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Updating instance_info_cache with network_info: [{"id": "a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39", "address": "fa:16:3e:05:9e:a2", "network": {"id": "2b7ff7fb-07d6-4791-9553-cb0a7a073e10", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2104350241-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12b4f42e155347e4a2055b151f04390a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f414a0-04", "ovs_interfaceid": "a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:03:06.716031 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Removed pending STOPPED event for 4baa35bb-b237-42be-aa8b-d9eeed7e41a0 due to new event <LifecycleEvent: 1779962586.7156334, 4baa35bb-b237-42be-aa8b-d9eeed7e41a0 => Resumed> {{(pid=98321) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 10:03:06.716244 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962586.7156334, 4baa35bb-b237-42be-aa8b-d9eeed7e41a0 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:03:06.716340 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] VM Resumed (Lifecycle Event)
May 28 10:03:06.718675 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-69c56951-1873-4546-94c5-e0eb5a84932d tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:03:06.908702 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:06.934864 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:03:06.935027 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:03:06.935315 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:06.936235 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:07.061655 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd3def75f0dd411888f23a2f432896b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd64b0e2ce54cac860344420cf9c5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:03:07.072560 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:07.102252 np0000001613 nova-compute[98321]: DEBUG nova.compute.rpcapi [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98321) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 10:03:07.112697 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "36fde791-779f-42a8-9aef-87eafbbe0370-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:07.113062 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "36fde791-779f-42a8-9aef-87eafbbe0370-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:07.113308 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "36fde791-779f-42a8-9aef-87eafbbe0370-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:07.215281 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ef57bbd0-bc2f-4adf-a797-009616a0f84c req-b8e97045-43cd-4281-8e41-8653e7fc89d7 service nova] Releasing lock "refresh_cache-4baa35bb-b237-42be-aa8b-d9eeed7e41a0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:03:07.215602 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ef57bbd0-bc2f-4adf-a797-009616a0f84c req-b8e97045-43cd-4281-8e41-8653e7fc89d7 service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Received event network-vif-unplugged-0e857900-174b-46cf-bfa1-ce7f2f8ffdb1 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:07.215940 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ef57bbd0-bc2f-4adf-a797-009616a0f84c req-b8e97045-43cd-4281-8e41-8653e7fc89d7 service nova] Acquiring lock "36fde791-779f-42a8-9aef-87eafbbe0370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:07.216144 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ef57bbd0-bc2f-4adf-a797-009616a0f84c req-b8e97045-43cd-4281-8e41-8653e7fc89d7 service nova] Lock "36fde791-779f-42a8-9aef-87eafbbe0370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:07.216424 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ef57bbd0-bc2f-4adf-a797-009616a0f84c req-b8e97045-43cd-4281-8e41-8653e7fc89d7 service nova] Lock "36fde791-779f-42a8-9aef-87eafbbe0370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:07.216495 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ef57bbd0-bc2f-4adf-a797-009616a0f84c req-b8e97045-43cd-4281-8e41-8653e7fc89d7 service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] No waiting events found dispatching network-vif-unplugged-0e857900-174b-46cf-bfa1-ce7f2f8ffdb1 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:03:07.217095 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-ef57bbd0-bc2f-4adf-a797-009616a0f84c req-b8e97045-43cd-4281-8e41-8653e7fc89d7 service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Received unexpected event network-vif-unplugged-0e857900-174b-46cf-bfa1-ce7f2f8ffdb1 for instance with vm_state active and task_state resize_migrating.
May 28 10:03:07.217095 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ef57bbd0-bc2f-4adf-a797-009616a0f84c req-b8e97045-43cd-4281-8e41-8653e7fc89d7 service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Received event network-vif-unplugged-0e857900-174b-46cf-bfa1-ce7f2f8ffdb1 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:07.217095 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ef57bbd0-bc2f-4adf-a797-009616a0f84c req-b8e97045-43cd-4281-8e41-8653e7fc89d7 service nova] Acquiring lock "36fde791-779f-42a8-9aef-87eafbbe0370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:07.217095 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ef57bbd0-bc2f-4adf-a797-009616a0f84c req-b8e97045-43cd-4281-8e41-8653e7fc89d7 service nova] Lock "36fde791-779f-42a8-9aef-87eafbbe0370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:07.217283 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ef57bbd0-bc2f-4adf-a797-009616a0f84c req-b8e97045-43cd-4281-8e41-8653e7fc89d7 service nova] Lock "36fde791-779f-42a8-9aef-87eafbbe0370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:07.217283 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ef57bbd0-bc2f-4adf-a797-009616a0f84c req-b8e97045-43cd-4281-8e41-8653e7fc89d7 service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] No waiting events found dispatching network-vif-unplugged-0e857900-174b-46cf-bfa1-ce7f2f8ffdb1 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:03:07.217446 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-ef57bbd0-bc2f-4adf-a797-009616a0f84c req-b8e97045-43cd-4281-8e41-8653e7fc89d7 service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Received unexpected event network-vif-unplugged-0e857900-174b-46cf-bfa1-ce7f2f8ffdb1 for instance with vm_state active and task_state resize_migrating.
May 28 10:03:07.220582 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:03:07.223452 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:03:07.441554 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:03:07.729304 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962587.7288418, 4baa35bb-b237-42be-aa8b-d9eeed7e41a0 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:03:07.729441 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] VM Started (Lifecycle Event)
May 28 10:03:07.893666 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Successfully created port: 08d656bf-1f8f-4bd8-b04a-27184a5225d5 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:03:07.948528 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:03:08.126145 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:08.214238 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "refresh_cache-36fde791-779f-42a8-9aef-87eafbbe0370" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:03:08.214901 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquired lock "refresh_cache-36fde791-779f-42a8-9aef-87eafbbe0370" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:03:08.214901 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:03:08.233575 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:03:08.239023 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:03:08.564279 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Successfully updated port: 08d656bf-1f8f-4bd8-b04a-27184a5225d5 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:03:08.627853 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-072b0cd0-8457-4a98-96c8-564320753613 req-a5a8e2e4-ded3-4b86-9689-2237e8a8a2f1 service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Received event network-changed-08d656bf-1f8f-4bd8-b04a-27184a5225d5 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:08.628214 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-072b0cd0-8457-4a98-96c8-564320753613 req-a5a8e2e4-ded3-4b86-9689-2237e8a8a2f1 service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Refreshing instance network info cache due to event network-changed-08d656bf-1f8f-4bd8-b04a-27184a5225d5. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:03:08.628214 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-072b0cd0-8457-4a98-96c8-564320753613 req-a5a8e2e4-ded3-4b86-9689-2237e8a8a2f1 service nova] Acquiring lock "refresh_cache-7ca4978c-d8a8-4ca2-81f3-63bc1e397615" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:03:08.628363 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-072b0cd0-8457-4a98-96c8-564320753613 req-a5a8e2e4-ded3-4b86-9689-2237e8a8a2f1 service nova] Acquired lock "refresh_cache-7ca4978c-d8a8-4ca2-81f3-63bc1e397615" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:03:08.628461 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-072b0cd0-8457-4a98-96c8-564320753613 req-a5a8e2e4-ded3-4b86-9689-2237e8a8a2f1 service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Refreshing network info cache for port 08d656bf-1f8f-4bd8-b04a-27184a5225d5 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:03:08.682022 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:08.717202 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:08.961886 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:03:08.964305 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:03:08.965682 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Creating image(s)
May 28 10:03:08.967193 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:08.967193 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "/opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:08.972863 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "/opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:08.974032 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:03:08.978649 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:03:08.982233 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:09.067909 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "refresh_cache-7ca4978c-d8a8-4ca2-81f3-63bc1e397615" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:03:09.108810 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.127s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:09.109373 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:09.109888 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:09.110511 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:03:09.119525 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:03:09.119902 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:09.139822 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-072b0cd0-8457-4a98-96c8-564320753613 req-a5a8e2e4-ded3-4b86-9689-2237e8a8a2f1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:09.217994 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.097s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:09.218143 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:09.245888 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.48 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:03:09.255788 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-072b0cd0-8457-4a98-96c8-564320753613 req-a5a8e2e4-ded3-4b86-9689-2237e8a8a2f1 service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:03:09.283973 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615/disk 1073741824" returned: 0 in 0.065s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:09.283973 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.174s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:09.283973 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:09.385016 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.101s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:09.385514 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:03:09.385792 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:09.474539 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:09.483494 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:09.484384 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Cannot resize image /opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:03:09.484852 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:03:09.485296 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Ensure instance console log exists: /opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:03:09.485512 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:09.485786 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:09.485984 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:09.513088 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-072b0cd0-8457-4a98-96c8-564320753613 req-a5a8e2e4-ded3-4b86-9689-2237e8a8a2f1 service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:03:09.532100 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:09.799089 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Updating instance_info_cache with network_info: [{"id": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "address": "fa:16:3e:e1:06:59", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e857900-17", "ovs_interfaceid": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:03:09.885752 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:09.893383 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Acquiring lock "60ce69b1-4c77-45a4-8975-bbba6924448d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:09.894216 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Lock "60ce69b1-4c77-45a4-8975-bbba6924448d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:10.017344 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-072b0cd0-8457-4a98-96c8-564320753613 req-a5a8e2e4-ded3-4b86-9689-2237e8a8a2f1 service nova] Releasing lock "refresh_cache-7ca4978c-d8a8-4ca2-81f3-63bc1e397615" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:03:10.018142 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquired lock "refresh_cache-7ca4978c-d8a8-4ca2-81f3-63bc1e397615" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:03:10.018374 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:03:10.302968 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Releasing lock "refresh_cache-36fde791-779f-42a8-9aef-87eafbbe0370" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:03:10.326935 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0004322730001149466 future=<Future at 0x73c1f41b5520 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:10.327235 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Emitting event <LifecycleEvent: 1779962575.326261, be4a8d87-07fc-4c56-a68d-c95e98e99184 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:03:10.327410 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:10.327589 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] VM Stopped (Lifecycle Event)
May 28 10:03:10.329390 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=1.377360944999964 future=<Future at 0x73c1f41b8950 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:10.329390 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=1.377245270000003 future=<Future at 0x73c1f41b8950 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:10.398580 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:03:10.623379 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:03:10.815009 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:03:10.831090 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:10.834103 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: be4a8d87-07fc-4c56-a68d-c95e98e99184] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:03:10.836365 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:03:10.858378 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:10.900902 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:03:10.901407 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:03:10.913899 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:03:10.916539 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fefd:30e7', 'fe80::e4df:c0ff:fe86:6341', 'fe80::ce2:7bff:fe0e:d096', 'fe80::fc16:3eff:fedb:1077', 'fe80::fc16:3eff:fee0:9ccd', 'fe80::fc16:3eff:fe3c:b7e1', 'fe80::fc16:3eff:fe86:604b', 'fe80::fc16:3eff:feaf:c736', 'fe80::24a6:e6ff:febf:f93c', 'fe80::fc16:3eff:fe24:b36a', 'fe80::fc16:3eff:fe5d:f989', 'fe80::fc16:3eff:fea3:f365', 'fe80::fc16:3eff:fee5:b9aa', 'fe80::fc16:3eff:feeb:2b41', 'fe80::8038:a7ff:fe21:5b5c', 'fe80::fc16:3eff:fed0:5ae8', 'fe80::7c9a:d6ff:fe01:2456', 'fe80::fc16:3eff:fe9e:2624', 'fe80::fc16:3eff:fe44:a72', 'fe80::fc16:3eff:fe05:9ea2', 'fe80::3037:7fff:fec8:89ce'] 
May 28 10:03:10.916792 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:03:10.916792 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:03:10.917716 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] <== get_connector_properties: return (102ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:03:10.974143 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:10.974500 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:10.979549 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:03:10.979723 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Claim successful on node np0000001613
May 28 10:03:11.072200 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Updating instance_info_cache with network_info: [{"id": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "address": "fa:16:3e:e9:42:eb", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d656bf-1f", "ovs_interfaceid": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:03:11.574598 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Releasing lock "refresh_cache-7ca4978c-d8a8-4ca2-81f3-63bc1e397615" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:03:11.575041 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Instance network_info: |[{"id": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "address": "fa:16:3e:e9:42:eb", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d656bf-1f", "ovs_interfaceid": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:03:11.580641 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Start _get_guest_xml network_info=[{"id": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "address": "fa:16:3e:e9:42:eb", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d656bf-1f", "ovs_interfaceid": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:03:11.586333 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:03:11.587010 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-1013676903', uuid='7ca4978c-d8a8-4ca2-81f3-63bc1e397615'), owner=OwnerMeta(userid='bd3def75f0dd411888f23a2f432896b0', username='tempest-AttachVolumeShelveTestJSON-1618900663-project-member', projectid='edd64b0e2ce54cac860344420cf9c5b6', projectname='tempest-AttachVolumeShelveTestJSON-1618900663'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "address": "fa:16:3e:e9:42:eb", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d656bf-1f", "ovs_interfaceid": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962591.5866501) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:03:11.588397 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:03:11.588771 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:03:11.590463 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:03:11.590463 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:03:11.591216 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:03:11.591634 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:03:11.591824 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:03:11.591946 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:03:11.592125 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:03:11.592286 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:03:11.592386 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:03:11.592579 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:03:11.592706 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:03:11.593360 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:03:11.593514 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:03:11.593672 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:03:11.614453 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1013676903',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumeshelvetestjson-server-1013676903',id=32,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHz2G0qwtG+p66QDfkgHp2vl8nrQQplJ9NHdbfClwRXi9vojNet9Hqu6l7KTsv5EeGVyPJRozCH7j4HE5omMIeof86ceGpj80eHZxOn83kxa204OWpaQyXSXj0b71RyAA==',key_name='tempest-keypair-1225597873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='edd64b0e2ce54cac860344420cf9c5b6',ramdisk_id='',reservation_id='r-1n6ox9bd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1618900663',owner_user_name='tempest-AttachVolumeShelveTestJSON-1618900663-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:03:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd3def75f0dd411888f23a2f432896b0',uuid=7ca4978c-d8a8-4ca2-81f3-63bc1e397615,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "address": "fa:16:3e:e9:42:eb", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d656bf-1f", "ovs_interfaceid": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:03:11.614756 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Converting VIF {"id": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "address": "fa:16:3e:e9:42:eb", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d656bf-1f", "ovs_interfaceid": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:03:11.615444 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:42:eb,bridge_name='br-int',has_traffic_filtering=True,id=08d656bf-1f8f-4bd8-b04a-27184a5225d5,network=Network(d262816b-8751-4e64-8f19-7d59ddaabc41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d656bf-1f') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:03:11.616107 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ca4978c-d8a8-4ca2-81f3-63bc1e397615 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:03:11.708720 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0027609829999164504 future=<Future at 0x73c1f41b8950 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:11.709476 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:11.709476 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=6.943520346999776 future=<Future at 0x73c1fc62d610 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:11.709663 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=6.94304192699974 future=<Future at 0x73c1fc62d610 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:11.709931 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-4ebe5eac-5fbf-4b5d-b47d-693e5a8cdb01 None None] Emitting event <LifecycleEvent: 1779962576.7058434, 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:03:11.710066 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-4ebe5eac-5fbf-4b5d-b47d-693e5a8cdb01 None None] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] VM Stopped (Lifecycle Event)
May 28 10:03:12.126185 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] End _get_guest_xml xml=<domain type="qemu">
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:   <uuid>7ca4978c-d8a8-4ca2-81f3-63bc1e397615</uuid>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:   <name>instance-00000020</name>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1013676903</nova:name>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:03:11</nova:creationTime>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:         <nova:user uuid="bd3def75f0dd411888f23a2f432896b0">tempest-AttachVolumeShelveTestJSON-1618900663-project-member</nova:user>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:         <nova:project uuid="edd64b0e2ce54cac860344420cf9c5b6">tempest-AttachVolumeShelveTestJSON-1618900663</nova:project>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:         <nova:port uuid="08d656bf-1f8f-4bd8-b04a-27184a5225d5">
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:     <system>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:       <entry name="serial">7ca4978c-d8a8-4ca2-81f3-63bc1e397615</entry>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:       <entry name="uuid">7ca4978c-d8a8-4ca2-81f3-63bc1e397615</entry>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:     </system>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:   <os>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:   </os>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:   <features>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:   </features>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:   <devices>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615/disk"/>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:     </disk>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615/disk.config"/>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:     </disk>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:e9:42:eb"/>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:       <target dev="tap08d656bf-1f"/>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:     </interface>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615/console.log" append="off"/>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:     </serial>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:     <video>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:     </video>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:     </rng>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:   </devices>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]: </domain>
May 28 10:03:12.126185 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:03:12.126185 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Preparing to wait for external event network-vif-plugged-08d656bf-1f8f-4bd8-b04a-27184a5225d5 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:03:12.126185 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:12.130539 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:12.130539 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:12.130539 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1013676903',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumeshelvetestjson-server-1013676903',id=32,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHz2G0qwtG+p66QDfkgHp2vl8nrQQplJ9NHdbfClwRXi9vojNet9Hqu6l7KTsv5EeGVyPJRozCH7j4HE5omMIeof86ceGpj80eHZxOn83kxa204OWpaQyXSXj0b71RyAA==',key_name='tempest-keypair-1225597873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='edd64b0e2ce54cac860344420cf9c5b6',ramdisk_id='',reservation_id='r-1n6ox9bd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1618900663',owner_user_name='tempest-AttachVolumeShelveTestJSON-1618900663-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:03:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd3def75f0dd411888f23a2f432896b0',uuid=7ca4978c-d8a8-4ca2-81f3-63bc1e397615,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "address": "fa:16:3e:e9:42:eb", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d656bf-1f", "ovs_interfaceid": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:03:12.130539 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Converting VIF {"id": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "address": "fa:16:3e:e9:42:eb", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d656bf-1f", "ovs_interfaceid": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:03:12.131354 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:42:eb,bridge_name='br-int',has_traffic_filtering=True,id=08d656bf-1f8f-4bd8-b04a-27184a5225d5,network=Network(d262816b-8751-4e64-8f19-7d59ddaabc41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d656bf-1f') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:03:12.131354 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:42:eb,bridge_name='br-int',has_traffic_filtering=True,id=08d656bf-1f8f-4bd8-b04a-27184a5225d5,network=Network(d262816b-8751-4e64-8f19-7d59ddaabc41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d656bf-1f') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:03:12.131629 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:12.131946 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:12.132255 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:03:12.133515 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:12.135740 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Starting finish_migration {{(pid=98321) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 28 10:03:12.136839 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Instance directory exists: not creating {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 10:03:12.138645 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9ffe9529-d411-5e62-aef8-91288d9fb1d4', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:12.139180 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Creating image(s)
May 28 10:03:12.141956 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:12.143394 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:03:12.158380 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:12.163444 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08d656bf-1f, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:12.163444 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap08d656bf-1f, col_values=(('qos', UUID('cf5b944e-c8bd-4e0f-8de8-68fde2888525')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:12.163731 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap08d656bf-1f, col_values=(('external_ids', {'iface-id': '08d656bf-1f8f-4bd8-b04a-27184a5225d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:42:eb', 'vm-uuid': '7ca4978c-d8a8-4ca2-81f3-63bc1e397615'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:12.168863 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:03:12.173476 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:12.175288 np0000001613 nova-compute[98321]: INFO os_vif [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:42:eb,bridge_name='br-int',has_traffic_filtering=True,id=08d656bf-1f8f-4bd8-b04a-27184a5225d5,network=Network(d262816b-8751-4e64-8f19-7d59ddaabc41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d656bf-1f')
May 28 10:03:12.212561 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-4ebe5eac-5fbf-4b5d-b47d-693e5a8cdb01 None None] [instance: 9b4c4c5b-de85-4dd9-8d29-e8b3c8e41590] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:03:12.264917 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.123s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:12.267660 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Checking if we can resize image /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:03:12.267660 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:12.343785 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:12.389219 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk --force-share --output=json" returned: 0 in 0.123s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:12.389591 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Cannot resize image /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:03:12.841292 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:03:12.841551 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:03:12.896480 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Did not create local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 10:03:12.896629 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Ensure instance console log exists: /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:03:12.897027 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:12.897188 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:12.897337 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:12.899992 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Start _get_guest_xml network_info=[{"id": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "address": "fa:16:3e:e1:06:59", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "vif_mac": "fa:16:3e:e1:06:59"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e857900-17", "ovs_interfaceid": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e8aeb4ed-7738-4054-b253-74e118c84fab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '36fde791-779f-42a8-9aef-87eafbbe0370', 'attached_at': '2026-05-28T10:03:11.000000', 'detached_at': '', 'volume_id': 'e8aeb4ed-7738-4054-b253-74e118c84fab', 'multiattach': True, 'serial': 'e8aeb4ed-7738-4054-b253-74e118c84fab'}, 'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': '874d486a-ef67-4c73-99bc-eb477ac48b53', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:03:12.907096 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:03:12.909116 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='36fde791-779f-42a8-9aef-87eafbbe0370'), owner=OwnerMeta(userid='13481913e22d4bf1a94e1a9a270f5494', username='tempest-AttachVolumeMultiAttachTest-1052626787-project-member', projectid='3403b533910644d2b254922fb84b1ac0', projectname='tempest-AttachVolumeMultiAttachTest-1052626787'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "address": "fa:16:3e:e1:06:59", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "vif_mac": "fa:16:3e:e1:06:59"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e857900-17", "ovs_interfaceid": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962592.9084682) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:03:12.910411 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:03:12.910951 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:03:12.912260 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:03:12.912328 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:03:12.913592 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:03:12.914408 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:03:12.914886 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:03:12.914886 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:03:12.915100 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:03:12.915611 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:03:12.915826 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:03:12.916111 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:03:12.916388 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:03:12.916583 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:03:12.917096 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:03:12.917096 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:03:12.933184 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk.config --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:13.033076 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk.config --force-share --output=json" returned: 0 in 0.098s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:13.033076 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "/opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:13.033076 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "/opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:13.033406 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "/opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:13.034912 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:03:13.034912 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e8aeb4ed-7738-4054-b253-74e118c84fab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:03:13.034912 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:03:13.034912 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:03:13.035127 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e8aeb4ed-7738-4054-b253-74e118c84fab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:03:13.050569 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:03:13.051074 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:03:13.051419 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:03:13.053611 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:03:13.054172 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:03:13.054439 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.startup = automatic
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.session.scan = manual
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:03:13.071802 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:03:13.071802 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.startup = automatic
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.session.scan = manual
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:03:13.078218 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:03:13.078218 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:03:13.088184 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:03:13.097938 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:03:13.107756 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:03:13.107756 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:03:13.107756 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:03:13.107756 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:03:13.107756 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:03:13.107756 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:03:13.107756 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:03:13.107756 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:03:13.107756 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:03:13.107756 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:03:13.107756 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:03:13.107756 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:03:13.107756 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:03:13.107756 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:03:13.107756 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:03:13.108785 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:03:13.108785 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:03:13.108785 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:03:13.108785 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:03:13.108785 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:03:13.108785 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:03:13.108785 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:03:13.108785 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:03:13.108785 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:03:13.108785 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:03:13.108785 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:03:13.108785 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:03:13.108785 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:03:13.108785 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:03:13.108785 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:03:13.108785 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.057s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:03:13.108785 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:03:13.110150 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] HCTL ('11', '0', '0', 0) found on session 59 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:03:13.110333 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Scanning host 11 c: 0, t: 0, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:03:13.120736 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Searching for a device in session 59 and hctl ('11', '0', '0', 0) yield: sdf {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:03:13.120965 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e8aeb4ed-7738-4054-b253-74e118c84fab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:03:13.122464 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:03:13.122464 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:03:13.122464 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:03:13.122464 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:03:13.122464 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:03:13.122464 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:03:13.122464 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:03:13.122464 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:03:13.122464 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:03:13.122464 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:03:13.122464 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:03:13.122464 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:03:13.122464 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:03:13.122464 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:03:13.122464 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:03:13.122927 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:03:13.122927 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:03:13.122927 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:03:13.122927 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:03:13.122927 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:03:13.122927 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:03:13.122927 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:03:13.122927 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:03:13.122927 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:03:13.122927 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:03:13.122927 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:03:13.122927 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:03:13.122927 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:03:13.122927 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:03:13.122927 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:03:13.123421 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.069s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:03:13.123421 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:03:13.123939 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] HCTL ('12', '0', '0', 0) found on session 60 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:03:13.124087 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Scanning host 12 c: 0, t: 0, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:03:13.136412 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Searching for a device in session 60 and hctl ('12', '0', '0', 0) yield: sdg {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:03:13.136772 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e8aeb4ed-7738-4054-b253-74e118c84fab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:03:13.345145 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:03:13.711487 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:03:13.711691 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:03:13.711862 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] No VIF found with MAC fa:16:3e:e9:42:eb, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:03:13.712619 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Using config drive
May 28 10:03:13.854004 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.879s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:13.854542 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:03:14.055858 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:03:14.220553 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:14.317861 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Acquiring lock "03313f66-d1dd-4269-b2e9-3b0796217299" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:14.318004 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "03313f66-d1dd-4269-b2e9-3b0796217299" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:14.319553 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Acquiring lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:14.319553 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:14.319553 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:14.320963 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Terminating instance
May 28 10:03:14.363284 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:03:14.363462 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:03:14.363711 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:14.363934 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:14.379737 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Creating config drive at /opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615/disk.config
May 28 10:03:14.387104 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpd2uoul5z {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:14.451210 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpd2uoul5z" returned: 0 in 0.064s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:14.457341 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5d30ab8162f645b5928317737d115d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0e2495daf24926a478a05961d90b35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:03:14.475661 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:14.644490 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:14.830180 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:03:14.855941 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:14.866694 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:14.867641 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:03:14.894761 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:14.907079 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:14.928330 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:14.931931 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:14.960834 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:15.038975 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:15.051226 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:15.080932 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Found WWN 330000000a8b99648 for multipath device dm-1 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:03:15.081486 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.046s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:03:15.081699 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] <== connect_volume: return (2046ms) {'type': 'block', 'scsi_wwn': '330000000a8b99648', 'path': '/dev/dm-1', 'multipath_id': '330000000a8b99648'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:03:15.081888 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a8b99648', 'path': '/dev/dm-1', 'multipath_id': '330000000a8b99648'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:03:15.140720 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Successfully created port: 3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:03:15.205193 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d9d6cd6a-6fca-4db7-9591-53d009c7e738 req-4d8b2a3a-fd67-4b3f-9af5-9094ca85c51f service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-vif-unplugged-12bb71f4-467b-4cc8-b164-f795401a0117 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:15.206484 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d9d6cd6a-6fca-4db7-9591-53d009c7e738 req-4d8b2a3a-fd67-4b3f-9af5-9094ca85c51f service nova] Acquiring lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:15.206801 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d9d6cd6a-6fca-4db7-9591-53d009c7e738 req-4d8b2a3a-fd67-4b3f-9af5-9094ca85c51f service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:15.206922 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d9d6cd6a-6fca-4db7-9591-53d009c7e738 req-4d8b2a3a-fd67-4b3f-9af5-9094ca85c51f service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:15.207041 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d9d6cd6a-6fca-4db7-9591-53d009c7e738 req-4d8b2a3a-fd67-4b3f-9af5-9094ca85c51f service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] No waiting events found dispatching network-vif-unplugged-12bb71f4-467b-4cc8-b164-f795401a0117 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:03:15.207156 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d9d6cd6a-6fca-4db7-9591-53d009c7e738 req-4d8b2a3a-fd67-4b3f-9af5-9094ca85c51f service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-vif-unplugged-12bb71f4-467b-4cc8-b164-f795401a0117 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:03:15.214061 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:15.225520 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:15.266972 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:15.272330 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:15.304790 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:15.380807 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:03:15.383917 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:15.540369 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999674995999612 future=<Future at 0x73c1f43509b0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:15.548442 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Instance destroyed successfully.
May 28 10:03:15.549143 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lazy-loading 'resources' on Instance uuid 03313f66-d1dd-4269-b2e9-3b0796217299 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:03:15.592625 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:01:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001613',hostname='multiattach-server-0',id=30,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrmebBJn1C7uIkB9JjrF4yuEuto77kf4SaBedfdmOdQwZzJyqrVQd0Wq/SA1eDV6FpWwBB4BKjLBcFgkvBrXSx4LeKHMUic/tPGA5px/F625klLXypbV+9p49FvQ4XImQ==',key_name='tempest-keypair-2082049331',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:02:06Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001613',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3403b533910644d2b254922fb84b1ac0',ramdisk_id='',reservation_id='r-apelrt3z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1052626787',owner_user_name='tempest-AttachVolumeMultiAttachTest-1052626787-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:03:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13481913e22d4bf1a94e1a9a270f5494',uuid=36fde791-779f-42a8-9aef-87eafbbe0370,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "address": "fa:16:3e:e1:06:59", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "vif_mac": "fa:16:3e:e1:06:59"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e857900-17", "ovs_interfaceid": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:03:15.592838 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converting VIF {"id": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "address": "fa:16:3e:e1:06:59", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "vif_mac": "fa:16:3e:e1:06:59"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e857900-17", "ovs_interfaceid": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:03:15.593670 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:06:59,bridge_name='br-int',has_traffic_filtering=True,id=0e857900-174b-46cf-bfa1-ce7f2f8ffdb1,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e857900-17') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:03:15.599438 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] End _get_guest_xml xml=<domain type="qemu">
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:   <uuid>36fde791-779f-42a8-9aef-87eafbbe0370</uuid>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:   <name>instance-0000001e</name>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:   <memory>262144</memory>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:       <nova:name>multiattach-server-0</nova:name>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:03:12</nova:creationTime>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.micro" id="84">
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:         <nova:memory>256</nova:memory>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:         <nova:user uuid="13481913e22d4bf1a94e1a9a270f5494">tempest-AttachVolumeMultiAttachTest-1052626787-project-member</nova:user>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:         <nova:project uuid="3403b533910644d2b254922fb84b1ac0">tempest-AttachVolumeMultiAttachTest-1052626787</nova:project>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:         <nova:port uuid="0e857900-174b-46cf-bfa1-ce7f2f8ffdb1">
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:     <system>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:       <entry name="serial">36fde791-779f-42a8-9aef-87eafbbe0370</entry>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:       <entry name="uuid">36fde791-779f-42a8-9aef-87eafbbe0370</entry>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:     </system>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:   <os>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:   </os>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:   <features>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:   </features>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:   <devices>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk"/>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:     </disk>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk.config"/>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:     </disk>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:       <alias name="ua-e8aeb4ed-7738-4054-b253-74e118c84fab"/>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-1"/>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:       <target dev="vdb" bus="virtio"/>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:       <serial>e8aeb4ed-7738-4054-b253-74e118c84fab</serial>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:       <shareable/>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:     </disk>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:e1:06:59"/>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:       <target dev="tap0e857900-17"/>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:     </interface>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/console.log" append="off"/>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:     </serial>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:     <video>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:     </video>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:     </rng>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:   </devices>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]: </domain>
May 28 10:03:15.599438 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:03:15.604872 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:01:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001613',hostname='multiattach-server-0',id=30,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrmebBJn1C7uIkB9JjrF4yuEuto77kf4SaBedfdmOdQwZzJyqrVQd0Wq/SA1eDV6FpWwBB4BKjLBcFgkvBrXSx4LeKHMUic/tPGA5px/F625klLXypbV+9p49FvQ4XImQ==',key_name='tempest-keypair-2082049331',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:02:06Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001613',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3403b533910644d2b254922fb84b1ac0',ramdisk_id='',reservation_id='r-apelrt3z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1052626787',owner_user_name='tempest-AttachVolumeMultiAttachTest-1052626787-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:03:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13481913e22d4bf1a94e1a9a270f5494',uuid=36fde791-779f-42a8-9aef-87eafbbe0370,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "address": "fa:16:3e:e1:06:59", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "vif_mac": "fa:16:3e:e1:06:59"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e857900-17", "ovs_interfaceid": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:03:15.604872 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converting VIF {"id": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "address": "fa:16:3e:e1:06:59", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "vif_mac": "fa:16:3e:e1:06:59"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e857900-17", "ovs_interfaceid": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:03:15.604872 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:06:59,bridge_name='br-int',has_traffic_filtering=True,id=0e857900-174b-46cf-bfa1-ce7f2f8ffdb1,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e857900-17') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:03:15.604872 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:06:59,bridge_name='br-int',has_traffic_filtering=True,id=0e857900-174b-46cf-bfa1-ce7f2f8ffdb1,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e857900-17') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:03:15.604872 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:15.604872 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:15.605316 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:03:15.610187 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:15.610187 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9b623a54-333d-5518-aa63-9967e370aac2', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:15.613269 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:15.615602 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:03:15.688454 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:15.700459 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:15.700459 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e857900-17, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:15.700459 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0e857900-17, col_values=(('qos', UUID('0cc65507-daf4-4bed-8eea-7dabf04c43b6')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:15.700459 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0e857900-17, col_values=(('external_ids', {'iface-id': '0e857900-174b-46cf-bfa1-ce7f2f8ffdb1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:06:59', 'vm-uuid': '36fde791-779f-42a8-9aef-87eafbbe0370'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:15.700922 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:15.702095 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:03:15.789190 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:15.789190 np0000001613 nova-compute[98321]: INFO os_vif [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:06:59,bridge_name='br-int',has_traffic_filtering=True,id=0e857900-174b-46cf-bfa1-ce7f2f8ffdb1,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e857900-17')
May 28 10:03:15.887059 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e0d648b8-b270-49d5-ad0f-741e9f53ee20 req-cbd1cf33-b457-49f4-8c65-7f9a7a277d36 service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Received event network-vif-plugged-08d656bf-1f8f-4bd8-b04a-27184a5225d5 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:15.893593 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e0d648b8-b270-49d5-ad0f-741e9f53ee20 req-cbd1cf33-b457-49f4-8c65-7f9a7a277d36 service nova] Acquiring lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:15.893593 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e0d648b8-b270-49d5-ad0f-741e9f53ee20 req-cbd1cf33-b457-49f4-8c65-7f9a7a277d36 service nova] Lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:15.893593 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e0d648b8-b270-49d5-ad0f-741e9f53ee20 req-cbd1cf33-b457-49f4-8c65-7f9a7a277d36 service nova] Lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:15.893593 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e0d648b8-b270-49d5-ad0f-741e9f53ee20 req-cbd1cf33-b457-49f4-8c65-7f9a7a277d36 service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Processing event network-vif-plugged-08d656bf-1f8f-4bd8-b04a-27184a5225d5 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:03:15.977391 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.024633 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.055353 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:01:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733955908',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-733955908',id=26,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDXMJyVhJWTJeHgrZbBiUGgXmjuhwbUVd2Kr7gMNTj4c2UOOPJTFYxL/+LAZETaDNBqelxft20PeTjvHZIXg32AtTWPekPM83zplKnShpnzBc89MemVKDq6yaEiiy5EMA==',key_name='tempest-keypair-328174998',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:02:04Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb5bac5cd317420ab74fc9f416a80e59',ramdisk_id='',reservation_id='r-mwck76pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1732945749',owner_user_name='tempest-TaggedBootDevicesTest-1732945749-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:02:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4253d01a8baa41978a589f90a58d945d',uuid=03313f66-d1dd-4269-b2e9-3b0796217299,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "12bb71f4-467b-4cc8-b164-f795401a0117", "address": "fa:16:3e:af:c7:36", "network": {"id": "1008534f-5c0f-4968-962e-d7e533fcc852", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1379747783-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12bb71f4-46", "ovs_interfaceid": "12bb71f4-467b-4cc8-b164-f795401a0117", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:03:16.055648 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converting VIF {"id": "12bb71f4-467b-4cc8-b164-f795401a0117", "address": "fa:16:3e:af:c7:36", "network": {"id": "1008534f-5c0f-4968-962e-d7e533fcc852", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1379747783-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap12bb71f4-46", "ovs_interfaceid": "12bb71f4-467b-4cc8-b164-f795401a0117", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:03:16.057551 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:c7:36,bridge_name='br-int',has_traffic_filtering=True,id=12bb71f4-467b-4cc8-b164-f795401a0117,network=Network(1008534f-5c0f-4968-962e-d7e533fcc852),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12bb71f4-46') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:03:16.061584 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:c7:36,bridge_name='br-int',has_traffic_filtering=True,id=12bb71f4-467b-4cc8-b164-f795401a0117,network=Network(1008534f-5c0f-4968-962e-d7e533fcc852),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12bb71f4-46') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:03:16.062956 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.067654 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap12bb71f4-46, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:16.067654 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.067654 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:03:16.070352 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Successfully updated port: 3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:03:16.090192 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.124722 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8608f729-03d4-46d7-b900-d8f2f7a514d5 req-99a957c8-51f4-4d09-884c-2e0d5697ff53 service nova] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Received event network-changed-3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:16.126205 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8608f729-03d4-46d7-b900-d8f2f7a514d5 req-99a957c8-51f4-4d09-884c-2e0d5697ff53 service nova] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Refreshing instance network info cache due to event network-changed-3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:03:16.126205 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8608f729-03d4-46d7-b900-d8f2f7a514d5 req-99a957c8-51f4-4d09-884c-2e0d5697ff53 service nova] Acquiring lock "refresh_cache-60ce69b1-4c77-45a4-8975-bbba6924448d" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:03:16.126205 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8608f729-03d4-46d7-b900-d8f2f7a514d5 req-99a957c8-51f4-4d09-884c-2e0d5697ff53 service nova] Acquired lock "refresh_cache-60ce69b1-4c77-45a4-8975-bbba6924448d" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:03:16.126205 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-8608f729-03d4-46d7-b900-d8f2f7a514d5 req-99a957c8-51f4-4d09-884c-2e0d5697ff53 service nova] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Refreshing network info cache for port 3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:03:16.132285 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.135477 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.135477 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=95715f00-567d-4c53-92c1-363de7e74572) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:16.137322 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:03:16.166466 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962596.1646078, 7ca4978c-d8a8-4ca2-81f3-63bc1e397615 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:03:16.166466 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] VM Started (Lifecycle Event)
May 28 10:03:16.166738 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:03:16.173026 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.174078 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:03:16.178654 np0000001613 nova-compute[98321]: INFO os_vif [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:c7:36,bridge_name='br-int',has_traffic_filtering=True,id=12bb71f4-467b-4cc8-b164-f795401a0117,network=Network(1008534f-5c0f-4968-962e-d7e533fcc852),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12bb71f4-46')
May 28 10:03:16.179234 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:01:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733955908',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-733955908',id=26,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDXMJyVhJWTJeHgrZbBiUGgXmjuhwbUVd2Kr7gMNTj4c2UOOPJTFYxL/+LAZETaDNBqelxft20PeTjvHZIXg32AtTWPekPM83zplKnShpnzBc89MemVKDq6yaEiiy5EMA==',key_name='tempest-keypair-328174998',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:02:04Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb5bac5cd317420ab74fc9f416a80e59',ramdisk_id='',reservation_id='r-mwck76pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1732945749',owner_user_name='tempest-TaggedBootDevicesTest-1732945749-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:02:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4253d01a8baa41978a589f90a58d945d',uuid=03313f66-d1dd-4269-b2e9-3b0796217299,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f218cf2-d351-42a5-8b44-3e7ee9417bbd", "address": "fa:16:3e:24:b3:6a", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f218cf2-d3", "ovs_interfaceid": "9f218cf2-d351-42a5-8b44-3e7ee9417bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:03:16.179414 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converting VIF {"id": "9f218cf2-d351-42a5-8b44-3e7ee9417bbd", "address": "fa:16:3e:24:b3:6a", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f218cf2-d3", "ovs_interfaceid": "9f218cf2-d351-42a5-8b44-3e7ee9417bbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:03:16.179813 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:b3:6a,bridge_name='br-int',has_traffic_filtering=True,id=9f218cf2-d351-42a5-8b44-3e7ee9417bbd,network=Network(7c6d76e7-89ec-4a10-a21c-11c44b491f29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9f218cf2-d3') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:03:16.180008 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:b3:6a,bridge_name='br-int',has_traffic_filtering=True,id=9f218cf2-d351-42a5-8b44-3e7ee9417bbd,network=Network(7c6d76e7-89ec-4a10-a21c-11c44b491f29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9f218cf2-d3') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:03:16.180708 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Instance spawned successfully.
May 28 10:03:16.181361 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:03:16.185954 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.187153 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f218cf2-d3, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:16.190663 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.190663 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:03:16.219942 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.220638 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.220863 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b8d62d80-53eb-4411-a6bc-7885ffb9cf1d) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:16.222212 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.222741 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:03:16.252399 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.256218 np0000001613 nova-compute[98321]: INFO os_vif [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:b3:6a,bridge_name='br-int',has_traffic_filtering=True,id=9f218cf2-d351-42a5-8b44-3e7ee9417bbd,network=Network(7c6d76e7-89ec-4a10-a21c-11c44b491f29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9f218cf2-d3')
May 28 10:03:16.257283 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:01:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733955908',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-733955908',id=26,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDXMJyVhJWTJeHgrZbBiUGgXmjuhwbUVd2Kr7gMNTj4c2UOOPJTFYxL/+LAZETaDNBqelxft20PeTjvHZIXg32AtTWPekPM83zplKnShpnzBc89MemVKDq6yaEiiy5EMA==',key_name='tempest-keypair-328174998',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:02:04Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb5bac5cd317420ab74fc9f416a80e59',ramdisk_id='',reservation_id='r-mwck76pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1732945749',owner_user_name='tempest-TaggedBootDevicesTest-1732945749-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:02:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4253d01a8baa41978a589f90a58d945d',uuid=03313f66-d1dd-4269-b2e9-3b0796217299,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2c9fb75-0a9e-47cb-a561-effaa19b4156", "address": "fa:16:3e:5d:f9:89", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c9fb75-0a", "ovs_interfaceid": "c2c9fb75-0a9e-47cb-a561-effaa19b4156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:03:16.259201 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converting VIF {"id": "c2c9fb75-0a9e-47cb-a561-effaa19b4156", "address": "fa:16:3e:5d:f9:89", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c9fb75-0a", "ovs_interfaceid": "c2c9fb75-0a9e-47cb-a561-effaa19b4156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:03:16.259201 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:f9:89,bridge_name='br-int',has_traffic_filtering=True,id=c2c9fb75-0a9e-47cb-a561-effaa19b4156,network=Network(7c6d76e7-89ec-4a10-a21c-11c44b491f29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc2c9fb75-0a') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:03:16.259201 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:f9:89,bridge_name='br-int',has_traffic_filtering=True,id=c2c9fb75-0a9e-47cb-a561-effaa19b4156,network=Network(7c6d76e7-89ec-4a10-a21c-11c44b491f29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc2c9fb75-0a') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:03:16.261178 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.261481 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2c9fb75-0a, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:16.263409 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.264230 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:03:16.283413 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.320651 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.323988 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.324200 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ea1c2fc7-90d3-451e-937f-d0a2d4ddf449) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:16.324769 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.325371 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:03:16.349112 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.380583 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.384044 np0000001613 nova-compute[98321]: INFO os_vif [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:f9:89,bridge_name='br-int',has_traffic_filtering=True,id=c2c9fb75-0a9e-47cb-a561-effaa19b4156,network=Network(7c6d76e7-89ec-4a10-a21c-11c44b491f29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc2c9fb75-0a')
May 28 10:03:16.384915 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:01:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733955908',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-733955908',id=26,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDXMJyVhJWTJeHgrZbBiUGgXmjuhwbUVd2Kr7gMNTj4c2UOOPJTFYxL/+LAZETaDNBqelxft20PeTjvHZIXg32AtTWPekPM83zplKnShpnzBc89MemVKDq6yaEiiy5EMA==',key_name='tempest-keypair-328174998',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:02:04Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb5bac5cd317420ab74fc9f416a80e59',ramdisk_id='',reservation_id='r-mwck76pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1732945749',owner_user_name='tempest-TaggedBootDevicesTest-1732945749-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:02:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4253d01a8baa41978a589f90a58d945d',uuid=03313f66-d1dd-4269-b2e9-3b0796217299,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5", "address": "fa:16:3e:a3:f3:65", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7db2f4e-c4", "ovs_interfaceid": "d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:03:16.385148 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converting VIF {"id": "d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5", "address": "fa:16:3e:a3:f3:65", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7db2f4e-c4", "ovs_interfaceid": "d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:03:16.385844 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:f3:65,bridge_name='br-int',has_traffic_filtering=True,id=d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5,network=Network(7c6d76e7-89ec-4a10-a21c-11c44b491f29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7db2f4e-c4') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:03:16.386218 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:f3:65,bridge_name='br-int',has_traffic_filtering=True,id=d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5,network=Network(7c6d76e7-89ec-4a10-a21c-11c44b491f29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7db2f4e-c4') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:03:16.387579 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.387787 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd7db2f4e-c4, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:16.388897 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.389862 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:03:16.395306 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:03:16.397569 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:03:16.397781 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Creating image(s)
May 28 10:03:16.398210 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Acquiring lock "/opt/stack/data/nova/instances/60ce69b1-4c77-45a4-8975-bbba6924448d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:16.398370 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Lock "/opt/stack/data/nova/instances/60ce69b1-4c77-45a4-8975-bbba6924448d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:16.398887 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Lock "/opt/stack/data/nova/instances/60ce69b1-4c77-45a4-8975-bbba6924448d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:16.399140 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:03:16.401559 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:03:16.402696 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:16.436518 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.438288 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.438504 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2730f843-e942-46bd-b91b-a5cd2a26680e) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:16.439481 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.440140 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:03:16.459956 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.464961 np0000001613 nova-compute[98321]: INFO os_vif [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:f3:65,bridge_name='br-int',has_traffic_filtering=True,id=d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5,network=Network(7c6d76e7-89ec-4a10-a21c-11c44b491f29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7db2f4e-c4')
May 28 10:03:16.466052 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:01:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733955908',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-733955908',id=26,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDXMJyVhJWTJeHgrZbBiUGgXmjuhwbUVd2Kr7gMNTj4c2UOOPJTFYxL/+LAZETaDNBqelxft20PeTjvHZIXg32AtTWPekPM83zplKnShpnzBc89MemVKDq6yaEiiy5EMA==',key_name='tempest-keypair-328174998',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:02:04Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb5bac5cd317420ab74fc9f416a80e59',ramdisk_id='',reservation_id='r-mwck76pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1732945749',owner_user_name='tempest-TaggedBootDevicesTest-1732945749-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:02:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4253d01a8baa41978a589f90a58d945d',uuid=03313f66-d1dd-4269-b2e9-3b0796217299,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd18fd3a-9dc5-4433-a638-72e5586eeb9c", "address": "fa:16:3e:e5:b9:aa", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd18fd3a-9d", "ovs_interfaceid": "fd18fd3a-9dc5-4433-a638-72e5586eeb9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:03:16.470456 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converting VIF {"id": "fd18fd3a-9dc5-4433-a638-72e5586eeb9c", "address": "fa:16:3e:e5:b9:aa", "network": {"id": "7c6d76e7-89ec-4a10-a21c-11c44b491f29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1276606018", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd18fd3a-9d", "ovs_interfaceid": "fd18fd3a-9dc5-4433-a638-72e5586eeb9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:03:16.470456 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:b9:aa,bridge_name='br-int',has_traffic_filtering=True,id=fd18fd3a-9dc5-4433-a638-72e5586eeb9c,network=Network(7c6d76e7-89ec-4a10-a21c-11c44b491f29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd18fd3a-9d') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:03:16.470456 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:b9:aa,bridge_name='br-int',has_traffic_filtering=True,id=fd18fd3a-9dc5-4433-a638-72e5586eeb9c,network=Network(7c6d76e7-89ec-4a10-a21c-11c44b491f29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd18fd3a-9d') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:03:16.471808 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.472015 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd18fd3a-9d, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:16.476396 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.477527 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:03:16.489442 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.490688 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.491184 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=61f27860-5982-421b-b3f2-6b7ff1e62509) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:16.492403 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.493098 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:03:16.508532 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.509714 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.107s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:16.510743 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:16.510743 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:16.511189 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:03:16.514852 np0000001613 nova-compute[98321]: INFO os_vif [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:b9:aa,bridge_name='br-int',has_traffic_filtering=True,id=fd18fd3a-9dc5-4433-a638-72e5586eeb9c,network=Network(7c6d76e7-89ec-4a10-a21c-11c44b491f29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd18fd3a-9d')
May 28 10:03:16.515874 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:03:16.516805 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:01:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733955908',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-733955908',id=26,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDXMJyVhJWTJeHgrZbBiUGgXmjuhwbUVd2Kr7gMNTj4c2UOOPJTFYxL/+LAZETaDNBqelxft20PeTjvHZIXg32AtTWPekPM83zplKnShpnzBc89MemVKDq6yaEiiy5EMA==',key_name='tempest-keypair-328174998',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:02:04Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb5bac5cd317420ab74fc9f416a80e59',ramdisk_id='',reservation_id='r-mwck76pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1732945749',owner_user_name='tempest-TaggedBootDevicesTest-1732945749-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:02:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4253d01a8baa41978a589f90a58d945d',uuid=03313f66-d1dd-4269-b2e9-3b0796217299,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc674202-2354-4a2d-bdcf-3faf31e8cc7d", "address": "fa:16:3e:eb:2b:41", "network": {"id": "da83acc7-b5da-4d42-bd74-8a3a51d2f657", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377824470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc674202-23", "ovs_interfaceid": "bc674202-2354-4a2d-bdcf-3faf31e8cc7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:03:16.517016 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converting VIF {"id": "bc674202-2354-4a2d-bdcf-3faf31e8cc7d", "address": "fa:16:3e:eb:2b:41", "network": {"id": "da83acc7-b5da-4d42-bd74-8a3a51d2f657", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377824470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc674202-23", "ovs_interfaceid": "bc674202-2354-4a2d-bdcf-3faf31e8cc7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:03:16.517587 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:2b:41,bridge_name='br-int',has_traffic_filtering=True,id=bc674202-2354-4a2d-bdcf-3faf31e8cc7d,network=Network(da83acc7-b5da-4d42-bd74-8a3a51d2f657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc674202-23') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:03:16.518128 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:2b:41,bridge_name='br-int',has_traffic_filtering=True,id=bc674202-2354-4a2d-bdcf-3faf31e8cc7d,network=Network(da83acc7-b5da-4d42-bd74-8a3a51d2f657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc674202-23') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:03:16.518757 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:16.537333 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.537333 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc674202-23, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:16.538549 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.542050 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:03:16.552417 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.554202 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.554565 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=87c2ee83-afcb-4d75-be40-81ec7a1a7160) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:16.555768 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.557691 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:03:16.568835 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.571126 np0000001613 nova-compute[98321]: INFO os_vif [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:2b:41,bridge_name='br-int',has_traffic_filtering=True,id=bc674202-2354-4a2d-bdcf-3faf31e8cc7d,network=Network(da83acc7-b5da-4d42-bd74-8a3a51d2f657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc674202-23')
May 28 10:03:16.572358 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:01:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733955908',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-device-tagging-server-733955908',id=26,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDXMJyVhJWTJeHgrZbBiUGgXmjuhwbUVd2Kr7gMNTj4c2UOOPJTFYxL/+LAZETaDNBqelxft20PeTjvHZIXg32AtTWPekPM83zplKnShpnzBc89MemVKDq6yaEiiy5EMA==',key_name='tempest-keypair-328174998',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:02:04Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb5bac5cd317420ab74fc9f416a80e59',ramdisk_id='',reservation_id='r-mwck76pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1732945749',owner_user_name='tempest-TaggedBootDevicesTest-1732945749-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:02:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4253d01a8baa41978a589f90a58d945d',uuid=03313f66-d1dd-4269-b2e9-3b0796217299,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44", "address": "fa:16:3e:d0:5a:e8", "network": {"id": "da83acc7-b5da-4d42-bd74-8a3a51d2f657", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377824470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd184f1f0-b1", "ovs_interfaceid": "d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:03:16.572686 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converting VIF {"id": "d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44", "address": "fa:16:3e:d0:5a:e8", "network": {"id": "da83acc7-b5da-4d42-bd74-8a3a51d2f657", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377824470", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eb5bac5cd317420ab74fc9f416a80e59", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd184f1f0-b1", "ovs_interfaceid": "d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:03:16.573567 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:5a:e8,bridge_name='br-int',has_traffic_filtering=True,id=d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44,network=Network(da83acc7-b5da-4d42-bd74-8a3a51d2f657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd184f1f0-b1') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:03:16.575015 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Acquiring lock "refresh_cache-60ce69b1-4c77-45a4-8975-bbba6924448d" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:03:16.575429 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:5a:e8,bridge_name='br-int',has_traffic_filtering=True,id=d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44,network=Network(da83acc7-b5da-4d42-bd74-8a3a51d2f657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd184f1f0-b1') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:03:16.578298 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.578298 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd184f1f0-b1, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:16.578822 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.581026 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:03:16.585675 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.587406 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.587742 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4acc2ae0-ce3f-4831-a3ad-88c3747f4978) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:16.588466 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.590665 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:03:16.595581 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:16.597371 np0000001613 nova-compute[98321]: INFO os_vif [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:5a:e8,bridge_name='br-int',has_traffic_filtering=True,id=d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44,network=Network(da83acc7-b5da-4d42-bd74-8a3a51d2f657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd184f1f0-b1')
May 28 10:03:16.600704 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:03:16.601262 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488', 'iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b8249ce3-d570-41ff-bcb4-97559f72c488', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:03:16.601521 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:03:16.602005 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:03:16.602448 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488', 'iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b8249ce3-d570-41ff-bcb4-97559f72c488', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:03:16.602670 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:03:16.623114 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.104s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:16.623391 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/60ce69b1-4c77-45a4-8975-bbba6924448d/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:16.638034 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-8608f729-03d4-46d7-b900-d8f2f7a514d5 req-99a957c8-51f4-4d09-884c-2e0d5697ff53 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:16.650873 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:03:16.650873 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:03:16.650873 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:03:16.650873 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:03:16.650873 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:03:16.650873 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:03:16.650873 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:03:16.650873 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:03:16.650873 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:03:16.650873 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:03:16.650873 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:03:16.650873 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:03:16.650873 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:03:16.650873 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:03:16.650873 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:03:16.651799 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:03:16.651799 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:03:16.651799 np0000001613 nova-compute[98321]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:03:16.651799 np0000001613 nova-compute[98321]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488 (non-flash)
May 28 10:03:16.651799 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:03:16.651799 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:03:16.651799 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:03:16.651799 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:03:16.651799 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:03:16.651799 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:03:16.651799 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:03:16.651799 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:03:16.651799 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:03:16.651799 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:03:16.651799 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:03:16.655523 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0', '45'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04', '49'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04', '50'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec', '58'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', '59'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', '60'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d', '61'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d', '62')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:03:16.655751 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488', '44')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:03:16.657558 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488', '43')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:03:16.661758 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1f403c680>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488'): ({'sdj'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:03:16.662075 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Removing multipathed devices sdj, sdk {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:03:16.663454 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Flush multipath device 3300000007ce8b511 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:03:16.671615 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:03:16.679794 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:03:16.682939 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/60ce69b1-4c77-45a4-8975-bbba6924448d/disk 1073741824" returned: 0 in 0.059s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:16.683735 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.173s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:16.684111 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:16.722740 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:03:16.729346 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:03:16.729777 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:03:16.729956 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:03:16.730214 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:03:16.730527 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:03:16.730836 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:03:16.777464 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:03:16.789552 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.105s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:16.790085 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Checking if we can resize image /opt/stack/data/nova/instances/60ce69b1-4c77-45a4-8975-bbba6924448d/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:03:16.792919 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ce69b1-4c77-45a4-8975-bbba6924448d/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:16.826544 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:03:16.828353 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:03:16.830570 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:03:16.845940 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:03:16.846283 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:03:16.857088 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-8608f729-03d4-46d7-b900-d8f2f7a514d5 req-99a957c8-51f4-4d09-884c-2e0d5697ff53 service nova] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:03:16.865313 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:03:16.903502 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ce69b1-4c77-45a4-8975-bbba6924448d/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:16.904200 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Cannot resize image /opt/stack/data/nova/instances/60ce69b1-4c77-45a4-8975-bbba6924448d/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:03:16.904463 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:03:16.905276 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Ensure instance console log exists: /opt/stack/data/nova/instances/60ce69b1-4c77-45a4-8975-bbba6924448d/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:03:16.905276 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:16.905349 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:16.905553 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:16.914453 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488, portal: 192.168.40.100,3260]
May 28 10:03:16.914453 np0000001613 nova-compute[98321]: Logout of [sid: 44, target: iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488, portal: 192.168.40.100,3260] successful.
May 28 10:03:16.914453 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:03:16.939858 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:03:16.958194 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:03:17.000561 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488, portal: 192.168.50.100,3260]
May 28 10:03:17.000561 np0000001613 nova-compute[98321]: Logout of [sid: 43, target: iqn.2023-03.storpool.com:os--volume-b8249ce3-d570-41ff-bcb4-97559f72c488, portal: 192.168.50.100,3260] successful.
May 28 10:03:17.000561 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:03:17.024644 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:03:17.025639 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.423s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:03:17.025639 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] <== disconnect_volume: return (423ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:03:17.025907 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:03:17.030212 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:03:17.030212 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0', 'iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '45364262-cab4-45b7-8f81-d8ccf73c75b0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:03:17.030407 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:03:17.030902 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:03:17.031215 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0', 'iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '45364262-cab4-45b7-8f81-d8ccf73c75b0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:03:17.031422 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:03:17.060934 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-8608f729-03d4-46d7-b900-d8f2f7a514d5 req-99a957c8-51f4-4d09-884c-2e0d5697ff53 service nova] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:03:17.066439 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:03:17.066439 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:03:17.066439 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:03:17.066439 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:03:17.066439 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:03:17.066439 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:03:17.066439 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:03:17.066439 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:03:17.066439 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:03:17.066439 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:03:17.066439 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:03:17.066439 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:03:17.066439 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:03:17.066841 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:03:17.066841 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:03:17.066841 np0000001613 nova-compute[98321]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:03:17.066841 np0000001613 nova-compute[98321]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0 (non-flash)
May 28 10:03:17.066841 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:03:17.066841 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:03:17.066841 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:03:17.066841 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:03:17.066841 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:03:17.066841 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:03:17.066841 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:03:17.066841 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:03:17.066841 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:03:17.067156 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0', '45'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04', '49'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04', '50'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec', '58'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', '59'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', '60'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d', '61'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d', '62')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:03:17.067156 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0', '46')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:03:17.068557 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0', '45')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:03:17.070139 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1f44923e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0'): ({'sdb'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:03:17.070569 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Removing multipathed devices sdb, sdc {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:03:17.070895 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Flush multipath device 33000000001195308 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:03:17.104579 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:03:17.159951 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:03:17.185951 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:03:17.186566 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962597.1861224, 7ca4978c-d8a8-4ca2-81f3-63bc1e397615 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:03:17.186754 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] VM Paused (Lifecycle Event)
May 28 10:03:17.210553 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:03:17.210727 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:03:17.212194 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:03:17.227713 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:03:17.227893 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:03:17.244497 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Took 8.28 seconds to spawn the instance on the hypervisor.
May 28 10:03:17.244669 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:03:17.245191 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:03:17.293029 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0, portal: 192.168.40.100,3260]
May 28 10:03:17.293029 np0000001613 nova-compute[98321]: Logout of [sid: 46, target: iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0, portal: 192.168.40.100,3260] successful.
May 28 10:03:17.293029 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:03:17.296626 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-vif-unplugged-12bb71f4-467b-4cc8-b164-f795401a0117 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:17.297124 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] Acquiring lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:17.300450 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:17.303906 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:17.303906 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] No waiting events found dispatching network-vif-unplugged-12bb71f4-467b-4cc8-b164-f795401a0117 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:03:17.303906 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-vif-unplugged-12bb71f4-467b-4cc8-b164-f795401a0117 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:03:17.303906 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-vif-unplugged-9f218cf2-d351-42a5-8b44-3e7ee9417bbd {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:17.303906 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] Acquiring lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:17.303906 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:17.303906 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:17.303906 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] No waiting events found dispatching network-vif-unplugged-9f218cf2-d351-42a5-8b44-3e7ee9417bbd {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:03:17.303906 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-vif-unplugged-9f218cf2-d351-42a5-8b44-3e7ee9417bbd for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:03:17.303906 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-vif-unplugged-9f218cf2-d351-42a5-8b44-3e7ee9417bbd {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:17.303906 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] Acquiring lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:17.303906 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:17.303906 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:17.304518 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] No waiting events found dispatching network-vif-unplugged-9f218cf2-d351-42a5-8b44-3e7ee9417bbd {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:03:17.309649 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-vif-unplugged-9f218cf2-d351-42a5-8b44-3e7ee9417bbd for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:03:17.309649 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-vif-unplugged-d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:17.309649 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] Acquiring lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:17.309649 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:17.310506 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:17.314003 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] No waiting events found dispatching network-vif-unplugged-d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:03:17.315876 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-vif-unplugged-d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:03:17.315876 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-vif-unplugged-d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:17.315876 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] Acquiring lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:17.315876 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:17.315876 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:17.315876 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] No waiting events found dispatching network-vif-unplugged-d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:03:17.315876 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-vif-unplugged-d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:03:17.315876 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-vif-unplugged-fd18fd3a-9dc5-4433-a638-72e5586eeb9c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:17.315876 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] Acquiring lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:17.315876 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:17.316301 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:17.316607 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] No waiting events found dispatching network-vif-unplugged-fd18fd3a-9dc5-4433-a638-72e5586eeb9c {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:03:17.316796 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-vif-unplugged-fd18fd3a-9dc5-4433-a638-72e5586eeb9c for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:03:17.316979 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-vif-unplugged-fd18fd3a-9dc5-4433-a638-72e5586eeb9c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:17.317156 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] Acquiring lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:17.317386 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:17.317550 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:17.317856 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] No waiting events found dispatching network-vif-unplugged-fd18fd3a-9dc5-4433-a638-72e5586eeb9c {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:03:17.318029 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a5cf11dd-7b1e-484f-9ab5-92e1d6f614a6 req-a2163108-a93d-444e-b473-09b188802a71 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-vif-unplugged-fd18fd3a-9dc5-4433-a638-72e5586eeb9c for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:03:17.323862 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:03:17.331018 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:03:17.331187 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:03:17.331840 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:03:17.331840 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No VIF found with MAC fa:16:3e:e1:06:59, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:03:17.331935 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Using config drive
May 28 10:03:17.339794 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:03:17.382761 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0, portal: 192.168.50.100,3260]
May 28 10:03:17.382761 np0000001613 nova-compute[98321]: Logout of [sid: 45, target: iqn.2023-03.storpool.com:os--volume-45364262-cab4-45b7-8f81-d8ccf73c75b0, portal: 192.168.50.100,3260] successful.
May 28 10:03:17.382761 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:03:17.409402 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:03:17.409599 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:03:17.410955 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] <== disconnect_volume: return (379ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:03:17.410955 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:03:17.411539 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:03:17.411876 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04', 'iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '714453c0-1620-406b-ae4c-f244696a4a04', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:03:17.412025 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:03:17.412540 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:03:17.412876 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04', 'iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '714453c0-1620-406b-ae4c-f244696a4a04', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:03:17.413070 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:03:17.447628 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:03:17.447628 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:03:17.447628 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:03:17.447628 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:03:17.447628 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:03:17.447628 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:03:17.447628 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:03:17.447628 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:03:17.447628 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:03:17.447628 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:03:17.447628 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:03:17.447942 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:03:17.447942 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:03:17.447942 np0000001613 nova-compute[98321]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:03:17.447942 np0000001613 nova-compute[98321]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04 (non-flash)
May 28 10:03:17.447942 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:03:17.447942 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:03:17.447942 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:03:17.447942 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:03:17.447942 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:03:17.447942 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:03:17.447942 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:03:17.449156 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04', '49'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04', '50'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec', '58'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', '59'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', '60'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d', '61'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d', '62')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:03:17.451341 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04', '50')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:03:17.452613 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04', '49')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:03:17.456332 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1f4717560>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04'): ({'sdm'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04'): ({'sdl'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:03:17.456644 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Removing multipathed devices sdl, sdm {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:03:17.456910 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Flush multipath device 3300000001f9fa0ab {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:03:17.498532 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:03:17.545489 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:03:17.563223 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8608f729-03d4-46d7-b900-d8f2f7a514d5 req-99a957c8-51f4-4d09-884c-2e0d5697ff53 service nova] Releasing lock "refresh_cache-60ce69b1-4c77-45a4-8975-bbba6924448d" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:03:17.563983 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Acquired lock "refresh_cache-60ce69b1-4c77-45a4-8975-bbba6924448d" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:03:17.563983 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:03:17.591825 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Checking to see if SCSI volumes sdl, sdm have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:03:17.591825 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] SCSI volumes sdl, sdm have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:03:17.592792 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Checking to see if device paths {'sdl', 'sdm'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:03:17.605773 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Device paths {'sdl', 'sdm'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:03:17.606521 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:03:17.626857 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:03:17.665049 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04, portal: 192.168.40.100,3260]
May 28 10:03:17.665049 np0000001613 nova-compute[98321]: Logout of [sid: 50, target: iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04, portal: 192.168.40.100,3260] successful.
May 28 10:03:17.665049 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:03:17.685214 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:03:17.691955 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:03:17.698103 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962597.6977882, 7ca4978c-d8a8-4ca2-81f3-63bc1e397615 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:03:17.698344 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] VM Resumed (Lifecycle Event)
May 28 10:03:17.703023 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:03:17.746192 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04, portal: 192.168.50.100,3260]
May 28 10:03:17.746192 np0000001613 nova-compute[98321]: Logout of [sid: 49, target: iqn.2023-03.storpool.com:os--volume-714453c0-1620-406b-ae4c-f244696a4a04, portal: 192.168.50.100,3260] successful.
May 28 10:03:17.746192 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:03:17.763933 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Took 16.76 seconds to build instance.
May 28 10:03:17.766406 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:03:17.766674 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:03:17.766777 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] <== disconnect_volume: return (355ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:03:17.766892 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:03:17.767253 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Deleting instance files /opt/stack/data/nova/instances/03313f66-d1dd-4269-b2e9-3b0796217299_del
May 28 10:03:17.767813 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Deletion of /opt/stack/data/nova/instances/03313f66-d1dd-4269-b2e9-3b0796217299_del complete
May 28 10:03:17.882215 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:17.912564 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:17.914831 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:17.975200 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ef004d05-dba5-4c35-a2b6-4c6116d95e94 req-2c3a75f4-fc41-4151-ad17-b24a79340607 service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Received event network-vif-plugged-08d656bf-1f8f-4bd8-b04a-27184a5225d5 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:17.976409 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ef004d05-dba5-4c35-a2b6-4c6116d95e94 req-2c3a75f4-fc41-4151-ad17-b24a79340607 service nova] Acquiring lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:17.976639 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ef004d05-dba5-4c35-a2b6-4c6116d95e94 req-2c3a75f4-fc41-4151-ad17-b24a79340607 service nova] Lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:17.976800 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ef004d05-dba5-4c35-a2b6-4c6116d95e94 req-2c3a75f4-fc41-4151-ad17-b24a79340607 service nova] Lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:17.976968 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ef004d05-dba5-4c35-a2b6-4c6116d95e94 req-2c3a75f4-fc41-4151-ad17-b24a79340607 service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] No waiting events found dispatching network-vif-plugged-08d656bf-1f8f-4bd8-b04a-27184a5225d5 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:03:17.977123 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-ef004d05-dba5-4c35-a2b6-4c6116d95e94 req-2c3a75f4-fc41-4151-ad17-b24a79340607 service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Received unexpected event network-vif-plugged-08d656bf-1f8f-4bd8-b04a-27184a5225d5 for instance with vm_state active and task_state None.
May 28 10:03:18.021811 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:18.075804 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:18.076894 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:18.157625 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:03:18.202227 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:03:18.206261 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:03:18.266999 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-16e8357f-36c7-4317-be20-e89eb20e7d31 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.280s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:18.275904 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Took 3.45 seconds to destroy the instance on the hypervisor.
May 28 10:03:18.277228 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:03:18.277461 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:03:18.277564 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:03:18.277791 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:18.390474 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:18.399411 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:18.603861 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Updating instance_info_cache with network_info: [{"id": "3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9", "address": "fa:16:3e:0f:38:13", "network": {"id": "6a2ed18f-61ae-4c1f-a1e3-ddfd8c254b01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-891009375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0e2495daf24926a478a05961d90b35", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea723e5-b4", "ovs_interfaceid": "3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:03:18.653298 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0005354480003916251 future=<Future at 0x73c1fc62d610 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:18.653653 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:18.654770 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] Emitting event <LifecycleEvent: 1779962583.6526167, 36fde791-779f-42a8-9aef-87eafbbe0370 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:03:18.654975 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=0.9801243510000859 future=<Future at 0x73c1f40d3770 state=cancelled>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:18.655212 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] VM Stopped (Lifecycle Event)
May 28 10:03:18.655961 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=0.9791080320001129 future=<Future at 0x73c1f40d3770 state=cancelled>) was cancelled while queued, skipping {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:18.656094 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:18.656273 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=11.88349688299968 future=<Future at 0x73c1f43509b0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:18.656370 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=11.883373272999961 future=<Future at 0x73c1f43509b0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:18.821676 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Removed pending STOPPED event for 36fde791-779f-42a8-9aef-87eafbbe0370 due to new event <LifecycleEvent: 1779962598.8212657, 36fde791-779f-42a8-9aef-87eafbbe0370 => Resumed> {{(pid=98321) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 10:03:18.821899 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962598.8212657, 36fde791-779f-42a8-9aef-87eafbbe0370 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:03:18.822012 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] VM Resumed (Lifecycle Event)
May 28 10:03:18.823193 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Instance event wait completed in 0 seconds for  {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:03:18.825867 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Instance running successfully.
May 28 10:03:18.827051 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Failed to set time: agent not configured {{(pid=98321) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 28 10:03:18.827263 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ce93b927-0e9b-44f9-a294-546ba2174d27 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] finish_migration finished successfully. {{(pid=98321) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 28 10:03:19.049098 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:19.049098 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:19.108728 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Releasing lock "refresh_cache-60ce69b1-4c77-45a4-8975-bbba6924448d" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:03:19.108728 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Instance network_info: |[{"id": "3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9", "address": "fa:16:3e:0f:38:13", "network": {"id": "6a2ed18f-61ae-4c1f-a1e3-ddfd8c254b01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-891009375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0e2495daf24926a478a05961d90b35", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea723e5-b4", "ovs_interfaceid": "3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:03:19.111206 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Start _get_guest_xml network_info=[{"id": "3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9", "address": "fa:16:3e:0f:38:13", "network": {"id": "6a2ed18f-61ae-4c1f-a1e3-ddfd8c254b01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-891009375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0e2495daf24926a478a05961d90b35", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea723e5-b4", "ovs_interfaceid": "3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:03:19.117058 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:03:19.118499 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-ServersNegativeTestJSON-server-681156522', uuid='60ce69b1-4c77-45a4-8975-bbba6924448d'), owner=OwnerMeta(userid='5d30ab8162f645b5928317737d115d63', username='tempest-ServersNegativeTestJSON-177803216-project-member', projectid='2a0e2495daf24926a478a05961d90b35', projectname='tempest-ServersNegativeTestJSON-177803216'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9", "address": "fa:16:3e:0f:38:13", "network": {"id": "6a2ed18f-61ae-4c1f-a1e3-ddfd8c254b01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-891009375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0e2495daf24926a478a05961d90b35", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea723e5-b4", "ovs_interfaceid": "3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962599.1180243) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:03:19.119889 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:03:19.120474 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:03:19.122001 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:03:19.122188 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:03:19.123325 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:03:19.123769 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:03:19.124022 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:03:19.124171 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:03:19.124372 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:03:19.124513 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:03:19.124614 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:03:19.124839 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:03:19.124839 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:03:19.124971 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:03:19.125080 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:03:19.125336 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:03:19.143321 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:03:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-681156522',display_name='tempest-ServersNegativeTestJSON-server-681156522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serversnegativetestjson-server-681156522',id=33,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a0e2495daf24926a478a05961d90b35',ramdisk_id='',reservation_id='r-h4ot5s9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-177803216',owner_user_name='tempest-ServersNegativeTestJSON-177803216-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:03:15Z,user_data=None,user_id='5d30ab8162f645b5928317737d115d63',uuid=60ce69b1-4c77-45a4-8975-bbba6924448d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9", "address": "fa:16:3e:0f:38:13", "network": {"id": "6a2ed18f-61ae-4c1f-a1e3-ddfd8c254b01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-891009375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0e2495daf24926a478a05961d90b35", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea723e5-b4", "ovs_interfaceid": "3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:03:19.143574 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Converting VIF {"id": "3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9", "address": "fa:16:3e:0f:38:13", "network": {"id": "6a2ed18f-61ae-4c1f-a1e3-ddfd8c254b01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-891009375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0e2495daf24926a478a05961d90b35", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea723e5-b4", "ovs_interfaceid": "3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:03:19.144645 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:38:13,bridge_name='br-int',has_traffic_filtering=True,id=3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9,network=Network(6a2ed18f-61ae-4c1f-a1e3-ddfd8c254b01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ea723e5-b4') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:03:19.145415 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Lazy-loading 'pci_devices' on Instance uuid 60ce69b1-4c77-45a4-8975-bbba6924448d {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:03:19.160618 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f559d4f1-8645-429d-ad0d-75354b11edd5 tempest-AttachVolumeNegativeTest-775348461 tempest-AttachVolumeNegativeTest-775348461-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:03:19.325372 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:03:19.327679 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:03:19.479207 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:19.551729 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:03:19.648315 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] End _get_guest_xml xml=<domain type="qemu">
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:   <uuid>60ce69b1-4c77-45a4-8975-bbba6924448d</uuid>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:   <name>instance-00000021</name>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:       <nova:name>tempest-ServersNegativeTestJSON-server-681156522</nova:name>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:03:19</nova:creationTime>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:         <nova:user uuid="5d30ab8162f645b5928317737d115d63">tempest-ServersNegativeTestJSON-177803216-project-member</nova:user>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:         <nova:project uuid="2a0e2495daf24926a478a05961d90b35">tempest-ServersNegativeTestJSON-177803216</nova:project>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:         <nova:port uuid="3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9">
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:     <system>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:       <entry name="serial">60ce69b1-4c77-45a4-8975-bbba6924448d</entry>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:       <entry name="uuid">60ce69b1-4c77-45a4-8975-bbba6924448d</entry>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:     </system>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:   <os>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:   </os>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:   <features>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:   </features>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:   <devices>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/60ce69b1-4c77-45a4-8975-bbba6924448d/disk"/>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:     </disk>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/60ce69b1-4c77-45a4-8975-bbba6924448d/disk.config"/>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:     </disk>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:0f:38:13"/>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:       <target dev="tap3ea723e5-b4"/>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:     </interface>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/60ce69b1-4c77-45a4-8975-bbba6924448d/console.log" append="off"/>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:     </serial>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:     <video>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:     </video>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:     </rng>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:   </devices>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]: </domain>
May 28 10:03:19.648315 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:03:19.655489 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Preparing to wait for external event network-vif-plugged-3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:03:19.655489 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Acquiring lock "60ce69b1-4c77-45a4-8975-bbba6924448d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:19.655489 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Lock "60ce69b1-4c77-45a4-8975-bbba6924448d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:19.655489 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Lock "60ce69b1-4c77-45a4-8975-bbba6924448d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:19.655489 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:03:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-681156522',display_name='tempest-ServersNegativeTestJSON-server-681156522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serversnegativetestjson-server-681156522',id=33,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a0e2495daf24926a478a05961d90b35',ramdisk_id='',reservation_id='r-h4ot5s9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-177803216',owner_user_name='tempest-ServersNegativeTestJSON-177803216-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:03:15Z,user_data=None,user_id='5d30ab8162f645b5928317737d115d63',uuid=60ce69b1-4c77-45a4-8975-bbba6924448d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9", "address": "fa:16:3e:0f:38:13", "network": {"id": "6a2ed18f-61ae-4c1f-a1e3-ddfd8c254b01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-891009375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0e2495daf24926a478a05961d90b35", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea723e5-b4", "ovs_interfaceid": "3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:03:19.655489 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Converting VIF {"id": "3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9", "address": "fa:16:3e:0f:38:13", "network": {"id": "6a2ed18f-61ae-4c1f-a1e3-ddfd8c254b01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-891009375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0e2495daf24926a478a05961d90b35", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea723e5-b4", "ovs_interfaceid": "3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:03:19.655489 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:38:13,bridge_name='br-int',has_traffic_filtering=True,id=3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9,network=Network(6a2ed18f-61ae-4c1f-a1e3-ddfd8c254b01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ea723e5-b4') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:03:19.655489 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:38:13,bridge_name='br-int',has_traffic_filtering=True,id=3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9,network=Network(6a2ed18f-61ae-4c1f-a1e3-ddfd8c254b01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ea723e5-b4') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:03:19.655489 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:19.655489 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:19.655489 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:03:19.655489 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:19.655489 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '76921036-e76e-5e20-a85b-47dd956670eb', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:19.658344 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:19.659852 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:03:19.663982 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:19.664334 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ea723e5-b4, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:19.665657 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ea723e5-b4, col_values=(('qos', UUID('83968221-b43b-453f-b0c8-8f5adecc351d')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:19.665657 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ea723e5-b4, col_values=(('external_ids', {'iface-id': '3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:38:13', 'vm-uuid': '60ce69b1-4c77-45a4-8975-bbba6924448d'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:19.668315 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:03:19.677989 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:19.679933 np0000001613 nova-compute[98321]: INFO os_vif [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:38:13,bridge_name='br-int',has_traffic_filtering=True,id=3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9,network=Network(6a2ed18f-61ae-4c1f-a1e3-ddfd8c254b01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ea723e5-b4')
May 28 10:03:19.830543 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 28 10:03:19.830886 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962599.8306448, 36fde791-779f-42a8-9aef-87eafbbe0370 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:03:19.831020 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] VM Started (Lifecycle Event)
May 28 10:03:19.840554 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-99e846be-3fae-4c0b-972d-477c163ad743 req-a5fcf673-e25f-4848-8924-1f51579838e6 service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Received event network-changed-08d656bf-1f8f-4bd8-b04a-27184a5225d5 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:19.843985 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-99e846be-3fae-4c0b-972d-477c163ad743 req-a5fcf673-e25f-4848-8924-1f51579838e6 service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Refreshing instance network info cache due to event network-changed-08d656bf-1f8f-4bd8-b04a-27184a5225d5. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:03:19.846607 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-99e846be-3fae-4c0b-972d-477c163ad743 req-a5fcf673-e25f-4848-8924-1f51579838e6 service nova] Acquiring lock "refresh_cache-7ca4978c-d8a8-4ca2-81f3-63bc1e397615" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:03:19.846607 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-99e846be-3fae-4c0b-972d-477c163ad743 req-a5fcf673-e25f-4848-8924-1f51579838e6 service nova] Acquired lock "refresh_cache-7ca4978c-d8a8-4ca2-81f3-63bc1e397615" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:03:19.846607 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-99e846be-3fae-4c0b-972d-477c163ad743 req-a5fcf673-e25f-4848-8924-1f51579838e6 service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Refreshing network info cache for port 08d656bf-1f8f-4bd8-b04a-27184a5225d5 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:03:19.925249 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d09c6e46-5944-475f-ac0e-5be57d01cc8f req-564b41af-a15d-4351-bb83-5ae017cf05ba service nova] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Received event network-vif-unplugged-3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:19.926031 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d09c6e46-5944-475f-ac0e-5be57d01cc8f req-564b41af-a15d-4351-bb83-5ae017cf05ba service nova] Acquiring lock "60ce69b1-4c77-45a4-8975-bbba6924448d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:19.927671 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d09c6e46-5944-475f-ac0e-5be57d01cc8f req-564b41af-a15d-4351-bb83-5ae017cf05ba service nova] Lock "60ce69b1-4c77-45a4-8975-bbba6924448d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:19.927671 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d09c6e46-5944-475f-ac0e-5be57d01cc8f req-564b41af-a15d-4351-bb83-5ae017cf05ba service nova] Lock "60ce69b1-4c77-45a4-8975-bbba6924448d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:19.927671 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d09c6e46-5944-475f-ac0e-5be57d01cc8f req-564b41af-a15d-4351-bb83-5ae017cf05ba service nova] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] No event matching network-vif-unplugged-3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9 in dict_keys([('network-vif-plugged', '3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9')]) {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 10:03:19.927671 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-d09c6e46-5944-475f-ac0e-5be57d01cc8f req-564b41af-a15d-4351-bb83-5ae017cf05ba service nova] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Received unexpected event network-vif-unplugged-3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9 for instance with vm_state building and task_state spawning.
May 28 10:03:20.129596 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:20.129945 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:20.135513 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:03:20.136389 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Claim successful on node np0000001613
May 28 10:03:20.335439 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:03:20.337137 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:03:20.352503 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-99e846be-3fae-4c0b-972d-477c163ad743 req-a5fcf673-e25f-4848-8924-1f51579838e6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:20.895204 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-99e846be-3fae-4c0b-972d-477c163ad743 req-a5fcf673-e25f-4848-8924-1f51579838e6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:21.150071 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-99e846be-3fae-4c0b-972d-477c163ad743 req-a5fcf673-e25f-4848-8924-1f51579838e6 service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Updated VIF entry in instance network info cache for port 08d656bf-1f8f-4bd8-b04a-27184a5225d5. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:03:21.150399 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-99e846be-3fae-4c0b-972d-477c163ad743 req-a5fcf673-e25f-4848-8924-1f51579838e6 service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Updating instance_info_cache with network_info: [{"id": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "address": "fa:16:3e:e9:42:eb", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d656bf-1f", "ovs_interfaceid": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:03:21.219876 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:03:21.221174 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:03:21.221174 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] No VIF found with MAC fa:16:3e:0f:38:13, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:03:21.221174 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Using config drive
May 28 10:03:21.603904 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-33f7eadd-0380-463b-be91-ce90bbd59041 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "36fde791-779f-42a8-9aef-87eafbbe0370" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:21.604100 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-33f7eadd-0380-463b-be91-ce90bbd59041 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "36fde791-779f-42a8-9aef-87eafbbe0370" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:21.604357 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-33f7eadd-0380-463b-be91-ce90bbd59041 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Going to confirm migration 3 {{(pid=98321) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 28 10:03:21.656508 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-99e846be-3fae-4c0b-972d-477c163ad743 req-a5fcf673-e25f-4848-8924-1f51579838e6 service nova] Releasing lock "refresh_cache-7ca4978c-d8a8-4ca2-81f3-63bc1e397615" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:03:21.738437 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:21.920008 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-523093e1-5ded-421e-be44-2b91acdd408d req-f7e5a6d4-fb8e-4c9d-80a2-757c73137455 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-vif-deleted-fd18fd3a-9dc5-4433-a638-72e5586eeb9c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:21.920436 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-523093e1-5ded-421e-be44-2b91acdd408d req-f7e5a6d4-fb8e-4c9d-80a2-757c73137455 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Neutron deleted interface fd18fd3a-9dc5-4433-a638-72e5586eeb9c; detaching it from the instance and deleting it from the info cache
May 28 10:03:21.922398 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-523093e1-5ded-421e-be44-2b91acdd408d req-f7e5a6d4-fb8e-4c9d-80a2-757c73137455 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Detach interface failed, port_id=fd18fd3a-9dc5-4433-a638-72e5586eeb9c, reason: Instance 03313f66-d1dd-4269-b2e9-3b0796217299 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:03:21.959421 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Creating config drive at /opt/stack/data/nova/instances/60ce69b1-4c77-45a4-8975-bbba6924448d/disk.config
May 28 10:03:21.963481 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/60ce69b1-4c77-45a4-8975-bbba6924448d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmprxrpqk1k {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:22.041341 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/60ce69b1-4c77-45a4-8975-bbba6924448d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmprxrpqk1k" returned: 0 in 0.078s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:22.069324 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-98a42a77-9351-479b-bc56-e20e349a0372 req-2760a16b-aa73-46e8-b0fa-b42b0ea56e33 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-vif-unplugged-bc674202-2354-4a2d-bdcf-3faf31e8cc7d {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:22.069506 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-98a42a77-9351-479b-bc56-e20e349a0372 req-2760a16b-aa73-46e8-b0fa-b42b0ea56e33 service nova] Acquiring lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:22.070094 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-98a42a77-9351-479b-bc56-e20e349a0372 req-2760a16b-aa73-46e8-b0fa-b42b0ea56e33 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:22.070094 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-98a42a77-9351-479b-bc56-e20e349a0372 req-2760a16b-aa73-46e8-b0fa-b42b0ea56e33 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:22.070094 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-98a42a77-9351-479b-bc56-e20e349a0372 req-2760a16b-aa73-46e8-b0fa-b42b0ea56e33 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] No waiting events found dispatching network-vif-unplugged-bc674202-2354-4a2d-bdcf-3faf31e8cc7d {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:03:22.070613 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-98a42a77-9351-479b-bc56-e20e349a0372 req-2760a16b-aa73-46e8-b0fa-b42b0ea56e33 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-vif-unplugged-bc674202-2354-4a2d-bdcf-3faf31e8cc7d for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:03:22.070787 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-98a42a77-9351-479b-bc56-e20e349a0372 req-2760a16b-aa73-46e8-b0fa-b42b0ea56e33 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-vif-deleted-d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:22.070976 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-98a42a77-9351-479b-bc56-e20e349a0372 req-2760a16b-aa73-46e8-b0fa-b42b0ea56e33 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Neutron deleted interface d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44; detaching it from the instance and deleting it from the info cache
May 28 10:03:22.075767 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-98a42a77-9351-479b-bc56-e20e349a0372 req-2760a16b-aa73-46e8-b0fa-b42b0ea56e33 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Detach interface failed, port_id=d184f1f0-b1f9-4c6f-a8d6-8e128f05bb44, reason: Instance 03313f66-d1dd-4269-b2e9-3b0796217299 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:03:22.076041 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-98a42a77-9351-479b-bc56-e20e349a0372 req-2760a16b-aa73-46e8-b0fa-b42b0ea56e33 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-vif-unplugged-bc674202-2354-4a2d-bdcf-3faf31e8cc7d {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:22.076888 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-98a42a77-9351-479b-bc56-e20e349a0372 req-2760a16b-aa73-46e8-b0fa-b42b0ea56e33 service nova] Acquiring lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:22.076888 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-98a42a77-9351-479b-bc56-e20e349a0372 req-2760a16b-aa73-46e8-b0fa-b42b0ea56e33 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:22.076888 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-98a42a77-9351-479b-bc56-e20e349a0372 req-2760a16b-aa73-46e8-b0fa-b42b0ea56e33 service nova] Lock "03313f66-d1dd-4269-b2e9-3b0796217299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:22.077031 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-98a42a77-9351-479b-bc56-e20e349a0372 req-2760a16b-aa73-46e8-b0fa-b42b0ea56e33 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] No waiting events found dispatching network-vif-unplugged-bc674202-2354-4a2d-bdcf-3faf31e8cc7d {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:03:22.077253 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-98a42a77-9351-479b-bc56-e20e349a0372 req-2760a16b-aa73-46e8-b0fa-b42b0ea56e33 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-vif-unplugged-bc674202-2354-4a2d-bdcf-3faf31e8cc7d for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:03:22.077412 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-98a42a77-9351-479b-bc56-e20e349a0372 req-2760a16b-aa73-46e8-b0fa-b42b0ea56e33 service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Received event network-vif-plugged-0e857900-174b-46cf-bfa1-ce7f2f8ffdb1 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:22.077707 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-98a42a77-9351-479b-bc56-e20e349a0372 req-2760a16b-aa73-46e8-b0fa-b42b0ea56e33 service nova] Acquiring lock "36fde791-779f-42a8-9aef-87eafbbe0370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:22.077889 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-98a42a77-9351-479b-bc56-e20e349a0372 req-2760a16b-aa73-46e8-b0fa-b42b0ea56e33 service nova] Lock "36fde791-779f-42a8-9aef-87eafbbe0370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:22.078024 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-98a42a77-9351-479b-bc56-e20e349a0372 req-2760a16b-aa73-46e8-b0fa-b42b0ea56e33 service nova] Lock "36fde791-779f-42a8-9aef-87eafbbe0370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:22.078206 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-98a42a77-9351-479b-bc56-e20e349a0372 req-2760a16b-aa73-46e8-b0fa-b42b0ea56e33 service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] No waiting events found dispatching network-vif-plugged-0e857900-174b-46cf-bfa1-ce7f2f8ffdb1 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:03:22.078355 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-98a42a77-9351-479b-bc56-e20e349a0372 req-2760a16b-aa73-46e8-b0fa-b42b0ea56e33 service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Received unexpected event network-vif-plugged-0e857900-174b-46cf-bfa1-ce7f2f8ffdb1 for instance with vm_state resized and task_state None.
May 28 10:03:22.078437 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-98a42a77-9351-479b-bc56-e20e349a0372 req-2760a16b-aa73-46e8-b0fa-b42b0ea56e33 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-vif-deleted-bc674202-2354-4a2d-bdcf-3faf31e8cc7d {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:22.078504 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-98a42a77-9351-479b-bc56-e20e349a0372 req-2760a16b-aa73-46e8-b0fa-b42b0ea56e33 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Neutron deleted interface bc674202-2354-4a2d-bdcf-3faf31e8cc7d; detaching it from the instance and deleting it from the info cache
May 28 10:03:22.083019 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-98a42a77-9351-479b-bc56-e20e349a0372 req-2760a16b-aa73-46e8-b0fa-b42b0ea56e33 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Detach interface failed, port_id=bc674202-2354-4a2d-bdcf-3faf31e8cc7d, reason: Instance 03313f66-d1dd-4269-b2e9-3b0796217299 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:03:22.084598 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-98a42a77-9351-479b-bc56-e20e349a0372 req-2760a16b-aa73-46e8-b0fa-b42b0ea56e33 service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Received event network-vif-plugged-0e857900-174b-46cf-bfa1-ce7f2f8ffdb1 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:22.084598 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-98a42a77-9351-479b-bc56-e20e349a0372 req-2760a16b-aa73-46e8-b0fa-b42b0ea56e33 service nova] Acquiring lock "36fde791-779f-42a8-9aef-87eafbbe0370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:22.084598 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-98a42a77-9351-479b-bc56-e20e349a0372 req-2760a16b-aa73-46e8-b0fa-b42b0ea56e33 service nova] Lock "36fde791-779f-42a8-9aef-87eafbbe0370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:22.084598 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-98a42a77-9351-479b-bc56-e20e349a0372 req-2760a16b-aa73-46e8-b0fa-b42b0ea56e33 service nova] Lock "36fde791-779f-42a8-9aef-87eafbbe0370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:22.084598 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-98a42a77-9351-479b-bc56-e20e349a0372 req-2760a16b-aa73-46e8-b0fa-b42b0ea56e33 service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] No waiting events found dispatching network-vif-plugged-0e857900-174b-46cf-bfa1-ce7f2f8ffdb1 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:03:22.084598 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-98a42a77-9351-479b-bc56-e20e349a0372 req-2760a16b-aa73-46e8-b0fa-b42b0ea56e33 service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Received unexpected event network-vif-plugged-0e857900-174b-46cf-bfa1-ce7f2f8ffdb1 for instance with vm_state resized and task_state None.
May 28 10:03:22.084598 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-98a42a77-9351-479b-bc56-e20e349a0372 req-2760a16b-aa73-46e8-b0fa-b42b0ea56e33 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-vif-deleted-d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:22.084598 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-98a42a77-9351-479b-bc56-e20e349a0372 req-2760a16b-aa73-46e8-b0fa-b42b0ea56e33 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Neutron deleted interface d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5; detaching it from the instance and deleting it from the info cache
May 28 10:03:22.085869 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-98a42a77-9351-479b-bc56-e20e349a0372 req-2760a16b-aa73-46e8-b0fa-b42b0ea56e33 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Detach interface failed, port_id=d7db2f4e-c42b-4d0c-ada3-8abb1d10ddf5, reason: Instance 03313f66-d1dd-4269-b2e9-3b0796217299 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:03:22.113531 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-33f7eadd-0380-463b-be91-ce90bbd59041 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:22.167287 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:03:22.167541 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:03:22.240717 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-33f7eadd-0380-463b-be91-ce90bbd59041 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:22.240968 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-33f7eadd-0380-463b-be91-ce90bbd59041 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "refresh_cache-36fde791-779f-42a8-9aef-87eafbbe0370" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:03:22.241182 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-33f7eadd-0380-463b-be91-ce90bbd59041 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquired lock "refresh_cache-36fde791-779f-42a8-9aef-87eafbbe0370" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:03:22.241437 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-33f7eadd-0380-463b-be91-ce90bbd59041 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:03:22.241589 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-33f7eadd-0380-463b-be91-ce90bbd59041 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lazy-loading 'info_cache' on Instance uuid 36fde791-779f-42a8-9aef-87eafbbe0370 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:03:22.570936 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:22.613875 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:22.673656 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:03:22.691614 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:23.039689 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:23.045209 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:23.050955 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:23.053689 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:03:23.081479 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:23.083550 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:23.182128 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.052s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:23.182693 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:03:23.248624 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-33f7eadd-0380-463b-be91-ce90bbd59041 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:23.524177 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962603.5236037, 60ce69b1-4c77-45a4-8975-bbba6924448d => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:03:23.524639 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] VM Started (Lifecycle Event)
May 28 10:03:23.566412 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Took 5.29 seconds to deallocate network for instance.
May 28 10:03:23.629766 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-33f7eadd-0380-463b-be91-ce90bbd59041 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:23.691748 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:03:23.692025 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:03:23.692333 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:23.693860 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:23.790748 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2c88efa7ed26463d928a0e4228dca6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d040c323b4b948803334de7c8ec44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:03:23.805634 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-33f7eadd-0380-463b-be91-ce90bbd59041 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Updating instance_info_cache with network_info: [{"id": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "address": "fa:16:3e:e1:06:59", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e857900-17", "ovs_interfaceid": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:03:24.027813 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:03:24.031404 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962604.031105, 60ce69b1-4c77-45a4-8975-bbba6924448d => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:03:24.031541 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] VM Paused (Lifecycle Event)
May 28 10:03:24.154464 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ed4d2c8f-f642-4ed8-b350-0640a494f690 req-04c8df58-3d1e-44f9-9571-37bf2deea752 service nova] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Received event network-vif-deleted-12bb71f4-467b-4cc8-b164-f795401a0117 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:24.155347 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ed4d2c8f-f642-4ed8-b350-0640a494f690 req-04c8df58-3d1e-44f9-9571-37bf2deea752 service nova] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Received event network-vif-plugged-3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:24.155347 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ed4d2c8f-f642-4ed8-b350-0640a494f690 req-04c8df58-3d1e-44f9-9571-37bf2deea752 service nova] Acquiring lock "60ce69b1-4c77-45a4-8975-bbba6924448d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:24.155347 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ed4d2c8f-f642-4ed8-b350-0640a494f690 req-04c8df58-3d1e-44f9-9571-37bf2deea752 service nova] Lock "60ce69b1-4c77-45a4-8975-bbba6924448d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:24.156458 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ed4d2c8f-f642-4ed8-b350-0640a494f690 req-04c8df58-3d1e-44f9-9571-37bf2deea752 service nova] Lock "60ce69b1-4c77-45a4-8975-bbba6924448d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:24.156749 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ed4d2c8f-f642-4ed8-b350-0640a494f690 req-04c8df58-3d1e-44f9-9571-37bf2deea752 service nova] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Processing event network-vif-plugged-3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:03:24.156830 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ed4d2c8f-f642-4ed8-b350-0640a494f690 req-04c8df58-3d1e-44f9-9571-37bf2deea752 service nova] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Received event network-vif-plugged-3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:24.157006 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ed4d2c8f-f642-4ed8-b350-0640a494f690 req-04c8df58-3d1e-44f9-9571-37bf2deea752 service nova] Acquiring lock "60ce69b1-4c77-45a4-8975-bbba6924448d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:24.157238 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ed4d2c8f-f642-4ed8-b350-0640a494f690 req-04c8df58-3d1e-44f9-9571-37bf2deea752 service nova] Lock "60ce69b1-4c77-45a4-8975-bbba6924448d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:24.158696 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:03:24.161467 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ed4d2c8f-f642-4ed8-b350-0640a494f690 req-04c8df58-3d1e-44f9-9571-37bf2deea752 service nova] Lock "60ce69b1-4c77-45a4-8975-bbba6924448d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:24.161721 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ed4d2c8f-f642-4ed8-b350-0640a494f690 req-04c8df58-3d1e-44f9-9571-37bf2deea752 service nova] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] No waiting events found dispatching network-vif-plugged-3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:03:24.161897 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-ed4d2c8f-f642-4ed8-b350-0640a494f690 req-04c8df58-3d1e-44f9-9571-37bf2deea752 service nova] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Received unexpected event network-vif-plugged-3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9 for instance with vm_state building and task_state spawning.
May 28 10:03:24.162577 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:03:24.167591 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Instance spawned successfully.
May 28 10:03:24.169759 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:03:24.195533 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:03:24.310110 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-33f7eadd-0380-463b-be91-ce90bbd59041 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Releasing lock "refresh_cache-36fde791-779f-42a8-9aef-87eafbbe0370" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:03:24.310110 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-33f7eadd-0380-463b-be91-ce90bbd59041 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lazy-loading 'migration_context' on Instance uuid 36fde791-779f-42a8-9aef-87eafbbe0370 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:03:24.441914 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Successfully created port: dc1640f1-0633-403e-8f70-6a6d90053cfc {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:03:24.480225 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:24.534062 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:03:24.537082 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962604.5368059, 60ce69b1-4c77-45a4-8975-bbba6924448d => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:03:24.537288 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] VM Resumed (Lifecycle Event)
May 28 10:03:24.666810 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:24.674290 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:03:24.674470 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:03:24.674787 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:03:24.675065 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:03:24.675422 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:03:24.675715 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:03:24.699524 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:03:24.813190 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-33f7eadd-0380-463b-be91-ce90bbd59041 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Object Instance<36fde791-779f-42a8-9aef-87eafbbe0370> lazy-loaded attributes: info_cache,migration_context {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:03:24.818689 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-33f7eadd-0380-463b-be91-ce90bbd59041 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:24.819008 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-33f7eadd-0380-463b-be91-ce90bbd59041 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:25.000594 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Successfully updated port: dc1640f1-0633-403e-8f70-6a6d90053cfc {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:03:25.039973 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:03:25.042178 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:03:25.061115 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c9bb1114-1759-4651-ac69-5d99d1fbbbdd req-74b7e422-e6d1-4222-89c3-3defe5e6c120 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Received event network-changed-dc1640f1-0633-403e-8f70-6a6d90053cfc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:25.061391 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c9bb1114-1759-4651-ac69-5d99d1fbbbdd req-74b7e422-e6d1-4222-89c3-3defe5e6c120 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Refreshing instance network info cache due to event network-changed-dc1640f1-0633-403e-8f70-6a6d90053cfc. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:03:25.066483 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c9bb1114-1759-4651-ac69-5d99d1fbbbdd req-74b7e422-e6d1-4222-89c3-3defe5e6c120 service nova] Acquiring lock "refresh_cache-2641ee65-c9c2-401d-b511-6ecc1247a3ad" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:03:25.066737 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c9bb1114-1759-4651-ac69-5d99d1fbbbdd req-74b7e422-e6d1-4222-89c3-3defe5e6c120 service nova] Acquired lock "refresh_cache-2641ee65-c9c2-401d-b511-6ecc1247a3ad" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:03:25.067073 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-c9bb1114-1759-4651-ac69-5d99d1fbbbdd req-74b7e422-e6d1-4222-89c3-3defe5e6c120 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Refreshing network info cache for port dc1640f1-0633-403e-8f70-6a6d90053cfc {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:03:25.180922 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Took 8.78 seconds to spawn the instance on the hypervisor.
May 28 10:03:25.181483 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:03:25.317886 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Took 1.75 seconds to detach 3 volumes for instance.
May 28 10:03:25.503018 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "refresh_cache-2641ee65-c9c2-401d-b511-6ecc1247a3ad" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:03:25.544751 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:03:25.569398 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-c9bb1114-1759-4651-ac69-5d99d1fbbbdd req-74b7e422-e6d1-4222-89c3-3defe5e6c120 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:25.670253 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-c9bb1114-1759-4651-ac69-5d99d1fbbbdd req-74b7e422-e6d1-4222-89c3-3defe5e6c120 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:03:25.689519 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Took 14.79 seconds to build instance.
May 28 10:03:25.713682 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:03:25.713682 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:03:25.713682 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Creating image(s)
May 28 10:03:25.714221 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "/opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:25.714626 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "/opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:25.722969 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "/opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:25.724103 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:03:25.728653 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:03:25.730451 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:25.834261 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:25.844766 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.114s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:25.847220 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:25.849683 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:25.849683 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:03:25.856000 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:03:25.862017 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:25.887777 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-c9bb1114-1759-4651-ac69-5d99d1fbbbdd req-74b7e422-e6d1-4222-89c3-3defe5e6c120 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:03:25.964442 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.102s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:25.966643 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:26.042567 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk 1073741824" returned: 0 in 0.077s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:26.043417 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:26.045191 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:26.164631 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.120s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:26.165616 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:03:26.166511 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:26.194906 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Lock "60ce69b1-4c77-45a4-8975-bbba6924448d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.300s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:26.263138 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:26.263657 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Cannot resize image /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:03:26.265374 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:03:26.265633 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Ensure instance console log exists: /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:03:26.265957 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:26.266264 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:26.266443 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:26.297664 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-33f7eadd-0380-463b-be91-ce90bbd59041 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:03:26.297664 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-33f7eadd-0380-463b-be91-ce90bbd59041 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:03:26.394842 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c9bb1114-1759-4651-ac69-5d99d1fbbbdd req-74b7e422-e6d1-4222-89c3-3defe5e6c120 service nova] Releasing lock "refresh_cache-2641ee65-c9c2-401d-b511-6ecc1247a3ad" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:03:26.396505 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquired lock "refresh_cache-2641ee65-c9c2-401d-b511-6ecc1247a3ad" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:03:26.396505 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:03:26.800733 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-33f7eadd-0380-463b-be91-ce90bbd59041 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:03:26.967279 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:03:27.029956 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Acquiring lock "41678987-f525-4994-81c7-32ab2a92c194" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:27.030099 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Lock "41678987-f525-4994-81c7-32ab2a92c194" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:27.143039 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:27.308537 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Updating instance_info_cache with network_info: [{"id": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "address": "fa:16:3e:08:31:07", "network": {"id": "cfc0fcd2-826d-4851-bc3e-3f0433d6fbce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1771427851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f2d040c323b4b948803334de7c8ec44", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc1640f1-06", "ovs_interfaceid": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:03:27.532232 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:03:27.817413 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Releasing lock "refresh_cache-2641ee65-c9c2-401d-b511-6ecc1247a3ad" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:03:27.817694 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Instance network_info: |[{"id": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "address": "fa:16:3e:08:31:07", "network": {"id": "cfc0fcd2-826d-4851-bc3e-3f0433d6fbce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1771427851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f2d040c323b4b948803334de7c8ec44", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc1640f1-06", "ovs_interfaceid": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:03:27.819020 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-33f7eadd-0380-463b-be91-ce90bbd59041 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 3.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:27.823833 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.992s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:27.825822 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Start _get_guest_xml network_info=[{"id": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "address": "fa:16:3e:08:31:07", "network": {"id": "cfc0fcd2-826d-4851-bc3e-3f0433d6fbce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1771427851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f2d040c323b4b948803334de7c8ec44", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc1640f1-06", "ovs_interfaceid": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:03:27.835947 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:03:27.838420 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-1119204149', uuid='2641ee65-c9c2-401d-b511-6ecc1247a3ad'), owner=OwnerMeta(userid='2c88efa7ed26463d928a0e4228dca6cf', username='tempest-AttachVolumeTestJSON-1743003640-project-member', projectid='6f2d040c323b4b948803334de7c8ec44', projectname='tempest-AttachVolumeTestJSON-1743003640'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "address": "fa:16:3e:08:31:07", "network": {"id": "cfc0fcd2-826d-4851-bc3e-3f0433d6fbce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1771427851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f2d040c323b4b948803334de7c8ec44", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc1640f1-06", "ovs_interfaceid": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962607.8369167) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:03:27.841355 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:03:27.841927 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:03:27.842985 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:03:27.843242 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:03:27.845623 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:03:27.845623 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:03:27.845623 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:03:27.845623 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:03:27.845623 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:03:27.845623 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:03:27.845623 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:03:27.845623 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:03:27.845623 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:03:27.845623 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:03:27.845623 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:03:27.845623 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:03:27.857793 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:03:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1119204149',display_name='tempest-AttachVolumeTestJSON-server-1119204149',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumetestjson-server-1119204149',id=34,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqD3i0NyKUYk701QA/12tGT7VZdARZzjNaHq8E3bqiWoRx7uJQPxa/ABqLzgddi+LvAs2Iatbj3S16oUNtlAmNjXKSqbg4xg/bifRd6D1DjOpjgoBB+xCgTJwlOZatWFw==',key_name='tempest-keypair-1805479953',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f2d040c323b4b948803334de7c8ec44',ramdisk_id='',reservation_id='r-92jv1vdq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1743003640',owner_user_name='tempest-AttachVolumeTestJSON-1743003640-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:03:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c88efa7ed26463d928a0e4228dca6cf',uuid=2641ee65-c9c2-401d-b511-6ecc1247a3ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "address": "fa:16:3e:08:31:07", "network": {"id": "cfc0fcd2-826d-4851-bc3e-3f0433d6fbce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1771427851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f2d040c323b4b948803334de7c8ec44", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc1640f1-06", "ovs_interfaceid": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:03:27.857793 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Converting VIF {"id": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "address": "fa:16:3e:08:31:07", "network": {"id": "cfc0fcd2-826d-4851-bc3e-3f0433d6fbce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1771427851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f2d040c323b4b948803334de7c8ec44", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc1640f1-06", "ovs_interfaceid": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:03:27.858176 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:31:07,bridge_name='br-int',has_traffic_filtering=True,id=dc1640f1-0633-403e-8f70-6a6d90053cfc,network=Network(cfc0fcd2-826d-4851-bc3e-3f0433d6fbce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc1640f1-06') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:03:27.859067 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lazy-loading 'pci_devices' on Instance uuid 2641ee65-c9c2-401d-b511-6ecc1247a3ad {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:03:28.123945 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:28.361125 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] End _get_guest_xml xml=<domain type="qemu">
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:   <uuid>2641ee65-c9c2-401d-b511-6ecc1247a3ad</uuid>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:   <name>instance-00000022</name>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:       <nova:name>tempest-AttachVolumeTestJSON-server-1119204149</nova:name>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:03:27</nova:creationTime>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:         <nova:user uuid="2c88efa7ed26463d928a0e4228dca6cf">tempest-AttachVolumeTestJSON-1743003640-project-member</nova:user>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:         <nova:project uuid="6f2d040c323b4b948803334de7c8ec44">tempest-AttachVolumeTestJSON-1743003640</nova:project>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:         <nova:port uuid="dc1640f1-0633-403e-8f70-6a6d90053cfc">
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:     <system>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:       <entry name="serial">2641ee65-c9c2-401d-b511-6ecc1247a3ad</entry>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:       <entry name="uuid">2641ee65-c9c2-401d-b511-6ecc1247a3ad</entry>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:     </system>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:   <os>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:   </os>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:   <features>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:   </features>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:   <devices>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk"/>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:     </disk>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk.config"/>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:     </disk>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:08:31:07"/>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:       <target dev="tapdc1640f1-06"/>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:     </interface>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/console.log" append="off"/>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:     </serial>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:     <video>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:     </video>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:     </rng>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:   </devices>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]: </domain>
May 28 10:03:28.361125 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:03:28.364805 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Preparing to wait for external event network-vif-plugged-dc1640f1-0633-403e-8f70-6a6d90053cfc {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:03:28.364805 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:28.364805 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:28.364805 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:28.364805 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:03:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1119204149',display_name='tempest-AttachVolumeTestJSON-server-1119204149',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumetestjson-server-1119204149',id=34,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqD3i0NyKUYk701QA/12tGT7VZdARZzjNaHq8E3bqiWoRx7uJQPxa/ABqLzgddi+LvAs2Iatbj3S16oUNtlAmNjXKSqbg4xg/bifRd6D1DjOpjgoBB+xCgTJwlOZatWFw==',key_name='tempest-keypair-1805479953',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f2d040c323b4b948803334de7c8ec44',ramdisk_id='',reservation_id='r-92jv1vdq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1743003640',owner_user_name='tempest-AttachVolumeTestJSON-1743003640-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:03:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c88efa7ed26463d928a0e4228dca6cf',uuid=2641ee65-c9c2-401d-b511-6ecc1247a3ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "address": "fa:16:3e:08:31:07", "network": {"id": "cfc0fcd2-826d-4851-bc3e-3f0433d6fbce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1771427851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f2d040c323b4b948803334de7c8ec44", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc1640f1-06", "ovs_interfaceid": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:03:28.364805 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Converting VIF {"id": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "address": "fa:16:3e:08:31:07", "network": {"id": "cfc0fcd2-826d-4851-bc3e-3f0433d6fbce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1771427851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f2d040c323b4b948803334de7c8ec44", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc1640f1-06", "ovs_interfaceid": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:03:28.364805 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:31:07,bridge_name='br-int',has_traffic_filtering=True,id=dc1640f1-0633-403e-8f70-6a6d90053cfc,network=Network(cfc0fcd2-826d-4851-bc3e-3f0433d6fbce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc1640f1-06') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:03:28.364805 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:31:07,bridge_name='br-int',has_traffic_filtering=True,id=dc1640f1-0633-403e-8f70-6a6d90053cfc,network=Network(cfc0fcd2-826d-4851-bc3e-3f0433d6fbce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc1640f1-06') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:03:28.364805 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:28.364805 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:28.364805 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:03:28.365528 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:28.365788 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f21c2dd4-42f2-524e-a524-26080a0eb1d9', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:28.366790 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:28.367863 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:03:28.370669 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:28.373063 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:28.373331 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc1640f1-06, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:28.373807 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdc1640f1-06, col_values=(('qos', UUID('794659e9-50df-4ff4-9f8b-64e6804b5f10')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:28.374018 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdc1640f1-06, col_values=(('external_ids', {'iface-id': 'dc1640f1-0633-403e-8f70-6a6d90053cfc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:31:07', 'vm-uuid': '2641ee65-c9c2-401d-b511-6ecc1247a3ad'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:28.375513 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:28.377097 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:03:28.381652 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:28.382942 np0000001613 nova-compute[98321]: INFO os_vif [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:31:07,bridge_name='br-int',has_traffic_filtering=True,id=dc1640f1-0633-403e-8f70-6a6d90053cfc,network=Network(cfc0fcd2-826d-4851-bc3e-3f0433d6fbce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc1640f1-06')
May 28 10:03:28.508722 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-33f7eadd-0380-463b-be91-ce90bbd59041 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Deleted allocation for migration 11e98384-9dcd-4e80-abe8-766b265a4310
May 28 10:03:28.579582 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:28.579582 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:28.715841 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:03:28.716047 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:03:29.014140 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-33f7eadd-0380-463b-be91-ce90bbd59041 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "36fde791-779f-42a8-9aef-87eafbbe0370" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 7.410s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:29.081926 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Detaching volume 0535b5b5-fe9b-46f2-b850-07e27f9b75ec
May 28 10:03:29.132180 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Attempting to driver detach volume 0535b5b5-fe9b-46f2-b850-07e27f9b75ec from mountpoint /dev/vdb
May 28 10:03:29.142719 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Found disk vdb by alias ua-0535b5b5-fe9b-46f2-b850-07e27f9b75ec {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:03:29.145271 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Found disk vdb by alias ua-0535b5b5-fe9b-46f2-b850-07e27f9b75ec {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:03:29.145271 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Attempting to detach device vdb from instance 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 10:03:29.145438 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:03:29.145438 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:03:29.145438 np0000001613 nova-compute[98321]:   <alias name="ua-0535b5b5-fe9b-46f2-b850-07e27f9b75ec"/>
May 28 10:03:29.145438 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-15"/>
May 28 10:03:29.145438 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:03:29.145438 np0000001613 nova-compute[98321]:   <serial>0535b5b5-fe9b-46f2-b850-07e27f9b75ec</serial>
May 28 10:03:29.145438 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:03:29.145438 np0000001613 nova-compute[98321]: </disk>
May 28 10:03:29.145438 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:03:29.154348 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Successfully detached device vdb from instance 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f from the persistent domain config.
May 28 10:03:29.154492 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] (1/8): Attempting to detach device vdb with device alias ua-0535b5b5-fe9b-46f2-b850-07e27f9b75ec from instance 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 10:03:29.154730 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:03:29.154730 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:03:29.154730 np0000001613 nova-compute[98321]:   <alias name="ua-0535b5b5-fe9b-46f2-b850-07e27f9b75ec"/>
May 28 10:03:29.154730 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-15"/>
May 28 10:03:29.154730 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:03:29.154730 np0000001613 nova-compute[98321]:   <serial>0535b5b5-fe9b-46f2-b850-07e27f9b75ec</serial>
May 28 10:03:29.154730 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:03:29.154730 np0000001613 nova-compute[98321]: </disk>
May 28 10:03:29.154730 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:03:29.219392 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:03:29.482791 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:29.716379 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779962609.7153974, 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f => ua-0535b5b5-fe9b-46f2-b850-07e27f9b75ec> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 10:03:29.717062 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-0535b5b5-fe9b-46f2-b850-07e27f9b75ec for instance 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 10:03:29.719456 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Successfully detached device vdb from instance 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f from the live domain config.
May 28 10:03:29.720798 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:03:29.721930 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec', 'iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0535b5b5-fe9b-46f2-b850-07e27f9b75ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-15'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:03:29.721930 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:03:29.722258 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:03:29.722456 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec', 'iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0535b5b5-fe9b-46f2-b850-07e27f9b75ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-15'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:03:29.722625 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:03:29.727757 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.904s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:29.730026 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.604s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:29.735064 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:03:29.735448 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Claim successful on node np0000001613
May 28 10:03:29.758845 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:03:29.758845 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:03:29.758845 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:03:29.758845 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:03:29.758845 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:03:29.758845 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:03:29.758845 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:03:29.758845 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:03:29.758845 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:03:29.759221 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:03:29.759221 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:03:29.759221 np0000001613 nova-compute[98321]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:03:29.759221 np0000001613 nova-compute[98321]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec (non-flash)
May 28 10:03:29.759221 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:03:29.759221 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:03:29.759221 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:03:29.759221 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:03:29.759221 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:03:29.759221 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec', '58'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', '59'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', '60'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d', '61'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d', '62')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:03:29.759581 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec', '57')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:03:29.760282 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec', '58')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:03:29.761134 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc63c540>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec'): ({'sdp'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec'): ({'sdq'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:03:29.761375 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Removing multipathed devices sdq, sdp {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:03:29.761634 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Flush multipath device 3300000007f2a93cb {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:03:29.796291 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Remove SCSI device /dev/sdq with /sys/block/sdq/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:03:29.821342 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Deleted allocations for instance 03313f66-d1dd-4269-b2e9-3b0796217299
May 28 10:03:29.849289 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Remove SCSI device /dev/sdp with /sys/block/sdp/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:03:29.889694 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Checking to see if SCSI volumes sdq, sdp have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:03:29.889887 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] SCSI volumes sdq, sdp have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:03:29.891315 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Checking to see if device paths {'sdq', 'sdp'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:03:29.905591 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:03:29.905774 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:03:29.905905 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] No VIF found with MAC fa:16:3e:08:31:07, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:03:29.906449 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Using config drive
May 28 10:03:29.907968 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Device paths {'sdq', 'sdp'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:03:29.908220 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:03:29.925802 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:03:29.961582 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec, portal: 192.168.40.100,3260]
May 28 10:03:29.961582 np0000001613 nova-compute[98321]: Logout of [sid: 57, target: iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec, portal: 192.168.40.100,3260] successful.
May 28 10:03:29.961582 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:03:29.976044 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:03:29.989082 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:03:30.026372 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec, portal: 192.168.50.100,3260]
May 28 10:03:30.026372 np0000001613 nova-compute[98321]: Logout of [sid: 58, target: iqn.2023-03.storpool.com:os--volume-0535b5b5-fe9b-46f2-b850-07e27f9b75ec, portal: 192.168.50.100,3260] successful.
May 28 10:03:30.026372 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:03:30.044228 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:03:30.044569 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:03:30.044778 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] <== disconnect_volume: return (323ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:03:30.044979 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:03:30.234915 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f9ec1344-f2d6-435f-905a-93a5f32c31ac req-cceaece1-02b4-48ce-9c03-119f4284e01b service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Received event network-changed-9df7e969-a155-41f1-9e30-c42f172029e4 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:30.235034 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f9ec1344-f2d6-435f-905a-93a5f32c31ac req-cceaece1-02b4-48ce-9c03-119f4284e01b service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Refreshing instance network info cache due to event network-changed-9df7e969-a155-41f1-9e30-c42f172029e4. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:03:30.235190 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f9ec1344-f2d6-435f-905a-93a5f32c31ac req-cceaece1-02b4-48ce-9c03-119f4284e01b service nova] Acquiring lock "refresh_cache-de9742b9-43db-40a6-b635-81d9244fd5e0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:03:30.235297 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f9ec1344-f2d6-435f-905a-93a5f32c31ac req-cceaece1-02b4-48ce-9c03-119f4284e01b service nova] Acquired lock "refresh_cache-de9742b9-43db-40a6-b635-81d9244fd5e0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:03:30.235397 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-f9ec1344-f2d6-435f-905a-93a5f32c31ac req-cceaece1-02b4-48ce-9c03-119f4284e01b service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Refreshing network info cache for port 9df7e969-a155-41f1-9e30-c42f172029e4 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:03:30.413118 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:30.540278 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.00044144200001028366 future=<Future at 0x73c1f43509b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:30.540830 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Emitting event <LifecycleEvent: 1779962595.5396695, 03313f66-d1dd-4269-b2e9-3b0796217299 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:03:30.540830 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:30.540906 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] VM Stopped (Lifecycle Event)
May 28 10:03:30.586103 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Creating config drive at /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk.config
May 28 10:03:30.592105 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpc_mrhz2q {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:30.609336 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lazy-loading 'flavor' on Instance uuid 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:03:30.642882 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpc_mrhz2q" returned: 0 in 0.051s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:30.738487 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-f9ec1344-f2d6-435f-905a-93a5f32c31ac req-cceaece1-02b4-48ce-9c03-119f4284e01b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:30.833621 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8fa2b1be-1ad7-4648-a762-9b8f5cb09416 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Lock "03313f66-d1dd-4269-b2e9-3b0796217299" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 16.515s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:31.046050 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 03313f66-d1dd-4269-b2e9-3b0796217299] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:03:31.127500 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:31.153879 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:31.155904 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:31.177865 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-f9ec1344-f2d6-435f-905a-93a5f32c31ac req-cceaece1-02b4-48ce-9c03-119f4284e01b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:31.248809 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:31.486961 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-f9ec1344-f2d6-435f-905a-93a5f32c31ac req-cceaece1-02b4-48ce-9c03-119f4284e01b service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Updated VIF entry in instance network info cache for port 9df7e969-a155-41f1-9e30-c42f172029e4. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:03:31.486961 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-f9ec1344-f2d6-435f-905a-93a5f32c31ac req-cceaece1-02b4-48ce-9c03-119f4284e01b service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Updating instance_info_cache with network_info: [{"id": "9df7e969-a155-41f1-9e30-c42f172029e4", "address": "fa:16:3e:9e:26:24", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df7e969-a1", "ovs_interfaceid": "9df7e969-a155-41f1-9e30-c42f172029e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:03:31.586157 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:31.597041 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:31.628272 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:31.632333 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-63f60f3d-026c-4fc7-9519-437a8a7be185 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.051s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:31.712637 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:03:31.712637 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:03:31.980087 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f84bd591-cf7c-42c2-8e04-935e0d3f0e2e tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:31.980087 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f84bd591-cf7c-42c2-8e04-935e0d3f0e2e tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:31.980087 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f84bd591-cf7c-42c2-8e04-935e0d3f0e2e tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:31.980087 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f84bd591-cf7c-42c2-8e04-935e0d3f0e2e tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:31.980087 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f84bd591-cf7c-42c2-8e04-935e0d3f0e2e tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:31.983361 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-f84bd591-cf7c-42c2-8e04-935e0d3f0e2e tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Terminating instance
May 28 10:03:31.989379 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f9ec1344-f2d6-435f-905a-93a5f32c31ac req-cceaece1-02b4-48ce-9c03-119f4284e01b service nova] Releasing lock "refresh_cache-de9742b9-43db-40a6-b635-81d9244fd5e0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:03:32.137025 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962612.1366646, 2641ee65-c9c2-401d-b511-6ecc1247a3ad => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:03:32.137328 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] VM Started (Lifecycle Event)
May 28 10:03:32.216463 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:03:32.309597 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-11a03310-321c-4f45-86d1-2333553d9c73 req-cf28ac4d-a3de-434e-a368-bf13f62e4be9 service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Received event network-changed-0e857900-174b-46cf-bfa1-ce7f2f8ffdb1 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:32.310426 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-11a03310-321c-4f45-86d1-2333553d9c73 req-cf28ac4d-a3de-434e-a368-bf13f62e4be9 service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Refreshing instance network info cache due to event network-changed-0e857900-174b-46cf-bfa1-ce7f2f8ffdb1. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:03:32.312273 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-11a03310-321c-4f45-86d1-2333553d9c73 req-cf28ac4d-a3de-434e-a368-bf13f62e4be9 service nova] Acquiring lock "refresh_cache-36fde791-779f-42a8-9aef-87eafbbe0370" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:03:32.312852 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-11a03310-321c-4f45-86d1-2333553d9c73 req-cf28ac4d-a3de-434e-a368-bf13f62e4be9 service nova] Acquired lock "refresh_cache-36fde791-779f-42a8-9aef-87eafbbe0370" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:03:32.313017 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-11a03310-321c-4f45-86d1-2333553d9c73 req-cf28ac4d-a3de-434e-a368-bf13f62e4be9 service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Refreshing network info cache for port 0e857900-174b-46cf-bfa1-ce7f2f8ffdb1 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:03:32.440761 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:32.486571 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f84bd591-cf7c-42c2-8e04-935e0d3f0e2e tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:03:32.508840 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:32.511350 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:32.535547 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:32.639607 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:03:32.643286 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962612.6427445, 2641ee65-c9c2-401d-b511-6ecc1247a3ad => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:03:32.643286 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] VM Paused (Lifecycle Event)
May 28 10:03:32.727782 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:32.728417 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:03:32.741919 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f62b4c93-b8ff-4f32-8d2f-4b6d4446ded1 req-c6768dfb-b48c-40c7-8cbb-cbed96fbfa7f service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Received event network-vif-unplugged-4edd294f-7bb5-46ec-9cdc-c8683088408c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:32.745229 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f62b4c93-b8ff-4f32-8d2f-4b6d4446ded1 req-c6768dfb-b48c-40c7-8cbb-cbed96fbfa7f service nova] Acquiring lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:32.745229 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f62b4c93-b8ff-4f32-8d2f-4b6d4446ded1 req-c6768dfb-b48c-40c7-8cbb-cbed96fbfa7f service nova] Lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:32.745229 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f62b4c93-b8ff-4f32-8d2f-4b6d4446ded1 req-c6768dfb-b48c-40c7-8cbb-cbed96fbfa7f service nova] Lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:32.745229 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f62b4c93-b8ff-4f32-8d2f-4b6d4446ded1 req-c6768dfb-b48c-40c7-8cbb-cbed96fbfa7f service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] No waiting events found dispatching network-vif-unplugged-4edd294f-7bb5-46ec-9cdc-c8683088408c {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:03:32.747189 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f62b4c93-b8ff-4f32-8d2f-4b6d4446ded1 req-c6768dfb-b48c-40c7-8cbb-cbed96fbfa7f service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Received event network-vif-unplugged-4edd294f-7bb5-46ec-9cdc-c8683088408c for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:03:32.755194 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:32.763109 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:32.818707 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-11a03310-321c-4f45-86d1-2333553d9c73 req-cf28ac4d-a3de-434e-a368-bf13f62e4be9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:32.829820 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:32.837746 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:32.864359 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Instance destroyed successfully.
May 28 10:03:32.865271 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-f84bd591-cf7c-42c2-8e04-935e0d3f0e2e tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lazy-loading 'resources' on Instance uuid 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:03:33.146755 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:03:33.151340 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:03:33.239551 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:03:33.239718 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:03:33.239977 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:33.240254 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:33.335828 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-11a03310-321c-4f45-86d1-2333553d9c73 req-cf28ac4d-a3de-434e-a368-bf13f62e4be9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:33.354649 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5d30ab8162f645b5928317737d115d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0e2495daf24926a478a05961d90b35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:03:33.368022 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-f84bd591-cf7c-42c2-8e04-935e0d3f0e2e tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:01:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1240965804',display_name='tempest-ServerRescueNegativeTestJSON-server-1240965804',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serverrescuenegativetestjson-server-1240965804',id=27,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4cGw7X+Q2nx15R5jh2EKJ3VR+oUGPb5WmFwZPLNWg5EFnojPDhCKqU015r+n4sVEHS6gVIGvoSAjxxWq0zAUAI8n+AO14k3HGl23rDCNVGMYgSQsH9e+S27cmLpZ/MSQ==',key_name='tempest-keypair-501617819',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:02:42Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f5fc8bc5d1984c1c839a3ef7e30b9d36',ramdisk_id='',reservation_id='r-c3zv0nco',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1286552851',owner_user_name='tempest-ServerRescueNegativeTestJSON-1286552851-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:02:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45c67299cd204090b9ebf7e0eb873e37',uuid=2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4edd294f-7bb5-46ec-9cdc-c8683088408c", "address": "fa:16:3e:44:0a:72", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4edd294f-7b", "ovs_interfaceid": "4edd294f-7bb5-46ec-9cdc-c8683088408c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:03:33.368148 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-f84bd591-cf7c-42c2-8e04-935e0d3f0e2e tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Converting VIF {"id": "4edd294f-7bb5-46ec-9cdc-c8683088408c", "address": "fa:16:3e:44:0a:72", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4edd294f-7b", "ovs_interfaceid": "4edd294f-7bb5-46ec-9cdc-c8683088408c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:03:33.371197 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-f84bd591-cf7c-42c2-8e04-935e0d3f0e2e tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:0a:72,bridge_name='br-int',has_traffic_filtering=True,id=4edd294f-7bb5-46ec-9cdc-c8683088408c,network=Network(729946be-b963-4dfb-ad38-335762a8666c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4edd294f-7b') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:03:33.371197 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-f84bd591-cf7c-42c2-8e04-935e0d3f0e2e tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:0a:72,bridge_name='br-int',has_traffic_filtering=True,id=4edd294f-7bb5-46ec-9cdc-c8683088408c,network=Network(729946be-b963-4dfb-ad38-335762a8666c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4edd294f-7b') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:03:33.371458 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:33.371750 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4edd294f-7b, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:33.374394 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:33.377040 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:03:33.378137 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:33.378805 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c274c212-dace-4443-b391-8bd546b819db) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:33.381898 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:33.382785 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:03:33.387374 np0000001613 nova-compute[98321]: INFO os_vif [None req-f84bd591-cf7c-42c2-8e04-935e0d3f0e2e tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:0a:72,bridge_name='br-int',has_traffic_filtering=True,id=4edd294f-7bb5-46ec-9cdc-c8683088408c,network=Network(729946be-b963-4dfb-ad38-335762a8666c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4edd294f-7b')
May 28 10:03:33.387575 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-f84bd591-cf7c-42c2-8e04-935e0d3f0e2e tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Deleting instance files /opt/stack/data/nova/instances/2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f_del
May 28 10:03:33.388540 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-f84bd591-cf7c-42c2-8e04-935e0d3f0e2e tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Deletion of /opt/stack/data/nova/instances/2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f_del complete
May 28 10:03:33.551928 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-11a03310-321c-4f45-86d1-2333553d9c73 req-cf28ac4d-a3de-434e-a368-bf13f62e4be9 service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Updated VIF entry in instance network info cache for port 0e857900-174b-46cf-bfa1-ce7f2f8ffdb1. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:03:33.552258 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-11a03310-321c-4f45-86d1-2333553d9c73 req-cf28ac4d-a3de-434e-a368-bf13f62e4be9 service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Updating instance_info_cache with network_info: [{"id": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "address": "fa:16:3e:e1:06:59", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e857900-17", "ovs_interfaceid": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:03:33.655747 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:03:33.655747 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999715870999808 future=<Future at 0x73c1f41c9400 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:33.656346 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.998817358999986 future=<Future at 0x73c1f41c9400 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:33.656389 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.99855284799969 future=<Future at 0x73c1f41c9400 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:33.743940 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:03:33.909958 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-f84bd591-cf7c-42c2-8e04-935e0d3f0e2e tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Took 1.42 seconds to destroy the instance on the hypervisor.
May 28 10:03:33.911522 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-f84bd591-cf7c-42c2-8e04-935e0d3f0e2e tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:03:33.911522 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:03:33.911522 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:03:33.911774 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:33.931449 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Successfully created port: 7b726d59-4d13-4e3e-b9d9-1536c96d6af1 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:03:33.991832 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:34.056389 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-11a03310-321c-4f45-86d1-2333553d9c73 req-cf28ac4d-a3de-434e-a368-bf13f62e4be9 service nova] Releasing lock "refresh_cache-36fde791-779f-42a8-9aef-87eafbbe0370" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:03:34.056389 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-11a03310-321c-4f45-86d1-2333553d9c73 req-cf28ac4d-a3de-434e-a368-bf13f62e4be9 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Received event network-vif-plugged-dc1640f1-0633-403e-8f70-6a6d90053cfc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:34.056389 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-11a03310-321c-4f45-86d1-2333553d9c73 req-cf28ac4d-a3de-434e-a368-bf13f62e4be9 service nova] Acquiring lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:34.056546 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-11a03310-321c-4f45-86d1-2333553d9c73 req-cf28ac4d-a3de-434e-a368-bf13f62e4be9 service nova] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:34.056590 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-11a03310-321c-4f45-86d1-2333553d9c73 req-cf28ac4d-a3de-434e-a368-bf13f62e4be9 service nova] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:34.056864 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-11a03310-321c-4f45-86d1-2333553d9c73 req-cf28ac4d-a3de-434e-a368-bf13f62e4be9 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Processing event network-vif-plugged-dc1640f1-0633-403e-8f70-6a6d90053cfc {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:03:34.056939 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-11a03310-321c-4f45-86d1-2333553d9c73 req-cf28ac4d-a3de-434e-a368-bf13f62e4be9 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Received event network-vif-plugged-dc1640f1-0633-403e-8f70-6a6d90053cfc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:34.057085 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-11a03310-321c-4f45-86d1-2333553d9c73 req-cf28ac4d-a3de-434e-a368-bf13f62e4be9 service nova] Acquiring lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:34.057324 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-11a03310-321c-4f45-86d1-2333553d9c73 req-cf28ac4d-a3de-434e-a368-bf13f62e4be9 service nova] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:34.057401 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-11a03310-321c-4f45-86d1-2333553d9c73 req-cf28ac4d-a3de-434e-a368-bf13f62e4be9 service nova] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:34.057545 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-11a03310-321c-4f45-86d1-2333553d9c73 req-cf28ac4d-a3de-434e-a368-bf13f62e4be9 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] No waiting events found dispatching network-vif-plugged-dc1640f1-0633-403e-8f70-6a6d90053cfc {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:03:34.057684 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-11a03310-321c-4f45-86d1-2333553d9c73 req-cf28ac4d-a3de-434e-a368-bf13f62e4be9 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Received unexpected event network-vif-plugged-dc1640f1-0633-403e-8f70-6a6d90053cfc for instance with vm_state building and task_state spawning.
May 28 10:03:34.063632 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:03:34.067042 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962614.0666912, 2641ee65-c9c2-401d-b511-6ecc1247a3ad => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:03:34.067259 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] VM Resumed (Lifecycle Event)
May 28 10:03:34.068933 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:03:34.071809 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Instance spawned successfully.
May 28 10:03:34.072409 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:03:34.248472 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:03:34.486890 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:34.571580 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:03:34.574485 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:03:34.590215 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:03:34.590215 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:03:34.590215 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:03:34.590215 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:03:34.590487 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:03:34.591536 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:03:34.749424 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Successfully updated port: 7b726d59-4d13-4e3e-b9d9-1536c96d6af1 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:03:34.768373 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6e36c7e1-dedb-4b1f-82a8-5142162956cb req-25a58aed-4bdd-41a0-93e8-c02d7372b81f service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Received event network-vif-deleted-4edd294f-7bb5-46ec-9cdc-c8683088408c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:34.768537 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-6e36c7e1-dedb-4b1f-82a8-5142162956cb req-25a58aed-4bdd-41a0-93e8-c02d7372b81f service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Neutron deleted interface 4edd294f-7bb5-46ec-9cdc-c8683088408c; detaching it from the instance and deleting it from the info cache
May 28 10:03:34.772194 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6e36c7e1-dedb-4b1f-82a8-5142162956cb req-25a58aed-4bdd-41a0-93e8-c02d7372b81f service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Detach interface failed, port_id=4edd294f-7bb5-46ec-9cdc-c8683088408c, reason: Instance 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:03:34.823614 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ca94ac3f-db2b-45f2-8543-199b4b84d5be req-89e9df7d-cb02-4a06-abc2-5748f3ee5eef service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Received event network-vif-unplugged-4edd294f-7bb5-46ec-9cdc-c8683088408c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:34.826659 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ca94ac3f-db2b-45f2-8543-199b4b84d5be req-89e9df7d-cb02-4a06-abc2-5748f3ee5eef service nova] Acquiring lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:34.827019 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ca94ac3f-db2b-45f2-8543-199b4b84d5be req-89e9df7d-cb02-4a06-abc2-5748f3ee5eef service nova] Lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:34.827288 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ca94ac3f-db2b-45f2-8543-199b4b84d5be req-89e9df7d-cb02-4a06-abc2-5748f3ee5eef service nova] Lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:34.827802 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ca94ac3f-db2b-45f2-8543-199b4b84d5be req-89e9df7d-cb02-4a06-abc2-5748f3ee5eef service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] No waiting events found dispatching network-vif-unplugged-4edd294f-7bb5-46ec-9cdc-c8683088408c {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:03:34.827802 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ca94ac3f-db2b-45f2-8543-199b4b84d5be req-89e9df7d-cb02-4a06-abc2-5748f3ee5eef service nova] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Received event network-vif-unplugged-4edd294f-7bb5-46ec-9cdc-c8683088408c for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:03:35.080857 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:03:35.099446 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Took 9.39 seconds to spawn the instance on the hypervisor.
May 28 10:03:35.099631 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:03:35.200052 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:03:35.401922 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Acquiring lock "refresh_cache-41678987-f525-4994-81c7-32ab2a92c194" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:03:35.402081 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Acquired lock "refresh_cache-41678987-f525-4994-81c7-32ab2a92c194" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:03:35.402234 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:03:35.405765 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:03:35.428189 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:03:35.428688 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Creating image(s)
May 28 10:03:35.429373 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Acquiring lock "/opt/stack/data/nova/instances/41678987-f525-4994-81c7-32ab2a92c194/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:35.429540 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Lock "/opt/stack/data/nova/instances/41678987-f525-4994-81c7-32ab2a92c194/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:35.431221 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Lock "/opt/stack/data/nova/instances/41678987-f525-4994-81c7-32ab2a92c194/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:35.431684 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:03:35.434669 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:03:35.435856 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:35.530204 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.094s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:35.530575 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:35.531087 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:35.531624 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:03:35.534498 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:03:35.534924 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:35.616996 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Took 15.56 seconds to build instance.
May 28 10:03:35.634398 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.099s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:35.636389 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/41678987-f525-4994-81c7-32ab2a92c194/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:35.707662 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/41678987-f525-4994-81c7-32ab2a92c194/disk 1073741824" returned: 0 in 0.071s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:35.711242 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.177s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:35.711242 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:35.824085 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.115s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:35.824706 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Checking if we can resize image /opt/stack/data/nova/instances/41678987-f525-4994-81c7-32ab2a92c194/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:03:35.824915 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41678987-f525-4994-81c7-32ab2a92c194/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:35.932695 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Took 2.02 seconds to deallocate network for instance.
May 28 10:03:35.935527 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41678987-f525-4994-81c7-32ab2a92c194/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:35.935905 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Cannot resize image /opt/stack/data/nova/instances/41678987-f525-4994-81c7-32ab2a92c194/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:03:35.936244 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:03:35.936776 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Ensure instance console log exists: /opt/stack/data/nova/instances/41678987-f525-4994-81c7-32ab2a92c194/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:03:35.936776 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:35.936926 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:35.937078 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:36.030549 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:03:36.119178 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.071s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:36.247899 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:36.444799 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f84bd591-cf7c-42c2-8e04-935e0d3f0e2e tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:36.445203 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f84bd591-cf7c-42c2-8e04-935e0d3f0e2e tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:36.451964 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Updating instance_info_cache with network_info: [{"id": "7b726d59-4d13-4e3e-b9d9-1536c96d6af1", "address": "fa:16:3e:52:8f:8c", "network": {"id": "6a2ed18f-61ae-4c1f-a1e3-ddfd8c254b01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-891009375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0e2495daf24926a478a05961d90b35", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b726d59-4d", "ovs_interfaceid": "7b726d59-4d13-4e3e-b9d9-1536c96d6af1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:03:36.939868 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3707fedc-e8ef-49cd-a54a-9295ee78f4c1 req-33cef399-452d-4741-8231-407e0d9e437e service nova] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Received event network-changed-7b726d59-4d13-4e3e-b9d9-1536c96d6af1 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:36.940883 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3707fedc-e8ef-49cd-a54a-9295ee78f4c1 req-33cef399-452d-4741-8231-407e0d9e437e service nova] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Refreshing instance network info cache due to event network-changed-7b726d59-4d13-4e3e-b9d9-1536c96d6af1. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:03:36.940883 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3707fedc-e8ef-49cd-a54a-9295ee78f4c1 req-33cef399-452d-4741-8231-407e0d9e437e service nova] Acquiring lock "refresh_cache-41678987-f525-4994-81c7-32ab2a92c194" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:03:36.958565 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Releasing lock "refresh_cache-41678987-f525-4994-81c7-32ab2a92c194" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:03:36.958877 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Instance network_info: |[{"id": "7b726d59-4d13-4e3e-b9d9-1536c96d6af1", "address": "fa:16:3e:52:8f:8c", "network": {"id": "6a2ed18f-61ae-4c1f-a1e3-ddfd8c254b01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-891009375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0e2495daf24926a478a05961d90b35", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b726d59-4d", "ovs_interfaceid": "7b726d59-4d13-4e3e-b9d9-1536c96d6af1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:03:36.960960 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Start _get_guest_xml network_info=[{"id": "7b726d59-4d13-4e3e-b9d9-1536c96d6af1", "address": "fa:16:3e:52:8f:8c", "network": {"id": "6a2ed18f-61ae-4c1f-a1e3-ddfd8c254b01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-891009375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0e2495daf24926a478a05961d90b35", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b726d59-4d", "ovs_interfaceid": "7b726d59-4d13-4e3e-b9d9-1536c96d6af1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:03:36.962629 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3707fedc-e8ef-49cd-a54a-9295ee78f4c1 req-33cef399-452d-4741-8231-407e0d9e437e service nova] Acquired lock "refresh_cache-41678987-f525-4994-81c7-32ab2a92c194" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:03:36.963341 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-3707fedc-e8ef-49cd-a54a-9295ee78f4c1 req-33cef399-452d-4741-8231-407e0d9e437e service nova] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Refreshing network info cache for port 7b726d59-4d13-4e3e-b9d9-1536c96d6af1 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:03:36.965905 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:03:36.967461 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-ServersNegativeTestJSON-server-1238076561', uuid='41678987-f525-4994-81c7-32ab2a92c194'), owner=OwnerMeta(userid='5d30ab8162f645b5928317737d115d63', username='tempest-ServersNegativeTestJSON-177803216-project-member', projectid='2a0e2495daf24926a478a05961d90b35', projectname='tempest-ServersNegativeTestJSON-177803216'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7b726d59-4d13-4e3e-b9d9-1536c96d6af1", "address": "fa:16:3e:52:8f:8c", "network": {"id": "6a2ed18f-61ae-4c1f-a1e3-ddfd8c254b01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-891009375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0e2495daf24926a478a05961d90b35", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b726d59-4d", "ovs_interfaceid": "7b726d59-4d13-4e3e-b9d9-1536c96d6af1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962616.9667938) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:03:36.968567 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:03:36.969048 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:03:36.973198 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:03:36.974128 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:03:36.975255 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:03:36.975699 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:03:36.975939 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:03:36.976062 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:03:36.976266 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:03:36.976422 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:03:36.976566 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:03:36.977265 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:03:36.977498 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:03:36.977751 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:03:36.978004 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:03:36.978220 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:03:37.000962 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:03:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1238076561',display_name='tempest-ServersNegativeTestJSON-server-1238076561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serversnegativetestjson-server-1238076561',id=35,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a0e2495daf24926a478a05961d90b35',ramdisk_id='',reservation_id='r-md5gzacd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-177803216',owner_user_name='tempest-ServersNegativeTestJSON-177803216-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:03:34Z,user_data=None,user_id='5d30ab8162f645b5928317737d115d63',uuid=41678987-f525-4994-81c7-32ab2a92c194,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b726d59-4d13-4e3e-b9d9-1536c96d6af1", "address": "fa:16:3e:52:8f:8c", "network": {"id": "6a2ed18f-61ae-4c1f-a1e3-ddfd8c254b01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-891009375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0e2495daf24926a478a05961d90b35", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b726d59-4d", "ovs_interfaceid": "7b726d59-4d13-4e3e-b9d9-1536c96d6af1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:03:37.001219 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Converting VIF {"id": "7b726d59-4d13-4e3e-b9d9-1536c96d6af1", "address": "fa:16:3e:52:8f:8c", "network": {"id": "6a2ed18f-61ae-4c1f-a1e3-ddfd8c254b01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-891009375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0e2495daf24926a478a05961d90b35", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b726d59-4d", "ovs_interfaceid": "7b726d59-4d13-4e3e-b9d9-1536c96d6af1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:03:37.001877 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:8f:8c,bridge_name='br-int',has_traffic_filtering=True,id=7b726d59-4d13-4e3e-b9d9-1536c96d6af1,network=Network(6a2ed18f-61ae-4c1f-a1e3-ddfd8c254b01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b726d59-4d') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:03:37.003681 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Lazy-loading 'pci_devices' on Instance uuid 41678987-f525-4994-81c7-32ab2a92c194 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:03:37.255519 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f84bd591-cf7c-42c2-8e04-935e0d3f0e2e tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:03:37.255782 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-f84bd591-cf7c-42c2-8e04-935e0d3f0e2e tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:03:37.470852 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-3707fedc-e8ef-49cd-a54a-9295ee78f4c1 req-33cef399-452d-4741-8231-407e0d9e437e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:37.508241 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] End _get_guest_xml xml=<domain type="qemu">
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:   <uuid>41678987-f525-4994-81c7-32ab2a92c194</uuid>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:   <name>instance-00000023</name>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:       <nova:name>tempest-ServersNegativeTestJSON-server-1238076561</nova:name>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:03:36</nova:creationTime>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:         <nova:user uuid="5d30ab8162f645b5928317737d115d63">tempest-ServersNegativeTestJSON-177803216-project-member</nova:user>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:         <nova:project uuid="2a0e2495daf24926a478a05961d90b35">tempest-ServersNegativeTestJSON-177803216</nova:project>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:         <nova:port uuid="7b726d59-4d13-4e3e-b9d9-1536c96d6af1">
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:     <system>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:       <entry name="serial">41678987-f525-4994-81c7-32ab2a92c194</entry>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:       <entry name="uuid">41678987-f525-4994-81c7-32ab2a92c194</entry>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:     </system>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:   <os>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:   </os>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:   <features>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:   </features>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:   <devices>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/41678987-f525-4994-81c7-32ab2a92c194/disk"/>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:     </disk>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/41678987-f525-4994-81c7-32ab2a92c194/disk.config"/>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:     </disk>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:52:8f:8c"/>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:       <target dev="tap7b726d59-4d"/>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:     </interface>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/41678987-f525-4994-81c7-32ab2a92c194/console.log" append="off"/>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:     </serial>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:     <video>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:     </video>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:     </rng>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:   </devices>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]: </domain>
May 28 10:03:37.508241 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:03:37.511135 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Preparing to wait for external event network-vif-plugged-7b726d59-4d13-4e3e-b9d9-1536c96d6af1 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:03:37.511135 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Acquiring lock "41678987-f525-4994-81c7-32ab2a92c194-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:37.511135 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Lock "41678987-f525-4994-81c7-32ab2a92c194-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:37.511135 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Lock "41678987-f525-4994-81c7-32ab2a92c194-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:37.511135 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:03:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1238076561',display_name='tempest-ServersNegativeTestJSON-server-1238076561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serversnegativetestjson-server-1238076561',id=35,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a0e2495daf24926a478a05961d90b35',ramdisk_id='',reservation_id='r-md5gzacd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-177803216',owner_user_name='tempest-ServersNegativeTestJSON-177803216-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:03:34Z,user_data=None,user_id='5d30ab8162f645b5928317737d115d63',uuid=41678987-f525-4994-81c7-32ab2a92c194,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b726d59-4d13-4e3e-b9d9-1536c96d6af1", "address": "fa:16:3e:52:8f:8c", "network": {"id": "6a2ed18f-61ae-4c1f-a1e3-ddfd8c254b01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-891009375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0e2495daf24926a478a05961d90b35", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b726d59-4d", "ovs_interfaceid": "7b726d59-4d13-4e3e-b9d9-1536c96d6af1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:03:37.511135 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Converting VIF {"id": "7b726d59-4d13-4e3e-b9d9-1536c96d6af1", "address": "fa:16:3e:52:8f:8c", "network": {"id": "6a2ed18f-61ae-4c1f-a1e3-ddfd8c254b01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-891009375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0e2495daf24926a478a05961d90b35", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b726d59-4d", "ovs_interfaceid": "7b726d59-4d13-4e3e-b9d9-1536c96d6af1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:03:37.511135 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:8f:8c,bridge_name='br-int',has_traffic_filtering=True,id=7b726d59-4d13-4e3e-b9d9-1536c96d6af1,network=Network(6a2ed18f-61ae-4c1f-a1e3-ddfd8c254b01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b726d59-4d') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:03:37.512756 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:8f:8c,bridge_name='br-int',has_traffic_filtering=True,id=7b726d59-4d13-4e3e-b9d9-1536c96d6af1,network=Network(6a2ed18f-61ae-4c1f-a1e3-ddfd8c254b01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b726d59-4d') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:03:37.513905 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:37.514425 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:37.516457 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:03:37.518296 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:37.518533 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '78b8bdc8-5d01-5757-acdc-d20f6768f6eb', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:37.520608 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:37.521645 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:03:37.523572 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:37.526451 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:37.526796 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b726d59-4d, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:37.527855 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7b726d59-4d, col_values=(('qos', UUID('84d15558-5933-4005-b2cc-17ea71d24a83')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:37.528043 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7b726d59-4d, col_values=(('external_ids', {'iface-id': '7b726d59-4d13-4e3e-b9d9-1536c96d6af1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:8f:8c', 'vm-uuid': '41678987-f525-4994-81c7-32ab2a92c194'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:37.529320 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:37.533121 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:03:37.536872 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:37.538499 np0000001613 nova-compute[98321]: INFO os_vif [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:8f:8c,bridge_name='br-int',has_traffic_filtering=True,id=7b726d59-4d13-4e3e-b9d9-1536c96d6af1,network=Network(6a2ed18f-61ae-4c1f-a1e3-ddfd8c254b01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b726d59-4d')
May 28 10:03:37.759431 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-f84bd591-cf7c-42c2-8e04-935e0d3f0e2e tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:03:37.907862 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-3707fedc-e8ef-49cd-a54a-9295ee78f4c1 req-33cef399-452d-4741-8231-407e0d9e437e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:38.094311 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-3707fedc-e8ef-49cd-a54a-9295ee78f4c1 req-33cef399-452d-4741-8231-407e0d9e437e service nova] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Updated VIF entry in instance network info cache for port 7b726d59-4d13-4e3e-b9d9-1536c96d6af1. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:03:38.094711 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-3707fedc-e8ef-49cd-a54a-9295ee78f4c1 req-33cef399-452d-4741-8231-407e0d9e437e service nova] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Updating instance_info_cache with network_info: [{"id": "7b726d59-4d13-4e3e-b9d9-1536c96d6af1", "address": "fa:16:3e:52:8f:8c", "network": {"id": "6a2ed18f-61ae-4c1f-a1e3-ddfd8c254b01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-891009375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0e2495daf24926a478a05961d90b35", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b726d59-4d", "ovs_interfaceid": "7b726d59-4d13-4e3e-b9d9-1536c96d6af1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:03:38.270596 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f84bd591-cf7c-42c2-8e04-935e0d3f0e2e tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.825s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:38.278455 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:38.333343 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-f84bd591-cf7c-42c2-8e04-935e0d3f0e2e tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Deleted allocations for instance 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f
May 28 10:03:38.596907 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3707fedc-e8ef-49cd-a54a-9295ee78f4c1 req-33cef399-452d-4741-8231-407e0d9e437e service nova] Releasing lock "refresh_cache-41678987-f525-4994-81c7-32ab2a92c194" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:03:39.034866 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3705e3f1-93c4-4022-b724-1fbe3b8184f1 req-9c1ef7cf-6dc1-4542-b88e-0a39b064b983 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Received event network-changed-dc1640f1-0633-403e-8f70-6a6d90053cfc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:39.035531 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3705e3f1-93c4-4022-b724-1fbe3b8184f1 req-9c1ef7cf-6dc1-4542-b88e-0a39b064b983 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Refreshing instance network info cache due to event network-changed-dc1640f1-0633-403e-8f70-6a6d90053cfc. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:03:39.035672 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3705e3f1-93c4-4022-b724-1fbe3b8184f1 req-9c1ef7cf-6dc1-4542-b88e-0a39b064b983 service nova] Acquiring lock "refresh_cache-2641ee65-c9c2-401d-b511-6ecc1247a3ad" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:03:39.035912 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3705e3f1-93c4-4022-b724-1fbe3b8184f1 req-9c1ef7cf-6dc1-4542-b88e-0a39b064b983 service nova] Acquired lock "refresh_cache-2641ee65-c9c2-401d-b511-6ecc1247a3ad" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:03:39.036176 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-3705e3f1-93c4-4022-b724-1fbe3b8184f1 req-9c1ef7cf-6dc1-4542-b88e-0a39b064b983 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Refreshing network info cache for port dc1640f1-0633-403e-8f70-6a6d90053cfc {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:03:39.068025 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:03:39.068244 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:03:39.068489 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] No VIF found with MAC fa:16:3e:52:8f:8c, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:03:39.069074 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Using config drive
May 28 10:03:39.244656 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Acquiring lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:39.244924 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:39.345301 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f84bd591-cf7c-42c2-8e04-935e0d3f0e2e tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.367s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:39.489896 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:39.538773 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-3705e3f1-93c4-4022-b724-1fbe3b8184f1 req-9c1ef7cf-6dc1-4542-b88e-0a39b064b983 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:39.580858 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:39.749485 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Detaching volume 3177d27e-24bf-418b-97a0-c324d705954d
May 28 10:03:39.756251 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Creating config drive at /opt/stack/data/nova/instances/41678987-f525-4994-81c7-32ab2a92c194/disk.config
May 28 10:03:39.759917 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/41678987-f525-4994-81c7-32ab2a92c194/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5a2u6rtx {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:39.827545 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/41678987-f525-4994-81c7-32ab2a92c194/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5a2u6rtx" returned: 0 in 0.067s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:39.840439 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Attempting to driver detach volume 3177d27e-24bf-418b-97a0-c324d705954d from mountpoint /dev/vdb
May 28 10:03:39.849434 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Found disk vdb by alias ua-3177d27e-24bf-418b-97a0-c324d705954d {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:03:39.850889 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Found disk vdb by alias ua-3177d27e-24bf-418b-97a0-c324d705954d {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:03:39.851030 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Attempting to detach device vdb from instance 4baa35bb-b237-42be-aa8b-d9eeed7e41a0 from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 10:03:39.851346 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:03:39.851346 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:03:39.851346 np0000001613 nova-compute[98321]:   <alias name="ua-3177d27e-24bf-418b-97a0-c324d705954d"/>
May 28 10:03:39.851346 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-2"/>
May 28 10:03:39.851346 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:03:39.851346 np0000001613 nova-compute[98321]:   <serial>3177d27e-24bf-418b-97a0-c324d705954d</serial>
May 28 10:03:39.851346 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:03:39.851346 np0000001613 nova-compute[98321]: </disk>
May 28 10:03:39.851346 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:03:39.857423 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Successfully detached device vdb from instance 4baa35bb-b237-42be-aa8b-d9eeed7e41a0 from the persistent domain config.
May 28 10:03:39.857615 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] (1/8): Attempting to detach device vdb with device alias ua-3177d27e-24bf-418b-97a0-c324d705954d from instance 4baa35bb-b237-42be-aa8b-d9eeed7e41a0 from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 10:03:39.857793 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:03:39.857793 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:03:39.857793 np0000001613 nova-compute[98321]:   <alias name="ua-3177d27e-24bf-418b-97a0-c324d705954d"/>
May 28 10:03:39.857793 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-2"/>
May 28 10:03:39.857793 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:03:39.857793 np0000001613 nova-compute[98321]:   <serial>3177d27e-24bf-418b-97a0-c324d705954d</serial>
May 28 10:03:39.857793 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:03:39.857793 np0000001613 nova-compute[98321]: </disk>
May 28 10:03:39.857793 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:03:39.963869 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-3705e3f1-93c4-4022-b724-1fbe3b8184f1 req-9c1ef7cf-6dc1-4542-b88e-0a39b064b983 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:40.135531 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-3705e3f1-93c4-4022-b724-1fbe3b8184f1 req-9c1ef7cf-6dc1-4542-b88e-0a39b064b983 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Updated VIF entry in instance network info cache for port dc1640f1-0633-403e-8f70-6a6d90053cfc. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:03:40.135531 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-3705e3f1-93c4-4022-b724-1fbe3b8184f1 req-9c1ef7cf-6dc1-4542-b88e-0a39b064b983 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Updating instance_info_cache with network_info: [{"id": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "address": "fa:16:3e:08:31:07", "network": {"id": "cfc0fcd2-826d-4851-bc3e-3f0433d6fbce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1771427851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f2d040c323b4b948803334de7c8ec44", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc1640f1-06", "ovs_interfaceid": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:03:40.401616 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:40.415405 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:40.499684 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779962620.499325, 4baa35bb-b237-42be-aa8b-d9eeed7e41a0 => ua-3177d27e-24bf-418b-97a0-c324d705954d> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 10:03:40.503353 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-3177d27e-24bf-418b-97a0-c324d705954d for instance 4baa35bb-b237-42be-aa8b-d9eeed7e41a0 {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 10:03:40.507129 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Successfully detached device vdb from instance 4baa35bb-b237-42be-aa8b-d9eeed7e41a0 from the live domain config.
May 28 10:03:40.512188 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:03:40.512188 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d', 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3177d27e-24bf-418b-97a0-c324d705954d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:03:40.512188 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:03:40.512188 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:03:40.512188 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d', 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3177d27e-24bf-418b-97a0-c324d705954d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:03:40.512188 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:03:40.533537 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:40.541597 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:03:40.541597 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:03:40.541597 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:03:40.541597 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:03:40.541597 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:03:40.541597 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:03:40.541597 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:03:40.542210 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:03:40.542210 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:03:40.542210 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:03:40.542210 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:03:40.542210 np0000001613 nova-compute[98321]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:03:40.542210 np0000001613 nova-compute[98321]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d (non-flash)
May 28 10:03:40.542210 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:03:40.542210 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', '59'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', '60'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d', '61'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d', '62')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:03:40.542210 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d', '62')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:03:40.543338 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d', '61')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:03:40.544319 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc2be480>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d'): ({'sdo'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d'): ({'sdn'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:03:40.544582 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Removing multipathed devices sdn, sdo {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:03:40.544848 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Flush multipath device 3300000006509bf9e {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:03:40.560677 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:40.581989 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:03:40.632481 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:03:40.632721 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:40.636781 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3705e3f1-93c4-4022-b724-1fbe3b8184f1 req-9c1ef7cf-6dc1-4542-b88e-0a39b064b983 service nova] Releasing lock "refresh_cache-2641ee65-c9c2-401d-b511-6ecc1247a3ad" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:03:40.654997 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:40.679006 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Checking to see if SCSI volumes sdn, sdo have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:03:40.679304 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] SCSI volumes sdn, sdo have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:03:40.681039 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Checking to see if device paths {'sdn', 'sdo'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:03:40.693936 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Device paths {'sdn', 'sdo'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:03:40.694293 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:03:40.705639 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:03:40.738978 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d, portal: 192.168.40.100,3260]
May 28 10:03:40.738978 np0000001613 nova-compute[98321]: Logout of [sid: 62, target: iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d, portal: 192.168.40.100,3260] successful.
May 28 10:03:40.738978 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:03:40.757506 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:03:40.778877 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:03:40.813622 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d, portal: 192.168.50.100,3260]
May 28 10:03:40.813622 np0000001613 nova-compute[98321]: Logout of [sid: 61, target: iqn.2023-03.storpool.com:os--volume-3177d27e-24bf-418b-97a0-c324d705954d, portal: 192.168.50.100,3260] successful.
May 28 10:03:40.813622 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:03:40.833864 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:03:40.834116 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:03:40.834311 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] <== disconnect_volume: return (324ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:03:40.834472 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:03:40.844879 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-401de068-e87a-454d-ae4e-ebaa93cbac61 req-cb9e2657-a436-4fec-afd5-f14396115a80 service nova] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Received event network-vif-plugged-7b726d59-4d13-4e3e-b9d9-1536c96d6af1 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:40.844879 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-401de068-e87a-454d-ae4e-ebaa93cbac61 req-cb9e2657-a436-4fec-afd5-f14396115a80 service nova] Acquiring lock "41678987-f525-4994-81c7-32ab2a92c194-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:40.846455 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-401de068-e87a-454d-ae4e-ebaa93cbac61 req-cb9e2657-a436-4fec-afd5-f14396115a80 service nova] Lock "41678987-f525-4994-81c7-32ab2a92c194-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:40.846455 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-401de068-e87a-454d-ae4e-ebaa93cbac61 req-cb9e2657-a436-4fec-afd5-f14396115a80 service nova] Lock "41678987-f525-4994-81c7-32ab2a92c194-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:40.846907 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-401de068-e87a-454d-ae4e-ebaa93cbac61 req-cb9e2657-a436-4fec-afd5-f14396115a80 service nova] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Processing event network-vif-plugged-7b726d59-4d13-4e3e-b9d9-1536c96d6af1 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:03:41.413897 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lazy-loading 'flavor' on Instance uuid 4baa35bb-b237-42be-aa8b-d9eeed7e41a0 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:03:41.484045 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:03:41.484413 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962621.4840932, 41678987-f525-4994-81c7-32ab2a92c194 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:03:41.484760 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 41678987-f525-4994-81c7-32ab2a92c194] VM Started (Lifecycle Event)
May 28 10:03:41.487223 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:03:41.492114 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Instance spawned successfully.
May 28 10:03:41.492621 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:03:41.990186 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:03:41.993515 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:03:42.004093 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:03:42.004396 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:03:42.005048 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:03:42.005320 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:03:42.005640 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:03:42.005973 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:03:42.412838 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e7127cc6-684b-4c89-8c1f-b430aae6d3f1 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "d2e043b6-afe6-4afb-92d6-7d8b33545f19" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:42.412838 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e7127cc6-684b-4c89-8c1f-b430aae6d3f1 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "d2e043b6-afe6-4afb-92d6-7d8b33545f19" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:42.412838 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e7127cc6-684b-4c89-8c1f-b430aae6d3f1 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "d2e043b6-afe6-4afb-92d6-7d8b33545f19-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:42.412838 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e7127cc6-684b-4c89-8c1f-b430aae6d3f1 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "d2e043b6-afe6-4afb-92d6-7d8b33545f19-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:42.412838 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e7127cc6-684b-4c89-8c1f-b430aae6d3f1 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "d2e043b6-afe6-4afb-92d6-7d8b33545f19-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:42.419229 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-e7127cc6-684b-4c89-8c1f-b430aae6d3f1 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Terminating instance
May 28 10:03:42.433601 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f0a62a65-97b5-4a18-be05-6e7174b72aeb tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.188s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:42.498061 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 41678987-f525-4994-81c7-32ab2a92c194] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:03:42.498333 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962622.49814, 41678987-f525-4994-81c7-32ab2a92c194 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:03:42.498441 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 41678987-f525-4994-81c7-32ab2a92c194] VM Paused (Lifecycle Event)
May 28 10:03:42.517425 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Took 7.09 seconds to spawn the instance on the hypervisor.
May 28 10:03:42.517638 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:03:42.530402 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:42.923581 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-e7127cc6-684b-4c89-8c1f-b430aae6d3f1 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:03:42.929430 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d5c2ffbb-ee17-43ec-9808-9d99cab92670 req-4079441b-671a-4685-a367-916282dbb57c service nova] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Received event network-vif-plugged-7b726d59-4d13-4e3e-b9d9-1536c96d6af1 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:42.929640 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d5c2ffbb-ee17-43ec-9808-9d99cab92670 req-4079441b-671a-4685-a367-916282dbb57c service nova] Acquiring lock "41678987-f525-4994-81c7-32ab2a92c194-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:42.932609 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d5c2ffbb-ee17-43ec-9808-9d99cab92670 req-4079441b-671a-4685-a367-916282dbb57c service nova] Lock "41678987-f525-4994-81c7-32ab2a92c194-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:42.932925 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d5c2ffbb-ee17-43ec-9808-9d99cab92670 req-4079441b-671a-4685-a367-916282dbb57c service nova] Lock "41678987-f525-4994-81c7-32ab2a92c194-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:42.933710 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d5c2ffbb-ee17-43ec-9808-9d99cab92670 req-4079441b-671a-4685-a367-916282dbb57c service nova] [instance: 41678987-f525-4994-81c7-32ab2a92c194] No waiting events found dispatching network-vif-plugged-7b726d59-4d13-4e3e-b9d9-1536c96d6af1 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:03:42.933907 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-d5c2ffbb-ee17-43ec-9808-9d99cab92670 req-4079441b-671a-4685-a367-916282dbb57c service nova] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Received unexpected event network-vif-plugged-7b726d59-4d13-4e3e-b9d9-1536c96d6af1 for instance with vm_state active and task_state None.
May 28 10:03:42.957100 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:42.967778 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:42.987524 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:43.002994 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:03:43.014701 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962623.0135636, 41678987-f525-4994-81c7-32ab2a92c194 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:03:43.015467 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 41678987-f525-4994-81c7-32ab2a92c194] VM Resumed (Lifecycle Event)
May 28 10:03:43.027299 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Took 14.99 seconds to build instance.
May 28 10:03:43.183617 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:43.192147 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:43.213668 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-be40aacb-e657-4bc3-a442-9a20b1e2ed01 req-63a647be-9504-40be-9e0d-7d708c4b092b service nova] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Received event network-vif-unplugged-f58856d7-37d0-48f5-8883-32267e5b73bc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:43.213668 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-be40aacb-e657-4bc3-a442-9a20b1e2ed01 req-63a647be-9504-40be-9e0d-7d708c4b092b service nova] Acquiring lock "d2e043b6-afe6-4afb-92d6-7d8b33545f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:43.213992 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-be40aacb-e657-4bc3-a442-9a20b1e2ed01 req-63a647be-9504-40be-9e0d-7d708c4b092b service nova] Lock "d2e043b6-afe6-4afb-92d6-7d8b33545f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:43.214088 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-be40aacb-e657-4bc3-a442-9a20b1e2ed01 req-63a647be-9504-40be-9e0d-7d708c4b092b service nova] Lock "d2e043b6-afe6-4afb-92d6-7d8b33545f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:43.214437 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-be40aacb-e657-4bc3-a442-9a20b1e2ed01 req-63a647be-9504-40be-9e0d-7d708c4b092b service nova] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] No waiting events found dispatching network-vif-unplugged-f58856d7-37d0-48f5-8883-32267e5b73bc {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:03:43.214567 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-be40aacb-e657-4bc3-a442-9a20b1e2ed01 req-63a647be-9504-40be-9e0d-7d708c4b092b service nova] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Received event network-vif-unplugged-f58856d7-37d0-48f5-8883-32267e5b73bc for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:03:43.218628 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-51df8617-98d2-4783-b329-59b2e7e29137 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Acquiring lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:43.219154 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-51df8617-98d2-4783-b329-59b2e7e29137 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:43.219359 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-51df8617-98d2-4783-b329-59b2e7e29137 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Acquiring lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:43.219486 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-51df8617-98d2-4783-b329-59b2e7e29137 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:43.219610 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-51df8617-98d2-4783-b329-59b2e7e29137 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:43.222269 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-51df8617-98d2-4783-b329-59b2e7e29137 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Terminating instance
May 28 10:03:43.311194 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Instance destroyed successfully.
May 28 10:03:43.311888 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-e7127cc6-684b-4c89-8c1f-b430aae6d3f1 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lazy-loading 'resources' on Instance uuid d2e043b6-afe6-4afb-92d6-7d8b33545f19 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:03:43.517791 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:03:43.522190 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:03:43.531475 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Lock "41678987-f525-4994-81c7-32ab2a92c194" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.501s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:43.726696 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-51df8617-98d2-4783-b329-59b2e7e29137 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:03:43.767868 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:43.774018 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:43.799544 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:43.811093 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:43.818523 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-e7127cc6-684b-4c89-8c1f-b430aae6d3f1 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-246966041',display_name='tempest-ServerRescueNegativeTestJSON-server-246966041',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serverrescuenegativetestjson-server-246966041',id=20,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:00:53Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f5fc8bc5d1984c1c839a3ef7e30b9d36',ramdisk_id='',reservation_id='r-i9h0da26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1286552851',owner_user_name='tempest-ServerRescueNegativeTestJSON-1286552851-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:00:54Z,user_data=None,user_id='45c67299cd204090b9ebf7e0eb873e37',uuid=d2e043b6-afe6-4afb-92d6-7d8b33545f19,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "f58856d7-37d0-48f5-8883-32267e5b73bc", "address": "fa:16:3e:e0:9c:cd", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf58856d7-37", "ovs_interfaceid": "f58856d7-37d0-48f5-8883-32267e5b73bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:03:43.818523 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-e7127cc6-684b-4c89-8c1f-b430aae6d3f1 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Converting VIF {"id": "f58856d7-37d0-48f5-8883-32267e5b73bc", "address": "fa:16:3e:e0:9c:cd", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf58856d7-37", "ovs_interfaceid": "f58856d7-37d0-48f5-8883-32267e5b73bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:03:43.818924 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-e7127cc6-684b-4c89-8c1f-b430aae6d3f1 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:9c:cd,bridge_name='br-int',has_traffic_filtering=True,id=f58856d7-37d0-48f5-8883-32267e5b73bc,network=Network(729946be-b963-4dfb-ad38-335762a8666c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf58856d7-37') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:03:43.819112 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-e7127cc6-684b-4c89-8c1f-b430aae6d3f1 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:9c:cd,bridge_name='br-int',has_traffic_filtering=True,id=f58856d7-37d0-48f5-8883-32267e5b73bc,network=Network(729946be-b963-4dfb-ad38-335762a8666c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf58856d7-37') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:03:43.821221 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:43.821221 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf58856d7-37, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:43.823949 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:43.824896 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:03:43.852611 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:43.854030 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:43.866929 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:43.869303 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:43.869516 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f6f6ff9a-35ec-46f6-9905-8ae84ea5d689) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:43.870560 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:43.872681 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:03:43.891050 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:43.897645 np0000001613 nova-compute[98321]: INFO os_vif [None req-e7127cc6-684b-4c89-8c1f-b430aae6d3f1 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:9c:cd,bridge_name='br-int',has_traffic_filtering=True,id=f58856d7-37d0-48f5-8883-32267e5b73bc,network=Network(729946be-b963-4dfb-ad38-335762a8666c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf58856d7-37')
May 28 10:03:43.898552 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-e7127cc6-684b-4c89-8c1f-b430aae6d3f1 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Deleting instance files /opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19_del
May 28 10:03:43.900041 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-e7127cc6-684b-4c89-8c1f-b430aae6d3f1 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Deletion of /opt/stack/data/nova/instances/d2e043b6-afe6-4afb-92d6-7d8b33545f19_del complete
May 28 10:03:44.024438 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999655829999938 future=<Future at 0x73c1fc1ac410 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:44.095922 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999633858999914 future=<Future at 0x73c1fc15e2d0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:44.103777 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Instance destroyed successfully.
May 28 10:03:44.106899 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-51df8617-98d2-4783-b329-59b2e7e29137 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lazy-loading 'resources' on Instance uuid 4baa35bb-b237-42be-aa8b-d9eeed7e41a0 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:03:44.370659 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3e71bf58-339b-4f26-a4b3-4e90cd629474 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Acquiring lock "41678987-f525-4994-81c7-32ab2a92c194" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:44.370877 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3e71bf58-339b-4f26-a4b3-4e90cd629474 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Lock "41678987-f525-4994-81c7-32ab2a92c194" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:44.371072 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3e71bf58-339b-4f26-a4b3-4e90cd629474 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Acquiring lock "41678987-f525-4994-81c7-32ab2a92c194-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:44.371296 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3e71bf58-339b-4f26-a4b3-4e90cd629474 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Lock "41678987-f525-4994-81c7-32ab2a92c194-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:44.371446 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3e71bf58-339b-4f26-a4b3-4e90cd629474 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Lock "41678987-f525-4994-81c7-32ab2a92c194-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:44.373731 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-3e71bf58-339b-4f26-a4b3-4e90cd629474 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Terminating instance
May 28 10:03:44.409071 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-e7127cc6-684b-4c89-8c1f-b430aae6d3f1 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Took 1.49 seconds to destroy the instance on the hypervisor.
May 28 10:03:44.410529 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-e7127cc6-684b-4c89-8c1f-b430aae6d3f1 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:03:44.410655 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:03:44.411269 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:03:44.412096 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:44.492575 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:44.498054 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:44.610933 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-51df8617-98d2-4783-b329-59b2e7e29137 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:01:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-445999024',display_name='tempest-ServerStableDeviceRescueTest-server-445999024',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serverstabledevicerescuetest-server-445999024',id=28,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHYEtJPZFtEAxWytQRE0q9ojBtsXp8sLSsdVhH0fWy0OH7NIWqXHiL4IKGra0wQLgHSM0O03o37kQJrxR0gIvqWp6aM3ftiLSmbak4otJmNefvORIwdb0k3Y0ZFuCp+DA==',key_name='tempest-keypair-325561194',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:03:00Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12b4f42e155347e4a2055b151f04390a',ramdisk_id='',reservation_id='r-acgw6178',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2062770061',owner_user_name='tempest-ServerStableDeviceRescueTest-2062770061-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:03:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f33df1d85634228ba269922d1f23be0',uuid=4baa35bb-b237-42be-aa8b-d9eeed7e41a0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39", "address": "fa:16:3e:05:9e:a2", "network": {"id": "2b7ff7fb-07d6-4791-9553-cb0a7a073e10", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2104350241-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12b4f42e155347e4a2055b151f04390a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f414a0-04", "ovs_interfaceid": "a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:03:44.610933 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-51df8617-98d2-4783-b329-59b2e7e29137 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Converting VIF {"id": "a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39", "address": "fa:16:3e:05:9e:a2", "network": {"id": "2b7ff7fb-07d6-4791-9553-cb0a7a073e10", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2104350241-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12b4f42e155347e4a2055b151f04390a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f414a0-04", "ovs_interfaceid": "a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:03:44.610933 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-51df8617-98d2-4783-b329-59b2e7e29137 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:9e:a2,bridge_name='br-int',has_traffic_filtering=True,id=a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39,network=Network(2b7ff7fb-07d6-4791-9553-cb0a7a073e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4f414a0-04') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:03:44.610933 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-51df8617-98d2-4783-b329-59b2e7e29137 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:9e:a2,bridge_name='br-int',has_traffic_filtering=True,id=a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39,network=Network(2b7ff7fb-07d6-4791-9553-cb0a7a073e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4f414a0-04') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:03:44.611583 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:44.611583 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4f414a0-04, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:44.623970 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:44.625206 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:03:44.626708 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:44.626708 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d2f012a-acea-4f0b-a7e8-d7a5c1d797c5) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:44.627569 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:44.628301 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:03:44.628474 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:44.632520 np0000001613 nova-compute[98321]: INFO os_vif [None req-51df8617-98d2-4783-b329-59b2e7e29137 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:9e:a2,bridge_name='br-int',has_traffic_filtering=True,id=a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39,network=Network(2b7ff7fb-07d6-4791-9553-cb0a7a073e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4f414a0-04')
May 28 10:03:44.635186 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-51df8617-98d2-4783-b329-59b2e7e29137 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Deleting instance files /opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0_del
May 28 10:03:44.635186 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-51df8617-98d2-4783-b329-59b2e7e29137 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Deletion of /opt/stack/data/nova/instances/4baa35bb-b237-42be-aa8b-d9eeed7e41a0_del complete
May 28 10:03:44.877082 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3e71bf58-339b-4f26-a4b3-4e90cd629474 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:03:44.899734 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:44.902996 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:44.932405 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:45.066925 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-92701f63-2c87-41d6-a115-df4b7023b55d req-bfd92f1e-55b9-40bc-bd69-e067cd0efc49 service nova] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Received event network-vif-unplugged-7b726d59-4d13-4e3e-b9d9-1536c96d6af1 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:45.068276 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-92701f63-2c87-41d6-a115-df4b7023b55d req-bfd92f1e-55b9-40bc-bd69-e067cd0efc49 service nova] Acquiring lock "41678987-f525-4994-81c7-32ab2a92c194-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:45.069917 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-92701f63-2c87-41d6-a115-df4b7023b55d req-bfd92f1e-55b9-40bc-bd69-e067cd0efc49 service nova] Lock "41678987-f525-4994-81c7-32ab2a92c194-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:45.070192 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-92701f63-2c87-41d6-a115-df4b7023b55d req-bfd92f1e-55b9-40bc-bd69-e067cd0efc49 service nova] Lock "41678987-f525-4994-81c7-32ab2a92c194-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:45.071526 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-92701f63-2c87-41d6-a115-df4b7023b55d req-bfd92f1e-55b9-40bc-bd69-e067cd0efc49 service nova] [instance: 41678987-f525-4994-81c7-32ab2a92c194] No waiting events found dispatching network-vif-unplugged-7b726d59-4d13-4e3e-b9d9-1536c96d6af1 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:03:45.071753 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-92701f63-2c87-41d6-a115-df4b7023b55d req-bfd92f1e-55b9-40bc-bd69-e067cd0efc49 service nova] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Received event network-vif-unplugged-7b726d59-4d13-4e3e-b9d9-1536c96d6af1 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:03:45.117174 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:45.124934 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:45.152655 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-51df8617-98d2-4783-b329-59b2e7e29137 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Took 1.43 seconds to destroy the instance on the hypervisor.
May 28 10:03:45.153319 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-51df8617-98d2-4783-b329-59b2e7e29137 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:03:45.153491 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:03:45.153576 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:03:45.154213 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:45.254121 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.99969393099991 future=<Future at 0x73c1fc62d7f0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:45.259385 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Instance destroyed successfully.
May 28 10:03:45.261055 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-3e71bf58-339b-4f26-a4b3-4e90cd629474 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Lazy-loading 'resources' on Instance uuid 41678987-f525-4994-81c7-32ab2a92c194 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:03:45.265815 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:45.291471 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:03:45.306708 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f460c95f-8ca1-4312-ad23-313c9c267d56 req-02e8c563-85ba-4e93-aa28-fd249df981b8 service nova] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Received event network-vif-unplugged-f58856d7-37d0-48f5-8883-32267e5b73bc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:45.306911 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f460c95f-8ca1-4312-ad23-313c9c267d56 req-02e8c563-85ba-4e93-aa28-fd249df981b8 service nova] Acquiring lock "d2e043b6-afe6-4afb-92d6-7d8b33545f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:45.308336 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f460c95f-8ca1-4312-ad23-313c9c267d56 req-02e8c563-85ba-4e93-aa28-fd249df981b8 service nova] Lock "d2e043b6-afe6-4afb-92d6-7d8b33545f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:45.312724 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f460c95f-8ca1-4312-ad23-313c9c267d56 req-02e8c563-85ba-4e93-aa28-fd249df981b8 service nova] Lock "d2e043b6-afe6-4afb-92d6-7d8b33545f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:45.312724 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f460c95f-8ca1-4312-ad23-313c9c267d56 req-02e8c563-85ba-4e93-aa28-fd249df981b8 service nova] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] No waiting events found dispatching network-vif-unplugged-f58856d7-37d0-48f5-8883-32267e5b73bc {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:03:45.312724 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f460c95f-8ca1-4312-ad23-313c9c267d56 req-02e8c563-85ba-4e93-aa28-fd249df981b8 service nova] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Received event network-vif-unplugged-f58856d7-37d0-48f5-8883-32267e5b73bc for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:03:45.312724 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f460c95f-8ca1-4312-ad23-313c9c267d56 req-02e8c563-85ba-4e93-aa28-fd249df981b8 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Received event network-vif-unplugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:45.312724 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f460c95f-8ca1-4312-ad23-313c9c267d56 req-02e8c563-85ba-4e93-aa28-fd249df981b8 service nova] Acquiring lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:45.313362 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f460c95f-8ca1-4312-ad23-313c9c267d56 req-02e8c563-85ba-4e93-aa28-fd249df981b8 service nova] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:45.313635 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f460c95f-8ca1-4312-ad23-313c9c267d56 req-02e8c563-85ba-4e93-aa28-fd249df981b8 service nova] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:45.315725 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f460c95f-8ca1-4312-ad23-313c9c267d56 req-02e8c563-85ba-4e93-aa28-fd249df981b8 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] No waiting events found dispatching network-vif-unplugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:03:45.317337 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f460c95f-8ca1-4312-ad23-313c9c267d56 req-02e8c563-85ba-4e93-aa28-fd249df981b8 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Received event network-vif-unplugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:03:45.317879 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f460c95f-8ca1-4312-ad23-313c9c267d56 req-02e8c563-85ba-4e93-aa28-fd249df981b8 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Received event network-vif-unplugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:45.318089 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f460c95f-8ca1-4312-ad23-313c9c267d56 req-02e8c563-85ba-4e93-aa28-fd249df981b8 service nova] Acquiring lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:45.318344 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f460c95f-8ca1-4312-ad23-313c9c267d56 req-02e8c563-85ba-4e93-aa28-fd249df981b8 service nova] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:45.318504 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f460c95f-8ca1-4312-ad23-313c9c267d56 req-02e8c563-85ba-4e93-aa28-fd249df981b8 service nova] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:45.318662 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f460c95f-8ca1-4312-ad23-313c9c267d56 req-02e8c563-85ba-4e93-aa28-fd249df981b8 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] No waiting events found dispatching network-vif-unplugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:03:45.318794 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f460c95f-8ca1-4312-ad23-313c9c267d56 req-02e8c563-85ba-4e93-aa28-fd249df981b8 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Received event network-vif-unplugged-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:03:45.318936 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f460c95f-8ca1-4312-ad23-313c9c267d56 req-02e8c563-85ba-4e93-aa28-fd249df981b8 service nova] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Received event network-vif-deleted-f58856d7-37d0-48f5-8883-32267e5b73bc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:45.319101 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-f460c95f-8ca1-4312-ad23-313c9c267d56 req-02e8c563-85ba-4e93-aa28-fd249df981b8 service nova] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Neutron deleted interface f58856d7-37d0-48f5-8883-32267e5b73bc; detaching it from the instance and deleting it from the info cache
May 28 10:03:45.321993 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f460c95f-8ca1-4312-ad23-313c9c267d56 req-02e8c563-85ba-4e93-aa28-fd249df981b8 service nova] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Detach interface failed, port_id=f58856d7-37d0-48f5-8883-32267e5b73bc, reason: Instance d2e043b6-afe6-4afb-92d6-7d8b33545f19 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:03:45.763337 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-3e71bf58-339b-4f26-a4b3-4e90cd629474 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:03:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1238076561',display_name='tempest-ServersNegativeTestJSON-server-1238076561',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serversnegativetestjson-server-1238076561',id=35,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:03:42Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a0e2495daf24926a478a05961d90b35',ramdisk_id='',reservation_id='r-md5gzacd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-177803216',owner_user_name='tempest-ServersNegativeTestJSON-177803216-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:03:43Z,user_data=None,user_id='5d30ab8162f645b5928317737d115d63',uuid=41678987-f525-4994-81c7-32ab2a92c194,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b726d59-4d13-4e3e-b9d9-1536c96d6af1", "address": "fa:16:3e:52:8f:8c", "network": {"id": "6a2ed18f-61ae-4c1f-a1e3-ddfd8c254b01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-891009375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0e2495daf24926a478a05961d90b35", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b726d59-4d", "ovs_interfaceid": "7b726d59-4d13-4e3e-b9d9-1536c96d6af1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:03:45.763961 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-3e71bf58-339b-4f26-a4b3-4e90cd629474 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Converting VIF {"id": "7b726d59-4d13-4e3e-b9d9-1536c96d6af1", "address": "fa:16:3e:52:8f:8c", "network": {"id": "6a2ed18f-61ae-4c1f-a1e3-ddfd8c254b01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-891009375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0e2495daf24926a478a05961d90b35", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b726d59-4d", "ovs_interfaceid": "7b726d59-4d13-4e3e-b9d9-1536c96d6af1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:03:45.764074 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-3e71bf58-339b-4f26-a4b3-4e90cd629474 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:8f:8c,bridge_name='br-int',has_traffic_filtering=True,id=7b726d59-4d13-4e3e-b9d9-1536c96d6af1,network=Network(6a2ed18f-61ae-4c1f-a1e3-ddfd8c254b01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b726d59-4d') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:03:45.764376 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-3e71bf58-339b-4f26-a4b3-4e90cd629474 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:8f:8c,bridge_name='br-int',has_traffic_filtering=True,id=7b726d59-4d13-4e3e-b9d9-1536c96d6af1,network=Network(6a2ed18f-61ae-4c1f-a1e3-ddfd8c254b01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b726d59-4d') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:03:45.765177 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:45.765354 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b726d59-4d, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:45.766439 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:45.767221 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:03:45.767571 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:45.768491 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:45.768615 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=84d15558-5933-4005-b2cc-17ea71d24a83) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:45.768983 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:45.769618 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:03:45.769727 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:45.772572 np0000001613 nova-compute[98321]: INFO os_vif [None req-3e71bf58-339b-4f26-a4b3-4e90cd629474 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:8f:8c,bridge_name='br-int',has_traffic_filtering=True,id=7b726d59-4d13-4e3e-b9d9-1536c96d6af1,network=Network(6a2ed18f-61ae-4c1f-a1e3-ddfd8c254b01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b726d59-4d')
May 28 10:03:45.772897 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-3e71bf58-339b-4f26-a4b3-4e90cd629474 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Deleting instance files /opt/stack/data/nova/instances/41678987-f525-4994-81c7-32ab2a92c194_del
May 28 10:03:45.773533 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-3e71bf58-339b-4f26-a4b3-4e90cd629474 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Deletion of /opt/stack/data/nova/instances/41678987-f525-4994-81c7-32ab2a92c194_del complete
May 28 10:03:45.796569 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Took 1.39 seconds to deallocate network for instance.
May 28 10:03:45.813379 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-788c81f5-c1c5-45c5-b41a-c9b082f24ee6 req-27bf783e-74d6-4c45-8df6-0ece6c999c04 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Received event network-vif-deleted-a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:45.813379 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-788c81f5-c1c5-45c5-b41a-c9b082f24ee6 req-27bf783e-74d6-4c45-8df6-0ece6c999c04 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Neutron deleted interface a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39; detaching it from the instance and deleting it from the info cache
May 28 10:03:45.817976 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-788c81f5-c1c5-45c5-b41a-c9b082f24ee6 req-27bf783e-74d6-4c45-8df6-0ece6c999c04 service nova] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Detach interface failed, port_id=a4f414a0-04f5-41ca-8b8a-8f54dd8eeb39, reason: Instance 4baa35bb-b237-42be-aa8b-d9eeed7e41a0 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:03:46.242540 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:03:46.278931 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-3e71bf58-339b-4f26-a4b3-4e90cd629474 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Took 1.40 seconds to destroy the instance on the hypervisor.
May 28 10:03:46.279497 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-3e71bf58-339b-4f26-a4b3-4e90cd629474 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:03:46.279783 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:03:46.279933 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 41678987-f525-4994-81c7-32ab2a92c194] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:03:46.280253 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:46.303112 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e7127cc6-684b-4c89-8c1f-b430aae6d3f1 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:46.303316 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e7127cc6-684b-4c89-8c1f-b430aae6d3f1 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:46.425013 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:46.745360 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Took 1.59 seconds to deallocate network for instance.
May 28 10:03:47.125142 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e7127cc6-684b-4c89-8c1f-b430aae6d3f1 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:03:47.125517 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-e7127cc6-684b-4c89-8c1f-b430aae6d3f1 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:03:47.154903 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2fc5a634-0b75-4727-969f-69958f76f6ca req-60dcd42b-bc6a-45db-a61e-f8612b6826ac service nova] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Received event network-vif-unplugged-7b726d59-4d13-4e3e-b9d9-1536c96d6af1 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:47.155652 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2fc5a634-0b75-4727-969f-69958f76f6ca req-60dcd42b-bc6a-45db-a61e-f8612b6826ac service nova] Acquiring lock "41678987-f525-4994-81c7-32ab2a92c194-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:47.155896 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2fc5a634-0b75-4727-969f-69958f76f6ca req-60dcd42b-bc6a-45db-a61e-f8612b6826ac service nova] Lock "41678987-f525-4994-81c7-32ab2a92c194-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:47.156014 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2fc5a634-0b75-4727-969f-69958f76f6ca req-60dcd42b-bc6a-45db-a61e-f8612b6826ac service nova] Lock "41678987-f525-4994-81c7-32ab2a92c194-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:47.156174 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2fc5a634-0b75-4727-969f-69958f76f6ca req-60dcd42b-bc6a-45db-a61e-f8612b6826ac service nova] [instance: 41678987-f525-4994-81c7-32ab2a92c194] No waiting events found dispatching network-vif-unplugged-7b726d59-4d13-4e3e-b9d9-1536c96d6af1 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:03:47.156332 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2fc5a634-0b75-4727-969f-69958f76f6ca req-60dcd42b-bc6a-45db-a61e-f8612b6826ac service nova] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Received event network-vif-unplugged-7b726d59-4d13-4e3e-b9d9-1536c96d6af1 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:03:47.259902 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-51df8617-98d2-4783-b329-59b2e7e29137 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:47.263262 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:03:47.628808 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-e7127cc6-684b-4c89-8c1f-b430aae6d3f1 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:03:47.765927 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Took 1.49 seconds to deallocate network for instance.
May 28 10:03:47.889305 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-072bf02a-17a3-4e85-862b-aeb8c537dddc req-27c7d480-00fa-4b11-b4b7-7d2c86bc2c49 service nova] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Received event network-vif-deleted-7b726d59-4d13-4e3e-b9d9-1536c96d6af1 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:48.139049 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e7127cc6-684b-4c89-8c1f-b430aae6d3f1 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.835s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:48.140890 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-51df8617-98d2-4783-b329-59b2e7e29137 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.881s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:48.228041 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-e7127cc6-684b-4c89-8c1f-b430aae6d3f1 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Deleted allocations for instance d2e043b6-afe6-4afb-92d6-7d8b33545f19
May 28 10:03:48.273383 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3e71bf58-339b-4f26-a4b3-4e90cd629474 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:48.655611 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0004901180000160821 future=<Future at 0x73c1f41c9400 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:48.655872 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:48.656039 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=10.367099448999852 future=<Future at 0x73c1fc1ac410 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:48.656039 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=10.366984604999743 future=<Future at 0x73c1fc1ac410 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:48.657799 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Emitting event <LifecycleEvent: 1779962613.6548831, 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:03:48.657799 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] VM Stopped (Lifecycle Event)
May 28 10:03:48.866782 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-51df8617-98d2-4783-b329-59b2e7e29137 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:03:48.867003 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-51df8617-98d2-4783-b329-59b2e7e29137 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:03:49.159103 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: 2ed39bf7-c7ad-4925-a8fe-080cc2af4d2f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:03:49.237617 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e7127cc6-684b-4c89-8c1f-b430aae6d3f1 tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "d2e043b6-afe6-4afb-92d6-7d8b33545f19" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.827s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:49.369683 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-51df8617-98d2-4783-b329-59b2e7e29137 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:03:49.496535 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:49.790462 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:03:49.791722 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:03:49.792687 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:03:49.793747 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:03:49.877875 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-51df8617-98d2-4783-b329-59b2e7e29137 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.737s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:49.879425 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3e71bf58-339b-4f26-a4b3-4e90cd629474 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.606s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:49.893220 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8cdd1a93-11b3-465f-84a3-83a63ebc743f tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "87f6620a-fa87-4d27-8512-74215ef4fe34" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:49.893398 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8cdd1a93-11b3-465f-84a3-83a63ebc743f tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "87f6620a-fa87-4d27-8512-74215ef4fe34" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:49.893695 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8cdd1a93-11b3-465f-84a3-83a63ebc743f tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:49.893945 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8cdd1a93-11b3-465f-84a3-83a63ebc743f tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:49.894160 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8cdd1a93-11b3-465f-84a3-83a63ebc743f tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:49.896853 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-8cdd1a93-11b3-465f-84a3-83a63ebc743f tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Terminating instance
May 28 10:03:49.955887 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-51df8617-98d2-4783-b329-59b2e7e29137 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Deleted allocations for instance 4baa35bb-b237-42be-aa8b-d9eeed7e41a0
May 28 10:03:50.400658 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8cdd1a93-11b3-465f-84a3-83a63ebc743f tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:03:50.439470 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:50.442223 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:50.470360 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:50.474948 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:50.506517 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:50.623035 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3e71bf58-339b-4f26-a4b3-4e90cd629474 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:03:50.623354 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-3e71bf58-339b-4f26-a4b3-4e90cd629474 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:03:50.680131 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6c0461a5-affa-4b42-8895-7c0210477cad req-5792fcbc-16be-4a7e-96c3-1fd3df6ee4b6 service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Received event network-vif-unplugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:50.680131 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6c0461a5-affa-4b42-8895-7c0210477cad req-5792fcbc-16be-4a7e-96c3-1fd3df6ee4b6 service nova] Acquiring lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:50.680131 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6c0461a5-affa-4b42-8895-7c0210477cad req-5792fcbc-16be-4a7e-96c3-1fd3df6ee4b6 service nova] Lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:50.680131 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6c0461a5-affa-4b42-8895-7c0210477cad req-5792fcbc-16be-4a7e-96c3-1fd3df6ee4b6 service nova] Lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:50.680131 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6c0461a5-affa-4b42-8895-7c0210477cad req-5792fcbc-16be-4a7e-96c3-1fd3df6ee4b6 service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] No waiting events found dispatching network-vif-unplugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:03:50.680131 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6c0461a5-affa-4b42-8895-7c0210477cad req-5792fcbc-16be-4a7e-96c3-1fd3df6ee4b6 service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Received event network-vif-unplugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:03:50.739153 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:50.766620 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.998464423999849 future=<Future at 0x73c1fc6bf290 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:50.770765 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:50.771808 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Instance destroyed successfully.
May 28 10:03:50.772634 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-8cdd1a93-11b3-465f-84a3-83a63ebc743f tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lazy-loading 'resources' on Instance uuid 87f6620a-fa87-4d27-8512-74215ef4fe34 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:03:50.782993 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:50.784807 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:50.794210 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:50.795080 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:03:50.796608 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:03:50.814944 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:50.975913 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-51df8617-98d2-4783-b329-59b2e7e29137 tempest-ServerStableDeviceRescueTest-2062770061 tempest-ServerStableDeviceRescueTest-2062770061-project-member] Lock "4baa35bb-b237-42be-aa8b-d9eeed7e41a0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.757s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:51.128787 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-3e71bf58-339b-4f26-a4b3-4e90cd629474 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:03:51.229473 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:51.239438 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:51.243553 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:51.270491 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:51.275683 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-8cdd1a93-11b3-465f-84a3-83a63ebc743f tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:00:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1834037810',display_name='tempest-ServerRescueNegativeTestJSON-server-1834037810',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serverrescuenegativetestjson-server-1834037810',id=19,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:01:09Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f5fc8bc5d1984c1c839a3ef7e30b9d36',ramdisk_id='',reservation_id='r-ieli90wk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1286552851',owner_user_name='tempest-ServerRescueNegativeTestJSON-1286552851-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:01:17Z,user_data=None,user_id='45c67299cd204090b9ebf7e0eb873e37',uuid=87f6620a-fa87-4d27-8512-74215ef4fe34,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ac6cb03-1362-4f61-8f2d-3ae856d28f49", "address": "fa:16:3e:86:60:4b", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac6cb03-13", "ovs_interfaceid": "6ac6cb03-1362-4f61-8f2d-3ae856d28f49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:03:51.275953 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-8cdd1a93-11b3-465f-84a3-83a63ebc743f tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Converting VIF {"id": "6ac6cb03-1362-4f61-8f2d-3ae856d28f49", "address": "fa:16:3e:86:60:4b", "network": {"id": "729946be-b963-4dfb-ad38-335762a8666c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1326213026-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5fc8bc5d1984c1c839a3ef7e30b9d36", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac6cb03-13", "ovs_interfaceid": "6ac6cb03-1362-4f61-8f2d-3ae856d28f49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:03:51.276639 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-8cdd1a93-11b3-465f-84a3-83a63ebc743f tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:60:4b,bridge_name='br-int',has_traffic_filtering=True,id=6ac6cb03-1362-4f61-8f2d-3ae856d28f49,network=Network(729946be-b963-4dfb-ad38-335762a8666c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ac6cb03-13') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:03:51.277046 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-8cdd1a93-11b3-465f-84a3-83a63ebc743f tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:60:4b,bridge_name='br-int',has_traffic_filtering=True,id=6ac6cb03-1362-4f61-8f2d-3ae856d28f49,network=Network(729946be-b963-4dfb-ad38-335762a8666c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ac6cb03-13') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:03:51.281639 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:51.282688 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ac6cb03-13, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:51.284577 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:51.285238 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:03:51.293366 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:51.297566 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:51.297849 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e7a4a45c-37c3-400e-9dac-db1ab6cc75da) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:51.299318 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:51.300026 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:03:51.301887 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:51.307043 np0000001613 nova-compute[98321]: INFO os_vif [None req-8cdd1a93-11b3-465f-84a3-83a63ebc743f tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:60:4b,bridge_name='br-int',has_traffic_filtering=True,id=6ac6cb03-1362-4f61-8f2d-3ae856d28f49,network=Network(729946be-b963-4dfb-ad38-335762a8666c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ac6cb03-13')
May 28 10:03:51.307667 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-8cdd1a93-11b3-465f-84a3-83a63ebc743f tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Deleting instance files /opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34_del
May 28 10:03:51.308653 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-8cdd1a93-11b3-465f-84a3-83a63ebc743f tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Deletion of /opt/stack/data/nova/instances/87f6620a-fa87-4d27-8512-74215ef4fe34_del complete
May 28 10:03:51.420383 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:51.446461 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:51.448392 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:51.636916 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3e71bf58-339b-4f26-a4b3-4e90cd629474 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.757s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:51.716182 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-3e71bf58-339b-4f26-a4b3-4e90cd629474 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Deleted allocations for instance 41678987-f525-4994-81c7-32ab2a92c194
May 28 10:03:51.791619 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:03:51.791896 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:03:51.819706 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-8cdd1a93-11b3-465f-84a3-83a63ebc743f tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Took 1.42 seconds to destroy the instance on the hypervisor.
May 28 10:03:51.821250 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-8cdd1a93-11b3-465f-84a3-83a63ebc743f tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:03:51.821250 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:03:51.821250 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:03:51.821578 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:51.916340 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:52.301802 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:52.302365 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:52.304211 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:52.304211 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Auditing locally available compute resources for np0000001613 (node: np0000001613) {{(pid=98321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 10:03:52.345853 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8bcb8e02-66d9-494d-99f3-82822a75679b req-1afc9f61-58e6-4ef8-9c7c-afb0ae149e91 service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Received event network-vif-deleted-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:52.346001 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-8bcb8e02-66d9-494d-99f3-82822a75679b req-1afc9f61-58e6-4ef8-9c7c-afb0ae149e91 service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Neutron deleted interface 6ac6cb03-1362-4f61-8f2d-3ae856d28f49; detaching it from the instance and deleting it from the info cache
May 28 10:03:52.347693 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8bcb8e02-66d9-494d-99f3-82822a75679b req-1afc9f61-58e6-4ef8-9c7c-afb0ae149e91 service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Detach interface failed, port_id=6ac6cb03-1362-4f61-8f2d-3ae856d28f49, reason: Instance 87f6620a-fa87-4d27-8512-74215ef4fe34 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:03:52.482148 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Stashing vm_state: active {{(pid=98321) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 28 10:03:52.732250 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3e71bf58-339b-4f26-a4b3-4e90cd629474 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Lock "41678987-f525-4994-81c7-32ab2a92c194" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.361s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:52.766637 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:03:52.774965 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-388a78d8-33e6-46f0-9f1a-4536122aaade req-5dd85430-cd98-432d-8de8-3a82032b09e9 service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Received event network-vif-unplugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:52.775850 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-388a78d8-33e6-46f0-9f1a-4536122aaade req-5dd85430-cd98-432d-8de8-3a82032b09e9 service nova] Acquiring lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:52.775850 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-388a78d8-33e6-46f0-9f1a-4536122aaade req-5dd85430-cd98-432d-8de8-3a82032b09e9 service nova] Lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:52.775850 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-388a78d8-33e6-46f0-9f1a-4536122aaade req-5dd85430-cd98-432d-8de8-3a82032b09e9 service nova] Lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:52.776081 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-388a78d8-33e6-46f0-9f1a-4536122aaade req-5dd85430-cd98-432d-8de8-3a82032b09e9 service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] No waiting events found dispatching network-vif-unplugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:03:52.777060 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-388a78d8-33e6-46f0-9f1a-4536122aaade req-5dd85430-cd98-432d-8de8-3a82032b09e9 service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Received event network-vif-unplugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:03:52.777060 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-388a78d8-33e6-46f0-9f1a-4536122aaade req-5dd85430-cd98-432d-8de8-3a82032b09e9 service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Received event network-vif-plugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:52.777060 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-388a78d8-33e6-46f0-9f1a-4536122aaade req-5dd85430-cd98-432d-8de8-3a82032b09e9 service nova] Acquiring lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:52.777060 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-388a78d8-33e6-46f0-9f1a-4536122aaade req-5dd85430-cd98-432d-8de8-3a82032b09e9 service nova] Lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:52.777060 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-388a78d8-33e6-46f0-9f1a-4536122aaade req-5dd85430-cd98-432d-8de8-3a82032b09e9 service nova] Lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:52.777060 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-388a78d8-33e6-46f0-9f1a-4536122aaade req-5dd85430-cd98-432d-8de8-3a82032b09e9 service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] No waiting events found dispatching network-vif-plugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:03:52.777385 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-388a78d8-33e6-46f0-9f1a-4536122aaade req-5dd85430-cd98-432d-8de8-3a82032b09e9 service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Received unexpected event network-vif-plugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 for instance with vm_state active and task_state deleting.
May 28 10:03:52.777385 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-388a78d8-33e6-46f0-9f1a-4536122aaade req-5dd85430-cd98-432d-8de8-3a82032b09e9 service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Received event network-vif-plugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:52.777545 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-388a78d8-33e6-46f0-9f1a-4536122aaade req-5dd85430-cd98-432d-8de8-3a82032b09e9 service nova] Acquiring lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:52.779077 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-388a78d8-33e6-46f0-9f1a-4536122aaade req-5dd85430-cd98-432d-8de8-3a82032b09e9 service nova] Lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:52.779077 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-388a78d8-33e6-46f0-9f1a-4536122aaade req-5dd85430-cd98-432d-8de8-3a82032b09e9 service nova] Lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:52.779077 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-388a78d8-33e6-46f0-9f1a-4536122aaade req-5dd85430-cd98-432d-8de8-3a82032b09e9 service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] No waiting events found dispatching network-vif-plugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:03:52.779077 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-388a78d8-33e6-46f0-9f1a-4536122aaade req-5dd85430-cd98-432d-8de8-3a82032b09e9 service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Received unexpected event network-vif-plugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 for instance with vm_state active and task_state deleting.
May 28 10:03:52.779077 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-388a78d8-33e6-46f0-9f1a-4536122aaade req-5dd85430-cd98-432d-8de8-3a82032b09e9 service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Received event network-vif-unplugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:52.779077 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-388a78d8-33e6-46f0-9f1a-4536122aaade req-5dd85430-cd98-432d-8de8-3a82032b09e9 service nova] Acquiring lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:52.779077 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-388a78d8-33e6-46f0-9f1a-4536122aaade req-5dd85430-cd98-432d-8de8-3a82032b09e9 service nova] Lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:52.780426 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-388a78d8-33e6-46f0-9f1a-4536122aaade req-5dd85430-cd98-432d-8de8-3a82032b09e9 service nova] Lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:52.780426 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-388a78d8-33e6-46f0-9f1a-4536122aaade req-5dd85430-cd98-432d-8de8-3a82032b09e9 service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] No waiting events found dispatching network-vif-unplugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:03:52.780426 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-388a78d8-33e6-46f0-9f1a-4536122aaade req-5dd85430-cd98-432d-8de8-3a82032b09e9 service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Received event network-vif-unplugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:03:52.780426 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-388a78d8-33e6-46f0-9f1a-4536122aaade req-5dd85430-cd98-432d-8de8-3a82032b09e9 service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Received event network-vif-unplugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:52.780426 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-388a78d8-33e6-46f0-9f1a-4536122aaade req-5dd85430-cd98-432d-8de8-3a82032b09e9 service nova] Acquiring lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:52.780426 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-388a78d8-33e6-46f0-9f1a-4536122aaade req-5dd85430-cd98-432d-8de8-3a82032b09e9 service nova] Lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:52.780426 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-388a78d8-33e6-46f0-9f1a-4536122aaade req-5dd85430-cd98-432d-8de8-3a82032b09e9 service nova] Lock "87f6620a-fa87-4d27-8512-74215ef4fe34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:52.780426 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-388a78d8-33e6-46f0-9f1a-4536122aaade req-5dd85430-cd98-432d-8de8-3a82032b09e9 service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] No waiting events found dispatching network-vif-unplugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:03:52.780677 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-388a78d8-33e6-46f0-9f1a-4536122aaade req-5dd85430-cd98-432d-8de8-3a82032b09e9 service nova] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Received event network-vif-unplugged-6ac6cb03-1362-4f61-8f2d-3ae856d28f49 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:03:53.056598 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:53.056888 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:53.269124 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Took 1.45 seconds to deallocate network for instance.
May 28 10:03:53.366504 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:53.469581 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:53.470927 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:53.573700 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:03:53.574188 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Claim successful on node np0000001613
May 28 10:03:53.589437 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:53.589963 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:03:53.593703 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:53.696146 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:53.696609 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:53.779394 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8cdd1a93-11b3-465f-84a3-83a63ebc743f tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:53.805844 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:53.812283 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-5 (vda) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:03:53.815037 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:53.924491 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:53.925509 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:54.019677 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:54.020145 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:03:54.024922 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:54.091892 np0000001613 nova-compute[98321]: INFO nova.compute.resource_tracker [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Updating resource usage from migration ef07e63e-ffa4-4b38-aa43-ebb2b2851224
May 28 10:03:54.114470 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:54.114900 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:54.225355 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:54.230935 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3edc00a8-2c60-4c44-acb8-6f4d02114bf0/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:54.360446 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3edc00a8-2c60-4c44-acb8-6f4d02114bf0/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:54.360998 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3edc00a8-2c60-4c44-acb8-6f4d02114bf0/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:54.485892 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3edc00a8-2c60-4c44-acb8-6f4d02114bf0/disk --force-share --output=json" returned: 0 in 0.125s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:54.490307 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ce69b1-4c77-45a4-8975-bbba6924448d/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:54.504216 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:54.623017 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ce69b1-4c77-45a4-8975-bbba6924448d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:54.623473 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ce69b1-4c77-45a4-8975-bbba6924448d/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:54.753073 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ce69b1-4c77-45a4-8975-bbba6924448d/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:54.763880 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:54.890138 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c/disk --force-share --output=json" returned: 0 in 0.125s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:54.890874 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:54.909684 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:03:54.910309 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:03:54.993903 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:55.004516 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:03:55.005552 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:03:55.054685 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "env LANG=C uptime" returned: 0 in 0.049s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:03:55.056019 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Hypervisor/Node resource view: name=np0000001613 free_ram=11420MB free_disk=74.09206771850586GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 10:03:55.056389 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:55.135661 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:55.419565 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:03:55.932385 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.875s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:55.932853 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Migrating
May 28 10:03:55.933465 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8cdd1a93-11b3-465f-84a3-83a63ebc743f tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.154s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:55.933684 np0000001613 nova-compute[98321]: DEBUG nova.compute.rpcapi [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98321) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 10:03:56.302642 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:56.471356 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "refresh_cache-de9742b9-43db-40a6-b635-81d9244fd5e0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:03:56.471550 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquired lock "refresh_cache-de9742b9-43db-40a6-b635-81d9244fd5e0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:03:56.471755 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:03:56.659287 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8cdd1a93-11b3-465f-84a3-83a63ebc743f tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:03:56.659544 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-8cdd1a93-11b3-465f-84a3-83a63ebc743f tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:03:56.978534 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:57.164368 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-8cdd1a93-11b3-465f-84a3-83a63ebc743f tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:03:57.381979 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:03:57.555933 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Updating instance_info_cache with network_info: [{"id": "9df7e969-a155-41f1-9e30-c42f172029e4", "address": "fa:16:3e:9e:26:24", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df7e969-a1", "ovs_interfaceid": "9df7e969-a155-41f1-9e30-c42f172029e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:03:57.679687 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8cdd1a93-11b3-465f-84a3-83a63ebc743f tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.747s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:57.681581 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 2.623s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:57.744155 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-8cdd1a93-11b3-465f-84a3-83a63ebc743f tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Deleted allocations for instance 87f6620a-fa87-4d27-8512-74215ef4fe34
May 28 10:03:58.059258 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Releasing lock "refresh_cache-de9742b9-43db-40a6-b635-81d9244fd5e0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:03:58.695024 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Applying migration context for instance de9742b9-43db-40a6-b635-81d9244fd5e0 as it has an incoming, in-progress migration ef07e63e-ffa4-4b38-aa43-ebb2b2851224. Migration status is migrating {{(pid=98321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
May 28 10:03:58.696117 np0000001613 nova-compute[98321]: INFO nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Updating resource usage from migration ef07e63e-ffa4-4b38-aa43-ebb2b2851224
May 28 10:03:58.753332 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8cdd1a93-11b3-465f-84a3-83a63ebc743f tempest-ServerRescueNegativeTestJSON-1286552851 tempest-ServerRescueNegativeTestJSON-1286552851-project-member] Lock "87f6620a-fa87-4d27-8512-74215ef4fe34" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.860s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:58.764061 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 6895009a-024f-4919-9d25-a52905eac818 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:03:58.764766 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance b50eced2-71bf-4448-b2e1-f9657509f34c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:03:58.765480 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 3edc00a8-2c60-4c44-acb8-6f4d02114bf0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:03:58.765480 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 36fde791-779f-42a8-9aef-87eafbbe0370 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:03:58.765480 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 7ca4978c-d8a8-4ca2-81f3-63bc1e397615 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:03:58.765480 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 60ce69b1-4c77-45a4-8975-bbba6924448d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:03:58.765685 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 2641ee65-c9c2-401d-b511-6ecc1247a3ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:03:58.765685 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Migration ef07e63e-ffa4-4b38-aa43-ebb2b2851224 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 28 10:03:58.765751 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance de9742b9-43db-40a6-b635-81d9244fd5e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:03:58.766020 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 10:03:58.766219 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Final resource view: name=np0000001613 phys_ram=24030MB used_ram=2368MB phys_disk=95GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 10:03:55 up 36 min,  2 users,  load average: 8.70, 7.53, 3.95\n', 'num_instances': '8', 'num_vm_active': '8', 'num_task_None': '7', 'num_os_type_None': '8', 'num_proj_3403b533910644d2b254922fb84b1ac0': '5', 'io_workload': '1', 'num_task_resize_prep': '1', 'num_proj_edd64b0e2ce54cac860344420cf9c5b6': '1', 'num_proj_2a0e2495daf24926a478a05961d90b35': '1', 'num_proj_6f2d040c323b4b948803334de7c8ec44': '1'} {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 10:03:59.028626 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.005525654000393843 future=<Future at 0x73c1fc1ac410 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:59.029416 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Emitting event <LifecycleEvent: 1779962624.0229683, d2e043b6-afe6-4afb-92d6-7d8b33545f19 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:03:59.030708 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:59.031261 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] VM Stopped (Lifecycle Event)
May 28 10:03:59.033456 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=0.06209296599990921 future=<Future at 0x73c1fc15e2d0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:59.033719 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=0.06183406499985722 future=<Future at 0x73c1fc15e2d0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:59.096711 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0007671570001548389 future=<Future at 0x73c1fc15e2d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:59.096711 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:59.096711 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=1.1572064329998284 future=<Future at 0x73c1fc62d7f0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:59.096711 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=1.1570903669999097 future=<Future at 0x73c1fc62d7f0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:59.097357 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Emitting event <LifecycleEvent: 1779962624.0954711, 4baa35bb-b237-42be-aa8b-d9eeed7e41a0 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:03:59.098817 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] VM Stopped (Lifecycle Event)
May 28 10:03:59.267236 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-84a0e21f-1cfa-41f3-9f02-b2df18d7c846 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:59.267236 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-84a0e21f-1cfa-41f3-9f02-b2df18d7c846 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:59.267874 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-84a0e21f-1cfa-41f3-9f02-b2df18d7c846 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Shelving
May 28 10:03:59.409829 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:03:59.410087 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:03:59.502682 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:59.538276 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2f824a18-7073-4c11-9fde-f0725469ba5a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: d2e043b6-afe6-4afb-92d6-7d8b33545f19] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:03:59.575288 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Starting migrate_disk_and_power_off {{(pid=98321) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 28 10:03:59.577419 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6a0d1580-4544-470c-8cf1-dfeaad601d9d tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Acquiring lock "60ce69b1-4c77-45a4-8975-bbba6924448d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:59.578357 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6a0d1580-4544-470c-8cf1-dfeaad601d9d tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Lock "60ce69b1-4c77-45a4-8975-bbba6924448d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:59.578593 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6a0d1580-4544-470c-8cf1-dfeaad601d9d tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Acquiring lock "60ce69b1-4c77-45a4-8975-bbba6924448d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:59.578733 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6a0d1580-4544-470c-8cf1-dfeaad601d9d tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Lock "60ce69b1-4c77-45a4-8975-bbba6924448d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:59.578992 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6a0d1580-4544-470c-8cf1-dfeaad601d9d tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Lock "60ce69b1-4c77-45a4-8975-bbba6924448d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:59.584939 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-6a0d1580-4544-470c-8cf1-dfeaad601d9d tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Terminating instance
May 28 10:03:59.602691 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:59.603817 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 4baa35bb-b237-42be-aa8b-d9eeed7e41a0] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:03:59.605076 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:59.636524 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:59.825843 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:59.831547 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:59.913144 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:03:59.931769 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999697687999742 future=<Future at 0x73c1fc4e2ae0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:03:59.933543 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Instance destroyed successfully.
May 28 10:03:59.935353 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:02:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='multiattach-server-1',id=31,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrmebBJn1C7uIkB9JjrF4yuEuto77kf4SaBedfdmOdQwZzJyqrVQd0Wq/SA1eDV6FpWwBB4BKjLBcFgkvBrXSx4LeKHMUic/tPGA5px/F625klLXypbV+9p49FvQ4XImQ==',key_name='tempest-keypair-2082049331',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:02:24Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3403b533910644d2b254922fb84b1ac0',ramdisk_id='',reservation_id='r-d0jzlqs3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1052626787',owner_user_name='tempest-AttachVolumeMultiAttachTest-1052626787-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:03:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13481913e22d4bf1a94e1a9a270f5494',uuid=de9742b9-43db-40a6-b635-81d9244fd5e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9df7e969-a155-41f1-9e30-c42f172029e4", "address": "fa:16:3e:9e:26:24", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "vif_mac": "fa:16:3e:9e:26:24"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df7e969-a1", "ovs_interfaceid": "9df7e969-a155-41f1-9e30-c42f172029e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:03:59.935553 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converting VIF {"id": "9df7e969-a155-41f1-9e30-c42f172029e4", "address": "fa:16:3e:9e:26:24", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "vif_mac": "fa:16:3e:9e:26:24"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df7e969-a1", "ovs_interfaceid": "9df7e969-a155-41f1-9e30-c42f172029e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:03:59.936385 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:26:24,bridge_name='br-int',has_traffic_filtering=True,id=9df7e969-a155-41f1-9e30-c42f172029e4,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df7e969-a1') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:03:59.936583 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:26:24,bridge_name='br-int',has_traffic_filtering=True,id=9df7e969-a155-41f1-9e30-c42f172029e4,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df7e969-a1') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:03:59.940009 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:59.940009 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9df7e969-a1, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:59.940650 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:59.942692 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:03:59.947223 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:59.947617 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5d78d97e-4ce5-4fee-833b-5a737d02fa0a) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:03:59.949887 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:03:59.951123 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:03:59.952965 np0000001613 nova-compute[98321]: INFO os_vif [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:26:24,bridge_name='br-int',has_traffic_filtering=True,id=9df7e969-a155-41f1-9e30-c42f172029e4,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df7e969-a1')
May 28 10:03:59.963950 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-192e1940-2958-45b3-bb84-b71130a49a75 req-fb3eaffb-55e7-4ea3-a457-317047d57e0d service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Received event network-vif-unplugged-9df7e969-a155-41f1-9e30-c42f172029e4 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:03:59.966201 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-192e1940-2958-45b3-bb84-b71130a49a75 req-fb3eaffb-55e7-4ea3-a457-317047d57e0d service nova] Acquiring lock "de9742b9-43db-40a6-b635-81d9244fd5e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:03:59.966201 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-192e1940-2958-45b3-bb84-b71130a49a75 req-fb3eaffb-55e7-4ea3-a457-317047d57e0d service nova] Lock "de9742b9-43db-40a6-b635-81d9244fd5e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:03:59.968535 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-192e1940-2958-45b3-bb84-b71130a49a75 req-fb3eaffb-55e7-4ea3-a457-317047d57e0d service nova] Lock "de9742b9-43db-40a6-b635-81d9244fd5e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:03:59.972786 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-192e1940-2958-45b3-bb84-b71130a49a75 req-fb3eaffb-55e7-4ea3-a457-317047d57e0d service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] No waiting events found dispatching network-vif-unplugged-9df7e969-a155-41f1-9e30-c42f172029e4 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:03:59.974137 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-192e1940-2958-45b3-bb84-b71130a49a75 req-fb3eaffb-55e7-4ea3-a457-317047d57e0d service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Received unexpected event network-vif-unplugged-9df7e969-a155-41f1-9e30-c42f172029e4 for instance with vm_state active and task_state resize_migrating.
May 28 10:04:00.091395 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-6a0d1580-4544-470c-8cf1-dfeaad601d9d tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:04:00.115339 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:00.123543 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:00.144410 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:00.147772 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:00.169396 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:00.176067 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:00.254294 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.00047330799998235307 future=<Future at 0x73c1fc62d7f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:04:00.254927 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Emitting event <LifecycleEvent: 1779962625.2537203, 41678987-f525-4994-81c7-32ab2a92c194 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:04:00.255153 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:04:00.255382 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] VM Stopped (Lifecycle Event)
May 28 10:04:00.256871 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=5.5084225259997766 future=<Future at 0x73c1fc6bf290 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:04:00.256871 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=5.508190183999886 future=<Future at 0x73c1fc6bf290 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:04:00.314248 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:00.319795 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:00.348421 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:00.357359 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c20c8bcc-f2ae-4bf2-a757-2fa335ac8678 req-e46f5146-a381-4960-9f9a-f96694133d2c service nova] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Received event network-vif-unplugged-3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:04:00.358701 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c20c8bcc-f2ae-4bf2-a757-2fa335ac8678 req-e46f5146-a381-4960-9f9a-f96694133d2c service nova] Acquiring lock "60ce69b1-4c77-45a4-8975-bbba6924448d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:00.358701 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c20c8bcc-f2ae-4bf2-a757-2fa335ac8678 req-e46f5146-a381-4960-9f9a-f96694133d2c service nova] Lock "60ce69b1-4c77-45a4-8975-bbba6924448d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:00.358701 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c20c8bcc-f2ae-4bf2-a757-2fa335ac8678 req-e46f5146-a381-4960-9f9a-f96694133d2c service nova] Lock "60ce69b1-4c77-45a4-8975-bbba6924448d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:00.358701 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c20c8bcc-f2ae-4bf2-a757-2fa335ac8678 req-e46f5146-a381-4960-9f9a-f96694133d2c service nova] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] No waiting events found dispatching network-vif-unplugged-3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:04:00.359030 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c20c8bcc-f2ae-4bf2-a757-2fa335ac8678 req-e46f5146-a381-4960-9f9a-f96694133d2c service nova] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Received event network-vif-unplugged-3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:04:00.385122 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:00.424134 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Compute_service record updated for np0000001613:np0000001613 {{(pid=98321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 10:04:00.424294 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.745s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:00.425730 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:04:00.458879 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999657912999737 future=<Future at 0x73c1fc767020 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:04:00.463347 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Instance destroyed successfully.
May 28 10:04:00.463758 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-6a0d1580-4544-470c-8cf1-dfeaad601d9d tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Lazy-loading 'resources' on Instance uuid 60ce69b1-4c77-45a4-8975-bbba6924448d {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:04:00.523597 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Detected multiple connections on this host for volume: e8aeb4ed-7738-4054-b253-74e118c84fab, skipping target disconnect.
May 28 10:04:00.529926 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:00.619909 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999455517000115 future=<Future at 0x73c1f4212de0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:04:00.632211 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Instance destroyed successfully.
May 28 10:04:00.632211 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-84a0e21f-1cfa-41f3-9f02-b2df18d7c846 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lazy-loading 'numa_topology' on Instance uuid 7ca4978c-d8a8-4ca2-81f3-63bc1e397615 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:04:00.641509 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:00.642428 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:00.740231 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:00.741447 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:04:00.742139 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0_resize/disk /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:00.760875 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 41678987-f525-4994-81c7-32ab2a92c194] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:04:00.838399 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "cp -r /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0_resize/disk /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk" returned: 0 in 0.096s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:00.838680 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0_resize/disk.config /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk.config {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:00.878688 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "cp -r /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0_resize/disk.config /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk.config" returned: 0 in 0.040s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:00.880420 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0_resize/disk.info /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk.info {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:00.918093 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "cp -r /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0_resize/disk.info /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk.info" returned: 0 in 0.037s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:00.967053 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-6a0d1580-4544-470c-8cf1-dfeaad601d9d tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:03:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-681156522',display_name='tempest-ServersNegativeTestJSON-server-681156522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-serversnegativetestjson-server-681156522',id=33,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:03:25Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a0e2495daf24926a478a05961d90b35',ramdisk_id='',reservation_id='r-h4ot5s9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-177803216',owner_user_name='tempest-ServersNegativeTestJSON-177803216-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:03:25Z,user_data=None,user_id='5d30ab8162f645b5928317737d115d63',uuid=60ce69b1-4c77-45a4-8975-bbba6924448d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9", "address": "fa:16:3e:0f:38:13", "network": {"id": "6a2ed18f-61ae-4c1f-a1e3-ddfd8c254b01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-891009375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0e2495daf24926a478a05961d90b35", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea723e5-b4", "ovs_interfaceid": "3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:04:00.967381 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-6a0d1580-4544-470c-8cf1-dfeaad601d9d tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Converting VIF {"id": "3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9", "address": "fa:16:3e:0f:38:13", "network": {"id": "6a2ed18f-61ae-4c1f-a1e3-ddfd8c254b01", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-891009375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a0e2495daf24926a478a05961d90b35", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ea723e5-b4", "ovs_interfaceid": "3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:04:00.968324 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-6a0d1580-4544-470c-8cf1-dfeaad601d9d tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:38:13,bridge_name='br-int',has_traffic_filtering=True,id=3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9,network=Network(6a2ed18f-61ae-4c1f-a1e3-ddfd8c254b01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ea723e5-b4') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:04:00.968650 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-6a0d1580-4544-470c-8cf1-dfeaad601d9d tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:38:13,bridge_name='br-int',has_traffic_filtering=True,id=3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9,network=Network(6a2ed18f-61ae-4c1f-a1e3-ddfd8c254b01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ea723e5-b4') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:04:00.970435 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:00.970946 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ea723e5-b4, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:04:00.972559 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:00.973902 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:04:00.979592 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:00.980627 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:00.980796 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=83968221-b43b-453f-b0c8-8f5adecc351d) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:04:00.981404 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:00.981956 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:04:00.986862 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:00.990727 np0000001613 nova-compute[98321]: INFO os_vif [None req-6a0d1580-4544-470c-8cf1-dfeaad601d9d tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:38:13,bridge_name='br-int',has_traffic_filtering=True,id=3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9,network=Network(6a2ed18f-61ae-4c1f-a1e3-ddfd8c254b01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ea723e5-b4')
May 28 10:04:00.991146 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-6a0d1580-4544-470c-8cf1-dfeaad601d9d tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Deleting instance files /opt/stack/data/nova/instances/60ce69b1-4c77-45a4-8975-bbba6924448d_del
May 28 10:04:00.992122 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-6a0d1580-4544-470c-8cf1-dfeaad601d9d tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Deletion of /opt/stack/data/nova/instances/60ce69b1-4c77-45a4-8975-bbba6924448d_del complete
May 28 10:04:01.240006 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-84a0e21f-1cfa-41f3-9f02-b2df18d7c846 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Beginning cold snapshot process
May 28 10:04:01.481684 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:01.501201 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-6a0d1580-4544-470c-8cf1-dfeaad601d9d tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Took 1.41 seconds to destroy the instance on the hypervisor.
May 28 10:04:01.501956 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-6a0d1580-4544-470c-8cf1-dfeaad601d9d tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:04:01.502313 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:04:01.502448 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:04:01.502735 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:01.662975 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:02.060610 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4ea02d4c-0c8e-412f-abe4-8f4c7ac0cc77 req-00661685-d455-4667-ac19-7c7d44814954 service nova] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Received event network-vif-deleted-3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:04:02.061031 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-4ea02d4c-0c8e-412f-abe4-8f4c7ac0cc77 req-00661685-d455-4667-ac19-7c7d44814954 service nova] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Neutron deleted interface 3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9; detaching it from the instance and deleting it from the info cache
May 28 10:04:02.063031 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4ea02d4c-0c8e-412f-abe4-8f4c7ac0cc77 req-00661685-d455-4667-ac19-7c7d44814954 service nova] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Detach interface failed, port_id=3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9, reason: Instance 60ce69b1-4c77-45a4-8975-bbba6924448d could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:04:02.081230 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:02.081230 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:02.091554 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6934438a-655f-48f1-a285-7dbccc6716c2 req-fa325347-1a82-4571-9a19-4886f193cbcc service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Received event network-vif-unplugged-9df7e969-a155-41f1-9e30-c42f172029e4 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:04:02.092126 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6934438a-655f-48f1-a285-7dbccc6716c2 req-fa325347-1a82-4571-9a19-4886f193cbcc service nova] Acquiring lock "de9742b9-43db-40a6-b635-81d9244fd5e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:02.092399 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6934438a-655f-48f1-a285-7dbccc6716c2 req-fa325347-1a82-4571-9a19-4886f193cbcc service nova] Lock "de9742b9-43db-40a6-b635-81d9244fd5e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:02.092596 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6934438a-655f-48f1-a285-7dbccc6716c2 req-fa325347-1a82-4571-9a19-4886f193cbcc service nova] Lock "de9742b9-43db-40a6-b635-81d9244fd5e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:02.092737 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6934438a-655f-48f1-a285-7dbccc6716c2 req-fa325347-1a82-4571-9a19-4886f193cbcc service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] No waiting events found dispatching network-vif-unplugged-9df7e969-a155-41f1-9e30-c42f172029e4 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:04:02.092886 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-6934438a-655f-48f1-a285-7dbccc6716c2 req-fa325347-1a82-4571-9a19-4886f193cbcc service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Received unexpected event network-vif-unplugged-9df7e969-a155-41f1-9e30-c42f172029e4 for instance with vm_state active and task_state resize_migrating.
May 28 10:04:02.093021 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6934438a-655f-48f1-a285-7dbccc6716c2 req-fa325347-1a82-4571-9a19-4886f193cbcc service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Received event network-vif-unplugged-08d656bf-1f8f-4bd8-b04a-27184a5225d5 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:04:02.093186 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6934438a-655f-48f1-a285-7dbccc6716c2 req-fa325347-1a82-4571-9a19-4886f193cbcc service nova] Acquiring lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:02.093398 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6934438a-655f-48f1-a285-7dbccc6716c2 req-fa325347-1a82-4571-9a19-4886f193cbcc service nova] Lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:02.093516 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6934438a-655f-48f1-a285-7dbccc6716c2 req-fa325347-1a82-4571-9a19-4886f193cbcc service nova] Lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:02.093819 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6934438a-655f-48f1-a285-7dbccc6716c2 req-fa325347-1a82-4571-9a19-4886f193cbcc service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] No waiting events found dispatching network-vif-unplugged-08d656bf-1f8f-4bd8-b04a-27184a5225d5 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:04:02.093956 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-6934438a-655f-48f1-a285-7dbccc6716c2 req-fa325347-1a82-4571-9a19-4886f193cbcc service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Received unexpected event network-vif-unplugged-08d656bf-1f8f-4bd8-b04a-27184a5225d5 for instance with vm_state active and task_state shelving_image_uploading.
May 28 10:04:02.094066 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6934438a-655f-48f1-a285-7dbccc6716c2 req-fa325347-1a82-4571-9a19-4886f193cbcc service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Received event network-vif-unplugged-08d656bf-1f8f-4bd8-b04a-27184a5225d5 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:04:02.094256 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6934438a-655f-48f1-a285-7dbccc6716c2 req-fa325347-1a82-4571-9a19-4886f193cbcc service nova] Acquiring lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:02.094656 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6934438a-655f-48f1-a285-7dbccc6716c2 req-fa325347-1a82-4571-9a19-4886f193cbcc service nova] Lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:02.094768 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6934438a-655f-48f1-a285-7dbccc6716c2 req-fa325347-1a82-4571-9a19-4886f193cbcc service nova] Lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:02.094889 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6934438a-655f-48f1-a285-7dbccc6716c2 req-fa325347-1a82-4571-9a19-4886f193cbcc service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] No waiting events found dispatching network-vif-unplugged-08d656bf-1f8f-4bd8-b04a-27184a5225d5 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:04:02.095031 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-6934438a-655f-48f1-a285-7dbccc6716c2 req-fa325347-1a82-4571-9a19-4886f193cbcc service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Received unexpected event network-vif-unplugged-08d656bf-1f8f-4bd8-b04a-27184a5225d5 for instance with vm_state active and task_state shelving_image_uploading.
May 28 10:04:02.181820 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Port 9df7e969-a155-41f1-9e30-c42f172029e4 binding to destination host np0000001613 is already ACTIVE {{(pid=98321) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 28 10:04:02.279185 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Acquiring lock "ebfe249f-9326-47ad-8e83-b6058b04e1e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:02.279600 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Lock "ebfe249f-9326-47ad-8e83-b6058b04e1e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:02.431175 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-661f70d2-1d88-4ae8-98e5-d89a7ef165c9 req-998b5ae9-788a-43cb-b53a-e20867fc2e4a service nova] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Received event network-vif-unplugged-3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:04:02.431175 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-661f70d2-1d88-4ae8-98e5-d89a7ef165c9 req-998b5ae9-788a-43cb-b53a-e20867fc2e4a service nova] Acquiring lock "60ce69b1-4c77-45a4-8975-bbba6924448d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:02.431175 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-661f70d2-1d88-4ae8-98e5-d89a7ef165c9 req-998b5ae9-788a-43cb-b53a-e20867fc2e4a service nova] Lock "60ce69b1-4c77-45a4-8975-bbba6924448d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:02.431175 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-661f70d2-1d88-4ae8-98e5-d89a7ef165c9 req-998b5ae9-788a-43cb-b53a-e20867fc2e4a service nova] Lock "60ce69b1-4c77-45a4-8975-bbba6924448d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:02.431175 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-661f70d2-1d88-4ae8-98e5-d89a7ef165c9 req-998b5ae9-788a-43cb-b53a-e20867fc2e4a service nova] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] No waiting events found dispatching network-vif-unplugged-3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:04:02.431175 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-661f70d2-1d88-4ae8-98e5-d89a7ef165c9 req-998b5ae9-788a-43cb-b53a-e20867fc2e4a service nova] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Received event network-vif-unplugged-3ea723e5-b41e-46d4-8fbe-fd41c6ddc1d9 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:04:02.498081 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:04:02.759366 np0000001613 nova-compute[98321]: DEBUG nova.privsep.utils [None req-84a0e21f-1cfa-41f3-9f02-b2df18d7c846 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98321) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 10:04:02.759366 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-84a0e21f-1cfa-41f3-9f02-b2df18d7c846 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615/disk /opt/stack/data/nova/instances/snapshots/tmphlspowte/3b6d78ebaf484da5b910a37037c574b8 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:02.792748 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:04:03.000992 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Took 1.50 seconds to deallocate network for instance.
May 28 10:04:03.058178 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-84a0e21f-1cfa-41f3-9f02-b2df18d7c846 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615/disk /opt/stack/data/nova/instances/snapshots/tmphlspowte/3b6d78ebaf484da5b910a37037c574b8" returned: 0 in 0.299s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:03.058178 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-84a0e21f-1cfa-41f3-9f02-b2df18d7c846 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Snapshot extracted, beginning image upload
May 28 10:04:03.192035 np0000001613 nova-compute[98321]: DEBUG nova.compute.rpcapi [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98321) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 10:04:03.203484 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "de9742b9-43db-40a6-b635-81d9244fd5e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:03.212872 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "de9742b9-43db-40a6-b635-81d9244fd5e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.009s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:03.214011 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "de9742b9-43db-40a6-b635-81d9244fd5e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:03.362996 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:03.363483 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:03.367719 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:04:03.367917 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Claim successful on node np0000001613
May 28 10:04:03.425982 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:04:03.426274 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:04:03.426391 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 10:04:03.426641 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 43.36 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:04:03.508408 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6a0d1580-4544-470c-8cf1-dfeaad601d9d tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:04.222494 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:04.362398 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "refresh_cache-de9742b9-43db-40a6-b635-81d9244fd5e0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:04:04.362398 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquired lock "refresh_cache-de9742b9-43db-40a6-b635-81d9244fd5e0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:04:04.362398 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:04:04.502584 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:04.863590 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:05.008137 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:04:05.008423 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:04:05.226083 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:05.409991 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Updating instance_info_cache with network_info: [{"id": "9df7e969-a155-41f1-9e30-c42f172029e4", "address": "fa:16:3e:9e:26:24", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df7e969-a1", "ovs_interfaceid": "9df7e969-a155-41f1-9e30-c42f172029e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:04:05.511549 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:04:05.765585 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0005033610000282351 future=<Future at 0x73c1fc6bf290 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:04:05.765736 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:04:05.766126 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=9.165575041000011 future=<Future at 0x73c1fc4e2ae0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:04:05.766126 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=9.165466069000104 future=<Future at 0x73c1fc4e2ae0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:04:05.766974 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Emitting event <LifecycleEvent: 1779962630.7649524, 87f6620a-fa87-4d27-8512-74215ef4fe34 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:04:05.766974 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] VM Stopped (Lifecycle Event)
May 28 10:04:05.912095 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Releasing lock "refresh_cache-de9742b9-43db-40a6-b635-81d9244fd5e0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:04:05.984903 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:05.994620 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-84a0e21f-1cfa-41f3-9f02-b2df18d7c846 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Snapshot image upload complete
May 28 10:04:05.994921 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-84a0e21f-1cfa-41f3-9f02-b2df18d7c846 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:04:06.028774 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.665s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:06.029030 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:04:06.032088 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6a0d1580-4544-470c-8cf1-dfeaad601d9d tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.524s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:06.223727 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:06.270050 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 87f6620a-fa87-4d27-8512-74215ef4fe34] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:04:06.421193 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:04:06.437474 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:04:06.467180 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:06.514899 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-84a0e21f-1cfa-41f3-9f02-b2df18d7c846 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Shelve offloading
May 28 10:04:06.521879 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:04:06.522174 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:04:06.531356 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:04:06.532544 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fefd:30e7', 'fe80::e4df:c0ff:fe86:6341', 'fe80::fc16:3eff:fedb:1077', 'fe80::fc16:3eff:fe3c:b7e1', 'fe80::fc16:3eff:fee1:659', 'fe80::fc16:3eff:fe08:3107', 'fe80::e02b:1cff:fec7:1a41'] 
May 28 10:04:06.532684 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:04:06.532757 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:04:06.533040 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:04:06.551519 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:04:06.551883 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:04:06.552400 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:06.552723 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:06.734486 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6a0d1580-4544-470c-8cf1-dfeaad601d9d tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:04:06.734908 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-6a0d1580-4544-470c-8cf1-dfeaad601d9d tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:04:06.798404 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9e90ac16da754ec294694a965321111f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c134a4b41b44392b26d2e299b4911e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:04:07.036023 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Instance destroyed successfully.
May 28 10:04:07.036023 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-84a0e21f-1cfa-41f3-9f02-b2df18d7c846 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:04:07.037695 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-84a0e21f-1cfa-41f3-9f02-b2df18d7c846 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "refresh_cache-7ca4978c-d8a8-4ca2-81f3-63bc1e397615" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:04:07.037852 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-84a0e21f-1cfa-41f3-9f02-b2df18d7c846 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquired lock "refresh_cache-7ca4978c-d8a8-4ca2-81f3-63bc1e397615" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:04:07.037979 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-84a0e21f-1cfa-41f3-9f02-b2df18d7c846 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:04:07.061289 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:04:07.238560 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-6a0d1580-4544-470c-8cf1-dfeaad601d9d tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:04:07.507889 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Successfully created port: 835e2ca2-278c-4d61-9472-2107d4fc7ac3 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:04:07.542990 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-84a0e21f-1cfa-41f3-9f02-b2df18d7c846 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:07.568325 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:04:07.738323 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Starting finish_migration {{(pid=98321) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 28 10:04:07.738797 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Instance directory exists: not creating {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 10:04:07.739151 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Creating image(s)
May 28 10:04:07.740784 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:07.763572 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6a0d1580-4544-470c-8cf1-dfeaad601d9d tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.731s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:07.854394 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-6a0d1580-4544-470c-8cf1-dfeaad601d9d tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Deleted allocations for instance 60ce69b1-4c77-45a4-8975-bbba6924448d
May 28 10:04:07.864027 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.123s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:07.867178 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:04:07.867178 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:08.000134 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:08.000883 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Cannot resize image /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:04:08.078357 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Booting with volume 9cec193d-f880-40d9-82d0-9c0e4fb6c74d at /dev/vda
May 28 10:04:08.143128 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:04:08.165310 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:04:08.194899 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:08.251007 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:04:08.252502 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:04:08.266067 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:04:08.267208 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fefd:30e7', 'fe80::e4df:c0ff:fe86:6341', 'fe80::fc16:3eff:fedb:1077', 'fe80::fc16:3eff:fe3c:b7e1', 'fe80::fc16:3eff:fee1:659', 'fe80::fc16:3eff:fe08:3107', 'fe80::e02b:1cff:fec7:1a41'] 
May 28 10:04:08.267424 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:04:08.267424 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:04:08.267940 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:04:08.267940 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Updating existing volume attachment record: 3d61da90-6083-4aad-a4c5-9988d2f973c9 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:04:08.434447 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Successfully updated port: 835e2ca2-278c-4d61-9472-2107d4fc7ac3 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:04:08.507219 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Did not create local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 10:04:08.507482 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Ensure instance console log exists: /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:04:08.507908 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:08.508219 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:08.508399 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:08.513874 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Start _get_guest_xml network_info=[{"id": "9df7e969-a155-41f1-9e30-c42f172029e4", "address": "fa:16:3e:9e:26:24", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "vif_mac": "fa:16:3e:9e:26:24"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df7e969-a1", "ovs_interfaceid": "9df7e969-a155-41f1-9e30-c42f172029e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e8aeb4ed-7738-4054-b253-74e118c84fab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'de9742b9-43db-40a6-b635-81d9244fd5e0', 'attached_at': '2026-05-28T10:04:07.000000', 'detached_at': '', 'volume_id': 'e8aeb4ed-7738-4054-b253-74e118c84fab', 'multiattach': True, 'serial': 'e8aeb4ed-7738-4054-b253-74e118c84fab'}, 'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': '927e8af1-3ff8-4185-833c-e66077a07833', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:04:08.518339 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:04:08.519694 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='de9742b9-43db-40a6-b635-81d9244fd5e0'), owner=OwnerMeta(userid='13481913e22d4bf1a94e1a9a270f5494', username='tempest-AttachVolumeMultiAttachTest-1052626787-project-member', projectid='3403b533910644d2b254922fb84b1ac0', projectname='tempest-AttachVolumeMultiAttachTest-1052626787'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9df7e969-a155-41f1-9e30-c42f172029e4", "address": "fa:16:3e:9e:26:24", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "vif_mac": "fa:16:3e:9e:26:24"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df7e969-a1", "ovs_interfaceid": "9df7e969-a155-41f1-9e30-c42f172029e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962648.5192325) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:04:08.528341 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-bb592c7d-b93e-43f6-ac8e-0a7c48be2892 req-56cd3f5e-e282-4b86-8ce1-f5542f000097 service nova] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Received event network-changed-835e2ca2-278c-4d61-9472-2107d4fc7ac3 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:04:08.528520 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-bb592c7d-b93e-43f6-ac8e-0a7c48be2892 req-56cd3f5e-e282-4b86-8ce1-f5542f000097 service nova] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Refreshing instance network info cache due to event network-changed-835e2ca2-278c-4d61-9472-2107d4fc7ac3. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:04:08.528777 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-bb592c7d-b93e-43f6-ac8e-0a7c48be2892 req-56cd3f5e-e282-4b86-8ce1-f5542f000097 service nova] Acquiring lock "refresh_cache-ebfe249f-9326-47ad-8e83-b6058b04e1e5" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:04:08.528859 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-bb592c7d-b93e-43f6-ac8e-0a7c48be2892 req-56cd3f5e-e282-4b86-8ce1-f5542f000097 service nova] Acquired lock "refresh_cache-ebfe249f-9326-47ad-8e83-b6058b04e1e5" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:04:08.528998 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-bb592c7d-b93e-43f6-ac8e-0a7c48be2892 req-56cd3f5e-e282-4b86-8ce1-f5542f000097 service nova] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Refreshing network info cache for port 835e2ca2-278c-4d61-9472-2107d4fc7ac3 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:04:08.535404 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:04:08.536755 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:04:08.538359 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:04:08.539461 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:04:08.540651 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:04:08.541035 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:04:08.541365 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:04:08.541472 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:04:08.541648 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:04:08.541925 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:04:08.542279 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:04:08.543154 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:04:08.543154 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:04:08.544275 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:04:08.544435 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:04:08.544579 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:04:08.560176 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk.config --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:08.673058 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk.config --force-share --output=json" returned: 0 in 0.113s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:08.673705 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "/opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:08.674142 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "/opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:08.675360 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "/opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:08.675853 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:04:08.676452 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e8aeb4ed-7738-4054-b253-74e118c84fab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:04:08.676887 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:04:08.684229 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.007s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:04:08.684551 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e8aeb4ed-7738-4054-b253-74e118c84fab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:04:08.700645 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:04:08.701573 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:04:08.702153 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:04:08.702316 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:04:08.703335 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:04:08.703335 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.startup = automatic
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.session.scan = manual
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:04:08.720378 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:04:08.720378 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.startup = automatic
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.session.scan = manual
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:04:08.726896 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:04:08.726896 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:08.734934 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:08.747331 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:08.759067 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:08.759067 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:08.759067 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:08.759067 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:08.759067 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:04:08.759067 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:08.759067 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:08.759067 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:08.759067 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:08.759067 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:04:08.759528 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.057s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:04:08.759528 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:04:08.759968 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] HCTL ('11', '0', '0', 0) found on session 59 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:04:08.760146 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Scanning host 11 c: 0, t: 0, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:04:08.765962 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-84a0e21f-1cfa-41f3-9f02-b2df18d7c846 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:08.767304 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:08.767304 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:08.767304 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:08.767304 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:08.767304 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:04:08.767517 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:08.767517 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:08.767517 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:08.767517 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:08.767517 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:04:08.767658 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.066s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:04:08.768369 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:04:08.768481 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] HCTL ('12', '0', '0', 0) found on session 60 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:04:08.768630 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Scanning host 12 c: 0, t: 0, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:04:08.771207 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Searching for a device in session 59 and hctl ('11', '0', '0', 0) yield: sdf {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:04:08.771207 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e8aeb4ed-7738-4054-b253-74e118c84fab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:04:08.784593 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Searching for a device in session 60 and hctl ('12', '0', '0', 0) yield: sdg {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:04:08.784593 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e8aeb4ed-7738-4054-b253-74e118c84fab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:04:08.870494 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6a0d1580-4544-470c-8cf1-dfeaad601d9d tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Lock "60ce69b1-4c77-45a4-8975-bbba6924448d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.292s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:08.941897 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Acquiring lock "refresh_cache-ebfe249f-9326-47ad-8e83-b6058b04e1e5" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:04:08.963629 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-84a0e21f-1cfa-41f3-9f02-b2df18d7c846 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Updating instance_info_cache with network_info: [{"id": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "address": "fa:16:3e:e9:42:eb", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d656bf-1f", "ovs_interfaceid": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:04:09.036831 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-bb592c7d-b93e-43f6-ac8e-0a7c48be2892 req-56cd3f5e-e282-4b86-8ce1-f5542f000097 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:09.222403 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-bb592c7d-b93e-43f6-ac8e-0a7c48be2892 req-56cd3f5e-e282-4b86-8ce1-f5542f000097 service nova] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:04:09.428371 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:09.442919 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-bb592c7d-b93e-43f6-ac8e-0a7c48be2892 req-56cd3f5e-e282-4b86-8ce1-f5542f000097 service nova] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:04:09.465811 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-84a0e21f-1cfa-41f3-9f02-b2df18d7c846 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Releasing lock "refresh_cache-7ca4978c-d8a8-4ca2-81f3-63bc1e397615" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:04:09.466221 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-84a0e21f-1cfa-41f3-9f02-b2df18d7c846 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:09.466488 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-84a0e21f-1cfa-41f3-9f02-b2df18d7c846 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:09.504867 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:09.702198 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:04:09.945795 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-bb592c7d-b93e-43f6-ac8e-0a7c48be2892 req-56cd3f5e-e282-4b86-8ce1-f5542f000097 service nova] Releasing lock "refresh_cache-ebfe249f-9326-47ad-8e83-b6058b04e1e5" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:04:09.946270 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Acquired lock "refresh_cache-ebfe249f-9326-47ad-8e83-b6058b04e1e5" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:04:09.946493 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:04:10.026010 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Instance destroyed successfully.
May 28 10:04:10.027719 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-84a0e21f-1cfa-41f3-9f02-b2df18d7c846 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lazy-loading 'resources' on Instance uuid 7ca4978c-d8a8-4ca2-81f3-63bc1e397615 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:04:10.090341 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3f17e1c0-a832-4c88-9752-b7c1e2677a60 req-9d99bb21-ad8a-4c8f-beed-c68345b26b9e service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Received event network-changed-08d656bf-1f8f-4bd8-b04a-27184a5225d5 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:04:10.090473 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3f17e1c0-a832-4c88-9752-b7c1e2677a60 req-9d99bb21-ad8a-4c8f-beed-c68345b26b9e service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Refreshing instance network info cache due to event network-changed-08d656bf-1f8f-4bd8-b04a-27184a5225d5. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:04:10.090645 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3f17e1c0-a832-4c88-9752-b7c1e2677a60 req-9d99bb21-ad8a-4c8f-beed-c68345b26b9e service nova] Acquiring lock "refresh_cache-7ca4978c-d8a8-4ca2-81f3-63bc1e397615" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:04:10.090746 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3f17e1c0-a832-4c88-9752-b7c1e2677a60 req-9d99bb21-ad8a-4c8f-beed-c68345b26b9e service nova] Acquired lock "refresh_cache-7ca4978c-d8a8-4ca2-81f3-63bc1e397615" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:04:10.090868 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-3f17e1c0-a832-4c88-9752-b7c1e2677a60 req-9d99bb21-ad8a-4c8f-beed-c68345b26b9e service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Refreshing network info cache for port 08d656bf-1f8f-4bd8-b04a-27184a5225d5 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:04:10.435800 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:04:10.437831 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:04:10.438147 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Creating image(s)
May 28 10:04:10.438554 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Did not create local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 10:04:10.438735 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Ensure instance console log exists: /opt/stack/data/nova/instances/ebfe249f-9326-47ad-8e83-b6058b04e1e5/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:04:10.439586 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:10.439909 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:10.440082 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:10.529712 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-84a0e21f-1cfa-41f3-9f02-b2df18d7c846 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Object Instance<7ca4978c-d8a8-4ca2-81f3-63bc1e397615> lazy-loaded attributes: numa_topology,resources {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:04:10.531118 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-84a0e21f-1cfa-41f3-9f02-b2df18d7c846 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1013676903',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumeshelvetestjson-server-1013676903',id=32,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHz2G0qwtG+p66QDfkgHp2vl8nrQQplJ9NHdbfClwRXi9vojNet9Hqu6l7KTsv5EeGVyPJRozCH7j4HE5omMIeof86ceGpj80eHZxOn83kxa204OWpaQyXSXj0b71RyAA==',key_name='tempest-keypair-1225597873',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:03:17Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='edd64b0e2ce54cac860344420cf9c5b6',ramdisk_id='',reservation_id='r-1n6ox9bd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1618900663',owner_user_name='tempest-AttachVolumeShelveTestJSON-1618900663-project-member',shelved_at='2026-05-28T10:04:05.994656',shelved_host='np0000001613',shelved_image_id='dbf908ff-f983-44cd-8207-2c20614aae04'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:04:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd3def75f0dd411888f23a2f432896b0',uuid=7ca4978c-d8a8-4ca2-81f3-63bc1e397615,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "address": "fa:16:3e:e9:42:eb", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d656bf-1f", "ovs_interfaceid": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:04:10.531319 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-84a0e21f-1cfa-41f3-9f02-b2df18d7c846 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Converting VIF {"id": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "address": "fa:16:3e:e9:42:eb", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d656bf-1f", "ovs_interfaceid": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:04:10.532045 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-84a0e21f-1cfa-41f3-9f02-b2df18d7c846 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:42:eb,bridge_name='br-int',has_traffic_filtering=True,id=08d656bf-1f8f-4bd8-b04a-27184a5225d5,network=Network(d262816b-8751-4e64-8f19-7d59ddaabc41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d656bf-1f') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:04:10.532341 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-84a0e21f-1cfa-41f3-9f02-b2df18d7c846 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:42:eb,bridge_name='br-int',has_traffic_filtering=True,id=08d656bf-1f8f-4bd8-b04a-27184a5225d5,network=Network(d262816b-8751-4e64-8f19-7d59ddaabc41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d656bf-1f') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:04:10.534582 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:10.534962 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08d656bf-1f, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:04:10.539901 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:10.541398 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:10.541649 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cf5b944e-c8bd-4e0f-8de8-68fde2888525) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:04:10.545836 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:10.545836 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:04:10.548551 np0000001613 nova-compute[98321]: INFO os_vif [None req-84a0e21f-1cfa-41f3-9f02-b2df18d7c846 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:42:eb,bridge_name='br-int',has_traffic_filtering=True,id=08d656bf-1f8f-4bd8-b04a-27184a5225d5,network=Network(d262816b-8751-4e64-8f19-7d59ddaabc41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d656bf-1f')
May 28 10:04:10.548897 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-84a0e21f-1cfa-41f3-9f02-b2df18d7c846 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Deleting instance files /opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615_del
May 28 10:04:10.555878 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-84a0e21f-1cfa-41f3-9f02-b2df18d7c846 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Deletion of /opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615_del complete
May 28 10:04:10.593554 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-3f17e1c0-a832-4c88-9752-b7c1e2677a60 req-9d99bb21-ad8a-4c8f-beed-c68345b26b9e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:10.718568 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:04:10.722704 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Found WWN 330000000a8b99648 for multipath device dm-1 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:04:10.723068 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.040s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:04:10.723346 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] <== connect_volume: return (2046ms) {'type': 'block', 'scsi_wwn': '330000000a8b99648', 'path': '/dev/dm-1', 'multipath_id': '330000000a8b99648'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:04:10.723501 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a8b99648', 'path': '/dev/dm-1', 'multipath_id': '330000000a8b99648'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:04:11.136401 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-84a0e21f-1cfa-41f3-9f02-b2df18d7c846 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Deleted allocations for instance 7ca4978c-d8a8-4ca2-81f3-63bc1e397615
May 28 10:04:11.205199 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:11.232254 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:02:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001613',hostname='multiattach-server-1',id=31,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrmebBJn1C7uIkB9JjrF4yuEuto77kf4SaBedfdmOdQwZzJyqrVQd0Wq/SA1eDV6FpWwBB4BKjLBcFgkvBrXSx4LeKHMUic/tPGA5px/F625klLXypbV+9p49FvQ4XImQ==',key_name='tempest-keypair-2082049331',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:02:24Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001613',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3403b533910644d2b254922fb84b1ac0',ramdisk_id='',reservation_id='r-d0jzlqs3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1052626787',owner_user_name='tempest-AttachVolumeMultiAttachTest-1052626787-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:04:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13481913e22d4bf1a94e1a9a270f5494',uuid=de9742b9-43db-40a6-b635-81d9244fd5e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9df7e969-a155-41f1-9e30-c42f172029e4", "address": "fa:16:3e:9e:26:24", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "vif_mac": "fa:16:3e:9e:26:24"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df7e969-a1", "ovs_interfaceid": "9df7e969-a155-41f1-9e30-c42f172029e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:04:11.232411 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converting VIF {"id": "9df7e969-a155-41f1-9e30-c42f172029e4", "address": "fa:16:3e:9e:26:24", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "vif_mac": "fa:16:3e:9e:26:24"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df7e969-a1", "ovs_interfaceid": "9df7e969-a155-41f1-9e30-c42f172029e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:04:11.233108 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:26:24,bridge_name='br-int',has_traffic_filtering=True,id=9df7e969-a155-41f1-9e30-c42f172029e4,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df7e969-a1') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:04:11.234881 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] End _get_guest_xml xml=<domain type="qemu">
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:   <uuid>de9742b9-43db-40a6-b635-81d9244fd5e0</uuid>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:   <name>instance-0000001f</name>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:   <memory>262144</memory>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:       <nova:name>multiattach-server-1</nova:name>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:04:08</nova:creationTime>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.micro" id="84">
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:         <nova:memory>256</nova:memory>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:         <nova:user uuid="13481913e22d4bf1a94e1a9a270f5494">tempest-AttachVolumeMultiAttachTest-1052626787-project-member</nova:user>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:         <nova:project uuid="3403b533910644d2b254922fb84b1ac0">tempest-AttachVolumeMultiAttachTest-1052626787</nova:project>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:         <nova:port uuid="9df7e969-a155-41f1-9e30-c42f172029e4">
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:     <system>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:       <entry name="serial">de9742b9-43db-40a6-b635-81d9244fd5e0</entry>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:       <entry name="uuid">de9742b9-43db-40a6-b635-81d9244fd5e0</entry>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:     </system>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:   <os>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:   </os>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:   <features>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:   </features>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:   <devices>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk"/>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:     </disk>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk.config"/>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:     </disk>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:       <alias name="ua-e8aeb4ed-7738-4054-b253-74e118c84fab"/>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-1"/>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:       <target dev="vdb" bus="virtio"/>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:       <serial>e8aeb4ed-7738-4054-b253-74e118c84fab</serial>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:       <shareable/>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:     </disk>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:9e:26:24"/>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:       <target dev="tap9df7e969-a1"/>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:     </interface>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/console.log" append="off"/>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:     </serial>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:     <video>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:     </video>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:     </rng>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:   </devices>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]: </domain>
May 28 10:04:11.234881 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:04:11.237972 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:02:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001613',hostname='multiattach-server-1',id=31,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrmebBJn1C7uIkB9JjrF4yuEuto77kf4SaBedfdmOdQwZzJyqrVQd0Wq/SA1eDV6FpWwBB4BKjLBcFgkvBrXSx4LeKHMUic/tPGA5px/F625klLXypbV+9p49FvQ4XImQ==',key_name='tempest-keypair-2082049331',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:02:24Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001613',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3403b533910644d2b254922fb84b1ac0',ramdisk_id='',reservation_id='r-d0jzlqs3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1052626787',owner_user_name='tempest-AttachVolumeMultiAttachTest-1052626787-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:04:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13481913e22d4bf1a94e1a9a270f5494',uuid=de9742b9-43db-40a6-b635-81d9244fd5e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9df7e969-a155-41f1-9e30-c42f172029e4", "address": "fa:16:3e:9e:26:24", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "vif_mac": "fa:16:3e:9e:26:24"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df7e969-a1", "ovs_interfaceid": "9df7e969-a155-41f1-9e30-c42f172029e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:04:11.237972 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converting VIF {"id": "9df7e969-a155-41f1-9e30-c42f172029e4", "address": "fa:16:3e:9e:26:24", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "vif_mac": "fa:16:3e:9e:26:24"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df7e969-a1", "ovs_interfaceid": "9df7e969-a155-41f1-9e30-c42f172029e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:04:11.237972 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:26:24,bridge_name='br-int',has_traffic_filtering=True,id=9df7e969-a155-41f1-9e30-c42f172029e4,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df7e969-a1') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:04:11.237972 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:26:24,bridge_name='br-int',has_traffic_filtering=True,id=9df7e969-a155-41f1-9e30-c42f172029e4,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df7e969-a1') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:04:11.237972 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:11.237972 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:04:11.237972 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:04:11.237972 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:11.237972 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a5953926-2dba-5bea-94ee-1b207200f9c5', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:04:11.238658 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:11.239370 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:04:11.241791 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:11.245212 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:11.245405 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9df7e969-a1, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:04:11.245730 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9df7e969-a1, col_values=(('qos', UUID('1744e34b-8d3f-4a71-9a7a-7d4f79ea1d8a')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:04:11.245897 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9df7e969-a1, col_values=(('external_ids', {'iface-id': '9df7e969-a155-41f1-9e30-c42f172029e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:26:24', 'vm-uuid': 'de9742b9-43db-40a6-b635-81d9244fd5e0'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:04:11.246872 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:11.247989 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:04:11.256577 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:11.258011 np0000001613 nova-compute[98321]: INFO os_vif [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:26:24,bridge_name='br-int',has_traffic_filtering=True,id=9df7e969-a155-41f1-9e30-c42f172029e4,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df7e969-a1')
May 28 10:04:11.315658 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-3f17e1c0-a832-4c88-9752-b7c1e2677a60 req-9d99bb21-ad8a-4c8f-beed-c68345b26b9e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:11.466402 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Updating instance_info_cache with network_info: [{"id": "835e2ca2-278c-4d61-9472-2107d4fc7ac3", "address": "fa:16:3e:e2:8e:3b", "network": {"id": "f1a1b038-1ab9-40c1-b2d1-a4f95e93c396", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0ee907e07b942d09d375f1b1647d9b3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap835e2ca2-27", "ovs_interfaceid": "835e2ca2-278c-4d61-9472-2107d4fc7ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:04:11.592271 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-3f17e1c0-a832-4c88-9752-b7c1e2677a60 req-9d99bb21-ad8a-4c8f-beed-c68345b26b9e service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Updated VIF entry in instance network info cache for port 08d656bf-1f8f-4bd8-b04a-27184a5225d5. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:04:11.592536 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-3f17e1c0-a832-4c88-9752-b7c1e2677a60 req-9d99bb21-ad8a-4c8f-beed-c68345b26b9e service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Updating instance_info_cache with network_info: [{"id": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "address": "fa:16:3e:e9:42:eb", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap08d656bf-1f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:04:11.641878 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-84a0e21f-1cfa-41f3-9f02-b2df18d7c846 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:11.642146 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-84a0e21f-1cfa-41f3-9f02-b2df18d7c846 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:11.968958 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Releasing lock "refresh_cache-ebfe249f-9326-47ad-8e83-b6058b04e1e5" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:04:11.970138 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Instance network_info: |[{"id": "835e2ca2-278c-4d61-9472-2107d4fc7ac3", "address": "fa:16:3e:e2:8e:3b", "network": {"id": "f1a1b038-1ab9-40c1-b2d1-a4f95e93c396", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0ee907e07b942d09d375f1b1647d9b3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap835e2ca2-27", "ovs_interfaceid": "835e2ca2-278c-4d61-9472-2107d4fc7ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:04:11.975210 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Start _get_guest_xml network_info=[{"id": "835e2ca2-278c-4d61-9472-2107d4fc7ac3", "address": "fa:16:3e:e2:8e:3b", "network": {"id": "f1a1b038-1ab9-40c1-b2d1-a4f95e93c396", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0ee907e07b942d09d375f1b1647d9b3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap835e2ca2-27", "ovs_interfaceid": "835e2ca2-278c-4d61-9472-2107d4fc7ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d', 'iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9cec193d-f880-40d9-82d0-9c0e4fb6c74d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'ebfe249f-9326-47ad-8e83-b6058b04e1e5', 'attached_at': '', 'detached_at': '', 'volume_id': '9cec193d-f880-40d9-82d0-9c0e4fb6c74d', 'serial': '9cec193d-f880-40d9-82d0-9c0e4fb6c74d'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '3d61da90-6083-4aad-a4c5-9988d2f973c9', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:04:11.986260 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:04:11.986260 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='instance-depend-image', uuid='ebfe249f-9326-47ad-8e83-b6058b04e1e5'), owner=OwnerMeta(userid='9e90ac16da754ec294694a965321111f', username='tempest-ImageDependencyTests-2101881819-project-member', projectid='5c134a4b41b44392b26d2e299b4911e9', projectname='tempest-ImageDependencyTests-2101881819'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "835e2ca2-278c-4d61-9472-2107d4fc7ac3", "address": "fa:16:3e:e2:8e:3b", "network": {"id": "f1a1b038-1ab9-40c1-b2d1-a4f95e93c396", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0ee907e07b942d09d375f1b1647d9b3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap835e2ca2-27", "ovs_interfaceid": "835e2ca2-278c-4d61-9472-2107d4fc7ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962651.9842627) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:04:11.992257 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:04:11.992763 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:04:11.993824 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:04:11.994003 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:04:11.994972 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:04:11.995295 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:04:11.995451 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:04:11.995547 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:04:11.995684 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:04:11.995765 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:04:11.995854 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:04:11.995989 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:04:11.996092 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:04:11.996283 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:04:11.996418 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:04:11.996534 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:04:12.010492 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:04:12.011058 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d', 'iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9cec193d-f880-40d9-82d0-9c0e4fb6c74d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:04:12.011271 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:04:12.011562 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:04:12.011735 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d', 'iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9cec193d-f880-40d9-82d0-9c0e4fb6c74d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:04:12.026086 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:04:12.027563 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:04:12.028223 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:04:12.029274 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:04:12.029693 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:04:12.030174 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:04:12.045804 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:04:12.045804 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:12.049734 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:04:12.049734 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:12.059339 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d] added
May 28 10:04:12.059339 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:04:12.059339 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:04:12.059339 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:04:12.059339 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:04:12.059339 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:04:12.059339 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:12.059684 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:04:12.059875 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0303(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:04:12.060111 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:04:12.071549 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d] added
May 28 10:04:12.071549 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:04:12.071549 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:04:12.071549 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:04:12.071549 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:04:12.071549 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:04:12.071549 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:12.071549 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:04:12.071822 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0432(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:04:12.071876 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:04:12.096265 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3f17e1c0-a832-4c88-9752-b7c1e2677a60 req-9d99bb21-ad8a-4c8f-beed-c68345b26b9e service nova] Releasing lock "refresh_cache-7ca4978c-d8a8-4ca2-81f3-63bc1e397615" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:04:12.096265 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:12.162468 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-84a0e21f-1cfa-41f3-9f02-b2df18d7c846 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:04:12.162697 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-84a0e21f-1cfa-41f3-9f02-b2df18d7c846 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:04:12.666568 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-84a0e21f-1cfa-41f3-9f02-b2df18d7c846 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:04:12.780298 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:04:12.780298 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:04:12.780298 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:04:12.780298 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No VIF found with MAC fa:16:3e:9e:26:24, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:04:12.780298 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Using config drive
May 28 10:04:13.061975 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:04:13.072884 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:04:13.081739 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:04:13.084126 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:04:13.084126 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:04:13.091552 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:04:13.091552 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:13.113938 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:13.122109 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:13.134539 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:13.134539 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:13.134539 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:13.134539 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:13.134539 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:04:13.134762 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:13.134762 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:13.134762 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:13.134762 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:13.134762 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:04:13.137605 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:13.137605 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:13.137605 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:13.137605 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:13.137605 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:04:13.138084 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:13.138084 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:13.138084 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:13.138084 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:13.138084 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:04:13.176127 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-84a0e21f-1cfa-41f3-9f02-b2df18d7c846 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.534s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:13.187295 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d, portal: 192.168.50.100,3260]
May 28 10:04:13.187295 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d, portal: 192.168.50.100,3260] successful.
May 28 10:04:13.187295 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:13.198216 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d, portal: 192.168.40.100,3260]
May 28 10:04:13.198216 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d, portal: 192.168.40.100,3260] successful.
May 28 10:04:13.198216 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:13.204182 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:13.216100 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:13.223688 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:13.223688 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:13.223688 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:13.223688 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:13.223688 np0000001613 nova-compute[98321]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:13.223688 np0000001613 nova-compute[98321]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:13.223688 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:04:13.223688 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:13.223688 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:13.223688 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:13.223688 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:13.223688 np0000001613 nova-compute[98321]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:13.223688 np0000001613 nova-compute[98321]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:13.223688 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:04:13.224269 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.196s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:04:13.224269 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:04:13.225033 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] HCTL ('7', '-', '-', 0) found on session 69 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:04:13.225133 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:04:13.243774 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:13.243774 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:13.243774 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:13.243774 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:13.243774 np0000001613 nova-compute[98321]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:13.243774 np0000001613 nova-compute[98321]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:13.243774 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:04:13.244085 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:13.244085 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:13.244085 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:13.244085 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:13.244085 np0000001613 nova-compute[98321]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:13.244085 np0000001613 nova-compute[98321]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:13.244085 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:04:13.247864 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.218s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:04:13.247864 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:04:13.247864 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Searching for a device in session 69 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:04:13.247864 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9cec193d-f880-40d9-82d0-9c0e4fb6c74d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:04:13.249444 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] HCTL ('8', '-', '-', 0) found on session 70 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:04:13.249444 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:04:13.273003 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Searching for a device in session 70 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:04:13.273003 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9cec193d-f880-40d9-82d0-9c0e4fb6c74d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:04:13.354136 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:13.387198 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:13.512725 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:13.618296 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:13.687371 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-84a0e21f-1cfa-41f3-9f02-b2df18d7c846 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 14.419s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:13.796704 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4384ecf6-c657-4eb7-bff1-ee0dad664541 req-4d913b77-5ab5-4fb9-aeee-5521c9cd11ae service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Received event network-vif-plugged-9df7e969-a155-41f1-9e30-c42f172029e4 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:04:13.801941 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4384ecf6-c657-4eb7-bff1-ee0dad664541 req-4d913b77-5ab5-4fb9-aeee-5521c9cd11ae service nova] Acquiring lock "de9742b9-43db-40a6-b635-81d9244fd5e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:13.803444 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4384ecf6-c657-4eb7-bff1-ee0dad664541 req-4d913b77-5ab5-4fb9-aeee-5521c9cd11ae service nova] Lock "de9742b9-43db-40a6-b635-81d9244fd5e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:13.804599 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4384ecf6-c657-4eb7-bff1-ee0dad664541 req-4d913b77-5ab5-4fb9-aeee-5521c9cd11ae service nova] Lock "de9742b9-43db-40a6-b635-81d9244fd5e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:13.805040 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4384ecf6-c657-4eb7-bff1-ee0dad664541 req-4d913b77-5ab5-4fb9-aeee-5521c9cd11ae service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] No waiting events found dispatching network-vif-plugged-9df7e969-a155-41f1-9e30-c42f172029e4 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:04:13.805891 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-4384ecf6-c657-4eb7-bff1-ee0dad664541 req-4d913b77-5ab5-4fb9-aeee-5521c9cd11ae service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Received unexpected event network-vif-plugged-9df7e969-a155-41f1-9e30-c42f172029e4 for instance with vm_state active and task_state resize_finish.
May 28 10:04:14.028414 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:04:14.463304 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Removed pending STOPPED event for de9742b9-43db-40a6-b635-81d9244fd5e0 due to new event <LifecycleEvent: 1779962654.462788, de9742b9-43db-40a6-b635-81d9244fd5e0 => Resumed> {{(pid=98321) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 10:04:14.463690 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962654.462788, de9742b9-43db-40a6-b635-81d9244fd5e0 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:04:14.463690 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] VM Resumed (Lifecycle Event)
May 28 10:04:14.465811 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Instance event wait completed in 0 seconds for  {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:04:14.469872 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Instance running successfully.
May 28 10:04:14.471189 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Failed to set time: agent not configured {{(pid=98321) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 28 10:04:14.471411 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-63176d48-a3e5-4283-862e-15c9a4cbff2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] finish_migration finished successfully. {{(pid=98321) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 28 10:04:14.506868 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:14.931822 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.00036863700006506406 future=<Future at 0x73c1fc4e2ae0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:04:14.932468 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:04:14.932650 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=0.5258238910000728 future=<Future at 0x73c1fc767020 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:04:14.932802 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=0.5256643749999057 future=<Future at 0x73c1fc767020 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:04:14.966219 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:04:14.970419 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:04:15.047793 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Found WWN 330000000c169e3d3 for multipath device dm-0 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:04:15.048232 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:04:15.048491 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '330000000c169e3d3', 'path': '/dev/dm-0', 'multipath_id': '330000000c169e3d3'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:04:15.048652 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c169e3d3', 'path': '/dev/dm-0', 'multipath_id': '330000000c169e3d3'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:04:15.095446 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:15.095603 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:15.458939 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0003910190002898162 future=<Future at 0x73c1fc767020 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:04:15.459570 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Emitting event <LifecycleEvent: 1779962640.4584203, 60ce69b1-4c77-45a4-8975-bbba6924448d => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:04:15.459825 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:04:15.460136 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] VM Stopped (Lifecycle Event)
May 28 10:04:15.461277 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=0.15809132000003956 future=<Future at 0x73c1f4212de0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:04:15.461443 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=0.15787183199972787 future=<Future at 0x73c1f4212de0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:04:15.476682 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 28 10:04:15.477221 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962655.4769592, de9742b9-43db-40a6-b635-81d9244fd5e0 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:04:15.477412 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] VM Started (Lifecycle Event)
May 28 10:04:15.560976 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:04:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='instance-depend-image',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c134a4b41b44392b26d2e299b4911e9',ramdisk_id='',reservation_id='r-a7zqegjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ImageDependencyTests-2101881819',owner_user_name='tempest-ImageDependencyTests-2101881819-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:04:08Z,user_data=None,user_id='9e90ac16da754ec294694a965321111f',uuid=ebfe249f-9326-47ad-8e83-b6058b04e1e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "835e2ca2-278c-4d61-9472-2107d4fc7ac3", "address": "fa:16:3e:e2:8e:3b", "network": {"id": "f1a1b038-1ab9-40c1-b2d1-a4f95e93c396", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0ee907e07b942d09d375f1b1647d9b3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap835e2ca2-27", "ovs_interfaceid": "835e2ca2-278c-4d61-9472-2107d4fc7ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:04:15.562252 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Converting VIF {"id": "835e2ca2-278c-4d61-9472-2107d4fc7ac3", "address": "fa:16:3e:e2:8e:3b", "network": {"id": "f1a1b038-1ab9-40c1-b2d1-a4f95e93c396", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0ee907e07b942d09d375f1b1647d9b3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap835e2ca2-27", "ovs_interfaceid": "835e2ca2-278c-4d61-9472-2107d4fc7ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:04:15.563090 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:8e:3b,bridge_name='br-int',has_traffic_filtering=True,id=835e2ca2-278c-4d61-9472-2107d4fc7ac3,network=Network(f1a1b038-1ab9-40c1-b2d1-a4f95e93c396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap835e2ca2-27') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:04:15.565553 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Lazy-loading 'pci_devices' on Instance uuid ebfe249f-9326-47ad-8e83-b6058b04e1e5 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:04:15.599566 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lazy-loading 'flavor' on Instance uuid 2641ee65-c9c2-401d-b511-6ecc1247a3ad {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:04:15.605542 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:15.605832 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:15.606342 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Unshelving
May 28 10:04:15.619904 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.000560851000045659 future=<Future at 0x73c1f4212de0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:04:15.620023 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:04:15.620524 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Emitting event <LifecycleEvent: 1779962640.6192377, 7ca4978c-d8a8-4ca2-81f3-63bc1e397615 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:04:15.620684 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] VM Stopped (Lifecycle Event)
May 28 10:04:15.949681 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4e320f1f-501f-4d65-99a2-485a4bdb7245 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "de9742b9-43db-40a6-b635-81d9244fd5e0" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:15.950198 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4e320f1f-501f-4d65-99a2-485a4bdb7245 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "de9742b9-43db-40a6-b635-81d9244fd5e0" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:15.950198 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-4e320f1f-501f-4d65-99a2-485a4bdb7245 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Going to confirm migration 4 {{(pid=98321) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 28 10:04:15.962661 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-702461f4-fdfc-4db1-aa78-3ffcbed5f0f7 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: 60ce69b1-4c77-45a4-8975-bbba6924448d] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:04:15.981287 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:04:15.982287 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:04:15.989998 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:16.069696 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] End _get_guest_xml xml=<domain type="qemu">
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:   <uuid>ebfe249f-9326-47ad-8e83-b6058b04e1e5</uuid>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:   <name>instance-00000024</name>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:       <nova:name>instance-depend-image</nova:name>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:04:11</nova:creationTime>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:       <nova:image uuid="">
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:         <nova:properties/>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:         <nova:user uuid="9e90ac16da754ec294694a965321111f">tempest-ImageDependencyTests-2101881819-project-member</nova:user>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:         <nova:project uuid="5c134a4b41b44392b26d2e299b4911e9">tempest-ImageDependencyTests-2101881819</nova:project>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:       <nova:root type="volume" uuid=""/>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:         <nova:port uuid="835e2ca2-278c-4d61-9472-2107d4fc7ac3">
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="192.168.233.4" ipVersion="4"/>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:     <system>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:       <entry name="serial">ebfe249f-9326-47ad-8e83-b6058b04e1e5</entry>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:       <entry name="uuid">ebfe249f-9326-47ad-8e83-b6058b04e1e5</entry>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:     </system>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:   <os>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:   </os>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:   <features>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:   </features>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:   <devices>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/ebfe249f-9326-47ad-8e83-b6058b04e1e5/disk.config"/>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:     </disk>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:       <alias name="ua-9cec193d-f880-40d9-82d0-9c0e4fb6c74d"/>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-0"/>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:       <serial>9cec193d-f880-40d9-82d0-9c0e4fb6c74d</serial>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:     </disk>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:e2:8e:3b"/>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:       <target dev="tap835e2ca2-27"/>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:     </interface>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/ebfe249f-9326-47ad-8e83-b6058b04e1e5/console.log" append="off"/>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:     </serial>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:     <video>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:     </video>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:     </rng>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:   </devices>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]: </domain>
May 28 10:04:16.069696 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:04:16.073663 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Preparing to wait for external event network-vif-plugged-835e2ca2-278c-4d61-9472-2107d4fc7ac3 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:04:16.073663 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Acquiring lock "ebfe249f-9326-47ad-8e83-b6058b04e1e5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:16.073663 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Lock "ebfe249f-9326-47ad-8e83-b6058b04e1e5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:16.073663 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Lock "ebfe249f-9326-47ad-8e83-b6058b04e1e5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:16.073663 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:04:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='instance-depend-image',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c134a4b41b44392b26d2e299b4911e9',ramdisk_id='',reservation_id='r-a7zqegjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ImageDependencyTests-2101881819',owner_user_name='tempest-ImageDependencyTests-2101881819-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:04:08Z,user_data=None,user_id='9e90ac16da754ec294694a965321111f',uuid=ebfe249f-9326-47ad-8e83-b6058b04e1e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "835e2ca2-278c-4d61-9472-2107d4fc7ac3", "address": "fa:16:3e:e2:8e:3b", "network": {"id": "f1a1b038-1ab9-40c1-b2d1-a4f95e93c396", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0ee907e07b942d09d375f1b1647d9b3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap835e2ca2-27", "ovs_interfaceid": "835e2ca2-278c-4d61-9472-2107d4fc7ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:04:16.073663 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Converting VIF {"id": "835e2ca2-278c-4d61-9472-2107d4fc7ac3", "address": "fa:16:3e:e2:8e:3b", "network": {"id": "f1a1b038-1ab9-40c1-b2d1-a4f95e93c396", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0ee907e07b942d09d375f1b1647d9b3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap835e2ca2-27", "ovs_interfaceid": "835e2ca2-278c-4d61-9472-2107d4fc7ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:04:16.073663 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:8e:3b,bridge_name='br-int',has_traffic_filtering=True,id=835e2ca2-278c-4d61-9472-2107d4fc7ac3,network=Network(f1a1b038-1ab9-40c1-b2d1-a4f95e93c396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap835e2ca2-27') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:04:16.073663 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:8e:3b,bridge_name='br-int',has_traffic_filtering=True,id=835e2ca2-278c-4d61-9472-2107d4fc7ac3,network=Network(f1a1b038-1ab9-40c1-b2d1-a4f95e93c396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap835e2ca2-27') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:04:16.073663 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:16.073663 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:04:16.073663 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:04:16.073663 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:16.073663 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '812de0d8-4a81-59f1-a7aa-e900fea9b240', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:04:16.075508 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:16.076938 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:04:16.079917 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:16.080126 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap835e2ca2-27, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:04:16.080438 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap835e2ca2-27, col_values=(('qos', UUID('df64ed58-025d-484a-9a7f-a29118033fc3')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:04:16.080602 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap835e2ca2-27, col_values=(('external_ids', {'iface-id': '835e2ca2-278c-4d61-9472-2107d4fc7ac3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:8e:3b', 'vm-uuid': 'ebfe249f-9326-47ad-8e83-b6058b04e1e5'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:04:16.081341 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:16.083612 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:04:16.091113 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:16.091987 np0000001613 nova-compute[98321]: INFO os_vif [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:8e:3b,bridge_name='br-int',has_traffic_filtering=True,id=835e2ca2-278c-4d61-9472-2107d4fc7ac3,network=Network(f1a1b038-1ab9-40c1-b2d1-a4f95e93c396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap835e2ca2-27')
May 28 10:04:16.124049 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:04:16.191789 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-09970131-a83e-4d61-a373-0ba3243e43a0 req-119026a1-48df-402a-98df-ba2711288259 service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Received event network-vif-plugged-9df7e969-a155-41f1-9e30-c42f172029e4 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:04:16.193014 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-09970131-a83e-4d61-a373-0ba3243e43a0 req-119026a1-48df-402a-98df-ba2711288259 service nova] Acquiring lock "de9742b9-43db-40a6-b635-81d9244fd5e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:16.193263 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-09970131-a83e-4d61-a373-0ba3243e43a0 req-119026a1-48df-402a-98df-ba2711288259 service nova] Lock "de9742b9-43db-40a6-b635-81d9244fd5e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:16.193474 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-09970131-a83e-4d61-a373-0ba3243e43a0 req-119026a1-48df-402a-98df-ba2711288259 service nova] Lock "de9742b9-43db-40a6-b635-81d9244fd5e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:16.193657 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-09970131-a83e-4d61-a373-0ba3243e43a0 req-119026a1-48df-402a-98df-ba2711288259 service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] No waiting events found dispatching network-vif-plugged-9df7e969-a155-41f1-9e30-c42f172029e4 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:04:16.193791 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-09970131-a83e-4d61-a373-0ba3243e43a0 req-119026a1-48df-402a-98df-ba2711288259 service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Received unexpected event network-vif-plugged-9df7e969-a155-41f1-9e30-c42f172029e4 for instance with vm_state resized and task_state None.
May 28 10:04:16.450374 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:16.458194 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-4e320f1f-501f-4d65-99a2-485a4bdb7245 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:16.560807 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-4e320f1f-501f-4d65-99a2-485a4bdb7245 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:16.561298 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4e320f1f-501f-4d65-99a2-485a4bdb7245 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "refresh_cache-de9742b9-43db-40a6-b635-81d9244fd5e0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:04:16.561298 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4e320f1f-501f-4d65-99a2-485a4bdb7245 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquired lock "refresh_cache-de9742b9-43db-40a6-b635-81d9244fd5e0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:04:16.561409 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-4e320f1f-501f-4d65-99a2-485a4bdb7245 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:04:16.561553 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-4e320f1f-501f-4d65-99a2-485a4bdb7245 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lazy-loading 'info_cache' on Instance uuid de9742b9-43db-40a6-b635-81d9244fd5e0 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:04:16.606014 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:17.126831 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Booting with volume b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 at /dev/vdc
May 28 10:04:17.198796 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:04:17.217134 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:04:17.248545 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:17.299122 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:04:17.299529 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:04:17.309143 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:04:17.310398 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fefd:30e7', 'fe80::e4df:c0ff:fe86:6341', 'fe80::fc16:3eff:fedb:1077', 'fe80::fc16:3eff:fe3c:b7e1', 'fe80::fc16:3eff:fee1:659', 'fe80::fc16:3eff:fe08:3107', 'fe80::e02b:1cff:fec7:1a41', 'fe80::fc16:3eff:fe9e:2624'] 
May 28 10:04:17.310530 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:04:17.310597 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:04:17.310807 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:04:17.311078 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Updating existing volume attachment record: 9323e0c3-3d61-42bb-852a-b8f5c4c18e11 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:04:17.566561 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-4e320f1f-501f-4d65-99a2-485a4bdb7245 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:17.614956 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:04:17.615216 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:04:17.615337 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] No VIF found with MAC fa:16:3e:e2:8e:3b, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:04:17.615899 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Using config drive
May 28 10:04:17.710851 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:17.711214 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:17.711364 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Attaching volume d565e760-7309-464b-9f49-2e176d23ac7b to /dev/vdb
May 28 10:04:17.763417 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:04:17.781028 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:04:17.807513 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:17.852662 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:04:17.856533 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:04:17.869972 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:04:17.870876 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fefd:30e7', 'fe80::e4df:c0ff:fe86:6341', 'fe80::fc16:3eff:fedb:1077', 'fe80::fc16:3eff:fe3c:b7e1', 'fe80::fc16:3eff:fee1:659', 'fe80::fc16:3eff:fe08:3107', 'fe80::e02b:1cff:fec7:1a41', 'fe80::fc16:3eff:fe9e:2624'] 
May 28 10:04:17.871108 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:04:17.871189 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:04:17.871380 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:04:17.871676 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Updating existing volume attachment record: 11f048d4-61dc-48a7-912b-e077a8eb8fc9 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:04:17.960235 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-4e320f1f-501f-4d65-99a2-485a4bdb7245 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:18.127847 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:18.201621 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-4e320f1f-501f-4d65-99a2-485a4bdb7245 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Updating instance_info_cache with network_info: [{"id": "9df7e969-a155-41f1-9e30-c42f172029e4", "address": "fa:16:3e:9e:26:24", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df7e969-a1", "ovs_interfaceid": "9df7e969-a155-41f1-9e30-c42f172029e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:04:18.304548 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Creating config drive at /opt/stack/data/nova/instances/ebfe249f-9326-47ad-8e83-b6058b04e1e5/disk.config
May 28 10:04:18.308809 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ebfe249f-9326-47ad-8e83-b6058b04e1e5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppc4p16xl {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:18.377309 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ebfe249f-9326-47ad-8e83-b6058b04e1e5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppc4p16xl" returned: 0 in 0.068s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:18.449367 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:04:18.449881 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b', 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd565e760-7309-464b-9f49-2e176d23ac7b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:04:18.450115 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:04:18.450681 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:04:18.451768 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b', 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd565e760-7309-464b-9f49-2e176d23ac7b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:04:18.465526 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:04:18.465895 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:04:18.467081 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:04:18.467198 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:04:18.467433 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:04:18.467724 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:04:18.480119 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:04:18.480119 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:18.489643 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:04:18.489643 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:18.498009 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b] added
May 28 10:04:18.498009 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:04:18.498009 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:04:18.498009 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:04:18.498009 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:04:18.498009 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:04:18.498009 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:18.498009 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:04:18.499431 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0308(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:04:18.499431 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:04:18.504995 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b] added
May 28 10:04:18.504995 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:04:18.504995 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:04:18.504995 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:04:18.504995 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:04:18.504995 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:04:18.504995 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:18.505198 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:04:18.505433 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0388(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:04:18.505782 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:04:18.707752 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4e320f1f-501f-4d65-99a2-485a4bdb7245 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Releasing lock "refresh_cache-de9742b9-43db-40a6-b635-81d9244fd5e0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:04:18.707752 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-4e320f1f-501f-4d65-99a2-485a4bdb7245 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lazy-loading 'migration_context' on Instance uuid de9742b9-43db-40a6-b635-81d9244fd5e0 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:04:18.919360 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:18.991938 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:18.993868 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:18.995482 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:19.023885 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:19.024066 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:19.026519 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lazy-loading 'pci_requests' on Instance uuid 7ca4978c-d8a8-4ca2-81f3-63bc1e397615 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:04:19.050065 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:19.208450 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-4e320f1f-501f-4d65-99a2-485a4bdb7245 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Object Instance<de9742b9-43db-40a6-b635-81d9244fd5e0> lazy-loaded attributes: info_cache,migration_context {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:04:19.215707 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4e320f1f-501f-4d65-99a2-485a4bdb7245 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:19.346360 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:19.351774 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:19.386041 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:19.500286 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:04:19.506296 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:04:19.510151 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:04:19.523969 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:04:19.523969 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:04:19.527662 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:04:19.527662 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:19.532099 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lazy-loading 'numa_topology' on Instance uuid 7ca4978c-d8a8-4ca2-81f3-63bc1e397615 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:04:19.542330 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:19.558584 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:19.569856 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:19.569856 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:19.569856 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:19.569856 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:19.569856 np0000001613 nova-compute[98321]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:19.569856 np0000001613 nova-compute[98321]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:19.569856 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:04:19.570314 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:19.570314 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:19.570314 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:19.570314 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:19.570314 np0000001613 nova-compute[98321]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:19.570314 np0000001613 nova-compute[98321]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:19.570314 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:04:19.579002 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:19.579002 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:19.579002 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:19.579002 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:19.579002 np0000001613 nova-compute[98321]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:19.579002 np0000001613 nova-compute[98321]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:19.579002 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:04:19.579310 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:19.579310 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:19.579310 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:19.579310 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:19.579310 np0000001613 nova-compute[98321]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:19.579310 np0000001613 nova-compute[98321]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:19.579310 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:04:19.637215 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b, portal: 192.168.50.100,3260]
May 28 10:04:19.637215 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b, portal: 192.168.50.100,3260] successful.
May 28 10:04:19.637215 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:19.653821 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b, portal: 192.168.40.100,3260]
May 28 10:04:19.653821 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b, portal: 192.168.40.100,3260] successful.
May 28 10:04:19.653821 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:19.661096 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:19.671155 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:19.686982 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:19.686982 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:19.686982 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:19.686982 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:19.686982 np0000001613 nova-compute[98321]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:19.686982 np0000001613 nova-compute[98321]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:19.686982 np0000001613 nova-compute[98321]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:19.686982 np0000001613 nova-compute[98321]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:19.686982 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:04:19.686982 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:19.686982 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:19.686982 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:19.686982 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:19.686982 np0000001613 nova-compute[98321]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:19.686982 np0000001613 nova-compute[98321]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:19.686982 np0000001613 nova-compute[98321]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:19.686982 np0000001613 nova-compute[98321]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:19.686982 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:04:19.687709 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.220s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:04:19.687709 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:04:19.689030 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] HCTL ('9', '-', '-', 0) found on session 71 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:04:19.689030 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:04:19.696360 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:19.696360 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:19.696360 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:19.696360 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:19.696360 np0000001613 nova-compute[98321]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:19.696360 np0000001613 nova-compute[98321]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:19.696360 np0000001613 nova-compute[98321]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:19.696360 np0000001613 nova-compute[98321]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:19.696360 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:04:19.696655 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:19.696655 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:19.696655 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:19.696655 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:19.696655 np0000001613 nova-compute[98321]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:19.696655 np0000001613 nova-compute[98321]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:19.696655 np0000001613 nova-compute[98321]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:19.696655 np0000001613 nova-compute[98321]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:19.696655 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:04:19.696857 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.231s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:04:19.697065 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:04:19.697811 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] HCTL ('10', '-', '-', 0) found on session 72 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:04:19.697979 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:04:19.722091 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Searching for a device in session 72 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:04:19.722091 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd565e760-7309-464b-9f49-2e176d23ac7b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:04:19.722091 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Searching for a device in session 71 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:04:19.722091 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd565e760-7309-464b-9f49-2e176d23ac7b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:04:20.036626 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:04:20.038155 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Claim successful on node np0000001613
May 28 10:04:20.130308 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962660.12959, ebfe249f-9326-47ad-8e83-b6058b04e1e5 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:04:20.130555 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] VM Started (Lifecycle Event)
May 28 10:04:20.467451 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:04:20.634638 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:04:20.640097 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962660.6397092, ebfe249f-9326-47ad-8e83-b6058b04e1e5 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:04:20.641247 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] VM Paused (Lifecycle Event)
May 28 10:04:21.084920 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:21.149079 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:04:21.152014 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:04:21.488695 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Found WWN 330000000e8f820e4 for multipath device dm-2 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:04:21.488975 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:04:21.489157 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '330000000e8f820e4', 'path': '/dev/dm-2', 'multipath_id': '330000000e8f820e4'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:04:21.489382 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e8f820e4', 'path': '/dev/dm-2', 'multipath_id': '330000000e8f820e4'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:04:21.496808 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lazy-loading 'flavor' on Instance uuid 2641ee65-c9c2-401d-b511-6ecc1247a3ad {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:04:21.585275 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-9b98f7bf-b8bf-4e96-a596-9a63dce2e8bd req-8d8d071f-aaa0-42fd-8980-8b4c981f1091 service nova] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Received event network-vif-plugged-835e2ca2-278c-4d61-9472-2107d4fc7ac3 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:04:21.585275 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9b98f7bf-b8bf-4e96-a596-9a63dce2e8bd req-8d8d071f-aaa0-42fd-8980-8b4c981f1091 service nova] Acquiring lock "ebfe249f-9326-47ad-8e83-b6058b04e1e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:21.585275 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9b98f7bf-b8bf-4e96-a596-9a63dce2e8bd req-8d8d071f-aaa0-42fd-8980-8b4c981f1091 service nova] Lock "ebfe249f-9326-47ad-8e83-b6058b04e1e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:21.590291 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9b98f7bf-b8bf-4e96-a596-9a63dce2e8bd req-8d8d071f-aaa0-42fd-8980-8b4c981f1091 service nova] Lock "ebfe249f-9326-47ad-8e83-b6058b04e1e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:21.592685 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-9b98f7bf-b8bf-4e96-a596-9a63dce2e8bd req-8d8d071f-aaa0-42fd-8980-8b4c981f1091 service nova] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Processing event network-vif-plugged-835e2ca2-278c-4d61-9472-2107d4fc7ac3 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:04:21.593536 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:04:21.597767 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:04:21.601942 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Instance spawned successfully.
May 28 10:04:21.603485 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:04:21.658511 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:04:21.666270 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962661.663217, ebfe249f-9326-47ad-8e83-b6058b04e1e5 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:04:21.666496 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] VM Resumed (Lifecycle Event)
May 28 10:04:21.669015 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:04:21.669372 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:04:22.001445 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Attempting to attach volume d565e760-7309-464b-9f49-2e176d23ac7b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 10:04:22.002643 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] attach device xml: <disk type="block" device="disk">
May 28 10:04:22.002643 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:04:22.002643 np0000001613 nova-compute[98321]:   <alias name="ua-d565e760-7309-464b-9f49-2e176d23ac7b"/>
May 28 10:04:22.002643 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-2"/>
May 28 10:04:22.002643 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:04:22.002643 np0000001613 nova-compute[98321]:   <serial>d565e760-7309-464b-9f49-2e176d23ac7b</serial>
May 28 10:04:22.002643 np0000001613 nova-compute[98321]: </disk>
May 28 10:04:22.002643 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 10:04:22.112439 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:04:22.112826 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:04:22.113042 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:04:22.113357 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:04:22.113677 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:04:22.114504 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:04:22.172296 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:04:22.173651 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:04:22.183710 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:04:22.619607 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Took 12.18 seconds to spawn the instance on the hypervisor.
May 28 10:04:22.619827 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:04:22.684651 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.660s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:22.685012 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:22.687704 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4e320f1f-501f-4d65-99a2-485a4bdb7245 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 3.472s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:22.696298 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:04:22.761154 np0000001613 nova-compute[98321]: INFO nova.network.neutron [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Updating port 08d656bf-1f8f-4bd8-b04a-27184a5225d5 with attributes {'binding:host_id': 'np0000001613', 'device_owner': 'compute:nova'}
May 28 10:04:23.129359 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Took 19.83 seconds to build instance.
May 28 10:04:23.359741 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "refresh_cache-7ca4978c-d8a8-4ca2-81f3-63bc1e397615" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:04:23.359883 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquired lock "refresh_cache-7ca4978c-d8a8-4ca2-81f3-63bc1e397615" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:04:23.360652 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:04:23.632823 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3841951a-65f5-47ef-a152-3e910bbb17c5 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Lock "ebfe249f-9326-47ad-8e83-b6058b04e1e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.353s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:23.674482 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-273d8ea1-3969-4cf7-8b8e-86a193f5d955 req-be74eb9a-4805-4b20-8736-8f2fa90ac1e1 service nova] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Received event network-vif-plugged-835e2ca2-278c-4d61-9472-2107d4fc7ac3 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:04:23.675822 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-273d8ea1-3969-4cf7-8b8e-86a193f5d955 req-be74eb9a-4805-4b20-8736-8f2fa90ac1e1 service nova] Acquiring lock "ebfe249f-9326-47ad-8e83-b6058b04e1e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:23.675961 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-273d8ea1-3969-4cf7-8b8e-86a193f5d955 req-be74eb9a-4805-4b20-8736-8f2fa90ac1e1 service nova] Lock "ebfe249f-9326-47ad-8e83-b6058b04e1e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:23.676056 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-273d8ea1-3969-4cf7-8b8e-86a193f5d955 req-be74eb9a-4805-4b20-8736-8f2fa90ac1e1 service nova] Lock "ebfe249f-9326-47ad-8e83-b6058b04e1e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:23.676248 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-273d8ea1-3969-4cf7-8b8e-86a193f5d955 req-be74eb9a-4805-4b20-8736-8f2fa90ac1e1 service nova] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] No waiting events found dispatching network-vif-plugged-835e2ca2-278c-4d61-9472-2107d4fc7ac3 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:04:23.680365 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-273d8ea1-3969-4cf7-8b8e-86a193f5d955 req-be74eb9a-4805-4b20-8736-8f2fa90ac1e1 service nova] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Received unexpected event network-vif-plugged-835e2ca2-278c-4d61-9472-2107d4fc7ac3 for instance with vm_state active and task_state None.
May 28 10:04:23.680365 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-273d8ea1-3969-4cf7-8b8e-86a193f5d955 req-be74eb9a-4805-4b20-8736-8f2fa90ac1e1 service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Received event network-changed-08d656bf-1f8f-4bd8-b04a-27184a5225d5 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:04:23.680365 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-273d8ea1-3969-4cf7-8b8e-86a193f5d955 req-be74eb9a-4805-4b20-8736-8f2fa90ac1e1 service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Refreshing instance network info cache due to event network-changed-08d656bf-1f8f-4bd8-b04a-27184a5225d5. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:04:23.680365 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-273d8ea1-3969-4cf7-8b8e-86a193f5d955 req-be74eb9a-4805-4b20-8736-8f2fa90ac1e1 service nova] Acquiring lock "refresh_cache-7ca4978c-d8a8-4ca2-81f3-63bc1e397615" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:04:23.694500 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:04:23.694845 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:04:23.695116 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:04:23.695363 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] No VIF found with MAC fa:16:3e:08:31:07, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:04:23.731533 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4e320f1f-501f-4d65-99a2-485a4bdb7245 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:04:23.731533 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-4e320f1f-501f-4d65-99a2-485a4bdb7245 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:04:23.864508 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:24.234421 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-4e320f1f-501f-4d65-99a2-485a4bdb7245 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:04:24.244318 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:24.394869 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Updating instance_info_cache with network_info: [{"id": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "address": "fa:16:3e:e9:42:eb", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d656bf-1f", "ovs_interfaceid": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:04:24.511484 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:24.899075 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Releasing lock "refresh_cache-7ca4978c-d8a8-4ca2-81f3-63bc1e397615" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:04:24.899075 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:04:24.899075 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Creating image(s)
May 28 10:04:24.899075 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:24.899075 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "/opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:24.899448 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-273d8ea1-3969-4cf7-8b8e-86a193f5d955 req-be74eb9a-4805-4b20-8736-8f2fa90ac1e1 service nova] Acquired lock "refresh_cache-7ca4978c-d8a8-4ca2-81f3-63bc1e397615" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:04:24.899963 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-273d8ea1-3969-4cf7-8b8e-86a193f5d955 req-be74eb9a-4805-4b20-8736-8f2fa90ac1e1 service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Refreshing network info cache for port 08d656bf-1f8f-4bd8-b04a-27184a5225d5 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:04:24.903808 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "/opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:24.903808 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7ca4978c-d8a8-4ca2-81f3-63bc1e397615 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:04:25.249673 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4e320f1f-501f-4d65-99a2-485a4bdb7245 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.562s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:25.282894 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e238e582-bfee-4e72-8bf5-727e0e3eaed3 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.572s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:25.404200 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-273d8ea1-3969-4cf7-8b8e-86a193f5d955 req-be74eb9a-4805-4b20-8736-8f2fa90ac1e1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:25.406651 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Object Instance<7ca4978c-d8a8-4ca2-81f3-63bc1e397615> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:04:25.406988 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "804c382a6c8bc8a3f6d73e9c7afcdbe6acc759c9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:25.407382 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "804c382a6c8bc8a3f6d73e9c7afcdbe6acc759c9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:25.662983 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0f60f3e6-54cd-4399-b43b-39e8cd9f358e tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:25.663215 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0f60f3e6-54cd-4399-b43b-39e8cd9f358e tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:25.663363 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-0f60f3e6-54cd-4399-b43b-39e8cd9f358e tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:04:25.665385 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-0f60f3e6-54cd-4399-b43b-39e8cd9f358e tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98321) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 28 10:04:25.665947 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-0f60f3e6-54cd-4399-b43b-39e8cd9f358e tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lazy-loading 'flavor' on Instance uuid 2641ee65-c9c2-401d-b511-6ecc1247a3ad {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:04:25.842852 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-273d8ea1-3969-4cf7-8b8e-86a193f5d955 req-be74eb9a-4805-4b20-8736-8f2fa90ac1e1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:25.895457 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:25.962402 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-4e320f1f-501f-4d65-99a2-485a4bdb7245 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Deleted allocation for migration ef07e63e-ffa4-4b38-aa43-ebb2b2851224
May 28 10:04:26.088677 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:26.204081 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-273d8ea1-3969-4cf7-8b8e-86a193f5d955 req-be74eb9a-4805-4b20-8736-8f2fa90ac1e1 service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Updated VIF entry in instance network info cache for port 08d656bf-1f8f-4bd8-b04a-27184a5225d5. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:04:26.204403 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-273d8ea1-3969-4cf7-8b8e-86a193f5d955 req-be74eb9a-4805-4b20-8736-8f2fa90ac1e1 service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Updating instance_info_cache with network_info: [{"id": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "address": "fa:16:3e:e9:42:eb", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d656bf-1f", "ovs_interfaceid": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:04:26.478057 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4e320f1f-501f-4d65-99a2-485a4bdb7245 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "de9742b9-43db-40a6-b635-81d9244fd5e0" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 10.528s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:26.691003 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:04:26.700790 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:04:26.701133 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/804c382a6c8bc8a3f6d73e9c7afcdbe6acc759c9.part --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:26.724380 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-273d8ea1-3969-4cf7-8b8e-86a193f5d955 req-be74eb9a-4805-4b20-8736-8f2fa90ac1e1 service nova] Releasing lock "refresh_cache-7ca4978c-d8a8-4ca2-81f3-63bc1e397615" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:04:26.728988 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:26.740352 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:26.774312 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:26.827285 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/804c382a6c8bc8a3f6d73e9c7afcdbe6acc759c9.part --force-share --output=json" returned: 0 in 0.126s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:26.827879 np0000001613 nova-compute[98321]: DEBUG nova.virt.images [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] dbf908ff-f983-44cd-8207-2c20614aae04 was qcow2, converting to raw {{(pid=98321) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 10:04:26.830378 np0000001613 nova-compute[98321]: DEBUG nova.privsep.utils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98321) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 10:04:26.830378 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/804c382a6c8bc8a3f6d73e9c7afcdbe6acc759c9.part /opt/stack/data/nova/instances/_base/804c382a6c8bc8a3f6d73e9c7afcdbe6acc759c9.converted {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:27.047241 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-28e7700c-a553-441e-810b-e43024495f2f req-dfdfa3c0-b942-45d4-a07d-8c9913643cf9 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Received event network-vif-unplugged-dc1640f1-0633-403e-8f70-6a6d90053cfc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:04:27.047241 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-28e7700c-a553-441e-810b-e43024495f2f req-dfdfa3c0-b942-45d4-a07d-8c9913643cf9 service nova] Acquiring lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:27.047241 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-28e7700c-a553-441e-810b-e43024495f2f req-dfdfa3c0-b942-45d4-a07d-8c9913643cf9 service nova] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:27.047241 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-28e7700c-a553-441e-810b-e43024495f2f req-dfdfa3c0-b942-45d4-a07d-8c9913643cf9 service nova] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:27.048254 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-28e7700c-a553-441e-810b-e43024495f2f req-dfdfa3c0-b942-45d4-a07d-8c9913643cf9 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] No waiting events found dispatching network-vif-unplugged-dc1640f1-0633-403e-8f70-6a6d90053cfc {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:04:27.049656 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-28e7700c-a553-441e-810b-e43024495f2f req-dfdfa3c0-b942-45d4-a07d-8c9913643cf9 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Received unexpected event network-vif-unplugged-dc1640f1-0633-403e-8f70-6a6d90053cfc for instance with vm_state active and task_state powering-off.
May 28 10:04:27.054243 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:27.056759 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/804c382a6c8bc8a3f6d73e9c7afcdbe6acc759c9.part /opt/stack/data/nova/instances/_base/804c382a6c8bc8a3f6d73e9c7afcdbe6acc759c9.converted" returned: 0 in 0.226s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:27.079595 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/804c382a6c8bc8a3f6d73e9c7afcdbe6acc759c9.converted --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:27.106228 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.998510230000193 future=<Future at 0x73c1fc13dd30 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:04:27.107925 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.996139270000185 future=<Future at 0x73c1fc13dd30 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:04:27.108399 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.995882543000334 future=<Future at 0x73c1fc13dd30 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:04:27.109368 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Instance destroyed successfully.
May 28 10:04:27.111221 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-0f60f3e6-54cd-4399-b43b-39e8cd9f358e tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lazy-loading 'numa_topology' on Instance uuid 2641ee65-c9c2-401d-b511-6ecc1247a3ad {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:04:27.197717 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/804c382a6c8bc8a3f6d73e9c7afcdbe6acc759c9.converted --force-share --output=json" returned: 0 in 0.119s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:27.198997 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "804c382a6c8bc8a3f6d73e9c7afcdbe6acc759c9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.791s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:27.200303 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:04:27.203559 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:04:27.207757 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/804c382a6c8bc8a3f6d73e9c7afcdbe6acc759c9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:27.318805 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/804c382a6c8bc8a3f6d73e9c7afcdbe6acc759c9 --force-share --output=json" returned: 0 in 0.110s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:27.319627 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "804c382a6c8bc8a3f6d73e9c7afcdbe6acc759c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:27.320325 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "804c382a6c8bc8a3f6d73e9c7afcdbe6acc759c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:27.320978 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:04:27.330646 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:04:27.331894 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/804c382a6c8bc8a3f6d73e9c7afcdbe6acc759c9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:27.441327 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/804c382a6c8bc8a3f6d73e9c7afcdbe6acc759c9 --force-share --output=json" returned: 0 in 0.109s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:27.442448 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/804c382a6c8bc8a3f6d73e9c7afcdbe6acc759c9,backing_fmt=raw /opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:27.509256 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/804c382a6c8bc8a3f6d73e9c7afcdbe6acc759c9,backing_fmt=raw /opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615/disk 1073741824" returned: 0 in 0.066s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:27.512957 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "804c382a6c8bc8a3f6d73e9c7afcdbe6acc759c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:27.512957 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/804c382a6c8bc8a3f6d73e9c7afcdbe6acc759c9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:27.618234 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-0f60f3e6-54cd-4399-b43b-39e8cd9f358e tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Object Instance<2641ee65-c9c2-401d-b511-6ecc1247a3ad> lazy-loaded attributes: flavor,numa_topology {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:04:27.618591 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-0f60f3e6-54cd-4399-b43b-39e8cd9f358e tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:04:27.620944 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/804c382a6c8bc8a3f6d73e9c7afcdbe6acc759c9 --force-share --output=json" returned: 0 in 0.110s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:27.621641 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lazy-loading 'migration_context' on Instance uuid 7ca4978c-d8a8-4ca2-81f3-63bc1e397615 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:04:28.125838 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Object Instance<7ca4978c-d8a8-4ca2-81f3-63bc1e397615> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:04:28.126361 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Rebasing disk image.
May 28 10:04:28.126743 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:28.152202 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0f60f3e6-54cd-4399-b43b-39e8cd9f358e tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.488s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:28.237298 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.110s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:28.237727 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 -F raw /opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615/disk {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:28.669262 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lazy-loading 'flavor' on Instance uuid 2641ee65-c9c2-401d-b511-6ecc1247a3ad {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:04:29.148348 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6ad80fba-906c-456a-a127-a85b0cc67c1b req-ba5bc5c4-cfc6-4674-9f4c-17c5654932f0 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Received event network-vif-unplugged-dc1640f1-0633-403e-8f70-6a6d90053cfc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:04:29.148613 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6ad80fba-906c-456a-a127-a85b0cc67c1b req-ba5bc5c4-cfc6-4674-9f4c-17c5654932f0 service nova] Acquiring lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:29.148793 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6ad80fba-906c-456a-a127-a85b0cc67c1b req-ba5bc5c4-cfc6-4674-9f4c-17c5654932f0 service nova] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:29.148903 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6ad80fba-906c-456a-a127-a85b0cc67c1b req-ba5bc5c4-cfc6-4674-9f4c-17c5654932f0 service nova] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:29.149116 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6ad80fba-906c-456a-a127-a85b0cc67c1b req-ba5bc5c4-cfc6-4674-9f4c-17c5654932f0 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] No waiting events found dispatching network-vif-unplugged-dc1640f1-0633-403e-8f70-6a6d90053cfc {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:04:29.149410 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-6ad80fba-906c-456a-a127-a85b0cc67c1b req-ba5bc5c4-cfc6-4674-9f4c-17c5654932f0 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Received unexpected event network-vif-unplugged-dc1640f1-0633-403e-8f70-6a6d90053cfc for instance with vm_state stopped and task_state powering-on.
May 28 10:04:29.150906 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6ad80fba-906c-456a-a127-a85b0cc67c1b req-ba5bc5c4-cfc6-4674-9f4c-17c5654932f0 service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Received event network-changed-0e857900-174b-46cf-bfa1-ce7f2f8ffdb1 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:04:29.151358 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6ad80fba-906c-456a-a127-a85b0cc67c1b req-ba5bc5c4-cfc6-4674-9f4c-17c5654932f0 service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Refreshing instance network info cache due to event network-changed-0e857900-174b-46cf-bfa1-ce7f2f8ffdb1. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:04:29.151593 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6ad80fba-906c-456a-a127-a85b0cc67c1b req-ba5bc5c4-cfc6-4674-9f4c-17c5654932f0 service nova] Acquiring lock "refresh_cache-36fde791-779f-42a8-9aef-87eafbbe0370" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:04:29.151713 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6ad80fba-906c-456a-a127-a85b0cc67c1b req-ba5bc5c4-cfc6-4674-9f4c-17c5654932f0 service nova] Acquired lock "refresh_cache-36fde791-779f-42a8-9aef-87eafbbe0370" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:04:29.151875 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-6ad80fba-906c-456a-a127-a85b0cc67c1b req-ba5bc5c4-cfc6-4674-9f4c-17c5654932f0 service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Refreshing network info cache for port 0e857900-174b-46cf-bfa1-ce7f2f8ffdb1 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:04:29.178286 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "refresh_cache-2641ee65-c9c2-401d-b511-6ecc1247a3ad" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:04:29.178406 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquired lock "refresh_cache-2641ee65-c9c2-401d-b511-6ecc1247a3ad" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:04:29.178528 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:04:29.178675 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lazy-loading 'info_cache' on Instance uuid 2641ee65-c9c2-401d-b511-6ecc1247a3ad {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:04:29.379354 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 -F raw /opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615/disk" returned: 0 in 1.142s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:29.379813 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:04:29.380439 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Ensure instance console log exists: /opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:04:29.380522 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:29.380748 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:29.380924 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:29.383612 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Start _get_guest_xml network_info=[{"id": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "address": "fa:16:3e:e9:42:eb", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d656bf-1f", "ovs_interfaceid": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='2ef5d373d95c9c3e8926436c32626ff9',container_format='bare',created_at=2026-05-28T10:03:59Z,direct_url=<?>,disk_format='qcow2',id=dbf908ff-f983-44cd-8207-2c20614aae04,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1013676903-shelved',owner='edd64b0e2ce54cac860344420cf9c5b6',properties=ImageMetaProps,protected=<?>,size=53673984,status='active',tags=<?>,updated_at=2026-05-28T10:04:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7', 'iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attached', 'instance': '7ca4978c-d8a8-4ca2-81f3-63bc1e397615', 'attached_at': '', 'detached_at': '', 'volume_id': 'b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7', 'serial': 'b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7'}, 'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'attachment_id': '9323e0c3-3d61-42bb-852a-b8f5c4c18e11', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:04:29.390693 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:04:29.396224 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-1013676903', uuid='7ca4978c-d8a8-4ca2-81f3-63bc1e397615'), owner=OwnerMeta(userid='bd3def75f0dd411888f23a2f432896b0', username='tempest-AttachVolumeShelveTestJSON-1618900663-project-member', projectid='edd64b0e2ce54cac860344420cf9c5b6', projectname='tempest-AttachVolumeShelveTestJSON-1618900663'), image=ImageMeta(id='dbf908ff-f983-44cd-8207-2c20614aae04', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "address": "fa:16:3e:e9:42:eb", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d656bf-1f", "ovs_interfaceid": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962669.3956375) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:04:29.397722 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:04:29.398309 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:04:29.401708 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:04:29.401943 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:04:29.402919 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:04:29.407350 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='2ef5d373d95c9c3e8926436c32626ff9',container_format='bare',created_at=2026-05-28T10:03:59Z,direct_url=<?>,disk_format='qcow2',id=dbf908ff-f983-44cd-8207-2c20614aae04,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1013676903-shelved',owner='edd64b0e2ce54cac860344420cf9c5b6',properties=ImageMetaProps,protected=<?>,size=53673984,status='active',tags=<?>,updated_at=2026-05-28T10:04:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:04:29.407607 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:04:29.407738 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:04:29.407896 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:04:29.407991 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:04:29.408128 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:04:29.408303 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:04:29.408426 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:04:29.408753 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:04:29.408753 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:04:29.408840 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:04:29.408990 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7ca4978c-d8a8-4ca2-81f3-63bc1e397615 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:04:29.513046 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:29.658292 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-6ad80fba-906c-456a-a127-a85b0cc67c1b req-ba5bc5c4-cfc6-4674-9f4c-17c5654932f0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:29.683941 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Object Instance<2641ee65-c9c2-401d-b511-6ecc1247a3ad> lazy-loaded attributes: flavor,info_cache {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:04:29.729239 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:29.911498 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Object Instance<7ca4978c-d8a8-4ca2-81f3-63bc1e397615> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:04:29.921810 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:04:29.922090 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7', 'iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:04:29.922245 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:04:29.994196 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Acquiring lock "ebfe249f-9326-47ad-8e83-b6058b04e1e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:29.994196 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Lock "ebfe249f-9326-47ad-8e83-b6058b04e1e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:29.994196 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Acquiring lock "ebfe249f-9326-47ad-8e83-b6058b04e1e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:29.994196 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Lock "ebfe249f-9326-47ad-8e83-b6058b04e1e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:29.994196 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Lock "ebfe249f-9326-47ad-8e83-b6058b04e1e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:29.996966 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Terminating instance
May 28 10:04:30.009197 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-6ad80fba-906c-456a-a127-a85b0cc67c1b req-ba5bc5c4-cfc6-4674-9f4c-17c5654932f0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:30.172082 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-6ad80fba-906c-456a-a127-a85b0cc67c1b req-ba5bc5c4-cfc6-4674-9f4c-17c5654932f0 service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Updated VIF entry in instance network info cache for port 0e857900-174b-46cf-bfa1-ce7f2f8ffdb1. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:04:30.172477 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-6ad80fba-906c-456a-a127-a85b0cc67c1b req-ba5bc5c4-cfc6-4674-9f4c-17c5654932f0 service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Updating instance_info_cache with network_info: [{"id": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "address": "fa:16:3e:e1:06:59", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e857900-17", "ovs_interfaceid": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:04:30.185589 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:30.287407 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.364s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:04:30.287407 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7', 'iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:04:30.301270 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:04:30.302080 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:04:30.302601 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:04:30.302830 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:04:30.303403 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:04:30.303570 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:04:30.321901 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:04:30.321901 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:30.329229 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:04:30.329229 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:30.337517 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7] added
May 28 10:04:30.337517 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:04:30.337517 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:04:30.337517 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:04:30.337517 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:04:30.337517 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:04:30.337517 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:30.337517 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:04:30.338121 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0348(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:04:30.338121 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:04:30.350001 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7] added
May 28 10:04:30.350001 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:04:30.350001 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:04:30.350001 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:04:30.350001 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:04:30.350001 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:04:30.350001 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:30.350273 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:04:30.350415 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0467(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:04:30.350613 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:04:30.505018 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:04:30.540199 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:30.544059 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:30.562989 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:30.567385 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:30.571656 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:30.601777 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:30.612874 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:30.675089 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6ad80fba-906c-456a-a127-a85b0cc67c1b req-ba5bc5c4-cfc6-4674-9f4c-17c5654932f0 service nova] Releasing lock "refresh_cache-36fde791-779f-42a8-9aef-87eafbbe0370" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:04:30.675320 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6ad80fba-906c-456a-a127-a85b0cc67c1b req-ba5bc5c4-cfc6-4674-9f4c-17c5654932f0 service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Received event network-changed-9df7e969-a155-41f1-9e30-c42f172029e4 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:04:30.675482 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6ad80fba-906c-456a-a127-a85b0cc67c1b req-ba5bc5c4-cfc6-4674-9f4c-17c5654932f0 service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Refreshing instance network info cache due to event network-changed-9df7e969-a155-41f1-9e30-c42f172029e4. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:04:30.675641 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6ad80fba-906c-456a-a127-a85b0cc67c1b req-ba5bc5c4-cfc6-4674-9f4c-17c5654932f0 service nova] Acquiring lock "refresh_cache-de9742b9-43db-40a6-b635-81d9244fd5e0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:04:30.675723 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6ad80fba-906c-456a-a127-a85b0cc67c1b req-ba5bc5c4-cfc6-4674-9f4c-17c5654932f0 service nova] Acquired lock "refresh_cache-de9742b9-43db-40a6-b635-81d9244fd5e0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:04:30.675877 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-6ad80fba-906c-456a-a127-a85b0cc67c1b req-ba5bc5c4-cfc6-4674-9f4c-17c5654932f0 service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Refreshing network info cache for port 9df7e969-a155-41f1-9e30-c42f172029e4 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:04:30.817494 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Updating instance_info_cache with network_info: [{"id": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "address": "fa:16:3e:08:31:07", "network": {"id": "cfc0fcd2-826d-4851-bc3e-3f0433d6fbce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1771427851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f2d040c323b4b948803334de7c8ec44", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc1640f1-06", "ovs_interfaceid": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:04:30.845101 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.99965903500015 future=<Future at 0x73c1fc13dac0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:04:30.848858 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Instance destroyed successfully.
May 28 10:04:30.849380 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Lazy-loading 'resources' on Instance uuid ebfe249f-9326-47ad-8e83-b6058b04e1e5 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:04:31.089250 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:31.181253 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-6ad80fba-906c-456a-a127-a85b0cc67c1b req-ba5bc5c4-cfc6-4674-9f4c-17c5654932f0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:31.321270 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Releasing lock "refresh_cache-2641ee65-c9c2-401d-b511-6ecc1247a3ad" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:04:31.341180 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:04:31.351060 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:04:31.352618 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:04:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='instance-depend-image',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:04:22Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c134a4b41b44392b26d2e299b4911e9',ramdisk_id='',reservation_id='r-a7zqegjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_signature_verified='False',owner_project_name='tempest-ImageDependencyTests-2101881819',owner_user_name='tempest-ImageDependencyTests-2101881819-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:04:23Z,user_data=None,user_id='9e90ac16da754ec294694a965321111f',uuid=ebfe249f-9326-47ad-8e83-b6058b04e1e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "835e2ca2-278c-4d61-9472-2107d4fc7ac3", "address": "fa:16:3e:e2:8e:3b", "network": {"id": "f1a1b038-1ab9-40c1-b2d1-a4f95e93c396", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0ee907e07b942d09d375f1b1647d9b3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap835e2ca2-27", "ovs_interfaceid": "835e2ca2-278c-4d61-9472-2107d4fc7ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:04:31.352880 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Converting VIF {"id": "835e2ca2-278c-4d61-9472-2107d4fc7ac3", "address": "fa:16:3e:e2:8e:3b", "network": {"id": "f1a1b038-1ab9-40c1-b2d1-a4f95e93c396", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0ee907e07b942d09d375f1b1647d9b3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap835e2ca2-27", "ovs_interfaceid": "835e2ca2-278c-4d61-9472-2107d4fc7ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:04:31.353659 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:8e:3b,bridge_name='br-int',has_traffic_filtering=True,id=835e2ca2-278c-4d61-9472-2107d4fc7ac3,network=Network(f1a1b038-1ab9-40c1-b2d1-a4f95e93c396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap835e2ca2-27') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:04:31.353877 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:8e:3b,bridge_name='br-int',has_traffic_filtering=True,id=835e2ca2-278c-4d61-9472-2107d4fc7ac3,network=Network(f1a1b038-1ab9-40c1-b2d1-a4f95e93c396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap835e2ca2-27') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:04:31.359489 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:04:31.359489 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:31.361591 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:31.361591 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap835e2ca2-27, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:04:31.364181 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:31.364181 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:04:31.369071 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:04:31.369071 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:31.370951 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:31.373982 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:31.373982 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=df64ed58-025d-484a-9a7f-a29118033fc3) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:04:31.374639 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:31.375505 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:04:31.378667 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:31.384261 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:31.387644 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:31.390272 np0000001613 nova-compute[98321]: INFO os_vif [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:8e:3b,bridge_name='br-int',has_traffic_filtering=True,id=835e2ca2-278c-4d61-9472-2107d4fc7ac3,network=Network(f1a1b038-1ab9-40c1-b2d1-a4f95e93c396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap835e2ca2-27')
May 28 10:04:31.391804 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:04:31.392104 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d', 'iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9cec193d-f880-40d9-82d0-9c0e4fb6c74d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:04:31.392281 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:04:31.402643 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:31.402643 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:31.402643 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:31.402643 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:31.402643 np0000001613 nova-compute[98321]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:31.402643 np0000001613 nova-compute[98321]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:31.402643 np0000001613 nova-compute[98321]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:31.402643 np0000001613 nova-compute[98321]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:31.402643 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:04:31.402643 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:31.402643 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:31.402643 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:31.402643 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:31.402643 np0000001613 nova-compute[98321]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:31.402643 np0000001613 nova-compute[98321]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:31.402643 np0000001613 nova-compute[98321]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:31.402643 np0000001613 nova-compute[98321]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:31.402643 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:04:31.413545 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:31.413545 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:31.413545 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:31.413545 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:31.413545 np0000001613 nova-compute[98321]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:31.413545 np0000001613 nova-compute[98321]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:31.413545 np0000001613 nova-compute[98321]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:31.413545 np0000001613 nova-compute[98321]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:31.413545 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:04:31.414299 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:31.414299 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:31.414299 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:31.414299 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:31.414299 np0000001613 nova-compute[98321]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:31.414299 np0000001613 nova-compute[98321]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:31.414299 np0000001613 nova-compute[98321]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:31.414299 np0000001613 nova-compute[98321]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:31.414299 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:04:31.464142 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7, portal: 192.168.50.100,3260]
May 28 10:04:31.464142 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7, portal: 192.168.50.100,3260] successful.
May 28 10:04:31.464142 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:31.471258 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7, portal: 192.168.40.100,3260]
May 28 10:04:31.471258 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7, portal: 192.168.40.100,3260] successful.
May 28 10:04:31.471258 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:31.485053 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:31.491949 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:31.502750 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:31.502750 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:31.502750 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:31.502750 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:31.502750 np0000001613 nova-compute[98321]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:31.502750 np0000001613 nova-compute[98321]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:31.502750 np0000001613 nova-compute[98321]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:31.502750 np0000001613 nova-compute[98321]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:31.502750 np0000001613 nova-compute[98321]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:31.502750 np0000001613 nova-compute[98321]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:31.502750 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:04:31.503066 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:31.503066 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:31.503066 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:31.503066 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:31.503066 np0000001613 nova-compute[98321]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:31.503066 np0000001613 nova-compute[98321]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:31.503066 np0000001613 nova-compute[98321]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:31.503066 np0000001613 nova-compute[98321]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:31.503066 np0000001613 nova-compute[98321]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:31.503066 np0000001613 nova-compute[98321]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:31.503066 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:04:31.503267 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.201s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:04:31.503267 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:04:31.504266 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] HCTL ('15', '-', '-', 0) found on session 75 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:04:31.504379 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:04:31.515289 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:31.515289 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:31.515289 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:31.515289 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:31.515289 np0000001613 nova-compute[98321]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:31.515289 np0000001613 nova-compute[98321]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:31.515289 np0000001613 nova-compute[98321]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:31.515289 np0000001613 nova-compute[98321]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:31.515289 np0000001613 nova-compute[98321]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:31.515289 np0000001613 nova-compute[98321]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:31.515289 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:04:31.515528 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:31.515528 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:31.515528 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:31.515528 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:31.515528 np0000001613 nova-compute[98321]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:31.515528 np0000001613 nova-compute[98321]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:31.515528 np0000001613 nova-compute[98321]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:31.515528 np0000001613 nova-compute[98321]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:31.515528 np0000001613 nova-compute[98321]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:31.515528 np0000001613 nova-compute[98321]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:31.515528 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:04:31.515905 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.212s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:04:31.516083 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:04:31.517331 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] HCTL ('16', '-', '-', 0) found on session 76 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:04:31.517485 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:04:31.527580 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Searching for a device in session 75 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:04:31.527580 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:04:31.540329 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Searching for a device in session 76 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:04:31.540329 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:04:31.577703 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-6ad80fba-906c-456a-a127-a85b0cc67c1b req-ba5bc5c4-cfc6-4674-9f4c-17c5654932f0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:31.802271 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-6ad80fba-906c-456a-a127-a85b0cc67c1b req-ba5bc5c4-cfc6-4674-9f4c-17c5654932f0 service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Updated VIF entry in instance network info cache for port 9df7e969-a155-41f1-9e30-c42f172029e4. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:04:31.802726 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-6ad80fba-906c-456a-a127-a85b0cc67c1b req-ba5bc5c4-cfc6-4674-9f4c-17c5654932f0 service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Updating instance_info_cache with network_info: [{"id": "9df7e969-a155-41f1-9e30-c42f172029e4", "address": "fa:16:3e:9e:26:24", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df7e969-a1", "ovs_interfaceid": "9df7e969-a155-41f1-9e30-c42f172029e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:04:32.304189 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:04:32.309214 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6ad80fba-906c-456a-a127-a85b0cc67c1b req-ba5bc5c4-cfc6-4674-9f4c-17c5654932f0 service nova] Releasing lock "refresh_cache-de9742b9-43db-40a6-b635-81d9244fd5e0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:04:32.343498 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Instance destroyed successfully.
May 28 10:04:32.343875 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lazy-loading 'numa_topology' on Instance uuid 2641ee65-c9c2-401d-b511-6ecc1247a3ad {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:04:32.846589 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Object Instance<2641ee65-c9c2-401d-b511-6ecc1247a3ad> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:04:32.846841 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lazy-loading 'resources' on Instance uuid 2641ee65-c9c2-401d-b511-6ecc1247a3ad {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:04:32.990732 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Acquiring lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:32.990915 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:33.159634 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:33.323378 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Found WWN 3300000008a391f1a for multipath device dm-3 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:04:33.323704 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:04:33.323885 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] <== connect_volume: return (3401ms) {'type': 'block', 'scsi_wwn': '3300000008a391f1a', 'path': '/dev/dm-3', 'multipath_id': '3300000008a391f1a'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:04:33.324046 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008a391f1a', 'path': '/dev/dm-3', 'multipath_id': '3300000008a391f1a'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:04:33.324596 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.932s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:04:33.325080 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d', 'iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9cec193d-f880-40d9-82d0-9c0e4fb6c74d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:04:33.325288 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:04:33.353271 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Object Instance<2641ee65-c9c2-401d-b511-6ecc1247a3ad> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:04:33.354147 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:03:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1119204149',display_name='tempest-AttachVolumeTestJSON-server-1119204149',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumetestjson-server-1119204149',id=34,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqD3i0NyKUYk701QA/12tGT7VZdARZzjNaHq8E3bqiWoRx7uJQPxa/ABqLzgddi+LvAs2Iatbj3S16oUNtlAmNjXKSqbg4xg/bifRd6D1DjOpjgoBB+xCgTJwlOZatWFw==',key_name='tempest-keypair-1805479953',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:03:35Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6f2d040c323b4b948803334de7c8ec44',ramdisk_id='',reservation_id='r-92jv1vdq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1743003640',owner_user_name='tempest-AttachVolumeTestJSON-1743003640-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:04:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c88efa7ed26463d928a0e4228dca6cf',uuid=2641ee65-c9c2-401d-b511-6ecc1247a3ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "address": "fa:16:3e:08:31:07", "network": {"id": "cfc0fcd2-826d-4851-bc3e-3f0433d6fbce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1771427851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f2d040c323b4b948803334de7c8ec44", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc1640f1-06", "ovs_interfaceid": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:04:33.354384 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Converting VIF {"id": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "address": "fa:16:3e:08:31:07", "network": {"id": "cfc0fcd2-826d-4851-bc3e-3f0433d6fbce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1771427851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f2d040c323b4b948803334de7c8ec44", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc1640f1-06", "ovs_interfaceid": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:04:33.354969 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:31:07,bridge_name='br-int',has_traffic_filtering=True,id=dc1640f1-0633-403e-8f70-6a6d90053cfc,network=Network(cfc0fcd2-826d-4851-bc3e-3f0433d6fbce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc1640f1-06') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:04:33.355302 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:31:07,bridge_name='br-int',has_traffic_filtering=True,id=dc1640f1-0633-403e-8f70-6a6d90053cfc,network=Network(cfc0fcd2-826d-4851-bc3e-3f0433d6fbce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc1640f1-06') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:04:33.357840 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:33.358807 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc1640f1-06, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:04:33.359940 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:33.362372 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:33.362673 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:33.362875 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=794659e9-50df-4ff4-9f8b-64e6804b5f10) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:04:33.363320 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:33.363320 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:33.363320 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:33.363320 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:33.363320 np0000001613 nova-compute[98321]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:33.363320 np0000001613 nova-compute[98321]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:33.363320 np0000001613 nova-compute[98321]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:33.363320 np0000001613 nova-compute[98321]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:33.363320 np0000001613 nova-compute[98321]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:33.363320 np0000001613 nova-compute[98321]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:33.363320 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:04:33.364126 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:33.364126 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:33.364126 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:33.364126 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:33.364126 np0000001613 nova-compute[98321]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:33.364126 np0000001613 nova-compute[98321]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d (non-flash)
May 28 10:04:33.364126 np0000001613 nova-compute[98321]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:33.364126 np0000001613 nova-compute[98321]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:33.364126 np0000001613 nova-compute[98321]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:33.364126 np0000001613 nova-compute[98321]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:33.364126 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:04:33.364126 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', '59'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', '60'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d', '69'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d', '70'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b', '71'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b', '72'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7', '75'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7', '76')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:04:33.364126 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d', '70')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:04:33.364637 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:04:33.366067 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:33.367580 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d', '69')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:04:33.368881 np0000001613 nova-compute[98321]: INFO os_vif [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:31:07,bridge_name='br-int',has_traffic_filtering=True,id=dc1640f1-0633-403e-8f70-6a6d90053cfc,network=Network(cfc0fcd2-826d-4851-bc3e-3f0433d6fbce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc1640f1-06')
May 28 10:04:33.369535 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc7caac0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d'): ({'sdb'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:04:33.369894 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Removing multipathed devices sdb, sdc {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:04:33.370109 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Flush multipath device 330000000c169e3d3 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:04:33.371992 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:04:33.371992 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b', 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd565e760-7309-464b-9f49-2e176d23ac7b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:04:33.372347 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:04:33.405656 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:04:33.470066 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:04:33.493048 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:04:33.532802 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:04:33.532802 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:04:33.533961 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:04:33.547334 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:04:33.547544 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:04:33.560246 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:33.600020 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d, portal: 192.168.40.100,3260]
May 28 10:04:33.600020 np0000001613 nova-compute[98321]: Logout of [sid: 70, target: iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d, portal: 192.168.40.100,3260] successful.
May 28 10:04:33.600020 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:33.621497 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:33.642747 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:33.681676 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d, portal: 192.168.50.100,3260]
May 28 10:04:33.681676 np0000001613 nova-compute[98321]: Logout of [sid: 69, target: iqn.2023-03.storpool.com:os--volume-9cec193d-f880-40d9-82d0-9c0e4fb6c74d, portal: 192.168.50.100,3260] successful.
May 28 10:04:33.681676 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:33.712327 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:33.712590 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:04:33.712750 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] <== disconnect_volume: return (2320ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:04:33.713136 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:04:33.714186 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Deleting instance files /opt/stack/data/nova/instances/ebfe249f-9326-47ad-8e83-b6058b04e1e5_del
May 28 10:04:33.714186 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Deletion of /opt/stack/data/nova/instances/ebfe249f-9326-47ad-8e83-b6058b04e1e5_del complete
May 28 10:04:33.717779 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.345s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:04:33.717779 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b', 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd565e760-7309-464b-9f49-2e176d23ac7b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:04:33.717779 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:04:33.756115 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:33.756115 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:33.756115 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:33.756115 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:33.756115 np0000001613 nova-compute[98321]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:33.756115 np0000001613 nova-compute[98321]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:33.756115 np0000001613 nova-compute[98321]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:33.756115 np0000001613 nova-compute[98321]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:33.756115 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:04:33.756115 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:33.756115 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:33.756115 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:33.756115 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:33.756115 np0000001613 nova-compute[98321]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:33.756115 np0000001613 nova-compute[98321]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:33.756115 np0000001613 nova-compute[98321]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:33.756115 np0000001613 nova-compute[98321]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:33.756115 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:04:33.756115 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', '59'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', '60'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b', '71'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b', '72'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7', '75'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7', '76')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:04:33.756115 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b', '72')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:04:33.756883 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b', '71')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:04:33.756960 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc7caac0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b'): ({'sdd'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:04:33.757125 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Removing multipathed devices sdd, sde {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:04:33.757358 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Flush multipath device 330000000e8f820e4 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:04:33.797614 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:04:33.832631 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T10:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1013676903',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumeshelvetestjson-server-1013676903',id=32,image_ref='dbf908ff-f983-44cd-8207-2c20614aae04',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1225597873',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:03:17Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='edd64b0e2ce54cac860344420cf9c5b6',ramdisk_id='',reservation_id='r-1n6ox9bd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1618900663',owner_user_name='tempest-AttachVolumeShelveTestJSON-1618900663-project-member',shelved_at='2026-05-28T10:04:05.994656',shelved_host='np0000001613',shelved_image_id='dbf908ff-f983-44cd-8207-2c20614aae04'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:04:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd3def75f0dd411888f23a2f432896b0',uuid=7ca4978c-d8a8-4ca2-81f3-63bc1e397615,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "address": "fa:16:3e:e9:42:eb", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d656bf-1f", "ovs_interfaceid": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:04:33.832631 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Converting VIF {"id": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "address": "fa:16:3e:e9:42:eb", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d656bf-1f", "ovs_interfaceid": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:04:33.833093 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:42:eb,bridge_name='br-int',has_traffic_filtering=True,id=08d656bf-1f8f-4bd8-b04a-27184a5225d5,network=Network(d262816b-8751-4e64-8f19-7d59ddaabc41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d656bf-1f') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:04:33.833665 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ca4978c-d8a8-4ca2-81f3-63bc1e397615 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:04:33.848353 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:04:33.899791 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:04:33.899967 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:04:33.901067 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:04:33.915271 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:04:33.915656 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:04:33.937043 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:33.976820 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 72, target: iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b, portal: 192.168.40.100,3260]
May 28 10:04:33.976820 np0000001613 nova-compute[98321]: Logout of [sid: 72, target: iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b, portal: 192.168.40.100,3260] successful.
May 28 10:04:33.976820 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:33.998980 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:34.016745 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:34.054035 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 71, target: iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b, portal: 192.168.50.100,3260]
May 28 10:04:34.054035 np0000001613 nova-compute[98321]: Logout of [sid: 71, target: iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b, portal: 192.168.50.100,3260] successful.
May 28 10:04:34.054035 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:34.074594 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:34.074594 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:04:34.074594 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] <== disconnect_volume: return (701ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:04:34.074594 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:04:34.082725 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Start _get_guest_xml network_info=[{"id": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "address": "fa:16:3e:08:31:07", "network": {"id": "cfc0fcd2-826d-4851-bc3e-3f0433d6fbce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1771427851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f2d040c323b4b948803334de7c8ec44", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc1640f1-06", "ovs_interfaceid": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b', 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd565e760-7309-464b-9f49-2e176d23ac7b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, 'status': 'reserved', 'instance': '2641ee65-c9c2-401d-b511-6ecc1247a3ad', 'attached_at': '', 'detached_at': '', 'volume_id': 'd565e760-7309-464b-9f49-2e176d23ac7b', 'serial': 'd565e760-7309-464b-9f49-2e176d23ac7b'}, 'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': '11f048d4-61dc-48a7-912b-e077a8eb8fc9', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:04:34.093598 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:34.093970 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:34.094587 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:04:34.096217 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-1119204149', uuid='2641ee65-c9c2-401d-b511-6ecc1247a3ad'), owner=OwnerMeta(userid='2c88efa7ed26463d928a0e4228dca6cf', username='tempest-AttachVolumeTestJSON-1743003640-project-member', projectid='6f2d040c323b4b948803334de7c8ec44', projectname='tempest-AttachVolumeTestJSON-1743003640'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "address": "fa:16:3e:08:31:07", "network": {"id": "cfc0fcd2-826d-4851-bc3e-3f0433d6fbce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1771427851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f2d040c323b4b948803334de7c8ec44", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc1640f1-06", "ovs_interfaceid": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962674.0958235) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:04:34.099398 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:04:34.099682 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Claim successful on node np0000001613
May 28 10:04:34.104394 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:04:34.107246 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:04:34.122658 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:04:34.123302 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:04:34.124176 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:04:34.124458 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:04:34.124593 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:04:34.124698 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:04:34.124813 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:04:34.124883 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:04:34.125003 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:04:34.125095 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:04:34.125314 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:04:34.125839 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:04:34.127423 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:04:34.127728 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:04:34.127894 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2641ee65-c9c2-401d-b511-6ecc1247a3ad {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:04:34.222027 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Took 3.72 seconds to destroy the instance on the hypervisor.
May 28 10:04:34.224215 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:04:34.226332 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:04:34.226467 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:04:34.226794 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:34.323355 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:34.336441 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Object Instance<7ca4978c-d8a8-4ca2-81f3-63bc1e397615> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:04:34.337411 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] End _get_guest_xml xml=<domain type="qemu">
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:   <uuid>7ca4978c-d8a8-4ca2-81f3-63bc1e397615</uuid>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:   <name>instance-00000020</name>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1013676903</nova:name>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:04:29</nova:creationTime>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:         <nova:user uuid="bd3def75f0dd411888f23a2f432896b0">tempest-AttachVolumeShelveTestJSON-1618900663-project-member</nova:user>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:         <nova:project uuid="edd64b0e2ce54cac860344420cf9c5b6">tempest-AttachVolumeShelveTestJSON-1618900663</nova:project>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:         <nova:port uuid="08d656bf-1f8f-4bd8-b04a-27184a5225d5">
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:     <system>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:       <entry name="serial">7ca4978c-d8a8-4ca2-81f3-63bc1e397615</entry>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:       <entry name="uuid">7ca4978c-d8a8-4ca2-81f3-63bc1e397615</entry>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:     </system>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:   <os>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:   </os>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:   <features>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:   </features>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:   <devices>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615/disk"/>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:     </disk>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615/disk.config"/>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:     </disk>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:       <alias name="ua-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7"/>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-3"/>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:       <target dev="vdc" bus="virtio"/>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:       <serial>b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7</serial>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:     </disk>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:e9:42:eb"/>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:       <target dev="tap08d656bf-1f"/>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:     </interface>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615/console.log" append="off"/>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:     </serial>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:     <video>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:     </video>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:     </rng>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:   </devices>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]: </domain>
May 28 10:04:34.337411 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:04:34.340738 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Preparing to wait for external event network-vif-plugged-08d656bf-1f8f-4bd8-b04a-27184a5225d5 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:04:34.340738 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:34.340738 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:34.340738 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:34.340738 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T10:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1013676903',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumeshelvetestjson-server-1013676903',id=32,image_ref='dbf908ff-f983-44cd-8207-2c20614aae04',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1225597873',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:03:17Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='edd64b0e2ce54cac860344420cf9c5b6',ramdisk_id='',reservation_id='r-1n6ox9bd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1618900663',owner_user_name='tempest-AttachVolumeShelveTestJSON-1618900663-project-member',shelved_at='2026-05-28T10:04:05.994656',shelved_host='np0000001613',shelved_image_id='dbf908ff-f983-44cd-8207-2c20614aae04'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:04:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd3def75f0dd411888f23a2f432896b0',uuid=7ca4978c-d8a8-4ca2-81f3-63bc1e397615,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "address": "fa:16:3e:e9:42:eb", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d656bf-1f", "ovs_interfaceid": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:04:34.340738 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Converting VIF {"id": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "address": "fa:16:3e:e9:42:eb", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d656bf-1f", "ovs_interfaceid": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:04:34.340738 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:42:eb,bridge_name='br-int',has_traffic_filtering=True,id=08d656bf-1f8f-4bd8-b04a-27184a5225d5,network=Network(d262816b-8751-4e64-8f19-7d59ddaabc41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d656bf-1f') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:04:34.340738 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:42:eb,bridge_name='br-int',has_traffic_filtering=True,id=08d656bf-1f8f-4bd8-b04a-27184a5225d5,network=Network(d262816b-8751-4e64-8f19-7d59ddaabc41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d656bf-1f') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:04:34.340738 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:34.340738 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:04:34.341371 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:04:34.342556 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:34.342814 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9ffe9529-d411-5e62-aef8-91288d9fb1d4', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:04:34.343671 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:34.344465 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:04:34.346144 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:34.349906 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:34.350195 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08d656bf-1f, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:04:34.350568 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap08d656bf-1f, col_values=(('qos', UUID('0d585bd7-9607-4d19-b7f9-5797bbad0d10')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:04:34.350696 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap08d656bf-1f, col_values=(('external_ids', {'iface-id': '08d656bf-1f8f-4bd8-b04a-27184a5225d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:42:eb', 'vm-uuid': '7ca4978c-d8a8-4ca2-81f3-63bc1e397615'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:04:34.351713 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:34.353194 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:04:34.360343 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:34.361443 np0000001613 nova-compute[98321]: INFO os_vif [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:42:eb,bridge_name='br-int',has_traffic_filtering=True,id=08d656bf-1f8f-4bd8-b04a-27184a5225d5,network=Network(d262816b-8751-4e64-8f19-7d59ddaabc41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d656bf-1f')
May 28 10:04:34.516582 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:34.629729 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Object Instance<2641ee65-c9c2-401d-b511-6ecc1247a3ad> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:04:34.645952 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-19a6943f-c7d1-4f42-b87a-718dd1f555f8 req-bb714dcb-d6e2-4728-8026-f93abe3184d2 service nova] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Received event network-vif-deleted-835e2ca2-278c-4d61-9472-2107d4fc7ac3 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:04:34.645952 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-19a6943f-c7d1-4f42-b87a-718dd1f555f8 req-bb714dcb-d6e2-4728-8026-f93abe3184d2 service nova] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Neutron deleted interface 835e2ca2-278c-4d61-9472-2107d4fc7ac3; detaching it from the instance and deleting it from the info cache
May 28 10:04:34.653769 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-19a6943f-c7d1-4f42-b87a-718dd1f555f8 req-bb714dcb-d6e2-4728-8026-f93abe3184d2 service nova] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Detach interface failed, port_id=835e2ca2-278c-4d61-9472-2107d4fc7ac3, reason: Instance ebfe249f-9326-47ad-8e83-b6058b04e1e5 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:04:34.658432 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk.config --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:34.782890 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk.config --force-share --output=json" returned: 0 in 0.124s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:34.783493 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "/opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:34.783843 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "/opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:34.784456 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "/opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:34.784847 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:04:34.785284 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b', 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd565e760-7309-464b-9f49-2e176d23ac7b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:04:34.785438 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:04:34.785820 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:04:34.786114 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b', 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd565e760-7309-464b-9f49-2e176d23ac7b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:04:34.801108 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:04:34.802221 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:04:34.802980 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:04:34.803325 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:04:34.803734 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:04:34.803903 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:04:34.816485 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:04:34.816485 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:34.822591 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:04:34.822591 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:34.831589 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b] added
May 28 10:04:34.831589 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:04:34.831589 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:04:34.831589 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:04:34.831589 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:04:34.831589 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:04:34.831589 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:34.831789 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:04:34.832010 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0287(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:04:34.832180 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:04:34.839506 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b] added
May 28 10:04:34.839506 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:04:34.839506 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:04:34.839506 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:04:34.839506 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:04:34.839506 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:04:34.839506 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:34.839924 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:04:34.840157 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0362(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:04:34.840282 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:04:35.062972 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:04:35.166320 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:35.565099 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Took 1.34 seconds to deallocate network for instance.
May 28 10:04:35.609449 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:04:35.609821 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:04:35.832698 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:04:35.840708 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:04:35.846910 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:04:35.846910 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:04:35.853974 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:04:35.853974 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:35.860148 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:35.867390 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:35.876538 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:35.876538 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:35.876538 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:35.876538 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:35.876538 np0000001613 nova-compute[98321]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:35.876538 np0000001613 nova-compute[98321]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:35.876538 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:04:35.876730 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:35.876730 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:35.876730 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:35.876730 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:35.876730 np0000001613 nova-compute[98321]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:35.876730 np0000001613 nova-compute[98321]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:35.876730 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:04:35.881761 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:04:35.881960 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:04:35.882055 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:04:35.882307 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] No VIF found with MAC fa:16:3e:e9:42:eb, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:04:35.882954 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Using config drive
May 28 10:04:35.886253 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:35.886253 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:35.886253 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:35.886253 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:35.886253 np0000001613 nova-compute[98321]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:35.886253 np0000001613 nova-compute[98321]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:35.886253 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:04:35.886564 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:35.886564 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:35.886564 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:35.886564 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:35.886564 np0000001613 nova-compute[98321]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:35.886564 np0000001613 nova-compute[98321]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:35.886564 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:04:35.914636 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b, portal: 192.168.50.100,3260]
May 28 10:04:35.914636 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b, portal: 192.168.50.100,3260] successful.
May 28 10:04:35.914636 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:35.925570 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:35.930384 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b, portal: 192.168.40.100,3260]
May 28 10:04:35.930384 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b, portal: 192.168.40.100,3260] successful.
May 28 10:04:35.930384 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:35.940022 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:35.940022 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:35.940022 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:35.940022 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:35.940022 np0000001613 nova-compute[98321]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:35.940022 np0000001613 nova-compute[98321]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:35.940022 np0000001613 nova-compute[98321]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:35.940022 np0000001613 nova-compute[98321]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:35.940022 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:04:35.940507 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:35.940507 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:35.940507 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:35.940507 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:35.940507 np0000001613 nova-compute[98321]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:35.940507 np0000001613 nova-compute[98321]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:35.940507 np0000001613 nova-compute[98321]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:35.940507 np0000001613 nova-compute[98321]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:35.940507 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:04:35.940507 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.138s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:04:35.940847 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:04:35.941725 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] HCTL ('7', '-', '-', 0) found on session 77 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:04:35.941847 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:04:35.943386 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:35.966212 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Searching for a device in session 77 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:04:35.966212 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd565e760-7309-464b-9f49-2e176d23ac7b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:04:35.967445 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:35.967445 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:35.967445 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:35.967445 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:35.967445 np0000001613 nova-compute[98321]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:35.967445 np0000001613 nova-compute[98321]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:35.967445 np0000001613 nova-compute[98321]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:35.967445 np0000001613 nova-compute[98321]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:35.967445 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:04:35.967699 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:35.967699 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:35.967699 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:35.967699 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:35.967699 np0000001613 nova-compute[98321]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:35.967699 np0000001613 nova-compute[98321]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:35.967699 np0000001613 nova-compute[98321]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:35.967699 np0000001613 nova-compute[98321]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:35.967699 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:04:35.967912 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.164s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:04:35.967912 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:04:35.968658 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] HCTL ('8', '-', '-', 0) found on session 78 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:04:35.968756 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:04:35.984271 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Searching for a device in session 78 and hctl ['8', '*', '*', 0] yield: None {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:04:36.114387 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:04:36.137597 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Took 0.57 seconds to detach 1 volumes for instance.
May 28 10:04:36.140473 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Deleting volume: 9cec193d-f880-40d9-82d0-9c0e4fb6c74d {{(pid=98321) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 10:04:36.385781 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lazy-loading 'ec2_ids' on Instance uuid 7ca4978c-d8a8-4ca2-81f3-63bc1e397615 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:04:36.623425 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.529s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:36.623806 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:04:36.695597 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:36.695775 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:36.892711 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Object Instance<7ca4978c-d8a8-4ca2-81f3-63bc1e397615> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:04:36.892832 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lazy-loading 'keypairs' on Instance uuid 7ca4978c-d8a8-4ca2-81f3-63bc1e397615 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:04:36.983388 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Searching for a device in session 78 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:04:36.983599 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd565e760-7309-464b-9f49-2e176d23ac7b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:04:37.131270 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:04:37.131539 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:04:37.132593 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:37.132922 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:37.223331 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:04:37.223552 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:04:37.229743 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '42a648dd5e4b46a6aa0b2f8e7c8abcc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97358e7c52d42788014ffe493108674', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:04:37.396117 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Object Instance<7ca4978c-d8a8-4ca2-81f3-63bc1e397615> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:04:37.399960 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:37.527379 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Creating config drive at /opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615/disk.config
May 28 10:04:37.532078 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpoyhpvt02 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:37.590116 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpoyhpvt02" returned: 0 in 0.057s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:37.636030 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:04:37.694632 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Successfully created port: 54117267-f360-4419-98f0-5dde7b893041 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:04:37.728565 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:04:37.825706 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Found WWN 330000000e8f820e4 for multipath device dm-0 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:04:37.826098 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:04:37.826395 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '330000000e8f820e4', 'path': '/dev/dm-0', 'multipath_id': '330000000e8f820e4'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:04:37.826566 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e8f820e4', 'path': '/dev/dm-0', 'multipath_id': '330000000e8f820e4'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:04:38.086655 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:38.122824 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:38.143085 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:04:39.118840 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:39.118840 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.543s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:39.118840 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Deleted allocations for instance ebfe249f-9326-47ad-8e83-b6058b04e1e5
May 28 10:04:39.118840 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:03:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1119204149',display_name='tempest-AttachVolumeTestJSON-server-1119204149',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumetestjson-server-1119204149',id=34,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqD3i0NyKUYk701QA/12tGT7VZdARZzjNaHq8E3bqiWoRx7uJQPxa/ABqLzgddi+LvAs2Iatbj3S16oUNtlAmNjXKSqbg4xg/bifRd6D1DjOpjgoBB+xCgTJwlOZatWFw==',key_name='tempest-keypair-1805479953',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:03:35Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6f2d040c323b4b948803334de7c8ec44',ramdisk_id='',reservation_id='r-92jv1vdq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1743003640',owner_user_name='tempest-AttachVolumeTestJSON-1743003640-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:04:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c88efa7ed26463d928a0e4228dca6cf',uuid=2641ee65-c9c2-401d-b511-6ecc1247a3ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "address": "fa:16:3e:08:31:07", "network": {"id": "cfc0fcd2-826d-4851-bc3e-3f0433d6fbce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1771427851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f2d040c323b4b948803334de7c8ec44", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc1640f1-06", "ovs_interfaceid": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:04:39.118840 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Converting VIF {"id": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "address": "fa:16:3e:08:31:07", "network": {"id": "cfc0fcd2-826d-4851-bc3e-3f0433d6fbce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1771427851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f2d040c323b4b948803334de7c8ec44", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc1640f1-06", "ovs_interfaceid": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:04:39.118840 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:31:07,bridge_name='br-int',has_traffic_filtering=True,id=dc1640f1-0633-403e-8f70-6a6d90053cfc,network=Network(cfc0fcd2-826d-4851-bc3e-3f0433d6fbce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc1640f1-06') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:04:39.118840 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lazy-loading 'pci_devices' on Instance uuid 2641ee65-c9c2-401d-b511-6ecc1247a3ad {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:04:39.118840 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Successfully updated port: 54117267-f360-4419-98f0-5dde7b893041 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:04:39.118840 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4a44f677-144b-4257-baa7-b9b2f56969e0 req-8cae5c5c-f281-4469-9b77-94264de68a0f service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Received event network-vif-plugged-08d656bf-1f8f-4bd8-b04a-27184a5225d5 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:04:39.118840 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4a44f677-144b-4257-baa7-b9b2f56969e0 req-8cae5c5c-f281-4469-9b77-94264de68a0f service nova] Acquiring lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:39.118840 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4a44f677-144b-4257-baa7-b9b2f56969e0 req-8cae5c5c-f281-4469-9b77-94264de68a0f service nova] Lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:39.118840 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4a44f677-144b-4257-baa7-b9b2f56969e0 req-8cae5c5c-f281-4469-9b77-94264de68a0f service nova] Lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:39.118840 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4a44f677-144b-4257-baa7-b9b2f56969e0 req-8cae5c5c-f281-4469-9b77-94264de68a0f service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Processing event network-vif-plugged-08d656bf-1f8f-4bd8-b04a-27184a5225d5 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:04:39.118840 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-11057a2e-9366-463a-a127-e53564e01743 req-59dcf5f9-e203-446d-9806-a9ac2eca6535 service nova] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Received event network-changed-54117267-f360-4419-98f0-5dde7b893041 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:04:39.118840 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-11057a2e-9366-463a-a127-e53564e01743 req-59dcf5f9-e203-446d-9806-a9ac2eca6535 service nova] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Refreshing instance network info cache due to event network-changed-54117267-f360-4419-98f0-5dde7b893041. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:04:39.118840 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-11057a2e-9366-463a-a127-e53564e01743 req-59dcf5f9-e203-446d-9806-a9ac2eca6535 service nova] Acquiring lock "refresh_cache-cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:04:39.118840 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-11057a2e-9366-463a-a127-e53564e01743 req-59dcf5f9-e203-446d-9806-a9ac2eca6535 service nova] Acquired lock "refresh_cache-cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:04:39.118840 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-11057a2e-9366-463a-a127-e53564e01743 req-59dcf5f9-e203-446d-9806-a9ac2eca6535 service nova] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Refreshing network info cache for port 54117267-f360-4419-98f0-5dde7b893041 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:04:39.118840 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:39.118840 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:39.118840 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:39.118840 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:39.118840 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Booting with volume bfa5634a-0742-4951-bf49-a141f1f9134e at /dev/vda
May 28 10:04:39.118840 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:04:39.118840 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:04:39.118840 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:39.125509 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:04:39.125509 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:04:39.125509 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:04:39.125509 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fefd:30e7', 'fe80::e4df:c0ff:fe86:6341', 'fe80::fc16:3eff:fedb:1077', 'fe80::fc16:3eff:fe3c:b7e1', 'fe80::fc16:3eff:fee1:659', 'fe80::fc16:3eff:fe9e:2624', 'fe80::fc16:3eff:fee9:42eb', 'fe80::d42a:61ff:fe18:5003'] 
May 28 10:04:39.125509 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:04:39.125509 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:04:39.125509 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:04:39.125509 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Updating existing volume attachment record: c0e0e607-3d2a-4660-a249-057a64b90a78 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:04:39.125509 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Object Instance<2641ee65-c9c2-401d-b511-6ecc1247a3ad> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:04:39.125509 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] End _get_guest_xml xml=<domain type="qemu">
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:   <uuid>2641ee65-c9c2-401d-b511-6ecc1247a3ad</uuid>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:   <name>instance-00000022</name>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:       <nova:name>tempest-AttachVolumeTestJSON-server-1119204149</nova:name>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:04:34</nova:creationTime>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:         <nova:user uuid="2c88efa7ed26463d928a0e4228dca6cf">tempest-AttachVolumeTestJSON-1743003640-project-member</nova:user>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:         <nova:project uuid="6f2d040c323b4b948803334de7c8ec44">tempest-AttachVolumeTestJSON-1743003640</nova:project>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:         <nova:port uuid="dc1640f1-0633-403e-8f70-6a6d90053cfc">
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:     <system>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:       <entry name="serial">2641ee65-c9c2-401d-b511-6ecc1247a3ad</entry>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:       <entry name="uuid">2641ee65-c9c2-401d-b511-6ecc1247a3ad</entry>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:     </system>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:   <os>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:   </os>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:   <features>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:   </features>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:   <devices>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk"/>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:     </disk>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk.config"/>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:     </disk>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:       <alias name="ua-d565e760-7309-464b-9f49-2e176d23ac7b"/>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-0"/>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:       <target dev="vdb" bus="virtio"/>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:       <serial>d565e760-7309-464b-9f49-2e176d23ac7b</serial>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:     </disk>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:08:31:07"/>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:       <target dev="tapdc1640f1-06"/>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:     </interface>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/console.log" append="off"/>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:     </serial>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:     <video>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:     </video>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:     </rng>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:   </devices>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]: </domain>
May 28 10:04:39.125509 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:04:39.125509 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:39.125509 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Acquiring lock "refresh_cache-cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:04:39.125509 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:39.125509 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:39.125509 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-11057a2e-9366-463a-a127-e53564e01743 req-59dcf5f9-e203-446d-9806-a9ac2eca6535 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:39.125509 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962679.0148573, 7ca4978c-d8a8-4ca2-81f3-63bc1e397615 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:04:39.125509 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] VM Started (Lifecycle Event)
May 28 10:04:39.125509 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:04:39.125509 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:04:39.125509 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Instance spawned successfully.
May 28 10:04:39.125509 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:39.125509 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:04:39.133365 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2641ee65-c9c2-401d-b511-6ecc1247a3ad {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:04:39.133365 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-11057a2e-9366-463a-a127-e53564e01743 req-59dcf5f9-e203-446d-9806-a9ac2eca6535 service nova] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:04:39.258490 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-11057a2e-9366-463a-a127-e53564e01743 req-59dcf5f9-e203-446d-9806-a9ac2eca6535 service nova] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:04:39.340409 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7dcde66f-a4e4-4af4-a7c8-b41e60e2d041 tempest-ImageDependencyTests-2101881819 tempest-ImageDependencyTests-2101881819-project-member] Lock "ebfe249f-9326-47ad-8e83-b6058b04e1e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.349s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:39.361119 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:39.379999 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Acquiring lock "13636cda-9029-46e5-8305-ee3ea32ce0f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:39.380442 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Lock "13636cda-9029-46e5-8305-ee3ea32ce0f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:39.516109 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:39.521634 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:04:39.526736 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:04:39.565943 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Object Instance<2641ee65-c9c2-401d-b511-6ecc1247a3ad> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:04:39.566314 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:39.611680 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:04:39.672996 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.107s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:39.673484 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:04:39.673791 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:39.762370 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-11057a2e-9366-463a-a127-e53564e01743 req-59dcf5f9-e203-446d-9806-a9ac2eca6535 service nova] Releasing lock "refresh_cache-cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:04:39.762809 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Acquired lock "refresh_cache-cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:04:39.763218 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:04:39.766264 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:39.766930 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Cannot resize image /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:04:39.767179 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lazy-loading 'migration_context' on Instance uuid 2641ee65-c9c2-401d-b511-6ecc1247a3ad {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:04:39.885477 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:04:40.029003 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:04:40.029553 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962680.0292747, 7ca4978c-d8a8-4ca2-81f3-63bc1e397615 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:04:40.029695 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] VM Paused (Lifecycle Event)
May 28 10:04:40.133282 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8218b473-7fbb-4bf5-a140-6d8d6742594d tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 24.527s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:40.275532 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Object Instance<2641ee65-c9c2-401d-b511-6ecc1247a3ad> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:04:40.278426 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:03:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1119204149',display_name='tempest-AttachVolumeTestJSON-server-1119204149',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumetestjson-server-1119204149',id=34,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqD3i0NyKUYk701QA/12tGT7VZdARZzjNaHq8E3bqiWoRx7uJQPxa/ABqLzgddi+LvAs2Iatbj3S16oUNtlAmNjXKSqbg4xg/bifRd6D1DjOpjgoBB+xCgTJwlOZatWFw==',key_name='tempest-keypair-1805479953',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:03:35Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='6f2d040c323b4b948803334de7c8ec44',ramdisk_id='',reservation_id='r-92jv1vdq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1743003640',owner_user_name='tempest-AttachVolumeTestJSON-1743003640-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:04:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c88efa7ed26463d928a0e4228dca6cf',uuid=2641ee65-c9c2-401d-b511-6ecc1247a3ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "address": "fa:16:3e:08:31:07", "network": {"id": "cfc0fcd2-826d-4851-bc3e-3f0433d6fbce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1771427851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f2d040c323b4b948803334de7c8ec44", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc1640f1-06", "ovs_interfaceid": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:04:40.282123 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Converting VIF {"id": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "address": "fa:16:3e:08:31:07", "network": {"id": "cfc0fcd2-826d-4851-bc3e-3f0433d6fbce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1771427851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f2d040c323b4b948803334de7c8ec44", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc1640f1-06", "ovs_interfaceid": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:04:40.282123 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:31:07,bridge_name='br-int',has_traffic_filtering=True,id=dc1640f1-0633-403e-8f70-6a6d90053cfc,network=Network(cfc0fcd2-826d-4851-bc3e-3f0433d6fbce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc1640f1-06') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:04:40.282123 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:31:07,bridge_name='br-int',has_traffic_filtering=True,id=dc1640f1-0633-403e-8f70-6a6d90053cfc,network=Network(cfc0fcd2-826d-4851-bc3e-3f0433d6fbce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc1640f1-06') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:04:40.282123 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:40.282123 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:04:40.282123 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:04:40.282123 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:40.282123 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f21c2dd4-42f2-524e-a524-26080a0eb1d9', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:04:40.282512 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:40.282782 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:04:40.283846 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:40.285375 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:40.285498 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc1640f1-06, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:04:40.285796 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdc1640f1-06, col_values=(('qos', UUID('db4b10b0-93ce-4bad-9d7f-49923b29794e')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:04:40.285934 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdc1640f1-06, col_values=(('external_ids', {'iface-id': 'dc1640f1-0633-403e-8f70-6a6d90053cfc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:31:07', 'vm-uuid': '2641ee65-c9c2-401d-b511-6ecc1247a3ad'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:04:40.288387 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:40.288387 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:04:40.295887 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:40.296864 np0000001613 nova-compute[98321]: INFO os_vif [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:31:07,bridge_name='br-int',has_traffic_filtering=True,id=dc1640f1-0633-403e-8f70-6a6d90053cfc,network=Network(cfc0fcd2-826d-4851-bc3e-3f0433d6fbce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc1640f1-06')
May 28 10:04:40.355501 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:04:40.466016 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:40.466646 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:40.472426 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:04:40.473251 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Claim successful on node np0000001613
May 28 10:04:40.506668 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-21c2029f-f779-49e0-827a-d3de047101f9 req-457134b2-3499-42da-820b-21ad3c2f45fb service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Received event network-vif-plugged-08d656bf-1f8f-4bd8-b04a-27184a5225d5 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:04:40.506890 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-21c2029f-f779-49e0-827a-d3de047101f9 req-457134b2-3499-42da-820b-21ad3c2f45fb service nova] Acquiring lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:40.507073 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-21c2029f-f779-49e0-827a-d3de047101f9 req-457134b2-3499-42da-820b-21ad3c2f45fb service nova] Lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:40.514013 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-21c2029f-f779-49e0-827a-d3de047101f9 req-457134b2-3499-42da-820b-21ad3c2f45fb service nova] Lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:40.514406 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-21c2029f-f779-49e0-827a-d3de047101f9 req-457134b2-3499-42da-820b-21ad3c2f45fb service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] No waiting events found dispatching network-vif-plugged-08d656bf-1f8f-4bd8-b04a-27184a5225d5 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:04:40.514541 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-21c2029f-f779-49e0-827a-d3de047101f9 req-457134b2-3499-42da-820b-21ad3c2f45fb service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Received unexpected event network-vif-plugged-08d656bf-1f8f-4bd8-b04a-27184a5225d5 for instance with vm_state active and task_state None.
May 28 10:04:40.532712 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:04:40.542711 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962680.542353, 7ca4978c-d8a8-4ca2-81f3-63bc1e397615 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:04:40.542913 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] VM Resumed (Lifecycle Event)
May 28 10:04:40.567188 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:40.759320 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Updating instance_info_cache with network_info: [{"id": "54117267-f360-4419-98f0-5dde7b893041", "address": "fa:16:3e:9c:76:06", "network": {"id": "8b62826e-c5d4-44f9-91d0-3eeb2191966f", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-311879232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e97358e7c52d42788014ffe493108674", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap54117267-f3", "ovs_interfaceid": "54117267-f360-4419-98f0-5dde7b893041", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:04:40.830722 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:40.870967 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:40.934603 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:04:40.935557 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:04:40.935752 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Creating image(s)
May 28 10:04:40.936048 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Did not create local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 10:04:40.936151 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Ensure instance console log exists: /opt/stack/data/nova/instances/cc75b5c9-a7ad-4a7c-aff0-336c8e64b120/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:04:40.936411 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:40.936551 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:40.936661 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:40.983195 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:41.046193 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:04:41.051703 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:04:41.204726 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-98302cd9-6354-40ff-81ae-8f0c21ac8864 req-3bc3297f-783c-4e47-b8b3-8c8107cd8d10 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Received event network-vif-plugged-dc1640f1-0633-403e-8f70-6a6d90053cfc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:04:41.207950 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-98302cd9-6354-40ff-81ae-8f0c21ac8864 req-3bc3297f-783c-4e47-b8b3-8c8107cd8d10 service nova] Acquiring lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:41.207950 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-98302cd9-6354-40ff-81ae-8f0c21ac8864 req-3bc3297f-783c-4e47-b8b3-8c8107cd8d10 service nova] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:41.207950 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-98302cd9-6354-40ff-81ae-8f0c21ac8864 req-3bc3297f-783c-4e47-b8b3-8c8107cd8d10 service nova] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:41.207950 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-98302cd9-6354-40ff-81ae-8f0c21ac8864 req-3bc3297f-783c-4e47-b8b3-8c8107cd8d10 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] No waiting events found dispatching network-vif-plugged-dc1640f1-0633-403e-8f70-6a6d90053cfc {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:04:41.207950 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-98302cd9-6354-40ff-81ae-8f0c21ac8864 req-3bc3297f-783c-4e47-b8b3-8c8107cd8d10 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Received unexpected event network-vif-plugged-dc1640f1-0633-403e-8f70-6a6d90053cfc for instance with vm_state stopped and task_state powering-on.
May 28 10:04:41.262296 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Releasing lock "refresh_cache-cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:04:41.262762 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Instance network_info: |[{"id": "54117267-f360-4419-98f0-5dde7b893041", "address": "fa:16:3e:9c:76:06", "network": {"id": "8b62826e-c5d4-44f9-91d0-3eeb2191966f", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-311879232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e97358e7c52d42788014ffe493108674", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap54117267-f3", "ovs_interfaceid": "54117267-f360-4419-98f0-5dde7b893041", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:04:41.263439 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Start _get_guest_xml network_info=[{"id": "54117267-f360-4419-98f0-5dde7b893041", "address": "fa:16:3e:9c:76:06", "network": {"id": "8b62826e-c5d4-44f9-91d0-3eeb2191966f", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-311879232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e97358e7c52d42788014ffe493108674", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap54117267-f3", "ovs_interfaceid": "54117267-f360-4419-98f0-5dde7b893041", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e', 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bfa5634a-0742-4951-bf49-a141f1f9134e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'cc75b5c9-a7ad-4a7c-aff0-336c8e64b120', 'attached_at': '', 'detached_at': '', 'volume_id': 'bfa5634a-0742-4951-bf49-a141f1f9134e', 'serial': 'bfa5634a-0742-4951-bf49-a141f1f9134e'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'c0e0e607-3d2a-4660-a249-057a64b90a78', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:04:41.268262 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:04:41.268262 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestInstancesWithCinderVolumes-server-25394265', uuid='cc75b5c9-a7ad-4a7c-aff0-336c8e64b120'), owner=OwnerMeta(userid='42a648dd5e4b46a6aa0b2f8e7c8abcc0', username='tempest-TestInstancesWithCinderVolumes-1983686635-project-member', projectid='e97358e7c52d42788014ffe493108674', projectname='tempest-TestInstancesWithCinderVolumes-1983686635'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "54117267-f360-4419-98f0-5dde7b893041", "address": "fa:16:3e:9c:76:06", "network": {"id": "8b62826e-c5d4-44f9-91d0-3eeb2191966f", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-311879232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e97358e7c52d42788014ffe493108674", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap54117267-f3", "ovs_interfaceid": "54117267-f360-4419-98f0-5dde7b893041", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962681.2677565) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:04:41.270299 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:04:41.270299 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:04:41.276084 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:04:41.276084 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:04:41.276084 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:04:41.276084 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:04:41.276084 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:04:41.276084 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:04:41.276084 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:04:41.276084 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:04:41.276084 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:04:41.276084 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:04:41.276084 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:04:41.277008 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:04:41.277315 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:04:41.277554 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:04:41.289132 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:41.306154 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:04:41.306154 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e', 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bfa5634a-0742-4951-bf49-a141f1f9134e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:04:41.306154 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:04:41.306154 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:04:41.306154 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e', 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bfa5634a-0742-4951-bf49-a141f1f9134e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:04:41.316426 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:41.325359 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:04:41.326225 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:04:41.326691 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:04:41.326917 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:04:41.327754 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:04:41.327989 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:04:41.343359 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:04:41.343359 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:41.352650 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:04:41.352650 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:41.360362 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e] added
May 28 10:04:41.360362 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:04:41.360362 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:04:41.360362 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:04:41.360362 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:04:41.360362 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:04:41.360362 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:41.360738 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:04:41.360792 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0338(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:04:41.360974 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:04:41.373642 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e] added
May 28 10:04:41.373642 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:04:41.373642 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:04:41.373642 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:04:41.373642 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:04:41.373642 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:04:41.373642 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:41.373855 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:04:41.374208 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.046(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:04:41.374760 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:04:41.839112 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Removed pending STOPPED event for 2641ee65-c9c2-401d-b511-6ecc1247a3ad due to new event <LifecycleEvent: 1779962681.838727, 2641ee65-c9c2-401d-b511-6ecc1247a3ad => Resumed> {{(pid=98321) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 10:04:41.839317 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962681.838727, 2641ee65-c9c2-401d-b511-6ecc1247a3ad => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:04:41.839438 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] VM Resumed (Lifecycle Event)
May 28 10:04:41.841609 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Instance event wait completed in 0 seconds for  {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:04:41.843566 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Instance rebooted successfully.
May 28 10:04:42.057583 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:04:42.057777 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:04:42.104404 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.00039066699991963105 future=<Future at 0x73c1fc13dd30 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:04:42.104484 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:04:42.104576 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=3.7397713519999343 future=<Future at 0x73c1fc13dac0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:04:42.104640 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=3.739696752999862 future=<Future at 0x73c1fc13dac0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:04:42.344186 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:04:42.353735 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:04:42.362739 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:04:42.375346 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:04:42.382395 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:04:42.382395 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:04:42.395225 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:04:42.395225 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:42.401472 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:42.417342 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:42.426540 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:42.426540 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:42.426540 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:42.426540 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:42.426540 np0000001613 nova-compute[98321]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:42.426540 np0000001613 nova-compute[98321]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:42.426540 np0000001613 nova-compute[98321]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:42.426540 np0000001613 nova-compute[98321]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:42.426540 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:04:42.426735 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:42.426735 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:42.426735 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:42.426735 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:42.426735 np0000001613 nova-compute[98321]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:42.426735 np0000001613 nova-compute[98321]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:42.426735 np0000001613 nova-compute[98321]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:42.426735 np0000001613 nova-compute[98321]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:42.426735 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:04:42.436855 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:42.436855 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:42.436855 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:42.436855 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:42.436855 np0000001613 nova-compute[98321]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:42.436855 np0000001613 nova-compute[98321]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:42.436855 np0000001613 nova-compute[98321]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:42.436855 np0000001613 nova-compute[98321]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:42.436855 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:04:42.438664 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:42.438664 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:42.438664 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:42.438664 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:42.438664 np0000001613 nova-compute[98321]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:42.438664 np0000001613 nova-compute[98321]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:42.438664 np0000001613 nova-compute[98321]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:42.438664 np0000001613 nova-compute[98321]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:42.438664 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:04:42.479079 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e, portal: 192.168.40.100,3260]
May 28 10:04:42.479079 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e, portal: 192.168.40.100,3260] successful.
May 28 10:04:42.479079 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:42.492653 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:42.493391 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e, portal: 192.168.50.100,3260]
May 28 10:04:42.493391 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e, portal: 192.168.50.100,3260] successful.
May 28 10:04:42.493391 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:42.512659 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:42.512659 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:42.512659 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:42.512659 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:42.512659 np0000001613 nova-compute[98321]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:42.512659 np0000001613 nova-compute[98321]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:42.512659 np0000001613 nova-compute[98321]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:42.512659 np0000001613 nova-compute[98321]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:42.512659 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:04:42.512659 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:04:42.512659 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:04:42.514536 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:42.514536 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:42.514536 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:42.514536 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:42.514536 np0000001613 nova-compute[98321]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:42.514536 np0000001613 nova-compute[98321]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:42.514536 np0000001613 nova-compute[98321]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:42.514536 np0000001613 nova-compute[98321]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:42.514536 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:04:42.514536 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:04:42.514536 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:04:42.515056 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.188s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:04:42.515994 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:42.516885 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:04:42.518601 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] HCTL ('9', '-', '-', 0) found on session 79 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:04:42.518745 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:04:42.540977 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:42.540977 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:42.540977 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:42.540977 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:42.540977 np0000001613 nova-compute[98321]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:42.540977 np0000001613 nova-compute[98321]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:42.540977 np0000001613 nova-compute[98321]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:42.540977 np0000001613 nova-compute[98321]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:42.540977 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:04:42.540977 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:04:42.540977 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:04:42.541611 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:42.541611 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:42.541611 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:42.541611 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:42.541611 np0000001613 nova-compute[98321]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:42.541611 np0000001613 nova-compute[98321]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:42.541611 np0000001613 nova-compute[98321]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:42.541611 np0000001613 nova-compute[98321]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:42.541611 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:04:42.541611 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:04:42.541611 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:04:42.542618 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.215s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:04:42.542618 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:04:42.543795 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Searching for a device in session 79 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:04:42.544118 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bfa5634a-0742-4951-bf49-a141f1f9134e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:04:42.546418 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] HCTL ('10', '-', '-', 0) found on session 80 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:04:42.547346 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:04:42.561072 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:04:42.568685 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Searching for a device in session 80 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:04:42.569914 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'bfa5634a-0742-4951-bf49-a141f1f9134e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:04:42.855617 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] During sync_power_state the instance has a pending task (powering-on). Skip.
May 28 10:04:42.855865 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962682.8556325, 2641ee65-c9c2-401d-b511-6ecc1247a3ad => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:04:42.856015 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] VM Started (Lifecycle Event)
May 28 10:04:43.071077 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.605s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:43.071502 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:04:43.293259 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f7e689d8-67b5-4239-b4e4-29eac5e41992 req-7eb165d8-a4d0-43b6-bf34-92d4bd962d67 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Received event network-vif-plugged-dc1640f1-0633-403e-8f70-6a6d90053cfc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:04:43.293400 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f7e689d8-67b5-4239-b4e4-29eac5e41992 req-7eb165d8-a4d0-43b6-bf34-92d4bd962d67 service nova] Acquiring lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:43.293574 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f7e689d8-67b5-4239-b4e4-29eac5e41992 req-7eb165d8-a4d0-43b6-bf34-92d4bd962d67 service nova] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:43.294061 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f7e689d8-67b5-4239-b4e4-29eac5e41992 req-7eb165d8-a4d0-43b6-bf34-92d4bd962d67 service nova] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:43.294061 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f7e689d8-67b5-4239-b4e4-29eac5e41992 req-7eb165d8-a4d0-43b6-bf34-92d4bd962d67 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] No waiting events found dispatching network-vif-plugged-dc1640f1-0633-403e-8f70-6a6d90053cfc {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:04:43.294061 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-f7e689d8-67b5-4239-b4e4-29eac5e41992 req-7eb165d8-a4d0-43b6-bf34-92d4bd962d67 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Received unexpected event network-vif-plugged-dc1640f1-0633-403e-8f70-6a6d90053cfc for instance with vm_state stopped and task_state powering-on.
May 28 10:04:43.328613 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:04:43.356102 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:04:43.356534 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:04:43.356534 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:04:43.356607 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] No VIF found with MAC fa:16:3e:08:31:07, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:04:43.357065 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a05fe5dc-6a0f-49fe-aab3-9483594fcfa7 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:04:43.362261 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:04:43.364454 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:04:43.578783 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:04:43.579113 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:04:43.579417 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:43.579664 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:43.680411 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '23a911d56ea541538a02e7a32dbdbc3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ac26283162468aa1d9b9563114b43f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:04:43.868491 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] During sync_power_state the instance has a pending task (powering-on). Skip.
May 28 10:04:44.083050 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:04:44.358575 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Found WWN 330000000f3a590ef for multipath device dm-2 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:04:44.358575 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.052s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:04:44.358575 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] <== connect_volume: return (3052ms) {'type': 'block', 'scsi_wwn': '330000000f3a590ef', 'path': '/dev/dm-2', 'multipath_id': '330000000f3a590ef'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:04:44.358575 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f3a590ef', 'path': '/dev/dm-2', 'multipath_id': '330000000f3a590ef'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:04:44.398758 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Successfully created port: 7875c736-bfcd-45e2-9f9d-0d17da37b90c {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:04:44.518766 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:44.586845 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:04:44.869216 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:04:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-25394265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testinstanceswithcindervolumes-server-25394265',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/73rGjZoiXNNhQujongkHGynD0AirXLGQk/g8+npo0erwiqqEXQWMY30ctPT/ujHO/Nv9k+SVqd8Z0uXR2+GF28qopPnvQ7igPrN7hSt3mksJiO8rU2cIm58O/wCgL2w==',key_name='tempest-TestInstancesWithCinderVolumes-1387098066',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e97358e7c52d42788014ffe493108674',ramdisk_id='',reservation_id='r-bttiieol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestInstancesWithCinderVolumes-1983686635',owner_user_name='tempest-TestInstancesWithCinderVolumes-1983686635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:04:38Z,user_data=None,user_id='42a648dd5e4b46a6aa0b2f8e7c8abcc0',uuid=cc75b5c9-a7ad-4a7c-aff0-336c8e64b120,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54117267-f360-4419-98f0-5dde7b893041", "address": "fa:16:3e:9c:76:06", "network": {"id": "8b62826e-c5d4-44f9-91d0-3eeb2191966f", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-311879232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e97358e7c52d42788014ffe493108674", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap54117267-f3", "ovs_interfaceid": "54117267-f360-4419-98f0-5dde7b893041", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:04:44.869216 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Converting VIF {"id": "54117267-f360-4419-98f0-5dde7b893041", "address": "fa:16:3e:9c:76:06", "network": {"id": "8b62826e-c5d4-44f9-91d0-3eeb2191966f", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-311879232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e97358e7c52d42788014ffe493108674", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap54117267-f3", "ovs_interfaceid": "54117267-f360-4419-98f0-5dde7b893041", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:04:44.869216 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:76:06,bridge_name='br-int',has_traffic_filtering=True,id=54117267-f360-4419-98f0-5dde7b893041,network=Network(8b62826e-c5d4-44f9-91d0-3eeb2191966f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54117267-f3') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:04:44.869216 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lazy-loading 'pci_devices' on Instance uuid cc75b5c9-a7ad-4a7c-aff0-336c8e64b120 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:04:44.979617 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Successfully updated port: 7875c736-bfcd-45e2-9f9d-0d17da37b90c {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:04:45.037171 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-12f41609-40cd-4bc9-b911-d77f599b88fb req-32cfdade-247c-4c88-83a1-26bf2f17dc61 service nova] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Received event network-changed-7875c736-bfcd-45e2-9f9d-0d17da37b90c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:04:45.037316 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-12f41609-40cd-4bc9-b911-d77f599b88fb req-32cfdade-247c-4c88-83a1-26bf2f17dc61 service nova] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Refreshing instance network info cache due to event network-changed-7875c736-bfcd-45e2-9f9d-0d17da37b90c. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:04:45.037464 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-12f41609-40cd-4bc9-b911-d77f599b88fb req-32cfdade-247c-4c88-83a1-26bf2f17dc61 service nova] Acquiring lock "refresh_cache-13636cda-9029-46e5-8305-ee3ea32ce0f7" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:04:45.037551 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-12f41609-40cd-4bc9-b911-d77f599b88fb req-32cfdade-247c-4c88-83a1-26bf2f17dc61 service nova] Acquired lock "refresh_cache-13636cda-9029-46e5-8305-ee3ea32ce0f7" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:04:45.037660 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-12f41609-40cd-4bc9-b911-d77f599b88fb req-32cfdade-247c-4c88-83a1-26bf2f17dc61 service nova] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Refreshing network info cache for port 7875c736-bfcd-45e2-9f9d-0d17da37b90c {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:04:45.288035 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:45.375584 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] End _get_guest_xml xml=<domain type="qemu">
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:   <uuid>cc75b5c9-a7ad-4a7c-aff0-336c8e64b120</uuid>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:   <name>instance-00000025</name>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:       <nova:name>tempest-TestInstancesWithCinderVolumes-server-25394265</nova:name>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:04:41</nova:creationTime>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:       <nova:image uuid="">
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:         <nova:properties/>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:         <nova:user uuid="42a648dd5e4b46a6aa0b2f8e7c8abcc0">tempest-TestInstancesWithCinderVolumes-1983686635-project-member</nova:user>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:         <nova:project uuid="e97358e7c52d42788014ffe493108674">tempest-TestInstancesWithCinderVolumes-1983686635</nova:project>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:       <nova:root type="volume" uuid=""/>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:         <nova:port uuid="54117267-f360-4419-98f0-5dde7b893041">
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:     <system>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:       <entry name="serial">cc75b5c9-a7ad-4a7c-aff0-336c8e64b120</entry>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:       <entry name="uuid">cc75b5c9-a7ad-4a7c-aff0-336c8e64b120</entry>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:     </system>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:   <os>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:   </os>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:   <features>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:   </features>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:   <devices>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/cc75b5c9-a7ad-4a7c-aff0-336c8e64b120/disk.config"/>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:     </disk>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:       <alias name="ua-bfa5634a-0742-4951-bf49-a141f1f9134e"/>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-2"/>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:       <serial>bfa5634a-0742-4951-bf49-a141f1f9134e</serial>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:     </disk>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:9c:76:06"/>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:       <target dev="tap54117267-f3"/>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:     </interface>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/cc75b5c9-a7ad-4a7c-aff0-336c8e64b120/console.log" append="off"/>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:     </serial>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:     <video>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:     </video>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:     </rng>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:   </devices>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]: </domain>
May 28 10:04:45.375584 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:04:45.375584 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Preparing to wait for external event network-vif-plugged-54117267-f360-4419-98f0-5dde7b893041 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:04:45.375584 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Acquiring lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:45.375584 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:45.375584 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:45.375584 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:04:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-25394265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testinstanceswithcindervolumes-server-25394265',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/73rGjZoiXNNhQujongkHGynD0AirXLGQk/g8+npo0erwiqqEXQWMY30ctPT/ujHO/Nv9k+SVqd8Z0uXR2+GF28qopPnvQ7igPrN7hSt3mksJiO8rU2cIm58O/wCgL2w==',key_name='tempest-TestInstancesWithCinderVolumes-1387098066',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e97358e7c52d42788014ffe493108674',ramdisk_id='',reservation_id='r-bttiieol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestInstancesWithCinderVolumes-1983686635',owner_user_name='tempest-TestInstancesWithCinderVolumes-1983686635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:04:38Z,user_data=None,user_id='42a648dd5e4b46a6aa0b2f8e7c8abcc0',uuid=cc75b5c9-a7ad-4a7c-aff0-336c8e64b120,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54117267-f360-4419-98f0-5dde7b893041", "address": "fa:16:3e:9c:76:06", "network": {"id": "8b62826e-c5d4-44f9-91d0-3eeb2191966f", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-311879232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e97358e7c52d42788014ffe493108674", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap54117267-f3", "ovs_interfaceid": "54117267-f360-4419-98f0-5dde7b893041", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:04:45.375584 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Converting VIF {"id": "54117267-f360-4419-98f0-5dde7b893041", "address": "fa:16:3e:9c:76:06", "network": {"id": "8b62826e-c5d4-44f9-91d0-3eeb2191966f", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-311879232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e97358e7c52d42788014ffe493108674", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap54117267-f3", "ovs_interfaceid": "54117267-f360-4419-98f0-5dde7b893041", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:04:45.375584 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:76:06,bridge_name='br-int',has_traffic_filtering=True,id=54117267-f360-4419-98f0-5dde7b893041,network=Network(8b62826e-c5d4-44f9-91d0-3eeb2191966f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54117267-f3') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:04:45.375584 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:76:06,bridge_name='br-int',has_traffic_filtering=True,id=54117267-f360-4419-98f0-5dde7b893041,network=Network(8b62826e-c5d4-44f9-91d0-3eeb2191966f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54117267-f3') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:04:45.378609 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:45.378609 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:04:45.378609 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:04:45.380323 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:45.380463 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'faf6b6a9-5d4e-5201-84b0-40355d1d8d99', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:04:45.381146 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:45.381722 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:04:45.383096 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:45.384793 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:45.384938 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54117267-f3, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:04:45.385232 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap54117267-f3, col_values=(('qos', UUID('f7bdb395-a4e2-4242-a29d-17fb1d3272be')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:04:45.385367 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap54117267-f3, col_values=(('external_ids', {'iface-id': '54117267-f360-4419-98f0-5dde7b893041', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:76:06', 'vm-uuid': 'cc75b5c9-a7ad-4a7c-aff0-336c8e64b120'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:04:45.386047 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:45.387452 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:04:45.392731 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:45.394072 np0000001613 nova-compute[98321]: INFO os_vif [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:76:06,bridge_name='br-int',has_traffic_filtering=True,id=54117267-f360-4419-98f0-5dde7b893041,network=Network(8b62826e-c5d4-44f9-91d0-3eeb2191966f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54117267-f3')
May 28 10:04:45.485704 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Acquiring lock "refresh_cache-13636cda-9029-46e5-8305-ee3ea32ce0f7" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:04:45.541977 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-12f41609-40cd-4bc9-b911-d77f599b88fb req-32cfdade-247c-4c88-83a1-26bf2f17dc61 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:45.601891 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:04:45.603099 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:04:45.603417 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Creating image(s)
May 28 10:04:45.605722 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Acquiring lock "/opt/stack/data/nova/instances/13636cda-9029-46e5-8305-ee3ea32ce0f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:45.605935 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Lock "/opt/stack/data/nova/instances/13636cda-9029-46e5-8305-ee3ea32ce0f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:45.606527 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Lock "/opt/stack/data/nova/instances/13636cda-9029-46e5-8305-ee3ea32ce0f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:45.608357 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:04:45.613349 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:04:45.613349 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:45.644550 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-12f41609-40cd-4bc9-b911-d77f599b88fb req-32cfdade-247c-4c88-83a1-26bf2f17dc61 service nova] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:04:45.702182 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.089s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:45.702582 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:45.703051 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:45.703476 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:04:45.706118 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:04:45.706692 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:45.800592 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.094s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:45.802059 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/13636cda-9029-46e5-8305-ee3ea32ce0f7/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:45.828061 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-12f41609-40cd-4bc9-b911-d77f599b88fb req-32cfdade-247c-4c88-83a1-26bf2f17dc61 service nova] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:04:45.844989 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0005660950000674347 future=<Future at 0x73c1fc13dac0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:04:45.845186 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:04:45.845834 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] Emitting event <LifecycleEvent: 1779962670.8442845, ebfe249f-9326-47ad-8e83-b6058b04e1e5 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:04:45.846126 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] VM Stopped (Lifecycle Event)
May 28 10:04:45.856855 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/13636cda-9029-46e5-8305-ee3ea32ce0f7/disk 1073741824" returned: 0 in 0.056s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:45.857124 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.154s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:45.857438 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:45.949227 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.091s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:45.949790 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Checking if we can resize image /opt/stack/data/nova/instances/13636cda-9029-46e5-8305-ee3ea32ce0f7/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:04:45.950151 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13636cda-9029-46e5-8305-ee3ea32ce0f7/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:46.044742 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13636cda-9029-46e5-8305-ee3ea32ce0f7/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:46.045554 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Cannot resize image /opt/stack/data/nova/instances/13636cda-9029-46e5-8305-ee3ea32ce0f7/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:04:46.046298 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:04:46.046413 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Ensure instance console log exists: /opt/stack/data/nova/instances/13636cda-9029-46e5-8305-ee3ea32ce0f7/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:04:46.046820 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:46.047400 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:46.047400 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:46.332649 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-12f41609-40cd-4bc9-b911-d77f599b88fb req-32cfdade-247c-4c88-83a1-26bf2f17dc61 service nova] Releasing lock "refresh_cache-13636cda-9029-46e5-8305-ee3ea32ce0f7" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:04:46.333523 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Acquired lock "refresh_cache-13636cda-9029-46e5-8305-ee3ea32ce0f7" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:04:46.333842 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:04:46.356369 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-6931fd91-69b9-4725-95f7-ccf79066a7f2 tempest-ServersNegativeTestJSON-177803216 tempest-ServersNegativeTestJSON-177803216-project-member] [instance: ebfe249f-9326-47ad-8e83-b6058b04e1e5] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:04:46.793181 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:04:46.793596 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Cleaning up deleted instances {{(pid=98321) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
May 28 10:04:46.807837 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:46.917692 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:04:46.917692 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:04:46.917692 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] No VIF found with MAC fa:16:3e:9c:76:06, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:04:46.918303 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Using config drive
May 28 10:04:46.942847 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:04:47.168036 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:47.297762 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] There are 0 instances to clean {{(pid=98321) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
May 28 10:04:47.298499 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.49 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:04:47.395613 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Updating instance_info_cache with network_info: [{"id": "7875c736-bfcd-45e2-9f9d-0d17da37b90c", "address": "fa:16:3e:a8:ba:ad", "network": {"id": "b952947c-9dfe-4b64-ba35-8ea7334cf4dd", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1051915270-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7ac26283162468aa1d9b9563114b43f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7875c736-bf", "ovs_interfaceid": "7875c736-bfcd-45e2-9f9d-0d17da37b90c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:04:47.426268 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:47.794239 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Creating config drive at /opt/stack/data/nova/instances/cc75b5c9-a7ad-4a7c-aff0-336c8e64b120/disk.config
May 28 10:04:47.796833 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/cc75b5c9-a7ad-4a7c-aff0-336c8e64b120/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5d4hkuj1 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:47.871473 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/cc75b5c9-a7ad-4a7c-aff0-336c8e64b120/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5d4hkuj1" returned: 0 in 0.074s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:47.898649 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Releasing lock "refresh_cache-13636cda-9029-46e5-8305-ee3ea32ce0f7" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:04:47.899566 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Instance network_info: |[{"id": "7875c736-bfcd-45e2-9f9d-0d17da37b90c", "address": "fa:16:3e:a8:ba:ad", "network": {"id": "b952947c-9dfe-4b64-ba35-8ea7334cf4dd", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1051915270-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7ac26283162468aa1d9b9563114b43f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7875c736-bf", "ovs_interfaceid": "7875c736-bfcd-45e2-9f9d-0d17da37b90c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:04:47.902724 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Start _get_guest_xml network_info=[{"id": "7875c736-bfcd-45e2-9f9d-0d17da37b90c", "address": "fa:16:3e:a8:ba:ad", "network": {"id": "b952947c-9dfe-4b64-ba35-8ea7334cf4dd", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1051915270-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7ac26283162468aa1d9b9563114b43f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7875c736-bf", "ovs_interfaceid": "7875c736-bfcd-45e2-9f9d-0d17da37b90c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:04:47.916377 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:04:47.918383 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-VolumesExtendAttachedTest-instance-1645121584', uuid='13636cda-9029-46e5-8305-ee3ea32ce0f7'), owner=OwnerMeta(userid='23a911d56ea541538a02e7a32dbdbc3c', username='tempest-VolumesExtendAttachedTest-1071205551-project-member', projectid='f7ac26283162468aa1d9b9563114b43f', projectname='tempest-VolumesExtendAttachedTest-1071205551'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7875c736-bfcd-45e2-9f9d-0d17da37b90c", "address": "fa:16:3e:a8:ba:ad", "network": {"id": "b952947c-9dfe-4b64-ba35-8ea7334cf4dd", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1051915270-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7ac26283162468aa1d9b9563114b43f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7875c736-bf", "ovs_interfaceid": "7875c736-bfcd-45e2-9f9d-0d17da37b90c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962687.917835) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:04:47.923455 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:04:47.924374 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:04:47.927250 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:04:47.927547 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:04:47.929075 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:04:47.929533 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:04:47.930590 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:04:47.930790 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:04:47.932199 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:04:47.933177 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:04:47.933357 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:04:47.933605 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:04:47.935207 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:04:47.935469 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:04:47.935648 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:04:47.935830 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:04:47.955774 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:04:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-1645121584',display_name='tempest-VolumesExtendAttachedTest-instance-1645121584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumesextendattachedtest-instance-1645121584',id=38,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiPfw2oeOh6wfeXCY6HJehDBOgghVXL0YQ8baRxSQUTlv4N6rLJXoyb4vDj0LVZfuesDpMEMbp2Y9KK64Ur3pxa0SmbFrNgX/36knFWVLl73/9Bu7shRQFBqcJ3+oHW9Q==',key_name='tempest-keypair-655911425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7ac26283162468aa1d9b9563114b43f',ramdisk_id='',reservation_id='r-8hq7p29u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesExtendAttachedTest-1071205551',owner_user_name='tempest-VolumesExtendAttachedTest-1071205551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:04:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23a911d56ea541538a02e7a32dbdbc3c',uuid=13636cda-9029-46e5-8305-ee3ea32ce0f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7875c736-bfcd-45e2-9f9d-0d17da37b90c", "address": "fa:16:3e:a8:ba:ad", "network": {"id": "b952947c-9dfe-4b64-ba35-8ea7334cf4dd", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1051915270-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7ac26283162468aa1d9b9563114b43f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7875c736-bf", "ovs_interfaceid": "7875c736-bfcd-45e2-9f9d-0d17da37b90c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:04:47.956932 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Converting VIF {"id": "7875c736-bfcd-45e2-9f9d-0d17da37b90c", "address": "fa:16:3e:a8:ba:ad", "network": {"id": "b952947c-9dfe-4b64-ba35-8ea7334cf4dd", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1051915270-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7ac26283162468aa1d9b9563114b43f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7875c736-bf", "ovs_interfaceid": "7875c736-bfcd-45e2-9f9d-0d17da37b90c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:04:47.956932 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:ba:ad,bridge_name='br-int',has_traffic_filtering=True,id=7875c736-bfcd-45e2-9f9d-0d17da37b90c,network=Network(b952947c-9dfe-4b64-ba35-8ea7334cf4dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7875c736-bf') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:04:47.957899 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Lazy-loading 'pci_devices' on Instance uuid 13636cda-9029-46e5-8305-ee3ea32ce0f7 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:04:48.377627 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:48.407977 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:48.461548 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] End _get_guest_xml xml=<domain type="qemu">
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:   <uuid>13636cda-9029-46e5-8305-ee3ea32ce0f7</uuid>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:   <name>instance-00000026</name>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:       <nova:name>tempest-VolumesExtendAttachedTest-instance-1645121584</nova:name>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:04:47</nova:creationTime>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:         <nova:user uuid="23a911d56ea541538a02e7a32dbdbc3c">tempest-VolumesExtendAttachedTest-1071205551-project-member</nova:user>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:         <nova:project uuid="f7ac26283162468aa1d9b9563114b43f">tempest-VolumesExtendAttachedTest-1071205551</nova:project>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:         <nova:port uuid="7875c736-bfcd-45e2-9f9d-0d17da37b90c">
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:     <system>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:       <entry name="serial">13636cda-9029-46e5-8305-ee3ea32ce0f7</entry>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:       <entry name="uuid">13636cda-9029-46e5-8305-ee3ea32ce0f7</entry>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:     </system>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:   <os>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:   </os>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:   <features>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:   </features>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:   <devices>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/13636cda-9029-46e5-8305-ee3ea32ce0f7/disk"/>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:     </disk>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/13636cda-9029-46e5-8305-ee3ea32ce0f7/disk.config"/>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:     </disk>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:a8:ba:ad"/>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:       <target dev="tap7875c736-bf"/>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:     </interface>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/13636cda-9029-46e5-8305-ee3ea32ce0f7/console.log" append="off"/>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:     </serial>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:     <video>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:     </video>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:     </rng>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:   </devices>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]: </domain>
May 28 10:04:48.461548 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:04:48.465193 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Preparing to wait for external event network-vif-plugged-7875c736-bfcd-45e2-9f9d-0d17da37b90c {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:04:48.465193 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Acquiring lock "13636cda-9029-46e5-8305-ee3ea32ce0f7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:48.465193 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Lock "13636cda-9029-46e5-8305-ee3ea32ce0f7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:48.465193 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Lock "13636cda-9029-46e5-8305-ee3ea32ce0f7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:48.465193 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:04:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-1645121584',display_name='tempest-VolumesExtendAttachedTest-instance-1645121584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumesextendattachedtest-instance-1645121584',id=38,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiPfw2oeOh6wfeXCY6HJehDBOgghVXL0YQ8baRxSQUTlv4N6rLJXoyb4vDj0LVZfuesDpMEMbp2Y9KK64Ur3pxa0SmbFrNgX/36knFWVLl73/9Bu7shRQFBqcJ3+oHW9Q==',key_name='tempest-keypair-655911425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7ac26283162468aa1d9b9563114b43f',ramdisk_id='',reservation_id='r-8hq7p29u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesExtendAttachedTest-1071205551',owner_user_name='tempest-VolumesExtendAttachedTest-1071205551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:04:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23a911d56ea541538a02e7a32dbdbc3c',uuid=13636cda-9029-46e5-8305-ee3ea32ce0f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7875c736-bfcd-45e2-9f9d-0d17da37b90c", "address": "fa:16:3e:a8:ba:ad", "network": {"id": "b952947c-9dfe-4b64-ba35-8ea7334cf4dd", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1051915270-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7ac26283162468aa1d9b9563114b43f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7875c736-bf", "ovs_interfaceid": "7875c736-bfcd-45e2-9f9d-0d17da37b90c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:04:48.465193 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Converting VIF {"id": "7875c736-bfcd-45e2-9f9d-0d17da37b90c", "address": "fa:16:3e:a8:ba:ad", "network": {"id": "b952947c-9dfe-4b64-ba35-8ea7334cf4dd", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1051915270-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7ac26283162468aa1d9b9563114b43f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7875c736-bf", "ovs_interfaceid": "7875c736-bfcd-45e2-9f9d-0d17da37b90c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:04:48.465193 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:ba:ad,bridge_name='br-int',has_traffic_filtering=True,id=7875c736-bfcd-45e2-9f9d-0d17da37b90c,network=Network(b952947c-9dfe-4b64-ba35-8ea7334cf4dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7875c736-bf') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:04:48.465193 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:ba:ad,bridge_name='br-int',has_traffic_filtering=True,id=7875c736-bfcd-45e2-9f9d-0d17da37b90c,network=Network(b952947c-9dfe-4b64-ba35-8ea7334cf4dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7875c736-bf') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:04:48.466059 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:48.466386 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:04:48.466685 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:04:48.470538 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:48.470747 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b6ba78f2-eb16-5df1-b121-bb30a9ce3d12', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:04:48.471542 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:48.472443 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:04:48.475471 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:48.483005 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:48.483005 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7875c736-bf, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:04:48.483005 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7875c736-bf, col_values=(('qos', UUID('2bd4a350-8dc6-48cd-a83f-90ce3f1550f2')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:04:48.483005 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7875c736-bf, col_values=(('external_ids', {'iface-id': '7875c736-bfcd-45e2-9f9d-0d17da37b90c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:ba:ad', 'vm-uuid': '13636cda-9029-46e5-8305-ee3ea32ce0f7'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:04:48.485213 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:48.486721 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:04:48.493601 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:48.495461 np0000001613 nova-compute[98321]: INFO os_vif [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:ba:ad,bridge_name='br-int',has_traffic_filtering=True,id=7875c736-bfcd-45e2-9f9d-0d17da37b90c,network=Network(b952947c-9dfe-4b64-ba35-8ea7334cf4dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7875c736-bf')
May 28 10:04:48.531531 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-21eb75ab-dc10-4894-85df-65e6e64ac1d6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "36fde791-779f-42a8-9aef-87eafbbe0370" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:48.531721 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-21eb75ab-dc10-4894-85df-65e6e64ac1d6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "36fde791-779f-42a8-9aef-87eafbbe0370" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:48.594538 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-1667af56-c385-4a3d-b8a3-bf490955f61c req-27538539-bdee-4992-84a5-cac42c3aec90 service nova] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Received event network-vif-plugged-54117267-f360-4419-98f0-5dde7b893041 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:04:48.594538 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1667af56-c385-4a3d-b8a3-bf490955f61c req-27538539-bdee-4992-84a5-cac42c3aec90 service nova] Acquiring lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:48.594538 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1667af56-c385-4a3d-b8a3-bf490955f61c req-27538539-bdee-4992-84a5-cac42c3aec90 service nova] Lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:48.594538 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1667af56-c385-4a3d-b8a3-bf490955f61c req-27538539-bdee-4992-84a5-cac42c3aec90 service nova] Lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:48.594538 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-1667af56-c385-4a3d-b8a3-bf490955f61c req-27538539-bdee-4992-84a5-cac42c3aec90 service nova] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Processing event network-vif-plugged-54117267-f360-4419-98f0-5dde7b893041 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:04:48.794152 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:04:48.794364 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98321) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
May 28 10:04:48.800290 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:48.807277 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:48.811234 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:48.839894 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:48.848213 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:48.974418 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:49.038944 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-21eb75ab-dc10-4894-85df-65e6e64ac1d6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Detaching volume e8aeb4ed-7738-4054-b253-74e118c84fab
May 28 10:04:49.107914 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-21eb75ab-dc10-4894-85df-65e6e64ac1d6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Attempting to driver detach volume e8aeb4ed-7738-4054-b253-74e118c84fab from mountpoint /dev/vdb
May 28 10:04:49.117227 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-21eb75ab-dc10-4894-85df-65e6e64ac1d6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Found disk vdb by alias ua-e8aeb4ed-7738-4054-b253-74e118c84fab {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:04:49.122022 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-21eb75ab-dc10-4894-85df-65e6e64ac1d6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Found disk vdb by alias ua-e8aeb4ed-7738-4054-b253-74e118c84fab {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:04:49.122181 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-21eb75ab-dc10-4894-85df-65e6e64ac1d6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Attempting to detach device vdb from instance 36fde791-779f-42a8-9aef-87eafbbe0370 from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 10:04:49.122469 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-21eb75ab-dc10-4894-85df-65e6e64ac1d6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:04:49.122469 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:04:49.122469 np0000001613 nova-compute[98321]:   <alias name="ua-e8aeb4ed-7738-4054-b253-74e118c84fab"/>
May 28 10:04:49.122469 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-1"/>
May 28 10:04:49.122469 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:04:49.122469 np0000001613 nova-compute[98321]:   <serial>e8aeb4ed-7738-4054-b253-74e118c84fab</serial>
May 28 10:04:49.122469 np0000001613 nova-compute[98321]:   <shareable/>
May 28 10:04:49.122469 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 10:04:49.122469 np0000001613 nova-compute[98321]: </disk>
May 28 10:04:49.122469 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:04:49.130056 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-21eb75ab-dc10-4894-85df-65e6e64ac1d6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Successfully detached device vdb from instance 36fde791-779f-42a8-9aef-87eafbbe0370 from the persistent domain config.
May 28 10:04:49.130196 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-21eb75ab-dc10-4894-85df-65e6e64ac1d6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] (1/8): Attempting to detach device vdb with device alias ua-e8aeb4ed-7738-4054-b253-74e118c84fab from instance 36fde791-779f-42a8-9aef-87eafbbe0370 from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 10:04:49.130431 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-21eb75ab-dc10-4894-85df-65e6e64ac1d6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:04:49.130431 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:04:49.130431 np0000001613 nova-compute[98321]:   <alias name="ua-e8aeb4ed-7738-4054-b253-74e118c84fab"/>
May 28 10:04:49.130431 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-1"/>
May 28 10:04:49.130431 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:04:49.130431 np0000001613 nova-compute[98321]:   <serial>e8aeb4ed-7738-4054-b253-74e118c84fab</serial>
May 28 10:04:49.130431 np0000001613 nova-compute[98321]:   <shareable/>
May 28 10:04:49.130431 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 10:04:49.130431 np0000001613 nova-compute[98321]: </disk>
May 28 10:04:49.130431 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:04:49.296773 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:04:49.361617 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962689.3612127, cc75b5c9-a7ad-4a7c-aff0-336c8e64b120 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:04:49.361902 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] VM Started (Lifecycle Event)
May 28 10:04:49.363270 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:04:49.366700 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:04:49.370669 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Instance spawned successfully.
May 28 10:04:49.371765 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:04:49.536440 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:49.722195 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-21eb75ab-dc10-4894-85df-65e6e64ac1d6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-e8aeb4ed-7738-4054-b253-74e118c84fab for instance 36fde791-779f-42a8-9aef-87eafbbe0370 {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 10:04:49.866419 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:04:49.872121 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:04:49.881743 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:04:49.882041 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:04:49.882603 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:04:49.882779 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:04:49.883108 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:04:49.883416 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:04:50.021401 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:04:50.021401 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:04:50.021401 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] No VIF found with MAC fa:16:3e:a8:ba:ad, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:04:50.021401 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Using config drive
May 28 10:04:50.381648 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:04:50.381844 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962690.381673, cc75b5c9-a7ad-4a7c-aff0-336c8e64b120 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:04:50.381955 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] VM Paused (Lifecycle Event)
May 28 10:04:50.399619 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Took 9.46 seconds to spawn the instance on the hypervisor.
May 28 10:04:50.399872 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:04:50.526033 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:50.686341 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Creating config drive at /opt/stack/data/nova/instances/13636cda-9029-46e5-8305-ee3ea32ce0f7/disk.config
May 28 10:04:50.691708 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/13636cda-9029-46e5-8305-ee3ea32ce0f7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdx07bnqa {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:50.719038 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-559a5c7f-9724-44e8-8d79-4e042203cd88 req-9d9636af-e08a-4b3b-9107-55412be6cbc6 service nova] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Received event network-vif-plugged-54117267-f360-4419-98f0-5dde7b893041 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:04:50.719374 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-559a5c7f-9724-44e8-8d79-4e042203cd88 req-9d9636af-e08a-4b3b-9107-55412be6cbc6 service nova] Acquiring lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:50.719694 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-559a5c7f-9724-44e8-8d79-4e042203cd88 req-9d9636af-e08a-4b3b-9107-55412be6cbc6 service nova] Lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:50.720353 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-559a5c7f-9724-44e8-8d79-4e042203cd88 req-9d9636af-e08a-4b3b-9107-55412be6cbc6 service nova] Lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:50.720564 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-559a5c7f-9724-44e8-8d79-4e042203cd88 req-9d9636af-e08a-4b3b-9107-55412be6cbc6 service nova] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] No waiting events found dispatching network-vif-plugged-54117267-f360-4419-98f0-5dde7b893041 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:04:50.720841 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-559a5c7f-9724-44e8-8d79-4e042203cd88 req-9d9636af-e08a-4b3b-9107-55412be6cbc6 service nova] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Received unexpected event network-vif-plugged-54117267-f360-4419-98f0-5dde7b893041 for instance with vm_state active and task_state None.
May 28 10:04:50.752441 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/13636cda-9029-46e5-8305-ee3ea32ce0f7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdx07bnqa" returned: 0 in 0.061s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:50.887190 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:04:50.889593 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962690.8892944, cc75b5c9-a7ad-4a7c-aff0-336c8e64b120 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:04:50.889731 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] VM Resumed (Lifecycle Event)
May 28 10:04:50.921408 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Took 16.92 seconds to build instance.
May 28 10:04:51.242257 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:51.242713 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:51.279213 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:51.281374 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:51.298107 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:04:51.298862 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.49 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:04:51.395214 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:04:51.398661 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:04:51.405789 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:51.422613 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.431s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:51.735311 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:51.737231 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:51.744940 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:51.747331 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:51.783562 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:51.789908 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:04:51.789908 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:04:51.792278 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:04:51.792675 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:04:51.901020 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779962691.9005325, 36fde791-779f-42a8-9aef-87eafbbe0370 => ua-e8aeb4ed-7738-4054-b253-74e118c84fab> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 10:04:51.906182 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-21eb75ab-dc10-4894-85df-65e6e64ac1d6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Successfully detached device vdb from instance 36fde791-779f-42a8-9aef-87eafbbe0370 from the live domain config.
May 28 10:04:52.303018 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:52.303237 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:52.303285 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:52.303486 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Auditing locally available compute resources for np0000001613 (node: np0000001613) {{(pid=98321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 10:04:52.365353 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962692.3649049, 13636cda-9029-46e5-8305-ee3ea32ce0f7 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:04:52.365474 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] VM Started (Lifecycle Event)
May 28 10:04:52.469234 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-21eb75ab-dc10-4894-85df-65e6e64ac1d6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Detected multiple connections on this host for volume: e8aeb4ed-7738-4054-b253-74e118c84fab, skipping target disconnect.
May 28 10:04:52.778254 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-41644492-ff86-4b63-a06e-2f8039fabf60 req-fcb07a5e-08a2-4593-b5f7-7825bdc89c21 service nova] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Received event network-vif-plugged-7875c736-bfcd-45e2-9f9d-0d17da37b90c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:04:52.778390 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-41644492-ff86-4b63-a06e-2f8039fabf60 req-fcb07a5e-08a2-4593-b5f7-7825bdc89c21 service nova] Acquiring lock "13636cda-9029-46e5-8305-ee3ea32ce0f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:52.778555 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-41644492-ff86-4b63-a06e-2f8039fabf60 req-fcb07a5e-08a2-4593-b5f7-7825bdc89c21 service nova] Lock "13636cda-9029-46e5-8305-ee3ea32ce0f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:52.778687 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-41644492-ff86-4b63-a06e-2f8039fabf60 req-fcb07a5e-08a2-4593-b5f7-7825bdc89c21 service nova] Lock "13636cda-9029-46e5-8305-ee3ea32ce0f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:52.779122 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-41644492-ff86-4b63-a06e-2f8039fabf60 req-fcb07a5e-08a2-4593-b5f7-7825bdc89c21 service nova] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Processing event network-vif-plugged-7875c736-bfcd-45e2-9f9d-0d17da37b90c {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:04:52.779122 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-41644492-ff86-4b63-a06e-2f8039fabf60 req-fcb07a5e-08a2-4593-b5f7-7825bdc89c21 service nova] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Received event network-vif-plugged-7875c736-bfcd-45e2-9f9d-0d17da37b90c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:04:52.779122 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-41644492-ff86-4b63-a06e-2f8039fabf60 req-fcb07a5e-08a2-4593-b5f7-7825bdc89c21 service nova] Acquiring lock "13636cda-9029-46e5-8305-ee3ea32ce0f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:52.779260 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-41644492-ff86-4b63-a06e-2f8039fabf60 req-fcb07a5e-08a2-4593-b5f7-7825bdc89c21 service nova] Lock "13636cda-9029-46e5-8305-ee3ea32ce0f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:52.779450 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-41644492-ff86-4b63-a06e-2f8039fabf60 req-fcb07a5e-08a2-4593-b5f7-7825bdc89c21 service nova] Lock "13636cda-9029-46e5-8305-ee3ea32ce0f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:52.779554 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-41644492-ff86-4b63-a06e-2f8039fabf60 req-fcb07a5e-08a2-4593-b5f7-7825bdc89c21 service nova] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] No waiting events found dispatching network-vif-plugged-7875c736-bfcd-45e2-9f9d-0d17da37b90c {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:04:52.780274 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-41644492-ff86-4b63-a06e-2f8039fabf60 req-fcb07a5e-08a2-4593-b5f7-7825bdc89c21 service nova] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Received unexpected event network-vif-plugged-7875c736-bfcd-45e2-9f9d-0d17da37b90c for instance with vm_state building and task_state spawning.
May 28 10:04:52.781585 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:04:52.785588 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:04:52.790609 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Instance spawned successfully.
May 28 10:04:52.794855 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:04:52.870653 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:04:52.872910 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:04:53.067022 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-21eb75ab-dc10-4894-85df-65e6e64ac1d6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lazy-loading 'flavor' on Instance uuid 36fde791-779f-42a8-9aef-87eafbbe0370 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:04:53.284152 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:53.302298 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:04:53.302503 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:04:53.302999 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:04:53.303431 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:04:53.303566 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:04:53.304878 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:04:53.368182 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:53.385181 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:04:53.386910 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962693.3864963, 13636cda-9029-46e5-8305-ee3ea32ce0f7 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:04:53.387142 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] VM Paused (Lifecycle Event)
May 28 10:04:53.476745 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:53.479319 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:53.499543 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:53.595482 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f80a6ee9-9a55-40ce-b53a-7758522074fb req-14d59228-e697-4af9-8782-28da39f3b344 service nova] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Received event network-changed-54117267-f360-4419-98f0-5dde7b893041 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:04:53.596237 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f80a6ee9-9a55-40ce-b53a-7758522074fb req-14d59228-e697-4af9-8782-28da39f3b344 service nova] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Refreshing instance network info cache due to event network-changed-54117267-f360-4419-98f0-5dde7b893041. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:04:53.596682 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f80a6ee9-9a55-40ce-b53a-7758522074fb req-14d59228-e697-4af9-8782-28da39f3b344 service nova] Acquiring lock "refresh_cache-cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:04:53.596923 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f80a6ee9-9a55-40ce-b53a-7758522074fb req-14d59228-e697-4af9-8782-28da39f3b344 service nova] Acquired lock "refresh_cache-cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:04:53.597228 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-f80a6ee9-9a55-40ce-b53a-7758522074fb req-14d59228-e697-4af9-8782-28da39f3b344 service nova] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Refreshing network info cache for port 54117267-f360-4419-98f0-5dde7b893041 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:04:53.604731 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:53.613683 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:53.721360 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:53.723753 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:53.812763 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Took 8.21 seconds to spawn the instance on the hypervisor.
May 28 10:04:53.813192 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:04:53.856558 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:53.857450 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:04:53.861590 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3edc00a8-2c60-4c44-acb8-6f4d02114bf0/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:53.895129 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:04:53.910305 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962693.908363, 13636cda-9029-46e5-8305-ee3ea32ce0f7 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:04:53.910305 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] VM Resumed (Lifecycle Event)
May 28 10:04:53.988762 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3edc00a8-2c60-4c44-acb8-6f4d02114bf0/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:53.991034 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3edc00a8-2c60-4c44-acb8-6f4d02114bf0/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:54.081417 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-21eb75ab-dc10-4894-85df-65e6e64ac1d6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "36fde791-779f-42a8-9aef-87eafbbe0370" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.549s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:54.102693 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-f80a6ee9-9a55-40ce-b53a-7758522074fb req-14d59228-e697-4af9-8782-28da39f3b344 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:54.155698 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3edc00a8-2c60-4c44-acb8-6f4d02114bf0/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:54.161517 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13636cda-9029-46e5-8305-ee3ea32ce0f7/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:54.295157 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13636cda-9029-46e5-8305-ee3ea32ce0f7/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:54.295773 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13636cda-9029-46e5-8305-ee3ea32ce0f7/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:54.348065 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Took 13.95 seconds to build instance.
May 28 10:04:54.358471 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "de9742b9-43db-40a6-b635-81d9244fd5e0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:54.358802 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "de9742b9-43db-40a6-b635-81d9244fd5e0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:54.417055 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:04:54.423207 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:04:54.436480 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13636cda-9029-46e5-8305-ee3ea32ce0f7/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:54.453142 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-5 (vda) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:04:54.459806 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:54.538077 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:54.570405 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:54.572258 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:54.713289 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:54.713930 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:04:54.720065 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:54.850428 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b8d4f745-789a-4871-93ff-cb83fadee841 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Lock "13636cda-9029-46e5-8305-ee3ea32ce0f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.470s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:54.856850 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:54.857543 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:54.882849 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Detaching volume e8aeb4ed-7738-4054-b253-74e118c84fab
May 28 10:04:54.899983 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-f80a6ee9-9a55-40ce-b53a-7758522074fb req-14d59228-e697-4af9-8782-28da39f3b344 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:54.995846 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Attempting to driver detach volume e8aeb4ed-7738-4054-b253-74e118c84fab from mountpoint /dev/vdb
May 28 10:04:55.001572 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:55.003805 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-3 (vdc) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:04:55.005683 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Found disk vdb by alias ua-e8aeb4ed-7738-4054-b253-74e118c84fab {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:04:55.007328 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Found disk vdb by alias ua-e8aeb4ed-7738-4054-b253-74e118c84fab {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:04:55.007752 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Attempting to detach device vdb from instance de9742b9-43db-40a6-b635-81d9244fd5e0 from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 10:04:55.009754 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:04:55.009754 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:04:55.009754 np0000001613 nova-compute[98321]:   <alias name="ua-e8aeb4ed-7738-4054-b253-74e118c84fab"/>
May 28 10:04:55.009754 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-1"/>
May 28 10:04:55.009754 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:04:55.009754 np0000001613 nova-compute[98321]:   <serial>e8aeb4ed-7738-4054-b253-74e118c84fab</serial>
May 28 10:04:55.009754 np0000001613 nova-compute[98321]:   <shareable/>
May 28 10:04:55.009754 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 10:04:55.009754 np0000001613 nova-compute[98321]: </disk>
May 28 10:04:55.009754 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:04:55.009754 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:04:55.015185 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:55.031830 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Successfully detached device vdb from instance de9742b9-43db-40a6-b635-81d9244fd5e0 from the persistent domain config.
May 28 10:04:55.033721 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] (1/8): Attempting to detach device vdb with device alias ua-e8aeb4ed-7738-4054-b253-74e118c84fab from instance de9742b9-43db-40a6-b635-81d9244fd5e0 from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 10:04:55.033721 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:04:55.033721 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:04:55.033721 np0000001613 nova-compute[98321]:   <alias name="ua-e8aeb4ed-7738-4054-b253-74e118c84fab"/>
May 28 10:04:55.033721 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-1"/>
May 28 10:04:55.033721 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:04:55.033721 np0000001613 nova-compute[98321]:   <serial>e8aeb4ed-7738-4054-b253-74e118c84fab</serial>
May 28 10:04:55.033721 np0000001613 nova-compute[98321]:   <shareable/>
May 28 10:04:55.033721 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 10:04:55.033721 np0000001613 nova-compute[98321]: </disk>
May 28 10:04:55.033721 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:04:55.139855 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c/disk --force-share --output=json" returned: 0 in 0.125s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:55.141282 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:55.220839 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-f80a6ee9-9a55-40ce-b53a-7758522074fb req-14d59228-e697-4af9-8782-28da39f3b344 service nova] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Updated VIF entry in instance network info cache for port 54117267-f360-4419-98f0-5dde7b893041. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:04:55.221841 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-f80a6ee9-9a55-40ce-b53a-7758522074fb req-14d59228-e697-4af9-8782-28da39f3b344 service nova] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Updating instance_info_cache with network_info: [{"id": "54117267-f360-4419-98f0-5dde7b893041", "address": "fa:16:3e:9c:76:06", "network": {"id": "8b62826e-c5d4-44f9-91d0-3eeb2191966f", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-311879232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e97358e7c52d42788014ffe493108674", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap54117267-f3", "ovs_interfaceid": "54117267-f360-4419-98f0-5dde7b893041", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:04:55.288070 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:55.298847 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:04:55.300384 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:04:55.367959 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "env LANG=C uptime" returned: 0 in 0.067s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:04:55.368486 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Hypervisor/Node resource view: name=np0000001613 free_ram=11575MB free_disk=73.9229850769043GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 10:04:55.369726 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:04:55.369726 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:04:55.725005 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f80a6ee9-9a55-40ce-b53a-7758522074fb req-14d59228-e697-4af9-8782-28da39f3b344 service nova] Releasing lock "refresh_cache-cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:04:56.121914 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c2552ffb-802f-4412-a0e0-2eb0ddd1f29f req-d56e62c0-d763-43cc-889d-a878cd8ab486 service nova] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Received event network-changed-7875c736-bfcd-45e2-9f9d-0d17da37b90c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:04:56.121914 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c2552ffb-802f-4412-a0e0-2eb0ddd1f29f req-d56e62c0-d763-43cc-889d-a878cd8ab486 service nova] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Refreshing instance network info cache due to event network-changed-7875c736-bfcd-45e2-9f9d-0d17da37b90c. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:04:56.121914 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c2552ffb-802f-4412-a0e0-2eb0ddd1f29f req-d56e62c0-d763-43cc-889d-a878cd8ab486 service nova] Acquiring lock "refresh_cache-13636cda-9029-46e5-8305-ee3ea32ce0f7" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:04:56.121914 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c2552ffb-802f-4412-a0e0-2eb0ddd1f29f req-d56e62c0-d763-43cc-889d-a878cd8ab486 service nova] Acquired lock "refresh_cache-13636cda-9029-46e5-8305-ee3ea32ce0f7" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:04:56.121914 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-c2552ffb-802f-4412-a0e0-2eb0ddd1f29f req-d56e62c0-d763-43cc-889d-a878cd8ab486 service nova] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Refreshing network info cache for port 7875c736-bfcd-45e2-9f9d-0d17da37b90c {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:04:56.476028 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 6895009a-024f-4919-9d25-a52905eac818 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:04:56.476637 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance b50eced2-71bf-4448-b2e1-f9657509f34c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:04:56.476637 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 3edc00a8-2c60-4c44-acb8-6f4d02114bf0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:04:56.476637 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 36fde791-779f-42a8-9aef-87eafbbe0370 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:04:56.476637 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 2641ee65-c9c2-401d-b511-6ecc1247a3ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:04:56.476864 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance de9742b9-43db-40a6-b635-81d9244fd5e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:04:56.476864 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 7ca4978c-d8a8-4ca2-81f3-63bc1e397615 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:04:56.480463 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance cc75b5c9-a7ad-4a7c-aff0-336c8e64b120 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:04:56.480463 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 13636cda-9029-46e5-8305-ee3ea32ce0f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:04:56.480463 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 10:04:56.480463 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Final resource view: name=np0000001613 phys_ram=24030MB used_ram=2368MB phys_disk=95GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 10:04:55 up 37 min,  2 users,  load average: 10.21, 8.17, 4.40\n', 'num_instances': '9', 'num_vm_active': '9', 'num_task_None': '9', 'num_os_type_None': '9', 'num_proj_3403b533910644d2b254922fb84b1ac0': '5', 'io_workload': '0', 'num_proj_edd64b0e2ce54cac860344420cf9c5b6': '1', 'num_proj_6f2d040c323b4b948803334de7c8ec44': '1', 'num_proj_e97358e7c52d42788014ffe493108674': '1', 'num_proj_f7ac26283162468aa1d9b9563114b43f': '1'} {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 10:04:56.625380 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-c2552ffb-802f-4412-a0e0-2eb0ddd1f29f req-d56e62c0-d763-43cc-889d-a878cd8ab486 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:57.117774 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:04:57.118252 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:04:57.213455 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-c2552ffb-802f-4412-a0e0-2eb0ddd1f29f req-d56e62c0-d763-43cc-889d-a878cd8ab486 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:57.396634 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-c2552ffb-802f-4412-a0e0-2eb0ddd1f29f req-d56e62c0-d763-43cc-889d-a878cd8ab486 service nova] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Updated VIF entry in instance network info cache for port 7875c736-bfcd-45e2-9f9d-0d17da37b90c. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:04:57.397039 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-c2552ffb-802f-4412-a0e0-2eb0ddd1f29f req-d56e62c0-d763-43cc-889d-a878cd8ab486 service nova] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Updating instance_info_cache with network_info: [{"id": "7875c736-bfcd-45e2-9f9d-0d17da37b90c", "address": "fa:16:3e:a8:ba:ad", "network": {"id": "b952947c-9dfe-4b64-ba35-8ea7334cf4dd", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1051915270-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7ac26283162468aa1d9b9563114b43f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7875c736-bf", "ovs_interfaceid": "7875c736-bfcd-45e2-9f9d-0d17da37b90c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:04:57.621590 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:04:57.899224 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c2552ffb-802f-4412-a0e0-2eb0ddd1f29f req-d56e62c0-d763-43cc-889d-a878cd8ab486 service nova] Releasing lock "refresh_cache-13636cda-9029-46e5-8305-ee3ea32ce0f7" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:04:57.925249 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779962697.9246628, de9742b9-43db-40a6-b635-81d9244fd5e0 => ua-e8aeb4ed-7738-4054-b253-74e118c84fab> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 10:04:57.926664 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-e8aeb4ed-7738-4054-b253-74e118c84fab for instance de9742b9-43db-40a6-b635-81d9244fd5e0 {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 10:04:57.930475 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Successfully detached device vdb from instance de9742b9-43db-40a6-b635-81d9244fd5e0 from the live domain config.
May 28 10:04:57.973712 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:04:57.974206 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e8aeb4ed-7738-4054-b253-74e118c84fab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:04:57.974411 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:04:57.975189 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:04:57.975869 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e8aeb4ed-7738-4054-b253-74e118c84fab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:04:57.976059 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:04:58.012556 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:58.012556 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:58.012556 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:58.012556 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:58.012556 np0000001613 nova-compute[98321]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:58.012556 np0000001613 nova-compute[98321]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:58.012556 np0000001613 nova-compute[98321]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:58.012556 np0000001613 nova-compute[98321]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:58.012556 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:04:58.012556 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:04:58.012556 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:04:58.013096 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:58.013096 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:04:58.013096 np0000001613 nova-compute[98321]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:58.013096 np0000001613 nova-compute[98321]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab (non-flash)
May 28 10:04:58.013096 np0000001613 nova-compute[98321]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:58.013096 np0000001613 nova-compute[98321]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:04:58.013096 np0000001613 nova-compute[98321]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:58.013096 np0000001613 nova-compute[98321]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:04:58.013096 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:04:58.013096 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:04:58.013096 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:04:58.013096 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', '59'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', '60'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7', '75'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7', '76'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b', '77'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b', '78'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e', '79'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e', '80')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:04:58.013096 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', '59')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:04:58.014153 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab', '60')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:04:58.015816 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1f4347420>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab'): ({'sdg'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:04:58.016056 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Removing multipathed devices sdf, sdg {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:04:58.016325 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Flush multipath device 330000000a8b99648 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:04:58.056964 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:04:58.110113 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:04:58.131448 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Compute_service record updated for np0000001613:np0000001613 {{(pid=98321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 10:04:58.132136 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.763s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:04:58.133242 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:04:58.160448 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:04:58.160570 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:04:58.162283 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:04:58.177340 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:04:58.177672 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:04:58.194185 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:58.229079 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5ced2530-17fb-4eba-8dbf-4ae4900a51c4 req-98720dea-2b5b-4db9-965a-f2601bf248b1 service nova] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Received event network-changed-54117267-f360-4419-98f0-5dde7b893041 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:04:58.229239 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5ced2530-17fb-4eba-8dbf-4ae4900a51c4 req-98720dea-2b5b-4db9-965a-f2601bf248b1 service nova] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Refreshing instance network info cache due to event network-changed-54117267-f360-4419-98f0-5dde7b893041. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:04:58.229410 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5ced2530-17fb-4eba-8dbf-4ae4900a51c4 req-98720dea-2b5b-4db9-965a-f2601bf248b1 service nova] Acquiring lock "refresh_cache-cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:04:58.229493 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5ced2530-17fb-4eba-8dbf-4ae4900a51c4 req-98720dea-2b5b-4db9-965a-f2601bf248b1 service nova] Acquired lock "refresh_cache-cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:04:58.230682 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-5ced2530-17fb-4eba-8dbf-4ae4900a51c4 req-98720dea-2b5b-4db9-965a-f2601bf248b1 service nova] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Refreshing network info cache for port 54117267-f360-4419-98f0-5dde7b893041 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:04:58.243564 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab, portal: 192.168.40.100,3260]
May 28 10:04:58.243564 np0000001613 nova-compute[98321]: Logout of [sid: 59, target: iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab, portal: 192.168.40.100,3260] successful.
May 28 10:04:58.243564 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:58.269700 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:58.283221 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:58.324078 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab, portal: 192.168.50.100,3260]
May 28 10:04:58.324078 np0000001613 nova-compute[98321]: Logout of [sid: 60, target: iqn.2023-03.storpool.com:os--volume-e8aeb4ed-7738-4054-b253-74e118c84fab, portal: 192.168.50.100,3260] successful.
May 28 10:04:58.324078 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:58.346570 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:04:58.346854 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:04:58.347031 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] <== disconnect_volume: return (372ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:04:58.347387 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:04:58.502857 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:58.642752 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:04:58.719182 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:58.735541 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-5ced2530-17fb-4eba-8dbf-4ae4900a51c4 req-98720dea-2b5b-4db9-965a-f2601bf248b1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:58.917861 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lazy-loading 'flavor' on Instance uuid de9742b9-43db-40a6-b635-81d9244fd5e0 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:04:59.168583 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:59.344037 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-5ced2530-17fb-4eba-8dbf-4ae4900a51c4 req-98720dea-2b5b-4db9-965a-f2601bf248b1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:04:59.539902 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:04:59.568090 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-5ced2530-17fb-4eba-8dbf-4ae4900a51c4 req-98720dea-2b5b-4db9-965a-f2601bf248b1 service nova] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Updated VIF entry in instance network info cache for port 54117267-f360-4419-98f0-5dde7b893041. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:04:59.568779 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-5ced2530-17fb-4eba-8dbf-4ae4900a51c4 req-98720dea-2b5b-4db9-965a-f2601bf248b1 service nova] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Updating instance_info_cache with network_info: [{"id": "54117267-f360-4419-98f0-5dde7b893041", "address": "fa:16:3e:9c:76:06", "network": {"id": "8b62826e-c5d4-44f9-91d0-3eeb2191966f", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-311879232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e97358e7c52d42788014ffe493108674", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap54117267-f3", "ovs_interfaceid": "54117267-f360-4419-98f0-5dde7b893041", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:04:59.639921 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:04:59.643423 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:04:59.643423 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:04:59.643423 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:04:59.643423 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:04:59.643423 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 10:04:59.643423 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 37.07 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:04:59.930545 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-de2d340e-bed2-48d1-8143-6977578d04fd tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "de9742b9-43db-40a6-b635-81d9244fd5e0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.572s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:00.073542 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5ced2530-17fb-4eba-8dbf-4ae4900a51c4 req-98720dea-2b5b-4db9-965a-f2601bf248b1 service nova] Releasing lock "refresh_cache-cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:05:01.832139 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:02.600363 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "065c91b8-09c2-4ec8-95e8-606247a3c350" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:02.600363 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "065c91b8-09c2-4ec8-95e8-606247a3c350" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:03.104837 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:05:03.483374 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "ca13ce1a-6de6-4923-a01c-e0b822b0e640" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:03.483774 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "ca13ce1a-6de6-4923-a01c-e0b822b0e640" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:03.506969 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:03.662353 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:03.662353 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:03.665687 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:05:03.667936 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Claim successful on node np0000001613
May 28 10:05:03.986755 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:05:04.541659 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:04.571831 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:05.124285 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Acquiring lock "11fd9dae-9efe-4726-abdd-995998d1df87" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:05.124829 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "11fd9dae-9efe-4726-abdd-995998d1df87" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:05.261622 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:05:05.261622 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:05:05.626969 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:05:05.763117 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:05:06.182279 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:06.271540 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.609s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:06.272448 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:05:06.275560 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.700s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:06.281180 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:05:06.281420 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Claim successful on node np0000001613
May 28 10:05:06.786662 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:05:06.789208 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:05:06.791229 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:06.791229 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:06.908797 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '961948be669c4a18a29398d53015f03b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7563a83d33d4bc1a6610ccf53c18dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:05:07.290265 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:05:07.383295 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Successfully created port: 969bbc57-12a6-430b-a878-5424caa1a488 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:05:07.504190 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Refreshing inventories for resource provider ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 28 10:05:07.571416 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Updating ProviderTree inventory for provider ad4de091-3626-4008-ac9a-3e83de44a510 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 28 10:05:07.573652 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Updating inventory in ProviderTree for provider ad4de091-3626-4008-ac9a-3e83de44a510 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 28 10:05:07.634787 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Refreshing aggregate associations for resource provider ad4de091-3626-4008-ac9a-3e83de44a510, aggregates: None {{(pid=98321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 28 10:05:07.697601 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Refreshing trait associations for resource provider ad4de091-3626-4008-ac9a-3e83de44a510, traits: COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ARCH_PPC64LE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ARCH_RISCV64,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_ARCH_S390X,COMPUTE_VOLUME_EXTEND,COMPUTE_ARCH_AARCH64,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOUND_MODEL_SB16,COMPUTE_ACCELERATORS,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_SOUND_MODEL_AC97,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_ARCH_MIPSEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_LAN9118,HW_ARCH_X86_64,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ARCH_X86_64,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOUND_MODEL_USB,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=98321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 28 10:05:07.795780 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:05:08.089503 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Successfully updated port: 969bbc57-12a6-430b-a878-5424caa1a488 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:05:08.154781 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-541f9d09-4304-4fec-8a2b-d15e6cd4d06d req-9bb4b1fb-8422-49fb-a274-c9f92b3edc90 service nova] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Received event network-changed-969bbc57-12a6-430b-a878-5424caa1a488 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:05:08.155336 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-541f9d09-4304-4fec-8a2b-d15e6cd4d06d req-9bb4b1fb-8422-49fb-a274-c9f92b3edc90 service nova] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Refreshing instance network info cache due to event network-changed-969bbc57-12a6-430b-a878-5424caa1a488. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:05:08.155576 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-541f9d09-4304-4fec-8a2b-d15e6cd4d06d req-9bb4b1fb-8422-49fb-a274-c9f92b3edc90 service nova] Acquiring lock "refresh_cache-065c91b8-09c2-4ec8-95e8-606247a3c350" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:05:08.155767 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-541f9d09-4304-4fec-8a2b-d15e6cd4d06d req-9bb4b1fb-8422-49fb-a274-c9f92b3edc90 service nova] Acquired lock "refresh_cache-065c91b8-09c2-4ec8-95e8-606247a3c350" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:05:08.155936 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-541f9d09-4304-4fec-8a2b-d15e6cd4d06d req-9bb4b1fb-8422-49fb-a274-c9f92b3edc90 service nova] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Refreshing network info cache for port 969bbc57-12a6-430b-a878-5424caa1a488 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:05:08.506615 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:05:08.506888 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:05:08.511678 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:08.591110 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "refresh_cache-065c91b8-09c2-4ec8-95e8-606247a3c350" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:05:08.659362 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-541f9d09-4304-4fec-8a2b-d15e6cd4d06d req-9bb4b1fb-8422-49fb-a274-c9f92b3edc90 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:08.755062 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-541f9d09-4304-4fec-8a2b-d15e6cd4d06d req-9bb4b1fb-8422-49fb-a274-c9f92b3edc90 service nova] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:05:08.813718 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:05:08.814740 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:05:08.815043 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Creating image(s)
May 28 10:05:08.815676 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "/opt/stack/data/nova/instances/065c91b8-09c2-4ec8-95e8-606247a3c350/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:08.815884 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "/opt/stack/data/nova/instances/065c91b8-09c2-4ec8-95e8-606247a3c350/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:08.816472 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "/opt/stack/data/nova/instances/065c91b8-09c2-4ec8-95e8-606247a3c350/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:08.817087 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:05:08.820343 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:05:08.821951 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:08.937696 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.115s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:05:08.938239 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:08.938717 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:08.939271 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:05:08.943296 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:05:08.943792 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:08.969316 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-541f9d09-4304-4fec-8a2b-d15e6cd4d06d req-9bb4b1fb-8422-49fb-a274-c9f92b3edc90 service nova] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:05:09.012186 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:05:09.064857 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.121s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:05:09.066645 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/065c91b8-09c2-4ec8-95e8-606247a3c350/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:09.146423 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/065c91b8-09c2-4ec8-95e8-606247a3c350/disk 1073741824" returned: 0 in 0.079s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:05:09.146848 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:09.147339 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:09.229983 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:05:09.277278 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.130s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:05:09.277735 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Checking if we can resize image /opt/stack/data/nova/instances/065c91b8-09c2-4ec8-95e8-606247a3c350/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:05:09.278059 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c91b8-09c2-4ec8-95e8-606247a3c350/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:09.378815 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c91b8-09c2-4ec8-95e8-606247a3c350/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:05:09.379331 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Cannot resize image /opt/stack/data/nova/instances/065c91b8-09c2-4ec8-95e8-606247a3c350/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:05:09.379840 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:05:09.380098 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Ensure instance console log exists: /opt/stack/data/nova/instances/065c91b8-09c2-4ec8-95e8-606247a3c350/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:05:09.380426 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:09.380652 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:09.380904 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:09.474881 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-541f9d09-4304-4fec-8a2b-d15e6cd4d06d req-9bb4b1fb-8422-49fb-a274-c9f92b3edc90 service nova] Releasing lock "refresh_cache-065c91b8-09c2-4ec8-95e8-606247a3c350" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:05:09.475708 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquired lock "refresh_cache-065c91b8-09c2-4ec8-95e8-606247a3c350" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:05:09.475901 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:05:09.525669 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.254s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:09.526389 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:05:09.528539 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.346s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:09.539603 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:05:09.542192 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Claim successful on node np0000001613
May 28 10:05:09.545587 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:10.034353 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:05:10.034866 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:05:10.035126 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:10.035429 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:10.094435 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:05:10.194698 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13481913e22d4bf1a94e1a9a270f5494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3403b533910644d2b254922fb84b1ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:05:10.330295 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:10.521291 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Updating instance_info_cache with network_info: [{"id": "969bbc57-12a6-430b-a878-5424caa1a488", "address": "fa:16:3e:04:ca:46", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap969bbc57-12", "ovs_interfaceid": "969bbc57-12a6-430b-a878-5424caa1a488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:05:10.539076 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:05:11.026033 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Releasing lock "refresh_cache-065c91b8-09c2-4ec8-95e8-606247a3c350" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:05:11.026743 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Instance network_info: |[{"id": "969bbc57-12a6-430b-a878-5424caa1a488", "address": "fa:16:3e:04:ca:46", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap969bbc57-12", "ovs_interfaceid": "969bbc57-12a6-430b-a878-5424caa1a488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:05:11.028644 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Start _get_guest_xml network_info=[{"id": "969bbc57-12a6-430b-a878-5424caa1a488", "address": "fa:16:3e:04:ca:46", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap969bbc57-12", "ovs_interfaceid": "969bbc57-12a6-430b-a878-5424caa1a488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:05:11.032140 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:05:11.033943 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-696493070', uuid='065c91b8-09c2-4ec8-95e8-606247a3c350'), owner=OwnerMeta(userid='961948be669c4a18a29398d53015f03b', username='tempest-TestEncryptedCinderVolumes-297752033-project-member', projectid='c7563a83d33d4bc1a6610ccf53c18dc1', projectname='tempest-TestEncryptedCinderVolumes-297752033'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "969bbc57-12a6-430b-a878-5424caa1a488", "address": "fa:16:3e:04:ca:46", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap969bbc57-12", "ovs_interfaceid": "969bbc57-12a6-430b-a878-5424caa1a488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962711.0332828) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:05:11.035573 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:05:11.036048 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:05:11.036937 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:05:11.037141 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:05:11.038642 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:05:11.039072 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:05:11.039282 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:05:11.039405 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:05:11.039863 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:05:11.040142 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:05:11.040377 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:05:11.040526 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:05:11.040677 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:05:11.040855 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:05:11.041022 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:05:11.041214 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:05:11.047319 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:05:11.066791 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:05:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-696493070',display_name='tempest-TestEncryptedCinderVolumes-server-696493070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testencryptedcindervolumes-server-696493070',id=39,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJkazBN+XtU9598PjGz7eBoPXWM/ePfBYZfDwMI7/O2WWXrMcZkgI/jRBFa3sf7hiaErYuSubjkr2Q6JMmgrZkTXUkmwdFWIRckCd6HyiSCRs5V2WcaCJm2hov7dKcV87Q==',key_name='tempest-keypair-380292068',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7563a83d33d4bc1a6610ccf53c18dc1',ramdisk_id='',reservation_id='r-rymjkr2c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-297752033',owner_user_name='tempest-TestEncryptedCinderVolumes-297752033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:05:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='961948be669c4a18a29398d53015f03b',uuid=065c91b8-09c2-4ec8-95e8-606247a3c350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "969bbc57-12a6-430b-a878-5424caa1a488", "address": "fa:16:3e:04:ca:46", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap969bbc57-12", "ovs_interfaceid": "969bbc57-12a6-430b-a878-5424caa1a488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:05:11.067068 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Converting VIF {"id": "969bbc57-12a6-430b-a878-5424caa1a488", "address": "fa:16:3e:04:ca:46", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap969bbc57-12", "ovs_interfaceid": "969bbc57-12a6-430b-a878-5424caa1a488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:05:11.068705 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:ca:46,bridge_name='br-int',has_traffic_filtering=True,id=969bbc57-12a6-430b-a878-5424caa1a488,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969bbc57-12') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:05:11.068705 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lazy-loading 'pci_devices' on Instance uuid 065c91b8-09c2-4ec8-95e8-606247a3c350 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:05:11.271339 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:05:11.272695 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:05:11.336693 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Successfully created port: c34d17cf-4b65-4629-a8f0-12963b7e883c {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:05:11.563764 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Booting with volume 6422d8fc-c492-4b2b-a83a-1a96e1daddd2 at /dev/vda
May 28 10:05:11.571490 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] End _get_guest_xml xml=<domain type="qemu">
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:   <uuid>065c91b8-09c2-4ec8-95e8-606247a3c350</uuid>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:   <name>instance-00000027</name>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-696493070</nova:name>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:05:11</nova:creationTime>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:         <nova:user uuid="961948be669c4a18a29398d53015f03b">tempest-TestEncryptedCinderVolumes-297752033-project-member</nova:user>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:         <nova:project uuid="c7563a83d33d4bc1a6610ccf53c18dc1">tempest-TestEncryptedCinderVolumes-297752033</nova:project>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:         <nova:port uuid="969bbc57-12a6-430b-a878-5424caa1a488">
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:     <system>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:       <entry name="serial">065c91b8-09c2-4ec8-95e8-606247a3c350</entry>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:       <entry name="uuid">065c91b8-09c2-4ec8-95e8-606247a3c350</entry>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:     </system>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:   <os>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:   </os>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:   <features>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:   </features>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:   <devices>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/065c91b8-09c2-4ec8-95e8-606247a3c350/disk"/>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:     </disk>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/065c91b8-09c2-4ec8-95e8-606247a3c350/disk.config"/>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:     </disk>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:04:ca:46"/>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:       <target dev="tap969bbc57-12"/>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:     </interface>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/065c91b8-09c2-4ec8-95e8-606247a3c350/console.log" append="off"/>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:     </serial>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:     <video>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:     </video>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:     </rng>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:   </devices>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]: </domain>
May 28 10:05:11.571490 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:05:11.574142 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Preparing to wait for external event network-vif-plugged-969bbc57-12a6-430b-a878-5424caa1a488 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:05:11.574142 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "065c91b8-09c2-4ec8-95e8-606247a3c350-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:11.574142 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "065c91b8-09c2-4ec8-95e8-606247a3c350-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:11.574142 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "065c91b8-09c2-4ec8-95e8-606247a3c350-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:11.574142 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:05:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-696493070',display_name='tempest-TestEncryptedCinderVolumes-server-696493070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testencryptedcindervolumes-server-696493070',id=39,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJkazBN+XtU9598PjGz7eBoPXWM/ePfBYZfDwMI7/O2WWXrMcZkgI/jRBFa3sf7hiaErYuSubjkr2Q6JMmgrZkTXUkmwdFWIRckCd6HyiSCRs5V2WcaCJm2hov7dKcV87Q==',key_name='tempest-keypair-380292068',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7563a83d33d4bc1a6610ccf53c18dc1',ramdisk_id='',reservation_id='r-rymjkr2c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-297752033',owner_user_name='tempest-TestEncryptedCinderVolumes-297752033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:05:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='961948be669c4a18a29398d53015f03b',uuid=065c91b8-09c2-4ec8-95e8-606247a3c350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "969bbc57-12a6-430b-a878-5424caa1a488", "address": "fa:16:3e:04:ca:46", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap969bbc57-12", "ovs_interfaceid": "969bbc57-12a6-430b-a878-5424caa1a488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:05:11.574142 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Converting VIF {"id": "969bbc57-12a6-430b-a878-5424caa1a488", "address": "fa:16:3e:04:ca:46", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap969bbc57-12", "ovs_interfaceid": "969bbc57-12a6-430b-a878-5424caa1a488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:05:11.574142 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:ca:46,bridge_name='br-int',has_traffic_filtering=True,id=969bbc57-12a6-430b-a878-5424caa1a488,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969bbc57-12') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:05:11.574142 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:ca:46,bridge_name='br-int',has_traffic_filtering=True,id=969bbc57-12a6-430b-a878-5424caa1a488,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969bbc57-12') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:05:11.574882 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:11.577139 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:11.577614 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:05:11.579194 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:11.579718 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9e113eca-65e6-543d-9d7b-78b4f4da23f3', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:11.581499 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:11.582785 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:05:11.583741 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:11.586684 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:11.587138 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap969bbc57-12, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:11.588734 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap969bbc57-12, col_values=(('qos', UUID('6e42bf00-b489-48c7-b9e0-8203b5535dae')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:11.588734 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap969bbc57-12, col_values=(('external_ids', {'iface-id': '969bbc57-12a6-430b-a878-5424caa1a488', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:ca:46', 'vm-uuid': '065c91b8-09c2-4ec8-95e8-606247a3c350'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:11.590524 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:11.593305 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:05:11.599396 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:11.599884 np0000001613 nova-compute[98321]: INFO os_vif [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:ca:46,bridge_name='br-int',has_traffic_filtering=True,id=969bbc57-12a6-430b-a878-5424caa1a488,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969bbc57-12')
May 28 10:05:11.621560 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:05:11.637042 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:05:11.665370 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:11.705994 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:05:11.706312 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:05:11.714541 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:05:11.715792 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fefd:30e7', 'fe80::e4df:c0ff:fe86:6341', 'fe80::fc16:3eff:fedb:1077', 'fe80::fc16:3eff:fe3c:b7e1', 'fe80::fc16:3eff:fee1:659', 'fe80::fc16:3eff:fe9e:2624', 'fe80::fc16:3eff:fee9:42eb', 'fe80::d42a:61ff:fe18:5003', 'fe80::fc16:3eff:fe08:3107', 'fe80::e02b:1cff:fec7:1a41', 'fe80::fc16:3eff:fe9c:7606', 'fe80::e867:17ff:fe2f:2260', 'fe80::fc16:3eff:fea8:baad', 'fe80::3c2b:beff:fe36:4b2a'] 
May 28 10:05:11.715934 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:05:11.716143 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:05:11.716474 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] <== get_connector_properties: return (94ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:05:11.716726 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Updating existing volume attachment record: a50881ed-2f3f-4ff9-a11b-a71cc73673f1 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:05:11.775221 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:05:11.931681 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Successfully updated port: c34d17cf-4b65-4629-a8f0-12963b7e883c {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:05:11.988639 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-dfec9d85-e10f-43ff-9a6c-79e5adfee55d req-7f94480c-1e9b-413b-98e7-ef981033f309 service nova] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Received event network-changed-c34d17cf-4b65-4629-a8f0-12963b7e883c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:05:11.989251 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-dfec9d85-e10f-43ff-9a6c-79e5adfee55d req-7f94480c-1e9b-413b-98e7-ef981033f309 service nova] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Refreshing instance network info cache due to event network-changed-c34d17cf-4b65-4629-a8f0-12963b7e883c. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:05:11.989501 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-dfec9d85-e10f-43ff-9a6c-79e5adfee55d req-7f94480c-1e9b-413b-98e7-ef981033f309 service nova] Acquiring lock "refresh_cache-ca13ce1a-6de6-4923-a01c-e0b822b0e640" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:05:11.989639 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-dfec9d85-e10f-43ff-9a6c-79e5adfee55d req-7f94480c-1e9b-413b-98e7-ef981033f309 service nova] Acquired lock "refresh_cache-ca13ce1a-6de6-4923-a01c-e0b822b0e640" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:05:11.989828 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-dfec9d85-e10f-43ff-9a6c-79e5adfee55d req-7f94480c-1e9b-413b-98e7-ef981033f309 service nova] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Refreshing network info cache for port c34d17cf-4b65-4629-a8f0-12963b7e883c {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:05:12.284446 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.756s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:12.285543 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:05:12.434892 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "refresh_cache-ca13ce1a-6de6-4923-a01c-e0b822b0e640" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:05:12.496082 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-dfec9d85-e10f-43ff-9a6c-79e5adfee55d req-7f94480c-1e9b-413b-98e7-ef981033f309 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:12.582828 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-dfec9d85-e10f-43ff-9a6c-79e5adfee55d req-7f94480c-1e9b-413b-98e7-ef981033f309 service nova] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:05:12.795834 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:05:12.795834 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:05:12.795834 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:12.795834 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:12.815249 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a4fb824e-8b1a-4c24-9355-480bd3abce28 req-0a66be05-7714-4308-ad81-2175c74e7729 service nova] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Received event network-vif-unplugged-969bbc57-12a6-430b-a878-5424caa1a488 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:05:12.815512 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a4fb824e-8b1a-4c24-9355-480bd3abce28 req-0a66be05-7714-4308-ad81-2175c74e7729 service nova] Acquiring lock "065c91b8-09c2-4ec8-95e8-606247a3c350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:12.815801 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a4fb824e-8b1a-4c24-9355-480bd3abce28 req-0a66be05-7714-4308-ad81-2175c74e7729 service nova] Lock "065c91b8-09c2-4ec8-95e8-606247a3c350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:12.815874 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a4fb824e-8b1a-4c24-9355-480bd3abce28 req-0a66be05-7714-4308-ad81-2175c74e7729 service nova] Lock "065c91b8-09c2-4ec8-95e8-606247a3c350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:12.816311 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a4fb824e-8b1a-4c24-9355-480bd3abce28 req-0a66be05-7714-4308-ad81-2175c74e7729 service nova] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] No event matching network-vif-unplugged-969bbc57-12a6-430b-a878-5424caa1a488 in dict_keys([('network-vif-plugged', '969bbc57-12a6-430b-a878-5424caa1a488')]) {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 10:05:12.816473 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-a4fb824e-8b1a-4c24-9355-480bd3abce28 req-0a66be05-7714-4308-ad81-2175c74e7729 service nova] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Received unexpected event network-vif-unplugged-969bbc57-12a6-430b-a878-5424caa1a488 for instance with vm_state building and task_state spawning.
May 28 10:05:12.832740 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-dfec9d85-e10f-43ff-9a6c-79e5adfee55d req-7f94480c-1e9b-413b-98e7-ef981033f309 service nova] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:05:12.882070 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '655e1aff31fe454ab046a71daad5a888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b5a6b6c4514b76a651b71280c093f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:05:13.125079 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:05:13.125281 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:05:13.125281 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] No VIF found with MAC fa:16:3e:04:ca:46, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:05:13.125843 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Using config drive
May 28 10:05:13.296671 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:05:13.336919 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-dfec9d85-e10f-43ff-9a6c-79e5adfee55d req-7f94480c-1e9b-413b-98e7-ef981033f309 service nova] Releasing lock "refresh_cache-ca13ce1a-6de6-4923-a01c-e0b822b0e640" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:05:13.337581 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquired lock "refresh_cache-ca13ce1a-6de6-4923-a01c-e0b822b0e640" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:05:13.337869 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:05:13.403985 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Successfully created port: 52d06606-faa2-4fb3-a532-996445fd106f {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:05:13.634068 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:13.786272 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Creating config drive at /opt/stack/data/nova/instances/065c91b8-09c2-4ec8-95e8-606247a3c350/disk.config
May 28 10:05:13.791387 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/065c91b8-09c2-4ec8-95e8-606247a3c350/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpibiu1mkn {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:13.803453 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:05:13.847301 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:05:13.849506 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:05:13.849963 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Creating image(s)
May 28 10:05:13.850396 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Did not create local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 10:05:13.850640 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Ensure instance console log exists: /opt/stack/data/nova/instances/ca13ce1a-6de6-4923-a01c-e0b822b0e640/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:05:13.851458 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:13.851742 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:13.851926 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:13.858347 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/065c91b8-09c2-4ec8-95e8-606247a3c350/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpibiu1mkn" returned: 0 in 0.067s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:05:13.909623 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:05:13.929015 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Successfully updated port: 52d06606-faa2-4fb3-a532-996445fd106f {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:05:13.977105 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-57d47dc2-10f4-4bd9-be0b-61418bf95f7a req-278e2ff6-526a-44a0-a499-8eaf8bdac7ef service nova] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Received event network-changed-52d06606-faa2-4fb3-a532-996445fd106f {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:05:13.977511 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-57d47dc2-10f4-4bd9-be0b-61418bf95f7a req-278e2ff6-526a-44a0-a499-8eaf8bdac7ef service nova] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Refreshing instance network info cache due to event network-changed-52d06606-faa2-4fb3-a532-996445fd106f. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:05:13.977665 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-57d47dc2-10f4-4bd9-be0b-61418bf95f7a req-278e2ff6-526a-44a0-a499-8eaf8bdac7ef service nova] Acquiring lock "refresh_cache-11fd9dae-9efe-4726-abdd-995998d1df87" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:05:13.977783 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-57d47dc2-10f4-4bd9-be0b-61418bf95f7a req-278e2ff6-526a-44a0-a499-8eaf8bdac7ef service nova] Acquired lock "refresh_cache-11fd9dae-9efe-4726-abdd-995998d1df87" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:05:13.977944 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-57d47dc2-10f4-4bd9-be0b-61418bf95f7a req-278e2ff6-526a-44a0-a499-8eaf8bdac7ef service nova] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Refreshing network info cache for port 52d06606-faa2-4fb3-a532-996445fd106f {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:05:14.104312 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:14.226337 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Updating instance_info_cache with network_info: [{"id": "c34d17cf-4b65-4629-a8f0-12963b7e883c", "address": "fa:16:3e:fe:8f:d0", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34d17cf-4b", "ovs_interfaceid": "c34d17cf-4b65-4629-a8f0-12963b7e883c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:05:14.279816 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:14.324400 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:14.412076 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:14.431286 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Acquiring lock "refresh_cache-11fd9dae-9efe-4726-abdd-995998d1df87" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:05:14.480497 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-57d47dc2-10f4-4bd9-be0b-61418bf95f7a req-278e2ff6-526a-44a0-a499-8eaf8bdac7ef service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:14.547488 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:14.563920 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-57d47dc2-10f4-4bd9-be0b-61418bf95f7a req-278e2ff6-526a-44a0-a499-8eaf8bdac7ef service nova] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:05:14.641662 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:14.644655 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:14.647074 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:14.672202 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:14.728554 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-57d47dc2-10f4-4bd9-be0b-61418bf95f7a req-278e2ff6-526a-44a0-a499-8eaf8bdac7ef service nova] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:05:14.730247 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Releasing lock "refresh_cache-ca13ce1a-6de6-4923-a01c-e0b822b0e640" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:05:14.730588 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Instance network_info: |[{"id": "c34d17cf-4b65-4629-a8f0-12963b7e883c", "address": "fa:16:3e:fe:8f:d0", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34d17cf-4b", "ovs_interfaceid": "c34d17cf-4b65-4629-a8f0-12963b7e883c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:05:14.731578 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Start _get_guest_xml network_info=[{"id": "c34d17cf-4b65-4629-a8f0-12963b7e883c", "address": "fa:16:3e:fe:8f:d0", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34d17cf-4b", "ovs_interfaceid": "c34d17cf-4b65-4629-a8f0-12963b7e883c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2', 'iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6422d8fc-c492-4b2b-a83a-1a96e1daddd2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'ca13ce1a-6de6-4923-a01c-e0b822b0e640', 'attached_at': '', 'detached_at': '', 'volume_id': '6422d8fc-c492-4b2b-a83a-1a96e1daddd2', 'serial': '6422d8fc-c492-4b2b-a83a-1a96e1daddd2', 'multiattach': True}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'a50881ed-2f3f-4ff9-a11b-a71cc73673f1', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:05:14.741689 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:05:14.743563 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-1094620528', uuid='ca13ce1a-6de6-4923-a01c-e0b822b0e640'), owner=OwnerMeta(userid='13481913e22d4bf1a94e1a9a270f5494', username='tempest-AttachVolumeMultiAttachTest-1052626787-project-member', projectid='3403b533910644d2b254922fb84b1ac0', projectname='tempest-AttachVolumeMultiAttachTest-1052626787'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c34d17cf-4b65-4629-a8f0-12963b7e883c", "address": "fa:16:3e:fe:8f:d0", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34d17cf-4b", "ovs_interfaceid": "c34d17cf-4b65-4629-a8f0-12963b7e883c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962714.743044) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:05:14.745218 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:05:14.745645 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:05:14.748812 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:05:14.749068 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:05:14.750261 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:05:14.750592 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:05:14.750734 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:05:14.750946 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:05:14.751108 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:05:14.751235 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:05:14.751327 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:05:14.751497 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:05:14.751598 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:05:14.751705 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:05:14.751805 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:05:14.751930 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:05:14.766689 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:05:14.767216 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2', 'iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6422d8fc-c492-4b2b-a83a-1a96e1daddd2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:05:14.767546 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:05:14.768006 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:05:14.768326 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2', 'iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6422d8fc-c492-4b2b-a83a-1a96e1daddd2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:05:14.779839 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:05:14.780350 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:05:14.780529 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:05:14.781048 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:05:14.781641 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:05:14.781856 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:05:14.793075 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:05:14.793075 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:14.795068 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:05:14.795068 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:14.805340 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2] added
May 28 10:05:14.805340 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:05:14.805340 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:05:14.805340 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:05:14.805340 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:05:14.805340 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:05:14.805340 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:14.805597 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:05:14.805724 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0251(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:05:14.806047 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:05:14.808309 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2] added
May 28 10:05:14.808309 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:05:14.808309 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:05:14.808309 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:05:14.808309 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:05:14.808309 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:05:14.808309 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:14.808525 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:05:14.808868 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0268(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:05:14.808868 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:05:14.816706 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:05:14.817651 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:05:14.818298 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Creating image(s)
May 28 10:05:14.818298 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Acquiring lock "/opt/stack/data/nova/instances/11fd9dae-9efe-4726-abdd-995998d1df87/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:14.818446 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "/opt/stack/data/nova/instances/11fd9dae-9efe-4726-abdd-995998d1df87/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:14.819509 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "/opt/stack/data/nova/instances/11fd9dae-9efe-4726-abdd-995998d1df87/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:14.819583 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:05:14.822458 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:05:14.824534 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:14.902976 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7ab9586c-4a18-49f5-862d-692ecd56d570 req-0287d851-f889-438d-8510-6583f4991679 service nova] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Received event network-vif-plugged-969bbc57-12a6-430b-a878-5424caa1a488 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:05:14.908808 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7ab9586c-4a18-49f5-862d-692ecd56d570 req-0287d851-f889-438d-8510-6583f4991679 service nova] Acquiring lock "065c91b8-09c2-4ec8-95e8-606247a3c350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:14.910183 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7ab9586c-4a18-49f5-862d-692ecd56d570 req-0287d851-f889-438d-8510-6583f4991679 service nova] Lock "065c91b8-09c2-4ec8-95e8-606247a3c350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:14.910183 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7ab9586c-4a18-49f5-862d-692ecd56d570 req-0287d851-f889-438d-8510-6583f4991679 service nova] Lock "065c91b8-09c2-4ec8-95e8-606247a3c350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:14.910183 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7ab9586c-4a18-49f5-862d-692ecd56d570 req-0287d851-f889-438d-8510-6583f4991679 service nova] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Processing event network-vif-plugged-969bbc57-12a6-430b-a878-5424caa1a488 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:05:14.910183 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7ab9586c-4a18-49f5-862d-692ecd56d570 req-0287d851-f889-438d-8510-6583f4991679 service nova] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Received event network-vif-plugged-969bbc57-12a6-430b-a878-5424caa1a488 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:05:14.910425 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7ab9586c-4a18-49f5-862d-692ecd56d570 req-0287d851-f889-438d-8510-6583f4991679 service nova] Acquiring lock "065c91b8-09c2-4ec8-95e8-606247a3c350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:14.910549 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7ab9586c-4a18-49f5-862d-692ecd56d570 req-0287d851-f889-438d-8510-6583f4991679 service nova] Lock "065c91b8-09c2-4ec8-95e8-606247a3c350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:14.910696 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7ab9586c-4a18-49f5-862d-692ecd56d570 req-0287d851-f889-438d-8510-6583f4991679 service nova] Lock "065c91b8-09c2-4ec8-95e8-606247a3c350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:14.911290 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7ab9586c-4a18-49f5-862d-692ecd56d570 req-0287d851-f889-438d-8510-6583f4991679 service nova] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] No waiting events found dispatching network-vif-plugged-969bbc57-12a6-430b-a878-5424caa1a488 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:05:14.911753 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.087s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:05:14.911939 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-7ab9586c-4a18-49f5-862d-692ecd56d570 req-0287d851-f889-438d-8510-6583f4991679 service nova] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Received unexpected event network-vif-plugged-969bbc57-12a6-430b-a878-5424caa1a488 for instance with vm_state building and task_state spawning.
May 28 10:05:14.912432 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:14.913500 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:14.913500 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:05:14.915838 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:05:14.916982 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:14.998284 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.081s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:05:14.998837 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/11fd9dae-9efe-4726-abdd-995998d1df87/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:15.055721 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/11fd9dae-9efe-4726-abdd-995998d1df87/disk 1073741824" returned: 0 in 0.057s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:05:15.056261 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.143s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:15.056694 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:15.121394 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962715.1206954, 065c91b8-09c2-4ec8-95e8-606247a3c350 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:05:15.121965 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:05:15.122215 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] VM Started (Lifecycle Event)
May 28 10:05:15.124976 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:05:15.127732 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Instance spawned successfully.
May 28 10:05:15.128107 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:05:15.149987 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.093s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:05:15.150596 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Checking if we can resize image /opt/stack/data/nova/instances/11fd9dae-9efe-4726-abdd-995998d1df87/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:05:15.150889 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fd9dae-9efe-4726-abdd-995998d1df87/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:15.232534 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-57d47dc2-10f4-4bd9-be0b-61418bf95f7a req-278e2ff6-526a-44a0-a499-8eaf8bdac7ef service nova] Releasing lock "refresh_cache-11fd9dae-9efe-4726-abdd-995998d1df87" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:05:15.233280 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Acquired lock "refresh_cache-11fd9dae-9efe-4726-abdd-995998d1df87" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:05:15.233498 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:05:15.240893 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fd9dae-9efe-4726-abdd-995998d1df87/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:05:15.241440 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Cannot resize image /opt/stack/data/nova/instances/11fd9dae-9efe-4726-abdd-995998d1df87/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:05:15.241813 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:05:15.241955 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Ensure instance console log exists: /opt/stack/data/nova/instances/11fd9dae-9efe-4726-abdd-995998d1df87/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:05:15.242285 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:15.242469 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:15.242689 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:15.626854 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:05:15.629856 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:05:15.638921 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:05:15.639209 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:05:15.639738 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:05:15.641034 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:05:15.641034 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:05:15.641034 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:05:15.806648 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:05:15.809637 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:05:15.821635 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:05:15.821635 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:15.828771 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:05:15.835209 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:05:15.835209 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:15.839620 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:15.848587 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:15.862070 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:15.862070 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:15.862070 np0000001613 nova-compute[98321]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:05:15.862070 np0000001613 nova-compute[98321]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:05:15.862070 np0000001613 nova-compute[98321]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:05:15.862070 np0000001613 nova-compute[98321]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:05:15.862070 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:15.862070 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:15.862070 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:05:15.862070 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:15.862070 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:15.862070 np0000001613 nova-compute[98321]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:05:15.862070 np0000001613 nova-compute[98321]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:05:15.862070 np0000001613 nova-compute[98321]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:05:15.862070 np0000001613 nova-compute[98321]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:05:15.862070 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:15.862070 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:15.862070 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:05:15.867760 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:15.867760 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:15.867760 np0000001613 nova-compute[98321]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:05:15.867760 np0000001613 nova-compute[98321]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:05:15.867760 np0000001613 nova-compute[98321]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:05:15.867760 np0000001613 nova-compute[98321]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:05:15.867760 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:15.867760 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:15.867760 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:05:15.867969 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:15.867969 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:15.867969 np0000001613 nova-compute[98321]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:05:15.867969 np0000001613 nova-compute[98321]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:05:15.867969 np0000001613 nova-compute[98321]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:05:15.867969 np0000001613 nova-compute[98321]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:05:15.867969 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:15.867969 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:15.867969 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:05:15.911675 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2, portal: 192.168.40.100,3260]
May 28 10:05:15.911675 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2, portal: 192.168.40.100,3260] successful.
May 28 10:05:15.911675 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:15.919102 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2, portal: 192.168.50.100,3260]
May 28 10:05:15.919102 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2, portal: 192.168.50.100,3260] successful.
May 28 10:05:15.919102 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:15.927827 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:15.940103 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:15.949791 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:15.949791 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:15.949791 np0000001613 nova-compute[98321]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:05:15.949791 np0000001613 nova-compute[98321]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:05:15.949791 np0000001613 nova-compute[98321]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:05:15.949791 np0000001613 nova-compute[98321]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:05:15.949791 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:15.949791 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:15.949791 np0000001613 nova-compute[98321]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2 (non-flash)
May 28 10:05:15.949791 np0000001613 nova-compute[98321]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2 (non-flash)
May 28 10:05:15.949791 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:05:15.949791 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:15.949791 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:15.949791 np0000001613 nova-compute[98321]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:05:15.949791 np0000001613 nova-compute[98321]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:05:15.949791 np0000001613 nova-compute[98321]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:05:15.949791 np0000001613 nova-compute[98321]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:05:15.949791 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:15.949791 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:15.949791 np0000001613 nova-compute[98321]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2 (non-flash)
May 28 10:05:15.949791 np0000001613 nova-compute[98321]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2 (non-flash)
May 28 10:05:15.949791 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:05:15.949791 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:05:15.949791 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:05:15.949791 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] HCTL ('11', '-', '-', 0) found on session 81 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:05:15.949791 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:05:15.961214 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:15.961214 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:15.961214 np0000001613 nova-compute[98321]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:05:15.961214 np0000001613 nova-compute[98321]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:05:15.961214 np0000001613 nova-compute[98321]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:05:15.961214 np0000001613 nova-compute[98321]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:05:15.961214 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:15.961214 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:15.961214 np0000001613 nova-compute[98321]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2 (non-flash)
May 28 10:05:15.961214 np0000001613 nova-compute[98321]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2 (non-flash)
May 28 10:05:15.961214 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:05:15.961466 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:15.961466 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:15.961466 np0000001613 nova-compute[98321]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:05:15.961466 np0000001613 nova-compute[98321]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:05:15.961466 np0000001613 nova-compute[98321]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:05:15.961466 np0000001613 nova-compute[98321]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:05:15.961466 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:15.961466 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:15.961466 np0000001613 nova-compute[98321]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2 (non-flash)
May 28 10:05:15.961466 np0000001613 nova-compute[98321]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2 (non-flash)
May 28 10:05:15.961466 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:05:15.961632 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.180s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:05:15.961703 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:05:15.962732 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] HCTL ('12', '-', '-', 0) found on session 82 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:05:15.962881 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:05:15.977632 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Searching for a device in session 81 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:05:15.977632 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6422d8fc-c492-4b2b-a83a-1a96e1daddd2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:05:15.981390 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Searching for a device in session 82 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:05:15.981390 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6422d8fc-c492-4b2b-a83a-1a96e1daddd2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:05:16.058288 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:16.136665 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:05:16.138079 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962716.1368558, 065c91b8-09c2-4ec8-95e8-606247a3c350 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:05:16.138321 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] VM Paused (Lifecycle Event)
May 28 10:05:16.148424 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Took 7.33 seconds to spawn the instance on the hypervisor.
May 28 10:05:16.148623 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:05:16.273190 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Updating instance_info_cache with network_info: [{"id": "52d06606-faa2-4fb3-a532-996445fd106f", "address": "fa:16:3e:b9:51:2c", "network": {"id": "6b4547f5-30ae-4bcf-b4e5-b7ffc2bcd25d", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1107528011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "42b5a6b6c4514b76a651b71280c093f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d06606-fa", "ovs_interfaceid": "52d06606-faa2-4fb3-a532-996445fd106f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:05:16.591306 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:16.642588 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:05:16.644963 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962716.6445477, 065c91b8-09c2-4ec8-95e8-606247a3c350 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:05:16.645059 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] VM Resumed (Lifecycle Event)
May 28 10:05:16.671966 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Took 13.06 seconds to build instance.
May 28 10:05:16.775493 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Releasing lock "refresh_cache-11fd9dae-9efe-4726-abdd-995998d1df87" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:05:16.775877 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Instance network_info: |[{"id": "52d06606-faa2-4fb3-a532-996445fd106f", "address": "fa:16:3e:b9:51:2c", "network": {"id": "6b4547f5-30ae-4bcf-b4e5-b7ffc2bcd25d", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1107528011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "42b5a6b6c4514b76a651b71280c093f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d06606-fa", "ovs_interfaceid": "52d06606-faa2-4fb3-a532-996445fd106f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:05:16.778547 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Start _get_guest_xml network_info=[{"id": "52d06606-faa2-4fb3-a532-996445fd106f", "address": "fa:16:3e:b9:51:2c", "network": {"id": "6b4547f5-30ae-4bcf-b4e5-b7ffc2bcd25d", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1107528011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "42b5a6b6c4514b76a651b71280c093f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d06606-fa", "ovs_interfaceid": "52d06606-faa2-4fb3-a532-996445fd106f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:05:16.785315 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:05:16.785547 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-VolumesBackupsTest-instance-2041439870', uuid='11fd9dae-9efe-4726-abdd-995998d1df87'), owner=OwnerMeta(userid='655e1aff31fe454ab046a71daad5a888', username='tempest-VolumesBackupsTest-1901675516-project-member', projectid='42b5a6b6c4514b76a651b71280c093f5', projectname='tempest-VolumesBackupsTest-1901675516'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "52d06606-faa2-4fb3-a532-996445fd106f", "address": "fa:16:3e:b9:51:2c", "network": {"id": "6b4547f5-30ae-4bcf-b4e5-b7ffc2bcd25d", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1107528011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "42b5a6b6c4514b76a651b71280c093f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d06606-fa", "ovs_interfaceid": "52d06606-faa2-4fb3-a532-996445fd106f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962716.785092) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:05:16.788400 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:05:16.788400 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:05:16.788400 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:05:16.789012 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:05:16.789299 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:05:16.790501 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:05:16.791504 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:05:16.791705 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:05:16.791844 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:05:16.792021 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:05:16.792178 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:05:16.796188 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:05:16.796188 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:05:16.796188 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:05:16.796188 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:05:16.796188 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:05:16.796188 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:05:16.812479 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:05:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-2041439870',display_name='tempest-VolumesBackupsTest-instance-2041439870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumesbackupstest-instance-2041439870',id=41,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIwzGuCfKDIjO52WxHs4MsE5v5j8fwj0YUAjVt+YG0zpGL3dRyg6tBclMt9lnvl6Afyt5Abh3wejuTdb/ELIPjsPmVg7HNEIWaTagHxuommirIKrsJpaeApKWpZq526gg==',key_name='tempest-keypair-212005276',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42b5a6b6c4514b76a651b71280c093f5',ramdisk_id='',reservation_id='r-rni8lwvz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-1901675516',owner_user_name='tempest-VolumesBackupsTest-1901675516-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:05:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='655e1aff31fe454ab046a71daad5a888',uuid=11fd9dae-9efe-4726-abdd-995998d1df87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52d06606-faa2-4fb3-a532-996445fd106f", "address": "fa:16:3e:b9:51:2c", "network": {"id": "6b4547f5-30ae-4bcf-b4e5-b7ffc2bcd25d", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1107528011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "42b5a6b6c4514b76a651b71280c093f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d06606-fa", "ovs_interfaceid": "52d06606-faa2-4fb3-a532-996445fd106f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:05:16.812723 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Converting VIF {"id": "52d06606-faa2-4fb3-a532-996445fd106f", "address": "fa:16:3e:b9:51:2c", "network": {"id": "6b4547f5-30ae-4bcf-b4e5-b7ffc2bcd25d", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1107528011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "42b5a6b6c4514b76a651b71280c093f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d06606-fa", "ovs_interfaceid": "52d06606-faa2-4fb3-a532-996445fd106f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:05:16.816089 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:51:2c,bridge_name='br-int',has_traffic_filtering=True,id=52d06606-faa2-4fb3-a532-996445fd106f,network=Network(6b4547f5-30ae-4bcf-b4e5-b7ffc2bcd25d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52d06606-fa') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:05:16.816089 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lazy-loading 'pci_devices' on Instance uuid 11fd9dae-9efe-4726-abdd-995998d1df87 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:05:17.147852 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:05:17.150414 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:05:17.172091 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ddf1f303-dfef-441f-8827-b3fafb02d6b7 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "065c91b8-09c2-4ec8-95e8-606247a3c350" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.573s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:17.233111 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:17.233408 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:17.316083 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-0270b348-f064-4db8-8131-5172d7240947 req-d185c6d0-0a74-4df3-bf03-256dc255db99 service nova] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Received event network-changed-969bbc57-12a6-430b-a878-5424caa1a488 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:05:17.316903 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-0270b348-f064-4db8-8131-5172d7240947 req-d185c6d0-0a74-4df3-bf03-256dc255db99 service nova] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Refreshing instance network info cache due to event network-changed-969bbc57-12a6-430b-a878-5424caa1a488. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:05:17.318215 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0270b348-f064-4db8-8131-5172d7240947 req-d185c6d0-0a74-4df3-bf03-256dc255db99 service nova] Acquiring lock "refresh_cache-065c91b8-09c2-4ec8-95e8-606247a3c350" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:05:17.318572 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] End _get_guest_xml xml=<domain type="qemu">
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:   <uuid>11fd9dae-9efe-4726-abdd-995998d1df87</uuid>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:   <name>instance-00000029</name>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:       <nova:name>tempest-VolumesBackupsTest-instance-2041439870</nova:name>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:05:16</nova:creationTime>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:         <nova:user uuid="655e1aff31fe454ab046a71daad5a888">tempest-VolumesBackupsTest-1901675516-project-member</nova:user>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:         <nova:project uuid="42b5a6b6c4514b76a651b71280c093f5">tempest-VolumesBackupsTest-1901675516</nova:project>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:         <nova:port uuid="52d06606-faa2-4fb3-a532-996445fd106f">
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:     <system>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:       <entry name="serial">11fd9dae-9efe-4726-abdd-995998d1df87</entry>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:       <entry name="uuid">11fd9dae-9efe-4726-abdd-995998d1df87</entry>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:     </system>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:   <os>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:   </os>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:   <features>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:   </features>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:   <devices>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/11fd9dae-9efe-4726-abdd-995998d1df87/disk"/>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:     </disk>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/11fd9dae-9efe-4726-abdd-995998d1df87/disk.config"/>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:     </disk>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:b9:51:2c"/>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:       <target dev="tap52d06606-fa"/>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:     </interface>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/11fd9dae-9efe-4726-abdd-995998d1df87/console.log" append="off"/>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:     </serial>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:     <video>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:     </video>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:     </rng>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:   </devices>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]: </domain>
May 28 10:05:17.318572 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:05:17.320994 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Preparing to wait for external event network-vif-plugged-52d06606-faa2-4fb3-a532-996445fd106f {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:05:17.320994 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Acquiring lock "11fd9dae-9efe-4726-abdd-995998d1df87-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:17.320994 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "11fd9dae-9efe-4726-abdd-995998d1df87-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:17.320994 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "11fd9dae-9efe-4726-abdd-995998d1df87-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:17.320994 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0270b348-f064-4db8-8131-5172d7240947 req-d185c6d0-0a74-4df3-bf03-256dc255db99 service nova] Acquired lock "refresh_cache-065c91b8-09c2-4ec8-95e8-606247a3c350" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:05:17.320994 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:05:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-2041439870',display_name='tempest-VolumesBackupsTest-instance-2041439870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumesbackupstest-instance-2041439870',id=41,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIwzGuCfKDIjO52WxHs4MsE5v5j8fwj0YUAjVt+YG0zpGL3dRyg6tBclMt9lnvl6Afyt5Abh3wejuTdb/ELIPjsPmVg7HNEIWaTagHxuommirIKrsJpaeApKWpZq526gg==',key_name='tempest-keypair-212005276',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42b5a6b6c4514b76a651b71280c093f5',ramdisk_id='',reservation_id='r-rni8lwvz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-1901675516',owner_user_name='tempest-VolumesBackupsTest-1901675516-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:05:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='655e1aff31fe454ab046a71daad5a888',uuid=11fd9dae-9efe-4726-abdd-995998d1df87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52d06606-faa2-4fb3-a532-996445fd106f", "address": "fa:16:3e:b9:51:2c", "network": {"id": "6b4547f5-30ae-4bcf-b4e5-b7ffc2bcd25d", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1107528011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "42b5a6b6c4514b76a651b71280c093f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d06606-fa", "ovs_interfaceid": "52d06606-faa2-4fb3-a532-996445fd106f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:05:17.321409 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-0270b348-f064-4db8-8131-5172d7240947 req-d185c6d0-0a74-4df3-bf03-256dc255db99 service nova] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Refreshing network info cache for port 969bbc57-12a6-430b-a878-5424caa1a488 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:05:17.322387 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Converting VIF {"id": "52d06606-faa2-4fb3-a532-996445fd106f", "address": "fa:16:3e:b9:51:2c", "network": {"id": "6b4547f5-30ae-4bcf-b4e5-b7ffc2bcd25d", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1107528011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "42b5a6b6c4514b76a651b71280c093f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d06606-fa", "ovs_interfaceid": "52d06606-faa2-4fb3-a532-996445fd106f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:05:17.322387 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:51:2c,bridge_name='br-int',has_traffic_filtering=True,id=52d06606-faa2-4fb3-a532-996445fd106f,network=Network(6b4547f5-30ae-4bcf-b4e5-b7ffc2bcd25d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52d06606-fa') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:05:17.322730 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:51:2c,bridge_name='br-int',has_traffic_filtering=True,id=52d06606-faa2-4fb3-a532-996445fd106f,network=Network(6b4547f5-30ae-4bcf-b4e5-b7ffc2bcd25d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52d06606-fa') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:05:17.324207 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:17.324207 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:17.324207 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:05:17.326424 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:17.326604 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5500438c-d8e5-51c8-9e60-46b99fa93d27', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:17.328041 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:05:17.328455 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:17.330296 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:17.330435 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap52d06606-fa, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:17.330736 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap52d06606-fa, col_values=(('qos', UUID('e7f6ca33-5016-424b-b411-7659b15c9e41')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:17.330922 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap52d06606-fa, col_values=(('external_ids', {'iface-id': '52d06606-faa2-4fb3-a532-996445fd106f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:51:2c', 'vm-uuid': '11fd9dae-9efe-4726-abdd-995998d1df87'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:17.331786 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:17.332611 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:05:17.337155 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:17.338283 np0000001613 nova-compute[98321]: INFO os_vif [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:51:2c,bridge_name='br-int',has_traffic_filtering=True,id=52d06606-faa2-4fb3-a532-996445fd106f,network=Network(6b4547f5-30ae-4bcf-b4e5-b7ffc2bcd25d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52d06606-fa')
May 28 10:05:17.736108 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Detaching volume b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7
May 28 10:05:17.780456 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Attempting to driver detach volume b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 from mountpoint /dev/vdc
May 28 10:05:17.785195 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Found disk vdc by alias ua-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:05:17.786421 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Found disk vdc by alias ua-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:05:17.786550 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Attempting to detach device vdc from instance 7ca4978c-d8a8-4ca2-81f3-63bc1e397615 from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 10:05:17.786829 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:05:17.786829 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:05:17.786829 np0000001613 nova-compute[98321]:   <alias name="ua-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7"/>
May 28 10:05:17.786829 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-3"/>
May 28 10:05:17.786829 np0000001613 nova-compute[98321]:   <target dev="vdc" bus="virtio"/>
May 28 10:05:17.786829 np0000001613 nova-compute[98321]:   <serial>b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7</serial>
May 28 10:05:17.786829 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 10:05:17.786829 np0000001613 nova-compute[98321]: </disk>
May 28 10:05:17.786829 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:05:17.794017 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Successfully detached device vdc from instance 7ca4978c-d8a8-4ca2-81f3-63bc1e397615 from the persistent domain config.
May 28 10:05:17.794283 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] (1/8): Attempting to detach device vdc with device alias ua-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 from instance 7ca4978c-d8a8-4ca2-81f3-63bc1e397615 from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 10:05:17.794519 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:05:17.794519 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:05:17.794519 np0000001613 nova-compute[98321]:   <alias name="ua-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7"/>
May 28 10:05:17.794519 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-3"/>
May 28 10:05:17.794519 np0000001613 nova-compute[98321]:   <target dev="vdc" bus="virtio"/>
May 28 10:05:17.794519 np0000001613 nova-compute[98321]:   <serial>b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7</serial>
May 28 10:05:17.794519 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 10:05:17.794519 np0000001613 nova-compute[98321]: </disk>
May 28 10:05:17.794519 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:05:17.813273 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Found WWN 330000000b1ae20dd for multipath device dm-1 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:05:17.813540 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.046s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:05:17.813800 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] <== connect_volume: return (3046ms) {'type': 'block', 'scsi_wwn': '330000000b1ae20dd', 'path': '/dev/dm-1', 'multipath_id': '330000000b1ae20dd'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:05:17.813944 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b1ae20dd', 'path': '/dev/dm-1', 'multipath_id': '330000000b1ae20dd'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:05:17.829009 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-0270b348-f064-4db8-8131-5172d7240947 req-d185c6d0-0a74-4df3-bf03-256dc255db99 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:18.159980 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-0270b348-f064-4db8-8131-5172d7240947 req-d185c6d0-0a74-4df3-bf03-256dc255db99 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:18.321436 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:05:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1094620528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumemultiattachtest-server-1094620528',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3403b533910644d2b254922fb84b1ac0',ramdisk_id='',reservation_id='r-pp7pv8bc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1052626787',owner_user_name='tempest-AttachVolumeMultiAttachTest-1052626787-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:05:11Z,user_data=None,user_id='13481913e22d4bf1a94e1a9a270f5494',uuid=ca13ce1a-6de6-4923-a01c-e0b822b0e640,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c34d17cf-4b65-4629-a8f0-12963b7e883c", "address": "fa:16:3e:fe:8f:d0", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34d17cf-4b", "ovs_interfaceid": "c34d17cf-4b65-4629-a8f0-12963b7e883c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:05:18.321802 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converting VIF {"id": "c34d17cf-4b65-4629-a8f0-12963b7e883c", "address": "fa:16:3e:fe:8f:d0", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34d17cf-4b", "ovs_interfaceid": "c34d17cf-4b65-4629-a8f0-12963b7e883c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:05:18.322272 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:8f:d0,bridge_name='br-int',has_traffic_filtering=True,id=c34d17cf-4b65-4629-a8f0-12963b7e883c,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc34d17cf-4b') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:05:18.322804 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lazy-loading 'pci_devices' on Instance uuid ca13ce1a-6de6-4923-a01c-e0b822b0e640 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:05:18.327205 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779962718.3266413, 7ca4978c-d8a8-4ca2-81f3-63bc1e397615 => ua-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 10:05:18.332616 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-0270b348-f064-4db8-8131-5172d7240947 req-d185c6d0-0a74-4df3-bf03-256dc255db99 service nova] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Updated VIF entry in instance network info cache for port 969bbc57-12a6-430b-a878-5424caa1a488. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:05:18.333178 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-0270b348-f064-4db8-8131-5172d7240947 req-d185c6d0-0a74-4df3-bf03-256dc255db99 service nova] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Updating instance_info_cache with network_info: [{"id": "969bbc57-12a6-430b-a878-5424caa1a488", "address": "fa:16:3e:04:ca:46", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap969bbc57-12", "ovs_interfaceid": "969bbc57-12a6-430b-a878-5424caa1a488", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:05:18.337456 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 for instance 7ca4978c-d8a8-4ca2-81f3-63bc1e397615 {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 10:05:18.345063 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Successfully detached device vdc from instance 7ca4978c-d8a8-4ca2-81f3-63bc1e397615 from the live domain config.
May 28 10:05:18.349595 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:05:18.349949 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7', 'iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:05:18.350141 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:05:18.350526 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:05:18.350846 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7', 'iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:05:18.351011 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:05:18.382910 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:18.382910 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:18.382910 np0000001613 nova-compute[98321]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:05:18.382910 np0000001613 nova-compute[98321]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:05:18.382910 np0000001613 nova-compute[98321]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:05:18.382910 np0000001613 nova-compute[98321]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:05:18.382910 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:18.382910 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:18.382910 np0000001613 nova-compute[98321]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2 (non-flash)
May 28 10:05:18.382910 np0000001613 nova-compute[98321]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2 (non-flash)
May 28 10:05:18.382910 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:05:18.383137 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:18.383137 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:18.383137 np0000001613 nova-compute[98321]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:05:18.383137 np0000001613 nova-compute[98321]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7 (non-flash)
May 28 10:05:18.383137 np0000001613 nova-compute[98321]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:05:18.383137 np0000001613 nova-compute[98321]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:05:18.383137 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:18.383137 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:18.383137 np0000001613 nova-compute[98321]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2 (non-flash)
May 28 10:05:18.383137 np0000001613 nova-compute[98321]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2 (non-flash)
May 28 10:05:18.383137 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:05:18.383346 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7', '75'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7', '76'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b', '77'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b', '78'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e', '79'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e', '80'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2', '81'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2', '82')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:05:18.383346 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7', '76')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:05:18.384514 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7', '75')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:05:18.385447 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc37a340>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7'): ({'sdj'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:05:18.385659 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Removing multipathed devices sdj, sdk {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:05:18.385922 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Flush multipath device 3300000008a391f1a {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:05:18.423417 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:05:18.470648 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:05:18.509603 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:05:18.509762 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:05:18.511023 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:05:18.521357 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:05:18.521520 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:05:18.532722 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:18.570120 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 76, target: iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7, portal: 192.168.40.100,3260]
May 28 10:05:18.570120 np0000001613 nova-compute[98321]: Logout of [sid: 76, target: iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7, portal: 192.168.40.100,3260] successful.
May 28 10:05:18.570120 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:18.587548 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:18.597588 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:18.632234 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 75, target: iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7, portal: 192.168.50.100,3260]
May 28 10:05:18.632234 np0000001613 nova-compute[98321]: Logout of [sid: 75, target: iqn.2023-03.storpool.com:os--volume-b05f9870-4d0c-48f1-8a2d-791b1e1a0fb7, portal: 192.168.50.100,3260] successful.
May 28 10:05:18.632234 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:18.649929 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:18.650150 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:05:18.650302 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] <== disconnect_volume: return (300ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:05:18.650401 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:05:18.826048 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] End _get_guest_xml xml=<domain type="qemu">
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:   <uuid>ca13ce1a-6de6-4923-a01c-e0b822b0e640</uuid>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:   <name>instance-00000028</name>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:       <nova:name>tempest-AttachVolumeMultiAttachTest-server-1094620528</nova:name>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:05:14</nova:creationTime>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:       <nova:image uuid="">
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:         <nova:user uuid="13481913e22d4bf1a94e1a9a270f5494">tempest-AttachVolumeMultiAttachTest-1052626787-project-member</nova:user>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:         <nova:project uuid="3403b533910644d2b254922fb84b1ac0">tempest-AttachVolumeMultiAttachTest-1052626787</nova:project>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:       <nova:root type="volume" uuid=""/>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:         <nova:port uuid="c34d17cf-4b65-4629-a8f0-12963b7e883c">
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:     <system>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:       <entry name="serial">ca13ce1a-6de6-4923-a01c-e0b822b0e640</entry>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:       <entry name="uuid">ca13ce1a-6de6-4923-a01c-e0b822b0e640</entry>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:     </system>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:   <os>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:   </os>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:   <features>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:   </features>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:   <devices>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/ca13ce1a-6de6-4923-a01c-e0b822b0e640/disk.config"/>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:     </disk>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:       <alias name="ua-6422d8fc-c492-4b2b-a83a-1a96e1daddd2"/>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-1"/>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:       <serial>6422d8fc-c492-4b2b-a83a-1a96e1daddd2</serial>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:       <shareable/>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:     </disk>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:fe:8f:d0"/>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:       <target dev="tapc34d17cf-4b"/>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:     </interface>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/ca13ce1a-6de6-4923-a01c-e0b822b0e640/console.log" append="off"/>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:     </serial>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:     <video>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:     </video>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:     </rng>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:   </devices>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]: </domain>
May 28 10:05:18.826048 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:05:18.828056 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Preparing to wait for external event network-vif-plugged-c34d17cf-4b65-4629-a8f0-12963b7e883c {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:05:18.828056 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "ca13ce1a-6de6-4923-a01c-e0b822b0e640-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:18.828056 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "ca13ce1a-6de6-4923-a01c-e0b822b0e640-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:18.828056 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "ca13ce1a-6de6-4923-a01c-e0b822b0e640-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:18.828264 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:05:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1094620528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumemultiattachtest-server-1094620528',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3403b533910644d2b254922fb84b1ac0',ramdisk_id='',reservation_id='r-pp7pv8bc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1052626787',owner_user_name='tempest-AttachVolumeMultiAttachTest-1052626787-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:05:11Z,user_data=None,user_id='13481913e22d4bf1a94e1a9a270f5494',uuid=ca13ce1a-6de6-4923-a01c-e0b822b0e640,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c34d17cf-4b65-4629-a8f0-12963b7e883c", "address": "fa:16:3e:fe:8f:d0", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34d17cf-4b", "ovs_interfaceid": "c34d17cf-4b65-4629-a8f0-12963b7e883c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:05:18.829300 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converting VIF {"id": "c34d17cf-4b65-4629-a8f0-12963b7e883c", "address": "fa:16:3e:fe:8f:d0", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34d17cf-4b", "ovs_interfaceid": "c34d17cf-4b65-4629-a8f0-12963b7e883c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:05:18.829300 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:8f:d0,bridge_name='br-int',has_traffic_filtering=True,id=c34d17cf-4b65-4629-a8f0-12963b7e883c,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc34d17cf-4b') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:05:18.829485 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:8f:d0,bridge_name='br-int',has_traffic_filtering=True,id=c34d17cf-4b65-4629-a8f0-12963b7e883c,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc34d17cf-4b') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:05:18.829762 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:18.830133 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:18.830428 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:05:18.831590 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:18.831833 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9fe88828-30de-5943-8e26-ac4e9913abb3', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:18.832746 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:18.833590 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:05:18.838199 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:18.840156 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0270b348-f064-4db8-8131-5172d7240947 req-d185c6d0-0a74-4df3-bf03-256dc255db99 service nova] Releasing lock "refresh_cache-065c91b8-09c2-4ec8-95e8-606247a3c350" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:05:18.840715 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:18.840997 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc34d17cf-4b, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:18.841336 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc34d17cf-4b, col_values=(('qos', UUID('822f4dcd-0b42-449e-a593-e53b5f23784d')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:18.841509 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc34d17cf-4b, col_values=(('external_ids', {'iface-id': 'c34d17cf-4b65-4629-a8f0-12963b7e883c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:8f:d0', 'vm-uuid': 'ca13ce1a-6de6-4923-a01c-e0b822b0e640'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:18.842546 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:18.843535 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:05:18.851238 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:18.852461 np0000001613 nova-compute[98321]: INFO os_vif [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:8f:d0,bridge_name='br-int',has_traffic_filtering=True,id=c34d17cf-4b65-4629-a8f0-12963b7e883c,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc34d17cf-4b')
May 28 10:05:18.857738 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:05:18.857881 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:05:18.858004 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] No VIF found with MAC fa:16:3e:b9:51:2c, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:05:18.858318 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Using config drive
May 28 10:05:19.205143 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lazy-loading 'flavor' on Instance uuid 7ca4978c-d8a8-4ca2-81f3-63bc1e397615 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:05:19.363411 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:19.539617 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Creating config drive at /opt/stack/data/nova/instances/11fd9dae-9efe-4726-abdd-995998d1df87/disk.config
May 28 10:05:19.544756 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/11fd9dae-9efe-4726-abdd-995998d1df87/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmtsq1nsc {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:19.560067 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:19.604678 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/11fd9dae-9efe-4726-abdd-995998d1df87/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmtsq1nsc" returned: 0 in 0.060s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:05:20.134962 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:20.181969 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:20.186151 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:20.214954 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-50789b15-d259-4682-b3a2-f90e03930686 tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.980s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:20.264722 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:20.375805 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:05:20.375805 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:05:20.375805 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] No VIF found with MAC fa:16:3e:fe:8f:d0, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:05:20.375805 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Using config drive
May 28 10:05:20.440435 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-dcad3198-c201-446f-a952-9d1ad956b168 req-b0775e10-81d7-4a9b-aad9-6b715d567115 service nova] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Received event network-vif-plugged-52d06606-faa2-4fb3-a532-996445fd106f {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:05:20.440924 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-dcad3198-c201-446f-a952-9d1ad956b168 req-b0775e10-81d7-4a9b-aad9-6b715d567115 service nova] Acquiring lock "11fd9dae-9efe-4726-abdd-995998d1df87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:20.441258 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-dcad3198-c201-446f-a952-9d1ad956b168 req-b0775e10-81d7-4a9b-aad9-6b715d567115 service nova] Lock "11fd9dae-9efe-4726-abdd-995998d1df87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:20.441881 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-dcad3198-c201-446f-a952-9d1ad956b168 req-b0775e10-81d7-4a9b-aad9-6b715d567115 service nova] Lock "11fd9dae-9efe-4726-abdd-995998d1df87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:20.441881 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-dcad3198-c201-446f-a952-9d1ad956b168 req-b0775e10-81d7-4a9b-aad9-6b715d567115 service nova] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Processing event network-vif-plugged-52d06606-faa2-4fb3-a532-996445fd106f {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:05:20.528247 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7989d2cc-3799-4ecb-b7a7-54c6863a892f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:20.528247 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7989d2cc-3799-4ecb-b7a7-54c6863a892f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:20.528247 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7989d2cc-3799-4ecb-b7a7-54c6863a892f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:20.528247 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7989d2cc-3799-4ecb-b7a7-54c6863a892f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:20.528247 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7989d2cc-3799-4ecb-b7a7-54c6863a892f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:20.532238 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-7989d2cc-3799-4ecb-b7a7-54c6863a892f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Terminating instance
May 28 10:05:20.571302 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:20.606593 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:20.615184 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:20.620650 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:20.655129 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:20.667488 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:20.801830 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:20.802053 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:20.882399 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:21.036573 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7989d2cc-3799-4ecb-b7a7-54c6863a892f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:05:21.064276 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Creating config drive at /opt/stack/data/nova/instances/ca13ce1a-6de6-4923-a01c-e0b822b0e640/disk.config
May 28 10:05:21.067465 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ca13ce1a-6de6-4923-a01c-e0b822b0e640/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwbzve23b {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:21.086565 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:21.105973 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:21.114809 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:21.149044 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ca13ce1a-6de6-4923-a01c-e0b822b0e640/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwbzve23b" returned: 0 in 0.081s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:05:21.157535 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:21.161219 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:21.251792 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:05:21.252507 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962721.2519722, 11fd9dae-9efe-4726-abdd-995998d1df87 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:05:21.252677 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] VM Started (Lifecycle Event)
May 28 10:05:21.261066 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:05:21.268555 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Instance spawned successfully.
May 28 10:05:21.269131 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:05:21.304954 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Detaching volume d565e760-7309-464b-9f49-2e176d23ac7b
May 28 10:05:21.343262 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7cad64ee-9925-4d19-8087-3557c834422b req-5db0d6c3-f231-43e1-9392-77a612dcc313 service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Received event network-vif-unplugged-08d656bf-1f8f-4bd8-b04a-27184a5225d5 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:05:21.344651 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7cad64ee-9925-4d19-8087-3557c834422b req-5db0d6c3-f231-43e1-9392-77a612dcc313 service nova] Acquiring lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:21.344984 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7cad64ee-9925-4d19-8087-3557c834422b req-5db0d6c3-f231-43e1-9392-77a612dcc313 service nova] Lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:21.345991 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7cad64ee-9925-4d19-8087-3557c834422b req-5db0d6c3-f231-43e1-9392-77a612dcc313 service nova] Lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:21.346217 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7cad64ee-9925-4d19-8087-3557c834422b req-5db0d6c3-f231-43e1-9392-77a612dcc313 service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] No waiting events found dispatching network-vif-unplugged-08d656bf-1f8f-4bd8-b04a-27184a5225d5 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:05:21.346693 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7cad64ee-9925-4d19-8087-3557c834422b req-5db0d6c3-f231-43e1-9392-77a612dcc313 service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Received event network-vif-unplugged-08d656bf-1f8f-4bd8-b04a-27184a5225d5 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:05:21.362956 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Attempting to driver detach volume d565e760-7309-464b-9f49-2e176d23ac7b from mountpoint /dev/vdb
May 28 10:05:21.377174 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Found disk vdb by alias ua-d565e760-7309-464b-9f49-2e176d23ac7b {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:05:21.383111 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Found disk vdb by alias ua-d565e760-7309-464b-9f49-2e176d23ac7b {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:05:21.383202 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Attempting to detach device vdb from instance 2641ee65-c9c2-401d-b511-6ecc1247a3ad from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 10:05:21.384197 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:05:21.384197 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:05:21.384197 np0000001613 nova-compute[98321]:   <alias name="ua-d565e760-7309-464b-9f49-2e176d23ac7b"/>
May 28 10:05:21.384197 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-0"/>
May 28 10:05:21.384197 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:05:21.384197 np0000001613 nova-compute[98321]:   <serial>d565e760-7309-464b-9f49-2e176d23ac7b</serial>
May 28 10:05:21.384197 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 10:05:21.384197 np0000001613 nova-compute[98321]: </disk>
May 28 10:05:21.384197 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:05:21.397739 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Successfully detached device vdb from instance 2641ee65-c9c2-401d-b511-6ecc1247a3ad from the persistent domain config.
May 28 10:05:21.398220 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] (1/8): Attempting to detach device vdb with device alias ua-d565e760-7309-464b-9f49-2e176d23ac7b from instance 2641ee65-c9c2-401d-b511-6ecc1247a3ad from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 10:05:21.398493 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:05:21.398493 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:05:21.398493 np0000001613 nova-compute[98321]:   <alias name="ua-d565e760-7309-464b-9f49-2e176d23ac7b"/>
May 28 10:05:21.398493 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-0"/>
May 28 10:05:21.398493 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:05:21.398493 np0000001613 nova-compute[98321]:   <serial>d565e760-7309-464b-9f49-2e176d23ac7b</serial>
May 28 10:05:21.398493 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 10:05:21.398493 np0000001613 nova-compute[98321]: </disk>
May 28 10:05:21.398493 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:05:21.540101 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Instance destroyed successfully.
May 28 10:05:21.541962 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-7989d2cc-3799-4ecb-b7a7-54c6863a892f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lazy-loading 'resources' on Instance uuid 7ca4978c-d8a8-4ca2-81f3-63bc1e397615 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:05:21.756070 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:05:21.761073 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:05:21.793192 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:05:21.793192 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:05:21.793192 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:05:21.793192 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:05:21.793192 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:05:21.793192 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:05:21.801372 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:21.835965 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:21.956778 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:22.026648 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:22.033460 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:22.045300 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-7989d2cc-3799-4ecb-b7a7-54c6863a892f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T10:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1013676903',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumeshelvetestjson-server-1013676903',id=32,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHz2G0qwtG+p66QDfkgHp2vl8nrQQplJ9NHdbfClwRXi9vojNet9Hqu6l7KTsv5EeGVyPJRozCH7j4HE5omMIeof86ceGpj80eHZxOn83kxa204OWpaQyXSXj0b71RyAA==',key_name='tempest-keypair-1225597873',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:04:39Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='edd64b0e2ce54cac860344420cf9c5b6',ramdisk_id='',reservation_id='r-1n6ox9bd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1618900663',owner_user_name='tempest-AttachVolumeShelveTestJSON-1618900663-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:04:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd3def75f0dd411888f23a2f432896b0',uuid=7ca4978c-d8a8-4ca2-81f3-63bc1e397615,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "address": "fa:16:3e:e9:42:eb", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d656bf-1f", "ovs_interfaceid": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:05:22.045300 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-7989d2cc-3799-4ecb-b7a7-54c6863a892f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Converting VIF {"id": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "address": "fa:16:3e:e9:42:eb", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d656bf-1f", "ovs_interfaceid": "08d656bf-1f8f-4bd8-b04a-27184a5225d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:05:22.045876 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-7989d2cc-3799-4ecb-b7a7-54c6863a892f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:42:eb,bridge_name='br-int',has_traffic_filtering=True,id=08d656bf-1f8f-4bd8-b04a-27184a5225d5,network=Network(d262816b-8751-4e64-8f19-7d59ddaabc41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d656bf-1f') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:05:22.045969 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-7989d2cc-3799-4ecb-b7a7-54c6863a892f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:42:eb,bridge_name='br-int',has_traffic_filtering=True,id=08d656bf-1f8f-4bd8-b04a-27184a5225d5,network=Network(d262816b-8751-4e64-8f19-7d59ddaabc41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d656bf-1f') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:05:22.048443 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:22.048443 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08d656bf-1f, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:22.055457 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:05:22.055457 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:22.056327 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d585bd7-9607-4d19-b7f9-5797bbad0d10) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:22.059240 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:05:22.060866 np0000001613 nova-compute[98321]: INFO os_vif [None req-7989d2cc-3799-4ecb-b7a7-54c6863a892f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:42:eb,bridge_name='br-int',has_traffic_filtering=True,id=08d656bf-1f8f-4bd8-b04a-27184a5225d5,network=Network(d262816b-8751-4e64-8f19-7d59ddaabc41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d656bf-1f')
May 28 10:05:22.061199 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-7989d2cc-3799-4ecb-b7a7-54c6863a892f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Deleting instance files /opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615_del
May 28 10:05:22.068231 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-7989d2cc-3799-4ecb-b7a7-54c6863a892f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Deletion of /opt/stack/data/nova/instances/7ca4978c-d8a8-4ca2-81f3-63bc1e397615_del complete
May 28 10:05:22.106073 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-d565e760-7309-464b-9f49-2e176d23ac7b for instance 2641ee65-c9c2-401d-b511-6ecc1247a3ad {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 10:05:22.264130 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:05:22.264585 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962722.264113, 11fd9dae-9efe-4726-abdd-995998d1df87 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:05:22.264585 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] VM Paused (Lifecycle Event)
May 28 10:05:22.305077 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Took 7.49 seconds to spawn the instance on the hypervisor.
May 28 10:05:22.305294 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:05:22.533839 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-0c667454-53a8-47ec-9802-3f078cd4eabe req-49e84c47-fa46-4eb5-9887-8dd4da2f102c service nova] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Received event network-vif-plugged-52d06606-faa2-4fb3-a532-996445fd106f {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:05:22.535998 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0c667454-53a8-47ec-9802-3f078cd4eabe req-49e84c47-fa46-4eb5-9887-8dd4da2f102c service nova] Acquiring lock "11fd9dae-9efe-4726-abdd-995998d1df87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:22.535998 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0c667454-53a8-47ec-9802-3f078cd4eabe req-49e84c47-fa46-4eb5-9887-8dd4da2f102c service nova] Lock "11fd9dae-9efe-4726-abdd-995998d1df87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:22.535998 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0c667454-53a8-47ec-9802-3f078cd4eabe req-49e84c47-fa46-4eb5-9887-8dd4da2f102c service nova] Lock "11fd9dae-9efe-4726-abdd-995998d1df87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:22.535998 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-0c667454-53a8-47ec-9802-3f078cd4eabe req-49e84c47-fa46-4eb5-9887-8dd4da2f102c service nova] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] No waiting events found dispatching network-vif-plugged-52d06606-faa2-4fb3-a532-996445fd106f {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:05:22.535998 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-0c667454-53a8-47ec-9802-3f078cd4eabe req-49e84c47-fa46-4eb5-9887-8dd4da2f102c service nova] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Received unexpected event network-vif-plugged-52d06606-faa2-4fb3-a532-996445fd106f for instance with vm_state active and task_state None.
May 28 10:05:22.535998 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-0c667454-53a8-47ec-9802-3f078cd4eabe req-49e84c47-fa46-4eb5-9887-8dd4da2f102c service nova] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Received event network-vif-plugged-c34d17cf-4b65-4629-a8f0-12963b7e883c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:05:22.535998 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0c667454-53a8-47ec-9802-3f078cd4eabe req-49e84c47-fa46-4eb5-9887-8dd4da2f102c service nova] Acquiring lock "ca13ce1a-6de6-4923-a01c-e0b822b0e640-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:22.536265 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0c667454-53a8-47ec-9802-3f078cd4eabe req-49e84c47-fa46-4eb5-9887-8dd4da2f102c service nova] Lock "ca13ce1a-6de6-4923-a01c-e0b822b0e640-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:22.538442 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0c667454-53a8-47ec-9802-3f078cd4eabe req-49e84c47-fa46-4eb5-9887-8dd4da2f102c service nova] Lock "ca13ce1a-6de6-4923-a01c-e0b822b0e640-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:22.538442 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-0c667454-53a8-47ec-9802-3f078cd4eabe req-49e84c47-fa46-4eb5-9887-8dd4da2f102c service nova] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Processing event network-vif-plugged-c34d17cf-4b65-4629-a8f0-12963b7e883c {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:05:22.538442 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-0c667454-53a8-47ec-9802-3f078cd4eabe req-49e84c47-fa46-4eb5-9887-8dd4da2f102c service nova] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Received event network-vif-plugged-c34d17cf-4b65-4629-a8f0-12963b7e883c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:05:22.538442 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0c667454-53a8-47ec-9802-3f078cd4eabe req-49e84c47-fa46-4eb5-9887-8dd4da2f102c service nova] Acquiring lock "ca13ce1a-6de6-4923-a01c-e0b822b0e640-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:22.538442 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0c667454-53a8-47ec-9802-3f078cd4eabe req-49e84c47-fa46-4eb5-9887-8dd4da2f102c service nova] Lock "ca13ce1a-6de6-4923-a01c-e0b822b0e640-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:22.538442 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0c667454-53a8-47ec-9802-3f078cd4eabe req-49e84c47-fa46-4eb5-9887-8dd4da2f102c service nova] Lock "ca13ce1a-6de6-4923-a01c-e0b822b0e640-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:22.538442 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-0c667454-53a8-47ec-9802-3f078cd4eabe req-49e84c47-fa46-4eb5-9887-8dd4da2f102c service nova] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] No waiting events found dispatching network-vif-plugged-c34d17cf-4b65-4629-a8f0-12963b7e883c {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:05:22.538442 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-0c667454-53a8-47ec-9802-3f078cd4eabe req-49e84c47-fa46-4eb5-9887-8dd4da2f102c service nova] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Received unexpected event network-vif-plugged-c34d17cf-4b65-4629-a8f0-12963b7e883c for instance with vm_state building and task_state spawning.
May 28 10:05:22.574158 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-7989d2cc-3799-4ecb-b7a7-54c6863a892f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Took 1.54 seconds to destroy the instance on the hypervisor.
May 28 10:05:22.575293 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-7989d2cc-3799-4ecb-b7a7-54c6863a892f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:05:22.575692 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:05:22.575827 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:05:22.576126 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:22.708362 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:22.768651 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:05:22.773786 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962722.7734668, 11fd9dae-9efe-4726-abdd-995998d1df87 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:05:22.773919 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] VM Resumed (Lifecycle Event)
May 28 10:05:22.819000 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Took 16.69 seconds to build instance.
May 28 10:05:22.994528 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:05:22.997093 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:05:23.000641 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Instance spawned successfully.
May 28 10:05:23.001626 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:05:23.277021 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:05:23.278854 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:05:23.320815 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "11fd9dae-9efe-4726-abdd-995998d1df87" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.196s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:23.439817 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2acce1ec-f950-4dd8-b2ba-2a29b966aacb req-9edb4ce2-de5b-4647-98b3-6d0e4bdc0907 service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Received event network-vif-unplugged-08d656bf-1f8f-4bd8-b04a-27184a5225d5 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:05:23.441468 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2acce1ec-f950-4dd8-b2ba-2a29b966aacb req-9edb4ce2-de5b-4647-98b3-6d0e4bdc0907 service nova] Acquiring lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:23.441468 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2acce1ec-f950-4dd8-b2ba-2a29b966aacb req-9edb4ce2-de5b-4647-98b3-6d0e4bdc0907 service nova] Lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:23.441468 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2acce1ec-f950-4dd8-b2ba-2a29b966aacb req-9edb4ce2-de5b-4647-98b3-6d0e4bdc0907 service nova] Lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:23.441468 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2acce1ec-f950-4dd8-b2ba-2a29b966aacb req-9edb4ce2-de5b-4647-98b3-6d0e4bdc0907 service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] No waiting events found dispatching network-vif-unplugged-08d656bf-1f8f-4bd8-b04a-27184a5225d5 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:05:23.441468 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2acce1ec-f950-4dd8-b2ba-2a29b966aacb req-9edb4ce2-de5b-4647-98b3-6d0e4bdc0907 service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Received event network-vif-unplugged-08d656bf-1f8f-4bd8-b04a-27184a5225d5 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:05:23.516217 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:05:23.516331 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:05:23.516776 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:05:23.516915 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:05:23.517128 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:05:23.517361 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:05:23.668715 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:05:23.781726 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999660137999854 future=<Future at 0x73c1f40d21e0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:05:23.782080 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779962723.7817848, 2641ee65-c9c2-401d-b511-6ecc1247a3ad => ua-d565e760-7309-464b-9f49-2e176d23ac7b> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 10:05:23.782906 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962723.782585, ca13ce1a-6de6-4923-a01c-e0b822b0e640 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:05:23.783101 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] VM Started (Lifecycle Event)
May 28 10:05:23.784509 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.996870158999627 future=<Future at 0x73c1f40d21e0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:05:23.784939 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.996735978999823 future=<Future at 0x73c1f40d21e0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:05:23.786506 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Successfully detached device vdb from instance 2641ee65-c9c2-401d-b511-6ecc1247a3ad from the live domain config.
May 28 10:05:23.787922 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:05:23.787983 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b', 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd565e760-7309-464b-9f49-2e176d23ac7b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:05:23.788077 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:05:23.788517 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:05:23.788818 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b', 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd565e760-7309-464b-9f49-2e176d23ac7b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:05:23.789014 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:05:23.825733 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:23.825733 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:23.825733 np0000001613 nova-compute[98321]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:05:23.825733 np0000001613 nova-compute[98321]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:05:23.825733 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:23.825733 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:23.825733 np0000001613 nova-compute[98321]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2 (non-flash)
May 28 10:05:23.825733 np0000001613 nova-compute[98321]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2 (non-flash)
May 28 10:05:23.825733 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:05:23.825733 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:23.825733 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:23.825733 np0000001613 nova-compute[98321]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:05:23.825733 np0000001613 nova-compute[98321]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b (non-flash)
May 28 10:05:23.825733 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:23.825733 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:23.825733 np0000001613 nova-compute[98321]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2 (non-flash)
May 28 10:05:23.825733 np0000001613 nova-compute[98321]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2 (non-flash)
May 28 10:05:23.825733 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:05:23.826381 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b', '77'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b', '78'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e', '79'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e', '80'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2', '81'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2', '82')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:05:23.826381 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b', '78')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:05:23.826999 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b', '77')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:05:23.828154 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc22dc60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b'): ({'sdb'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:05:23.828154 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Removing multipathed devices sdb, sdc {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:05:23.828366 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Flush multipath device 330000000e8f820e4 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:05:23.861875 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:05:23.914379 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:05:23.955272 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:05:23.955506 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:05:23.957613 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:05:23.975263 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:05:23.975374 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:05:23.991986 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:24.022262 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Took 10.17 seconds to spawn the instance on the hypervisor.
May 28 10:05:24.022574 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:05:24.036749 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 78, target: iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b, portal: 192.168.40.100,3260]
May 28 10:05:24.036749 np0000001613 nova-compute[98321]: Logout of [sid: 78, target: iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b, portal: 192.168.40.100,3260] successful.
May 28 10:05:24.036749 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:24.062858 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:24.084126 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:24.122533 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 77, target: iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b, portal: 192.168.50.100,3260]
May 28 10:05:24.122533 np0000001613 nova-compute[98321]: Logout of [sid: 77, target: iqn.2023-03.storpool.com:os--volume-d565e760-7309-464b-9f49-2e176d23ac7b, portal: 192.168.50.100,3260] successful.
May 28 10:05:24.122533 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:24.144518 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:24.144518 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:05:24.144518 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] <== disconnect_volume: return (354ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:05:24.144518 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:05:24.173315 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Took 1.60 seconds to deallocate network for instance.
May 28 10:05:24.287825 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:05:24.303815 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:05:24.374006 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:24.534937 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Took 20.04 seconds to build instance.
May 28 10:05:24.555830 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:24.628768 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e1b135e8-088c-4c74-81b4-bfa5bfbb5db9 req-59167dfb-fff2-4e7e-a7c6-def3f22374be service nova] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Received event network-vif-deleted-08d656bf-1f8f-4bd8-b04a-27184a5225d5 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:05:24.682143 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7989d2cc-3799-4ecb-b7a7-54c6863a892f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:24.684220 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7989d2cc-3799-4ecb-b7a7-54c6863a892f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:24.715596 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lazy-loading 'flavor' on Instance uuid 2641ee65-c9c2-401d-b511-6ecc1247a3ad {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:05:24.810953 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962724.8105435, ca13ce1a-6de6-4923-a01c-e0b822b0e640 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:05:24.811066 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] VM Paused (Lifecycle Event)
May 28 10:05:25.036861 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fa27e820-dc16-4f9d-9099-890068531b97 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "ca13ce1a-6de6-4923-a01c-e0b822b0e640" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.553s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:25.315804 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:05:25.322036 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962725.3216615, ca13ce1a-6de6-4923-a01c-e0b822b0e640 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:05:25.322238 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] VM Resumed (Lifecycle Event)
May 28 10:05:25.484268 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7989d2cc-3799-4ecb-b7a7-54c6863a892f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:05:25.484502 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-7989d2cc-3799-4ecb-b7a7-54c6863a892f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:05:25.725584 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b89e1e01-7fb0-4e5c-85bd-519a9dc75c3a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.923s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:25.826697 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:05:25.828520 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:05:25.989759 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-7989d2cc-3799-4ecb-b7a7-54c6863a892f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:05:26.190837 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7e0e1183-8e68-4c95-8d58-9005e96de3c6 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:26.191028 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7e0e1183-8e68-4c95-8d58-9005e96de3c6 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:26.191148 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7e0e1183-8e68-4c95-8d58-9005e96de3c6 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:05:26.195964 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7e0e1183-8e68-4c95-8d58-9005e96de3c6 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98321) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 28 10:05:26.196610 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-7e0e1183-8e68-4c95-8d58-9005e96de3c6 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lazy-loading 'flavor' on Instance uuid 2641ee65-c9c2-401d-b511-6ecc1247a3ad {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:05:26.488974 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:26.498214 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7989d2cc-3799-4ecb-b7a7-54c6863a892f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.814s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:26.574849 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-7989d2cc-3799-4ecb-b7a7-54c6863a892f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Deleted allocations for instance 7ca4978c-d8a8-4ca2-81f3-63bc1e397615
May 28 10:05:26.704303 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-64bd6d21-b079-4be2-b055-66dedf9b3183 req-4ac4128b-d25e-49ef-9987-7ebc91f8758d service nova] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Received event network-changed-52d06606-faa2-4fb3-a532-996445fd106f {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:05:26.704696 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-64bd6d21-b079-4be2-b055-66dedf9b3183 req-4ac4128b-d25e-49ef-9987-7ebc91f8758d service nova] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Refreshing instance network info cache due to event network-changed-52d06606-faa2-4fb3-a532-996445fd106f. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:05:26.704894 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-64bd6d21-b079-4be2-b055-66dedf9b3183 req-4ac4128b-d25e-49ef-9987-7ebc91f8758d service nova] Acquiring lock "refresh_cache-11fd9dae-9efe-4726-abdd-995998d1df87" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:05:26.705096 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-64bd6d21-b079-4be2-b055-66dedf9b3183 req-4ac4128b-d25e-49ef-9987-7ebc91f8758d service nova] Acquired lock "refresh_cache-11fd9dae-9efe-4726-abdd-995998d1df87" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:05:26.706792 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-64bd6d21-b079-4be2-b055-66dedf9b3183 req-4ac4128b-d25e-49ef-9987-7ebc91f8758d service nova] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Refreshing network info cache for port 52d06606-faa2-4fb3-a532-996445fd106f {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:05:27.058062 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:27.211446 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-64bd6d21-b079-4be2-b055-66dedf9b3183 req-4ac4128b-d25e-49ef-9987-7ebc91f8758d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:27.251117 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:27.278811 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:27.282511 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:27.316414 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:27.509252 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-29554f36-b182-4e61-8d7c-9adc1d4b7ed0 req-228ea5c2-b2fc-4e03-9ef5-1b368ed931e0 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Received event network-vif-unplugged-dc1640f1-0633-403e-8f70-6a6d90053cfc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:05:27.510321 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-29554f36-b182-4e61-8d7c-9adc1d4b7ed0 req-228ea5c2-b2fc-4e03-9ef5-1b368ed931e0 service nova] Acquiring lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:27.510321 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-29554f36-b182-4e61-8d7c-9adc1d4b7ed0 req-228ea5c2-b2fc-4e03-9ef5-1b368ed931e0 service nova] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:27.510321 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-29554f36-b182-4e61-8d7c-9adc1d4b7ed0 req-228ea5c2-b2fc-4e03-9ef5-1b368ed931e0 service nova] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:27.510321 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-29554f36-b182-4e61-8d7c-9adc1d4b7ed0 req-228ea5c2-b2fc-4e03-9ef5-1b368ed931e0 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] No waiting events found dispatching network-vif-unplugged-dc1640f1-0633-403e-8f70-6a6d90053cfc {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:05:27.510321 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-29554f36-b182-4e61-8d7c-9adc1d4b7ed0 req-228ea5c2-b2fc-4e03-9ef5-1b368ed931e0 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Received unexpected event network-vif-unplugged-dc1640f1-0633-403e-8f70-6a6d90053cfc for instance with vm_state active and task_state powering-off.
May 28 10:05:27.539430 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:27.553385 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:27.578000 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.99904033499979 future=<Future at 0x73c1f42127e0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:05:27.579965 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Instance destroyed successfully.
May 28 10:05:27.580471 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-7e0e1183-8e68-4c95-8d58-9005e96de3c6 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lazy-loading 'numa_topology' on Instance uuid 2641ee65-c9c2-401d-b511-6ecc1247a3ad {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:05:27.586325 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7989d2cc-3799-4ecb-b7a7-54c6863a892f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "7ca4978c-d8a8-4ca2-81f3-63bc1e397615" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.060s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:27.726498 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-64bd6d21-b079-4be2-b055-66dedf9b3183 req-4ac4128b-d25e-49ef-9987-7ebc91f8758d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:27.941969 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-64bd6d21-b079-4be2-b055-66dedf9b3183 req-4ac4128b-d25e-49ef-9987-7ebc91f8758d service nova] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Updated VIF entry in instance network info cache for port 52d06606-faa2-4fb3-a532-996445fd106f. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:05:27.945432 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-64bd6d21-b079-4be2-b055-66dedf9b3183 req-4ac4128b-d25e-49ef-9987-7ebc91f8758d service nova] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Updating instance_info_cache with network_info: [{"id": "52d06606-faa2-4fb3-a532-996445fd106f", "address": "fa:16:3e:b9:51:2c", "network": {"id": "6b4547f5-30ae-4bcf-b4e5-b7ffc2bcd25d", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1107528011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "42b5a6b6c4514b76a651b71280c093f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d06606-fa", "ovs_interfaceid": "52d06606-faa2-4fb3-a532-996445fd106f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:05:28.083520 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-7e0e1183-8e68-4c95-8d58-9005e96de3c6 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Object Instance<2641ee65-c9c2-401d-b511-6ecc1247a3ad> lazy-loaded attributes: flavor,numa_topology {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:05:28.083520 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7e0e1183-8e68-4c95-8d58-9005e96de3c6 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:05:28.451201 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-64bd6d21-b079-4be2-b055-66dedf9b3183 req-4ac4128b-d25e-49ef-9987-7ebc91f8758d service nova] Releasing lock "refresh_cache-11fd9dae-9efe-4726-abdd-995998d1df87" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:05:28.594897 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7e0e1183-8e68-4c95-8d58-9005e96de3c6 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.404s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:29.127878 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "ca13ce1a-6de6-4923-a01c-e0b822b0e640" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:29.128480 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "ca13ce1a-6de6-4923-a01c-e0b822b0e640" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:29.128480 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "ca13ce1a-6de6-4923-a01c-e0b822b0e640-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:29.128480 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "ca13ce1a-6de6-4923-a01c-e0b822b0e640-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:29.128916 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "ca13ce1a-6de6-4923-a01c-e0b822b0e640-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:29.133091 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Terminating instance
May 28 10:05:29.228722 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lazy-loading 'flavor' on Instance uuid 2641ee65-c9c2-401d-b511-6ecc1247a3ad {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:05:29.566230 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:29.585135 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e3cf3aa3-2e5e-4a10-8976-fb59908397e2 req-b5b604ee-fd7e-4543-8388-8c3cc7d352c7 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Received event network-vif-unplugged-dc1640f1-0633-403e-8f70-6a6d90053cfc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:05:29.585992 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e3cf3aa3-2e5e-4a10-8976-fb59908397e2 req-b5b604ee-fd7e-4543-8388-8c3cc7d352c7 service nova] Acquiring lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:29.586217 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e3cf3aa3-2e5e-4a10-8976-fb59908397e2 req-b5b604ee-fd7e-4543-8388-8c3cc7d352c7 service nova] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:29.586348 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e3cf3aa3-2e5e-4a10-8976-fb59908397e2 req-b5b604ee-fd7e-4543-8388-8c3cc7d352c7 service nova] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:29.586531 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e3cf3aa3-2e5e-4a10-8976-fb59908397e2 req-b5b604ee-fd7e-4543-8388-8c3cc7d352c7 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] No waiting events found dispatching network-vif-unplugged-dc1640f1-0633-403e-8f70-6a6d90053cfc {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:05:29.586698 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-e3cf3aa3-2e5e-4a10-8976-fb59908397e2 req-b5b604ee-fd7e-4543-8388-8c3cc7d352c7 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Received unexpected event network-vif-unplugged-dc1640f1-0633-403e-8f70-6a6d90053cfc for instance with vm_state stopped and task_state powering-on.
May 28 10:05:29.644770 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:05:29.674635 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:29.713079 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:29.736610 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "refresh_cache-2641ee65-c9c2-401d-b511-6ecc1247a3ad" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:05:29.736783 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquired lock "refresh_cache-2641ee65-c9c2-401d-b511-6ecc1247a3ad" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:05:29.736994 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:05:29.737184 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lazy-loading 'info_cache' on Instance uuid 2641ee65-c9c2-401d-b511-6ecc1247a3ad {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:05:29.859801 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:29.869541 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:29.987908 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999711924000167 future=<Future at 0x73c1fc423e30 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:05:29.991526 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Instance destroyed successfully.
May 28 10:05:29.992711 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lazy-loading 'resources' on Instance uuid ca13ce1a-6de6-4923-a01c-e0b822b0e640 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:05:30.246368 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Object Instance<2641ee65-c9c2-401d-b511-6ecc1247a3ad> lazy-loaded attributes: flavor,info_cache {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:05:30.253905 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:30.272032 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2f603252-1c4b-4f29-a946-f6a1313c74db req-f9c99ecf-adb4-4d3d-bfe9-537d0fe22d25 service nova] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Received event network-vif-unplugged-c34d17cf-4b65-4629-a8f0-12963b7e883c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:05:30.273325 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2f603252-1c4b-4f29-a946-f6a1313c74db req-f9c99ecf-adb4-4d3d-bfe9-537d0fe22d25 service nova] Acquiring lock "ca13ce1a-6de6-4923-a01c-e0b822b0e640-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:30.273507 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2f603252-1c4b-4f29-a946-f6a1313c74db req-f9c99ecf-adb4-4d3d-bfe9-537d0fe22d25 service nova] Lock "ca13ce1a-6de6-4923-a01c-e0b822b0e640-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:30.273652 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2f603252-1c4b-4f29-a946-f6a1313c74db req-f9c99ecf-adb4-4d3d-bfe9-537d0fe22d25 service nova] Lock "ca13ce1a-6de6-4923-a01c-e0b822b0e640-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:30.273811 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2f603252-1c4b-4f29-a946-f6a1313c74db req-f9c99ecf-adb4-4d3d-bfe9-537d0fe22d25 service nova] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] No waiting events found dispatching network-vif-unplugged-c34d17cf-4b65-4629-a8f0-12963b7e883c {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:05:30.273958 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2f603252-1c4b-4f29-a946-f6a1313c74db req-f9c99ecf-adb4-4d3d-bfe9-537d0fe22d25 service nova] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Received event network-vif-unplugged-c34d17cf-4b65-4629-a8f0-12963b7e883c for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:05:30.496993 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:05:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1094620528',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumemultiattachtest-server-1094620528',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:05:24Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3403b533910644d2b254922fb84b1ac0',ramdisk_id='',reservation_id='r-pp7pv8bc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1052626787',owner_user_name='tempest-AttachVolumeMultiAttachTest-1052626787-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:05:24Z,user_data=None,user_id='13481913e22d4bf1a94e1a9a270f5494',uuid=ca13ce1a-6de6-4923-a01c-e0b822b0e640,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c34d17cf-4b65-4629-a8f0-12963b7e883c", "address": "fa:16:3e:fe:8f:d0", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34d17cf-4b", "ovs_interfaceid": "c34d17cf-4b65-4629-a8f0-12963b7e883c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:05:30.497133 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converting VIF {"id": "c34d17cf-4b65-4629-a8f0-12963b7e883c", "address": "fa:16:3e:fe:8f:d0", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc34d17cf-4b", "ovs_interfaceid": "c34d17cf-4b65-4629-a8f0-12963b7e883c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:05:30.497805 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:8f:d0,bridge_name='br-int',has_traffic_filtering=True,id=c34d17cf-4b65-4629-a8f0-12963b7e883c,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc34d17cf-4b') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:05:30.498093 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:8f:d0,bridge_name='br-int',has_traffic_filtering=True,id=c34d17cf-4b65-4629-a8f0-12963b7e883c,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc34d17cf-4b') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:05:30.499243 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:30.499377 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc34d17cf-4b, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:30.500508 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:30.501504 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:05:30.511688 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:30.512942 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:30.513187 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=822f4dcd-0b42-449e-a593-e53b5f23784d) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:30.514523 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:30.514644 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:05:30.521022 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:30.522669 np0000001613 nova-compute[98321]: INFO os_vif [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:8f:d0,bridge_name='br-int',has_traffic_filtering=True,id=c34d17cf-4b65-4629-a8f0-12963b7e883c,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc34d17cf-4b')
May 28 10:05:30.589150 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:05:30.589465 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2', 'iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6422d8fc-c492-4b2b-a83a-1a96e1daddd2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:05:30.589617 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:05:30.589899 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:05:30.590199 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2', 'iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6422d8fc-c492-4b2b-a83a-1a96e1daddd2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:05:30.590282 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:05:30.618779 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:30.618779 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:30.618779 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:30.618779 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:30.618779 np0000001613 nova-compute[98321]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2 (non-flash)
May 28 10:05:30.618779 np0000001613 nova-compute[98321]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2 (non-flash)
May 28 10:05:30.618779 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:05:30.618959 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:30.618959 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:30.618959 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:30.618959 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:30.618959 np0000001613 nova-compute[98321]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2 (non-flash)
May 28 10:05:30.618959 np0000001613 nova-compute[98321]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2 (non-flash)
May 28 10:05:30.618959 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:05:30.619087 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e', '79'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e', '80'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2', '81'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2', '82')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:05:30.619205 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2', '81')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:05:30.620090 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2', '82')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:05:30.620828 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc37bb00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2'): ({'sdg'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:05:30.621033 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Removing multipathed devices sdf, sdg {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:05:30.621246 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Flush multipath device 330000000b1ae20dd {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:05:30.681249 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:05:30.728063 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:05:30.748219 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:30.762006 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:05:30.762460 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:05:30.763784 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:05:30.777992 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:05:30.778189 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:05:30.790670 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:30.827830 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 81, target: iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2, portal: 192.168.40.100,3260]
May 28 10:05:30.827830 np0000001613 nova-compute[98321]: Logout of [sid: 81, target: iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2, portal: 192.168.40.100,3260] successful.
May 28 10:05:30.827830 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:30.845192 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:30.859192 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:30.896587 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 82, target: iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2, portal: 192.168.50.100,3260]
May 28 10:05:30.896587 np0000001613 nova-compute[98321]: Logout of [sid: 82, target: iqn.2023-03.storpool.com:os--volume-6422d8fc-c492-4b2b-a83a-1a96e1daddd2, portal: 192.168.50.100,3260] successful.
May 28 10:05:30.896587 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:30.911433 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:30.911766 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:05:30.912040 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] <== disconnect_volume: return (322ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:05:30.912224 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:05:30.912587 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Deleting instance files /opt/stack/data/nova/instances/ca13ce1a-6de6-4923-a01c-e0b822b0e640_del
May 28 10:05:30.913353 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Deletion of /opt/stack/data/nova/instances/ca13ce1a-6de6-4923-a01c-e0b822b0e640_del complete
May 28 10:05:31.069554 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "11a2b3e7-1061-4a51-b520-113e13221658" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:31.069554 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "11a2b3e7-1061-4a51-b520-113e13221658" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:31.127099 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:31.295272 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Updating instance_info_cache with network_info: [{"id": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "address": "fa:16:3e:08:31:07", "network": {"id": "cfc0fcd2-826d-4851-bc3e-3f0433d6fbce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1771427851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f2d040c323b4b948803334de7c8ec44", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc1640f1-06", "ovs_interfaceid": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:05:31.427637 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Took 1.78 seconds to destroy the instance on the hypervisor.
May 28 10:05:31.428733 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:05:31.429107 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:05:31.429300 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:05:31.429415 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:31.565233 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:31.571642 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:05:31.799780 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Releasing lock "refresh_cache-2641ee65-c9c2-401d-b511-6ecc1247a3ad" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:05:31.918759 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-76aa3b2c-54c1-496f-b929-74117ffeb1e0 req-785eaa06-d6c5-4770-9d03-f315cdcd3b28 service nova] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Received event network-vif-deleted-c34d17cf-4b65-4629-a8f0-12963b7e883c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:05:31.918942 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-76aa3b2c-54c1-496f-b929-74117ffeb1e0 req-785eaa06-d6c5-4770-9d03-f315cdcd3b28 service nova] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Neutron deleted interface c34d17cf-4b65-4629-a8f0-12963b7e883c; detaching it from the instance and deleting it from the info cache
May 28 10:05:31.921315 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-76aa3b2c-54c1-496f-b929-74117ffeb1e0 req-785eaa06-d6c5-4770-9d03-f315cdcd3b28 service nova] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Detach interface failed, port_id=c34d17cf-4b65-4629-a8f0-12963b7e883c, reason: Instance ca13ce1a-6de6-4923-a01c-e0b822b0e640 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:05:32.145384 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:32.145652 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:32.149558 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:05:32.149775 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Claim successful on node np0000001613
May 28 10:05:32.344087 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-267becf6-f6b6-4875-9d06-1f1c5ba5044d req-44116d9c-ff24-4a38-b1d2-d55406d76804 service nova] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Received event network-vif-unplugged-c34d17cf-4b65-4629-a8f0-12963b7e883c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:05:32.344668 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-267becf6-f6b6-4875-9d06-1f1c5ba5044d req-44116d9c-ff24-4a38-b1d2-d55406d76804 service nova] Acquiring lock "ca13ce1a-6de6-4923-a01c-e0b822b0e640-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:32.345133 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-267becf6-f6b6-4875-9d06-1f1c5ba5044d req-44116d9c-ff24-4a38-b1d2-d55406d76804 service nova] Lock "ca13ce1a-6de6-4923-a01c-e0b822b0e640-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:32.345307 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-267becf6-f6b6-4875-9d06-1f1c5ba5044d req-44116d9c-ff24-4a38-b1d2-d55406d76804 service nova] Lock "ca13ce1a-6de6-4923-a01c-e0b822b0e640-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:32.345516 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-267becf6-f6b6-4875-9d06-1f1c5ba5044d req-44116d9c-ff24-4a38-b1d2-d55406d76804 service nova] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] No waiting events found dispatching network-vif-unplugged-c34d17cf-4b65-4629-a8f0-12963b7e883c {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:05:32.345625 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-267becf6-f6b6-4875-9d06-1f1c5ba5044d req-44116d9c-ff24-4a38-b1d2-d55406d76804 service nova] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Received event network-vif-unplugged-c34d17cf-4b65-4629-a8f0-12963b7e883c for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:05:32.366547 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:05:32.424967 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Acquiring lock "13636cda-9029-46e5-8305-ee3ea32ce0f7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:32.425444 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Lock "13636cda-9029-46e5-8305-ee3ea32ce0f7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:32.815913 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Instance destroyed successfully.
May 28 10:05:32.817504 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lazy-loading 'numa_topology' on Instance uuid 2641ee65-c9c2-401d-b511-6ecc1247a3ad {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:05:32.868927 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Took 1.44 seconds to deallocate network for instance.
May 28 10:05:32.928591 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Lazy-loading 'flavor' on Instance uuid 13636cda-9029-46e5-8305-ee3ea32ce0f7 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:05:33.124477 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:33.320138 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Object Instance<2641ee65-c9c2-401d-b511-6ecc1247a3ad> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:05:33.321026 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lazy-loading 'resources' on Instance uuid 2641ee65-c9c2-401d-b511-6ecc1247a3ad {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:05:33.432700 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Ignoring supplied device name: /dev/vdb
May 28 10:05:33.452462 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Took 0.58 seconds to detach 1 volumes for instance.
May 28 10:05:33.812267 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Acquiring lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:33.812505 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:33.822485 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Object Instance<2641ee65-c9c2-401d-b511-6ecc1247a3ad> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:05:33.824325 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:03:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1119204149',display_name='tempest-AttachVolumeTestJSON-server-1119204149',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumetestjson-server-1119204149',id=34,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqD3i0NyKUYk701QA/12tGT7VZdARZzjNaHq8E3bqiWoRx7uJQPxa/ABqLzgddi+LvAs2Iatbj3S16oUNtlAmNjXKSqbg4xg/bifRd6D1DjOpjgoBB+xCgTJwlOZatWFw==',key_name='tempest-keypair-1805479953',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:03:35Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6f2d040c323b4b948803334de7c8ec44',ramdisk_id='',reservation_id='r-92jv1vdq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1743003640',owner_user_name='tempest-AttachVolumeTestJSON-1743003640-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:05:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c88efa7ed26463d928a0e4228dca6cf',uuid=2641ee65-c9c2-401d-b511-6ecc1247a3ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "address": "fa:16:3e:08:31:07", "network": {"id": "cfc0fcd2-826d-4851-bc3e-3f0433d6fbce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1771427851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f2d040c323b4b948803334de7c8ec44", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc1640f1-06", "ovs_interfaceid": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:05:33.824700 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Converting VIF {"id": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "address": "fa:16:3e:08:31:07", "network": {"id": "cfc0fcd2-826d-4851-bc3e-3f0433d6fbce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1771427851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f2d040c323b4b948803334de7c8ec44", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc1640f1-06", "ovs_interfaceid": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:05:33.825641 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:31:07,bridge_name='br-int',has_traffic_filtering=True,id=dc1640f1-0633-403e-8f70-6a6d90053cfc,network=Network(cfc0fcd2-826d-4851-bc3e-3f0433d6fbce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc1640f1-06') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:05:33.826041 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:31:07,bridge_name='br-int',has_traffic_filtering=True,id=dc1640f1-0633-403e-8f70-6a6d90053cfc,network=Network(cfc0fcd2-826d-4851-bc3e-3f0433d6fbce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc1640f1-06') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:05:33.827337 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:33.827650 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc1640f1-06, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:33.830948 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:33.832269 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:05:33.833146 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:33.834087 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:33.834802 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=db4b10b0-93ce-4bad-9d7f-49923b29794e) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:33.837088 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:33.838331 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:05:33.841548 np0000001613 nova-compute[98321]: INFO os_vif [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:31:07,bridge_name='br-int',has_traffic_filtering=True,id=dc1640f1-0633-403e-8f70-6a6d90053cfc,network=Network(cfc0fcd2-826d-4851-bc3e-3f0433d6fbce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc1640f1-06')
May 28 10:05:33.847429 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Start _get_guest_xml network_info=[{"id": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "address": "fa:16:3e:08:31:07", "network": {"id": "cfc0fcd2-826d-4851-bc3e-3f0433d6fbce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1771427851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f2d040c323b4b948803334de7c8ec44", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc1640f1-06", "ovs_interfaceid": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:05:33.850594 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:05:33.852462 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-1119204149', uuid='2641ee65-c9c2-401d-b511-6ecc1247a3ad'), owner=OwnerMeta(userid='2c88efa7ed26463d928a0e4228dca6cf', username='tempest-AttachVolumeTestJSON-1743003640-project-member', projectid='6f2d040c323b4b948803334de7c8ec44', projectname='tempest-AttachVolumeTestJSON-1743003640'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "address": "fa:16:3e:08:31:07", "network": {"id": "cfc0fcd2-826d-4851-bc3e-3f0433d6fbce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1771427851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f2d040c323b4b948803334de7c8ec44", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc1640f1-06", "ovs_interfaceid": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962733.8516855) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:05:33.853748 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:05:33.854247 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:05:33.855806 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:05:33.856064 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:05:33.857331 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:05:33.857685 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:05:33.857921 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:05:33.858077 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:05:33.858302 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:05:33.858440 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:05:33.858570 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:05:33.858797 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:05:33.867587 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:05:33.867858 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:05:33.868077 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:05:33.868315 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:05:33.868597 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2641ee65-c9c2-401d-b511-6ecc1247a3ad {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:05:33.875150 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:05:33.875485 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:05:33.935538 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Lock "13636cda-9029-46e5-8305-ee3ea32ce0f7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:33.960547 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:34.315888 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lazy-loading 'flavor' on Instance uuid cc75b5c9-a7ad-4a7c-aff0-336c8e64b120 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:05:34.372618 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Object Instance<2641ee65-c9c2-401d-b511-6ecc1247a3ad> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:05:34.381157 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:05:34.394275 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:03:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1119204149',display_name='tempest-AttachVolumeTestJSON-server-1119204149',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumetestjson-server-1119204149',id=34,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqD3i0NyKUYk701QA/12tGT7VZdARZzjNaHq8E3bqiWoRx7uJQPxa/ABqLzgddi+LvAs2Iatbj3S16oUNtlAmNjXKSqbg4xg/bifRd6D1DjOpjgoBB+xCgTJwlOZatWFw==',key_name='tempest-keypair-1805479953',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:03:35Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6f2d040c323b4b948803334de7c8ec44',ramdisk_id='',reservation_id='r-92jv1vdq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1743003640',owner_user_name='tempest-AttachVolumeTestJSON-1743003640-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:05:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c88efa7ed26463d928a0e4228dca6cf',uuid=2641ee65-c9c2-401d-b511-6ecc1247a3ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "address": "fa:16:3e:08:31:07", "network": {"id": "cfc0fcd2-826d-4851-bc3e-3f0433d6fbce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1771427851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f2d040c323b4b948803334de7c8ec44", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc1640f1-06", "ovs_interfaceid": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:05:34.394733 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Converting VIF {"id": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "address": "fa:16:3e:08:31:07", "network": {"id": "cfc0fcd2-826d-4851-bc3e-3f0433d6fbce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1771427851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f2d040c323b4b948803334de7c8ec44", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc1640f1-06", "ovs_interfaceid": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:05:34.395342 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:31:07,bridge_name='br-int',has_traffic_filtering=True,id=dc1640f1-0633-403e-8f70-6a6d90053cfc,network=Network(cfc0fcd2-826d-4851-bc3e-3f0433d6fbce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc1640f1-06') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:05:34.396319 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lazy-loading 'pci_devices' on Instance uuid 2641ee65-c9c2-401d-b511-6ecc1247a3ad {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:05:34.572331 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:34.894150 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.748s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:34.894718 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:05:34.897812 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.937s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:34.898643 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Object Instance<2641ee65-c9c2-401d-b511-6ecc1247a3ad> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:05:34.902548 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] End _get_guest_xml xml=<domain type="qemu">
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:   <uuid>2641ee65-c9c2-401d-b511-6ecc1247a3ad</uuid>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:   <name>instance-00000022</name>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:       <nova:name>tempest-AttachVolumeTestJSON-server-1119204149</nova:name>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:05:33</nova:creationTime>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:         <nova:user uuid="2c88efa7ed26463d928a0e4228dca6cf">tempest-AttachVolumeTestJSON-1743003640-project-member</nova:user>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:         <nova:project uuid="6f2d040c323b4b948803334de7c8ec44">tempest-AttachVolumeTestJSON-1743003640</nova:project>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:         <nova:port uuid="dc1640f1-0633-403e-8f70-6a6d90053cfc">
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:     <system>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:       <entry name="serial">2641ee65-c9c2-401d-b511-6ecc1247a3ad</entry>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:       <entry name="uuid">2641ee65-c9c2-401d-b511-6ecc1247a3ad</entry>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:     </system>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:   <os>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:   </os>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:   <features>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:   </features>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:   <devices>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk"/>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:     </disk>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk.config"/>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:     </disk>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:08:31:07"/>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:       <target dev="tapdc1640f1-06"/>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:     </interface>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/console.log" append="off"/>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:     </serial>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:     <video>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:     </video>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:     </rng>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:   </devices>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]: </domain>
May 28 10:05:34.902548 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:05:34.904675 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:35.011672 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:05:35.012140 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:35.081139 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Acquiring lock "13636cda-9029-46e5-8305-ee3ea32ce0f7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:35.081491 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Lock "13636cda-9029-46e5-8305-ee3ea32ce0f7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:35.081816 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Attaching volume fa48ecee-1baa-40a8-9b99-bd2729ebd432 to /dev/vdb
May 28 10:05:35.103336 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:05:35.104300 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2641ee65-c9c2-401d-b511-6ecc1247a3ad {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:05:35.149953 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:05:35.163958 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:05:35.191108 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:35.240442 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:05:35.240799 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:05:35.251280 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:05:35.252750 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fefd:30e7', 'fe80::e4df:c0ff:fe86:6341', 'fe80::fc16:3eff:fedb:1077', 'fe80::fc16:3eff:fe3c:b7e1', 'fe80::fc16:3eff:fee1:659', 'fe80::fc16:3eff:fe9e:2624', 'fe80::fc16:3eff:fe9c:7606', 'fe80::e867:17ff:fe2f:2260', 'fe80::fc16:3eff:fea8:baad', 'fe80::3c2b:beff:fe36:4b2a', 'fe80::fc16:3eff:fe04:ca46', 'fe80::ec4e:cbff:fea7:f945', 'fe80::fc16:3eff:feb9:512c', 'fe80::1c9e:daff:fee5:c4bc'] 
May 28 10:05:35.252900 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:05:35.253025 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:05:35.253268 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:05:35.253510 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Updating existing volume attachment record: 40c92f3a-185d-4bdb-bce5-e1e3b5cfa3ed {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:05:35.322258 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:35.407545 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:05:35.407828 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:05:35.408266 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:35.411596 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:35.516808 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd3def75f0dd411888f23a2f432896b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd64b0e2ce54cac860344420cf9c5b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:05:35.609505 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Object Instance<2641ee65-c9c2-401d-b511-6ecc1247a3ad> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:05:35.610429 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:35.725492 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:05:35.725809 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:05:35.731337 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.121s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:05:35.731738 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:05:35.732012 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:35.823604 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:05:35.824153 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Cannot resize image /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:05:35.824448 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lazy-loading 'migration_context' on Instance uuid 2641ee65-c9c2-401d-b511-6ecc1247a3ad {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:05:35.826836 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:05:35.827401 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432', 'iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fa48ecee-1baa-40a8-9b99-bd2729ebd432', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:05:35.827401 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:05:35.828790 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:05:35.829023 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432', 'iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fa48ecee-1baa-40a8-9b99-bd2729ebd432', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:05:35.843714 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:05:35.844671 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:05:35.845596 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:05:35.845991 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:05:35.849273 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:05:35.849610 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:05:35.858136 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:05:35.858136 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:35.865075 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:05:35.865075 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:35.875202 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432] added
May 28 10:05:35.875202 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:05:35.875202 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:05:35.875202 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:05:35.875202 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:05:35.875202 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:05:35.875202 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:35.875559 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:05:35.875811 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0299(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:05:35.876045 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:05:35.879292 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432] added
May 28 10:05:35.879292 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:05:35.879292 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:05:35.879292 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:05:35.879292 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:05:35.879292 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:05:35.879292 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:35.879575 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:05:35.879707 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0302(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:05:35.879897 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:05:35.912742 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:05:36.229422 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:36.230325 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:36.231610 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:05:36.251661 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Successfully created port: fd381175-d629-4ae4-b6a9-860af0c0aebf {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:05:36.328550 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Object Instance<2641ee65-c9c2-401d-b511-6ecc1247a3ad> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:05:36.329696 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:03:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1119204149',display_name='tempest-AttachVolumeTestJSON-server-1119204149',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumetestjson-server-1119204149',id=34,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqD3i0NyKUYk701QA/12tGT7VZdARZzjNaHq8E3bqiWoRx7uJQPxa/ABqLzgddi+LvAs2Iatbj3S16oUNtlAmNjXKSqbg4xg/bifRd6D1DjOpjgoBB+xCgTJwlOZatWFw==',key_name='tempest-keypair-1805479953',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:03:35Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='6f2d040c323b4b948803334de7c8ec44',ramdisk_id='',reservation_id='r-92jv1vdq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1743003640',owner_user_name='tempest-AttachVolumeTestJSON-1743003640-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:05:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c88efa7ed26463d928a0e4228dca6cf',uuid=2641ee65-c9c2-401d-b511-6ecc1247a3ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "address": "fa:16:3e:08:31:07", "network": {"id": "cfc0fcd2-826d-4851-bc3e-3f0433d6fbce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1771427851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f2d040c323b4b948803334de7c8ec44", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc1640f1-06", "ovs_interfaceid": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:05:36.333191 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Converting VIF {"id": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "address": "fa:16:3e:08:31:07", "network": {"id": "cfc0fcd2-826d-4851-bc3e-3f0433d6fbce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1771427851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f2d040c323b4b948803334de7c8ec44", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc1640f1-06", "ovs_interfaceid": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:05:36.333191 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:31:07,bridge_name='br-int',has_traffic_filtering=True,id=dc1640f1-0633-403e-8f70-6a6d90053cfc,network=Network(cfc0fcd2-826d-4851-bc3e-3f0433d6fbce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc1640f1-06') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:05:36.333191 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:31:07,bridge_name='br-int',has_traffic_filtering=True,id=dc1640f1-0633-403e-8f70-6a6d90053cfc,network=Network(cfc0fcd2-826d-4851-bc3e-3f0433d6fbce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc1640f1-06') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:05:36.333191 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:36.333191 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:36.333191 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:05:36.334126 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:36.334336 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f21c2dd4-42f2-524e-a524-26080a0eb1d9', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:36.335595 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:36.336741 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:05:36.340479 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:36.340680 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc1640f1-06, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:36.341099 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdc1640f1-06, col_values=(('qos', UUID('c4e420f0-ecd1-434f-a69b-212f1efb6a41')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:36.341294 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdc1640f1-06, col_values=(('external_ids', {'iface-id': 'dc1640f1-0633-403e-8f70-6a6d90053cfc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:31:07', 'vm-uuid': '2641ee65-c9c2-401d-b511-6ecc1247a3ad'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:36.343215 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:36.344265 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:05:36.349473 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:36.349532 np0000001613 nova-compute[98321]: INFO os_vif [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:31:07,bridge_name='br-int',has_traffic_filtering=True,id=dc1640f1-0633-403e-8f70-6a6d90053cfc,network=Network(cfc0fcd2-826d-4851-bc3e-3f0433d6fbce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc1640f1-06')
May 28 10:05:36.422304 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:05:36.431458 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Acquiring lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:36.431675 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:36.431965 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Attaching volume cfafef38-8144-4f30-88af-842505295af7 to /dev/vdb
May 28 10:05:36.482434 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:05:36.498755 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:05:36.523794 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:36.578778 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:05:36.578778 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:05:36.592911 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:05:36.597040 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fefd:30e7', 'fe80::e4df:c0ff:fe86:6341', 'fe80::fc16:3eff:fedb:1077', 'fe80::fc16:3eff:fe3c:b7e1', 'fe80::fc16:3eff:fee1:659', 'fe80::fc16:3eff:fe9e:2624', 'fe80::fc16:3eff:fe9c:7606', 'fe80::e867:17ff:fe2f:2260', 'fe80::fc16:3eff:fea8:baad', 'fe80::3c2b:beff:fe36:4b2a', 'fe80::fc16:3eff:fe04:ca46', 'fe80::ec4e:cbff:fea7:f945', 'fe80::fc16:3eff:feb9:512c', 'fe80::1c9e:daff:fee5:c4bc'] 
May 28 10:05:36.597040 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:05:36.597040 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:05:36.597040 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:05:36.597040 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Updating existing volume attachment record: b627c5da-da5c-4e66-89cc-dc3a9f377a11 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:05:36.713288 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._sync_power_states {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:05:36.739338 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:05:36.742334 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.844s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:36.826998 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Deleted allocations for instance ca13ce1a-6de6-4923-a01c-e0b822b0e640
May 28 10:05:36.847516 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Successfully updated port: fd381175-d629-4ae4-b6a9-860af0c0aebf {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:05:36.876495 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:05:36.880468 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:05:36.890115 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:05:36.890115 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:05:36.896393 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:05:36.896393 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:36.907416 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:36.907805 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:36.917597 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:36.924963 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e294072a-7483-42b0-b662-7ff3cabd1cb0 req-fea35f36-4b29-4825-845d-1738ccf91a4c service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Received event network-changed-fd381175-d629-4ae4-b6a9-860af0c0aebf {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:05:36.925108 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e294072a-7483-42b0-b662-7ff3cabd1cb0 req-fea35f36-4b29-4825-845d-1738ccf91a4c service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Refreshing instance network info cache due to event network-changed-fd381175-d629-4ae4-b6a9-860af0c0aebf. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:05:36.926001 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:36.926001 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:36.926001 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:36.926001 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:36.926001 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:05:36.927566 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e294072a-7483-42b0-b662-7ff3cabd1cb0 req-fea35f36-4b29-4825-845d-1738ccf91a4c service nova] Acquiring lock "refresh_cache-11a2b3e7-1061-4a51-b520-113e13221658" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:05:36.927566 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e294072a-7483-42b0-b662-7ff3cabd1cb0 req-fea35f36-4b29-4825-845d-1738ccf91a4c service nova] Acquired lock "refresh_cache-11a2b3e7-1061-4a51-b520-113e13221658" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:05:36.927785 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-e294072a-7483-42b0-b662-7ff3cabd1cb0 req-fea35f36-4b29-4825-845d-1738ccf91a4c service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Refreshing network info cache for port fd381175-d629-4ae4-b6a9-860af0c0aebf {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:05:36.933746 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:36.933746 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:36.933746 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:36.933746 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:36.933746 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:05:36.936588 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:36.936588 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:36.936588 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:36.936588 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:36.936588 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:05:36.937214 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:36.937214 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:36.937214 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:36.937214 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:36.937214 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:05:36.939492 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:36.943032 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:36.980498 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432, portal: 192.168.40.100,3260]
May 28 10:05:36.980498 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432, portal: 192.168.40.100,3260] successful.
May 28 10:05:36.980498 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:36.988421 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432, portal: 192.168.50.100,3260]
May 28 10:05:36.988421 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432, portal: 192.168.50.100,3260] successful.
May 28 10:05:36.988421 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:36.995696 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:37.004890 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:37.015373 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:37.015373 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:37.015373 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:37.015373 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:37.015373 np0000001613 nova-compute[98321]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:37.015373 np0000001613 nova-compute[98321]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:37.015373 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:05:37.015373 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:37.015373 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:37.015373 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:37.015373 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:37.015373 np0000001613 nova-compute[98321]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:37.015373 np0000001613 nova-compute[98321]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:37.015373 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:05:37.015373 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.169s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:05:37.015373 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:05:37.016457 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] HCTL ('7', '-', '-', 0) found on session 83 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:05:37.016742 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:05:37.028318 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:37.028318 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:37.028318 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:37.028318 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:37.028318 np0000001613 nova-compute[98321]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:37.028318 np0000001613 nova-compute[98321]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:37.028318 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:05:37.028318 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:37.028318 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:37.028318 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:37.028318 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:37.028318 np0000001613 nova-compute[98321]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:37.028318 np0000001613 nova-compute[98321]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:37.028318 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:05:37.028318 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:05:37.028318 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:05:37.031188 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] HCTL ('8', '-', '-', 0) found on session 84 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:05:37.031188 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:05:37.037567 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:37.045328 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Searching for a device in session 83 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:05:37.045977 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fa48ecee-1baa-40a8-9b99-bd2729ebd432', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:05:37.086385 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Searching for a device in session 84 and hctl ['8', '*', '*', 0] yield: None {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:05:37.182949 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-1ea1d9e3-bd7a-4ea1-aed0-f1da0c515ea9 req-cdda969e-799d-4dc7-981e-908b4596d4aa service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Received event network-vif-plugged-dc1640f1-0633-403e-8f70-6a6d90053cfc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:05:37.183538 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1ea1d9e3-bd7a-4ea1-aed0-f1da0c515ea9 req-cdda969e-799d-4dc7-981e-908b4596d4aa service nova] Acquiring lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:37.184522 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1ea1d9e3-bd7a-4ea1-aed0-f1da0c515ea9 req-cdda969e-799d-4dc7-981e-908b4596d4aa service nova] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:37.184522 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1ea1d9e3-bd7a-4ea1-aed0-f1da0c515ea9 req-cdda969e-799d-4dc7-981e-908b4596d4aa service nova] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:37.184641 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-1ea1d9e3-bd7a-4ea1-aed0-f1da0c515ea9 req-cdda969e-799d-4dc7-981e-908b4596d4aa service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] No waiting events found dispatching network-vif-plugged-dc1640f1-0633-403e-8f70-6a6d90053cfc {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:05:37.184773 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-1ea1d9e3-bd7a-4ea1-aed0-f1da0c515ea9 req-cdda969e-799d-4dc7-981e-908b4596d4aa service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Received unexpected event network-vif-plugged-dc1640f1-0633-403e-8f70-6a6d90053cfc for instance with vm_state stopped and task_state powering-on.
May 28 10:05:37.185498 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:05:37.187850 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7', 'iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cfafef38-8144-4f30-88af-842505295af7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:05:37.187850 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:05:37.230347 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] While synchronizing instance power states, found 12 instances in the database and 10 instances on the hypervisor.
May 28 10:05:37.230904 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Triggering sync for uuid 6895009a-024f-4919-9d25-a52905eac818 {{(pid=98321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 10:05:37.231555 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Triggering sync for uuid b50eced2-71bf-4448-b2e1-f9657509f34c {{(pid=98321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 10:05:37.232357 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "6895009a-024f-4919-9d25-a52905eac818" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:37.232568 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "6895009a-024f-4919-9d25-a52905eac818" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:37.233240 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Triggering sync for uuid 3edc00a8-2c60-4c44-acb8-6f4d02114bf0 {{(pid=98321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 10:05:37.233792 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "b50eced2-71bf-4448-b2e1-f9657509f34c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:37.234065 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "b50eced2-71bf-4448-b2e1-f9657509f34c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:37.236268 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Triggering sync for uuid 36fde791-779f-42a8-9aef-87eafbbe0370 {{(pid=98321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 10:05:37.237812 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "3edc00a8-2c60-4c44-acb8-6f4d02114bf0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:37.237812 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "3edc00a8-2c60-4c44-acb8-6f4d02114bf0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:37.238872 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Triggering sync for uuid de9742b9-43db-40a6-b635-81d9244fd5e0 {{(pid=98321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 10:05:37.240450 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "36fde791-779f-42a8-9aef-87eafbbe0370" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:37.240826 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "36fde791-779f-42a8-9aef-87eafbbe0370" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:37.241297 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Triggering sync for uuid 2641ee65-c9c2-401d-b511-6ecc1247a3ad {{(pid=98321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 10:05:37.242624 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "de9742b9-43db-40a6-b635-81d9244fd5e0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:37.242905 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Triggering sync for uuid cc75b5c9-a7ad-4a7c-aff0-336c8e64b120 {{(pid=98321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 10:05:37.243271 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "de9742b9-43db-40a6-b635-81d9244fd5e0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:37.243705 np0000001613 nova-compute[98321]: WARNING nova.utils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x73c1f4493a60> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
May 28 10:05:37.243921 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Triggering sync for uuid 13636cda-9029-46e5-8305-ee3ea32ce0f7 {{(pid=98321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 10:05:37.246051 np0000001613 nova-compute[98321]: WARNING nova.utils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x73c1f4493a60> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
May 28 10:05:37.246324 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Triggering sync for uuid 065c91b8-09c2-4ec8-95e8-606247a3c350 {{(pid=98321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 10:05:37.246477 np0000001613 nova-compute[98321]: WARNING nova.utils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x73c1f4493a60> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
May 28 10:05:37.246672 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Triggering sync for uuid 11fd9dae-9efe-4726-abdd-995998d1df87 {{(pid=98321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 10:05:37.246765 np0000001613 nova-compute[98321]: WARNING nova.utils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x73c1f4493a60> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
May 28 10:05:37.246912 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Triggering sync for uuid 11a2b3e7-1061-4a51-b520-113e13221658 {{(pid=98321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 10:05:37.247027 np0000001613 nova-compute[98321]: WARNING nova.utils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x73c1f4493a60> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
May 28 10:05:37.249296 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Triggering sync for uuid ca13ce1a-6de6-4923-a01c-e0b822b0e640 {{(pid=98321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 10:05:37.249672 np0000001613 nova-compute[98321]: WARNING nova.utils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x73c1f4493a60> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
May 28 10:05:37.263617 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 14.53 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:05:37.340530 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:37.340769 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:37.344372 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:05:37.344541 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Claim successful on node np0000001613
May 28 10:05:37.353689 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "refresh_cache-11a2b3e7-1061-4a51-b520-113e13221658" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:05:37.387817 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:37.391405 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:37.398023 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:37.399674 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:37.428989 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:37.436214 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-e294072a-7483-42b0-b662-7ff3cabd1cb0 req-fea35f36-4b29-4825-845d-1738ccf91a4c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:37.439730 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:05:37.442492 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:05:37.442804 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Creating image(s)
May 28 10:05:37.443418 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "/opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:37.443591 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "/opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:37.447893 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "/opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:37.448524 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:05:37.452374 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:05:37.454060 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:37.553901 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-e294072a-7483-42b0-b662-7ff3cabd1cb0 req-fea35f36-4b29-4825-845d-1738ccf91a4c service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:05:37.572779 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.119s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:05:37.573930 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:37.573930 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:37.574441 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:05:37.577659 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:05:37.578766 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:37.708081 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.129s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:05:37.708589 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:37.764224 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "6895009a-024f-4919-9d25-a52905eac818" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.531s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:37.766047 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:37.766392 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:37.766672 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] During sync_power_state the instance has a pending task (powering-on). Skip.
May 28 10:05:37.767135 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:37.767431 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:37.770739 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "b50eced2-71bf-4448-b2e1-f9657509f34c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.536s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:37.771073 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "13636cda-9029-46e5-8305-ee3ea32ce0f7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:37.774480 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "3edc00a8-2c60-4c44-acb8-6f4d02114bf0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.537s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:37.774978 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "065c91b8-09c2-4ec8-95e8-606247a3c350" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:37.775105 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "065c91b8-09c2-4ec8-95e8-606247a3c350" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:37.786124 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "de9742b9-43db-40a6-b635-81d9244fd5e0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.543s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:37.786869 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "11fd9dae-9efe-4726-abdd-995998d1df87" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:37.791426 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658/disk 1073741824" returned: 0 in 0.078s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:05:37.795908 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "11fd9dae-9efe-4726-abdd-995998d1df87" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:37.795908 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "36fde791-779f-42a8-9aef-87eafbbe0370" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.554s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:37.796652 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:37.796652 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "11a2b3e7-1061-4a51-b520-113e13221658" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:37.799483 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:37.858060 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-e294072a-7483-42b0-b662-7ff3cabd1cb0 req-fea35f36-4b29-4825-845d-1738ccf91a4c service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:05:37.860073 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4dad276a-2e0d-4ecc-818b-91732a9e6948 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "ca13ce1a-6de6-4923-a01c-e0b822b0e640" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.732s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:37.910034 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.113s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:05:37.910390 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Checking if we can resize image /opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:05:37.910660 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:37.975491 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Removed pending STOPPED event for 2641ee65-c9c2-401d-b511-6ecc1247a3ad due to new event <LifecycleEvent: 1779962737.9746652, 2641ee65-c9c2-401d-b511-6ecc1247a3ad => Resumed> {{(pid=98321) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 10:05:37.976194 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Instance event wait completed in 0 seconds for  {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:05:37.977054 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962737.9746652, 2641ee65-c9c2-401d-b511-6ecc1247a3ad => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:05:37.977270 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] VM Resumed (Lifecycle Event)
May 28 10:05:37.980896 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Instance rebooted successfully.
May 28 10:05:38.005413 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:05:38.005803 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Cannot resize image /opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:05:38.006325 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:05:38.006493 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Ensure instance console log exists: /opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:05:38.006842 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:38.007127 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:38.007345 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:38.067650 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Searching for a device in session 84 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:05:38.067831 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'fa48ecee-1baa-40a8-9b99-bd2729ebd432', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:05:38.294701 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "065c91b8-09c2-4ec8-95e8-606247a3c350" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.520s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:38.295047 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "ca13ce1a-6de6-4923-a01c-e0b822b0e640" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:38.295196 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "ca13ce1a-6de6-4923-a01c-e0b822b0e640" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:38.335691 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "11fd9dae-9efe-4726-abdd-995998d1df87" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.548s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:38.375780 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e294072a-7483-42b0-b662-7ff3cabd1cb0 req-fea35f36-4b29-4825-845d-1738ccf91a4c service nova] Releasing lock "refresh_cache-11a2b3e7-1061-4a51-b520-113e13221658" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:05:38.376273 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquired lock "refresh_cache-11a2b3e7-1061-4a51-b520-113e13221658" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:05:38.376431 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:05:38.483323 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:05:38.487241 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:05:38.781885 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0004254730001775897 future=<Future at 0x73c1f40d21e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:05:38.781885 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:05:38.782118 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=3.794954293000046 future=<Future at 0x73c1f42127e0 state=cancelled>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:05:38.782118 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=3.7948724499997297 future=<Future at 0x73c1f42127e0 state=cancelled>) was cancelled while queued, skipping {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:05:38.782269 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:05:38.782269 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=6.205170716000339 future=<Future at 0x73c1fc423e30 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:05:38.782355 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=6.205102207999971 future=<Future at 0x73c1fc423e30 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:05:38.783876 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Emitting event <LifecycleEvent: 1779962723.7812486, 7ca4978c-d8a8-4ca2-81f3-63bc1e397615 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:05:38.783876 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] VM Stopped (Lifecycle Event)
May 28 10:05:38.799047 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "ca13ce1a-6de6-4923-a01c-e0b822b0e640" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.504s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:38.899723 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Found WWN 330000000145e8310 for multipath device dm-0 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:05:38.900240 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.071s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:05:38.900455 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] <== connect_volume: return (3072ms) {'type': 'block', 'scsi_wwn': '330000000145e8310', 'path': '/dev/dm-0', 'multipath_id': '330000000145e8310'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:05:38.900598 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000145e8310', 'path': '/dev/dm-0', 'multipath_id': '330000000145e8310'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:05:38.901341 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.714s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:05:38.901620 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7', 'iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cfafef38-8144-4f30-88af-842505295af7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:05:38.905399 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Lazy-loading 'flavor' on Instance uuid 13636cda-9029-46e5-8305-ee3ea32ce0f7 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:05:38.914557 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:05:38.915564 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:05:38.916417 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:05:38.916777 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:05:38.917193 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:05:38.918185 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:05:38.930607 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:05:38.930607 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:38.938784 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:05:38.938784 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:38.949030 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7] added
May 28 10:05:38.949030 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:05:38.949030 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:05:38.949030 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:05:38.949030 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:05:38.949030 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:05:38.949030 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:38.949030 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:05:38.949030 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0322(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:05:38.949524 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:05:38.952374 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7] added
May 28 10:05:38.952374 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:05:38.952374 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:05:38.952374 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:05:38.952374 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:05:38.952374 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:05:38.952374 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:38.952623 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:05:38.952907 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0357(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:05:38.953080 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:05:38.961555 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:05:38.989523 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] During sync_power_state the instance has a pending task (powering-on). Skip.
May 28 10:05:38.990210 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962738.9896462, 2641ee65-c9c2-401d-b511-6ecc1247a3ad => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:05:38.990210 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] VM Started (Lifecycle Event)
May 28 10:05:39.040236 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:05:39.040236 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:05:39.188992 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:39.261364 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2c89009b-3887-4ac6-b8f7-8010764ee496 req-b925d59d-3c09-4d3a-8625-74cf8b7b93e9 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Received event network-vif-plugged-dc1640f1-0633-403e-8f70-6a6d90053cfc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:05:39.261762 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2c89009b-3887-4ac6-b8f7-8010764ee496 req-b925d59d-3c09-4d3a-8625-74cf8b7b93e9 service nova] Acquiring lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:39.262023 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2c89009b-3887-4ac6-b8f7-8010764ee496 req-b925d59d-3c09-4d3a-8625-74cf8b7b93e9 service nova] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:39.262088 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2c89009b-3887-4ac6-b8f7-8010764ee496 req-b925d59d-3c09-4d3a-8625-74cf8b7b93e9 service nova] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:39.262177 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2c89009b-3887-4ac6-b8f7-8010764ee496 req-b925d59d-3c09-4d3a-8625-74cf8b7b93e9 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] No waiting events found dispatching network-vif-plugged-dc1640f1-0633-403e-8f70-6a6d90053cfc {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:05:39.262288 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-2c89009b-3887-4ac6-b8f7-8010764ee496 req-b925d59d-3c09-4d3a-8625-74cf8b7b93e9 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Received unexpected event network-vif-plugged-dc1640f1-0633-403e-8f70-6a6d90053cfc for instance with vm_state stopped and task_state powering-on.
May 28 10:05:39.289041 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ff58b58d-0746-49df-8faf-9bb869274227 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 7ca4978c-d8a8-4ca2-81f3-63bc1e397615] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:05:39.341802 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Updating instance_info_cache with network_info: [{"id": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "address": "fa:16:3e:b5:7a:19", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd381175-d6", "ovs_interfaceid": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:05:39.410035 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Attempting to attach volume fa48ecee-1baa-40a8-9b99-bd2729ebd432 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 10:05:39.411276 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] attach device xml: <disk type="block" device="disk">
May 28 10:05:39.411276 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:05:39.411276 np0000001613 nova-compute[98321]:   <alias name="ua-fa48ecee-1baa-40a8-9b99-bd2729ebd432"/>
May 28 10:05:39.411276 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-0"/>
May 28 10:05:39.411276 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:05:39.411276 np0000001613 nova-compute[98321]:   <serial>fa48ecee-1baa-40a8-9b99-bd2729ebd432</serial>
May 28 10:05:39.411276 np0000001613 nova-compute[98321]: </disk>
May 28 10:05:39.411276 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 10:05:39.494252 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:05:39.497961 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:05:39.498121 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:05:39.498247 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] No VIF found with MAC fa:16:3e:08:31:07, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:05:39.499579 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-0705f303-c0e1-4dbb-8e30-92d22588d17a tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:05:39.502550 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:05:39.543971 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:05:39.575078 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:39.843975 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Releasing lock "refresh_cache-11a2b3e7-1061-4a51-b520-113e13221658" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:05:39.845100 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Instance network_info: |[{"id": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "address": "fa:16:3e:b5:7a:19", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd381175-d6", "ovs_interfaceid": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:05:39.845764 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Start _get_guest_xml network_info=[{"id": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "address": "fa:16:3e:b5:7a:19", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd381175-d6", "ovs_interfaceid": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:05:39.849016 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:05:39.850311 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-1038469455', uuid='11a2b3e7-1061-4a51-b520-113e13221658'), owner=OwnerMeta(userid='bd3def75f0dd411888f23a2f432896b0', username='tempest-AttachVolumeShelveTestJSON-1618900663-project-member', projectid='edd64b0e2ce54cac860344420cf9c5b6', projectname='tempest-AttachVolumeShelveTestJSON-1618900663'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "address": "fa:16:3e:b5:7a:19", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd381175-d6", "ovs_interfaceid": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962739.8499436) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:05:39.852205 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:05:39.852205 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:05:39.853737 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:05:39.854558 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:05:39.855221 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:05:39.855611 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:05:39.856273 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:05:39.856273 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:05:39.856273 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:05:39.856273 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:05:39.856678 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:05:39.856722 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:05:39.856870 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:05:39.857037 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:05:39.858364 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:05:39.858364 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:05:39.874415 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1038469455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumeshelvetestjson-server-1038469455',id=42,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMY7kXjSfENddJg92HGAKjem9WrDThMi6I8TEBeHwoDzPui0P24CmO2SMbVIQkyN1o3DhCenQzSIsgKtBFuRyVtQHpeEnNk6L6E9kYszZ+Qxlovl7JB7OKSIEGTWV9SmQQ==',key_name='tempest-keypair-1521685008',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='edd64b0e2ce54cac860344420cf9c5b6',ramdisk_id='',reservation_id='r-oq6jrgqc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1618900663',owner_user_name='tempest-AttachVolumeShelveTestJSON-1618900663-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:05:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd3def75f0dd411888f23a2f432896b0',uuid=11a2b3e7-1061-4a51-b520-113e13221658,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "address": "fa:16:3e:b5:7a:19", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd381175-d6", "ovs_interfaceid": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:05:39.874647 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Converting VIF {"id": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "address": "fa:16:3e:b5:7a:19", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd381175-d6", "ovs_interfaceid": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:05:39.875503 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:7a:19,bridge_name='br-int',has_traffic_filtering=True,id=fd381175-d629-4ae4-b6a9-860af0c0aebf,network=Network(d262816b-8751-4e64-8f19-7d59ddaabc41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd381175-d6') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:05:39.876337 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lazy-loading 'pci_devices' on Instance uuid 11a2b3e7-1061-4a51-b520-113e13221658 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:05:39.949559 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:05:39.955599 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:05:39.964177 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:05:39.964177 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:05:39.977137 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:05:39.977137 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:39.983619 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:39.991096 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:40.003630 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:40.003630 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:40.003630 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:40.003630 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:40.003630 np0000001613 nova-compute[98321]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:40.003630 np0000001613 nova-compute[98321]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:40.003630 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:05:40.003912 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:40.003912 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:40.003912 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:40.003912 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:40.003912 np0000001613 nova-compute[98321]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:40.003912 np0000001613 nova-compute[98321]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:40.003912 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:05:40.005028 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] During sync_power_state the instance has a pending task (powering-on). Skip.
May 28 10:05:40.011485 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:40.011485 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:40.011485 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:40.011485 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:40.011485 np0000001613 nova-compute[98321]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:40.011485 np0000001613 nova-compute[98321]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:40.011485 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:05:40.014336 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:40.014336 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:40.014336 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:40.014336 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:40.014336 np0000001613 nova-compute[98321]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:40.014336 np0000001613 nova-compute[98321]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:40.014336 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:05:40.052705 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.712s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:40.052705 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:05:40.055272 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7, portal: 192.168.40.100,3260]
May 28 10:05:40.055272 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7, portal: 192.168.40.100,3260] successful.
May 28 10:05:40.055272 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:40.063920 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7, portal: 192.168.50.100,3260]
May 28 10:05:40.063920 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7, portal: 192.168.50.100,3260] successful.
May 28 10:05:40.063920 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:40.079107 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:40.080695 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:40.100574 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:40.100574 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:40.100574 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:40.100574 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:40.100574 np0000001613 nova-compute[98321]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:40.100574 np0000001613 nova-compute[98321]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:40.100574 np0000001613 nova-compute[98321]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:40.100574 np0000001613 nova-compute[98321]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:40.100574 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:05:40.100574 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:40.100574 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:40.100574 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:40.100574 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:40.100574 np0000001613 nova-compute[98321]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:40.100574 np0000001613 nova-compute[98321]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:40.100574 np0000001613 nova-compute[98321]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:40.100574 np0000001613 nova-compute[98321]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:40.100574 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:05:40.100574 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.183s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:05:40.100574 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:05:40.100574 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] HCTL ('11', '-', '-', 0) found on session 85 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:05:40.100574 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:05:40.105565 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:40.105565 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:40.105565 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:40.105565 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:40.105565 np0000001613 nova-compute[98321]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:40.105565 np0000001613 nova-compute[98321]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:40.105565 np0000001613 nova-compute[98321]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:40.105565 np0000001613 nova-compute[98321]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:40.105565 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:05:40.105751 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:40.105751 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:40.105751 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:40.105751 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:40.105751 np0000001613 nova-compute[98321]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:40.105751 np0000001613 nova-compute[98321]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:40.105751 np0000001613 nova-compute[98321]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:40.105751 np0000001613 nova-compute[98321]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:40.105751 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:05:40.106040 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.189s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:05:40.106222 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:05:40.107113 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] HCTL ('12', '-', '-', 0) found on session 86 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:05:40.107264 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:05:40.118322 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Searching for a device in session 85 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:05:40.118870 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cfafef38-8144-4f30-88af-842505295af7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:05:40.126425 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Searching for a device in session 86 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:05:40.126425 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'cfafef38-8144-4f30-88af-842505295af7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:05:40.379740 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] End _get_guest_xml xml=<domain type="qemu">
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:   <uuid>11a2b3e7-1061-4a51-b520-113e13221658</uuid>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:   <name>instance-0000002a</name>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1038469455</nova:name>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:05:39</nova:creationTime>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:         <nova:user uuid="bd3def75f0dd411888f23a2f432896b0">tempest-AttachVolumeShelveTestJSON-1618900663-project-member</nova:user>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:         <nova:project uuid="edd64b0e2ce54cac860344420cf9c5b6">tempest-AttachVolumeShelveTestJSON-1618900663</nova:project>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:         <nova:port uuid="fd381175-d629-4ae4-b6a9-860af0c0aebf">
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:     <system>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:       <entry name="serial">11a2b3e7-1061-4a51-b520-113e13221658</entry>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:       <entry name="uuid">11a2b3e7-1061-4a51-b520-113e13221658</entry>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:     </system>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:   <os>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:   </os>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:   <features>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:   </features>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:   <devices>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658/disk"/>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:     </disk>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658/disk.config"/>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:     </disk>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:b5:7a:19"/>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:       <target dev="tapfd381175-d6"/>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:     </interface>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658/console.log" append="off"/>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:     </serial>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:     <video>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:     </video>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:     </rng>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:   </devices>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]: </domain>
May 28 10:05:40.379740 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:05:40.382592 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Preparing to wait for external event network-vif-plugged-fd381175-d629-4ae4-b6a9-860af0c0aebf {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:05:40.382592 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "11a2b3e7-1061-4a51-b520-113e13221658-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:40.382592 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "11a2b3e7-1061-4a51-b520-113e13221658-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:40.382592 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "11a2b3e7-1061-4a51-b520-113e13221658-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:40.382592 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1038469455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumeshelvetestjson-server-1038469455',id=42,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMY7kXjSfENddJg92HGAKjem9WrDThMi6I8TEBeHwoDzPui0P24CmO2SMbVIQkyN1o3DhCenQzSIsgKtBFuRyVtQHpeEnNk6L6E9kYszZ+Qxlovl7JB7OKSIEGTWV9SmQQ==',key_name='tempest-keypair-1521685008',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='edd64b0e2ce54cac860344420cf9c5b6',ramdisk_id='',reservation_id='r-oq6jrgqc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1618900663',owner_user_name='tempest-AttachVolumeShelveTestJSON-1618900663-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:05:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd3def75f0dd411888f23a2f432896b0',uuid=11a2b3e7-1061-4a51-b520-113e13221658,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "address": "fa:16:3e:b5:7a:19", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd381175-d6", "ovs_interfaceid": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:05:40.382592 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Converting VIF {"id": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "address": "fa:16:3e:b5:7a:19", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd381175-d6", "ovs_interfaceid": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:05:40.382592 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:7a:19,bridge_name='br-int',has_traffic_filtering=True,id=fd381175-d629-4ae4-b6a9-860af0c0aebf,network=Network(d262816b-8751-4e64-8f19-7d59ddaabc41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd381175-d6') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:05:40.382592 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:7a:19,bridge_name='br-int',has_traffic_filtering=True,id=fd381175-d629-4ae4-b6a9-860af0c0aebf,network=Network(d262816b-8751-4e64-8f19-7d59ddaabc41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd381175-d6') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:05:40.383118 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:40.383401 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:40.383663 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:05:40.384591 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:40.384792 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '15093e86-d2ef-5332-91e5-5eb90d72240f', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:40.385683 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:40.386457 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:05:40.387262 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:40.389695 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:40.389923 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd381175-d6, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:40.390419 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfd381175-d6, col_values=(('qos', UUID('083dfc37-d39d-4353-94a9-1976b63ab051')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:40.390622 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfd381175-d6, col_values=(('external_ids', {'iface-id': 'fd381175-d629-4ae4-b6a9-860af0c0aebf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:7a:19', 'vm-uuid': '11a2b3e7-1061-4a51-b520-113e13221658'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:40.392115 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:40.392836 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:05:40.398868 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:40.399511 np0000001613 nova-compute[98321]: INFO os_vif [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:7a:19,bridge_name='br-int',has_traffic_filtering=True,id=fd381175-d629-4ae4-b6a9-860af0c0aebf,network=Network(d262816b-8751-4e64-8f19-7d59ddaabc41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd381175-d6')
May 28 10:05:40.558599 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:05:40.559650 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:05:40.560007 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:40.560348 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:40.654563 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec58233d3b2848bbb2e0b00650398cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e9651268114327a9cc6c6c59bef01e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:05:40.918230 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:05:41.060332 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:05:41.075921 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:05:41.076088 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:05:41.076143 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:05:41.076298 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] No VIF found with MAC fa:16:3e:a8:ba:ad, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:05:41.112133 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Successfully created port: 79f3ea8e-af7a-4778-8abc-96e97c5177f2 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:05:41.442204 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2072baf4-20c8-4c46-b4d8-1faa26acd9b3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "de9742b9-43db-40a6-b635-81d9244fd5e0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:41.442204 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2072baf4-20c8-4c46-b4d8-1faa26acd9b3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "de9742b9-43db-40a6-b635-81d9244fd5e0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:41.442204 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2072baf4-20c8-4c46-b4d8-1faa26acd9b3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "de9742b9-43db-40a6-b635-81d9244fd5e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:41.442204 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2072baf4-20c8-4c46-b4d8-1faa26acd9b3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "de9742b9-43db-40a6-b635-81d9244fd5e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:41.442204 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2072baf4-20c8-4c46-b4d8-1faa26acd9b3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "de9742b9-43db-40a6-b635-81d9244fd5e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:41.444409 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-2072baf4-20c8-4c46-b4d8-1faa26acd9b3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Terminating instance
May 28 10:05:41.563124 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:05:41.673372 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Successfully updated port: 79f3ea8e-af7a-4778-8abc-96e97c5177f2 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:05:41.739839 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-094ab0c5-0346-4fad-be0c-8123892c1eff req-c9cc8e9a-53ce-4613-ab41-b65e88d01e2b service nova] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Received event network-changed-79f3ea8e-af7a-4778-8abc-96e97c5177f2 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:05:41.740315 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-094ab0c5-0346-4fad-be0c-8123892c1eff req-c9cc8e9a-53ce-4613-ab41-b65e88d01e2b service nova] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Refreshing instance network info cache due to event network-changed-79f3ea8e-af7a-4778-8abc-96e97c5177f2. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:05:41.740490 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-094ab0c5-0346-4fad-be0c-8123892c1eff req-c9cc8e9a-53ce-4613-ab41-b65e88d01e2b service nova] Acquiring lock "refresh_cache-3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:05:41.740611 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-094ab0c5-0346-4fad-be0c-8123892c1eff req-c9cc8e9a-53ce-4613-ab41-b65e88d01e2b service nova] Acquired lock "refresh_cache-3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:05:41.740721 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-094ab0c5-0346-4fad-be0c-8123892c1eff req-c9cc8e9a-53ce-4613-ab41-b65e88d01e2b service nova] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Refreshing network info cache for port 79f3ea8e-af7a-4778-8abc-96e97c5177f2 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:05:41.915183 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:05:41.915360 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:05:41.915484 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] No VIF found with MAC fa:16:3e:b5:7a:19, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:05:41.916078 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Using config drive
May 28 10:05:41.938532 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Found WWN 3300000004a1ee274 for multipath device dm-1 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:05:41.938819 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:05:41.938999 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] <== connect_volume: return (4752ms) {'type': 'block', 'scsi_wwn': '3300000004a1ee274', 'path': '/dev/dm-1', 'multipath_id': '3300000004a1ee274'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:05:41.939184 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004a1ee274', 'path': '/dev/dm-1', 'multipath_id': '3300000004a1ee274'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:05:41.941950 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lazy-loading 'flavor' on Instance uuid cc75b5c9-a7ad-4a7c-aff0-336c8e64b120 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:05:41.949678 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2072baf4-20c8-4c46-b4d8-1faa26acd9b3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:05:41.980560 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:41.986482 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:42.018179 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:42.068826 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Booting with volume 00ef829b-d202-4a0f-bd33-f9b98af4b31d at /dev/vda
May 28 10:05:42.135695 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:05:42.149921 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:05:42.170765 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f7e17c35-1413-4ea9-b655-fba413595b32 req-6c169e69-7bcb-4b68-add7-31a284c5815f service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Received event network-vif-unplugged-9df7e969-a155-41f1-9e30-c42f172029e4 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:05:42.171264 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f7e17c35-1413-4ea9-b655-fba413595b32 req-6c169e69-7bcb-4b68-add7-31a284c5815f service nova] Acquiring lock "de9742b9-43db-40a6-b635-81d9244fd5e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:42.171520 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f7e17c35-1413-4ea9-b655-fba413595b32 req-6c169e69-7bcb-4b68-add7-31a284c5815f service nova] Lock "de9742b9-43db-40a6-b635-81d9244fd5e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:42.171728 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f7e17c35-1413-4ea9-b655-fba413595b32 req-6c169e69-7bcb-4b68-add7-31a284c5815f service nova] Lock "de9742b9-43db-40a6-b635-81d9244fd5e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:42.172004 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f7e17c35-1413-4ea9-b655-fba413595b32 req-6c169e69-7bcb-4b68-add7-31a284c5815f service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] No waiting events found dispatching network-vif-unplugged-9df7e969-a155-41f1-9e30-c42f172029e4 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:05:42.172362 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f7e17c35-1413-4ea9-b655-fba413595b32 req-6c169e69-7bcb-4b68-add7-31a284c5815f service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Received event network-vif-unplugged-9df7e969-a155-41f1-9e30-c42f172029e4 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:05:42.175504 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "refresh_cache-3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:05:42.179063 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:42.191511 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:42.195982 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:42.229133 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:05:42.229865 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:05:42.239313 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:05:42.242117 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fefd:30e7', 'fe80::e4df:c0ff:fe86:6341', 'fe80::fc16:3eff:fedb:1077', 'fe80::fc16:3eff:fe3c:b7e1', 'fe80::fc16:3eff:fee1:659', 'fe80::fc16:3eff:fe9c:7606', 'fe80::e867:17ff:fe2f:2260', 'fe80::fc16:3eff:fea8:baad', 'fe80::3c2b:beff:fe36:4b2a', 'fe80::fc16:3eff:fe04:ca46', 'fe80::ec4e:cbff:fea7:f945', 'fe80::fc16:3eff:feb9:512c', 'fe80::1c9e:daff:fee5:c4bc', 'fe80::fc16:3eff:fe08:3107', 'fe80::e02b:1cff:fec7:1a41'] 
May 28 10:05:42.242566 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:05:42.243865 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-094ab0c5-0346-4fad-be0c-8123892c1eff req-c9cc8e9a-53ce-4613-ab41-b65e88d01e2b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:42.246877 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:05:42.247419 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:05:42.247608 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Updating existing volume attachment record: 65c09173-5991-4a6d-8e28-555e33f27e2e {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:05:42.302416 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.99963749599965 future=<Future at 0x73c1f4310950 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:05:42.302831 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Instance destroyed successfully.
May 28 10:05:42.303414 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-2072baf4-20c8-4c46-b4d8-1faa26acd9b3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lazy-loading 'resources' on Instance uuid de9742b9-43db-40a6-b635-81d9244fd5e0 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:05:42.346247 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-094ab0c5-0346-4fad-be0c-8123892c1eff req-c9cc8e9a-53ce-4613-ab41-b65e88d01e2b service nova] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:05:42.423645 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:42.448948 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Attempting to attach volume cfafef38-8144-4f30-88af-842505295af7 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 10:05:42.454864 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] attach device xml: <disk type="block" device="disk">
May 28 10:05:42.454864 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:05:42.454864 np0000001613 nova-compute[98321]:   <alias name="ua-cfafef38-8144-4f30-88af-842505295af7"/>
May 28 10:05:42.454864 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-1"/>
May 28 10:05:42.454864 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:05:42.454864 np0000001613 nova-compute[98321]:   <serial>cfafef38-8144-4f30-88af-842505295af7</serial>
May 28 10:05:42.454864 np0000001613 nova-compute[98321]: </disk>
May 28 10:05:42.454864 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 10:05:42.550232 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-094ab0c5-0346-4fad-be0c-8123892c1eff req-c9cc8e9a-53ce-4613-ab41-b65e88d01e2b service nova] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:05:42.582028 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Creating config drive at /opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658/disk.config
May 28 10:05:42.588428 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp32bns2nq {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:42.652326 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-26c267ef-0e81-4e73-9401-11e7e13e04cd tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Lock "13636cda-9029-46e5-8305-ee3ea32ce0f7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.571s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:42.653784 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "13636cda-9029-46e5-8305-ee3ea32ce0f7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.882s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:42.655703 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp32bns2nq" returned: 0 in 0.067s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:05:42.771888 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4afeeffc-a1f1-4852-bee9-04bd7fb38daf req-534801da-1e11-47f4-918d-6133b0f727e1 service nova] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Received event volume-extended-fa48ecee-1baa-40a8-9b99-bd2729ebd432 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:05:42.807671 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-2072baf4-20c8-4c46-b4d8-1faa26acd9b3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:02:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001613',hostname='multiattach-server-1',id=31,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrmebBJn1C7uIkB9JjrF4yuEuto77kf4SaBedfdmOdQwZzJyqrVQd0Wq/SA1eDV6FpWwBB4BKjLBcFgkvBrXSx4LeKHMUic/tPGA5px/F625klLXypbV+9p49FvQ4XImQ==',key_name='tempest-keypair-2082049331',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:04:15Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3403b533910644d2b254922fb84b1ac0',ramdisk_id='',reservation_id='r-d0jzlqs3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1052626787',owner_user_name='tempest-AttachVolumeMultiAttachTest-1052626787-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:04:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13481913e22d4bf1a94e1a9a270f5494',uuid=de9742b9-43db-40a6-b635-81d9244fd5e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9df7e969-a155-41f1-9e30-c42f172029e4", "address": "fa:16:3e:9e:26:24", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df7e969-a1", "ovs_interfaceid": "9df7e969-a155-41f1-9e30-c42f172029e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:05:42.808008 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-2072baf4-20c8-4c46-b4d8-1faa26acd9b3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converting VIF {"id": "9df7e969-a155-41f1-9e30-c42f172029e4", "address": "fa:16:3e:9e:26:24", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df7e969-a1", "ovs_interfaceid": "9df7e969-a155-41f1-9e30-c42f172029e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:05:42.808578 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-2072baf4-20c8-4c46-b4d8-1faa26acd9b3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:26:24,bridge_name='br-int',has_traffic_filtering=True,id=9df7e969-a155-41f1-9e30-c42f172029e4,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df7e969-a1') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:05:42.808823 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-2072baf4-20c8-4c46-b4d8-1faa26acd9b3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:26:24,bridge_name='br-int',has_traffic_filtering=True,id=9df7e969-a155-41f1-9e30-c42f172029e4,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df7e969-a1') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:05:42.810339 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:42.811149 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9df7e969-a1, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:42.814138 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:42.814975 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:05:42.822604 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:42.827236 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:42.827681 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1744e34b-8d3f-4a71-9a7a-7d4f79ea1d8a) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:42.828297 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:42.829041 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:05:42.836808 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:42.838900 np0000001613 nova-compute[98321]: INFO os_vif [None req-2072baf4-20c8-4c46-b4d8-1faa26acd9b3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:26:24,bridge_name='br-int',has_traffic_filtering=True,id=9df7e969-a155-41f1-9e30-c42f172029e4,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df7e969-a1')
May 28 10:05:42.839624 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-2072baf4-20c8-4c46-b4d8-1faa26acd9b3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Deleting instance files /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0_del
May 28 10:05:42.849968 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-2072baf4-20c8-4c46-b4d8-1faa26acd9b3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Deletion of /opt/stack/data/nova/instances/de9742b9-43db-40a6-b635-81d9244fd5e0_del complete
May 28 10:05:43.053380 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-094ab0c5-0346-4fad-be0c-8123892c1eff req-c9cc8e9a-53ce-4613-ab41-b65e88d01e2b service nova] Releasing lock "refresh_cache-3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:05:43.054324 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquired lock "refresh_cache-3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:05:43.054532 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:05:43.162091 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:43.163675 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "13636cda-9029-46e5-8305-ee3ea32ce0f7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.511s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:43.192267 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:43.197640 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:43.274097 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4afeeffc-a1f1-4852-bee9-04bd7fb38daf req-534801da-1e11-47f4-918d-6133b0f727e1 service nova] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Handling volume-extended event for volume fa48ecee-1baa-40a8-9b99-bd2729ebd432 {{(pid=98321) extend_volume /opt/stack/nova/nova/compute/manager.py:11836}}
May 28 10:05:43.287118 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:43.361073 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-2072baf4-20c8-4c46-b4d8-1faa26acd9b3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Took 1.41 seconds to destroy the instance on the hypervisor.
May 28 10:05:43.362524 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-2072baf4-20c8-4c46-b4d8-1faa26acd9b3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:05:43.366040 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:05:43.366040 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:05:43.366040 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:43.388111 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-58075c3c-87b2-4e74-bb16-f2ceeab49555 req-92e5e833-c01f-4046-8576-cb670cb56bf6 service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Received event network-vif-plugged-fd381175-d629-4ae4-b6a9-860af0c0aebf {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:05:43.391483 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-58075c3c-87b2-4e74-bb16-f2ceeab49555 req-92e5e833-c01f-4046-8576-cb670cb56bf6 service nova] Acquiring lock "11a2b3e7-1061-4a51-b520-113e13221658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:43.392451 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-58075c3c-87b2-4e74-bb16-f2ceeab49555 req-92e5e833-c01f-4046-8576-cb670cb56bf6 service nova] Lock "11a2b3e7-1061-4a51-b520-113e13221658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:43.392710 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-58075c3c-87b2-4e74-bb16-f2ceeab49555 req-92e5e833-c01f-4046-8576-cb670cb56bf6 service nova] Lock "11a2b3e7-1061-4a51-b520-113e13221658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:43.392935 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-58075c3c-87b2-4e74-bb16-f2ceeab49555 req-92e5e833-c01f-4046-8576-cb670cb56bf6 service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Processing event network-vif-plugged-fd381175-d629-4ae4-b6a9-860af0c0aebf {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:05:43.504998 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:43.601411 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:43.645892 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:43.669553 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:05:43.776777 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-4afeeffc-a1f1-4852-bee9-04bd7fb38daf req-534801da-1e11-47f4-918d-6133b0f727e1 service nova] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Cinder extended volume fa48ecee-1baa-40a8-9b99-bd2729ebd432; extending it to detect new size
May 28 10:05:43.923751 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:44.086956 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Updating instance_info_cache with network_info: [{"id": "79f3ea8e-af7a-4778-8abc-96e97c5177f2", "address": "fa:16:3e:56:a4:d8", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f3ea8e-af", "ovs_interfaceid": "79f3ea8e-af7a-4778-8abc-96e97c5177f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:05:44.163337 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:05:44.163746 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:05:44.163746 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:05:44.163746 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] No VIF found with MAC fa:16:3e:9c:76:06, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:05:44.167505 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962744.1672094, 11a2b3e7-1061-4a51-b520-113e13221658 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:05:44.167685 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] VM Started (Lifecycle Event)
May 28 10:05:44.171723 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:05:44.174640 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:05:44.181395 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Instance spawned successfully.
May 28 10:05:44.182126 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:05:44.252892 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e64f4a3c-c932-45ad-b5a7-adb39629b7ec req-64eb3c5d-6256-46be-b61b-53c145bbe9a9 service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Received event network-vif-unplugged-9df7e969-a155-41f1-9e30-c42f172029e4 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:05:44.253357 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e64f4a3c-c932-45ad-b5a7-adb39629b7ec req-64eb3c5d-6256-46be-b61b-53c145bbe9a9 service nova] Acquiring lock "de9742b9-43db-40a6-b635-81d9244fd5e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:44.253529 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e64f4a3c-c932-45ad-b5a7-adb39629b7ec req-64eb3c5d-6256-46be-b61b-53c145bbe9a9 service nova] Lock "de9742b9-43db-40a6-b635-81d9244fd5e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:44.253593 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e64f4a3c-c932-45ad-b5a7-adb39629b7ec req-64eb3c5d-6256-46be-b61b-53c145bbe9a9 service nova] Lock "de9742b9-43db-40a6-b635-81d9244fd5e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:44.253886 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e64f4a3c-c932-45ad-b5a7-adb39629b7ec req-64eb3c5d-6256-46be-b61b-53c145bbe9a9 service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] No waiting events found dispatching network-vif-unplugged-9df7e969-a155-41f1-9e30-c42f172029e4 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:05:44.253886 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e64f4a3c-c932-45ad-b5a7-adb39629b7ec req-64eb3c5d-6256-46be-b61b-53c145bbe9a9 service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Received event network-vif-unplugged-9df7e969-a155-41f1-9e30-c42f172029e4 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:05:44.341304 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [req-4afeeffc-a1f1-4852-bee9-04bd7fb38daf req-534801da-1e11-47f4-918d-6133b0f727e1 service nova] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] calling os-brick to extend iSCSI Volume {{(pid=98321) extend_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:88}}
May 28 10:05:44.341616 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [req-4afeeffc-a1f1-4852-bee9-04bd7fb38daf req-534801da-1e11-47f4-918d-6133b0f727e1 service nova] ==> extend_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432', 'iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fa48ecee-1baa-40a8-9b99-bd2729ebd432', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}), 'kwargs': {}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:05:44.341778 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [req-4afeeffc-a1f1-4852-bee9-04bd7fb38daf req-534801da-1e11-47f4-918d-6133b0f727e1 service nova] Acquiring lock "extend_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:05:44.342299 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [req-4afeeffc-a1f1-4852-bee9-04bd7fb38daf req-534801da-1e11-47f4-918d-6133b0f727e1 service nova] Lock "extend_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:05:44.342622 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [req-4afeeffc-a1f1-4852-bee9-04bd7fb38daf req-534801da-1e11-47f4-918d-6133b0f727e1 service nova] Extend volume for {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432', 'iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fa48ecee-1baa-40a8-9b99-bd2729ebd432', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}
May 28 10:05:44.342718 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [req-4afeeffc-a1f1-4852-bee9-04bd7fb38daf req-534801da-1e11-47f4-918d-6133b0f727e1 service nova] Multipath discovery for iSCSI enabled
May 28 10:05:44.342934 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [req-4afeeffc-a1f1-4852-bee9-04bd7fb38daf req-534801da-1e11-47f4-918d-6133b0f727e1 service nova] Found paths for volume ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432-lun-0']
May 28 10:05:44.343044 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [req-4afeeffc-a1f1-4852-bee9-04bd7fb38daf req-534801da-1e11-47f4-918d-6133b0f727e1 service nova] Checking paths are valid ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432-lun-0'] {{(pid=98321) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:711}}
May 28 10:05:44.364995 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [req-4afeeffc-a1f1-4852-bee9-04bd7fb38daf req-534801da-1e11-47f4-918d-6133b0f727e1 service nova] extend volume ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432-lun-0'] {{(pid=98321) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:718}}
May 28 10:05:44.365254 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [req-4afeeffc-a1f1-4852-bee9-04bd7fb38daf req-534801da-1e11-47f4-918d-6133b0f727e1 service nova] Running cmd (subprocess): lsscsi {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:44.402120 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:05:44.404109 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:05:44.404399 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Creating image(s)
May 28 10:05:44.404724 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Did not create local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 10:05:44.404911 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Ensure instance console log exists: /opt/stack/data/nova/instances/3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:05:44.405234 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:44.405500 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:44.405738 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:44.408341 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [req-4afeeffc-a1f1-4852-bee9-04bd7fb38daf req-534801da-1e11-47f4-918d-6133b0f727e1 service nova] CMD "lsscsi" returned: 0 in 0.043s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:05:44.408754 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [req-4afeeffc-a1f1-4852-bee9-04bd7fb38daf req-534801da-1e11-47f4-918d-6133b0f727e1 service nova] dev_info={'device': '/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432-lun-0', 'host': '7', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98321) get_device_info /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:201}}
May 28 10:05:44.408934 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [req-4afeeffc-a1f1-4852-bee9-04bd7fb38daf req-534801da-1e11-47f4-918d-6133b0f727e1 service nova] Volume device info = {'device': '/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432-lun-0', 'host': '7', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98321) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:722}}
May 28 10:05:44.419852 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [req-4afeeffc-a1f1-4852-bee9-04bd7fb38daf req-534801da-1e11-47f4-918d-6133b0f727e1 service nova] Starting size: 1073741824 {{(pid=98321) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:733}}
May 28 10:05:44.446567 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [req-4afeeffc-a1f1-4852-bee9-04bd7fb38daf req-534801da-1e11-47f4-918d-6133b0f727e1 service nova] volume size after scsi device rescan 2147483648 {{(pid=98321) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:739}}
May 28 10:05:44.446800 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [req-4afeeffc-a1f1-4852-bee9-04bd7fb38daf req-534801da-1e11-47f4-918d-6133b0f727e1 service nova] Running cmd (subprocess): lsscsi {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:44.495155 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [req-4afeeffc-a1f1-4852-bee9-04bd7fb38daf req-534801da-1e11-47f4-918d-6133b0f727e1 service nova] CMD "lsscsi" returned: 0 in 0.048s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:05:44.495941 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [req-4afeeffc-a1f1-4852-bee9-04bd7fb38daf req-534801da-1e11-47f4-918d-6133b0f727e1 service nova] dev_info={'device': '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432-lun-0', 'host': '8', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98321) get_device_info /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:201}}
May 28 10:05:44.496130 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [req-4afeeffc-a1f1-4852-bee9-04bd7fb38daf req-534801da-1e11-47f4-918d-6133b0f727e1 service nova] Volume device info = {'device': '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432-lun-0', 'host': '8', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98321) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:722}}
May 28 10:05:44.504924 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [req-4afeeffc-a1f1-4852-bee9-04bd7fb38daf req-534801da-1e11-47f4-918d-6133b0f727e1 service nova] Starting size: 1073741824 {{(pid=98321) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:733}}
May 28 10:05:44.526650 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [req-4afeeffc-a1f1-4852-bee9-04bd7fb38daf req-534801da-1e11-47f4-918d-6133b0f727e1 service nova] volume size after scsi device rescan 2147483648 {{(pid=98321) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:739}}
May 28 10:05:44.536421 np0000001613 nova-compute[98321]: INFO os_brick.initiator.linuxscsi [req-4afeeffc-a1f1-4852-bee9-04bd7fb38daf req-534801da-1e11-47f4-918d-6133b0f727e1 service nova] Find Multipath device file for volume WWN 330000000145e8310
May 28 10:05:44.537061 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [req-4afeeffc-a1f1-4852-bee9-04bd7fb38daf req-534801da-1e11-47f4-918d-6133b0f727e1 service nova] Checking to see if /dev/disk/by-id/dm-uuid-mpath-330000000145e8310 exists yet. {{(pid=98321) wait_for_path /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:482}}
May 28 10:05:44.537406 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [req-4afeeffc-a1f1-4852-bee9-04bd7fb38daf req-534801da-1e11-47f4-918d-6133b0f727e1 service nova] /dev/disk/by-id/dm-uuid-mpath-330000000145e8310 has shown up. {{(pid=98321) wait_for_path /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:489}}
May 28 10:05:44.556535 np0000001613 nova-compute[98321]: INFO os_brick.initiator.linuxscsi [req-4afeeffc-a1f1-4852-bee9-04bd7fb38daf req-534801da-1e11-47f4-918d-6133b0f727e1 service nova] mpath(/dev/disk/by-id/dm-uuid-mpath-330000000145e8310) current size 1073741824
May 28 10:05:44.575898 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:44.589155 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Releasing lock "refresh_cache-3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:05:44.589640 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Instance network_info: |[{"id": "79f3ea8e-af7a-4778-8abc-96e97c5177f2", "address": "fa:16:3e:56:a4:d8", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f3ea8e-af", "ovs_interfaceid": "79f3ea8e-af7a-4778-8abc-96e97c5177f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:05:44.590422 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Start _get_guest_xml network_info=[{"id": "79f3ea8e-af7a-4778-8abc-96e97c5177f2", "address": "fa:16:3e:56:a4:d8", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f3ea8e-af", "ovs_interfaceid": "79f3ea8e-af7a-4778-8abc-96e97c5177f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d', 'iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '00ef829b-d202-4a0f-bd33-f9b98af4b31d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb', 'attached_at': '', 'detached_at': '', 'volume_id': '00ef829b-d202-4a0f-bd33-f9b98af4b31d', 'serial': '00ef829b-d202-4a0f-bd33-f9b98af4b31d'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '65c09173-5991-4a6d-8e28-555e33f27e2e', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:05:44.594231 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:05:44.595421 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-657476900', uuid='3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb'), owner=OwnerMeta(userid='ec58233d3b2848bbb2e0b00650398cd1', username='tempest-TestVolumeBootPattern-327944304-project-member', projectid='23e9651268114327a9cc6c6c59bef01e', projectname='tempest-TestVolumeBootPattern-327944304'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "79f3ea8e-af7a-4778-8abc-96e97c5177f2", "address": "fa:16:3e:56:a4:d8", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f3ea8e-af", "ovs_interfaceid": "79f3ea8e-af7a-4778-8abc-96e97c5177f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962744.5950634) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:05:44.597614 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:05:44.597948 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:05:44.598887 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:05:44.599023 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:05:44.599921 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:05:44.600221 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:05:44.600346 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:05:44.600450 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:05:44.600603 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:05:44.600686 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:05:44.600775 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:05:44.600934 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:05:44.601023 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:05:44.601123 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:05:44.601245 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:05:44.601356 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:05:44.612987 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:05:44.618332 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:05:44.618996 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d', 'iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '00ef829b-d202-4a0f-bd33-f9b98af4b31d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:05:44.619316 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:05:44.620082 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:05:44.620504 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d', 'iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '00ef829b-d202-4a0f-bd33-f9b98af4b31d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:05:44.626871 np0000001613 nova-compute[98321]: INFO os_brick.initiator.linuxscsi [req-4afeeffc-a1f1-4852-bee9-04bd7fb38daf req-534801da-1e11-47f4-918d-6133b0f727e1 service nova] mpath(/dev/disk/by-id/dm-uuid-mpath-330000000145e8310) new size 2147483648
May 28 10:05:44.627117 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [req-4afeeffc-a1f1-4852-bee9-04bd7fb38daf req-534801da-1e11-47f4-918d-6133b0f727e1 service nova] Lock "extend_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" :: held 0.285s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:05:44.627294 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [req-4afeeffc-a1f1-4852-bee9-04bd7fb38daf req-534801da-1e11-47f4-918d-6133b0f727e1 service nova] <== extend_volume: return (285ms) 2147483648 {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:05:44.627448 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [req-4afeeffc-a1f1-4852-bee9-04bd7fb38daf req-534801da-1e11-47f4-918d-6133b0f727e1 service nova] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Extend iSCSI Volume: new_size=2147483648 {{(pid=98321) extend_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:90}}
May 28 10:05:44.630004 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [req-4afeeffc-a1f1-4852-bee9-04bd7fb38daf req-534801da-1e11-47f4-918d-6133b0f727e1 service nova] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Resizing target device /dev/dm-0 to 2147483648 {{(pid=98321) _resize_attached_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2945}}
May 28 10:05:44.636272 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:05:44.637194 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:05:44.638350 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:05:44.638876 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:05:44.639305 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:05:44.639557 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:05:44.657002 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:05:44.657002 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:44.657787 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:05:44.657787 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:44.671514 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:05:44.673946 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d] added
May 28 10:05:44.673946 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:05:44.673946 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:05:44.673946 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:05:44.673946 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:05:44.673946 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:05:44.673946 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:44.673946 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:05:44.673946 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0344(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:05:44.673946 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:05:44.675899 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d] added
May 28 10:05:44.675899 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:05:44.675899 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:05:44.675899 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:05:44.675899 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:05:44.675899 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:05:44.675899 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:44.676783 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:05:44.677318 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0375(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:05:44.677318 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:05:44.677505 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:05:44.695483 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:05:44.696135 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:05:44.696269 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:05:44.696509 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:05:44.696769 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:05:44.697030 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:05:44.989183 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0004695579996223387 future=<Future at 0x73c1fc423e30 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:05:44.989183 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:05:44.989183 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=12.313826719999724 future=<Future at 0x73c1f4310950 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:05:44.989183 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=12.313715251999838 future=<Future at 0x73c1f4310950 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:05:44.989183 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Emitting event <LifecycleEvent: 1779962729.9873934, ca13ce1a-6de6-4923-a01c-e0b822b0e640 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:05:44.989183 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] VM Stopped (Lifecycle Event)
May 28 10:05:45.116737 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Took 1.75 seconds to deallocate network for instance.
May 28 10:05:45.180902 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:05:45.181491 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962745.181034, 11a2b3e7-1061-4a51-b520-113e13221658 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:05:45.181553 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] VM Paused (Lifecycle Event)
May 28 10:05:45.202228 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Took 7.76 seconds to spawn the instance on the hypervisor.
May 28 10:05:45.202378 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:05:45.460491 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-bda62ed9-3883-4746-aa60-2c7ceca34581 req-74fef791-6aed-4aec-8d23-14172bc5ae05 service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Received event network-vif-plugged-fd381175-d629-4ae4-b6a9-860af0c0aebf {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:05:45.460766 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-bda62ed9-3883-4746-aa60-2c7ceca34581 req-74fef791-6aed-4aec-8d23-14172bc5ae05 service nova] Acquiring lock "11a2b3e7-1061-4a51-b520-113e13221658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:45.460945 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-bda62ed9-3883-4746-aa60-2c7ceca34581 req-74fef791-6aed-4aec-8d23-14172bc5ae05 service nova] Lock "11a2b3e7-1061-4a51-b520-113e13221658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:45.461661 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-bda62ed9-3883-4746-aa60-2c7ceca34581 req-74fef791-6aed-4aec-8d23-14172bc5ae05 service nova] Lock "11a2b3e7-1061-4a51-b520-113e13221658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:45.461832 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-bda62ed9-3883-4746-aa60-2c7ceca34581 req-74fef791-6aed-4aec-8d23-14172bc5ae05 service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] No waiting events found dispatching network-vif-plugged-fd381175-d629-4ae4-b6a9-860af0c0aebf {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:05:45.461967 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-bda62ed9-3883-4746-aa60-2c7ceca34581 req-74fef791-6aed-4aec-8d23-14172bc5ae05 service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Received unexpected event network-vif-plugged-fd381175-d629-4ae4-b6a9-860af0c0aebf for instance with vm_state active and task_state None.
May 28 10:05:45.462096 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-bda62ed9-3883-4746-aa60-2c7ceca34581 req-74fef791-6aed-4aec-8d23-14172bc5ae05 service nova] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Received event network-vif-deleted-9df7e969-a155-41f1-9e30-c42f172029e4 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:05:45.495982 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: ca13ce1a-6de6-4923-a01c-e0b822b0e640] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:05:45.527193 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Acquiring lock "13636cda-9029-46e5-8305-ee3ea32ce0f7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:45.527403 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Lock "13636cda-9029-46e5-8305-ee3ea32ce0f7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:45.622138 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2072baf4-20c8-4c46-b4d8-1faa26acd9b3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:45.622314 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2072baf4-20c8-4c46-b4d8-1faa26acd9b3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:45.673753 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:05:45.677578 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:05:45.685082 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:05:45.686358 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:05:45.686358 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:45.689090 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962745.6884713, 11a2b3e7-1061-4a51-b520-113e13221658 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:05:45.689090 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] VM Resumed (Lifecycle Event)
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:05:45.696457 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:05:45.696457 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:45.705871 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:45.714388 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:45.716236 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Took 13.63 seconds to build instance.
May 28 10:05:45.722384 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:45.722384 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:45.722384 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:45.722384 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:45.722384 np0000001613 nova-compute[98321]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:45.722384 np0000001613 nova-compute[98321]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:45.722384 np0000001613 nova-compute[98321]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:45.722384 np0000001613 nova-compute[98321]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:45.722384 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:05:45.722763 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:45.722763 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:45.722763 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:45.722763 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:45.722763 np0000001613 nova-compute[98321]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:45.722763 np0000001613 nova-compute[98321]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:45.722763 np0000001613 nova-compute[98321]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:45.722763 np0000001613 nova-compute[98321]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:45.722763 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:05:45.734068 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:45.734068 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:45.734068 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:45.734068 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:45.734068 np0000001613 nova-compute[98321]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:45.734068 np0000001613 nova-compute[98321]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:45.734068 np0000001613 nova-compute[98321]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:45.734068 np0000001613 nova-compute[98321]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:45.734068 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:05:45.734633 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:45.734633 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:45.734633 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:45.734633 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:45.734633 np0000001613 nova-compute[98321]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:45.734633 np0000001613 nova-compute[98321]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:45.734633 np0000001613 nova-compute[98321]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:45.734633 np0000001613 nova-compute[98321]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:45.734633 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:05:45.735900 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f171c909-bc40-4472-a258-a4427bfa5b8b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.304s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:45.741038 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 7.974s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:45.771258 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d, portal: 192.168.40.100,3260]
May 28 10:05:45.771258 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d, portal: 192.168.40.100,3260] successful.
May 28 10:05:45.771258 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:45.786183 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:45.791283 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d, portal: 192.168.50.100,3260]
May 28 10:05:45.791283 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d, portal: 192.168.50.100,3260] successful.
May 28 10:05:45.791283 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:45.806522 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:45.806522 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:45.806522 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:45.806522 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:45.806522 np0000001613 nova-compute[98321]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:45.806522 np0000001613 nova-compute[98321]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:45.806522 np0000001613 nova-compute[98321]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:45.806522 np0000001613 nova-compute[98321]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:45.806522 np0000001613 nova-compute[98321]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:45.806522 np0000001613 nova-compute[98321]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:45.806522 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:05:45.806906 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:45.806906 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:45.806906 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:45.806906 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:45.806906 np0000001613 nova-compute[98321]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:45.806906 np0000001613 nova-compute[98321]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:45.806906 np0000001613 nova-compute[98321]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:45.806906 np0000001613 nova-compute[98321]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:45.806906 np0000001613 nova-compute[98321]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:45.806906 np0000001613 nova-compute[98321]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:45.806906 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:05:45.806906 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.169s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:05:45.807185 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:05:45.808094 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] HCTL ('15', '-', '-', 0) found on session 87 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:05:45.808255 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:05:45.812098 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:45.827621 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching for a device in session 87 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:05:45.827771 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '00ef829b-d202-4a0f-bd33-f9b98af4b31d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:05:45.835673 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:45.835673 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:45.835673 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:45.835673 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:45.835673 np0000001613 nova-compute[98321]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:45.835673 np0000001613 nova-compute[98321]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:45.835673 np0000001613 nova-compute[98321]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:45.835673 np0000001613 nova-compute[98321]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:45.835673 np0000001613 nova-compute[98321]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:45.835673 np0000001613 nova-compute[98321]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:45.835673 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:05:45.835951 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:45.835951 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:45.835951 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:45.835951 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:45.835951 np0000001613 nova-compute[98321]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:45.835951 np0000001613 nova-compute[98321]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:45.835951 np0000001613 nova-compute[98321]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:45.835951 np0000001613 nova-compute[98321]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:45.835951 np0000001613 nova-compute[98321]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:45.835951 np0000001613 nova-compute[98321]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:45.835951 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:05:45.836217 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.197s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:05:45.836390 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:05:45.837741 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] HCTL ('16', '-', '-', 0) found on session 88 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:05:45.837893 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:05:45.863322 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching for a device in session 88 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:05:45.863548 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '00ef829b-d202-4a0f-bd33-f9b98af4b31d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:05:46.030383 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Detaching volume fa48ecee-1baa-40a8-9b99-bd2729ebd432
May 28 10:05:46.077826 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Attempting to driver detach volume fa48ecee-1baa-40a8-9b99-bd2729ebd432 from mountpoint /dev/vdb
May 28 10:05:46.081685 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Found disk vdb by alias ua-fa48ecee-1baa-40a8-9b99-bd2729ebd432 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:05:46.082774 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Found disk vdb by alias ua-fa48ecee-1baa-40a8-9b99-bd2729ebd432 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:05:46.082913 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Attempting to detach device vdb from instance 13636cda-9029-46e5-8305-ee3ea32ce0f7 from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 10:05:46.083189 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:05:46.083189 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:05:46.083189 np0000001613 nova-compute[98321]:   <alias name="ua-fa48ecee-1baa-40a8-9b99-bd2729ebd432"/>
May 28 10:05:46.083189 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-0"/>
May 28 10:05:46.083189 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:05:46.083189 np0000001613 nova-compute[98321]:   <serial>fa48ecee-1baa-40a8-9b99-bd2729ebd432</serial>
May 28 10:05:46.083189 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:05:46.083189 np0000001613 nova-compute[98321]: </disk>
May 28 10:05:46.083189 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:05:46.095200 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Successfully detached device vdb from instance 13636cda-9029-46e5-8305-ee3ea32ce0f7 from the persistent domain config.
May 28 10:05:46.095200 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] (1/8): Attempting to detach device vdb with device alias ua-fa48ecee-1baa-40a8-9b99-bd2729ebd432 from instance 13636cda-9029-46e5-8305-ee3ea32ce0f7 from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 10:05:46.095200 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:05:46.095200 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:05:46.095200 np0000001613 nova-compute[98321]:   <alias name="ua-fa48ecee-1baa-40a8-9b99-bd2729ebd432"/>
May 28 10:05:46.095200 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-0"/>
May 28 10:05:46.095200 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:05:46.095200 np0000001613 nova-compute[98321]:   <serial>fa48ecee-1baa-40a8-9b99-bd2729ebd432</serial>
May 28 10:05:46.095200 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:05:46.095200 np0000001613 nova-compute[98321]: </disk>
May 28 10:05:46.095200 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:05:46.191481 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:05:46.194120 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:05:46.219149 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "11a2b3e7-1061-4a51-b520-113e13221658" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.150s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:46.221183 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "11a2b3e7-1061-4a51-b520-113e13221658" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 8.423s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:46.221183 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
May 28 10:05:46.221183 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "11a2b3e7-1061-4a51-b520-113e13221658" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:46.246506 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.505s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:46.336267 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2072baf4-20c8-4c46-b4d8-1faa26acd9b3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:05:46.336537 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-2072baf4-20c8-4c46-b4d8-1faa26acd9b3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:05:46.639552 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:05:46.654968 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-fa48ecee-1baa-40a8-9b99-bd2729ebd432 for instance 13636cda-9029-46e5-8305-ee3ea32ce0f7 {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 10:05:46.697952 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779962746.6973715, 13636cda-9029-46e5-8305-ee3ea32ce0f7 => ua-fa48ecee-1baa-40a8-9b99-bd2729ebd432> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 10:05:46.701730 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Successfully detached device vdb from instance 13636cda-9029-46e5-8305-ee3ea32ce0f7 from the live domain config.
May 28 10:05:46.704012 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:05:46.704684 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432', 'iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fa48ecee-1baa-40a8-9b99-bd2729ebd432', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:05:46.704852 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:05:46.841815 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Acquiring lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:46.842552 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:46.843800 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-2072baf4-20c8-4c46-b4d8-1faa26acd9b3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:05:47.350512 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lazy-loading 'flavor' on Instance uuid cc75b5c9-a7ad-4a7c-aff0-336c8e64b120 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:05:47.352720 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2072baf4-20c8-4c46-b4d8-1faa26acd9b3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.730s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:47.415272 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-2072baf4-20c8-4c46-b4d8-1faa26acd9b3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Deleted allocations for instance de9742b9-43db-40a6-b635-81d9244fd5e0
May 28 10:05:47.520277 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-98143ba1-0861-4473-865f-b0d87edd6397 req-f5cd10a6-f42a-4a9c-ab68-065c47455432 service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Received event network-changed-fd381175-d629-4ae4-b6a9-860af0c0aebf {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:05:47.520744 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-98143ba1-0861-4473-865f-b0d87edd6397 req-f5cd10a6-f42a-4a9c-ab68-065c47455432 service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Refreshing instance network info cache due to event network-changed-fd381175-d629-4ae4-b6a9-860af0c0aebf. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:05:47.520967 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-98143ba1-0861-4473-865f-b0d87edd6397 req-f5cd10a6-f42a-4a9c-ab68-065c47455432 service nova] Acquiring lock "refresh_cache-11a2b3e7-1061-4a51-b520-113e13221658" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:05:47.521097 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-98143ba1-0861-4473-865f-b0d87edd6397 req-f5cd10a6-f42a-4a9c-ab68-065c47455432 service nova] Acquired lock "refresh_cache-11a2b3e7-1061-4a51-b520-113e13221658" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:05:47.521266 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-98143ba1-0861-4473-865f-b0d87edd6397 req-f5cd10a6-f42a-4a9c-ab68-065c47455432 service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Refreshing network info cache for port fd381175-d629-4ae4-b6a9-860af0c0aebf {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:05:47.655254 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Found WWN 3300000000766efd1 for multipath device dm-3 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:05:47.655866 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:05:47.656466 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.952s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:05:47.656833 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432', 'iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fa48ecee-1baa-40a8-9b99-bd2729ebd432', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:05:47.657037 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:05:47.657596 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '3300000000766efd1', 'path': '/dev/disk/by-id/os-brick+dev+dm-3', 'multipath_id': '3300000000766efd1'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:05:47.657979 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000766efd1', 'path': '/dev/disk/by-id/os-brick+dev+dm-3', 'multipath_id': '3300000000766efd1'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:05:47.689885 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:47.689885 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:47.689885 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:47.689885 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:47.689885 np0000001613 nova-compute[98321]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:47.689885 np0000001613 nova-compute[98321]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:47.689885 np0000001613 nova-compute[98321]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:47.689885 np0000001613 nova-compute[98321]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:47.689885 np0000001613 nova-compute[98321]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:47.689885 np0000001613 nova-compute[98321]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:47.689885 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:05:47.690102 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:47.690102 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:47.690102 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:47.690102 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:47.690102 np0000001613 nova-compute[98321]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:47.690102 np0000001613 nova-compute[98321]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432 (non-flash)
May 28 10:05:47.690102 np0000001613 nova-compute[98321]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:47.690102 np0000001613 nova-compute[98321]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:47.690102 np0000001613 nova-compute[98321]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:47.690102 np0000001613 nova-compute[98321]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:47.690102 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:05:47.690301 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e', '79'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e', '80'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432', '83'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432', '84'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7', '85'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7', '86'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d', '88')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:05:47.690361 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432', '83')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:05:47.692516 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d', 'iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '00ef829b-d202-4a0f-bd33-f9b98af4b31d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-3'}, 'status': 'reserved', 'instance': '3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb', 'attached_at': '', 'detached_at': '', 'volume_id': '00ef829b-d202-4a0f-bd33-f9b98af4b31d', 'serial': '00ef829b-d202-4a0f-bd33-f9b98af4b31d'} {{(pid=98321) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 10:05:47.693062 np0000001613 nova-compute[98321]: WARNING stevedore.named [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 10:05:47.693293 np0000001613 nova-compute[98321]: WARNING castellan.key_manager [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 10:05:47.694175 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432', '84')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:05:47.696130 np0000001613 nova-compute[98321]: WARNING nova.keymgr.conf_key_mgr [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 10:05:47.697938 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1f40dd300>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432'): ({'sdc'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:05:47.698143 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Removing multipathed devices sdb, sdc {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:05:47.698384 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Flush multipath device 330000000145e8310 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:05:47.717549 np0000001613 nova-compute[98321]: WARNING os_brick.encryptors.luks [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 28 10:05:47.717654 np0000001613 nova-compute[98321]: WARNING stevedore.named [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 10:05:47.717827 np0000001613 nova-compute[98321]: WARNING castellan.key_manager [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 10:05:47.717970 np0000001613 nova-compute[98321]: WARNING nova.keymgr.conf_key_mgr [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 10:05:47.718452 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x73c1f4218cb0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d', 'iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '00ef829b-d202-4a0f-bd33-f9b98af4b31d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-3'}, 'status': 'reserved', 'instance': '3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb', 'attached_at': '', 'detached_at': '', 'volume_id': '00ef829b-d202-4a0f-bd33-f9b98af4b31d', 'serial': '00ef829b-d202-4a0f-bd33-f9b98af4b31d'} {{(pid=98321) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 10:05:47.718574 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors.luks [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] formatting encrypted volume /dev/dm-3 {{(pid=98321) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 28 10:05:47.745680 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:05:47.787086 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:05:47.828570 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:05:47.828682 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:05:47.828966 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:47.830747 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:05:47.846195 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:05:47.846467 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:05:47.864519 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:47.897677 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 83, target: iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432, portal: 192.168.40.100,3260]
May 28 10:05:47.897677 np0000001613 nova-compute[98321]: Logout of [sid: 83, target: iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432, portal: 192.168.40.100,3260] successful.
May 28 10:05:47.897677 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:47.925404 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:47.945189 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:47.987972 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 84, target: iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432, portal: 192.168.50.100,3260]
May 28 10:05:47.987972 np0000001613 nova-compute[98321]: Logout of [sid: 84, target: iqn.2023-03.storpool.com:os--volume-fa48ecee-1baa-40a8-9b99-bd2729ebd432, portal: 192.168.50.100,3260] successful.
May 28 10:05:47.987972 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:48.016611 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:48.017180 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:05:48.017180 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] <== disconnect_volume: return (1312ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:05:48.017180 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:05:48.025502 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-98143ba1-0861-4473-865f-b0d87edd6397 req-f5cd10a6-f42a-4a9c-ab68-065c47455432 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:48.356762 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.514s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:48.426924 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2072baf4-20c8-4c46-b4d8-1faa26acd9b3 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "de9742b9-43db-40a6-b635-81d9244fd5e0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.994s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:48.459286 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-98143ba1-0861-4473-865f-b0d87edd6397 req-f5cd10a6-f42a-4a9c-ab68-065c47455432 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:48.596490 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Lazy-loading 'flavor' on Instance uuid 13636cda-9029-46e5-8305-ee3ea32ce0f7 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:05:48.618916 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-98143ba1-0861-4473-865f-b0d87edd6397 req-f5cd10a6-f42a-4a9c-ab68-065c47455432 service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Updated VIF entry in instance network info cache for port fd381175-d629-4ae4-b6a9-860af0c0aebf. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:05:48.619474 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-98143ba1-0861-4473-865f-b0d87edd6397 req-f5cd10a6-f42a-4a9c-ab68-065c47455432 service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Updating instance_info_cache with network_info: [{"id": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "address": "fa:16:3e:b5:7a:19", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd381175-d6", "ovs_interfaceid": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:05:48.856800 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-880f2c94-73e2-4d8c-88a1-7ab117ddeb2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "36fde791-779f-42a8-9aef-87eafbbe0370" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:48.857064 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-880f2c94-73e2-4d8c-88a1-7ab117ddeb2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "36fde791-779f-42a8-9aef-87eafbbe0370" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:48.857403 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-880f2c94-73e2-4d8c-88a1-7ab117ddeb2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "36fde791-779f-42a8-9aef-87eafbbe0370-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:48.857541 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-880f2c94-73e2-4d8c-88a1-7ab117ddeb2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "36fde791-779f-42a8-9aef-87eafbbe0370-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:48.857702 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-880f2c94-73e2-4d8c-88a1-7ab117ddeb2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "36fde791-779f-42a8-9aef-87eafbbe0370-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:48.862209 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-880f2c94-73e2-4d8c-88a1-7ab117ddeb2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Terminating instance
May 28 10:05:49.123044 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-98143ba1-0861-4473-865f-b0d87edd6397 req-f5cd10a6-f42a-4a9c-ab68-065c47455432 service nova] Releasing lock "refresh_cache-11a2b3e7-1061-4a51-b520-113e13221658" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:05:49.372315 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-880f2c94-73e2-4d8c-88a1-7ab117ddeb2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:05:49.403335 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:49.404281 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:49.434921 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:49.445904 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Acquiring lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:49.446092 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:49.446878 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Attaching volume 3a1e5674-04a4-4eb3-be73-5104b2fc0204 to /dev/vdc
May 28 10:05:49.515476 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:05:49.531243 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:05:49.568041 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:49.604853 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:49.618240 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-76f4635f-9a9b-4e67-88e2-64dd83b0ffaa tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Lock "13636cda-9029-46e5-8305-ee3ea32ce0f7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.089s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:49.628416 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c7c496e9-27df-4e47-b2ee-e94f8823a7cc req-b3eea3c7-bc43-4cb9-a6e1-4cde89828d6d service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Received event network-vif-unplugged-0e857900-174b-46cf-bfa1-ce7f2f8ffdb1 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:05:49.628416 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c7c496e9-27df-4e47-b2ee-e94f8823a7cc req-b3eea3c7-bc43-4cb9-a6e1-4cde89828d6d service nova] Acquiring lock "36fde791-779f-42a8-9aef-87eafbbe0370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:49.628416 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c7c496e9-27df-4e47-b2ee-e94f8823a7cc req-b3eea3c7-bc43-4cb9-a6e1-4cde89828d6d service nova] Lock "36fde791-779f-42a8-9aef-87eafbbe0370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:49.628416 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c7c496e9-27df-4e47-b2ee-e94f8823a7cc req-b3eea3c7-bc43-4cb9-a6e1-4cde89828d6d service nova] Lock "36fde791-779f-42a8-9aef-87eafbbe0370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:49.628416 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c7c496e9-27df-4e47-b2ee-e94f8823a7cc req-b3eea3c7-bc43-4cb9-a6e1-4cde89828d6d service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] No waiting events found dispatching network-vif-unplugged-0e857900-174b-46cf-bfa1-ce7f2f8ffdb1 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:05:49.628416 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c7c496e9-27df-4e47-b2ee-e94f8823a7cc req-b3eea3c7-bc43-4cb9-a6e1-4cde89828d6d service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Received event network-vif-unplugged-0e857900-174b-46cf-bfa1-ce7f2f8ffdb1 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:05:49.636883 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:05:49.637067 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:05:49.640935 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:49.647990 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:49.655467 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:05:49.657383 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fefd:30e7', 'fe80::e4df:c0ff:fe86:6341', 'fe80::fc16:3eff:fedb:1077', 'fe80::fc16:3eff:fe3c:b7e1', 'fe80::fc16:3eff:fe9c:7606', 'fe80::e867:17ff:fe2f:2260', 'fe80::fc16:3eff:fea8:baad', 'fe80::3c2b:beff:fe36:4b2a', 'fe80::fc16:3eff:fe04:ca46', 'fe80::ec4e:cbff:fea7:f945', 'fe80::fc16:3eff:feb9:512c', 'fe80::1c9e:daff:fee5:c4bc', 'fe80::fc16:3eff:fe08:3107', 'fe80::e02b:1cff:fec7:1a41', 'fe80::fc16:3eff:feb5:7a19', 'fe80::d42a:61ff:fe18:5003'] 
May 28 10:05:49.657710 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:05:49.657798 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:05:49.658116 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:05:49.658375 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Updating existing volume attachment record: d0976506-dde2-45fd-976e-08840a73ee40 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:05:49.705510 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:49.720290 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:49.736526 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999633187999734 future=<Future at 0x73c1f4361850 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:05:49.739145 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Instance destroyed successfully.
May 28 10:05:49.739793 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-880f2c94-73e2-4d8c-88a1-7ab117ddeb2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lazy-loading 'resources' on Instance uuid 36fde791-779f-42a8-9aef-87eafbbe0370 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:05:49.812649 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-81ae8ec7-211c-4ead-8be8-17635fad30e1 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Acquiring lock "13636cda-9029-46e5-8305-ee3ea32ce0f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:49.812915 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-81ae8ec7-211c-4ead-8be8-17635fad30e1 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Lock "13636cda-9029-46e5-8305-ee3ea32ce0f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:49.813217 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-81ae8ec7-211c-4ead-8be8-17635fad30e1 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Acquiring lock "13636cda-9029-46e5-8305-ee3ea32ce0f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:49.813396 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-81ae8ec7-211c-4ead-8be8-17635fad30e1 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Lock "13636cda-9029-46e5-8305-ee3ea32ce0f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:49.813520 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-81ae8ec7-211c-4ead-8be8-17635fad30e1 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Lock "13636cda-9029-46e5-8305-ee3ea32ce0f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:49.816899 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-81ae8ec7-211c-4ead-8be8-17635fad30e1 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Terminating instance
May 28 10:05:50.242929 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-880f2c94-73e2-4d8c-88a1-7ab117ddeb2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:01:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001613',hostname='multiattach-server-0',id=30,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrmebBJn1C7uIkB9JjrF4yuEuto77kf4SaBedfdmOdQwZzJyqrVQd0Wq/SA1eDV6FpWwBB4BKjLBcFgkvBrXSx4LeKHMUic/tPGA5px/F625klLXypbV+9p49FvQ4XImQ==',key_name='tempest-keypair-2082049331',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:03:19Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3403b533910644d2b254922fb84b1ac0',ramdisk_id='',reservation_id='r-apelrt3z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1052626787',owner_user_name='tempest-AttachVolumeMultiAttachTest-1052626787-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:03:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13481913e22d4bf1a94e1a9a270f5494',uuid=36fde791-779f-42a8-9aef-87eafbbe0370,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "address": "fa:16:3e:e1:06:59", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e857900-17", "ovs_interfaceid": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:05:50.242929 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-880f2c94-73e2-4d8c-88a1-7ab117ddeb2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converting VIF {"id": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "address": "fa:16:3e:e1:06:59", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e857900-17", "ovs_interfaceid": "0e857900-174b-46cf-bfa1-ce7f2f8ffdb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:05:50.243752 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-880f2c94-73e2-4d8c-88a1-7ab117ddeb2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:06:59,bridge_name='br-int',has_traffic_filtering=True,id=0e857900-174b-46cf-bfa1-ce7f2f8ffdb1,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e857900-17') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:05:50.244353 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-880f2c94-73e2-4d8c-88a1-7ab117ddeb2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:06:59,bridge_name='br-int',has_traffic_filtering=True,id=0e857900-174b-46cf-bfa1-ce7f2f8ffdb1,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e857900-17') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:05:50.248215 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:50.248493 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e857900-17, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:50.250181 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:50.251545 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:05:50.252078 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:05:50.252560 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204', 'iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3a1e5674-04a4-4eb3-be73-5104b2fc0204', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:05:50.252978 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:05:50.253815 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:50.254018 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0cc65507-daf4-4bed-8eea-7dabf04c43b6) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:50.254556 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:05:50.254908 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204', 'iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3a1e5674-04a4-4eb3-be73-5104b2fc0204', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:05:50.255202 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:50.257608 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:05:50.258563 np0000001613 nova-compute[98321]: INFO os_vif [None req-880f2c94-73e2-4d8c-88a1-7ab117ddeb2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:06:59,bridge_name='br-int',has_traffic_filtering=True,id=0e857900-174b-46cf-bfa1-ce7f2f8ffdb1,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e857900-17')
May 28 10:05:50.258979 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-880f2c94-73e2-4d8c-88a1-7ab117ddeb2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Deleting instance files /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370_del
May 28 10:05:50.266449 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:05:50.267100 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:05:50.267641 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:05:50.267870 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:05:50.268435 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:05:50.269317 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:05:50.269874 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-880f2c94-73e2-4d8c-88a1-7ab117ddeb2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Deletion of /opt/stack/data/nova/instances/36fde791-779f-42a8-9aef-87eafbbe0370_del complete
May 28 10:05:50.283826 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:05:50.283826 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:50.291364 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:05:50.291364 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:50.301402 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204] added
May 28 10:05:50.301402 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:05:50.301402 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:05:50.301402 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:05:50.301402 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:05:50.301402 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:05:50.301402 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:50.301747 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:05:50.301802 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0339(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:05:50.301992 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:05:50.308198 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204] added
May 28 10:05:50.308198 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:05:50.308198 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:05:50.308198 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:05:50.308198 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:05:50.308198 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:05:50.308198 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:50.308474 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:05:50.308615 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0393(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:05:50.308794 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:05:50.321331 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-81ae8ec7-211c-4ead-8be8-17635fad30e1 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:05:50.345014 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:50.346767 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:50.376436 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:50.403913 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:50.529695 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-904148e5-354d-4374-a035-65277485aedb req-a1b5470e-3aa7-4c1d-8ef0-ff5f62259b47 service nova] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Received event network-vif-unplugged-7875c736-bfcd-45e2-9f9d-0d17da37b90c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:05:50.529913 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-904148e5-354d-4374-a035-65277485aedb req-a1b5470e-3aa7-4c1d-8ef0-ff5f62259b47 service nova] Acquiring lock "13636cda-9029-46e5-8305-ee3ea32ce0f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:50.530066 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-904148e5-354d-4374-a035-65277485aedb req-a1b5470e-3aa7-4c1d-8ef0-ff5f62259b47 service nova] Lock "13636cda-9029-46e5-8305-ee3ea32ce0f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:50.530194 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-904148e5-354d-4374-a035-65277485aedb req-a1b5470e-3aa7-4c1d-8ef0-ff5f62259b47 service nova] Lock "13636cda-9029-46e5-8305-ee3ea32ce0f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:50.530313 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-904148e5-354d-4374-a035-65277485aedb req-a1b5470e-3aa7-4c1d-8ef0-ff5f62259b47 service nova] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] No waiting events found dispatching network-vif-unplugged-7875c736-bfcd-45e2-9f9d-0d17da37b90c {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:05:50.530425 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-904148e5-354d-4374-a035-65277485aedb req-a1b5470e-3aa7-4c1d-8ef0-ff5f62259b47 service nova] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Received event network-vif-unplugged-7875c736-bfcd-45e2-9f9d-0d17da37b90c for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:05:50.634703 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:50.644127 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:50.668479 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999693068999932 future=<Future at 0x73c1f43cc620 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:05:50.671816 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Instance destroyed successfully.
May 28 10:05:50.672408 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-81ae8ec7-211c-4ead-8be8-17635fad30e1 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Lazy-loading 'resources' on Instance uuid 13636cda-9029-46e5-8305-ee3ea32ce0f7 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:05:50.775968 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-880f2c94-73e2-4d8c-88a1-7ab117ddeb2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Took 1.40 seconds to destroy the instance on the hypervisor.
May 28 10:05:50.776547 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-880f2c94-73e2-4d8c-88a1-7ab117ddeb2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:05:50.776957 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:05:50.777118 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:05:50.777423 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:50.847023 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:51.174874 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-81ae8ec7-211c-4ead-8be8-17635fad30e1 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:04:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-1645121584',display_name='tempest-VolumesExtendAttachedTest-instance-1645121584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumesextendattachedtest-instance-1645121584',id=38,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiPfw2oeOh6wfeXCY6HJehDBOgghVXL0YQ8baRxSQUTlv4N6rLJXoyb4vDj0LVZfuesDpMEMbp2Y9KK64Ur3pxa0SmbFrNgX/36knFWVLl73/9Bu7shRQFBqcJ3+oHW9Q==',key_name='tempest-keypair-655911425',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:04:53Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7ac26283162468aa1d9b9563114b43f',ramdisk_id='',reservation_id='r-8hq7p29u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesExtendAttachedTest-1071205551',owner_user_name='tempest-VolumesExtendAttachedTest-1071205551-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:04:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23a911d56ea541538a02e7a32dbdbc3c',uuid=13636cda-9029-46e5-8305-ee3ea32ce0f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7875c736-bfcd-45e2-9f9d-0d17da37b90c", "address": "fa:16:3e:a8:ba:ad", "network": {"id": "b952947c-9dfe-4b64-ba35-8ea7334cf4dd", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1051915270-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7ac26283162468aa1d9b9563114b43f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7875c736-bf", "ovs_interfaceid": "7875c736-bfcd-45e2-9f9d-0d17da37b90c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:05:51.175222 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-81ae8ec7-211c-4ead-8be8-17635fad30e1 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Converting VIF {"id": "7875c736-bfcd-45e2-9f9d-0d17da37b90c", "address": "fa:16:3e:a8:ba:ad", "network": {"id": "b952947c-9dfe-4b64-ba35-8ea7334cf4dd", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1051915270-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f7ac26283162468aa1d9b9563114b43f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7875c736-bf", "ovs_interfaceid": "7875c736-bfcd-45e2-9f9d-0d17da37b90c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:05:51.175909 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-81ae8ec7-211c-4ead-8be8-17635fad30e1 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:ba:ad,bridge_name='br-int',has_traffic_filtering=True,id=7875c736-bfcd-45e2-9f9d-0d17da37b90c,network=Network(b952947c-9dfe-4b64-ba35-8ea7334cf4dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7875c736-bf') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:05:51.176223 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-81ae8ec7-211c-4ead-8be8-17635fad30e1 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:ba:ad,bridge_name='br-int',has_traffic_filtering=True,id=7875c736-bfcd-45e2-9f9d-0d17da37b90c,network=Network(b952947c-9dfe-4b64-ba35-8ea7334cf4dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7875c736-bf') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:05:51.180651 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4718b880-33bb-4a13-bf59-e43719067ba2 req-838ae676-039b-48cf-b057-bb9e4cdb6b4a service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Received event network-vif-deleted-0e857900-174b-46cf-bfa1-ce7f2f8ffdb1 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:05:51.180949 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-4718b880-33bb-4a13-bf59-e43719067ba2 req-838ae676-039b-48cf-b057-bb9e4cdb6b4a service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Neutron deleted interface 0e857900-174b-46cf-bfa1-ce7f2f8ffdb1; detaching it from the instance and deleting it from the info cache
May 28 10:05:51.182390 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:51.182631 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7875c736-bf, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:51.183766 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4718b880-33bb-4a13-bf59-e43719067ba2 req-838ae676-039b-48cf-b057-bb9e4cdb6b4a service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Detach interface failed, port_id=0e857900-174b-46cf-bfa1-ce7f2f8ffdb1, reason: Instance 36fde791-779f-42a8-9aef-87eafbbe0370 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:05:51.187693 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:05:51.188397 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:51.188563 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2bd4a350-8dc6-48cd-a83f-90ce3f1550f2) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:51.189184 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:51.189747 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:05:51.192130 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:51.195137 np0000001613 nova-compute[98321]: INFO os_vif [None req-81ae8ec7-211c-4ead-8be8-17635fad30e1 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:ba:ad,bridge_name='br-int',has_traffic_filtering=True,id=7875c736-bfcd-45e2-9f9d-0d17da37b90c,network=Network(b952947c-9dfe-4b64-ba35-8ea7334cf4dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7875c736-bf')
May 28 10:05:51.195499 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-81ae8ec7-211c-4ead-8be8-17635fad30e1 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Deleting instance files /opt/stack/data/nova/instances/13636cda-9029-46e5-8305-ee3ea32ce0f7_del
May 28 10:05:51.196336 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-81ae8ec7-211c-4ead-8be8-17635fad30e1 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Deletion of /opt/stack/data/nova/instances/13636cda-9029-46e5-8305-ee3ea32ce0f7_del complete
May 28 10:05:51.302457 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:05:51.309336 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:05:51.320595 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:05:51.320595 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:05:51.330385 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:05:51.330385 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:51.336523 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:51.343661 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:51.356760 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:51.356760 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:51.356760 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:51.356760 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:51.356760 np0000001613 nova-compute[98321]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:51.356760 np0000001613 nova-compute[98321]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:51.356760 np0000001613 nova-compute[98321]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:51.356760 np0000001613 nova-compute[98321]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:51.356760 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:05:51.357073 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:51.357073 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:51.357073 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:51.357073 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:51.357073 np0000001613 nova-compute[98321]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:51.357073 np0000001613 nova-compute[98321]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:51.357073 np0000001613 nova-compute[98321]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:51.357073 np0000001613 nova-compute[98321]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:51.357073 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:05:51.366025 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:51.366025 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:51.366025 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:51.366025 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:51.366025 np0000001613 nova-compute[98321]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:51.366025 np0000001613 nova-compute[98321]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:51.366025 np0000001613 nova-compute[98321]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:51.366025 np0000001613 nova-compute[98321]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:51.366025 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:05:51.366384 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:51.366384 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:51.366384 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:51.366384 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:51.366384 np0000001613 nova-compute[98321]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:51.366384 np0000001613 nova-compute[98321]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:51.366384 np0000001613 nova-compute[98321]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:51.366384 np0000001613 nova-compute[98321]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:51.366384 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:05:51.419943 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204, portal: 192.168.40.100,3260]
May 28 10:05:51.419943 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204, portal: 192.168.40.100,3260] successful.
May 28 10:05:51.419943 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:51.420731 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204, portal: 192.168.50.100,3260]
May 28 10:05:51.420731 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204, portal: 192.168.50.100,3260] successful.
May 28 10:05:51.420731 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:51.434498 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:51.446027 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:51.458937 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:51.458937 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:51.458937 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:51.458937 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:51.458937 np0000001613 nova-compute[98321]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:51.458937 np0000001613 nova-compute[98321]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:51.458937 np0000001613 nova-compute[98321]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:51.458937 np0000001613 nova-compute[98321]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:51.458937 np0000001613 nova-compute[98321]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:05:51.458937 np0000001613 nova-compute[98321]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:05:51.458937 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:05:51.459304 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:51.459304 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:51.459304 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:51.459304 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:51.459304 np0000001613 nova-compute[98321]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:51.459304 np0000001613 nova-compute[98321]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:51.459304 np0000001613 nova-compute[98321]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:51.459304 np0000001613 nova-compute[98321]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:51.459304 np0000001613 nova-compute[98321]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:05:51.459304 np0000001613 nova-compute[98321]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:05:51.459304 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:05:51.459570 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.191s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:05:51.459644 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:05:51.460751 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] HCTL ('8', '-', '-', 0) found on session 90 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:05:51.460917 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:05:51.462955 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:51.462955 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:51.462955 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:51.462955 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:51.462955 np0000001613 nova-compute[98321]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:51.462955 np0000001613 nova-compute[98321]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:51.462955 np0000001613 nova-compute[98321]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:51.462955 np0000001613 nova-compute[98321]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:51.462955 np0000001613 nova-compute[98321]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:05:51.462955 np0000001613 nova-compute[98321]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:05:51.462955 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:05:51.463247 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:51.463247 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:51.463247 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:51.463247 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:51.463247 np0000001613 nova-compute[98321]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:51.463247 np0000001613 nova-compute[98321]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:51.463247 np0000001613 nova-compute[98321]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:51.463247 np0000001613 nova-compute[98321]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:51.463247 np0000001613 nova-compute[98321]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:05:51.463247 np0000001613 nova-compute[98321]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:05:51.463247 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:05:51.463648 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.196s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:05:51.463951 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:05:51.465491 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] HCTL ('7', '-', '-', 0) found on session 89 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:05:51.465609 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:05:51.481634 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Searching for a device in session 90 and hctl ['8', '*', '*', 0] yield: None {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:05:51.495488 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Searching for a device in session 89 and hctl ['7', '*', '*', 0] yield: sdc {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:05:51.495488 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3a1e5674-04a4-4eb3-be73-5104b2fc0204', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:05:51.629038 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:05:51.704475 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-81ae8ec7-211c-4ead-8be8-17635fad30e1 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Took 1.38 seconds to destroy the instance on the hypervisor.
May 28 10:05:51.706207 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-669aaf2c-32af-4afb-bdb4-b9af6b16cc4c req-dcb9b8b1-bdd7-42bf-963a-bfa5b2442915 service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Received event network-vif-unplugged-0e857900-174b-46cf-bfa1-ce7f2f8ffdb1 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:05:51.712199 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-81ae8ec7-211c-4ead-8be8-17635fad30e1 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:05:51.712199 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:05:51.712464 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-669aaf2c-32af-4afb-bdb4-b9af6b16cc4c req-dcb9b8b1-bdd7-42bf-963a-bfa5b2442915 service nova] Acquiring lock "36fde791-779f-42a8-9aef-87eafbbe0370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:51.712576 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:05:51.713040 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-669aaf2c-32af-4afb-bdb4-b9af6b16cc4c req-dcb9b8b1-bdd7-42bf-963a-bfa5b2442915 service nova] Lock "36fde791-779f-42a8-9aef-87eafbbe0370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:51.713184 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:51.715093 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-669aaf2c-32af-4afb-bdb4-b9af6b16cc4c req-dcb9b8b1-bdd7-42bf-963a-bfa5b2442915 service nova] Lock "36fde791-779f-42a8-9aef-87eafbbe0370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:51.715343 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-669aaf2c-32af-4afb-bdb4-b9af6b16cc4c req-dcb9b8b1-bdd7-42bf-963a-bfa5b2442915 service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] No waiting events found dispatching network-vif-unplugged-0e857900-174b-46cf-bfa1-ce7f2f8ffdb1 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:05:51.715703 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-669aaf2c-32af-4afb-bdb4-b9af6b16cc4c req-dcb9b8b1-bdd7-42bf-963a-bfa5b2442915 service nova] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Received event network-vif-unplugged-0e857900-174b-46cf-bfa1-ce7f2f8ffdb1 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:05:51.790381 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:51.797193 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:05:51.797193 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:05:51.908863 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 10:05:51.908863 np0000001613 nova-compute[98321]:   <usage type="volume">
May 28 10:05:51.908863 np0000001613 nova-compute[98321]:     <volume>00ef829b-d202-4a0f-bd33-f9b98af4b31d</volume>
May 28 10:05:51.908863 np0000001613 nova-compute[98321]:   </usage>
May 28 10:05:51.908863 np0000001613 nova-compute[98321]: </secret>
May 28 10:05:51.908863 np0000001613 nova-compute[98321]:  {{(pid=98321) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 10:05:52.131833 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Took 1.35 seconds to deallocate network for instance.
May 28 10:05:52.303721 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:52.304040 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:52.304138 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:52.304310 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Auditing locally available compute resources for np0000001613 (node: np0000001613) {{(pid=98321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 10:05:52.420556 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:05:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-657476900',display_name='tempest-TestVolumeBootPattern-server-657476900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpattern-server-657476900',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23e9651268114327a9cc6c6c59bef01e',ramdisk_id='',reservation_id='r-yqmsyopk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-327944304',owner_user_name='tempest-TestVolumeBootPattern-327944304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:05:42Z,user_data=None,user_id='ec58233d3b2848bbb2e0b00650398cd1',uuid=3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79f3ea8e-af7a-4778-8abc-96e97c5177f2", "address": "fa:16:3e:56:a4:d8", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f3ea8e-af", "ovs_interfaceid": "79f3ea8e-af7a-4778-8abc-96e97c5177f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:05:52.421071 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converting VIF {"id": "79f3ea8e-af7a-4778-8abc-96e97c5177f2", "address": "fa:16:3e:56:a4:d8", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f3ea8e-af", "ovs_interfaceid": "79f3ea8e-af7a-4778-8abc-96e97c5177f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:05:52.421071 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:a4:d8,bridge_name='br-int',has_traffic_filtering=True,id=79f3ea8e-af7a-4778-8abc-96e97c5177f2,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79f3ea8e-af') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:05:52.421954 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:05:52.480736 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Searching for a device in session 90 and hctl ['8', '*', '*', 0] yield: sdb {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:05:52.480982 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3a1e5674-04a4-4eb3-be73-5104b2fc0204', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:05:52.609528 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-fd53b84c-27e1-4129-b806-70d15d1e508f req-7f540c13-6115-4e44-83b1-ab442fdab614 service nova] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Received event network-vif-unplugged-7875c736-bfcd-45e2-9f9d-0d17da37b90c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:05:52.609885 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-fd53b84c-27e1-4129-b806-70d15d1e508f req-7f540c13-6115-4e44-83b1-ab442fdab614 service nova] Acquiring lock "13636cda-9029-46e5-8305-ee3ea32ce0f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:52.610109 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-fd53b84c-27e1-4129-b806-70d15d1e508f req-7f540c13-6115-4e44-83b1-ab442fdab614 service nova] Lock "13636cda-9029-46e5-8305-ee3ea32ce0f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:52.610291 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-fd53b84c-27e1-4129-b806-70d15d1e508f req-7f540c13-6115-4e44-83b1-ab442fdab614 service nova] Lock "13636cda-9029-46e5-8305-ee3ea32ce0f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:52.611877 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-fd53b84c-27e1-4129-b806-70d15d1e508f req-7f540c13-6115-4e44-83b1-ab442fdab614 service nova] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] No waiting events found dispatching network-vif-unplugged-7875c736-bfcd-45e2-9f9d-0d17da37b90c {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:05:52.612044 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-fd53b84c-27e1-4129-b806-70d15d1e508f req-7f540c13-6115-4e44-83b1-ab442fdab614 service nova] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Received event network-vif-unplugged-7875c736-bfcd-45e2-9f9d-0d17da37b90c for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:05:52.612196 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-fd53b84c-27e1-4129-b806-70d15d1e508f req-7f540c13-6115-4e44-83b1-ab442fdab614 service nova] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Received event network-vif-deleted-7875c736-bfcd-45e2-9f9d-0d17da37b90c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:05:52.612344 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-fd53b84c-27e1-4129-b806-70d15d1e508f req-7f540c13-6115-4e44-83b1-ab442fdab614 service nova] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Neutron deleted interface 7875c736-bfcd-45e2-9f9d-0d17da37b90c; detaching it from the instance and deleting it from the info cache
May 28 10:05:52.614123 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-fd53b84c-27e1-4129-b806-70d15d1e508f req-7f540c13-6115-4e44-83b1-ab442fdab614 service nova] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Detach interface failed, port_id=7875c736-bfcd-45e2-9f9d-0d17da37b90c, reason: Instance 13636cda-9029-46e5-8305-ee3ea32ce0f7 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:05:52.644493 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-880f2c94-73e2-4d8c-88a1-7ab117ddeb2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:52.645874 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-880f2c94-73e2-4d8c-88a1-7ab117ddeb2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:52.769478 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:05:52.925933 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] End _get_guest_xml xml=<domain type="qemu">
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:   <uuid>3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb</uuid>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:   <name>instance-0000002b</name>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:       <nova:name>tempest-TestVolumeBootPattern-server-657476900</nova:name>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:05:44</nova:creationTime>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:       <nova:image uuid="">
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:         <nova:properties/>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:         <nova:user uuid="ec58233d3b2848bbb2e0b00650398cd1">tempest-TestVolumeBootPattern-327944304-project-member</nova:user>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:         <nova:project uuid="23e9651268114327a9cc6c6c59bef01e">tempest-TestVolumeBootPattern-327944304</nova:project>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:       <nova:root type="volume" uuid=""/>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:         <nova:port uuid="79f3ea8e-af7a-4778-8abc-96e97c5177f2">
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:     <system>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:       <entry name="serial">3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb</entry>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:       <entry name="uuid">3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb</entry>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:     </system>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:   <os>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:   </os>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:   <features>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:   </features>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:   <devices>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb/disk.config"/>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:     </disk>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:       <alias name="ua-00ef829b-d202-4a0f-bd33-f9b98af4b31d"/>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-3"/>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:       <serial>00ef829b-d202-4a0f-bd33-f9b98af4b31d</serial>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:       <encryption format="luks">
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:         <secret type="passphrase" uuid="eaab59a1-fa69-429d-b88e-11405f173bd9"/>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:       </encryption>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:     </disk>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:56:a4:d8"/>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:       <target dev="tap79f3ea8e-af"/>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:     </interface>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb/console.log" append="off"/>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:     </serial>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:     <video>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:     </video>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:     </rng>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:   </devices>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]: </domain>
May 28 10:05:52.925933 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:05:52.930375 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Preparing to wait for external event network-vif-plugged-79f3ea8e-af7a-4778-8abc-96e97c5177f2 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:05:52.930375 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:52.930375 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:52.930375 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:52.930375 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:05:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-657476900',display_name='tempest-TestVolumeBootPattern-server-657476900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpattern-server-657476900',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23e9651268114327a9cc6c6c59bef01e',ramdisk_id='',reservation_id='r-yqmsyopk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-327944304',owner_user_name='tempest-TestVolumeBootPattern-327944304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:05:42Z,user_data=None,user_id='ec58233d3b2848bbb2e0b00650398cd1',uuid=3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79f3ea8e-af7a-4778-8abc-96e97c5177f2", "address": "fa:16:3e:56:a4:d8", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f3ea8e-af", "ovs_interfaceid": "79f3ea8e-af7a-4778-8abc-96e97c5177f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:05:52.930375 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converting VIF {"id": "79f3ea8e-af7a-4778-8abc-96e97c5177f2", "address": "fa:16:3e:56:a4:d8", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f3ea8e-af", "ovs_interfaceid": "79f3ea8e-af7a-4778-8abc-96e97c5177f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:05:52.930375 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:a4:d8,bridge_name='br-int',has_traffic_filtering=True,id=79f3ea8e-af7a-4778-8abc-96e97c5177f2,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79f3ea8e-af') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:05:52.930375 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:a4:d8,bridge_name='br-int',has_traffic_filtering=True,id=79f3ea8e-af7a-4778-8abc-96e97c5177f2,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79f3ea8e-af') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:05:52.933744 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:52.934608 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:52.934730 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:05:52.939713 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:52.939713 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b9723089-df53-50a1-aeb0-cb59d9a76102', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:52.941786 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:52.941786 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:05:52.942445 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:52.946722 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:52.949380 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79f3ea8e-af, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:52.949380 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap79f3ea8e-af, col_values=(('qos', UUID('100602fd-c529-4cf9-8b6b-75c51cac59eb')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:52.949380 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap79f3ea8e-af, col_values=(('external_ids', {'iface-id': '79f3ea8e-af7a-4778-8abc-96e97c5177f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:a4:d8', 'vm-uuid': '3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:52.951733 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:05:52.957350 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:52.958984 np0000001613 nova-compute[98321]: INFO os_vif [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:a4:d8,bridge_name='br-int',has_traffic_filtering=True,id=79f3ea8e-af7a-4778-8abc-96e97c5177f2,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79f3ea8e-af')
May 28 10:05:53.272508 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Took 1.56 seconds to deallocate network for instance.
May 28 10:05:53.295193 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Found WWN 330000000eec54f4f for multipath device dm-0 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:05:53.295396 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:05:53.295631 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] <== connect_volume: return (3042ms) {'type': 'block', 'scsi_wwn': '330000000eec54f4f', 'path': '/dev/dm-0', 'multipath_id': '330000000eec54f4f'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:05:53.295852 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000eec54f4f', 'path': '/dev/dm-0', 'multipath_id': '330000000eec54f4f'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:05:53.302299 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lazy-loading 'flavor' on Instance uuid cc75b5c9-a7ad-4a7c-aff0-336c8e64b120 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:05:53.351273 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-880f2c94-73e2-4d8c-88a1-7ab117ddeb2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:05:53.351273 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-880f2c94-73e2-4d8c-88a1-7ab117ddeb2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:05:53.353190 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:53.480511 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:05:53.481214 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:53.578809 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:05:53.583985 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3edc00a8-2c60-4c44-acb8-6f4d02114bf0/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:53.705158 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3edc00a8-2c60-4c44-acb8-6f4d02114bf0/disk --force-share --output=json" returned: 0 in 0.121s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:05:53.705850 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3edc00a8-2c60-4c44-acb8-6f4d02114bf0/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:53.781728 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-81ae8ec7-211c-4ead-8be8-17635fad30e1 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:53.786193 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "065c91b8-09c2-4ec8-95e8-606247a3c350" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:53.786780 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "065c91b8-09c2-4ec8-95e8-606247a3c350" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:53.807546 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Attempting to attach volume 3a1e5674-04a4-4eb3-be73-5104b2fc0204 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 10:05:53.815024 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] attach device xml: <disk type="block" device="disk">
May 28 10:05:53.815024 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:05:53.815024 np0000001613 nova-compute[98321]:   <alias name="ua-3a1e5674-04a4-4eb3-be73-5104b2fc0204"/>
May 28 10:05:53.815024 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-0"/>
May 28 10:05:53.815024 np0000001613 nova-compute[98321]:   <target dev="vdc" bus="virtio"/>
May 28 10:05:53.815024 np0000001613 nova-compute[98321]:   <serial>3a1e5674-04a4-4eb3-be73-5104b2fc0204</serial>
May 28 10:05:53.815024 np0000001613 nova-compute[98321]: </disk>
May 28 10:05:53.815024 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 10:05:53.817270 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3edc00a8-2c60-4c44-acb8-6f4d02114bf0/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:05:53.819778 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fd9dae-9efe-4726-abdd-995998d1df87/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:53.879821 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-880f2c94-73e2-4d8c-88a1-7ab117ddeb2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:05:53.921517 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fd9dae-9efe-4726-abdd-995998d1df87/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:05:53.922021 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fd9dae-9efe-4726-abdd-995998d1df87/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:54.022264 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fd9dae-9efe-4726-abdd-995998d1df87/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:05:54.025466 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-5 (vda) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:05:54.028210 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c91b8-09c2-4ec8-95e8-606247a3c350/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:54.128696 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c91b8-09c2-4ec8-95e8-606247a3c350/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:05:54.129260 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c91b8-09c2-4ec8-95e8-606247a3c350/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:54.226099 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c91b8-09c2-4ec8-95e8-606247a3c350/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:05:54.233265 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:05:54.233604 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:05:54.233841 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-0 (vdc) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:05:54.236508 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:54.293337 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lazy-loading 'flavor' on Instance uuid 065c91b8-09c2-4ec8-95e8-606247a3c350 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:05:54.326452 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:05:54.326894 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:54.391946 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-880f2c94-73e2-4d8c-88a1-7ab117ddeb2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.747s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:54.395771 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-81ae8ec7-211c-4ead-8be8-17635fad30e1 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.614s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:54.419601 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:05:54.422241 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:54.493229 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:05:54.493229 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:05:54.493229 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] No VIF found with MAC fa:16:3e:56:a4:d8, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:05:54.493229 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Using config drive
May 28 10:05:54.501686 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-880f2c94-73e2-4d8c-88a1-7ab117ddeb2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Deleted allocations for instance 36fde791-779f-42a8-9aef-87eafbbe0370
May 28 10:05:54.522133 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:05:54.522634 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:54.581857 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:54.611201 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:05:54.617268 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:05:54.618502 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:54.677389 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "env LANG=C uptime" returned: 0 in 0.059s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:05:54.678608 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Hypervisor/Node resource view: name=np0000001613 free_ram=11334MB free_disk=73.90983581542969GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 10:05:54.678921 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:55.000938 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:55.191781 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Creating config drive at /opt/stack/data/nova/instances/3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb/disk.config
May 28 10:05:55.196268 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0kuyot74 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:55.220742 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-81ae8ec7-211c-4ead-8be8-17635fad30e1 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:05:55.221181 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-81ae8ec7-211c-4ead-8be8-17635fad30e1 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:05:55.266041 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0kuyot74" returned: 0 in 0.070s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:05:55.303232 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "065c91b8-09c2-4ec8-95e8-606247a3c350" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.516s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:55.530190 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-880f2c94-73e2-4d8c-88a1-7ab117ddeb2f tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "36fde791-779f-42a8-9aef-87eafbbe0370" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.673s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:55.535921 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:05:55.535921 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:05:55.535921 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:05:55.535921 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:05:55.535921 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] No VIF found with MAC fa:16:3e:9c:76:06, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:05:55.713140 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:55.726356 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-81ae8ec7-211c-4ead-8be8-17635fad30e1 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:05:55.746200 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:55.843988 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:55.933857 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-0cb47bbe-e59b-467d-a655-dd1060a96194 req-78979986-20c8-4d7d-8bbc-3f8cc92c2037 service nova] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Received event network-vif-plugged-79f3ea8e-af7a-4778-8abc-96e97c5177f2 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:05:55.934608 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0cb47bbe-e59b-467d-a655-dd1060a96194 req-78979986-20c8-4d7d-8bbc-3f8cc92c2037 service nova] Acquiring lock "3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:55.937618 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0cb47bbe-e59b-467d-a655-dd1060a96194 req-78979986-20c8-4d7d-8bbc-3f8cc92c2037 service nova] Lock "3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:55.937857 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0cb47bbe-e59b-467d-a655-dd1060a96194 req-78979986-20c8-4d7d-8bbc-3f8cc92c2037 service nova] Lock "3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:55.938020 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-0cb47bbe-e59b-467d-a655-dd1060a96194 req-78979986-20c8-4d7d-8bbc-3f8cc92c2037 service nova] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Processing event network-vif-plugged-79f3ea8e-af7a-4778-8abc-96e97c5177f2 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:05:56.089176 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:56.091958 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:56.105226 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:56.128963 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:56.131096 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:56.234406 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-81ae8ec7-211c-4ead-8be8-17635fad30e1 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.839s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:56.236537 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 1.556s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:56.302112 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-81ae8ec7-211c-4ead-8be8-17635fad30e1 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Deleted allocations for instance 13636cda-9029-46e5-8305-ee3ea32ce0f7
May 28 10:05:56.401353 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "065c91b8-09c2-4ec8-95e8-606247a3c350" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:56.401353 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "065c91b8-09c2-4ec8-95e8-606247a3c350" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:56.401353 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Attaching volume 30e9f06a-e75c-41d1-a368-39a4e97f7c8e to /dev/vdb
May 28 10:05:56.461681 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:05:56.474042 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:05:56.500137 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:05:56.547379 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:05:56.547379 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:05:56.559496 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:05:56.561375 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fefd:30e7', 'fe80::e4df:c0ff:fe86:6341', 'fe80::fc16:3eff:fedb:1077', 'fe80::fc16:3eff:fe3c:b7e1', 'fe80::fc16:3eff:fe9c:7606', 'fe80::e867:17ff:fe2f:2260', 'fe80::fc16:3eff:fe04:ca46', 'fe80::ec4e:cbff:fea7:f945', 'fe80::fc16:3eff:feb9:512c', 'fe80::1c9e:daff:fee5:c4bc', 'fe80::fc16:3eff:fe08:3107', 'fe80::e02b:1cff:fec7:1a41', 'fe80::fc16:3eff:feb5:7a19', 'fe80::d42a:61ff:fe18:5003', 'fe80::fc16:3eff:fe56:a4d8', 'fe80::e4eb:4cff:fe5c:5eb7'] 
May 28 10:05:56.561564 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:05:56.561670 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:05:56.562405 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] <== get_connector_properties: return (100ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:05:56.562405 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Updating existing volume attachment record: f1024d8c-3a17-4cc2-87e0-df223a83d55c {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:05:57.104896 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-92ec2098-5ac7-47ae-b5ad-fe26a49b3afc tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.658s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:57.158144 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'plain'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e', 'iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '30e9f06a-e75c-41d1-a368-39a4e97f7c8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '065c91b8-09c2-4ec8-95e8-606247a3c350', 'attached_at': '', 'detached_at': '', 'volume_id': '30e9f06a-e75c-41d1-a368-39a4e97f7c8e', 'serial': '30e9f06a-e75c-41d1-a368-39a4e97f7c8e'} {{(pid=98321) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 10:05:57.161213 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:05:57.161524 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e', 'iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '30e9f06a-e75c-41d1-a368-39a4e97f7c8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:05:57.161706 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:05:57.162151 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:05:57.162400 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e', 'iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '30e9f06a-e75c-41d1-a368-39a4e97f7c8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:05:57.179741 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:05:57.180440 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:05:57.180914 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:05:57.181183 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:05:57.181575 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:05:57.181792 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:05:57.194495 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:05:57.194495 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:57.197202 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:05:57.197202 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:57.205875 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e] added
May 28 10:05:57.205875 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:05:57.205875 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:05:57.205875 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:05:57.205875 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:05:57.205875 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:05:57.205875 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:57.206273 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:05:57.206422 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0251(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:05:57.206679 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:05:57.209476 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e] added
May 28 10:05:57.209476 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:05:57.209476 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:05:57.209476 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:05:57.209476 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:05:57.209476 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:05:57.209476 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:57.209970 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:05:57.209970 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0281(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:05:57.210118 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:05:57.303029 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0009724650003590796 future=<Future at 0x73c1f4310950 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:05:57.303973 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Emitting event <LifecycleEvent: 1779962742.3019319, de9742b9-43db-40a6-b635-81d9244fd5e0 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:05:57.306966 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:05:57.307515 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] VM Stopped (Lifecycle Event)
May 28 10:05:57.308656 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 6895009a-024f-4919-9d25-a52905eac818 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:05:57.309109 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=7.427029722999578 future=<Future at 0x73c1f4361850 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:05:57.309318 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=7.426800295999783 future=<Future at 0x73c1f4361850 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:05:57.312246 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance b50eced2-71bf-4448-b2e1-f9657509f34c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:05:57.312246 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 3edc00a8-2c60-4c44-acb8-6f4d02114bf0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:05:57.312246 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 2641ee65-c9c2-401d-b511-6ecc1247a3ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:05:57.312246 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance cc75b5c9-a7ad-4a7c-aff0-336c8e64b120 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:05:57.312246 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 065c91b8-09c2-4ec8-95e8-606247a3c350 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:05:57.312246 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 11fd9dae-9efe-4726-abdd-995998d1df87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:05:57.312246 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 11a2b3e7-1061-4a51-b520-113e13221658 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:05:57.312246 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:05:57.312246 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 10:05:57.312246 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Final resource view: name=np0000001613 phys_ram=24030MB used_ram=2240MB phys_disk=95GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 10:05:54 up 38 min,  2 users,  load average: 8.02, 7.92, 4.55\n', 'num_instances': '9', 'num_vm_active': '8', 'num_task_None': '8', 'num_os_type_None': '9', 'num_proj_3403b533910644d2b254922fb84b1ac0': '3', 'io_workload': '1', 'num_proj_6f2d040c323b4b948803334de7c8ec44': '1', 'num_proj_e97358e7c52d42788014ffe493108674': '1', 'num_proj_c7563a83d33d4bc1a6610ccf53c18dc1': '1', 'num_proj_42b5a6b6c4514b76a651b71280c093f5': '1', 'num_proj_edd64b0e2ce54cac860344420cf9c5b6': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_23e9651268114327a9cc6c6c59bef01e': '1'} {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 10:05:57.316635 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-81ae8ec7-211c-4ead-8be8-17635fad30e1 tempest-VolumesExtendAttachedTest-1071205551 tempest-VolumesExtendAttachedTest-1071205551-project-member] Lock "13636cda-9029-46e5-8305-ee3ea32ce0f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.504s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:57.354483 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b1e03b9e-779a-46f8-b34b-be418a8b4b55 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "3edc00a8-2c60-4c44-acb8-6f4d02114bf0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:57.354812 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b1e03b9e-779a-46f8-b34b-be418a8b4b55 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "3edc00a8-2c60-4c44-acb8-6f4d02114bf0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:57.355264 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b1e03b9e-779a-46f8-b34b-be418a8b4b55 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "3edc00a8-2c60-4c44-acb8-6f4d02114bf0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:57.355264 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b1e03b9e-779a-46f8-b34b-be418a8b4b55 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "3edc00a8-2c60-4c44-acb8-6f4d02114bf0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:57.355451 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b1e03b9e-779a-46f8-b34b-be418a8b4b55 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "3edc00a8-2c60-4c44-acb8-6f4d02114bf0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:57.357612 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-b1e03b9e-779a-46f8-b34b-be418a8b4b55 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Terminating instance
May 28 10:05:57.420971 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962757.4204378, 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:05:57.421151 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] VM Started (Lifecycle Event)
May 28 10:05:57.422890 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:05:57.425093 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:05:57.428929 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Instance spawned successfully.
May 28 10:05:57.430304 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:05:57.785314 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:05:57.785904 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:05:57.818487 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: de9742b9-43db-40a6-b635-81d9244fd5e0] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:05:57.862575 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-b1e03b9e-779a-46f8-b34b-be418a8b4b55 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:05:57.885284 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:57.888469 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:57.924141 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:57.925023 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:05:57.935975 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:05:57.940562 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:05:57.940929 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:05:57.942183 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:05:57.942183 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:05:57.942183 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:05:57.942183 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:05:57.950358 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:58.033678 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-1d725b36-8f9a-4621-b9c2-a705a85e013b req-594feca4-4071-4682-8361-135ac2ef5ec2 service nova] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Received event network-vif-plugged-79f3ea8e-af7a-4778-8abc-96e97c5177f2 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:05:58.037177 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1d725b36-8f9a-4621-b9c2-a705a85e013b req-594feca4-4071-4682-8361-135ac2ef5ec2 service nova] Acquiring lock "3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:58.037387 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1d725b36-8f9a-4621-b9c2-a705a85e013b req-594feca4-4071-4682-8361-135ac2ef5ec2 service nova] Lock "3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:58.037540 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1d725b36-8f9a-4621-b9c2-a705a85e013b req-594feca4-4071-4682-8361-135ac2ef5ec2 service nova] Lock "3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:58.037781 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-1d725b36-8f9a-4621-b9c2-a705a85e013b req-594feca4-4071-4682-8361-135ac2ef5ec2 service nova] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] No waiting events found dispatching network-vif-plugged-79f3ea8e-af7a-4778-8abc-96e97c5177f2 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:05:58.037942 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-1d725b36-8f9a-4621-b9c2-a705a85e013b req-594feca4-4071-4682-8361-135ac2ef5ec2 service nova] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Received unexpected event network-vif-plugged-79f3ea8e-af7a-4778-8abc-96e97c5177f2 for instance with vm_state building and task_state spawning.
May 28 10:05:58.067596 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e050ec41-0443-49e9-bd04-2f142fdd41cb req-31145715-7f66-432d-a93d-1210d2662e95 service nova] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Received event network-vif-unplugged-dc94f5df-ac70-45ed-b3e3-795fc10af261 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:05:58.067978 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e050ec41-0443-49e9-bd04-2f142fdd41cb req-31145715-7f66-432d-a93d-1210d2662e95 service nova] Acquiring lock "3edc00a8-2c60-4c44-acb8-6f4d02114bf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:58.071570 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e050ec41-0443-49e9-bd04-2f142fdd41cb req-31145715-7f66-432d-a93d-1210d2662e95 service nova] Lock "3edc00a8-2c60-4c44-acb8-6f4d02114bf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:58.072603 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e050ec41-0443-49e9-bd04-2f142fdd41cb req-31145715-7f66-432d-a93d-1210d2662e95 service nova] Lock "3edc00a8-2c60-4c44-acb8-6f4d02114bf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:58.072955 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e050ec41-0443-49e9-bd04-2f142fdd41cb req-31145715-7f66-432d-a93d-1210d2662e95 service nova] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] No waiting events found dispatching network-vif-unplugged-dc94f5df-ac70-45ed-b3e3-795fc10af261 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:05:58.073117 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e050ec41-0443-49e9-bd04-2f142fdd41cb req-31145715-7f66-432d-a93d-1210d2662e95 service nova] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Received event network-vif-unplugged-dc94f5df-ac70-45ed-b3e3-795fc10af261 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:05:58.075919 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:58.082884 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:58.182523 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:58.190961 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:58.207070 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:05:58.211508 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:05:58.215717 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Instance destroyed successfully.
May 28 10:05:58.216315 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-b1e03b9e-779a-46f8-b34b-be418a8b4b55 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lazy-loading 'resources' on Instance uuid 3edc00a8-2c60-4c44-acb8-6f4d02114bf0 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:05:58.224154 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:05:58.224154 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:05:58.227653 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:05:58.227653 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:58.236411 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:58.244085 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:58.260189 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:58.260189 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:58.260189 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:58.260189 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:58.260189 np0000001613 nova-compute[98321]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:58.260189 np0000001613 nova-compute[98321]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:58.260189 np0000001613 nova-compute[98321]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:58.260189 np0000001613 nova-compute[98321]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:58.260189 np0000001613 nova-compute[98321]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:05:58.260189 np0000001613 nova-compute[98321]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:05:58.260189 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:05:58.260189 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:58.260189 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:58.260189 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:58.260189 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:58.260189 np0000001613 nova-compute[98321]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:58.260189 np0000001613 nova-compute[98321]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:58.260189 np0000001613 nova-compute[98321]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:58.260189 np0000001613 nova-compute[98321]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:58.260189 np0000001613 nova-compute[98321]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:05:58.260189 np0000001613 nova-compute[98321]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:05:58.260189 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:05:58.268653 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:58.268653 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:58.268653 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:58.268653 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:58.268653 np0000001613 nova-compute[98321]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:58.268653 np0000001613 nova-compute[98321]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:58.268653 np0000001613 nova-compute[98321]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:58.268653 np0000001613 nova-compute[98321]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:58.268653 np0000001613 nova-compute[98321]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:05:58.268653 np0000001613 nova-compute[98321]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:05:58.268653 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:05:58.268942 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:58.268942 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:58.268942 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:58.268942 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:58.268942 np0000001613 nova-compute[98321]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:58.268942 np0000001613 nova-compute[98321]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:58.268942 np0000001613 nova-compute[98321]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:58.268942 np0000001613 nova-compute[98321]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:58.268942 np0000001613 nova-compute[98321]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:05:58.268942 np0000001613 nova-compute[98321]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:05:58.268942 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:05:58.288484 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:05:58.333969 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e, portal: 192.168.40.100,3260]
May 28 10:05:58.333969 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e, portal: 192.168.40.100,3260] successful.
May 28 10:05:58.333969 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:58.340494 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e, portal: 192.168.50.100,3260]
May 28 10:05:58.340494 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e, portal: 192.168.50.100,3260] successful.
May 28 10:05:58.340494 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:58.348332 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:58.355111 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:05:58.372080 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:58.372080 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:58.372080 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:58.372080 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:58.372080 np0000001613 nova-compute[98321]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:58.372080 np0000001613 nova-compute[98321]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:58.372080 np0000001613 nova-compute[98321]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:58.372080 np0000001613 nova-compute[98321]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:58.372080 np0000001613 nova-compute[98321]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:05:58.372080 np0000001613 nova-compute[98321]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:05:58.372080 np0000001613 nova-compute[98321]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e (non-flash)
May 28 10:05:58.372080 np0000001613 nova-compute[98321]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e (non-flash)
May 28 10:05:58.372080 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:05:58.372460 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:58.372460 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:58.372460 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:58.372460 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:58.372460 np0000001613 nova-compute[98321]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:58.372460 np0000001613 nova-compute[98321]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:58.372460 np0000001613 nova-compute[98321]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:58.372460 np0000001613 nova-compute[98321]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:58.372460 np0000001613 nova-compute[98321]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:05:58.372460 np0000001613 nova-compute[98321]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:05:58.372460 np0000001613 nova-compute[98321]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e (non-flash)
May 28 10:05:58.372460 np0000001613 nova-compute[98321]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e (non-flash)
May 28 10:05:58.372460 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:05:58.373476 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.192s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:05:58.373476 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:05:58.375302 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] HCTL ('17', '-', '-', 0) found on session 91 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:05:58.375548 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:05:58.381451 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:58.381451 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:58.381451 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:58.381451 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:58.381451 np0000001613 nova-compute[98321]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:58.381451 np0000001613 nova-compute[98321]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:58.381451 np0000001613 nova-compute[98321]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:58.381451 np0000001613 nova-compute[98321]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:58.381451 np0000001613 nova-compute[98321]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:05:58.381451 np0000001613 nova-compute[98321]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:05:58.381451 np0000001613 nova-compute[98321]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e (non-flash)
May 28 10:05:58.381451 np0000001613 nova-compute[98321]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e (non-flash)
May 28 10:05:58.381451 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:05:58.382853 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:58.382853 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:05:58.382853 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:58.382853 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:05:58.382853 np0000001613 nova-compute[98321]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:58.382853 np0000001613 nova-compute[98321]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:05:58.382853 np0000001613 nova-compute[98321]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:58.382853 np0000001613 nova-compute[98321]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:05:58.382853 np0000001613 nova-compute[98321]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:05:58.382853 np0000001613 nova-compute[98321]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:05:58.382853 np0000001613 nova-compute[98321]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e (non-flash)
May 28 10:05:58.382853 np0000001613 nova-compute[98321]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e (non-flash)
May 28 10:05:58.382853 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:05:58.382853 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.201s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:05:58.382853 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:05:58.385498 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] HCTL ('18', '-', '-', 0) found on session 92 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:05:58.385498 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:05:58.396419 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Searching for a device in session 91 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:05:58.396810 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '30e9f06a-e75c-41d1-a368-39a4e97f7c8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:05:58.405074 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Searching for a device in session 92 and hctl ['18', '*', '*', 0] yield: None {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:05:58.446287 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:05:58.446676 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Took 14.04 seconds to spawn the instance on the hypervisor.
May 28 10:05:58.447483 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962758.446766, 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:05:58.448416 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:05:58.448416 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] VM Paused (Lifecycle Event)
May 28 10:05:58.719282 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-b1e03b9e-779a-46f8-b34b-be418a8b4b55 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:00:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='multiattach-server-1',id=24,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrmebBJn1C7uIkB9JjrF4yuEuto77kf4SaBedfdmOdQwZzJyqrVQd0Wq/SA1eDV6FpWwBB4BKjLBcFgkvBrXSx4LeKHMUic/tPGA5px/F625klLXypbV+9p49FvQ4XImQ==',key_name='tempest-keypair-2082049331',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:01:08Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3403b533910644d2b254922fb84b1ac0',ramdisk_id='',reservation_id='r-0bufnik2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1052626787',owner_user_name='tempest-AttachVolumeMultiAttachTest-1052626787-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13481913e22d4bf1a94e1a9a270f5494',uuid=3edc00a8-2c60-4c44-acb8-6f4d02114bf0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc94f5df-ac70-45ed-b3e3-795fc10af261", "address": "fa:16:3e:3c:b7:e1", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc94f5df-ac", "ovs_interfaceid": "dc94f5df-ac70-45ed-b3e3-795fc10af261", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:05:58.719569 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-b1e03b9e-779a-46f8-b34b-be418a8b4b55 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converting VIF {"id": "dc94f5df-ac70-45ed-b3e3-795fc10af261", "address": "fa:16:3e:3c:b7:e1", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc94f5df-ac", "ovs_interfaceid": "dc94f5df-ac70-45ed-b3e3-795fc10af261", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:05:58.720038 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-b1e03b9e-779a-46f8-b34b-be418a8b4b55 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:b7:e1,bridge_name='br-int',has_traffic_filtering=True,id=dc94f5df-ac70-45ed-b3e3-795fc10af261,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc94f5df-ac') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:05:58.720321 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-b1e03b9e-779a-46f8-b34b-be418a8b4b55 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:b7:e1,bridge_name='br-int',has_traffic_filtering=True,id=dc94f5df-ac70-45ed-b3e3-795fc10af261,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc94f5df-ac') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:05:58.722476 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:58.722794 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc94f5df-ac, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:58.725892 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:58.725892 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:05:58.725892 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:58.726096 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:58.726213 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ee4b26d0-ccf9-489d-846a-b053bb89a550) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:05:58.728356 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:58.728356 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:05:58.728356 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:58.729617 np0000001613 nova-compute[98321]: INFO os_vif [None req-b1e03b9e-779a-46f8-b34b-be418a8b4b55 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:b7:e1,bridge_name='br-int',has_traffic_filtering=True,id=dc94f5df-ac70-45ed-b3e3-795fc10af261,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc94f5df-ac')
May 28 10:05:58.729950 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-b1e03b9e-779a-46f8-b34b-be418a8b4b55 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Deleting instance files /opt/stack/data/nova/instances/3edc00a8-2c60-4c44-acb8-6f4d02114bf0_del
May 28 10:05:58.730791 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-b1e03b9e-779a-46f8-b34b-be418a8b4b55 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Deletion of /opt/stack/data/nova/instances/3edc00a8-2c60-4c44-acb8-6f4d02114bf0_del complete
May 28 10:05:58.800233 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Compute_service record updated for np0000001613:np0000001613 {{(pid=98321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 10:05:58.800803 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.566s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:58.800803 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:05:58.951481 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:05:58.953515 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962758.9533055, 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:05:58.953685 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] VM Resumed (Lifecycle Event)
May 28 10:05:58.960013 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Took 21.71 seconds to build instance.
May 28 10:05:59.239712 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-b1e03b9e-779a-46f8-b34b-be418a8b4b55 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Took 1.38 seconds to destroy the instance on the hypervisor.
May 28 10:05:59.241988 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-b1e03b9e-779a-46f8-b34b-be418a8b4b55 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:05:59.243100 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:05:59.243256 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:05:59.243534 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:59.307695 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:05:59.406282 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Searching for a device in session 92 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:05:59.406282 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '30e9f06a-e75c-41d1-a368-39a4e97f7c8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:05:59.456036 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:05:59.459179 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:05:59.462753 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.232s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:59.585512 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:05:59.742023 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:59.742180 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:59.742347 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:05:59.742486 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:05:59.742617 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:05:59.744761 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Terminating instance
May 28 10:05:59.793603 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:05:59.795734 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:05:59.795734 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:05:59.795734 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:05:59.795734 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:05:59.795734 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:05:59.795734 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 10:05:59.795734 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 53.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:05:59.962755 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] During sync_power_state the instance has a pending task (deleting). Skip.
May 28 10:05:59.963271 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.99984726699995 future=<Future at 0x73c1fc7d4cb0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:00.089236 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-21effb36-ce3a-4c45-a973-6d0fdd19d3c6 req-898f2395-6741-47e7-934b-7f7e54ae725e service nova] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Received event network-vif-deleted-dc94f5df-ac70-45ed-b3e3-795fc10af261 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:00.089743 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:06:00.090856 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-21effb36-ce3a-4c45-a973-6d0fdd19d3c6 req-898f2395-6741-47e7-934b-7f7e54ae725e service nova] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Neutron deleted interface dc94f5df-ac70-45ed-b3e3-795fc10af261; detaching it from the instance and deleting it from the info cache
May 28 10:06:00.093147 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-21effb36-ce3a-4c45-a973-6d0fdd19d3c6 req-898f2395-6741-47e7-934b-7f7e54ae725e service nova] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Detach interface failed, port_id=dc94f5df-ac70-45ed-b3e3-795fc10af261, reason: Instance 3edc00a8-2c60-4c44-acb8-6f4d02114bf0 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:06:00.150790 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b6f42073-0c6e-4ea1-ab72-1ef07a03c639 req-98aa0427-aa9e-4a14-867c-77f1b8a3cfc5 service nova] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Received event network-vif-unplugged-dc94f5df-ac70-45ed-b3e3-795fc10af261 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:00.151265 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b6f42073-0c6e-4ea1-ab72-1ef07a03c639 req-98aa0427-aa9e-4a14-867c-77f1b8a3cfc5 service nova] Acquiring lock "3edc00a8-2c60-4c44-acb8-6f4d02114bf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:00.151523 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b6f42073-0c6e-4ea1-ab72-1ef07a03c639 req-98aa0427-aa9e-4a14-867c-77f1b8a3cfc5 service nova] Lock "3edc00a8-2c60-4c44-acb8-6f4d02114bf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:00.151682 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b6f42073-0c6e-4ea1-ab72-1ef07a03c639 req-98aa0427-aa9e-4a14-867c-77f1b8a3cfc5 service nova] Lock "3edc00a8-2c60-4c44-acb8-6f4d02114bf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:00.151906 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b6f42073-0c6e-4ea1-ab72-1ef07a03c639 req-98aa0427-aa9e-4a14-867c-77f1b8a3cfc5 service nova] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] No waiting events found dispatching network-vif-unplugged-dc94f5df-ac70-45ed-b3e3-795fc10af261 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:06:00.152081 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b6f42073-0c6e-4ea1-ab72-1ef07a03c639 req-98aa0427-aa9e-4a14-867c-77f1b8a3cfc5 service nova] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Received event network-vif-unplugged-dc94f5df-ac70-45ed-b3e3-795fc10af261 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:06:00.196461 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Found WWN 3300000000cf33c05 for multipath device dm-9 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:06:00.196724 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:06:00.197767 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '3300000000cf33c05', 'path': '/dev/disk/by-id/os-brick+dev+dm-9', 'multipath_id': '3300000000cf33c05'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:06:00.197966 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000cf33c05', 'path': '/dev/disk/by-id/os-brick+dev+dm-9', 'multipath_id': '3300000000cf33c05'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:06:00.199936 np0000001613 nova-compute[98321]: WARNING stevedore.named [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 10:06:00.200204 np0000001613 nova-compute[98321]: WARNING castellan.key_manager [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 10:06:00.200392 np0000001613 nova-compute[98321]: WARNING nova.keymgr.conf_key_mgr [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 10:06:00.201547 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Using volume encryptor '<os_brick.encryptors.cryptsetup.CryptsetupEncryptor object at 0x73c1f423a000>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e', 'iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '30e9f06a-e75c-41d1-a368-39a4e97f7c8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-9'}, 'status': 'reserved', 'instance': '065c91b8-09c2-4ec8-95e8-606247a3c350', 'attached_at': '', 'detached_at': '', 'volume_id': '30e9f06a-e75c-41d1-a368-39a4e97f7c8e', 'serial': '30e9f06a-e75c-41d1-a368-39a4e97f7c8e'} {{(pid=98321) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 10:06:00.201869 np0000001613 nova-compute[98321]: WARNING os_brick.encryptors.cryptsetup [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Deprecated: The plain CryptsetupEncryptor is deprecated and will be removed in a future release. Existing users are encouraged to retype any existing volumes using this encryptor to the 'luks' LuksEncryptor or 'luks2' Luks2Encryptor encryptors as soon as possible.
May 28 10:06:00.202099 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=98321) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 28 10:06:00.202298 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors.cryptsetup [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] opening encrypted volume /dev/dm-9 {{(pid=98321) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/cryptsetup.py:104}}
May 28 10:06:00.248968 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:06:00.277605 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:00.302449 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:00.307334 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:00.311750 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lazy-loading 'flavor' on Instance uuid 065c91b8-09c2-4ec8-95e8-606247a3c350 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:06:00.336364 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:00.584037 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999680766999973 future=<Future at 0x73c1f42441a0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:00.585636 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Instance destroyed successfully.
May 28 10:06:00.585949 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lazy-loading 'resources' on Instance uuid 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:06:00.592450 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Took 1.35 seconds to deallocate network for instance.
May 28 10:06:00.816273 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Attempting to attach volume 30e9f06a-e75c-41d1-a368-39a4e97f7c8e with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 10:06:00.818545 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] attach device xml: <disk type="block" device="disk">
May 28 10:06:00.818545 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:06:00.818545 np0000001613 nova-compute[98321]:   <alias name="ua-30e9f06a-e75c-41d1-a368-39a4e97f7c8e"/>
May 28 10:06:00.818545 np0000001613 nova-compute[98321]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-9"/>
May 28 10:06:00.818545 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:06:00.818545 np0000001613 nova-compute[98321]:   <serial>30e9f06a-e75c-41d1-a368-39a4e97f7c8e</serial>
May 28 10:06:00.818545 np0000001613 nova-compute[98321]: </disk>
May 28 10:06:00.818545 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 10:06:00.988538 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Acquiring lock "11fd9dae-9efe-4726-abdd-995998d1df87" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:00.989374 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "11fd9dae-9efe-4726-abdd-995998d1df87" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:01.089017 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:05:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-657476900',display_name='tempest-TestVolumeBootPattern-server-657476900',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpattern-server-657476900',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:05:58Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='23e9651268114327a9cc6c6c59bef01e',ramdisk_id='',reservation_id='r-yqmsyopk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestVolumeBootPattern-327944304',owner_user_name='tempest-TestVolumeBootPattern-327944304-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:05:58Z,user_data=None,user_id='ec58233d3b2848bbb2e0b00650398cd1',uuid=3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79f3ea8e-af7a-4778-8abc-96e97c5177f2", "address": "fa:16:3e:56:a4:d8", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f3ea8e-af", "ovs_interfaceid": "79f3ea8e-af7a-4778-8abc-96e97c5177f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:06:01.089357 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converting VIF {"id": "79f3ea8e-af7a-4778-8abc-96e97c5177f2", "address": "fa:16:3e:56:a4:d8", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f3ea8e-af", "ovs_interfaceid": "79f3ea8e-af7a-4778-8abc-96e97c5177f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:06:01.090008 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:a4:d8,bridge_name='br-int',has_traffic_filtering=True,id=79f3ea8e-af7a-4778-8abc-96e97c5177f2,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79f3ea8e-af') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:06:01.090410 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:a4:d8,bridge_name='br-int',has_traffic_filtering=True,id=79f3ea8e-af7a-4778-8abc-96e97c5177f2,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79f3ea8e-af') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:06:01.091713 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:01.091947 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79f3ea8e-af, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:06:01.093253 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:01.094134 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:06:01.095409 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:01.096103 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:01.096232 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=100602fd-c529-4cf9-8b6b-75c51cac59eb) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:06:01.096841 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:01.098716 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:06:01.101932 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b1e03b9e-779a-46f8-b34b-be418a8b4b55 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:01.102182 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b1e03b9e-779a-46f8-b34b-be418a8b4b55 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:01.102715 np0000001613 nova-compute[98321]: INFO os_vif [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:a4:d8,bridge_name='br-int',has_traffic_filtering=True,id=79f3ea8e-af7a-4778-8abc-96e97c5177f2,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79f3ea8e-af')
May 28 10:06:01.108473 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:06:01.108870 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d', 'iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '00ef829b-d202-4a0f-bd33-f9b98af4b31d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:06:01.109145 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:06:01.109620 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:06:01.110019 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d', 'iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '00ef829b-d202-4a0f-bd33-f9b98af4b31d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:06:01.110213 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:06:01.142156 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:06:01.142156 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:06:01.142156 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:06:01.142156 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:06:01.142156 np0000001613 nova-compute[98321]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:06:01.142156 np0000001613 nova-compute[98321]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:06:01.142156 np0000001613 nova-compute[98321]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:06:01.142156 np0000001613 nova-compute[98321]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:06:01.142156 np0000001613 nova-compute[98321]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:06:01.142156 np0000001613 nova-compute[98321]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:06:01.142156 np0000001613 nova-compute[98321]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e (non-flash)
May 28 10:06:01.142156 np0000001613 nova-compute[98321]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e (non-flash)
May 28 10:06:01.142156 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:06:01.142453 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:06:01.142453 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:06:01.142453 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:06:01.142453 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:06:01.142453 np0000001613 nova-compute[98321]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:06:01.142453 np0000001613 nova-compute[98321]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:06:01.142453 np0000001613 nova-compute[98321]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:06:01.142453 np0000001613 nova-compute[98321]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d (non-flash)
May 28 10:06:01.142453 np0000001613 nova-compute[98321]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:06:01.142453 np0000001613 nova-compute[98321]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:06:01.142453 np0000001613 nova-compute[98321]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e (non-flash)
May 28 10:06:01.142453 np0000001613 nova-compute[98321]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e (non-flash)
May 28 10:06:01.142453 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:06:01.142453 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e', '79'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e', '80'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7', '85'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7', '86'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d', '88'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204', '89'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204', '90'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e', '91'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e', '92')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:06:01.142793 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d', '87')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:06:01.143914 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d', '88')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:06:01.144809 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1f47522a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d'): ({'sdk'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:06:01.145065 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Removing multipathed devices sdj, sdk {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:06:01.145306 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Flush multipath device 3300000000766efd1 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:06:01.184587 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:06:01.235599 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:06:01.293337 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:06:01.293337 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:06:01.294004 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:06:01.308180 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:06:01.308180 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:06:01.323137 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:01.382835 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:01.385745 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 87, target: iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d, portal: 192.168.40.100,3260]
May 28 10:06:01.385745 np0000001613 nova-compute[98321]: Logout of [sid: 87, target: iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d, portal: 192.168.40.100,3260] successful.
May 28 10:06:01.385745 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:01.412776 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:01.427477 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:01.470424 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 88, target: iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d, portal: 192.168.50.100,3260]
May 28 10:06:01.470424 np0000001613 nova-compute[98321]: Logout of [sid: 88, target: iqn.2023-03.storpool.com:os--volume-00ef829b-d202-4a0f-bd33-f9b98af4b31d, portal: 192.168.50.100,3260] successful.
May 28 10:06:01.470424 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:01.493638 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lazy-loading 'flavor' on Instance uuid 11fd9dae-9efe-4726-abdd-995998d1df87 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:06:01.507419 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:01.509515 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.399s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:06:01.509515 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] <== disconnect_volume: return (400ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:06:01.509515 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:06:01.510372 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Deleting instance files /opt/stack/data/nova/instances/3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb_del
May 28 10:06:01.511111 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Deletion of /opt/stack/data/nova/instances/3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb_del complete
May 28 10:06:01.671400 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b1e03b9e-779a-46f8-b34b-be418a8b4b55 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:06:01.671692 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-b1e03b9e-779a-46f8-b34b-be418a8b4b55 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:06:01.997364 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Ignoring supplied device name: /dev/vdb
May 28 10:06:02.027116 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Took 1.78 seconds to destroy the instance on the hypervisor.
May 28 10:06:02.030968 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:06:02.031336 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:06:02.031410 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:06:02.032101 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:02.103330 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:02.176683 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-b1e03b9e-779a-46f8-b34b-be418a8b4b55 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:06:02.183574 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ab8b24b1-57c6-45e3-a7ac-d112019cb885 req-f9a6710b-8988-471e-b805-730699190b1b service nova] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Received event network-vif-unplugged-79f3ea8e-af7a-4778-8abc-96e97c5177f2 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:02.183574 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ab8b24b1-57c6-45e3-a7ac-d112019cb885 req-f9a6710b-8988-471e-b805-730699190b1b service nova] Acquiring lock "3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:02.183574 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ab8b24b1-57c6-45e3-a7ac-d112019cb885 req-f9a6710b-8988-471e-b805-730699190b1b service nova] Lock "3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:02.183574 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ab8b24b1-57c6-45e3-a7ac-d112019cb885 req-f9a6710b-8988-471e-b805-730699190b1b service nova] Lock "3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:02.183574 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ab8b24b1-57c6-45e3-a7ac-d112019cb885 req-f9a6710b-8988-471e-b805-730699190b1b service nova] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] No waiting events found dispatching network-vif-unplugged-79f3ea8e-af7a-4778-8abc-96e97c5177f2 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:06:02.183574 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ab8b24b1-57c6-45e3-a7ac-d112019cb885 req-f9a6710b-8988-471e-b805-730699190b1b service nova] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Received event network-vif-unplugged-79f3ea8e-af7a-4778-8abc-96e97c5177f2 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:06:02.183714 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ab8b24b1-57c6-45e3-a7ac-d112019cb885 req-f9a6710b-8988-471e-b805-730699190b1b service nova] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Received event network-vif-unplugged-79f3ea8e-af7a-4778-8abc-96e97c5177f2 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:02.183820 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ab8b24b1-57c6-45e3-a7ac-d112019cb885 req-f9a6710b-8988-471e-b805-730699190b1b service nova] Acquiring lock "3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:02.183897 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ab8b24b1-57c6-45e3-a7ac-d112019cb885 req-f9a6710b-8988-471e-b805-730699190b1b service nova] Lock "3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:02.183990 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ab8b24b1-57c6-45e3-a7ac-d112019cb885 req-f9a6710b-8988-471e-b805-730699190b1b service nova] Lock "3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:02.184084 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ab8b24b1-57c6-45e3-a7ac-d112019cb885 req-f9a6710b-8988-471e-b805-730699190b1b service nova] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] No waiting events found dispatching network-vif-unplugged-79f3ea8e-af7a-4778-8abc-96e97c5177f2 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:06:02.184922 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ab8b24b1-57c6-45e3-a7ac-d112019cb885 req-f9a6710b-8988-471e-b805-730699190b1b service nova] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Received event network-vif-unplugged-79f3ea8e-af7a-4778-8abc-96e97c5177f2 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:06:02.359930 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b41c09c4-5dc7-412e-aff5-a8b02777a38f req-1ccf7964-2e74-4278-be63-d41c1d481b10 service nova] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Received event network-vif-deleted-79f3ea8e-af7a-4778-8abc-96e97c5177f2 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:02.359930 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-b41c09c4-5dc7-412e-aff5-a8b02777a38f req-1ccf7964-2e74-4278-be63-d41c1d481b10 service nova] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Neutron deleted interface 79f3ea8e-af7a-4778-8abc-96e97c5177f2; detaching it from the instance and deleting it from the info cache
May 28 10:06:02.361104 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b41c09c4-5dc7-412e-aff5-a8b02777a38f req-1ccf7964-2e74-4278-be63-d41c1d481b10 service nova] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Detach interface failed, port_id=79f3ea8e-af7a-4778-8abc-96e97c5177f2, reason: Instance 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:06:02.491738 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:06:02.491844 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:06:02.491939 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:06:02.492026 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] No VIF found with MAC fa:16:3e:04:ca:46, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:06:02.499938 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "11fd9dae-9efe-4726-abdd-995998d1df87" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:02.508290 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Acquiring lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:02.509527 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:02.683728 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b1e03b9e-779a-46f8-b34b-be418a8b4b55 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.582s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:02.726971 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-b1e03b9e-779a-46f8-b34b-be418a8b4b55 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Deleted allocations for instance 3edc00a8-2c60-4c44-acb8-6f4d02114bf0
May 28 10:06:02.818312 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:06:03.012368 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Detaching volume cfafef38-8144-4f30-88af-842505295af7
May 28 10:06:03.063694 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Attempting to driver detach volume cfafef38-8144-4f30-88af-842505295af7 from mountpoint /dev/vdb
May 28 10:06:03.069526 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Found disk vdb by alias ua-cfafef38-8144-4f30-88af-842505295af7 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:06:03.073635 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Found disk vdb by alias ua-cfafef38-8144-4f30-88af-842505295af7 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:06:03.073821 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Attempting to detach device vdb from instance cc75b5c9-a7ad-4a7c-aff0-336c8e64b120 from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 10:06:03.074090 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:06:03.074090 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:06:03.074090 np0000001613 nova-compute[98321]:   <alias name="ua-cfafef38-8144-4f30-88af-842505295af7"/>
May 28 10:06:03.074090 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-1"/>
May 28 10:06:03.074090 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:06:03.074090 np0000001613 nova-compute[98321]:   <serial>cfafef38-8144-4f30-88af-842505295af7</serial>
May 28 10:06:03.074090 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:06:03.074090 np0000001613 nova-compute[98321]: </disk>
May 28 10:06:03.074090 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:06:03.083641 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Successfully detached device vdb from instance cc75b5c9-a7ad-4a7c-aff0-336c8e64b120 from the persistent domain config.
May 28 10:06:03.083865 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] (1/8): Attempting to detach device vdb with device alias ua-cfafef38-8144-4f30-88af-842505295af7 from instance cc75b5c9-a7ad-4a7c-aff0-336c8e64b120 from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 10:06:03.084083 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:06:03.084083 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:06:03.084083 np0000001613 nova-compute[98321]:   <alias name="ua-cfafef38-8144-4f30-88af-842505295af7"/>
May 28 10:06:03.084083 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-1"/>
May 28 10:06:03.084083 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:06:03.084083 np0000001613 nova-compute[98321]:   <serial>cfafef38-8144-4f30-88af-842505295af7</serial>
May 28 10:06:03.084083 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:06:03.084083 np0000001613 nova-compute[98321]: </disk>
May 28 10:06:03.084083 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:06:03.320314 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Took 1.29 seconds to deallocate network for instance.
May 28 10:06:03.590523 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:03.601609 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Acquiring lock "11fd9dae-9efe-4726-abdd-995998d1df87" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:03.601826 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "11fd9dae-9efe-4726-abdd-995998d1df87" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:03.602025 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Attaching volume 39b5bd51-62c3-47bd-b975-8b8acb9799f4 to /dev/vdb
May 28 10:06:03.604840 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779962763.604525, cc75b5c9-a7ad-4a7c-aff0-336c8e64b120 => ua-cfafef38-8144-4f30-88af-842505295af7> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 10:06:03.606822 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-cfafef38-8144-4f30-88af-842505295af7 for instance cc75b5c9-a7ad-4a7c-aff0-336c8e64b120 {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 10:06:03.610702 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Successfully detached device vdb from instance cc75b5c9-a7ad-4a7c-aff0-336c8e64b120 from the live domain config.
May 28 10:06:03.615045 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:06:03.615356 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7', 'iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cfafef38-8144-4f30-88af-842505295af7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:06:03.615465 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:06:03.615791 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:06:03.616098 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7', 'iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cfafef38-8144-4f30-88af-842505295af7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:06:03.616297 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:06:03.644678 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:06:03.651981 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:06:03.651981 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:06:03.651981 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:06:03.651981 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:06:03.651981 np0000001613 nova-compute[98321]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:06:03.651981 np0000001613 nova-compute[98321]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:06:03.651981 np0000001613 nova-compute[98321]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:06:03.651981 np0000001613 nova-compute[98321]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:06:03.651981 np0000001613 nova-compute[98321]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e (non-flash)
May 28 10:06:03.651981 np0000001613 nova-compute[98321]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e (non-flash)
May 28 10:06:03.651981 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:06:03.652287 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:06:03.652287 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:06:03.652287 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:06:03.652287 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:06:03.652287 np0000001613 nova-compute[98321]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:06:03.652287 np0000001613 nova-compute[98321]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7 (non-flash)
May 28 10:06:03.652287 np0000001613 nova-compute[98321]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:06:03.652287 np0000001613 nova-compute[98321]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:06:03.652287 np0000001613 nova-compute[98321]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e (non-flash)
May 28 10:06:03.652287 np0000001613 nova-compute[98321]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e (non-flash)
May 28 10:06:03.652287 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:06:03.652542 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e', '79'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e', '80'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7', '85'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7', '86'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204', '89'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204', '90'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e', '91'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e', '92')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:06:03.652622 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7', '85')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:06:03.653717 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7', '86')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:06:03.654754 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc2e2ca0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7'): ({'sdg'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:06:03.656004 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Removing multipathed devices sdf, sdg {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:06:03.656259 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Flush multipath device 3300000004a1ee274 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:06:03.662451 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:06:03.702181 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:06:03.711551 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:06:03.740032 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b1e03b9e-779a-46f8-b34b-be418a8b4b55 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "3edc00a8-2c60-4c44-acb8-6f4d02114bf0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.385s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:03.747152 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:06:03.747517 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:06:03.757858 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:06:03.761475 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fefd:30e7', 'fe80::e4df:c0ff:fe86:6341', 'fe80::fc16:3eff:fedb:1077', 'fe80::fc16:3eff:fe9c:7606', 'fe80::e867:17ff:fe2f:2260', 'fe80::fc16:3eff:fe04:ca46', 'fe80::ec4e:cbff:fea7:f945', 'fe80::fc16:3eff:feb9:512c', 'fe80::1c9e:daff:fee5:c4bc', 'fe80::fc16:3eff:fe08:3107', 'fe80::e02b:1cff:fec7:1a41', 'fe80::fc16:3eff:feb5:7a19', 'fe80::d42a:61ff:fe18:5003'] 
May 28 10:06:03.761889 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:06:03.767544 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:06:03.767544 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:06:03.767544 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Updating existing volume attachment record: 9347eebd-63c5-4185-92fc-d0dc3dd0841a {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:06:03.774639 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:06:03.838006 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:06:03.838237 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:06:03.839516 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:06:03.871148 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:06:03.871382 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:06:03.887259 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:03.896918 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Took 0.58 seconds to detach 1 volumes for instance.
May 28 10:06:03.923916 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 85, target: iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7, portal: 192.168.40.100,3260]
May 28 10:06:03.923916 np0000001613 nova-compute[98321]: Logout of [sid: 85, target: iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7, portal: 192.168.40.100,3260] successful.
May 28 10:06:03.923916 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:03.945981 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:03.958157 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:03.994267 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 86, target: iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7, portal: 192.168.50.100,3260]
May 28 10:06:03.994267 np0000001613 nova-compute[98321]: Logout of [sid: 86, target: iqn.2023-03.storpool.com:os--volume-cfafef38-8144-4f30-88af-842505295af7, portal: 192.168.50.100,3260] successful.
May 28 10:06:03.994267 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:04.014616 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:04.014951 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.399s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:06:04.015083 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] <== disconnect_volume: return (399ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:06:04.015342 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:06:04.046103 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-203a87ee-c936-41f2-ae54-53ab6d98e57b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "065c91b8-09c2-4ec8-95e8-606247a3c350" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.645s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:04.332531 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:06:04.332993 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4', 'iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '39b5bd51-62c3-47bd-b975-8b8acb9799f4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:06:04.333092 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:06:04.333634 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:06:04.333896 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4', 'iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '39b5bd51-62c3-47bd-b975-8b8acb9799f4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:06:04.347354 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:06:04.348041 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:06:04.348607 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:06:04.348858 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:06:04.352610 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:06:04.352871 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:06:04.353603 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "065c91b8-09c2-4ec8-95e8-606247a3c350" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:04.353958 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "065c91b8-09c2-4ec8-95e8-606247a3c350" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:04.366196 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:06:04.366196 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:04.372398 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:06:04.372398 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:04.378869 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4] added
May 28 10:06:04.378869 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:06:04.378869 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:06:04.378869 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:06:04.378869 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:06:04.378869 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:06:04.378869 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:04.378869 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:06:04.378869 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0291(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:06:04.378869 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:06:04.383634 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4] added
May 28 10:06:04.383634 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:06:04.383634 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:06:04.383634 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:06:04.383634 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:06:04.383634 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:06:04.383634 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:04.384107 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:06:04.384107 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0311(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:06:04.384107 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:06:04.402691 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:04.404558 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:04.578624 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lazy-loading 'flavor' on Instance uuid cc75b5c9-a7ad-4a7c-aff0-336c8e64b120 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:06:04.586288 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:04.664265 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-55dd18b2-7f3a-439b-b596-7221f1f0c883 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "b50eced2-71bf-4448-b2e1-f9657509f34c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:04.664399 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-55dd18b2-7f3a-439b-b596-7221f1f0c883 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "b50eced2-71bf-4448-b2e1-f9657509f34c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:04.664581 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-55dd18b2-7f3a-439b-b596-7221f1f0c883 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "b50eced2-71bf-4448-b2e1-f9657509f34c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:04.664699 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-55dd18b2-7f3a-439b-b596-7221f1f0c883 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "b50eced2-71bf-4448-b2e1-f9657509f34c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:04.664814 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-55dd18b2-7f3a-439b-b596-7221f1f0c883 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "b50eced2-71bf-4448-b2e1-f9657509f34c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:04.666600 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-55dd18b2-7f3a-439b-b596-7221f1f0c883 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Terminating instance
May 28 10:06:04.736575 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0004198310002720973 future=<Future at 0x73c1f4361850 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:04.737121 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Emitting event <LifecycleEvent: 1779962749.7360353, 36fde791-779f-42a8-9aef-87eafbbe0370 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:06:04.737305 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:04.737540 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] VM Stopped (Lifecycle Event)
May 28 10:06:04.738406 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=0.9297501940000075 future=<Future at 0x73c1f43cc620 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:04.738603 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=0.9295343929998126 future=<Future at 0x73c1f43cc620 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:04.807969 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:06:04.808141 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:06:04.859877 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Detaching volume 30e9f06a-e75c-41d1-a368-39a4e97f7c8e
May 28 10:06:04.892380 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Attempting to driver detach volume 30e9f06a-e75c-41d1-a368-39a4e97f7c8e from mountpoint /dev/vdb
May 28 10:06:04.927762 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'plain'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e', 'iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '30e9f06a-e75c-41d1-a368-39a4e97f7c8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-9'}, 'status': 'reserved', 'instance': '065c91b8-09c2-4ec8-95e8-606247a3c350', 'attached_at': '', 'detached_at': '', 'volume_id': '30e9f06a-e75c-41d1-a368-39a4e97f7c8e', 'serial': '30e9f06a-e75c-41d1-a368-39a4e97f7c8e'} {{(pid=98321) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 10:06:04.933176 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Found disk vdb by alias ua-30e9f06a-e75c-41d1-a368-39a4e97f7c8e {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:06:04.934039 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Found disk vdb by alias ua-30e9f06a-e75c-41d1-a368-39a4e97f7c8e {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:06:04.934750 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Attempting to detach device vdb from instance 065c91b8-09c2-4ec8-95e8-606247a3c350 from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 10:06:04.934750 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:06:04.934750 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:06:04.934750 np0000001613 nova-compute[98321]:   <alias name="ua-30e9f06a-e75c-41d1-a368-39a4e97f7c8e"/>
May 28 10:06:04.934750 np0000001613 nova-compute[98321]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-9"/>
May 28 10:06:04.934750 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:06:04.934750 np0000001613 nova-compute[98321]:   <serial>30e9f06a-e75c-41d1-a368-39a4e97f7c8e</serial>
May 28 10:06:04.934750 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:06:04.934750 np0000001613 nova-compute[98321]: </disk>
May 28 10:06:04.934750 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:06:04.945108 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Successfully detached device vdb from instance 065c91b8-09c2-4ec8-95e8-606247a3c350 from the persistent domain config.
May 28 10:06:04.945108 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] (1/8): Attempting to detach device vdb with device alias ua-30e9f06a-e75c-41d1-a368-39a4e97f7c8e from instance 065c91b8-09c2-4ec8-95e8-606247a3c350 from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 10:06:04.945108 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:06:04.945108 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:06:04.945108 np0000001613 nova-compute[98321]:   <alias name="ua-30e9f06a-e75c-41d1-a368-39a4e97f7c8e"/>
May 28 10:06:04.945108 np0000001613 nova-compute[98321]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-9"/>
May 28 10:06:04.945108 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:06:04.945108 np0000001613 nova-compute[98321]:   <serial>30e9f06a-e75c-41d1-a368-39a4e97f7c8e</serial>
May 28 10:06:04.945108 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:06:04.945108 np0000001613 nova-compute[98321]: </disk>
May 28 10:06:04.945108 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:06:05.169558 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-55dd18b2-7f3a-439b-b596-7221f1f0c883 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:06:05.191189 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:05.201877 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:05.218205 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:05.243143 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 36fde791-779f-42a8-9aef-87eafbbe0370] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:06:05.310669 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:06:05.378499 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:06:05.384579 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:06:05.393794 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:06:05.393794 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:05.405967 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f500b567-624b-4f7a-bc29-69ee8275709b req-552c6fbb-4a8d-401e-97bb-e66596ea5755 service nova] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Received event network-vif-unplugged-285e920e-6acb-4c37-ab27-552538efb652 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:05.405967 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f500b567-624b-4f7a-bc29-69ee8275709b req-552c6fbb-4a8d-401e-97bb-e66596ea5755 service nova] Acquiring lock "b50eced2-71bf-4448-b2e1-f9657509f34c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:05.405967 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f500b567-624b-4f7a-bc29-69ee8275709b req-552c6fbb-4a8d-401e-97bb-e66596ea5755 service nova] Lock "b50eced2-71bf-4448-b2e1-f9657509f34c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:05.405967 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f500b567-624b-4f7a-bc29-69ee8275709b req-552c6fbb-4a8d-401e-97bb-e66596ea5755 service nova] Lock "b50eced2-71bf-4448-b2e1-f9657509f34c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:05.405967 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f500b567-624b-4f7a-bc29-69ee8275709b req-552c6fbb-4a8d-401e-97bb-e66596ea5755 service nova] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] No waiting events found dispatching network-vif-unplugged-285e920e-6acb-4c37-ab27-552538efb652 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:06:05.405967 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f500b567-624b-4f7a-bc29-69ee8275709b req-552c6fbb-4a8d-401e-97bb-e66596ea5755 service nova] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Received event network-vif-unplugged-285e920e-6acb-4c37-ab27-552538efb652 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:06:05.407210 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:06:05.407210 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:05.409600 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:05.409600 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:05.414204 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:05.423963 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:05.431939 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:06:05.431939 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:06:05.431939 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:06:05.431939 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:06:05.431939 np0000001613 nova-compute[98321]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:06:05.431939 np0000001613 nova-compute[98321]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:06:05.431939 np0000001613 nova-compute[98321]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e (non-flash)
May 28 10:06:05.431939 np0000001613 nova-compute[98321]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e (non-flash)
May 28 10:06:05.431939 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:06:05.432242 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:06:05.432242 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:06:05.432242 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:06:05.432242 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:06:05.432242 np0000001613 nova-compute[98321]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:06:05.432242 np0000001613 nova-compute[98321]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:06:05.432242 np0000001613 nova-compute[98321]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e (non-flash)
May 28 10:06:05.432242 np0000001613 nova-compute[98321]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e (non-flash)
May 28 10:06:05.432242 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:06:05.445184 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:06:05.445184 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:06:05.445184 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:06:05.445184 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:06:05.445184 np0000001613 nova-compute[98321]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:06:05.445184 np0000001613 nova-compute[98321]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:06:05.445184 np0000001613 nova-compute[98321]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e (non-flash)
May 28 10:06:05.445184 np0000001613 nova-compute[98321]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e (non-flash)
May 28 10:06:05.445184 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:06:05.445184 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:06:05.445184 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:06:05.445184 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:06:05.445184 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:06:05.445184 np0000001613 nova-compute[98321]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:06:05.445184 np0000001613 nova-compute[98321]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:06:05.445184 np0000001613 nova-compute[98321]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e (non-flash)
May 28 10:06:05.445184 np0000001613 nova-compute[98321]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e (non-flash)
May 28 10:06:05.445184 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:06:05.480007 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4, portal: 192.168.50.100,3260]
May 28 10:06:05.480007 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4, portal: 192.168.50.100,3260] successful.
May 28 10:06:05.480007 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:05.486009 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4, portal: 192.168.40.100,3260]
May 28 10:06:05.486009 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4, portal: 192.168.40.100,3260] successful.
May 28 10:06:05.486009 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:05.500462 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:05.506886 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:05.527967 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:06:05.527967 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:06:05.527967 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:06:05.527967 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:06:05.527967 np0000001613 nova-compute[98321]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:06:05.527967 np0000001613 nova-compute[98321]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:06:05.527967 np0000001613 nova-compute[98321]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e (non-flash)
May 28 10:06:05.527967 np0000001613 nova-compute[98321]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e (non-flash)
May 28 10:06:05.527967 np0000001613 nova-compute[98321]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:05.527967 np0000001613 nova-compute[98321]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:05.527967 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:06:05.527967 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:06:05.527967 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:06:05.527967 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:06:05.527967 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:06:05.527967 np0000001613 nova-compute[98321]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:06:05.527967 np0000001613 nova-compute[98321]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:06:05.527967 np0000001613 nova-compute[98321]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e (non-flash)
May 28 10:06:05.527967 np0000001613 nova-compute[98321]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e (non-flash)
May 28 10:06:05.527967 np0000001613 nova-compute[98321]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:05.527967 np0000001613 nova-compute[98321]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:05.527967 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:06:05.527967 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.178s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:06:05.527967 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:06:05.528922 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] HCTL ('11', '-', '-', 0) found on session 93 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:06:05.529178 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:06:05.532035 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:06:05.532035 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:06:05.532035 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:06:05.532035 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:06:05.532035 np0000001613 nova-compute[98321]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:06:05.532035 np0000001613 nova-compute[98321]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:06:05.532035 np0000001613 nova-compute[98321]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e (non-flash)
May 28 10:06:05.532035 np0000001613 nova-compute[98321]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e (non-flash)
May 28 10:06:05.532035 np0000001613 nova-compute[98321]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:05.532035 np0000001613 nova-compute[98321]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:05.532035 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:06:05.532035 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:06:05.532035 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:06:05.532035 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:06:05.532035 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:06:05.532035 np0000001613 nova-compute[98321]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:06:05.532035 np0000001613 nova-compute[98321]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:06:05.532035 np0000001613 nova-compute[98321]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e (non-flash)
May 28 10:06:05.532035 np0000001613 nova-compute[98321]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e (non-flash)
May 28 10:06:05.532035 np0000001613 nova-compute[98321]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:05.532035 np0000001613 nova-compute[98321]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:05.532035 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:06:05.532035 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:06:05.532035 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:06:05.532035 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] HCTL ('12', '-', '-', 0) found on session 94 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:06:05.532035 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:06:05.546456 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Searching for a device in session 93 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:06:05.547349 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '39b5bd51-62c3-47bd-b975-8b8acb9799f4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:06:05.553550 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Searching for a device in session 94 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:06:05.553739 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '39b5bd51-62c3-47bd-b975-8b8acb9799f4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:06:05.586895 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-299fe3df-3956-4fd7-948c-bc7ef458fd1b tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.078s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:05.636149 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779962765.635775, 065c91b8-09c2-4ec8-95e8-606247a3c350 => ua-30e9f06a-e75c-41d1-a368-39a4e97f7c8e> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 10:06:05.637113 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-30e9f06a-e75c-41d1-a368-39a4e97f7c8e for instance 065c91b8-09c2-4ec8-95e8-606247a3c350 {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 10:06:05.649587 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Successfully detached device vdb from instance 065c91b8-09c2-4ec8-95e8-606247a3c350 from the live domain config.
May 28 10:06:05.650658 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.99967697899956 future=<Future at 0x73c1f41ca360 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:05.652359 np0000001613 nova-compute[98321]: WARNING stevedore.named [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 10:06:05.652619 np0000001613 nova-compute[98321]: WARNING castellan.key_manager [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 10:06:05.652854 np0000001613 nova-compute[98321]: WARNING nova.keymgr.conf_key_mgr [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 10:06:05.653942 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Using volume encryptor '<os_brick.encryptors.cryptsetup.CryptsetupEncryptor object at 0x73c1f418d220>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e', 'iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '30e9f06a-e75c-41d1-a368-39a4e97f7c8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-9'}, 'status': 'reserved', 'instance': '065c91b8-09c2-4ec8-95e8-606247a3c350', 'attached_at': '', 'detached_at': '', 'volume_id': '30e9f06a-e75c-41d1-a368-39a4e97f7c8e', 'serial': '30e9f06a-e75c-41d1-a368-39a4e97f7c8e'} {{(pid=98321) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 10:06:05.654060 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors.cryptsetup [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] closing encrypted volume /dev/dm-10 {{(pid=98321) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/cryptsetup.py:153}}
May 28 10:06:05.657958 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Instance destroyed successfully.
May 28 10:06:05.658475 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-55dd18b2-7f3a-439b-b596-7221f1f0c883 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lazy-loading 'resources' on Instance uuid b50eced2-71bf-4448-b2e1-f9657509f34c {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:06:05.668478 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.00032295399978465866 future=<Future at 0x73c1f43cc620 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:05.668599 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:05.668632 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=9.294271391000166 future=<Future at 0x73c1fc7d4cb0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:05.668714 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=9.294193705999987 future=<Future at 0x73c1fc7d4cb0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:05.669318 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Emitting event <LifecycleEvent: 1779962750.6680732, 13636cda-9029-46e5-8305-ee3ea32ce0f7 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:06:05.669673 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] VM Stopped (Lifecycle Event)
May 28 10:06:05.690227 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:06:05.690465 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e', 'iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '30e9f06a-e75c-41d1-a368-39a4e97f7c8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-9'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:06:05.690706 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:06:05.823227 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.417s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:05.876969 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Deleted allocations for instance 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb
May 28 10:06:06.097515 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:06.161589 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-55dd18b2-7f3a-439b-b596-7221f1f0c883 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:00:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='multiattach-server-0',id=21,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrmebBJn1C7uIkB9JjrF4yuEuto77kf4SaBedfdmOdQwZzJyqrVQd0Wq/SA1eDV6FpWwBB4BKjLBcFgkvBrXSx4LeKHMUic/tPGA5px/F625klLXypbV+9p49FvQ4XImQ==',key_name='tempest-keypair-2082049331',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:00:46Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3403b533910644d2b254922fb84b1ac0',ramdisk_id='',reservation_id='r-t0zr0m60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1052626787',owner_user_name='tempest-AttachVolumeMultiAttachTest-1052626787-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:00:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13481913e22d4bf1a94e1a9a270f5494',uuid=b50eced2-71bf-4448-b2e1-f9657509f34c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "285e920e-6acb-4c37-ab27-552538efb652", "address": "fa:16:3e:db:10:77", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap285e920e-6a", "ovs_interfaceid": "285e920e-6acb-4c37-ab27-552538efb652", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:06:06.161832 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-55dd18b2-7f3a-439b-b596-7221f1f0c883 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converting VIF {"id": "285e920e-6acb-4c37-ab27-552538efb652", "address": "fa:16:3e:db:10:77", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap285e920e-6a", "ovs_interfaceid": "285e920e-6acb-4c37-ab27-552538efb652", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:06:06.162368 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-55dd18b2-7f3a-439b-b596-7221f1f0c883 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:10:77,bridge_name='br-int',has_traffic_filtering=True,id=285e920e-6acb-4c37-ab27-552538efb652,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap285e920e-6a') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:06:06.162693 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-55dd18b2-7f3a-439b-b596-7221f1f0c883 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:10:77,bridge_name='br-int',has_traffic_filtering=True,id=285e920e-6acb-4c37-ab27-552538efb652,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap285e920e-6a') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:06:06.164056 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:06.164381 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap285e920e-6a, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:06:06.165558 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:06.166439 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:06:06.167129 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:06.167892 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:06.168063 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8dea4167-a386-4d88-8469-69a2408f1ddb) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:06:06.168566 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:06.169015 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:06:06.169729 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:06.171539 np0000001613 nova-compute[98321]: INFO os_vif [None req-55dd18b2-7f3a-439b-b596-7221f1f0c883 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:10:77,bridge_name='br-int',has_traffic_filtering=True,id=285e920e-6acb-4c37-ab27-552538efb652,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap285e920e-6a')
May 28 10:06:06.171922 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-55dd18b2-7f3a-439b-b596-7221f1f0c883 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Deleting instance files /opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c_del
May 28 10:06:06.172852 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 13636cda-9029-46e5-8305-ee3ea32ce0f7] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:06:06.173589 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-55dd18b2-7f3a-439b-b596-7221f1f0c883 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Deletion of /opt/stack/data/nova/instances/b50eced2-71bf-4448-b2e1-f9657509f34c_del complete
May 28 10:06:06.349696 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:06:06.679305 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-55dd18b2-7f3a-439b-b596-7221f1f0c883 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Took 1.51 seconds to destroy the instance on the hypervisor.
May 28 10:06:06.679835 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-55dd18b2-7f3a-439b-b596-7221f1f0c883 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:06:06.682310 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:06:06.682432 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:06:06.682985 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:06.773487 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:06.882571 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-1280cd49-7210-458e-9631-f22fad312fc2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.140s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:07.033603 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-10cd0e0a-dec9-4fee-9692-3972ca51b4e6 req-a53d483e-68fe-475a-9af6-be724b84634a service nova] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Received event network-vif-deleted-285e920e-6acb-4c37-ab27-552538efb652 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:07.033603 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-10cd0e0a-dec9-4fee-9692-3972ca51b4e6 req-a53d483e-68fe-475a-9af6-be724b84634a service nova] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Neutron deleted interface 285e920e-6acb-4c37-ab27-552538efb652; detaching it from the instance and deleting it from the info cache
May 28 10:06:07.034914 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-10cd0e0a-dec9-4fee-9692-3972ca51b4e6 req-a53d483e-68fe-475a-9af6-be724b84634a service nova] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Detach interface failed, port_id=285e920e-6acb-4c37-ab27-552538efb652, reason: Instance b50eced2-71bf-4448-b2e1-f9657509f34c could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:06:07.372560 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Found WWN 330000000f3d35ae2 for multipath device dm-1 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:06:07.373062 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:06:07.373122 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '330000000f3d35ae2', 'path': '/dev/dm-1', 'multipath_id': '330000000f3d35ae2'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:06:07.373303 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f3d35ae2', 'path': '/dev/dm-1', 'multipath_id': '330000000f3d35ae2'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:06:07.373975 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.683s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:06:07.374442 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e', 'iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '30e9f06a-e75c-41d1-a368-39a4e97f7c8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:06:07.374618 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:06:07.384787 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lazy-loading 'flavor' on Instance uuid 11fd9dae-9efe-4726-abdd-995998d1df87 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:06:07.408556 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:06:07.408556 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:06:07.408556 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:06:07.408556 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:06:07.408556 np0000001613 nova-compute[98321]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:06:07.408556 np0000001613 nova-compute[98321]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:06:07.408556 np0000001613 nova-compute[98321]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e (non-flash)
May 28 10:06:07.408556 np0000001613 nova-compute[98321]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e (non-flash)
May 28 10:06:07.408556 np0000001613 nova-compute[98321]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:07.408556 np0000001613 nova-compute[98321]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:07.408556 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:06:07.408911 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:06:07.408911 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:06:07.408911 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:06:07.408911 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:06:07.408911 np0000001613 nova-compute[98321]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:06:07.408911 np0000001613 nova-compute[98321]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:06:07.408911 np0000001613 nova-compute[98321]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e (non-flash)
May 28 10:06:07.408911 np0000001613 nova-compute[98321]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e (non-flash)
May 28 10:06:07.408911 np0000001613 nova-compute[98321]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:07.408911 np0000001613 nova-compute[98321]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:07.408911 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:06:07.408911 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e', '79'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e', '80'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204', '89'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204', '90'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e', '91'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e', '92'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4', '93'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4', '94')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:06:07.408911 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e', '91')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:06:07.409835 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e', '92')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:06:07.410619 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc4742c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e'): ({'sdm'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:06:07.410836 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Removing multipathed devices sdl, sdm {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:06:07.411046 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Flush multipath device 3300000000cf33c05 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:06:07.447735 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:06:07.469400 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7c773c05-7017-4711-9739-7d7973e258ff req-24f400fe-f027-470d-9bf7-b74dc65c6434 service nova] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Received event network-vif-unplugged-285e920e-6acb-4c37-ab27-552538efb652 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:07.469688 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7c773c05-7017-4711-9739-7d7973e258ff req-24f400fe-f027-470d-9bf7-b74dc65c6434 service nova] Acquiring lock "b50eced2-71bf-4448-b2e1-f9657509f34c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:07.469939 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7c773c05-7017-4711-9739-7d7973e258ff req-24f400fe-f027-470d-9bf7-b74dc65c6434 service nova] Lock "b50eced2-71bf-4448-b2e1-f9657509f34c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:07.470126 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7c773c05-7017-4711-9739-7d7973e258ff req-24f400fe-f027-470d-9bf7-b74dc65c6434 service nova] Lock "b50eced2-71bf-4448-b2e1-f9657509f34c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:07.470351 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7c773c05-7017-4711-9739-7d7973e258ff req-24f400fe-f027-470d-9bf7-b74dc65c6434 service nova] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] No waiting events found dispatching network-vif-unplugged-285e920e-6acb-4c37-ab27-552538efb652 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:06:07.470540 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7c773c05-7017-4711-9739-7d7973e258ff req-24f400fe-f027-470d-9bf7-b74dc65c6434 service nova] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Received event network-vif-unplugged-285e920e-6acb-4c37-ab27-552538efb652 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:06:07.474466 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:06:07.497309 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:06:07.545646 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Checking to see if SCSI volumes sdl, sdm have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:06:07.545862 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] SCSI volumes sdl, sdm have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:06:07.547125 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Checking to see if device paths {'sdl', 'sdm'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:06:07.560207 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Device paths {'sdl', 'sdm'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:06:07.560325 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:06:07.570971 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:07.606260 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 91, target: iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e, portal: 192.168.40.100,3260]
May 28 10:06:07.606260 np0000001613 nova-compute[98321]: Logout of [sid: 91, target: iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e, portal: 192.168.40.100,3260] successful.
May 28 10:06:07.606260 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:07.623851 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:07.635495 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:07.666180 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 92, target: iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e, portal: 192.168.50.100,3260]
May 28 10:06:07.666180 np0000001613 nova-compute[98321]: Logout of [sid: 92, target: iqn.2023-03.storpool.com:os--volume-30e9f06a-e75c-41d1-a368-39a4e97f7c8e, portal: 192.168.50.100,3260] successful.
May 28 10:06:07.666180 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:07.685057 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:07.686058 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:06:07.686157 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] <== disconnect_volume: return (1995ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:06:07.686371 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:06:07.887771 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Attempting to attach volume 39b5bd51-62c3-47bd-b975-8b8acb9799f4 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 10:06:07.891140 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] attach device xml: <disk type="block" device="disk">
May 28 10:06:07.891140 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:06:07.891140 np0000001613 nova-compute[98321]:   <alias name="ua-39b5bd51-62c3-47bd-b975-8b8acb9799f4"/>
May 28 10:06:07.891140 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-1"/>
May 28 10:06:07.891140 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:06:07.891140 np0000001613 nova-compute[98321]:   <serial>39b5bd51-62c3-47bd-b975-8b8acb9799f4</serial>
May 28 10:06:07.891140 np0000001613 nova-compute[98321]: </disk>
May 28 10:06:07.891140 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 10:06:07.976625 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Took 1.29 seconds to deallocate network for instance.
May 28 10:06:08.243078 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lazy-loading 'flavor' on Instance uuid 065c91b8-09c2-4ec8-95e8-606247a3c350 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:06:08.483056 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-55dd18b2-7f3a-439b-b596-7221f1f0c883 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:08.483477 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-55dd18b2-7f3a-439b-b596-7221f1f0c883 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:08.827469 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-55dd18b2-7f3a-439b-b596-7221f1f0c883 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:06:08.827653 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-55dd18b2-7f3a-439b-b596-7221f1f0c883 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:06:09.250811 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bbad61f5-e0e7-4410-afa9-5a169c60dba4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "065c91b8-09c2-4ec8-95e8-606247a3c350" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.897s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:09.330349 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-55dd18b2-7f3a-439b-b596-7221f1f0c883 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:06:09.558301 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:06:09.558652 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:06:09.558652 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:06:09.558813 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] No VIF found with MAC fa:16:3e:b9:51:2c, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:06:09.603317 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:09.754304 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f7f864a2-62f6-456e-b923-9ce7fb35cead tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "065c91b8-09c2-4ec8-95e8-606247a3c350" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:09.754865 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f7f864a2-62f6-456e-b923-9ce7fb35cead tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "065c91b8-09c2-4ec8-95e8-606247a3c350" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:09.755126 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f7f864a2-62f6-456e-b923-9ce7fb35cead tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "065c91b8-09c2-4ec8-95e8-606247a3c350-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:09.755346 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f7f864a2-62f6-456e-b923-9ce7fb35cead tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "065c91b8-09c2-4ec8-95e8-606247a3c350-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:09.755541 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f7f864a2-62f6-456e-b923-9ce7fb35cead tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "065c91b8-09c2-4ec8-95e8-606247a3c350-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:09.757726 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-f7f864a2-62f6-456e-b923-9ce7fb35cead tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Terminating instance
May 28 10:06:09.840069 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-55dd18b2-7f3a-439b-b596-7221f1f0c883 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.357s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:09.898192 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-55dd18b2-7f3a-439b-b596-7221f1f0c883 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Deleted allocations for instance b50eced2-71bf-4448-b2e1-f9657509f34c
May 28 10:06:10.212003 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "86c73e57-3c63-4ccf-bff1-9529b5a1c837" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:10.212417 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "86c73e57-3c63-4ccf-bff1-9529b5a1c837" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:10.266000 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f7f864a2-62f6-456e-b923-9ce7fb35cead tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:06:10.283435 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:10.285821 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:10.300439 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:10.306345 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:10.325279 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:10.330133 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:10.408535 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-129307b0-975f-4b59-98f6-12eaf819e242 req-683c752f-e01e-41e2-8c1b-38ab598309ad service nova] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Received event network-vif-unplugged-969bbc57-12a6-430b-a878-5424caa1a488 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:10.408713 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-129307b0-975f-4b59-98f6-12eaf819e242 req-683c752f-e01e-41e2-8c1b-38ab598309ad service nova] Acquiring lock "065c91b8-09c2-4ec8-95e8-606247a3c350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:10.408812 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-129307b0-975f-4b59-98f6-12eaf819e242 req-683c752f-e01e-41e2-8c1b-38ab598309ad service nova] Lock "065c91b8-09c2-4ec8-95e8-606247a3c350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:10.409010 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-129307b0-975f-4b59-98f6-12eaf819e242 req-683c752f-e01e-41e2-8c1b-38ab598309ad service nova] Lock "065c91b8-09c2-4ec8-95e8-606247a3c350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:10.409194 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-129307b0-975f-4b59-98f6-12eaf819e242 req-683c752f-e01e-41e2-8c1b-38ab598309ad service nova] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] No waiting events found dispatching network-vif-unplugged-969bbc57-12a6-430b-a878-5424caa1a488 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:06:10.410006 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-129307b0-975f-4b59-98f6-12eaf819e242 req-683c752f-e01e-41e2-8c1b-38ab598309ad service nova] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Received event network-vif-unplugged-969bbc57-12a6-430b-a878-5424caa1a488 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:06:10.432301 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Acquiring lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:10.432486 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:10.593717 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:10.603847 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:10.628324 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999720679999882 future=<Future at 0x73c1f43aeff0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:10.630954 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Instance destroyed successfully.
May 28 10:06:10.631379 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-f7f864a2-62f6-456e-b923-9ce7fb35cead tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lazy-loading 'resources' on Instance uuid 065c91b8-09c2-4ec8-95e8-606247a3c350 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:06:10.716040 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:06:10.906046 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-55dd18b2-7f3a-439b-b596-7221f1f0c883 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "b50eced2-71bf-4448-b2e1-f9657509f34c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.242s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:10.935372 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Detaching volume 3a1e5674-04a4-4eb3-be73-5104b2fc0204
May 28 10:06:10.974140 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Attempting to driver detach volume 3a1e5674-04a4-4eb3-be73-5104b2fc0204 from mountpoint /dev/vdc
May 28 10:06:10.979182 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Found disk vdc by alias ua-3a1e5674-04a4-4eb3-be73-5104b2fc0204 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:06:10.979182 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Found disk vdc by alias ua-3a1e5674-04a4-4eb3-be73-5104b2fc0204 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:06:10.979182 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Attempting to detach device vdc from instance cc75b5c9-a7ad-4a7c-aff0-336c8e64b120 from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 10:06:10.979182 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:06:10.979182 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:06:10.979182 np0000001613 nova-compute[98321]:   <alias name="ua-3a1e5674-04a4-4eb3-be73-5104b2fc0204"/>
May 28 10:06:10.979182 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-0"/>
May 28 10:06:10.979182 np0000001613 nova-compute[98321]:   <target dev="vdc" bus="virtio"/>
May 28 10:06:10.979182 np0000001613 nova-compute[98321]:   <serial>3a1e5674-04a4-4eb3-be73-5104b2fc0204</serial>
May 28 10:06:10.979182 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 10:06:10.979182 np0000001613 nova-compute[98321]: </disk>
May 28 10:06:10.979182 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:06:10.984931 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Successfully detached device vdc from instance cc75b5c9-a7ad-4a7c-aff0-336c8e64b120 from the persistent domain config.
May 28 10:06:10.984931 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] (1/8): Attempting to detach device vdc with device alias ua-3a1e5674-04a4-4eb3-be73-5104b2fc0204 from instance cc75b5c9-a7ad-4a7c-aff0-336c8e64b120 from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 10:06:10.984931 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:06:10.984931 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:06:10.984931 np0000001613 nova-compute[98321]:   <alias name="ua-3a1e5674-04a4-4eb3-be73-5104b2fc0204"/>
May 28 10:06:10.984931 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-0"/>
May 28 10:06:10.984931 np0000001613 nova-compute[98321]:   <target dev="vdc" bus="virtio"/>
May 28 10:06:10.984931 np0000001613 nova-compute[98321]:   <serial>3a1e5674-04a4-4eb3-be73-5104b2fc0204</serial>
May 28 10:06:10.984931 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 10:06:10.984931 np0000001613 nova-compute[98321]: </disk>
May 28 10:06:10.984931 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:06:11.133976 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-f7f864a2-62f6-456e-b923-9ce7fb35cead tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:05:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-696493070',display_name='tempest-TestEncryptedCinderVolumes-server-696493070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testencryptedcindervolumes-server-696493070',id=39,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJkazBN+XtU9598PjGz7eBoPXWM/ePfBYZfDwMI7/O2WWXrMcZkgI/jRBFa3sf7hiaErYuSubjkr2Q6JMmgrZkTXUkmwdFWIRckCd6HyiSCRs5V2WcaCJm2hov7dKcV87Q==',key_name='tempest-keypair-380292068',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:05:16Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7563a83d33d4bc1a6610ccf53c18dc1',ramdisk_id='',reservation_id='r-rymjkr2c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-297752033',owner_user_name='tempest-TestEncryptedCinderVolumes-297752033-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:05:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='961948be669c4a18a29398d53015f03b',uuid=065c91b8-09c2-4ec8-95e8-606247a3c350,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "969bbc57-12a6-430b-a878-5424caa1a488", "address": "fa:16:3e:04:ca:46", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap969bbc57-12", "ovs_interfaceid": "969bbc57-12a6-430b-a878-5424caa1a488", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:06:11.136910 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-f7f864a2-62f6-456e-b923-9ce7fb35cead tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Converting VIF {"id": "969bbc57-12a6-430b-a878-5424caa1a488", "address": "fa:16:3e:04:ca:46", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap969bbc57-12", "ovs_interfaceid": "969bbc57-12a6-430b-a878-5424caa1a488", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:06:11.137589 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-f7f864a2-62f6-456e-b923-9ce7fb35cead tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:ca:46,bridge_name='br-int',has_traffic_filtering=True,id=969bbc57-12a6-430b-a878-5424caa1a488,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969bbc57-12') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:06:11.139444 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-f7f864a2-62f6-456e-b923-9ce7fb35cead tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:ca:46,bridge_name='br-int',has_traffic_filtering=True,id=969bbc57-12a6-430b-a878-5424caa1a488,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969bbc57-12') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:06:11.140676 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4cb0de7f-7344-45aa-86b1-89bd9c73301c tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "11fd9dae-9efe-4726-abdd-995998d1df87" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.539s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:11.142385 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:11.142650 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap969bbc57-12, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:06:11.143784 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:11.144559 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:06:11.145199 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:11.145590 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:11.145879 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6e42bf00-b489-48c7-b9e0-8203b5535dae) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:06:11.146392 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:11.146969 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:06:11.147052 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:11.151606 np0000001613 nova-compute[98321]: INFO os_vif [None req-f7f864a2-62f6-456e-b923-9ce7fb35cead tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:ca:46,bridge_name='br-int',has_traffic_filtering=True,id=969bbc57-12a6-430b-a878-5424caa1a488,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap969bbc57-12')
May 28 10:06:11.151887 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-f7f864a2-62f6-456e-b923-9ce7fb35cead tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Deleting instance files /opt/stack/data/nova/instances/065c91b8-09c2-4ec8-95e8-606247a3c350_del
May 28 10:06:11.152627 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-f7f864a2-62f6-456e-b923-9ce7fb35cead tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Deletion of /opt/stack/data/nova/instances/065c91b8-09c2-4ec8-95e8-606247a3c350_del complete
May 28 10:06:11.289135 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:11.289851 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:11.294685 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:06:11.294873 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Claim successful on node np0000001613
May 28 10:06:11.519914 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779962771.5195916, cc75b5c9-a7ad-4a7c-aff0-336c8e64b120 => ua-3a1e5674-04a4-4eb3-be73-5104b2fc0204> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 10:06:11.521544 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-3a1e5674-04a4-4eb3-be73-5104b2fc0204 for instance cc75b5c9-a7ad-4a7c-aff0-336c8e64b120 {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 10:06:11.524393 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Successfully detached device vdc from instance cc75b5c9-a7ad-4a7c-aff0-336c8e64b120 from the live domain config.
May 28 10:06:11.525631 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:06:11.526011 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204', 'iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3a1e5674-04a4-4eb3-be73-5104b2fc0204', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:06:11.526196 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:06:11.658473 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-f7f864a2-62f6-456e-b923-9ce7fb35cead tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Took 1.39 seconds to destroy the instance on the hypervisor.
May 28 10:06:11.659065 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-f7f864a2-62f6-456e-b923-9ce7fb35cead tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:06:11.659253 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:06:11.659343 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:06:11.659578 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:11.746435 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:12.216619 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "6895009a-024f-4919-9d25-a52905eac818" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:12.216853 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "6895009a-024f-4919-9d25-a52905eac818" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:12.216983 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "6895009a-024f-4919-9d25-a52905eac818-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:12.217123 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "6895009a-024f-4919-9d25-a52905eac818-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:12.217277 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "6895009a-024f-4919-9d25-a52905eac818-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:12.221691 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Terminating instance
May 28 10:06:12.476102 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ceb803a7-e470-4299-bac2-2054153a0aed req-f69bdc31-4eef-4f2b-bc00-2d409b796541 service nova] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Received event network-vif-unplugged-969bbc57-12a6-430b-a878-5424caa1a488 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:12.477603 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ceb803a7-e470-4299-bac2-2054153a0aed req-f69bdc31-4eef-4f2b-bc00-2d409b796541 service nova] Acquiring lock "065c91b8-09c2-4ec8-95e8-606247a3c350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:12.477800 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ceb803a7-e470-4299-bac2-2054153a0aed req-f69bdc31-4eef-4f2b-bc00-2d409b796541 service nova] Lock "065c91b8-09c2-4ec8-95e8-606247a3c350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:12.478022 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ceb803a7-e470-4299-bac2-2054153a0aed req-f69bdc31-4eef-4f2b-bc00-2d409b796541 service nova] Lock "065c91b8-09c2-4ec8-95e8-606247a3c350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:12.478125 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ceb803a7-e470-4299-bac2-2054153a0aed req-f69bdc31-4eef-4f2b-bc00-2d409b796541 service nova] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] No waiting events found dispatching network-vif-unplugged-969bbc57-12a6-430b-a878-5424caa1a488 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:06:12.478221 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ceb803a7-e470-4299-bac2-2054153a0aed req-f69bdc31-4eef-4f2b-bc00-2d409b796541 service nova] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Received event network-vif-unplugged-969bbc57-12a6-430b-a878-5424caa1a488 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:06:12.478714 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ceb803a7-e470-4299-bac2-2054153a0aed req-f69bdc31-4eef-4f2b-bc00-2d409b796541 service nova] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Received event network-vif-deleted-969bbc57-12a6-430b-a878-5424caa1a488 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:12.478857 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-ceb803a7-e470-4299-bac2-2054153a0aed req-f69bdc31-4eef-4f2b-bc00-2d409b796541 service nova] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Neutron deleted interface 969bbc57-12a6-430b-a878-5424caa1a488; detaching it from the instance and deleting it from the info cache
May 28 10:06:12.480038 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.954s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:06:12.480488 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204', 'iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3a1e5674-04a4-4eb3-be73-5104b2fc0204', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:06:12.480699 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:06:12.484394 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ceb803a7-e470-4299-bac2-2054153a0aed req-f69bdc31-4eef-4f2b-bc00-2d409b796541 service nova] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Detach interface failed, port_id=969bbc57-12a6-430b-a878-5424caa1a488, reason: Instance 065c91b8-09c2-4ec8-95e8-606247a3c350 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:06:12.518655 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:06:12.518655 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:06:12.518655 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:06:12.518655 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:06:12.518655 np0000001613 nova-compute[98321]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:06:12.518655 np0000001613 nova-compute[98321]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:06:12.518655 np0000001613 nova-compute[98321]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:12.518655 np0000001613 nova-compute[98321]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:12.518655 np0000001613 nova-compute[98321]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f805cb08-462d-4769-8c1b-9667f02243e2 (non-flash)
May 28 10:06:12.518655 np0000001613 nova-compute[98321]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f805cb08-462d-4769-8c1b-9667f02243e2 (non-flash)
May 28 10:06:12.518655 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:06:12.519849 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:06:12.519849 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:06:12.519849 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:06:12.519849 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:06:12.519849 np0000001613 nova-compute[98321]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:06:12.519849 np0000001613 nova-compute[98321]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204 (non-flash)
May 28 10:06:12.519849 np0000001613 nova-compute[98321]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:12.519849 np0000001613 nova-compute[98321]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:12.519849 np0000001613 nova-compute[98321]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f805cb08-462d-4769-8c1b-9667f02243e2 (non-flash)
May 28 10:06:12.519849 np0000001613 nova-compute[98321]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f805cb08-462d-4769-8c1b-9667f02243e2 (non-flash)
May 28 10:06:12.519849 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:06:12.519849 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e', '79'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e', '80'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204', '89'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4', '93'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f805cb08-462d-4769-8c1b-9667f02243e2', '95'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f805cb08-462d-4769-8c1b-9667f02243e2', '96')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:06:12.519849 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204', '89')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:06:12.522583 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204', '90')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:06:12.523661 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc2be340>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204'): ({'sdb'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:06:12.523985 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Removing multipathed devices sdb, sdc {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:06:12.524280 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Flush multipath device 330000000eec54f4f {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:06:12.551700 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:06:12.598621 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:06:12.648484 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:06:12.648655 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:06:12.649969 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:06:12.659914 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:06:12.660901 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:06:12.672959 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:12.679101 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:06:12.679484 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:06:12.711246 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 89, target: iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204, portal: 192.168.40.100,3260]
May 28 10:06:12.711246 np0000001613 nova-compute[98321]: Logout of [sid: 89, target: iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204, portal: 192.168.40.100,3260] successful.
May 28 10:06:12.711246 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:12.727054 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:06:12.730409 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:12.742469 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:12.749411 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:12.752077 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:06:12.754973 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:12.775765 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:12.791926 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 90, target: iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204, portal: 192.168.50.100,3260]
May 28 10:06:12.791926 np0000001613 nova-compute[98321]: Logout of [sid: 90, target: iqn.2023-03.storpool.com:os--volume-3a1e5674-04a4-4eb3-be73-5104b2fc0204, portal: 192.168.50.100,3260] successful.
May 28 10:06:12.791926 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:12.803098 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:12.805072 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:12.811124 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:12.812411 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:06:12.812607 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] <== disconnect_volume: return (1286ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:06:12.812780 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:06:12.925961 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7633e924-30b3-4e85-9bfc-937103455739 req-de81aa0a-c06d-4c11-bb5a-961af69f6050 service nova] [instance: 6895009a-024f-4919-9d25-a52905eac818] Received event network-vif-unplugged-8ec1ac70-71ab-4f36-93a8-fd51f9c08833 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:12.926425 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7633e924-30b3-4e85-9bfc-937103455739 req-de81aa0a-c06d-4c11-bb5a-961af69f6050 service nova] Acquiring lock "6895009a-024f-4919-9d25-a52905eac818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:12.926645 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7633e924-30b3-4e85-9bfc-937103455739 req-de81aa0a-c06d-4c11-bb5a-961af69f6050 service nova] Lock "6895009a-024f-4919-9d25-a52905eac818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:12.926816 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7633e924-30b3-4e85-9bfc-937103455739 req-de81aa0a-c06d-4c11-bb5a-961af69f6050 service nova] Lock "6895009a-024f-4919-9d25-a52905eac818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:12.926984 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7633e924-30b3-4e85-9bfc-937103455739 req-de81aa0a-c06d-4c11-bb5a-961af69f6050 service nova] [instance: 6895009a-024f-4919-9d25-a52905eac818] No waiting events found dispatching network-vif-unplugged-8ec1ac70-71ab-4f36-93a8-fd51f9c08833 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:06:12.927172 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7633e924-30b3-4e85-9bfc-937103455739 req-de81aa0a-c06d-4c11-bb5a-961af69f6050 service nova] [instance: 6895009a-024f-4919-9d25-a52905eac818] Received event network-vif-unplugged-8ec1ac70-71ab-4f36-93a8-fd51f9c08833 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:06:13.052293 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:13.059942 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:13.074340 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999719047000326 future=<Future at 0x73c1f423a780 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:13.076250 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 6895009a-024f-4919-9d25-a52905eac818] Instance destroyed successfully.
May 28 10:06:13.077644 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lazy-loading 'resources' on Instance uuid 6895009a-024f-4919-9d25-a52905eac818 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:06:13.182126 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:06:13.257019 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Took 1.60 seconds to deallocate network for instance.
May 28 10:06:13.358738 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lazy-loading 'flavor' on Instance uuid cc75b5c9-a7ad-4a7c-aff0-336c8e64b120 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:06:13.583890 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T09:59:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-329318184',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumemultiattachtest-server-329318184',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:00:23Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3403b533910644d2b254922fb84b1ac0',ramdisk_id='',reservation_id='r-n7z7kv0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1052626787',owner_user_name='tempest-AttachVolumeMultiAttachTest-1052626787-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:00:24Z,user_data=None,user_id='13481913e22d4bf1a94e1a9a270f5494',uuid=6895009a-024f-4919-9d25-a52905eac818,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ec1ac70-71ab-4f36-93a8-fd51f9c08833", "address": "fa:16:3e:fd:30:e7", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ec1ac70-71", "ovs_interfaceid": "8ec1ac70-71ab-4f36-93a8-fd51f9c08833", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:06:13.584207 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converting VIF {"id": "8ec1ac70-71ab-4f36-93a8-fd51f9c08833", "address": "fa:16:3e:fd:30:e7", "network": {"id": "93b81ccd-4ff5-4033-9080-d898caec2674", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1690616278-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3403b533910644d2b254922fb84b1ac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ec1ac70-71", "ovs_interfaceid": "8ec1ac70-71ab-4f36-93a8-fd51f9c08833", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:06:13.584626 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:30:e7,bridge_name='br-int',has_traffic_filtering=True,id=8ec1ac70-71ab-4f36-93a8-fd51f9c08833,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ec1ac70-71') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:06:13.584876 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:30:e7,bridge_name='br-int',has_traffic_filtering=True,id=8ec1ac70-71ab-4f36-93a8-fd51f9c08833,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ec1ac70-71') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:06:13.585798 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:13.586053 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ec1ac70-71, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:06:13.587188 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:13.587906 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:06:13.588915 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:13.589610 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:13.589748 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e94a6b76-a802-45e8-acda-b7fc283a42d4) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:06:13.590264 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:13.590689 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:06:13.590996 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:13.593699 np0000001613 nova-compute[98321]: INFO os_vif [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:30:e7,bridge_name='br-int',has_traffic_filtering=True,id=8ec1ac70-71ab-4f36-93a8-fd51f9c08833,network=Network(93b81ccd-4ff5-4033-9080-d898caec2674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ec1ac70-71')
May 28 10:06:13.622553 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:06:13.622798 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'edc07b36-f6b6-4feb-855e-506d7efb58ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:06:13.622930 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:06:13.688559 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.399s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:13.689047 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:06:13.762849 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f7f864a2-62f6-456e-b923-9ce7fb35cead tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:13.763048 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f7f864a2-62f6-456e-b923-9ce7fb35cead tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:14.179644 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f7f864a2-62f6-456e-b923-9ce7fb35cead tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:06:14.179945 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-f7f864a2-62f6-456e-b923-9ce7fb35cead tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:06:14.194516 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:06:14.194915 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:06:14.197252 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:14.198147 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:14.282695 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec58233d3b2848bbb2e0b00650398cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e9651268114327a9cc6c6c59bef01e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:06:14.363813 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2b7d017e-15d1-4183-84d5-0de4e3d5f830 tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.931s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:14.605493 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:14.684815 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-f7f864a2-62f6-456e-b923-9ce7fb35cead tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:06:14.698311 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:06:14.963313 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0003741000000445638 future=<Future at 0x73c1fc7d4cb0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:14.963832 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Emitting event <LifecycleEvent: 1779962759.962844, 3edc00a8-2c60-4c44-acb8-6f4d02114bf0 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:06:14.964039 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:14.964267 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] VM Stopped (Lifecycle Event)
May 28 10:06:14.964381 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=0.618720103999749 future=<Future at 0x73c1f42441a0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:14.965468 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=0.6176279520000207 future=<Future at 0x73c1f42441a0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:15.000187 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-153f5ca3-a0e4-4f28-8ce7-09418753b204 req-452f1769-c61f-4bb5-b97c-095043f6eaab service nova] [instance: 6895009a-024f-4919-9d25-a52905eac818] Received event network-vif-unplugged-8ec1ac70-71ab-4f36-93a8-fd51f9c08833 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:15.000402 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-153f5ca3-a0e4-4f28-8ce7-09418753b204 req-452f1769-c61f-4bb5-b97c-095043f6eaab service nova] Acquiring lock "6895009a-024f-4919-9d25-a52905eac818-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:15.001665 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-153f5ca3-a0e4-4f28-8ce7-09418753b204 req-452f1769-c61f-4bb5-b97c-095043f6eaab service nova] Lock "6895009a-024f-4919-9d25-a52905eac818-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:15.001754 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-153f5ca3-a0e4-4f28-8ce7-09418753b204 req-452f1769-c61f-4bb5-b97c-095043f6eaab service nova] Lock "6895009a-024f-4919-9d25-a52905eac818-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:15.001842 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-153f5ca3-a0e4-4f28-8ce7-09418753b204 req-452f1769-c61f-4bb5-b97c-095043f6eaab service nova] [instance: 6895009a-024f-4919-9d25-a52905eac818] No waiting events found dispatching network-vif-unplugged-8ec1ac70-71ab-4f36-93a8-fd51f9c08833 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:06:15.001994 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-153f5ca3-a0e4-4f28-8ce7-09418753b204 req-452f1769-c61f-4bb5-b97c-095043f6eaab service nova] [instance: 6895009a-024f-4919-9d25-a52905eac818] Received event network-vif-unplugged-8ec1ac70-71ab-4f36-93a8-fd51f9c08833 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:06:15.076977 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.453s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:06:15.078666 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'edc07b36-f6b6-4feb-855e-506d7efb58ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:06:15.078666 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:06:15.110672 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:06:15.110672 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:06:15.110672 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:06:15.110672 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:06:15.110672 np0000001613 nova-compute[98321]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:15.110672 np0000001613 nova-compute[98321]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:15.110672 np0000001613 nova-compute[98321]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f805cb08-462d-4769-8c1b-9667f02243e2 (non-flash)
May 28 10:06:15.110672 np0000001613 nova-compute[98321]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f805cb08-462d-4769-8c1b-9667f02243e2 (non-flash)
May 28 10:06:15.110672 np0000001613 nova-compute[98321]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1c38fe04-321d-4a63-b1ae-e2e9b88ce821 (non-flash)
May 28 10:06:15.110672 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:06:15.110672 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:06:15.110672 np0000001613 nova-compute[98321]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee (non-flash)
May 28 10:06:15.110672 np0000001613 nova-compute[98321]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:06:15.110672 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:06:15.110672 np0000001613 nova-compute[98321]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:15.110672 np0000001613 nova-compute[98321]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:15.110672 np0000001613 nova-compute[98321]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f805cb08-462d-4769-8c1b-9667f02243e2 (non-flash)
May 28 10:06:15.110672 np0000001613 nova-compute[98321]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f805cb08-462d-4769-8c1b-9667f02243e2 (non-flash)
May 28 10:06:15.110672 np0000001613 nova-compute[98321]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1c38fe04-321d-4a63-b1ae-e2e9b88ce821 (non-flash)
May 28 10:06:15.110672 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:06:15.110672 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e', '79'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e', '80'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4', '93'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f805cb08-462d-4769-8c1b-9667f02243e2', '95'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f805cb08-462d-4769-8c1b-9667f02243e2', '96'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1c38fe04-321d-4a63-b1ae-e2e9b88ce821', '97')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:06:15.110672 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '30')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:06:15.110672 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee', '29')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:06:15.110672 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1f4717880>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee'): ({'sdh'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:06:15.110672 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Removing multipathed devices sdh, sdi {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:06:15.110672 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Flush multipath device 330000000da67e242 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:06:15.168605 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:06:15.181849 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Successfully created port: e2f09a77-86d2-4a10-a6fa-8bd359b477ba {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:06:15.193573 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f7f864a2-62f6-456e-b923-9ce7fb35cead tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.430s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:15.202617 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:06:15.216996 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:06:15.253185 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-f7f864a2-62f6-456e-b923-9ce7fb35cead tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Deleted allocations for instance 065c91b8-09c2-4ec8-95e8-606247a3c350
May 28 10:06:15.276530 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:06:15.276714 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:06:15.281752 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:06:15.293843 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:06:15.294139 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:06:15.305631 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:15.345565 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee, portal: 192.168.40.100,3260]
May 28 10:06:15.345565 np0000001613 nova-compute[98321]: Logout of [sid: 30, target: iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee, portal: 192.168.40.100,3260] successful.
May 28 10:06:15.345565 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:15.366183 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:15.380844 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:15.418986 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee, portal: 192.168.50.100,3260]
May 28 10:06:15.418986 np0000001613 nova-compute[98321]: Logout of [sid: 29, target: iqn.2023-03.storpool.com:os--volume-edc07b36-f6b6-4feb-855e-506d7efb58ee, portal: 192.168.50.100,3260] successful.
May 28 10:06:15.418986 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:15.436379 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:15.436516 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:06:15.436516 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] <== disconnect_volume: return (1813ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:06:15.436642 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:06:15.436973 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Deleting instance files /opt/stack/data/nova/instances/6895009a-024f-4919-9d25-a52905eac818_del
May 28 10:06:15.437397 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Deletion of /opt/stack/data/nova/instances/6895009a-024f-4919-9d25-a52905eac818_del complete
May 28 10:06:15.468215 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f877c7cd-5215-4471-ade8-4c56eb54925b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 3edc00a8-2c60-4c44-acb8-6f4d02114bf0] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:06:15.583780 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0006391490001078637 future=<Future at 0x73c1f42441a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:15.583843 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:15.583920 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=5.066375570999753 future=<Future at 0x73c1f41ca360 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:15.583988 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=5.066299498999797 future=<Future at 0x73c1f41ca360 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:15.584234 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Emitting event <LifecycleEvent: 1779962760.5830295, 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:06:15.584347 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] VM Stopped (Lifecycle Event)
May 28 10:06:15.711144 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Booting with volume 49c2a3b7-24f1-43b2-9576-96031ee600b4 at /dev/vda
May 28 10:06:15.766965 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:06:15.783279 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:06:15.811261 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:06:15.856795 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Successfully updated port: e2f09a77-86d2-4a10-a6fa-8bd359b477ba {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:06:15.858857 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:06:15.858857 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:06:15.869254 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:06:15.870482 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe9c:7606', 'fe80::e867:17ff:fe2f:2260', 'fe80::fc16:3eff:feb9:512c', 'fe80::1c9e:daff:fee5:c4bc', 'fe80::fc16:3eff:fe08:3107', 'fe80::e02b:1cff:fec7:1a41', 'fe80::fc16:3eff:feb5:7a19', 'fe80::d42a:61ff:fe18:5003'] 
May 28 10:06:15.870609 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:06:15.870743 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:06:15.870995 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] <== get_connector_properties: return (104ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:06:15.871208 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Updating existing volume attachment record: 391b3e46-d7e6-4f23-a3a2-02eb5ecdca6d {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:06:15.918762 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d52f557a-93c3-4867-911f-a558d2302f67 req-6bc7a3b8-7829-4cba-bd1d-31ec11b0c0b9 service nova] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Received event network-changed-e2f09a77-86d2-4a10-a6fa-8bd359b477ba {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:15.918899 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d52f557a-93c3-4867-911f-a558d2302f67 req-6bc7a3b8-7829-4cba-bd1d-31ec11b0c0b9 service nova] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Refreshing instance network info cache due to event network-changed-e2f09a77-86d2-4a10-a6fa-8bd359b477ba. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:06:15.919103 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d52f557a-93c3-4867-911f-a558d2302f67 req-6bc7a3b8-7829-4cba-bd1d-31ec11b0c0b9 service nova] Acquiring lock "refresh_cache-86c73e57-3c63-4ccf-bff1-9529b5a1c837" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:06:15.919234 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d52f557a-93c3-4867-911f-a558d2302f67 req-6bc7a3b8-7829-4cba-bd1d-31ec11b0c0b9 service nova] Acquired lock "refresh_cache-86c73e57-3c63-4ccf-bff1-9529b5a1c837" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:06:15.922657 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-d52f557a-93c3-4867-911f-a558d2302f67 req-6bc7a3b8-7829-4cba-bd1d-31ec11b0c0b9 service nova] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Refreshing network info cache for port e2f09a77-86d2-4a10-a6fa-8bd359b477ba {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:06:15.949136 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Took 3.22 seconds to destroy the instance on the hypervisor.
May 28 10:06:15.949962 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:06:15.950257 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 6895009a-024f-4919-9d25-a52905eac818] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:06:15.950359 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 6895009a-024f-4919-9d25-a52905eac818] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:06:15.950686 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:16.039948 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:16.062458 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Acquiring lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:16.062853 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:16.063064 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Acquiring lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:16.063274 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:16.063448 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:16.066988 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Terminating instance
May 28 10:06:16.091543 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a9db04f-e62a-472a-bfbd-1b68cd4cf6bb] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:06:16.266710 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f7f864a2-62f6-456e-b923-9ce7fb35cead tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "065c91b8-09c2-4ec8-95e8-606247a3c350" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.512s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:16.360462 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "refresh_cache-86c73e57-3c63-4ccf-bff1-9529b5a1c837" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:06:16.424866 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-d52f557a-93c3-4867-911f-a558d2302f67 req-6bc7a3b8-7829-4cba-bd1d-31ec11b0c0b9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:16.510692 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-d52f557a-93c3-4867-911f-a558d2302f67 req-6bc7a3b8-7829-4cba-bd1d-31ec11b0c0b9 service nova] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:06:16.571204 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:06:16.605725 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:16.638709 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:16.639868 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:16.669758 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:16.716644 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-d52f557a-93c3-4867-911f-a558d2302f67 req-6bc7a3b8-7829-4cba-bd1d-31ec11b0c0b9 service nova] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:06:16.808920 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 6895009a-024f-4919-9d25-a52905eac818] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:06:16.940487 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.998641271999986 future=<Future at 0x73c1f473c530 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:16.944283 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Instance destroyed successfully.
May 28 10:06:16.945483 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lazy-loading 'resources' on Instance uuid cc75b5c9-a7ad-4a7c-aff0-336c8e64b120 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:06:17.083667 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e66068a3-ede8-42a3-a27d-584ae3df83e2 req-2c476276-1986-4a58-bf3e-6be5f0dec52e service nova] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Received event network-changed-54117267-f360-4419-98f0-5dde7b893041 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:17.084332 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e66068a3-ede8-42a3-a27d-584ae3df83e2 req-2c476276-1986-4a58-bf3e-6be5f0dec52e service nova] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Refreshing instance network info cache due to event network-changed-54117267-f360-4419-98f0-5dde7b893041. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:06:17.084405 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e66068a3-ede8-42a3-a27d-584ae3df83e2 req-2c476276-1986-4a58-bf3e-6be5f0dec52e service nova] Acquiring lock "refresh_cache-cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:06:17.084549 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e66068a3-ede8-42a3-a27d-584ae3df83e2 req-2c476276-1986-4a58-bf3e-6be5f0dec52e service nova] Acquired lock "refresh_cache-cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:06:17.084549 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-e66068a3-ede8-42a3-a27d-584ae3df83e2 req-2c476276-1986-4a58-bf3e-6be5f0dec52e service nova] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Refreshing network info cache for port 54117267-f360-4419-98f0-5dde7b893041 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:06:17.218645 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d52f557a-93c3-4867-911f-a558d2302f67 req-6bc7a3b8-7829-4cba-bd1d-31ec11b0c0b9 service nova] Releasing lock "refresh_cache-86c73e57-3c63-4ccf-bff1-9529b5a1c837" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:06:17.221420 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquired lock "refresh_cache-86c73e57-3c63-4ccf-bff1-9529b5a1c837" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:06:17.221590 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:06:17.311137 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 6895009a-024f-4919-9d25-a52905eac818] Took 1.36 seconds to deallocate network for instance.
May 28 10:06:17.450405 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:04:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-25394265',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testinstanceswithcindervolumes-server-25394265',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/73rGjZoiXNNhQujongkHGynD0AirXLGQk/g8+npo0erwiqqEXQWMY30ctPT/ujHO/Nv9k+SVqd8Z0uXR2+GF28qopPnvQ7igPrN7hSt3mksJiO8rU2cIm58O/wCgL2w==',key_name='tempest-TestInstancesWithCinderVolumes-1387098066',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:04:50Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e97358e7c52d42788014ffe493108674',ramdisk_id='',reservation_id='r-bttiieol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_signature_verified='False',owner_project_name='tempest-TestInstancesWithCinderVolumes-1983686635',owner_user_name='tempest-TestInstancesWithCinderVolumes-1983686635-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:04:50Z,user_data=None,user_id='42a648dd5e4b46a6aa0b2f8e7c8abcc0',uuid=cc75b5c9-a7ad-4a7c-aff0-336c8e64b120,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54117267-f360-4419-98f0-5dde7b893041", "address": "fa:16:3e:9c:76:06", "network": {"id": "8b62826e-c5d4-44f9-91d0-3eeb2191966f", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-311879232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e97358e7c52d42788014ffe493108674", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap54117267-f3", "ovs_interfaceid": "54117267-f360-4419-98f0-5dde7b893041", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:06:17.450603 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Converting VIF {"id": "54117267-f360-4419-98f0-5dde7b893041", "address": "fa:16:3e:9c:76:06", "network": {"id": "8b62826e-c5d4-44f9-91d0-3eeb2191966f", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-311879232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e97358e7c52d42788014ffe493108674", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap54117267-f3", "ovs_interfaceid": "54117267-f360-4419-98f0-5dde7b893041", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:06:17.451274 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:76:06,bridge_name='br-int',has_traffic_filtering=True,id=54117267-f360-4419-98f0-5dde7b893041,network=Network(8b62826e-c5d4-44f9-91d0-3eeb2191966f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54117267-f3') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:06:17.451588 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:76:06,bridge_name='br-int',has_traffic_filtering=True,id=54117267-f360-4419-98f0-5dde7b893041,network=Network(8b62826e-c5d4-44f9-91d0-3eeb2191966f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54117267-f3') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:06:17.452743 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:17.452941 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap54117267-f3, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:06:17.467374 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:17.468379 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:06:17.469525 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:17.471559 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:17.471825 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f7bdb395-a4e2-4242-a29d-17fb1d3272be) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:06:17.472737 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:17.473729 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:17.476219 np0000001613 nova-compute[98321]: INFO os_vif [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:76:06,bridge_name='br-int',has_traffic_filtering=True,id=54117267-f360-4419-98f0-5dde7b893041,network=Network(8b62826e-c5d4-44f9-91d0-3eeb2191966f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54117267-f3')
May 28 10:06:17.478041 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:06:17.478422 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e', 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bfa5634a-0742-4951-bf49-a141f1f9134e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:06:17.478569 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:06:17.478977 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:06:17.479414 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e', 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bfa5634a-0742-4951-bf49-a141f1f9134e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:06:17.479487 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:06:17.507373 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:06:17.507373 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:06:17.507373 np0000001613 nova-compute[98321]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:17.507373 np0000001613 nova-compute[98321]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:17.507373 np0000001613 nova-compute[98321]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1c38fe04-321d-4a63-b1ae-e2e9b88ce821 (non-flash)
May 28 10:06:17.507373 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:06:17.507603 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsi session list stdout=tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:06:17.507603 np0000001613 nova-compute[98321]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e (non-flash)
May 28 10:06:17.507603 np0000001613 nova-compute[98321]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:17.507603 np0000001613 nova-compute[98321]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:17.507603 np0000001613 nova-compute[98321]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1c38fe04-321d-4a63-b1ae-e2e9b88ce821 (non-flash)
May 28 10:06:17.507603 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:06:17.507603 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e', '79'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e', '80'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4', '93'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4', '94'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1c38fe04-321d-4a63-b1ae-e2e9b88ce821', '97')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:06:17.507832 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e', '79')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:06:17.508655 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e', '80')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:06:17.509395 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1f4750cc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e'): ({'sde'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:06:17.510049 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Removing multipathed devices sdd, sde {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:06:17.510049 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Flush multipath device 330000000f3a590ef {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:06:17.569838 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:06:17.588895 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-e66068a3-ede8-42a3-a27d-584ae3df83e2 req-2c476276-1986-4a58-bf3e-6be5f0dec52e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:17.621956 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:06:17.669204 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:06:17.669204 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:06:17.670107 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:06:17.682540 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:06:17.682805 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:06:17.696323 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:17.722614 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 79, target: iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e, portal: 192.168.40.100,3260]
May 28 10:06:17.722614 np0000001613 nova-compute[98321]: Logout of [sid: 79, target: iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e, portal: 192.168.40.100,3260] successful.
May 28 10:06:17.722614 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:17.738558 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:17.751549 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-33785c76-9b8d-4800-9127-8bea6e00ac46 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:17.752129 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:17.752377 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-33785c76-9b8d-4800-9127-8bea6e00ac46 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:17.752580 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-33785c76-9b8d-4800-9127-8bea6e00ac46 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:17.752821 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-33785c76-9b8d-4800-9127-8bea6e00ac46 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:17.752933 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-33785c76-9b8d-4800-9127-8bea6e00ac46 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:17.754938 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-33785c76-9b8d-4800-9127-8bea6e00ac46 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Terminating instance
May 28 10:06:17.784917 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 80, target: iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e, portal: 192.168.50.100,3260]
May 28 10:06:17.784917 np0000001613 nova-compute[98321]: Logout of [sid: 80, target: iqn.2023-03.storpool.com:os--volume-bfa5634a-0742-4951-bf49-a141f1f9134e, portal: 192.168.50.100,3260] successful.
May 28 10:06:17.784917 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:17.807520 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:17.808621 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:06:17.808621 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] <== disconnect_volume: return (329ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:06:17.808621 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:06:17.808986 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Deleting instance files /opt/stack/data/nova/instances/cc75b5c9-a7ad-4a7c-aff0-336c8e64b120_del
May 28 10:06:17.811396 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:06:17.813974 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Deletion of /opt/stack/data/nova/instances/cc75b5c9-a7ad-4a7c-aff0-336c8e64b120_del complete
May 28 10:06:17.885029 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Took 0.57 seconds to detach 1 volumes for instance.
May 28 10:06:17.940309 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-e66068a3-ede8-42a3-a27d-584ae3df83e2 req-2c476276-1986-4a58-bf3e-6be5f0dec52e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:18.029327 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:18.040987 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:06:18.042104 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:06:18.042475 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Creating image(s)
May 28 10:06:18.043083 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Did not create local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 10:06:18.043283 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Ensure instance console log exists: /opt/stack/data/nova/instances/86c73e57-3c63-4ccf-bff1-9529b5a1c837/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:06:18.043511 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:18.043695 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:18.043953 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:18.144600 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-e66068a3-ede8-42a3-a27d-584ae3df83e2 req-2c476276-1986-4a58-bf3e-6be5f0dec52e service nova] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Updated VIF entry in instance network info cache for port 54117267-f360-4419-98f0-5dde7b893041. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:06:18.144918 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-e66068a3-ede8-42a3-a27d-584ae3df83e2 req-2c476276-1986-4a58-bf3e-6be5f0dec52e service nova] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Updating instance_info_cache with network_info: [{"id": "54117267-f360-4419-98f0-5dde7b893041", "address": "fa:16:3e:9c:76:06", "network": {"id": "8b62826e-c5d4-44f9-91d0-3eeb2191966f", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-311879232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e97358e7c52d42788014ffe493108674", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap54117267-f3", "ovs_interfaceid": "54117267-f360-4419-98f0-5dde7b893041", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:06:18.237634 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Updating instance_info_cache with network_info: [{"id": "e2f09a77-86d2-4a10-a6fa-8bd359b477ba", "address": "fa:16:3e:c0:92:f2", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f09a77-86", "ovs_interfaceid": "e2f09a77-86d2-4a10-a6fa-8bd359b477ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:06:18.260660 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-33785c76-9b8d-4800-9127-8bea6e00ac46 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:06:18.281463 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:18.283973 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:18.307765 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:18.313570 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:18.326109 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Took 1.75 seconds to destroy the instance on the hypervisor.
May 28 10:06:18.326664 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:06:18.327189 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:06:18.327379 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:06:18.327626 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:18.340714 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:18.342560 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:18.393313 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:18.394124 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:18.438110 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:18.479553 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-84553a59-ad21-4d33-adf4-72ba893e373e req-5ee80b34-807c-480c-b7bb-3b8b01b4cb09 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Received event network-vif-unplugged-dc1640f1-0633-403e-8f70-6a6d90053cfc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:18.480860 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-84553a59-ad21-4d33-adf4-72ba893e373e req-5ee80b34-807c-480c-b7bb-3b8b01b4cb09 service nova] Acquiring lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:18.480860 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-84553a59-ad21-4d33-adf4-72ba893e373e req-5ee80b34-807c-480c-b7bb-3b8b01b4cb09 service nova] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:18.480860 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-84553a59-ad21-4d33-adf4-72ba893e373e req-5ee80b34-807c-480c-b7bb-3b8b01b4cb09 service nova] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:18.480860 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-84553a59-ad21-4d33-adf4-72ba893e373e req-5ee80b34-807c-480c-b7bb-3b8b01b4cb09 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] No waiting events found dispatching network-vif-unplugged-dc1640f1-0633-403e-8f70-6a6d90053cfc {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:06:18.480860 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-84553a59-ad21-4d33-adf4-72ba893e373e req-5ee80b34-807c-480c-b7bb-3b8b01b4cb09 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Received event network-vif-unplugged-dc1640f1-0633-403e-8f70-6a6d90053cfc for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:06:18.619300 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.99962570400021 future=<Future at 0x73c1f418db20 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:18.621904 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Instance destroyed successfully.
May 28 10:06:18.624596 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-33785c76-9b8d-4800-9127-8bea6e00ac46 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lazy-loading 'resources' on Instance uuid 2641ee65-c9c2-401d-b511-6ecc1247a3ad {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:06:18.666126 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e66068a3-ede8-42a3-a27d-584ae3df83e2 req-2c476276-1986-4a58-bf3e-6be5f0dec52e service nova] Releasing lock "refresh_cache-cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:06:18.666126 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e66068a3-ede8-42a3-a27d-584ae3df83e2 req-2c476276-1986-4a58-bf3e-6be5f0dec52e service nova] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Received event network-changed-54117267-f360-4419-98f0-5dde7b893041 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:18.666126 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e66068a3-ede8-42a3-a27d-584ae3df83e2 req-2c476276-1986-4a58-bf3e-6be5f0dec52e service nova] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Refreshing instance network info cache due to event network-changed-54117267-f360-4419-98f0-5dde7b893041. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:06:18.666557 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e66068a3-ede8-42a3-a27d-584ae3df83e2 req-2c476276-1986-4a58-bf3e-6be5f0dec52e service nova] Acquiring lock "refresh_cache-cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:06:18.666557 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e66068a3-ede8-42a3-a27d-584ae3df83e2 req-2c476276-1986-4a58-bf3e-6be5f0dec52e service nova] Acquired lock "refresh_cache-cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:06:18.666557 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-e66068a3-ede8-42a3-a27d-584ae3df83e2 req-2c476276-1986-4a58-bf3e-6be5f0dec52e service nova] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Refreshing network info cache for port 54117267-f360-4419-98f0-5dde7b893041 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:06:18.741000 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Releasing lock "refresh_cache-86c73e57-3c63-4ccf-bff1-9529b5a1c837" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:06:18.741000 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Instance network_info: |[{"id": "e2f09a77-86d2-4a10-a6fa-8bd359b477ba", "address": "fa:16:3e:c0:92:f2", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f09a77-86", "ovs_interfaceid": "e2f09a77-86d2-4a10-a6fa-8bd359b477ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:06:18.742427 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Start _get_guest_xml network_info=[{"id": "e2f09a77-86d2-4a10-a6fa-8bd359b477ba", "address": "fa:16:3e:c0:92:f2", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f09a77-86", "ovs_interfaceid": "e2f09a77-86d2-4a10-a6fa-8bd359b477ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4', 'iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '49c2a3b7-24f1-43b2-9576-96031ee600b4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '86c73e57-3c63-4ccf-bff1-9529b5a1c837', 'attached_at': '', 'detached_at': '', 'volume_id': '49c2a3b7-24f1-43b2-9576-96031ee600b4', 'serial': '49c2a3b7-24f1-43b2-9576-96031ee600b4'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '391b3e46-d7e6-4f23-a3a2-02eb5ecdca6d', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:06:18.756667 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:06:18.758404 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-109175609', uuid='86c73e57-3c63-4ccf-bff1-9529b5a1c837'), owner=OwnerMeta(userid='ec58233d3b2848bbb2e0b00650398cd1', username='tempest-TestVolumeBootPattern-327944304-project-member', projectid='23e9651268114327a9cc6c6c59bef01e', projectname='tempest-TestVolumeBootPattern-327944304'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e2f09a77-86d2-4a10-a6fa-8bd359b477ba", "address": "fa:16:3e:c0:92:f2", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f09a77-86", "ovs_interfaceid": "e2f09a77-86d2-4a10-a6fa-8bd359b477ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962778.757919) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:06:18.760795 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:06:18.761271 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:06:18.762531 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:06:18.762762 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:06:18.765788 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:06:18.766227 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:06:18.766482 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:06:18.766577 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:06:18.766740 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:06:18.766883 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:06:18.767011 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:06:18.770349 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:06:18.772429 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:06:18.775045 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:06:18.775279 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:06:18.775483 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:06:18.795838 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:06:18.796515 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4', 'iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '49c2a3b7-24f1-43b2-9576-96031ee600b4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:06:18.796638 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:06:18.797230 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:06:18.797583 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4', 'iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '49c2a3b7-24f1-43b2-9576-96031ee600b4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:06:18.817506 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:06:18.818836 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:06:18.819071 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:06:18.820238 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:06:18.820616 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:06:18.821259 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:06:18.845240 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:06:18.845240 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:18.858076 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:06:18.858076 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:18.874026 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4] added
May 28 10:06:18.874026 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:06:18.874026 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:06:18.874026 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:06:18.874026 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:06:18.874026 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:06:18.874026 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:18.874292 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:06:18.874574 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.054(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:06:18.874728 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:06:18.876594 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4] added
May 28 10:06:18.876594 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:06:18.876594 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:06:18.876594 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:06:18.876594 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:06:18.876594 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:06:18.876594 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:18.876724 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:06:18.876932 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0568(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:06:18.877091 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:06:18.885446 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:06:18.886057 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:06:19.138219 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-33785c76-9b8d-4800-9127-8bea6e00ac46 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:03:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1119204149',display_name='tempest-AttachVolumeTestJSON-server-1119204149',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumetestjson-server-1119204149',id=34,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqD3i0NyKUYk701QA/12tGT7VZdARZzjNaHq8E3bqiWoRx7uJQPxa/ABqLzgddi+LvAs2Iatbj3S16oUNtlAmNjXKSqbg4xg/bifRd6D1DjOpjgoBB+xCgTJwlOZatWFw==',key_name='tempest-keypair-1805479953',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:03:35Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f2d040c323b4b948803334de7c8ec44',ramdisk_id='',reservation_id='r-92jv1vdq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1743003640',owner_user_name='tempest-AttachVolumeTestJSON-1743003640-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:05:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c88efa7ed26463d928a0e4228dca6cf',uuid=2641ee65-c9c2-401d-b511-6ecc1247a3ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "address": "fa:16:3e:08:31:07", "network": {"id": "cfc0fcd2-826d-4851-bc3e-3f0433d6fbce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1771427851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f2d040c323b4b948803334de7c8ec44", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc1640f1-06", "ovs_interfaceid": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:06:19.138219 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-33785c76-9b8d-4800-9127-8bea6e00ac46 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Converting VIF {"id": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "address": "fa:16:3e:08:31:07", "network": {"id": "cfc0fcd2-826d-4851-bc3e-3f0433d6fbce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1771427851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f2d040c323b4b948803334de7c8ec44", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc1640f1-06", "ovs_interfaceid": "dc1640f1-0633-403e-8f70-6a6d90053cfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:06:19.138219 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-33785c76-9b8d-4800-9127-8bea6e00ac46 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:31:07,bridge_name='br-int',has_traffic_filtering=True,id=dc1640f1-0633-403e-8f70-6a6d90053cfc,network=Network(cfc0fcd2-826d-4851-bc3e-3f0433d6fbce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc1640f1-06') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:06:19.138219 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-33785c76-9b8d-4800-9127-8bea6e00ac46 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:31:07,bridge_name='br-int',has_traffic_filtering=True,id=dc1640f1-0633-403e-8f70-6a6d90053cfc,network=Network(cfc0fcd2-826d-4851-bc3e-3f0433d6fbce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc1640f1-06') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:06:19.138219 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:19.138219 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc1640f1-06, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:06:19.138219 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:06:19.138219 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:19.143433 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:19.143675 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c4e420f0-ecd1-434f-a69b-212f1efb6a41) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:06:19.145611 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:19.145758 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:06:19.146717 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:19.153904 np0000001613 nova-compute[98321]: INFO os_vif [None req-33785c76-9b8d-4800-9127-8bea6e00ac46 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:31:07,bridge_name='br-int',has_traffic_filtering=True,id=dc1640f1-0633-403e-8f70-6a6d90053cfc,network=Network(cfc0fcd2-826d-4851-bc3e-3f0433d6fbce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc1640f1-06')
May 28 10:06:19.154366 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-33785c76-9b8d-4800-9127-8bea6e00ac46 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Deleting instance files /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad_del
May 28 10:06:19.155392 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-33785c76-9b8d-4800-9127-8bea6e00ac46 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Deletion of /opt/stack/data/nova/instances/2641ee65-c9c2-401d-b511-6ecc1247a3ad_del complete
May 28 10:06:19.171146 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-1d2055b4-6536-4961-941b-677329b81dc6 req-8c70ee07-0b4c-45f8-a52a-c4e1400fd540 service nova] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Received event network-vif-deleted-54117267-f360-4419-98f0-5dde7b893041 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:19.171146 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-1d2055b4-6536-4961-941b-677329b81dc6 req-8c70ee07-0b4c-45f8-a52a-c4e1400fd540 service nova] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Neutron deleted interface 54117267-f360-4419-98f0-5dde7b893041; detaching it from the instance and deleting it from the info cache
May 28 10:06:19.172497 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-e66068a3-ede8-42a3-a27d-584ae3df83e2 req-2c476276-1986-4a58-bf3e-6be5f0dec52e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:19.175916 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-1d2055b4-6536-4961-941b-677329b81dc6 req-8c70ee07-0b4c-45f8-a52a-c4e1400fd540 service nova] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Detach interface failed, port_id=54117267-f360-4419-98f0-5dde7b893041, reason: Instance cc75b5c9-a7ad-4a7c-aff0-336c8e64b120 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:06:19.199609 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:06:19.241679 np0000001613 nova-compute[98321]: INFO nova.network.neutron [req-e66068a3-ede8-42a3-a27d-584ae3df83e2 req-2c476276-1986-4a58-bf3e-6be5f0dec52e service nova] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Port 54117267-f360-4419-98f0-5dde7b893041 from network info_cache is no longer associated with instance in Neutron. Keeping it in network info_cache until detach or instance delete cleanup can unplug it.
May 28 10:06:19.242063 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-e66068a3-ede8-42a3-a27d-584ae3df83e2 req-2c476276-1986-4a58-bf3e-6be5f0dec52e service nova] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Updating instance_info_cache with network_info: [{"id": "54117267-f360-4419-98f0-5dde7b893041", "address": "fa:16:3e:9c:76:06", "network": {"id": "8b62826e-c5d4-44f9-91d0-3eeb2191966f", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-311879232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e97358e7c52d42788014ffe493108674", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap54117267-f3", "ovs_interfaceid": "54117267-f360-4419-98f0-5dde7b893041", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:06:19.389477 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:06:19.614552 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:19.674825 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-33785c76-9b8d-4800-9127-8bea6e00ac46 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Took 1.41 seconds to destroy the instance on the hypervisor.
May 28 10:06:19.677381 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-33785c76-9b8d-4800-9127-8bea6e00ac46 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:06:19.677998 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:06:19.678243 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:06:19.678497 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:19.703087 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Took 1.38 seconds to deallocate network for instance.
May 28 10:06:19.747907 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e66068a3-ede8-42a3-a27d-584ae3df83e2 req-2c476276-1986-4a58-bf3e-6be5f0dec52e service nova] Releasing lock "refresh_cache-cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:06:19.747907 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e66068a3-ede8-42a3-a27d-584ae3df83e2 req-2c476276-1986-4a58-bf3e-6be5f0dec52e service nova] [instance: 6895009a-024f-4919-9d25-a52905eac818] Received event network-vif-deleted-8ec1ac70-71ab-4f36-93a8-fd51f9c08833 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:19.748411 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e66068a3-ede8-42a3-a27d-584ae3df83e2 req-2c476276-1986-4a58-bf3e-6be5f0dec52e service nova] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Received event network-vif-unplugged-54117267-f360-4419-98f0-5dde7b893041 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:19.748411 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e66068a3-ede8-42a3-a27d-584ae3df83e2 req-2c476276-1986-4a58-bf3e-6be5f0dec52e service nova] Acquiring lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:19.748411 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e66068a3-ede8-42a3-a27d-584ae3df83e2 req-2c476276-1986-4a58-bf3e-6be5f0dec52e service nova] Lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:19.748564 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e66068a3-ede8-42a3-a27d-584ae3df83e2 req-2c476276-1986-4a58-bf3e-6be5f0dec52e service nova] Lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:19.748616 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e66068a3-ede8-42a3-a27d-584ae3df83e2 req-2c476276-1986-4a58-bf3e-6be5f0dec52e service nova] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] No waiting events found dispatching network-vif-unplugged-54117267-f360-4419-98f0-5dde7b893041 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:06:19.748813 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e66068a3-ede8-42a3-a27d-584ae3df83e2 req-2c476276-1986-4a58-bf3e-6be5f0dec52e service nova] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Received event network-vif-unplugged-54117267-f360-4419-98f0-5dde7b893041 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:06:19.749043 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e66068a3-ede8-42a3-a27d-584ae3df83e2 req-2c476276-1986-4a58-bf3e-6be5f0dec52e service nova] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Received event network-vif-unplugged-54117267-f360-4419-98f0-5dde7b893041 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:19.749191 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e66068a3-ede8-42a3-a27d-584ae3df83e2 req-2c476276-1986-4a58-bf3e-6be5f0dec52e service nova] Acquiring lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:19.749355 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e66068a3-ede8-42a3-a27d-584ae3df83e2 req-2c476276-1986-4a58-bf3e-6be5f0dec52e service nova] Lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:19.749464 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e66068a3-ede8-42a3-a27d-584ae3df83e2 req-2c476276-1986-4a58-bf3e-6be5f0dec52e service nova] Lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:19.749576 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e66068a3-ede8-42a3-a27d-584ae3df83e2 req-2c476276-1986-4a58-bf3e-6be5f0dec52e service nova] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] No waiting events found dispatching network-vif-unplugged-54117267-f360-4419-98f0-5dde7b893041 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:06:19.749703 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e66068a3-ede8-42a3-a27d-584ae3df83e2 req-2c476276-1986-4a58-bf3e-6be5f0dec52e service nova] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Received event network-vif-unplugged-54117267-f360-4419-98f0-5dde7b893041 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:06:19.753742 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:19.875245 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:06:19.879143 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:06:19.892658 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:06:19.892658 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:06:19.894561 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:06:19.894561 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:19.903212 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.510s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:19.910258 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:19.916630 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:19.928266 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:19.928266 np0000001613 nova-compute[98321]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:19.928266 np0000001613 nova-compute[98321]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1c38fe04-321d-4a63-b1ae-e2e9b88ce821 (non-flash)
May 28 10:06:19.928266 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:06:19.928956 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:19.928956 np0000001613 nova-compute[98321]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:19.928956 np0000001613 nova-compute[98321]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1c38fe04-321d-4a63-b1ae-e2e9b88ce821 (non-flash)
May 28 10:06:19.928956 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:06:19.938456 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:19.938456 np0000001613 nova-compute[98321]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:19.938456 np0000001613 nova-compute[98321]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1c38fe04-321d-4a63-b1ae-e2e9b88ce821 (non-flash)
May 28 10:06:19.938456 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:06:19.938944 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:19.938944 np0000001613 nova-compute[98321]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:19.938944 np0000001613 nova-compute[98321]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1c38fe04-321d-4a63-b1ae-e2e9b88ce821 (non-flash)
May 28 10:06:19.938944 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:06:19.976223 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4, portal: 192.168.50.100,3260]
May 28 10:06:19.976223 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4, portal: 192.168.50.100,3260] successful.
May 28 10:06:19.976223 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:19.985619 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4, portal: 192.168.40.100,3260]
May 28 10:06:19.985619 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4, portal: 192.168.40.100,3260] successful.
May 28 10:06:19.985619 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:19.993287 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:20.001408 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:20.014444 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:20.014444 np0000001613 nova-compute[98321]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:20.014444 np0000001613 nova-compute[98321]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1c38fe04-321d-4a63-b1ae-e2e9b88ce821 (non-flash)
May 28 10:06:20.014444 np0000001613 nova-compute[98321]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4 (non-flash)
May 28 10:06:20.014444 np0000001613 nova-compute[98321]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4 (non-flash)
May 28 10:06:20.014444 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:06:20.014707 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:20.014707 np0000001613 nova-compute[98321]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:20.014707 np0000001613 nova-compute[98321]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1c38fe04-321d-4a63-b1ae-e2e9b88ce821 (non-flash)
May 28 10:06:20.014707 np0000001613 nova-compute[98321]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4 (non-flash)
May 28 10:06:20.014707 np0000001613 nova-compute[98321]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4 (non-flash)
May 28 10:06:20.014707 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:06:20.015282 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.196s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:06:20.015282 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:06:20.016255 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] HCTL ('8', '-', '-', 0) found on session 98 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:06:20.017077 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:06:20.017404 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Deleted allocations for instance 6895009a-024f-4919-9d25-a52905eac818
May 28 10:06:20.020683 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:20.020683 np0000001613 nova-compute[98321]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:20.020683 np0000001613 nova-compute[98321]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1c38fe04-321d-4a63-b1ae-e2e9b88ce821 (non-flash)
May 28 10:06:20.020683 np0000001613 nova-compute[98321]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4 (non-flash)
May 28 10:06:20.020683 np0000001613 nova-compute[98321]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4 (non-flash)
May 28 10:06:20.020683 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:06:20.020901 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:20.020901 np0000001613 nova-compute[98321]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:20.020901 np0000001613 nova-compute[98321]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1c38fe04-321d-4a63-b1ae-e2e9b88ce821 (non-flash)
May 28 10:06:20.020901 np0000001613 nova-compute[98321]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4 (non-flash)
May 28 10:06:20.020901 np0000001613 nova-compute[98321]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4 (non-flash)
May 28 10:06:20.020901 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:06:20.021235 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.202s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:06:20.021673 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:06:20.022233 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] HCTL ('9', '-', '-', 0) found on session 99 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:06:20.022233 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:06:20.038968 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching for a device in session 98 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:06:20.038968 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '49c2a3b7-24f1-43b2-9576-96031ee600b4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:06:20.054550 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching for a device in session 99 and hctl ['9', '*', '*', 0] yield: None {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:06:20.282672 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Took 0.58 seconds to detach 1 volumes for instance.
May 28 10:06:20.571118 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3369b4b3-4e9c-4b4d-a211-49f8c3a4f809 req-38970a17-3737-499f-9a1c-6fe484d92176 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Received event network-vif-unplugged-dc1640f1-0633-403e-8f70-6a6d90053cfc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:20.571311 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3369b4b3-4e9c-4b4d-a211-49f8c3a4f809 req-38970a17-3737-499f-9a1c-6fe484d92176 service nova] Acquiring lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:20.571512 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3369b4b3-4e9c-4b4d-a211-49f8c3a4f809 req-38970a17-3737-499f-9a1c-6fe484d92176 service nova] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:20.571632 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3369b4b3-4e9c-4b4d-a211-49f8c3a4f809 req-38970a17-3737-499f-9a1c-6fe484d92176 service nova] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:20.571834 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3369b4b3-4e9c-4b4d-a211-49f8c3a4f809 req-38970a17-3737-499f-9a1c-6fe484d92176 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] No waiting events found dispatching network-vif-unplugged-dc1640f1-0633-403e-8f70-6a6d90053cfc {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:06:20.575442 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3369b4b3-4e9c-4b4d-a211-49f8c3a4f809 req-38970a17-3737-499f-9a1c-6fe484d92176 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Received event network-vif-unplugged-dc1640f1-0633-403e-8f70-6a6d90053cfc for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:06:20.650752 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0004021100003228639 future=<Future at 0x73c1f41ca360 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:20.651442 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Emitting event <LifecycleEvent: 1779962765.6502397, b50eced2-71bf-4448-b2e1-f9657509f34c => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:06:20.652068 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:20.652316 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] VM Stopped (Lifecycle Event)
May 28 10:06:20.653390 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=4.9746851319996495 future=<Future at 0x73c1f43aeff0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:20.653535 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=4.974534159999621 future=<Future at 0x73c1f43aeff0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:20.790707 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:20.791470 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:20.894400 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:06:21.032231 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d07a6c18-6279-402a-acfa-a9315357a2a6 tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Lock "6895009a-024f-4919-9d25-a52905eac818" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.814s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:21.053176 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching for a device in session 99 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:06:21.053337 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '49c2a3b7-24f1-43b2-9576-96031ee600b4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:06:21.133514 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:06:21.133756 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:06:21.154898 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: b50eced2-71bf-4448-b2e1-f9657509f34c] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:06:21.253843 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-77cd7e07-7e9e-4a82-bc4c-b5d09a00b533 req-1b379791-02db-4088-9fe0-db6170161589 service nova] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Received event network-vif-deleted-dc1640f1-0633-403e-8f70-6a6d90053cfc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:21.397124 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Took 1.72 seconds to deallocate network for instance.
May 28 10:06:21.548149 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "94f83a1a-f61c-49bd-ac96-eefd2e3de22c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:21.550364 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "94f83a1a-f61c-49bd-ac96-eefd2e3de22c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:21.642184 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:06:21.836525 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Found WWN 3300000008945c9ca for multipath device dm-0 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:06:21.836896 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:06:21.837886 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] <== connect_volume: return (3041ms) {'type': 'block', 'scsi_wwn': '3300000008945c9ca', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '3300000008945c9ca'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:06:21.838090 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008945c9ca', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '3300000008945c9ca'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:06:21.873606 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4', 'iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '49c2a3b7-24f1-43b2-9576-96031ee600b4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '86c73e57-3c63-4ccf-bff1-9529b5a1c837', 'attached_at': '', 'detached_at': '', 'volume_id': '49c2a3b7-24f1-43b2-9576-96031ee600b4', 'serial': '49c2a3b7-24f1-43b2-9576-96031ee600b4'} {{(pid=98321) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 10:06:21.874270 np0000001613 nova-compute[98321]: WARNING stevedore.named [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 10:06:21.874544 np0000001613 nova-compute[98321]: WARNING castellan.key_manager [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 10:06:21.874760 np0000001613 nova-compute[98321]: WARNING nova.keymgr.conf_key_mgr [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 10:06:21.875258 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x73c1f4069130>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4', 'iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '49c2a3b7-24f1-43b2-9576-96031ee600b4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '86c73e57-3c63-4ccf-bff1-9529b5a1c837', 'attached_at': '', 'detached_at': '', 'volume_id': '49c2a3b7-24f1-43b2-9576-96031ee600b4', 'serial': '49c2a3b7-24f1-43b2-9576-96031ee600b4'} {{(pid=98321) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 10:06:21.875408 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=98321) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 28 10:06:21.875521 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors.luks [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] opening encrypted volume /dev/dm-0 {{(pid=98321) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 28 10:06:21.904479 np0000001613 nova-compute[98321]: WARNING os_brick.encryptors.luks [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 28 10:06:21.904638 np0000001613 nova-compute[98321]: INFO os_brick.encryptors.luks [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] /dev/dm-0 is not a valid LUKS device; formatting device for first use
May 28 10:06:21.904747 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors.luks [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] formatting encrypted volume /dev/dm-0 {{(pid=98321) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 28 10:06:21.922865 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-33785c76-9b8d-4800-9127-8bea6e00ac46 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:22.051577 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:06:22.147210 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.356s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:22.148630 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-33785c76-9b8d-4800-9127-8bea6e00ac46 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.225s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:22.209878 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Deleted allocations for instance cc75b5c9-a7ad-4a7c-aff0-336c8e64b120
May 28 10:06:22.456302 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-33785c76-9b8d-4800-9127-8bea6e00ac46 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:06:22.456511 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-33785c76-9b8d-4800-9127-8bea6e00ac46 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:06:22.620942 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:22.960141 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-33785c76-9b8d-4800-9127-8bea6e00ac46 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:06:23.034907 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:23.220277 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-70541ed8-803e-4091-80aa-bf92569c84ac tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Lock "cc75b5c9-a7ad-4a7c-aff0-336c8e64b120" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.157s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:23.470560 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-33785c76-9b8d-4800-9127-8bea6e00ac46 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.321s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:23.471593 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.850s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:23.474124 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:06:23.474396 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Claim successful on node np0000001613
May 28 10:06:23.540912 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-33785c76-9b8d-4800-9127-8bea6e00ac46 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Deleted allocations for instance 2641ee65-c9c2-401d-b511-6ecc1247a3ad
May 28 10:06:24.159478 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:24.556269 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-33785c76-9b8d-4800-9127-8bea6e00ac46 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "2641ee65-c9c2-401d-b511-6ecc1247a3ad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.804s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:24.623860 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:24.632389 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:24.810225 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:06:24.810670 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:06:25.315727 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:06:25.628620 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0005233650003901857 future=<Future at 0x73c1f43aeff0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:25.629847 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Emitting event <LifecycleEvent: 1779962770.6279635, 065c91b8-09c2-4ec8-95e8-606247a3c350 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:06:25.630339 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:25.631224 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] VM Stopped (Lifecycle Event)
May 28 10:06:25.631995 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=2.4420919180001874 future=<Future at 0x73c1f423a780 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:25.632407 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=2.441880876000141 future=<Future at 0x73c1f423a780 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:25.834240 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.363s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:25.834907 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:06:26.134288 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 065c91b8-09c2-4ec8-95e8-606247a3c350] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:06:26.356409 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:06:26.356891 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:06:26.357576 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:26.357731 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:26.502748 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '961948be669c4a18a29398d53015f03b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7563a83d33d4bc1a6610ccf53c18dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:06:26.720436 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-11eb4768-5704-4b77-9407-c79fd17e1b4a tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "11a2b3e7-1061-4a51-b520-113e13221658" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:26.721114 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-11eb4768-5704-4b77-9407-c79fd17e1b4a tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "11a2b3e7-1061-4a51-b520-113e13221658" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:26.721114 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-11eb4768-5704-4b77-9407-c79fd17e1b4a tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Shelving
May 28 10:06:26.864947 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:06:27.208740 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Successfully created port: c00621f0-d21c-42ae-85e1-4aba5aaa265b {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:06:27.377159 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:06:27.757799 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:27.763324 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:27.784811 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:27.803918 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:27.842800 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:28.044053 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:28.074468 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.00035650099971462623 future=<Future at 0x73c1f423a780 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:28.074520 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:28.074585 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=3.8644645149997814 future=<Future at 0x73c1f473c530 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:28.074653 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=3.8643831439999303 future=<Future at 0x73c1f473c530 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:28.075778 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Emitting event <LifecycleEvent: 1779962773.07397, 6895009a-024f-4919-9d25-a52905eac818 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:06:28.075778 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] VM Stopped (Lifecycle Event)
May 28 10:06:28.082699 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:28.089334 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.99968091699975 future=<Future at 0x73c1f4210ec0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:28.099228 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Instance destroyed successfully.
May 28 10:06:28.106101 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-11eb4768-5704-4b77-9407-c79fd17e1b4a tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lazy-loading 'numa_topology' on Instance uuid 11a2b3e7-1061-4a51-b520-113e13221658 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:06:28.106101 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:28.208599 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Successfully updated port: c00621f0-d21c-42ae-85e1-4aba5aaa265b {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:06:28.226980 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-76844f85-81f7-455e-bcf5-3adf8af3ca1f req-c8d7bb3e-38e0-45d9-9e75-4bedd2d1813c service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Received event network-vif-unplugged-fd381175-d629-4ae4-b6a9-860af0c0aebf {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:28.229124 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-76844f85-81f7-455e-bcf5-3adf8af3ca1f req-c8d7bb3e-38e0-45d9-9e75-4bedd2d1813c service nova] Acquiring lock "11a2b3e7-1061-4a51-b520-113e13221658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:28.229734 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-76844f85-81f7-455e-bcf5-3adf8af3ca1f req-c8d7bb3e-38e0-45d9-9e75-4bedd2d1813c service nova] Lock "11a2b3e7-1061-4a51-b520-113e13221658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:28.229992 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-76844f85-81f7-455e-bcf5-3adf8af3ca1f req-c8d7bb3e-38e0-45d9-9e75-4bedd2d1813c service nova] Lock "11a2b3e7-1061-4a51-b520-113e13221658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:28.230242 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-76844f85-81f7-455e-bcf5-3adf8af3ca1f req-c8d7bb3e-38e0-45d9-9e75-4bedd2d1813c service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] No waiting events found dispatching network-vif-unplugged-fd381175-d629-4ae4-b6a9-860af0c0aebf {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:06:28.230541 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-76844f85-81f7-455e-bcf5-3adf8af3ca1f req-c8d7bb3e-38e0-45d9-9e75-4bedd2d1813c service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Received unexpected event network-vif-unplugged-fd381175-d629-4ae4-b6a9-860af0c0aebf for instance with vm_state active and task_state shelving.
May 28 10:06:28.335782 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:28.396984 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:06:28.403906 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:06:28.406178 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Creating image(s)
May 28 10:06:28.406178 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "/opt/stack/data/nova/instances/94f83a1a-f61c-49bd-ac96-eefd2e3de22c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:28.406178 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "/opt/stack/data/nova/instances/94f83a1a-f61c-49bd-ac96-eefd2e3de22c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:28.406464 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "90a9853a-2830-42b5-912d-72188187a375" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:28.406574 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "90a9853a-2830-42b5-912d-72188187a375" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:28.410784 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "/opt/stack/data/nova/instances/94f83a1a-f61c-49bd-ac96-eefd2e3de22c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:28.410784 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:06:28.411184 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:06:28.417947 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:06:28.531908 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.114s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:06:28.534077 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:28.537985 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:28.538561 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:06:28.546138 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:06:28.546742 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:06:28.570922 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:28.579139 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:28.585809 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:28.593192 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 6895009a-024f-4919-9d25-a52905eac818] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:06:28.620406 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:28.672594 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.126s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:06:28.676180 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/94f83a1a-f61c-49bd-ac96-eefd2e3de22c/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:06:28.719077 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "refresh_cache-94f83a1a-f61c-49bd-ac96-eefd2e3de22c" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:06:28.722552 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquired lock "refresh_cache-94f83a1a-f61c-49bd-ac96-eefd2e3de22c" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:06:28.722961 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:06:28.734519 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:28.759693 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/94f83a1a-f61c-49bd-ac96-eefd2e3de22c/disk 1073741824" returned: 0 in 0.086s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:06:28.760397 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:28.764198 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:06:28.784268 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:28.810671 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-11eb4768-5704-4b77-9407-c79fd17e1b4a tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Beginning cold snapshot process
May 28 10:06:28.898777 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.138s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:06:28.901901 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Checking if we can resize image /opt/stack/data/nova/instances/94f83a1a-f61c-49bd-ac96-eefd2e3de22c/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:06:28.904227 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f83a1a-f61c-49bd-ac96-eefd2e3de22c/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:06:28.929183 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:06:29.022053 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f83a1a-f61c-49bd-ac96-eefd2e3de22c/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:06:29.024145 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Cannot resize image /opt/stack/data/nova/instances/94f83a1a-f61c-49bd-ac96-eefd2e3de22c/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:06:29.027316 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:06:29.027519 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Ensure instance console log exists: /opt/stack/data/nova/instances/94f83a1a-f61c-49bd-ac96-eefd2e3de22c/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:06:29.028651 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:29.028980 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:29.029194 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:29.161025 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:29.371192 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:06:29.512628 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:29.513040 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:29.518835 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:06:29.519134 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Claim successful on node np0000001613
May 28 10:06:29.625965 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:29.633033 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:29.798541 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Updating instance_info_cache with network_info: [{"id": "c00621f0-d21c-42ae-85e1-4aba5aaa265b", "address": "fa:16:3e:c4:58:1f", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc00621f0-d2", "ovs_interfaceid": "c00621f0-d21c-42ae-85e1-4aba5aaa265b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:06:29.979796 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors.luks [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] opening encrypted volume /dev/dm-0 {{(pid=98321) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 28 10:06:30.301305 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Releasing lock "refresh_cache-94f83a1a-f61c-49bd-ac96-eefd2e3de22c" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:06:30.301612 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Instance network_info: |[{"id": "c00621f0-d21c-42ae-85e1-4aba5aaa265b", "address": "fa:16:3e:c4:58:1f", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc00621f0-d2", "ovs_interfaceid": "c00621f0-d21c-42ae-85e1-4aba5aaa265b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:06:30.303792 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Start _get_guest_xml network_info=[{"id": "c00621f0-d21c-42ae-85e1-4aba5aaa265b", "address": "fa:16:3e:c4:58:1f", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc00621f0-d2", "ovs_interfaceid": "c00621f0-d21c-42ae-85e1-4aba5aaa265b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:06:30.307332 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:06:30.308450 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-407405005', uuid='94f83a1a-f61c-49bd-ac96-eefd2e3de22c'), owner=OwnerMeta(userid='961948be669c4a18a29398d53015f03b', username='tempest-TestEncryptedCinderVolumes-297752033-project-member', projectid='c7563a83d33d4bc1a6610ccf53c18dc1', projectname='tempest-TestEncryptedCinderVolumes-297752033'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c00621f0-d21c-42ae-85e1-4aba5aaa265b", "address": "fa:16:3e:c4:58:1f", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc00621f0-d2", "ovs_interfaceid": "c00621f0-d21c-42ae-85e1-4aba5aaa265b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962790.307877) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:06:30.309365 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:06:30.309747 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:06:30.312535 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:06:30.312573 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:06:30.313706 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:06:30.314056 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:06:30.314223 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:06:30.314323 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:06:30.314457 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:06:30.314523 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:06:30.314608 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:06:30.314880 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:06:30.314880 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:06:30.314991 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:06:30.315128 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:06:30.315230 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:06:30.330565 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:06:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-407405005',display_name='tempest-TestEncryptedCinderVolumes-server-407405005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testencryptedcindervolumes-server-407405005',id=45,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCVXrBq2Y6aeSfYUUMKJV8DMtxkJTzOOVxewh+xanq9+vtQN8VDyuUFwqgJI9tX01tcYQbol/ypCw5qe//1oGbfUjUfN/C1vVKZIpeK8TYWxk25lhzTdTnxFASMYGFRxDA==',key_name='tempest-keypair-1932720706',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7563a83d33d4bc1a6610ccf53c18dc1',ramdisk_id='',reservation_id='r-lgqqf5py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-297752033',owner_user_name='tempest-TestEncryptedCinderVolumes-297752033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='961948be669c4a18a29398d53015f03b',uuid=94f83a1a-f61c-49bd-ac96-eefd2e3de22c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c00621f0-d21c-42ae-85e1-4aba5aaa265b", "address": "fa:16:3e:c4:58:1f", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc00621f0-d2", "ovs_interfaceid": "c00621f0-d21c-42ae-85e1-4aba5aaa265b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:06:30.330565 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Converting VIF {"id": "c00621f0-d21c-42ae-85e1-4aba5aaa265b", "address": "fa:16:3e:c4:58:1f", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc00621f0-d2", "ovs_interfaceid": "c00621f0-d21c-42ae-85e1-4aba5aaa265b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:06:30.331081 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:58:1f,bridge_name='br-int',has_traffic_filtering=True,id=c00621f0-d21c-42ae-85e1-4aba5aaa265b,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc00621f0-d2') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:06:30.331391 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lazy-loading 'pci_devices' on Instance uuid 94f83a1a-f61c-49bd-ac96-eefd2e3de22c {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:06:30.337098 np0000001613 nova-compute[98321]: DEBUG nova.privsep.utils [None req-11eb4768-5704-4b77-9407-c79fd17e1b4a tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98321) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 10:06:30.337098 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-11eb4768-5704-4b77-9407-c79fd17e1b4a tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658/disk /opt/stack/data/nova/instances/snapshots/tmpajy1832n/8039c305277047f882fa29be2a669cf2 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:06:30.365472 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-75630d85-1a95-4978-bf83-05f1408eecd3 req-0830f041-428b-45ab-b8db-b009f8110011 service nova] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Received event network-changed-c00621f0-d21c-42ae-85e1-4aba5aaa265b {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:30.365472 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-75630d85-1a95-4978-bf83-05f1408eecd3 req-0830f041-428b-45ab-b8db-b009f8110011 service nova] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Refreshing instance network info cache due to event network-changed-c00621f0-d21c-42ae-85e1-4aba5aaa265b. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:06:30.365472 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-75630d85-1a95-4978-bf83-05f1408eecd3 req-0830f041-428b-45ab-b8db-b009f8110011 service nova] Acquiring lock "refresh_cache-94f83a1a-f61c-49bd-ac96-eefd2e3de22c" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:06:30.365472 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-75630d85-1a95-4978-bf83-05f1408eecd3 req-0830f041-428b-45ab-b8db-b009f8110011 service nova] Acquired lock "refresh_cache-94f83a1a-f61c-49bd-ac96-eefd2e3de22c" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:06:30.365612 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-75630d85-1a95-4978-bf83-05f1408eecd3 req-0830f041-428b-45ab-b8db-b009f8110011 service nova] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Refreshing network info cache for port c00621f0-d21c-42ae-85e1-4aba5aaa265b {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:06:30.614665 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-11eb4768-5704-4b77-9407-c79fd17e1b4a tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658/disk /opt/stack/data/nova/instances/snapshots/tmpajy1832n/8039c305277047f882fa29be2a669cf2" returned: 0 in 0.277s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:06:30.615188 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-11eb4768-5704-4b77-9407-c79fd17e1b4a tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Snapshot extracted, beginning image upload
May 28 10:06:30.836611 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] End _get_guest_xml xml=<domain type="qemu">
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:   <uuid>94f83a1a-f61c-49bd-ac96-eefd2e3de22c</uuid>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:   <name>instance-0000002d</name>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-407405005</nova:name>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:06:30</nova:creationTime>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:         <nova:user uuid="961948be669c4a18a29398d53015f03b">tempest-TestEncryptedCinderVolumes-297752033-project-member</nova:user>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:         <nova:project uuid="c7563a83d33d4bc1a6610ccf53c18dc1">tempest-TestEncryptedCinderVolumes-297752033</nova:project>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:         <nova:port uuid="c00621f0-d21c-42ae-85e1-4aba5aaa265b">
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:     <system>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:       <entry name="serial">94f83a1a-f61c-49bd-ac96-eefd2e3de22c</entry>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:       <entry name="uuid">94f83a1a-f61c-49bd-ac96-eefd2e3de22c</entry>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:     </system>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:   <os>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:   </os>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:   <features>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:   </features>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:   <devices>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/94f83a1a-f61c-49bd-ac96-eefd2e3de22c/disk"/>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:     </disk>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/94f83a1a-f61c-49bd-ac96-eefd2e3de22c/disk.config"/>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:     </disk>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:c4:58:1f"/>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:       <target dev="tapc00621f0-d2"/>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:     </interface>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/94f83a1a-f61c-49bd-ac96-eefd2e3de22c/console.log" append="off"/>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:     </serial>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:     <video>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:     </video>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:     </rng>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:   </devices>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]: </domain>
May 28 10:06:30.836611 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:06:30.841189 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Preparing to wait for external event network-vif-plugged-c00621f0-d21c-42ae-85e1-4aba5aaa265b {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:06:30.841189 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "94f83a1a-f61c-49bd-ac96-eefd2e3de22c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:30.841988 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "94f83a1a-f61c-49bd-ac96-eefd2e3de22c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:30.842198 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "94f83a1a-f61c-49bd-ac96-eefd2e3de22c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:30.843009 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:06:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-407405005',display_name='tempest-TestEncryptedCinderVolumes-server-407405005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testencryptedcindervolumes-server-407405005',id=45,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCVXrBq2Y6aeSfYUUMKJV8DMtxkJTzOOVxewh+xanq9+vtQN8VDyuUFwqgJI9tX01tcYQbol/ypCw5qe//1oGbfUjUfN/C1vVKZIpeK8TYWxk25lhzTdTnxFASMYGFRxDA==',key_name='tempest-keypair-1932720706',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7563a83d33d4bc1a6610ccf53c18dc1',ramdisk_id='',reservation_id='r-lgqqf5py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-297752033',owner_user_name='tempest-TestEncryptedCinderVolumes-297752033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='961948be669c4a18a29398d53015f03b',uuid=94f83a1a-f61c-49bd-ac96-eefd2e3de22c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c00621f0-d21c-42ae-85e1-4aba5aaa265b", "address": "fa:16:3e:c4:58:1f", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc00621f0-d2", "ovs_interfaceid": "c00621f0-d21c-42ae-85e1-4aba5aaa265b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:06:30.845258 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Converting VIF {"id": "c00621f0-d21c-42ae-85e1-4aba5aaa265b", "address": "fa:16:3e:c4:58:1f", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc00621f0-d2", "ovs_interfaceid": "c00621f0-d21c-42ae-85e1-4aba5aaa265b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:06:30.845258 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:58:1f,bridge_name='br-int',has_traffic_filtering=True,id=c00621f0-d21c-42ae-85e1-4aba5aaa265b,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc00621f0-d2') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:06:30.845946 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:58:1f,bridge_name='br-int',has_traffic_filtering=True,id=c00621f0-d21c-42ae-85e1-4aba5aaa265b,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc00621f0-d2') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:06:30.846786 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:30.847244 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:06:30.848406 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:06:30.849572 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:30.849863 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '673aa9a2-a98c-56a0-a8a8-fc5dd598438c', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:06:30.851375 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:30.854374 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:06:30.858435 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:30.864570 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:30.864973 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc00621f0-d2, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:06:30.865486 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc00621f0-d2, col_values=(('qos', UUID('2465e91f-222f-49eb-8dca-d31b68c8eb43')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:06:30.865733 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc00621f0-d2, col_values=(('external_ids', {'iface-id': 'c00621f0-d21c-42ae-85e1-4aba5aaa265b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:58:1f', 'vm-uuid': '94f83a1a-f61c-49bd-ac96-eefd2e3de22c'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:06:30.867486 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:30.869952 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:06:30.870679 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-75630d85-1a95-4978-bf83-05f1408eecd3 req-0830f041-428b-45ab-b8db-b009f8110011 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:30.882211 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:30.885325 np0000001613 nova-compute[98321]: INFO os_vif [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:58:1f,bridge_name='br-int',has_traffic_filtering=True,id=c00621f0-d21c-42ae-85e1-4aba5aaa265b,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc00621f0-d2')
May 28 10:06:30.893848 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:06:30.893924 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:06:31.252785 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-75630d85-1a95-4978-bf83-05f1408eecd3 req-0830f041-428b-45ab-b8db-b009f8110011 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:31.265718 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:31.401034 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:06:31.434541 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-75630d85-1a95-4978-bf83-05f1408eecd3 req-0830f041-428b-45ab-b8db-b009f8110011 service nova] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Updated VIF entry in instance network info cache for port c00621f0-d21c-42ae-85e1-4aba5aaa265b. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:06:31.435179 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-75630d85-1a95-4978-bf83-05f1408eecd3 req-0830f041-428b-45ab-b8db-b009f8110011 service nova] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Updating instance_info_cache with network_info: [{"id": "c00621f0-d21c-42ae-85e1-4aba5aaa265b", "address": "fa:16:3e:c4:58:1f", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc00621f0-d2", "ovs_interfaceid": "c00621f0-d21c-42ae-85e1-4aba5aaa265b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:06:31.916522 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.404s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:31.917290 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:06:31.938290 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-75630d85-1a95-4978-bf83-05f1408eecd3 req-0830f041-428b-45ab-b8db-b009f8110011 service nova] Releasing lock "refresh_cache-94f83a1a-f61c-49bd-ac96-eefd2e3de22c" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:06:31.938480 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-75630d85-1a95-4978-bf83-05f1408eecd3 req-0830f041-428b-45ab-b8db-b009f8110011 service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Received event network-vif-unplugged-fd381175-d629-4ae4-b6a9-860af0c0aebf {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:31.938992 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-75630d85-1a95-4978-bf83-05f1408eecd3 req-0830f041-428b-45ab-b8db-b009f8110011 service nova] Acquiring lock "11a2b3e7-1061-4a51-b520-113e13221658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:31.938992 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-75630d85-1a95-4978-bf83-05f1408eecd3 req-0830f041-428b-45ab-b8db-b009f8110011 service nova] Lock "11a2b3e7-1061-4a51-b520-113e13221658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:31.938992 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-75630d85-1a95-4978-bf83-05f1408eecd3 req-0830f041-428b-45ab-b8db-b009f8110011 service nova] Lock "11a2b3e7-1061-4a51-b520-113e13221658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:31.939154 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-75630d85-1a95-4978-bf83-05f1408eecd3 req-0830f041-428b-45ab-b8db-b009f8110011 service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] No waiting events found dispatching network-vif-unplugged-fd381175-d629-4ae4-b6a9-860af0c0aebf {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:06:31.939154 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-75630d85-1a95-4978-bf83-05f1408eecd3 req-0830f041-428b-45ab-b8db-b009f8110011 service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Received unexpected event network-vif-unplugged-fd381175-d629-4ae4-b6a9-860af0c0aebf for instance with vm_state active and task_state shelving_image_pending_upload.
May 28 10:06:31.939251 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-75630d85-1a95-4978-bf83-05f1408eecd3 req-0830f041-428b-45ab-b8db-b009f8110011 service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Received event network-vif-plugged-fd381175-d629-4ae4-b6a9-860af0c0aebf {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:31.939395 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-75630d85-1a95-4978-bf83-05f1408eecd3 req-0830f041-428b-45ab-b8db-b009f8110011 service nova] Acquiring lock "11a2b3e7-1061-4a51-b520-113e13221658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:31.939472 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-75630d85-1a95-4978-bf83-05f1408eecd3 req-0830f041-428b-45ab-b8db-b009f8110011 service nova] Lock "11a2b3e7-1061-4a51-b520-113e13221658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:31.939660 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-75630d85-1a95-4978-bf83-05f1408eecd3 req-0830f041-428b-45ab-b8db-b009f8110011 service nova] Lock "11a2b3e7-1061-4a51-b520-113e13221658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:31.939819 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-75630d85-1a95-4978-bf83-05f1408eecd3 req-0830f041-428b-45ab-b8db-b009f8110011 service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] No waiting events found dispatching network-vif-plugged-fd381175-d629-4ae4-b6a9-860af0c0aebf {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:06:31.939924 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-75630d85-1a95-4978-bf83-05f1408eecd3 req-0830f041-428b-45ab-b8db-b009f8110011 service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Received unexpected event network-vif-plugged-fd381175-d629-4ae4-b6a9-860af0c0aebf for instance with vm_state active and task_state shelving_image_pending_upload.
May 28 10:06:31.940031 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-75630d85-1a95-4978-bf83-05f1408eecd3 req-0830f041-428b-45ab-b8db-b009f8110011 service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Received event network-vif-plugged-fd381175-d629-4ae4-b6a9-860af0c0aebf {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:31.940134 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-75630d85-1a95-4978-bf83-05f1408eecd3 req-0830f041-428b-45ab-b8db-b009f8110011 service nova] Acquiring lock "11a2b3e7-1061-4a51-b520-113e13221658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:31.940294 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-75630d85-1a95-4978-bf83-05f1408eecd3 req-0830f041-428b-45ab-b8db-b009f8110011 service nova] Lock "11a2b3e7-1061-4a51-b520-113e13221658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:31.940337 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-75630d85-1a95-4978-bf83-05f1408eecd3 req-0830f041-428b-45ab-b8db-b009f8110011 service nova] Lock "11a2b3e7-1061-4a51-b520-113e13221658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:31.940459 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-75630d85-1a95-4978-bf83-05f1408eecd3 req-0830f041-428b-45ab-b8db-b009f8110011 service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] No waiting events found dispatching network-vif-plugged-fd381175-d629-4ae4-b6a9-860af0c0aebf {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:06:31.940513 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-75630d85-1a95-4978-bf83-05f1408eecd3 req-0830f041-428b-45ab-b8db-b009f8110011 service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Received unexpected event network-vif-plugged-fd381175-d629-4ae4-b6a9-860af0c0aebf for instance with vm_state active and task_state shelving_image_pending_upload.
May 28 10:06:31.940648 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-75630d85-1a95-4978-bf83-05f1408eecd3 req-0830f041-428b-45ab-b8db-b009f8110011 service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Received event network-vif-unplugged-fd381175-d629-4ae4-b6a9-860af0c0aebf {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:31.940766 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-75630d85-1a95-4978-bf83-05f1408eecd3 req-0830f041-428b-45ab-b8db-b009f8110011 service nova] Acquiring lock "11a2b3e7-1061-4a51-b520-113e13221658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:31.940900 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-75630d85-1a95-4978-bf83-05f1408eecd3 req-0830f041-428b-45ab-b8db-b009f8110011 service nova] Lock "11a2b3e7-1061-4a51-b520-113e13221658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:31.941007 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-75630d85-1a95-4978-bf83-05f1408eecd3 req-0830f041-428b-45ab-b8db-b009f8110011 service nova] Lock "11a2b3e7-1061-4a51-b520-113e13221658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:31.941114 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-75630d85-1a95-4978-bf83-05f1408eecd3 req-0830f041-428b-45ab-b8db-b009f8110011 service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] No waiting events found dispatching network-vif-unplugged-fd381175-d629-4ae4-b6a9-860af0c0aebf {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:06:31.941229 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-75630d85-1a95-4978-bf83-05f1408eecd3 req-0830f041-428b-45ab-b8db-b009f8110011 service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Received unexpected event network-vif-unplugged-fd381175-d629-4ae4-b6a9-860af0c0aebf for instance with vm_state active and task_state shelving_image_pending_upload.
May 28 10:06:31.941357 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-75630d85-1a95-4978-bf83-05f1408eecd3 req-0830f041-428b-45ab-b8db-b009f8110011 service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Received event network-vif-unplugged-fd381175-d629-4ae4-b6a9-860af0c0aebf {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:31.941458 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-75630d85-1a95-4978-bf83-05f1408eecd3 req-0830f041-428b-45ab-b8db-b009f8110011 service nova] Acquiring lock "11a2b3e7-1061-4a51-b520-113e13221658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:31.941596 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-75630d85-1a95-4978-bf83-05f1408eecd3 req-0830f041-428b-45ab-b8db-b009f8110011 service nova] Lock "11a2b3e7-1061-4a51-b520-113e13221658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:31.942138 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-75630d85-1a95-4978-bf83-05f1408eecd3 req-0830f041-428b-45ab-b8db-b009f8110011 service nova] Lock "11a2b3e7-1061-4a51-b520-113e13221658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:31.942138 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-75630d85-1a95-4978-bf83-05f1408eecd3 req-0830f041-428b-45ab-b8db-b009f8110011 service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] No waiting events found dispatching network-vif-unplugged-fd381175-d629-4ae4-b6a9-860af0c0aebf {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:06:31.942138 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-75630d85-1a95-4978-bf83-05f1408eecd3 req-0830f041-428b-45ab-b8db-b009f8110011 service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Received unexpected event network-vif-unplugged-fd381175-d629-4ae4-b6a9-860af0c0aebf for instance with vm_state active and task_state shelving_image_pending_upload.
May 28 10:06:31.942589 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.003446868000082759 future=<Future at 0x73c1f473c530 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:31.942702 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:31.942876 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=1.6760168340001655 future=<Future at 0x73c1f418db20 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:31.943030 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=1.6758792079999694 future=<Future at 0x73c1f418db20 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:31.943904 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Emitting event <LifecycleEvent: 1779962776.934366, cc75b5c9-a7ad-4a7c-aff0-336c8e64b120 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:06:31.944117 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] VM Stopped (Lifecycle Event)
May 28 10:06:32.420802 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:06:32.420920 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:06:32.421619 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] No VIF found with MAC fa:16:3e:c4:58:1f, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:06:32.424667 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Using config drive
May 28 10:06:32.425373 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:06:32.427227 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:06:32.427535 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:32.427816 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:32.446678 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: cc75b5c9-a7ad-4a7c-aff0-336c8e64b120] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:06:32.517859 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2c88efa7ed26463d928a0e4228dca6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d040c323b4b948803334de7c8ec44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:06:32.601878 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:06:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-109175609',display_name='tempest-TestVolumeBootPattern-server-109175609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpattern-server-109175609',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23e9651268114327a9cc6c6c59bef01e',ramdisk_id='',reservation_id='r-ku823eff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-327944304',owner_user_name='tempest-TestVolumeBootPattern-327944304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:06:15Z,user_data=None,user_id='ec58233d3b2848bbb2e0b00650398cd1',uuid=86c73e57-3c63-4ccf-bff1-9529b5a1c837,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2f09a77-86d2-4a10-a6fa-8bd359b477ba", "address": "fa:16:3e:c0:92:f2", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f09a77-86", "ovs_interfaceid": "e2f09a77-86d2-4a10-a6fa-8bd359b477ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:06:32.602091 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converting VIF {"id": "e2f09a77-86d2-4a10-a6fa-8bd359b477ba", "address": "fa:16:3e:c0:92:f2", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f09a77-86", "ovs_interfaceid": "e2f09a77-86d2-4a10-a6fa-8bd359b477ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:06:32.602744 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:92:f2,bridge_name='br-int',has_traffic_filtering=True,id=e2f09a77-86d2-4a10-a6fa-8bd359b477ba,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2f09a77-86') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:06:32.603480 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lazy-loading 'pci_devices' on Instance uuid 86c73e57-3c63-4ccf-bff1-9529b5a1c837 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:06:32.927397 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:06:32.938941 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:33.110367 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] End _get_guest_xml xml=<domain type="qemu">
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:   <uuid>86c73e57-3c63-4ccf-bff1-9529b5a1c837</uuid>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:   <name>instance-0000002c</name>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:       <nova:name>tempest-TestVolumeBootPattern-server-109175609</nova:name>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:06:18</nova:creationTime>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:       <nova:image uuid="">
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:         <nova:properties/>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:         <nova:user uuid="ec58233d3b2848bbb2e0b00650398cd1">tempest-TestVolumeBootPattern-327944304-project-member</nova:user>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:         <nova:project uuid="23e9651268114327a9cc6c6c59bef01e">tempest-TestVolumeBootPattern-327944304</nova:project>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:       <nova:root type="volume" uuid=""/>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:         <nova:port uuid="e2f09a77-86d2-4a10-a6fa-8bd359b477ba">
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:     <system>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:       <entry name="serial">86c73e57-3c63-4ccf-bff1-9529b5a1c837</entry>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:       <entry name="uuid">86c73e57-3c63-4ccf-bff1-9529b5a1c837</entry>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:     </system>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:   <os>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:   </os>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:   <features>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:   </features>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:   <devices>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/86c73e57-3c63-4ccf-bff1-9529b5a1c837/disk.config"/>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:     </disk>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:       <alias name="ua-49c2a3b7-24f1-43b2-9576-96031ee600b4"/>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:       <serial>49c2a3b7-24f1-43b2-9576-96031ee600b4</serial>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:     </disk>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:c0:92:f2"/>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:       <target dev="tape2f09a77-86"/>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:     </interface>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/86c73e57-3c63-4ccf-bff1-9529b5a1c837/console.log" append="off"/>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:     </serial>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:     <video>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:     </video>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:     </rng>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:   </devices>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]: </domain>
May 28 10:06:33.110367 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:06:33.112248 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Preparing to wait for external event network-vif-plugged-e2f09a77-86d2-4a10-a6fa-8bd359b477ba {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:06:33.112248 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "86c73e57-3c63-4ccf-bff1-9529b5a1c837-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:33.112248 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "86c73e57-3c63-4ccf-bff1-9529b5a1c837-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:33.112248 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "86c73e57-3c63-4ccf-bff1-9529b5a1c837-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:33.115064 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:06:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-109175609',display_name='tempest-TestVolumeBootPattern-server-109175609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpattern-server-109175609',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23e9651268114327a9cc6c6c59bef01e',ramdisk_id='',reservation_id='r-ku823eff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-327944304',owner_user_name='tempest-TestVolumeBootPattern-327944304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:06:15Z,user_data=None,user_id='ec58233d3b2848bbb2e0b00650398cd1',uuid=86c73e57-3c63-4ccf-bff1-9529b5a1c837,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2f09a77-86d2-4a10-a6fa-8bd359b477ba", "address": "fa:16:3e:c0:92:f2", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f09a77-86", "ovs_interfaceid": "e2f09a77-86d2-4a10-a6fa-8bd359b477ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:06:33.115064 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converting VIF {"id": "e2f09a77-86d2-4a10-a6fa-8bd359b477ba", "address": "fa:16:3e:c0:92:f2", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f09a77-86", "ovs_interfaceid": "e2f09a77-86d2-4a10-a6fa-8bd359b477ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:06:33.115064 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:92:f2,bridge_name='br-int',has_traffic_filtering=True,id=e2f09a77-86d2-4a10-a6fa-8bd359b477ba,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2f09a77-86') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:06:33.115064 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:92:f2,bridge_name='br-int',has_traffic_filtering=True,id=e2f09a77-86d2-4a10-a6fa-8bd359b477ba,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2f09a77-86') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:06:33.117987 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:33.118503 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:06:33.118572 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:06:33.120550 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:33.120808 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '20df989d-eb93-516c-83f7-96c52b82b5cd', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:06:33.123331 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:33.125397 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:06:33.136510 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:33.139151 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:33.139355 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2f09a77-86, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:06:33.139655 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape2f09a77-86, col_values=(('qos', UUID('e1be14b2-c886-4ccc-b9cf-17922151c679')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:06:33.139823 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape2f09a77-86, col_values=(('external_ids', {'iface-id': 'e2f09a77-86d2-4a10-a6fa-8bd359b477ba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:92:f2', 'vm-uuid': '86c73e57-3c63-4ccf-bff1-9529b5a1c837'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:06:33.145131 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:33.145445 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:06:33.160984 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:33.162092 np0000001613 nova-compute[98321]: INFO os_vif [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:92:f2,bridge_name='br-int',has_traffic_filtering=True,id=e2f09a77-86d2-4a10-a6fa-8bd359b477ba,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2f09a77-86')
May 28 10:06:33.190312 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Successfully created port: b2d3f59b-ddbc-4c8d-871c-e169b41b4241 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:06:33.200334 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Creating config drive at /opt/stack/data/nova/instances/94f83a1a-f61c-49bd-ac96-eefd2e3de22c/disk.config
May 28 10:06:33.209862 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/94f83a1a-f61c-49bd-ac96-eefd2e3de22c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkynz_m5b {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:06:33.280796 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/94f83a1a-f61c-49bd-ac96-eefd2e3de22c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkynz_m5b" returned: 0 in 0.071s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:06:33.375475 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Acquiring lock "11fd9dae-9efe-4726-abdd-995998d1df87" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:33.375717 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "11fd9dae-9efe-4726-abdd-995998d1df87" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:33.439110 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:06:33.534179 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-11eb4768-5704-4b77-9407-c79fd17e1b4a tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Snapshot image upload complete
May 28 10:06:33.534445 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-11eb4768-5704-4b77-9407-c79fd17e1b4a tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:06:33.619465 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0005341679998309701 future=<Future at 0x73c1f418db20 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:33.619977 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:33.620091 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=9.468354585999805 future=<Future at 0x73c1f4210ec0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:33.620204 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=9.468250261999856 future=<Future at 0x73c1f4210ec0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:33.620469 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Emitting event <LifecycleEvent: 1779962778.61882, 2641ee65-c9c2-401d-b511-6ecc1247a3ad => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:06:33.620658 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] VM Stopped (Lifecycle Event)
May 28 10:06:33.763791 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:33.781256 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Successfully updated port: b2d3f59b-ddbc-4c8d-871c-e169b41b4241 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:06:33.809789 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:33.849347 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d7164b10-9614-46e7-a76d-2f45de7a22ed req-adbb39a0-06be-426c-9ad9-09ab5c280daa service nova] [instance: 90a9853a-2830-42b5-912d-72188187a375] Received event network-changed-b2d3f59b-ddbc-4c8d-871c-e169b41b4241 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:33.849458 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d7164b10-9614-46e7-a76d-2f45de7a22ed req-adbb39a0-06be-426c-9ad9-09ab5c280daa service nova] [instance: 90a9853a-2830-42b5-912d-72188187a375] Refreshing instance network info cache due to event network-changed-b2d3f59b-ddbc-4c8d-871c-e169b41b4241. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:06:33.849793 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d7164b10-9614-46e7-a76d-2f45de7a22ed req-adbb39a0-06be-426c-9ad9-09ab5c280daa service nova] Acquiring lock "refresh_cache-90a9853a-2830-42b5-912d-72188187a375" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:06:33.849793 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d7164b10-9614-46e7-a76d-2f45de7a22ed req-adbb39a0-06be-426c-9ad9-09ab5c280daa service nova] Acquired lock "refresh_cache-90a9853a-2830-42b5-912d-72188187a375" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:06:33.849887 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-d7164b10-9614-46e7-a76d-2f45de7a22ed req-adbb39a0-06be-426c-9ad9-09ab5c280daa service nova] [instance: 90a9853a-2830-42b5-912d-72188187a375] Refreshing network info cache for port b2d3f59b-ddbc-4c8d-871c-e169b41b4241 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:06:33.879427 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Detaching volume 39b5bd51-62c3-47bd-b975-8b8acb9799f4
May 28 10:06:33.899462 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:33.937964 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Attempting to driver detach volume 39b5bd51-62c3-47bd-b975-8b8acb9799f4 from mountpoint /dev/vdb
May 28 10:06:33.954602 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Found disk vdb by alias ua-39b5bd51-62c3-47bd-b975-8b8acb9799f4 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:06:33.958447 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Found disk vdb by alias ua-39b5bd51-62c3-47bd-b975-8b8acb9799f4 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:06:33.958707 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Attempting to detach device vdb from instance 11fd9dae-9efe-4726-abdd-995998d1df87 from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 10:06:33.959088 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:06:33.959088 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:06:33.959088 np0000001613 nova-compute[98321]:   <alias name="ua-39b5bd51-62c3-47bd-b975-8b8acb9799f4"/>
May 28 10:06:33.959088 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-1"/>
May 28 10:06:33.959088 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:06:33.959088 np0000001613 nova-compute[98321]:   <serial>39b5bd51-62c3-47bd-b975-8b8acb9799f4</serial>
May 28 10:06:33.959088 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:06:33.959088 np0000001613 nova-compute[98321]: </disk>
May 28 10:06:33.959088 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:06:33.967656 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Successfully detached device vdb from instance 11fd9dae-9efe-4726-abdd-995998d1df87 from the persistent domain config.
May 28 10:06:33.967820 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] (1/8): Attempting to detach device vdb with device alias ua-39b5bd51-62c3-47bd-b975-8b8acb9799f4 from instance 11fd9dae-9efe-4726-abdd-995998d1df87 from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 10:06:33.968015 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:06:33.968015 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:06:33.968015 np0000001613 nova-compute[98321]:   <alias name="ua-39b5bd51-62c3-47bd-b975-8b8acb9799f4"/>
May 28 10:06:33.968015 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-1"/>
May 28 10:06:33.968015 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:06:33.968015 np0000001613 nova-compute[98321]:   <serial>39b5bd51-62c3-47bd-b975-8b8acb9799f4</serial>
May 28 10:06:33.968015 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:06:33.968015 np0000001613 nova-compute[98321]: </disk>
May 28 10:06:33.968015 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:06:34.003721 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-dad157f6-6e75-4720-82bc-eb7136d38a33 req-c5a3eef4-bc85-496c-86ee-a77442c023ac service nova] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Received event network-vif-plugged-c00621f0-d21c-42ae-85e1-4aba5aaa265b {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:34.004015 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-dad157f6-6e75-4720-82bc-eb7136d38a33 req-c5a3eef4-bc85-496c-86ee-a77442c023ac service nova] Acquiring lock "94f83a1a-f61c-49bd-ac96-eefd2e3de22c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:34.004295 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-dad157f6-6e75-4720-82bc-eb7136d38a33 req-c5a3eef4-bc85-496c-86ee-a77442c023ac service nova] Lock "94f83a1a-f61c-49bd-ac96-eefd2e3de22c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:34.004616 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-dad157f6-6e75-4720-82bc-eb7136d38a33 req-c5a3eef4-bc85-496c-86ee-a77442c023ac service nova] Lock "94f83a1a-f61c-49bd-ac96-eefd2e3de22c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:34.005384 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-dad157f6-6e75-4720-82bc-eb7136d38a33 req-c5a3eef4-bc85-496c-86ee-a77442c023ac service nova] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Processing event network-vif-plugged-c00621f0-d21c-42ae-85e1-4aba5aaa265b {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:06:34.050038 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-11eb4768-5704-4b77-9407-c79fd17e1b4a tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Shelve offloading
May 28 10:06:34.124353 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 2641ee65-c9c2-401d-b511-6ecc1247a3ad] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:06:34.187510 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:34.202045 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:34.204796 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:34.233724 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:34.245368 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:34.288430 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "refresh_cache-90a9853a-2830-42b5-912d-72188187a375" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:06:34.357009 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-d7164b10-9614-46e7-a76d-2f45de7a22ed req-adbb39a0-06be-426c-9ad9-09ab5c280daa service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:34.421726 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-d7164b10-9614-46e7-a76d-2f45de7a22ed req-adbb39a0-06be-426c-9ad9-09ab5c280daa service nova] [instance: 90a9853a-2830-42b5-912d-72188187a375] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:06:34.452038 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:06:34.456769 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:06:34.457114 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Creating image(s)
May 28 10:06:34.457925 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "/opt/stack/data/nova/instances/90a9853a-2830-42b5-912d-72188187a375/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:34.457925 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "/opt/stack/data/nova/instances/90a9853a-2830-42b5-912d-72188187a375/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:34.458339 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "/opt/stack/data/nova/instances/90a9853a-2830-42b5-912d-72188187a375/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:34.458937 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:06:34.463872 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:06:34.464981 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:06:34.534642 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779962794.5331302, 11fd9dae-9efe-4726-abdd-995998d1df87 => ua-39b5bd51-62c3-47bd-b975-8b8acb9799f4> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 10:06:34.535275 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-39b5bd51-62c3-47bd-b975-8b8acb9799f4 for instance 11fd9dae-9efe-4726-abdd-995998d1df87 {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 10:06:34.541178 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Successfully detached device vdb from instance 11fd9dae-9efe-4726-abdd-995998d1df87 from the live domain config.
May 28 10:06:34.546101 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:06:34.546971 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4', 'iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '39b5bd51-62c3-47bd-b975-8b8acb9799f4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:06:34.547352 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:06:34.547985 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:06:34.548534 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4', 'iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '39b5bd51-62c3-47bd-b975-8b8acb9799f4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:06:34.548836 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:06:34.563536 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Instance destroyed successfully.
May 28 10:06:34.564221 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-11eb4768-5704-4b77-9407-c79fd17e1b4a tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:06:34.567857 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-11eb4768-5704-4b77-9407-c79fd17e1b4a tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "refresh_cache-11a2b3e7-1061-4a51-b520-113e13221658" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:06:34.567981 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-11eb4768-5704-4b77-9407-c79fd17e1b4a tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquired lock "refresh_cache-11a2b3e7-1061-4a51-b520-113e13221658" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:06:34.568200 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-11eb4768-5704-4b77-9407-c79fd17e1b4a tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:06:34.576236 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.111s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:06:34.576836 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:34.577219 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:34.577620 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:06:34.582045 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:06:34.582279 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:06:34.602274 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:34.602274 np0000001613 nova-compute[98321]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:34.602274 np0000001613 nova-compute[98321]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4 (non-flash)
May 28 10:06:34.602274 np0000001613 nova-compute[98321]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4 (non-flash)
May 28 10:06:34.602274 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:06:34.602892 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsi session list stdout=tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:34.602892 np0000001613 nova-compute[98321]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4 (non-flash)
May 28 10:06:34.602892 np0000001613 nova-compute[98321]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4 (non-flash)
May 28 10:06:34.602892 np0000001613 nova-compute[98321]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4 (non-flash)
May 28 10:06:34.602892 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:06:34.603234 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4', '93'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4', '98'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4', '99')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:06:34.603456 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4', '94')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:06:34.605685 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4', '93')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:06:34.606448 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1f4344b80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4'): ({'sdf'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:06:34.606791 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Removing multipathed devices sdg, sdf {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:06:34.607238 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Flush multipath device 330000000f3d35ae2 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:06:34.640053 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-d7164b10-9614-46e7-a76d-2f45de7a22ed req-adbb39a0-06be-426c-9ad9-09ab5c280daa service nova] [instance: 90a9853a-2830-42b5-912d-72188187a375] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:06:34.641643 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:34.644526 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:06:34.686246 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.104s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:06:34.686638 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/90a9853a-2830-42b5-912d-72188187a375/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:06:34.704291 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:06:34.706405 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:06:34.707830 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962794.706617, 94f83a1a-f61c-49bd-ac96-eefd2e3de22c => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:06:34.708052 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] VM Started (Lifecycle Event)
May 28 10:06:34.718202 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:06:34.718925 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:06:34.719929 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:06:34.720222 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] No VIF found with MAC fa:16:3e:c0:92:f2, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:06:34.721653 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Using config drive
May 28 10:06:34.728682 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Instance spawned successfully.
May 28 10:06:34.729071 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:06:34.754476 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/90a9853a-2830-42b5-912d-72188187a375/disk 1073741824" returned: 0 in 0.068s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:06:34.754903 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.178s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:34.755194 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:06:34.774707 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:06:34.774969 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:06:34.776246 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:06:34.797850 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:06:34.797850 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:06:34.813783 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:34.849441 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 94, target: iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4, portal: 192.168.40.100,3260]
May 28 10:06:34.849441 np0000001613 nova-compute[98321]: Logout of [sid: 94, target: iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4, portal: 192.168.40.100,3260] successful.
May 28 10:06:34.849441 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:34.856905 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.101s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:06:34.857390 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Checking if we can resize image /opt/stack/data/nova/instances/90a9853a-2830-42b5-912d-72188187a375/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:06:34.857704 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a9853a-2830-42b5-912d-72188187a375/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:06:34.878514 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:34.892003 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:34.922686 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 93, target: iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4, portal: 192.168.50.100,3260]
May 28 10:06:34.922686 np0000001613 nova-compute[98321]: Logout of [sid: 93, target: iqn.2023-03.storpool.com:os--volume-39b5bd51-62c3-47bd-b975-8b8acb9799f4, portal: 192.168.50.100,3260] successful.
May 28 10:06:34.922686 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:34.938365 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:34.938871 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:06:34.939108 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] <== disconnect_volume: return (392ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:06:34.939306 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:06:34.956496 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a9853a-2830-42b5-912d-72188187a375/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:06:34.956824 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Cannot resize image /opt/stack/data/nova/instances/90a9853a-2830-42b5-912d-72188187a375/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:06:34.958029 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:06:34.958029 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Ensure instance console log exists: /opt/stack/data/nova/instances/90a9853a-2830-42b5-912d-72188187a375/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:06:34.958342 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:34.958558 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:34.958694 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:35.073295 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-11eb4768-5704-4b77-9407-c79fd17e1b4a tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:35.143957 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d7164b10-9614-46e7-a76d-2f45de7a22ed req-adbb39a0-06be-426c-9ad9-09ab5c280daa service nova] Releasing lock "refresh_cache-90a9853a-2830-42b5-912d-72188187a375" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:06:35.144446 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquired lock "refresh_cache-90a9853a-2830-42b5-912d-72188187a375" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:06:35.144726 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:06:35.213478 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:06:35.216970 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:06:35.236227 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:35.248405 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:06:35.248405 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:06:35.248830 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:06:35.249130 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:06:35.249546 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:06:35.250244 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:06:35.393531 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Creating config drive at /opt/stack/data/nova/instances/86c73e57-3c63-4ccf-bff1-9529b5a1c837/disk.config
May 28 10:06:35.397075 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/86c73e57-3c63-4ccf-bff1-9529b5a1c837/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7_j212pw {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:06:35.455177 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/86c73e57-3c63-4ccf-bff1-9529b5a1c837/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7_j212pw" returned: 0 in 0.058s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:06:35.476901 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-11eb4768-5704-4b77-9407-c79fd17e1b4a tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:35.496366 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lazy-loading 'flavor' on Instance uuid 11fd9dae-9efe-4726-abdd-995998d1df87 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:06:35.636530 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-11eb4768-5704-4b77-9407-c79fd17e1b4a tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Updating instance_info_cache with network_info: [{"id": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "address": "fa:16:3e:b5:7a:19", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd381175-d6", "ovs_interfaceid": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:06:35.720410 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:06:35.720724 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962795.7203963, 94f83a1a-f61c-49bd-ac96-eefd2e3de22c => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:06:35.720922 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] VM Paused (Lifecycle Event)
May 28 10:06:35.757821 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Took 7.36 seconds to spawn the instance on the hypervisor.
May 28 10:06:35.757821 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:06:35.760795 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:06:35.954105 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:35.999482 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:36.012309 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:36.133606 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b82728dc-7e7b-4673-ab50-f33c6f7d01ca req-6c6d8f20-04df-4572-ba0e-fcea17f666fb service nova] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Received event network-vif-plugged-c00621f0-d21c-42ae-85e1-4aba5aaa265b {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:36.133767 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b82728dc-7e7b-4673-ab50-f33c6f7d01ca req-6c6d8f20-04df-4572-ba0e-fcea17f666fb service nova] Acquiring lock "94f83a1a-f61c-49bd-ac96-eefd2e3de22c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:36.134038 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b82728dc-7e7b-4673-ab50-f33c6f7d01ca req-6c6d8f20-04df-4572-ba0e-fcea17f666fb service nova] Lock "94f83a1a-f61c-49bd-ac96-eefd2e3de22c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:36.134193 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b82728dc-7e7b-4673-ab50-f33c6f7d01ca req-6c6d8f20-04df-4572-ba0e-fcea17f666fb service nova] Lock "94f83a1a-f61c-49bd-ac96-eefd2e3de22c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:36.134330 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b82728dc-7e7b-4673-ab50-f33c6f7d01ca req-6c6d8f20-04df-4572-ba0e-fcea17f666fb service nova] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] No waiting events found dispatching network-vif-plugged-c00621f0-d21c-42ae-85e1-4aba5aaa265b {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:06:36.134458 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-b82728dc-7e7b-4673-ab50-f33c6f7d01ca req-6c6d8f20-04df-4572-ba0e-fcea17f666fb service nova] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Received unexpected event network-vif-plugged-c00621f0-d21c-42ae-85e1-4aba5aaa265b for instance with vm_state active and task_state None.
May 28 10:06:36.134995 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:36.139435 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-11eb4768-5704-4b77-9407-c79fd17e1b4a tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Releasing lock "refresh_cache-11a2b3e7-1061-4a51-b520-113e13221658" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:06:36.139782 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-11eb4768-5704-4b77-9407-c79fd17e1b4a tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:36.140024 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-11eb4768-5704-4b77-9407-c79fd17e1b4a tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:36.225016 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:06:36.235608 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962796.235264, 94f83a1a-f61c-49bd-ac96-eefd2e3de22c => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:06:36.235777 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] VM Resumed (Lifecycle Event)
May 28 10:06:36.268981 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Updating instance_info_cache with network_info: [{"id": "b2d3f59b-ddbc-4c8d-871c-e169b41b4241", "address": "fa:16:3e:59:15:c3", "network": {"id": "cfc0fcd2-826d-4851-bc3e-3f0433d6fbce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1771427851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f2d040c323b4b948803334de7c8ec44", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2d3f59b-dd", "ovs_interfaceid": "b2d3f59b-ddbc-4c8d-871c-e169b41b4241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:06:36.283667 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Took 13.73 seconds to build instance.
May 28 10:06:36.354318 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b8562930-8a8e-4888-9d37-12727dc59326 req-68dc5427-c29f-4956-ba5c-82adf04c4a95 service nova] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Received event network-vif-plugged-e2f09a77-86d2-4a10-a6fa-8bd359b477ba {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:36.354664 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b8562930-8a8e-4888-9d37-12727dc59326 req-68dc5427-c29f-4956-ba5c-82adf04c4a95 service nova] Acquiring lock "86c73e57-3c63-4ccf-bff1-9529b5a1c837-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:36.354705 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b8562930-8a8e-4888-9d37-12727dc59326 req-68dc5427-c29f-4956-ba5c-82adf04c4a95 service nova] Lock "86c73e57-3c63-4ccf-bff1-9529b5a1c837-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:36.354835 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b8562930-8a8e-4888-9d37-12727dc59326 req-68dc5427-c29f-4956-ba5c-82adf04c4a95 service nova] Lock "86c73e57-3c63-4ccf-bff1-9529b5a1c837-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:36.354952 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b8562930-8a8e-4888-9d37-12727dc59326 req-68dc5427-c29f-4956-ba5c-82adf04c4a95 service nova] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Processing event network-vif-plugged-e2f09a77-86d2-4a10-a6fa-8bd359b477ba {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:06:36.395703 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:36.402456 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:36.404933 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:36.438868 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:36.443485 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:36.526195 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a6cb2748-e104-4c0a-87f9-c25ab9855be4 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "11fd9dae-9efe-4726-abdd-995998d1df87" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.150s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:36.714429 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-247fca33-5a39-4802-ae01-2c56750461ff tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Acquiring lock "11fd9dae-9efe-4726-abdd-995998d1df87" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:36.714629 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-247fca33-5a39-4802-ae01-2c56750461ff tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "11fd9dae-9efe-4726-abdd-995998d1df87" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:36.714836 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-247fca33-5a39-4802-ae01-2c56750461ff tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Acquiring lock "11fd9dae-9efe-4726-abdd-995998d1df87-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:36.714985 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-247fca33-5a39-4802-ae01-2c56750461ff tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "11fd9dae-9efe-4726-abdd-995998d1df87-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:36.715116 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-247fca33-5a39-4802-ae01-2c56750461ff tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "11fd9dae-9efe-4726-abdd-995998d1df87-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:36.717822 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-247fca33-5a39-4802-ae01-2c56750461ff tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Terminating instance
May 28 10:06:36.739287 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:06:36.741868 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:06:36.746227 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Instance destroyed successfully.
May 28 10:06:36.746601 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-11eb4768-5704-4b77-9407-c79fd17e1b4a tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lazy-loading 'resources' on Instance uuid 11a2b3e7-1061-4a51-b520-113e13221658 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:06:36.773837 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Releasing lock "refresh_cache-90a9853a-2830-42b5-912d-72188187a375" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:06:36.773837 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Instance network_info: |[{"id": "b2d3f59b-ddbc-4c8d-871c-e169b41b4241", "address": "fa:16:3e:59:15:c3", "network": {"id": "cfc0fcd2-826d-4851-bc3e-3f0433d6fbce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1771427851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f2d040c323b4b948803334de7c8ec44", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2d3f59b-dd", "ovs_interfaceid": "b2d3f59b-ddbc-4c8d-871c-e169b41b4241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:06:36.774901 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Start _get_guest_xml network_info=[{"id": "b2d3f59b-ddbc-4c8d-871c-e169b41b4241", "address": "fa:16:3e:59:15:c3", "network": {"id": "cfc0fcd2-826d-4851-bc3e-3f0433d6fbce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1771427851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f2d040c323b4b948803334de7c8ec44", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2d3f59b-dd", "ovs_interfaceid": "b2d3f59b-ddbc-4c8d-871c-e169b41b4241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:06:36.780884 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:06:36.781985 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-960398528', uuid='90a9853a-2830-42b5-912d-72188187a375'), owner=OwnerMeta(userid='2c88efa7ed26463d928a0e4228dca6cf', username='tempest-AttachVolumeTestJSON-1743003640-project-member', projectid='6f2d040c323b4b948803334de7c8ec44', projectname='tempest-AttachVolumeTestJSON-1743003640'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b2d3f59b-ddbc-4c8d-871c-e169b41b4241", "address": "fa:16:3e:59:15:c3", "network": {"id": "cfc0fcd2-826d-4851-bc3e-3f0433d6fbce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1771427851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f2d040c323b4b948803334de7c8ec44", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2d3f59b-dd", "ovs_interfaceid": "b2d3f59b-ddbc-4c8d-871c-e169b41b4241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962796.7816312) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:06:36.785830 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-edd7dec9-f160-4bf5-aa89-7e17cc3ba302 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "94f83a1a-f61c-49bd-ac96-eefd2e3de22c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.236s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:36.787624 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:06:36.787943 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:06:36.789544 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:06:36.789792 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:06:36.790814 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:06:36.791254 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:06:36.791530 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:06:36.791660 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:06:36.791843 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:06:36.792335 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:06:36.792335 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:06:36.792335 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:06:36.792806 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:06:36.792806 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:06:36.792902 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:06:36.793018 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:06:36.808729 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:06:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-960398528',display_name='tempest-AttachVolumeTestJSON-server-960398528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumetestjson-server-960398528',id=46,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGc8jy6qlktFOlu4FSKfsI8iNg23Far8omcyRNXidV2sz+82AOt/P767HJGln5GU3WJ/VpsWOAWYg0rUbVBiC2aLaqarSBoy78+d0r2HWDkJCuYYq5u/WF9GMLYwHjHnKw==',key_name='tempest-keypair-1262128770',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f2d040c323b4b948803334de7c8ec44',ramdisk_id='',reservation_id='r-86c1v5ko',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1743003640',owner_user_name='tempest-AttachVolumeTestJSON-1743003640-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:06:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c88efa7ed26463d928a0e4228dca6cf',uuid=90a9853a-2830-42b5-912d-72188187a375,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2d3f59b-ddbc-4c8d-871c-e169b41b4241", "address": "fa:16:3e:59:15:c3", "network": {"id": "cfc0fcd2-826d-4851-bc3e-3f0433d6fbce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1771427851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f2d040c323b4b948803334de7c8ec44", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2d3f59b-dd", "ovs_interfaceid": "b2d3f59b-ddbc-4c8d-871c-e169b41b4241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:06:36.808899 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Converting VIF {"id": "b2d3f59b-ddbc-4c8d-871c-e169b41b4241", "address": "fa:16:3e:59:15:c3", "network": {"id": "cfc0fcd2-826d-4851-bc3e-3f0433d6fbce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1771427851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f2d040c323b4b948803334de7c8ec44", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2d3f59b-dd", "ovs_interfaceid": "b2d3f59b-ddbc-4c8d-871c-e169b41b4241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:06:36.809584 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:15:c3,bridge_name='br-int',has_traffic_filtering=True,id=b2d3f59b-ddbc-4c8d-871c-e169b41b4241,network=Network(cfc0fcd2-826d-4851-bc3e-3f0433d6fbce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2d3f59b-dd') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:06:36.810250 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lazy-loading 'pci_devices' on Instance uuid 90a9853a-2830-42b5-912d-72188187a375 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:06:36.861888 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:06:36.866290 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:06:36.870248 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Instance spawned successfully.
May 28 10:06:36.871018 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:06:37.003036 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:37.222609 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-247fca33-5a39-4802-ae01-2c56750461ff tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:06:37.245249 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962797.2449024, 86c73e57-3c63-4ccf-bff1-9529b5a1c837 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:06:37.245449 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] VM Started (Lifecycle Event)
May 28 10:06:37.248332 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-11eb4768-5704-4b77-9407-c79fd17e1b4a tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Object Instance<11a2b3e7-1061-4a51-b520-113e13221658> lazy-loaded attributes: numa_topology,resources {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:06:37.250072 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-11eb4768-5704-4b77-9407-c79fd17e1b4a tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1038469455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumeshelvetestjson-server-1038469455',id=42,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMY7kXjSfENddJg92HGAKjem9WrDThMi6I8TEBeHwoDzPui0P24CmO2SMbVIQkyN1o3DhCenQzSIsgKtBFuRyVtQHpeEnNk6L6E9kYszZ+Qxlovl7JB7OKSIEGTWV9SmQQ==',key_name='tempest-keypair-1521685008',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:05:45Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='edd64b0e2ce54cac860344420cf9c5b6',ramdisk_id='',reservation_id='r-oq6jrgqc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1618900663',owner_user_name='tempest-AttachVolumeShelveTestJSON-1618900663-project-member',shelved_at='2026-05-28T10:06:33.534257',shelved_host='np0000001613',shelved_image_id='3bc5584d-a882-41ca-ba19-ff52b508e44e'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:06:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd3def75f0dd411888f23a2f432896b0',uuid=11a2b3e7-1061-4a51-b520-113e13221658,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "address": "fa:16:3e:b5:7a:19", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd381175-d6", "ovs_interfaceid": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:06:37.250072 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-11eb4768-5704-4b77-9407-c79fd17e1b4a tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Converting VIF {"id": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "address": "fa:16:3e:b5:7a:19", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd381175-d6", "ovs_interfaceid": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:06:37.250072 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-11eb4768-5704-4b77-9407-c79fd17e1b4a tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:7a:19,bridge_name='br-int',has_traffic_filtering=True,id=fd381175-d629-4ae4-b6a9-860af0c0aebf,network=Network(d262816b-8751-4e64-8f19-7d59ddaabc41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd381175-d6') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:06:37.250471 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-11eb4768-5704-4b77-9407-c79fd17e1b4a tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:7a:19,bridge_name='br-int',has_traffic_filtering=True,id=fd381175-d629-4ae4-b6a9-860af0c0aebf,network=Network(d262816b-8751-4e64-8f19-7d59ddaabc41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd381175-d6') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:06:37.254648 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:37.256656 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:37.257198 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd381175-d6, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:06:37.261484 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:37.263839 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:06:37.285069 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:37.286582 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:37.289125 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:37.290136 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=083dfc37-d39d-4353-94a9-1976b63ab051) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:06:37.290638 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:37.291236 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:06:37.315213 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] End _get_guest_xml xml=<domain type="qemu">
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:   <uuid>90a9853a-2830-42b5-912d-72188187a375</uuid>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:   <name>instance-0000002e</name>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:       <nova:name>tempest-AttachVolumeTestJSON-server-960398528</nova:name>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:06:36</nova:creationTime>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:         <nova:user uuid="2c88efa7ed26463d928a0e4228dca6cf">tempest-AttachVolumeTestJSON-1743003640-project-member</nova:user>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:         <nova:project uuid="6f2d040c323b4b948803334de7c8ec44">tempest-AttachVolumeTestJSON-1743003640</nova:project>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:         <nova:port uuid="b2d3f59b-ddbc-4c8d-871c-e169b41b4241">
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:     <system>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:       <entry name="serial">90a9853a-2830-42b5-912d-72188187a375</entry>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:       <entry name="uuid">90a9853a-2830-42b5-912d-72188187a375</entry>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:     </system>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:   <os>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:   </os>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:   <features>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:   </features>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:   <devices>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/90a9853a-2830-42b5-912d-72188187a375/disk"/>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:     </disk>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/90a9853a-2830-42b5-912d-72188187a375/disk.config"/>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:     </disk>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:59:15:c3"/>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:       <target dev="tapb2d3f59b-dd"/>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:     </interface>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/90a9853a-2830-42b5-912d-72188187a375/console.log" append="off"/>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:     </serial>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:     <video>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:     </video>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:     </rng>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:   </devices>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]: </domain>
May 28 10:06:37.315213 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:06:37.315213 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Preparing to wait for external event network-vif-plugged-b2d3f59b-ddbc-4c8d-871c-e169b41b4241 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:06:37.315213 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "90a9853a-2830-42b5-912d-72188187a375-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:37.315213 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "90a9853a-2830-42b5-912d-72188187a375-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:37.315213 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "90a9853a-2830-42b5-912d-72188187a375-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:37.325243 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:06:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-960398528',display_name='tempest-AttachVolumeTestJSON-server-960398528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumetestjson-server-960398528',id=46,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGc8jy6qlktFOlu4FSKfsI8iNg23Far8omcyRNXidV2sz+82AOt/P767HJGln5GU3WJ/VpsWOAWYg0rUbVBiC2aLaqarSBoy78+d0r2HWDkJCuYYq5u/WF9GMLYwHjHnKw==',key_name='tempest-keypair-1262128770',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f2d040c323b4b948803334de7c8ec44',ramdisk_id='',reservation_id='r-86c1v5ko',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1743003640',owner_user_name='tempest-AttachVolumeTestJSON-1743003640-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:06:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c88efa7ed26463d928a0e4228dca6cf',uuid=90a9853a-2830-42b5-912d-72188187a375,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2d3f59b-ddbc-4c8d-871c-e169b41b4241", "address": "fa:16:3e:59:15:c3", "network": {"id": "cfc0fcd2-826d-4851-bc3e-3f0433d6fbce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1771427851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f2d040c323b4b948803334de7c8ec44", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2d3f59b-dd", "ovs_interfaceid": "b2d3f59b-ddbc-4c8d-871c-e169b41b4241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:06:37.325243 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Converting VIF {"id": "b2d3f59b-ddbc-4c8d-871c-e169b41b4241", "address": "fa:16:3e:59:15:c3", "network": {"id": "cfc0fcd2-826d-4851-bc3e-3f0433d6fbce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1771427851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f2d040c323b4b948803334de7c8ec44", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2d3f59b-dd", "ovs_interfaceid": "b2d3f59b-ddbc-4c8d-871c-e169b41b4241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:06:37.325243 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:15:c3,bridge_name='br-int',has_traffic_filtering=True,id=b2d3f59b-ddbc-4c8d-871c-e169b41b4241,network=Network(cfc0fcd2-826d-4851-bc3e-3f0433d6fbce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2d3f59b-dd') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:06:37.325243 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:37.325243 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:15:c3,bridge_name='br-int',has_traffic_filtering=True,id=b2d3f59b-ddbc-4c8d-871c-e169b41b4241,network=Network(cfc0fcd2-826d-4851-bc3e-3f0433d6fbce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2d3f59b-dd') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:06:37.329102 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:37.329750 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:37.329950 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:06:37.330197 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:06:37.331974 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:37.332431 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7fec27f2-5b92-596c-b932-cf9507b2148a', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:06:37.334048 np0000001613 nova-compute[98321]: INFO os_vif [None req-11eb4768-5704-4b77-9407-c79fd17e1b4a tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:7a:19,bridge_name='br-int',has_traffic_filtering=True,id=fd381175-d629-4ae4-b6a9-860af0c0aebf,network=Network(d262816b-8751-4e64-8f19-7d59ddaabc41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd381175-d6')
May 28 10:06:37.335504 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:06:37.336122 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-11eb4768-5704-4b77-9407-c79fd17e1b4a tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Deleting instance files /opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658_del
May 28 10:06:37.341204 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:37.346026 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-11eb4768-5704-4b77-9407-c79fd17e1b4a tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Deletion of /opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658_del complete
May 28 10:06:37.350216 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:37.350216 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2d3f59b-dd, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:06:37.350216 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb2d3f59b-dd, col_values=(('qos', UUID('ed65c334-6b08-49d7-952a-c977eb43d3b4')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:06:37.350216 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb2d3f59b-dd, col_values=(('external_ids', {'iface-id': 'b2d3f59b-ddbc-4c8d-871c-e169b41b4241', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:15:c3', 'vm-uuid': '90a9853a-2830-42b5-912d-72188187a375'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:06:37.353210 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:06:37.365976 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:37.367301 np0000001613 nova-compute[98321]: INFO os_vif [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:15:c3,bridge_name='br-int',has_traffic_filtering=True,id=b2d3f59b-ddbc-4c8d-871c-e169b41b4241,network=Network(cfc0fcd2-826d-4851-bc3e-3f0433d6fbce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2d3f59b-dd')
May 28 10:06:37.390153 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:06:37.390153 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:06:37.390676 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:06:37.390891 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:06:37.392078 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:06:37.392493 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:06:37.558868 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:37.574653 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:37.594455 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Instance destroyed successfully.
May 28 10:06:37.596571 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-247fca33-5a39-4802-ae01-2c56750461ff tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lazy-loading 'resources' on Instance uuid 11fd9dae-9efe-4726-abdd-995998d1df87 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:06:37.753114 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:06:37.759861 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:06:37.905312 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Took 19.86 seconds to spawn the instance on the hypervisor.
May 28 10:06:37.905312 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:06:37.935959 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-11eb4768-5704-4b77-9407-c79fd17e1b4a tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Deleted allocations for instance 11a2b3e7-1061-4a51-b520-113e13221658
May 28 10:06:38.098451 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-247fca33-5a39-4802-ae01-2c56750461ff tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:05:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-2041439870',display_name='tempest-VolumesBackupsTest-instance-2041439870',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumesbackupstest-instance-2041439870',id=41,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIwzGuCfKDIjO52WxHs4MsE5v5j8fwj0YUAjVt+YG0zpGL3dRyg6tBclMt9lnvl6Afyt5Abh3wejuTdb/ELIPjsPmVg7HNEIWaTagHxuommirIKrsJpaeApKWpZq526gg==',key_name='tempest-keypair-212005276',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:05:22Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42b5a6b6c4514b76a651b71280c093f5',ramdisk_id='',reservation_id='r-rni8lwvz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-1901675516',owner_user_name='tempest-VolumesBackupsTest-1901675516-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:05:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='655e1aff31fe454ab046a71daad5a888',uuid=11fd9dae-9efe-4726-abdd-995998d1df87,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52d06606-faa2-4fb3-a532-996445fd106f", "address": "fa:16:3e:b9:51:2c", "network": {"id": "6b4547f5-30ae-4bcf-b4e5-b7ffc2bcd25d", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1107528011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "42b5a6b6c4514b76a651b71280c093f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d06606-fa", "ovs_interfaceid": "52d06606-faa2-4fb3-a532-996445fd106f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:06:38.099134 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-247fca33-5a39-4802-ae01-2c56750461ff tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Converting VIF {"id": "52d06606-faa2-4fb3-a532-996445fd106f", "address": "fa:16:3e:b9:51:2c", "network": {"id": "6b4547f5-30ae-4bcf-b4e5-b7ffc2bcd25d", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1107528011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "42b5a6b6c4514b76a651b71280c093f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d06606-fa", "ovs_interfaceid": "52d06606-faa2-4fb3-a532-996445fd106f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:06:38.099406 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-247fca33-5a39-4802-ae01-2c56750461ff tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:51:2c,bridge_name='br-int',has_traffic_filtering=True,id=52d06606-faa2-4fb3-a532-996445fd106f,network=Network(6b4547f5-30ae-4bcf-b4e5-b7ffc2bcd25d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52d06606-fa') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:06:38.099601 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-247fca33-5a39-4802-ae01-2c56750461ff tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:51:2c,bridge_name='br-int',has_traffic_filtering=True,id=52d06606-faa2-4fb3-a532-996445fd106f,network=Network(6b4547f5-30ae-4bcf-b4e5-b7ffc2bcd25d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52d06606-fa') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:06:38.100665 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:38.100853 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap52d06606-fa, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:06:38.101646 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:38.103343 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:06:38.109155 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:38.110389 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:38.110582 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e7f6ca33-5016-424b-b411-7659b15c9e41) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:06:38.111224 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:38.111926 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:06:38.117631 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:38.119933 np0000001613 nova-compute[98321]: INFO os_vif [None req-247fca33-5a39-4802-ae01-2c56750461ff tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:51:2c,bridge_name='br-int',has_traffic_filtering=True,id=52d06606-faa2-4fb3-a532-996445fd106f,network=Network(6b4547f5-30ae-4bcf-b4e5-b7ffc2bcd25d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52d06606-fa')
May 28 10:06:38.120337 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-247fca33-5a39-4802-ae01-2c56750461ff tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Deleting instance files /opt/stack/data/nova/instances/11fd9dae-9efe-4726-abdd-995998d1df87_del
May 28 10:06:38.121498 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-247fca33-5a39-4802-ae01-2c56750461ff tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Deletion of /opt/stack/data/nova/instances/11fd9dae-9efe-4726-abdd-995998d1df87_del complete
May 28 10:06:38.201884 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8e86464c-f7fe-4988-82c5-b62bbab23312 req-f68d1678-1bbc-4def-a758-c8aa5b005cef service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Received event network-changed-fd381175-d629-4ae4-b6a9-860af0c0aebf {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:38.205596 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8e86464c-f7fe-4988-82c5-b62bbab23312 req-f68d1678-1bbc-4def-a758-c8aa5b005cef service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Refreshing instance network info cache due to event network-changed-fd381175-d629-4ae4-b6a9-860af0c0aebf. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:06:38.205780 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8e86464c-f7fe-4988-82c5-b62bbab23312 req-f68d1678-1bbc-4def-a758-c8aa5b005cef service nova] Acquiring lock "refresh_cache-11a2b3e7-1061-4a51-b520-113e13221658" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:06:38.205880 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8e86464c-f7fe-4988-82c5-b62bbab23312 req-f68d1678-1bbc-4def-a758-c8aa5b005cef service nova] Acquired lock "refresh_cache-11a2b3e7-1061-4a51-b520-113e13221658" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:06:38.205995 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-8e86464c-f7fe-4988-82c5-b62bbab23312 req-f68d1678-1bbc-4def-a758-c8aa5b005cef service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Refreshing network info cache for port fd381175-d629-4ae4-b6a9-860af0c0aebf {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:06:38.266008 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:06:38.266708 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962798.2665334, 86c73e57-3c63-4ccf-bff1-9529b5a1c837 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:06:38.266885 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] VM Paused (Lifecycle Event)
May 28 10:06:38.419465 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-0a25dcd4-e237-488f-8e42-dbea1b20e77f req-3de8fbb3-200c-40d6-b6d7-51ecfe7314c8 service nova] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Received event network-vif-plugged-e2f09a77-86d2-4a10-a6fa-8bd359b477ba {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:38.419758 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0a25dcd4-e237-488f-8e42-dbea1b20e77f req-3de8fbb3-200c-40d6-b6d7-51ecfe7314c8 service nova] Acquiring lock "86c73e57-3c63-4ccf-bff1-9529b5a1c837-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:38.420448 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0a25dcd4-e237-488f-8e42-dbea1b20e77f req-3de8fbb3-200c-40d6-b6d7-51ecfe7314c8 service nova] Lock "86c73e57-3c63-4ccf-bff1-9529b5a1c837-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:38.420448 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0a25dcd4-e237-488f-8e42-dbea1b20e77f req-3de8fbb3-200c-40d6-b6d7-51ecfe7314c8 service nova] Lock "86c73e57-3c63-4ccf-bff1-9529b5a1c837-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:38.420448 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-0a25dcd4-e237-488f-8e42-dbea1b20e77f req-3de8fbb3-200c-40d6-b6d7-51ecfe7314c8 service nova] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] No waiting events found dispatching network-vif-plugged-e2f09a77-86d2-4a10-a6fa-8bd359b477ba {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:06:38.420448 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-0a25dcd4-e237-488f-8e42-dbea1b20e77f req-3de8fbb3-200c-40d6-b6d7-51ecfe7314c8 service nova] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Received unexpected event network-vif-plugged-e2f09a77-86d2-4a10-a6fa-8bd359b477ba for instance with vm_state active and task_state None.
May 28 10:06:38.430848 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Took 27.21 seconds to build instance.
May 28 10:06:38.440980 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-11eb4768-5704-4b77-9407-c79fd17e1b4a tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:38.441180 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-11eb4768-5704-4b77-9407-c79fd17e1b4a tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:38.628751 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-247fca33-5a39-4802-ae01-2c56750461ff tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Took 1.41 seconds to destroy the instance on the hypervisor.
May 28 10:06:38.629910 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-247fca33-5a39-4802-ae01-2c56750461ff tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:06:38.630241 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:06:38.630342 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:06:38.630535 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:38.709539 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-8e86464c-f7fe-4988-82c5-b62bbab23312 req-f68d1678-1bbc-4def-a758-c8aa5b005cef service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:38.715305 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:38.727545 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-11eb4768-5704-4b77-9407-c79fd17e1b4a tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:06:38.727892 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-11eb4768-5704-4b77-9407-c79fd17e1b4a tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:06:38.770989 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:06:38.774236 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962798.7739482, 86c73e57-3c63-4ccf-bff1-9529b5a1c837 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:06:38.774405 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] VM Resumed (Lifecycle Event)
May 28 10:06:38.902805 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:06:38.903003 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:06:38.903177 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] No VIF found with MAC fa:16:3e:59:15:c3, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:06:38.903775 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Using config drive
May 28 10:06:38.939260 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d36c3c7d-f13a-4693-95be-b03ebbea9d57 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "86c73e57-3c63-4ccf-bff1-9529b5a1c837" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.727s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:39.233960 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-11eb4768-5704-4b77-9407-c79fd17e1b4a tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:06:39.276890 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:06:39.283572 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:06:39.294787 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:39.410243 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:39.491153 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-8e86464c-f7fe-4988-82c5-b62bbab23312 req-f68d1678-1bbc-4def-a758-c8aa5b005cef service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:39.635642 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:39.643042 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Creating config drive at /opt/stack/data/nova/instances/90a9853a-2830-42b5-912d-72188187a375/disk.config
May 28 10:06:39.655749 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/90a9853a-2830-42b5-912d-72188187a375/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9x53pvyn {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:06:39.710406 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-8e86464c-f7fe-4988-82c5-b62bbab23312 req-f68d1678-1bbc-4def-a758-c8aa5b005cef service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Updated VIF entry in instance network info cache for port fd381175-d629-4ae4-b6a9-860af0c0aebf. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:06:39.710406 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-8e86464c-f7fe-4988-82c5-b62bbab23312 req-f68d1678-1bbc-4def-a758-c8aa5b005cef service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Updating instance_info_cache with network_info: [{"id": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "address": "fa:16:3e:b5:7a:19", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapfd381175-d6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:06:39.732938 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/90a9853a-2830-42b5-912d-72188187a375/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9x53pvyn" returned: 0 in 0.077s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:06:39.745987 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-11eb4768-5704-4b77-9407-c79fd17e1b4a tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.305s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:39.787188 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.99961595600007 future=<Future at 0x73c1f4219700 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:39.792075 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:06:40.153454 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "86c73e57-3c63-4ccf-bff1-9529b5a1c837" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:40.153774 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "86c73e57-3c63-4ccf-bff1-9529b5a1c837" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:40.154046 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "86c73e57-3c63-4ccf-bff1-9529b5a1c837-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:40.154241 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "86c73e57-3c63-4ccf-bff1-9529b5a1c837-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:40.154398 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "86c73e57-3c63-4ccf-bff1-9529b5a1c837-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:40.157683 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Terminating instance
May 28 10:06:40.209857 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:40.215308 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8e86464c-f7fe-4988-82c5-b62bbab23312 req-f68d1678-1bbc-4def-a758-c8aa5b005cef service nova] Releasing lock "refresh_cache-11a2b3e7-1061-4a51-b520-113e13221658" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:06:40.215308 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8e86464c-f7fe-4988-82c5-b62bbab23312 req-f68d1678-1bbc-4def-a758-c8aa5b005cef service nova] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Received event network-vif-unplugged-52d06606-faa2-4fb3-a532-996445fd106f {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:40.215745 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8e86464c-f7fe-4988-82c5-b62bbab23312 req-f68d1678-1bbc-4def-a758-c8aa5b005cef service nova] Acquiring lock "11fd9dae-9efe-4726-abdd-995998d1df87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:40.215745 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8e86464c-f7fe-4988-82c5-b62bbab23312 req-f68d1678-1bbc-4def-a758-c8aa5b005cef service nova] Lock "11fd9dae-9efe-4726-abdd-995998d1df87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:40.216007 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8e86464c-f7fe-4988-82c5-b62bbab23312 req-f68d1678-1bbc-4def-a758-c8aa5b005cef service nova] Lock "11fd9dae-9efe-4726-abdd-995998d1df87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:40.216007 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8e86464c-f7fe-4988-82c5-b62bbab23312 req-f68d1678-1bbc-4def-a758-c8aa5b005cef service nova] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] No waiting events found dispatching network-vif-unplugged-52d06606-faa2-4fb3-a532-996445fd106f {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:06:40.216196 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8e86464c-f7fe-4988-82c5-b62bbab23312 req-f68d1678-1bbc-4def-a758-c8aa5b005cef service nova] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Received event network-vif-unplugged-52d06606-faa2-4fb3-a532-996445fd106f for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:06:40.216196 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8e86464c-f7fe-4988-82c5-b62bbab23312 req-f68d1678-1bbc-4def-a758-c8aa5b005cef service nova] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Received event network-vif-unplugged-52d06606-faa2-4fb3-a532-996445fd106f {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:40.216363 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8e86464c-f7fe-4988-82c5-b62bbab23312 req-f68d1678-1bbc-4def-a758-c8aa5b005cef service nova] Acquiring lock "11fd9dae-9efe-4726-abdd-995998d1df87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:40.216363 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8e86464c-f7fe-4988-82c5-b62bbab23312 req-f68d1678-1bbc-4def-a758-c8aa5b005cef service nova] Lock "11fd9dae-9efe-4726-abdd-995998d1df87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:40.216477 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8e86464c-f7fe-4988-82c5-b62bbab23312 req-f68d1678-1bbc-4def-a758-c8aa5b005cef service nova] Lock "11fd9dae-9efe-4726-abdd-995998d1df87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:40.216566 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8e86464c-f7fe-4988-82c5-b62bbab23312 req-f68d1678-1bbc-4def-a758-c8aa5b005cef service nova] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] No waiting events found dispatching network-vif-unplugged-52d06606-faa2-4fb3-a532-996445fd106f {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:06:40.216642 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8e86464c-f7fe-4988-82c5-b62bbab23312 req-f68d1678-1bbc-4def-a758-c8aa5b005cef service nova] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Received event network-vif-unplugged-52d06606-faa2-4fb3-a532-996445fd106f for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:06:40.216746 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8e86464c-f7fe-4988-82c5-b62bbab23312 req-f68d1678-1bbc-4def-a758-c8aa5b005cef service nova] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Received event network-changed-c00621f0-d21c-42ae-85e1-4aba5aaa265b {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:40.216882 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8e86464c-f7fe-4988-82c5-b62bbab23312 req-f68d1678-1bbc-4def-a758-c8aa5b005cef service nova] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Refreshing instance network info cache due to event network-changed-c00621f0-d21c-42ae-85e1-4aba5aaa265b. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:06:40.216977 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8e86464c-f7fe-4988-82c5-b62bbab23312 req-f68d1678-1bbc-4def-a758-c8aa5b005cef service nova] Acquiring lock "refresh_cache-94f83a1a-f61c-49bd-ac96-eefd2e3de22c" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:06:40.217053 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8e86464c-f7fe-4988-82c5-b62bbab23312 req-f68d1678-1bbc-4def-a758-c8aa5b005cef service nova] Acquired lock "refresh_cache-94f83a1a-f61c-49bd-ac96-eefd2e3de22c" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:06:40.217144 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-8e86464c-f7fe-4988-82c5-b62bbab23312 req-f68d1678-1bbc-4def-a758-c8aa5b005cef service nova] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Refreshing network info cache for port c00621f0-d21c-42ae-85e1-4aba5aaa265b {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:06:40.242224 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:40.253108 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-11eb4768-5704-4b77-9407-c79fd17e1b4a tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "11a2b3e7-1061-4a51-b520-113e13221658" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 13.532s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:40.294302 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Took 1.66 seconds to deallocate network for instance.
May 28 10:06:40.336216 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:40.498403 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-bd74d55b-1a1c-4c60-a92d-0c658f6c5d72 req-f0c854bc-1c92-45be-8611-d2f13bf0ee3f service nova] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Received event network-vif-deleted-52d06606-faa2-4fb3-a532-996445fd106f {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:40.630628 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:40.634196 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:40.636633 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:40.663906 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:40.665456 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:06:40.687217 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:40.689990 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:40.715450 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:40.719780 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-8e86464c-f7fe-4988-82c5-b62bbab23312 req-f68d1678-1bbc-4def-a758-c8aa5b005cef service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:40.774932 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:40.803950 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-247fca33-5a39-4802-ae01-2c56750461ff tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:40.804135 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-247fca33-5a39-4802-ae01-2c56750461ff tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:40.805894 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:41.037380 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.99961117599969 future=<Future at 0x73c1f4313860 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:41.045886 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Instance destroyed successfully.
May 28 10:06:41.046419 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lazy-loading 'resources' on Instance uuid 86c73e57-3c63-4ccf-bff1-9529b5a1c837 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:06:41.207304 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-247fca33-5a39-4802-ae01-2c56750461ff tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:06:41.207525 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-247fca33-5a39-4802-ae01-2c56750461ff tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:06:41.263704 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962801.2632558, 90a9853a-2830-42b5-912d-72188187a375 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:06:41.264112 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 90a9853a-2830-42b5-912d-72188187a375] VM Started (Lifecycle Event)
May 28 10:06:41.399209 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-8e86464c-f7fe-4988-82c5-b62bbab23312 req-f68d1678-1bbc-4def-a758-c8aa5b005cef service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:41.550654 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:06:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-109175609',display_name='tempest-TestVolumeBootPattern-server-109175609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpattern-server-109175609',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:06:37Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='23e9651268114327a9cc6c6c59bef01e',ramdisk_id='',reservation_id='r-ku823eff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestVolumeBootPattern-327944304',owner_user_name='tempest-TestVolumeBootPattern-327944304-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:06:38Z,user_data=None,user_id='ec58233d3b2848bbb2e0b00650398cd1',uuid=86c73e57-3c63-4ccf-bff1-9529b5a1c837,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2f09a77-86d2-4a10-a6fa-8bd359b477ba", "address": "fa:16:3e:c0:92:f2", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f09a77-86", "ovs_interfaceid": "e2f09a77-86d2-4a10-a6fa-8bd359b477ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:06:41.550879 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converting VIF {"id": "e2f09a77-86d2-4a10-a6fa-8bd359b477ba", "address": "fa:16:3e:c0:92:f2", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f09a77-86", "ovs_interfaceid": "e2f09a77-86d2-4a10-a6fa-8bd359b477ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:06:41.551388 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:92:f2,bridge_name='br-int',has_traffic_filtering=True,id=e2f09a77-86d2-4a10-a6fa-8bd359b477ba,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2f09a77-86') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:06:41.551593 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:92:f2,bridge_name='br-int',has_traffic_filtering=True,id=e2f09a77-86d2-4a10-a6fa-8bd359b477ba,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2f09a77-86') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:06:41.553955 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:41.554313 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2f09a77-86, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:06:41.556710 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:41.557479 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:06:41.559487 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:41.560578 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:41.560793 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e1be14b2-c886-4ccc-b9cf-17922151c679) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:06:41.562575 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:06:41.565612 np0000001613 nova-compute[98321]: INFO os_vif [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:92:f2,bridge_name='br-int',has_traffic_filtering=True,id=e2f09a77-86d2-4a10-a6fa-8bd359b477ba,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2f09a77-86')
May 28 10:06:41.574503 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-8e86464c-f7fe-4988-82c5-b62bbab23312 req-f68d1678-1bbc-4def-a758-c8aa5b005cef service nova] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Updated VIF entry in instance network info cache for port c00621f0-d21c-42ae-85e1-4aba5aaa265b. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:06:41.578706 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-8e86464c-f7fe-4988-82c5-b62bbab23312 req-f68d1678-1bbc-4def-a758-c8aa5b005cef service nova] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Updating instance_info_cache with network_info: [{"id": "c00621f0-d21c-42ae-85e1-4aba5aaa265b", "address": "fa:16:3e:c4:58:1f", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc00621f0-d2", "ovs_interfaceid": "c00621f0-d21c-42ae-85e1-4aba5aaa265b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:06:41.619588 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4', 'iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '49c2a3b7-24f1-43b2-9576-96031ee600b4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '86c73e57-3c63-4ccf-bff1-9529b5a1c837', 'attached_at': '', 'detached_at': '', 'volume_id': '49c2a3b7-24f1-43b2-9576-96031ee600b4', 'serial': '49c2a3b7-24f1-43b2-9576-96031ee600b4'} {{(pid=98321) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 10:06:41.619588 np0000001613 nova-compute[98321]: WARNING stevedore.named [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 10:06:41.619588 np0000001613 nova-compute[98321]: WARNING castellan.key_manager [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 10:06:41.619588 np0000001613 nova-compute[98321]: WARNING nova.keymgr.conf_key_mgr [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 10:06:41.620600 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x73c1fc35c2c0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4', 'iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '49c2a3b7-24f1-43b2-9576-96031ee600b4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '86c73e57-3c63-4ccf-bff1-9529b5a1c837', 'attached_at': '', 'detached_at': '', 'volume_id': '49c2a3b7-24f1-43b2-9576-96031ee600b4', 'serial': '49c2a3b7-24f1-43b2-9576-96031ee600b4'} {{(pid=98321) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 10:06:41.620600 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors.luks [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] closing encrypted volume /dev/dm-2 {{(pid=98321) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:207}}
May 28 10:06:41.658405 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:06:41.659028 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4', 'iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '49c2a3b7-24f1-43b2-9576-96031ee600b4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:06:41.659268 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:06:41.659650 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:06:41.660032 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4', 'iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '49c2a3b7-24f1-43b2-9576-96031ee600b4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:06:41.660385 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:06:41.692420 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a8cb6a1-c512-4a31-a536-60a735887c6b (non-flash)
May 28 10:06:41.692420 np0000001613 nova-compute[98321]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a8cb6a1-c512-4a31-a536-60a735887c6b (non-flash)
May 28 10:06:41.692420 np0000001613 nova-compute[98321]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4 (non-flash)
May 28 10:06:41.692420 np0000001613 nova-compute[98321]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4 (non-flash)
May 28 10:06:41.692420 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:06:41.692696 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a8cb6a1-c512-4a31-a536-60a735887c6b (non-flash)
May 28 10:06:41.692696 np0000001613 nova-compute[98321]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a8cb6a1-c512-4a31-a536-60a735887c6b (non-flash)
May 28 10:06:41.692696 np0000001613 nova-compute[98321]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4 (non-flash)
May 28 10:06:41.692696 np0000001613 nova-compute[98321]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4 (non-flash)
May 28 10:06:41.692696 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:06:41.693031 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a8cb6a1-c512-4a31-a536-60a735887c6b', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a8cb6a1-c512-4a31-a536-60a735887c6b', '103'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4', '98'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4', '99')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:06:41.693224 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4', '99')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:06:41.694212 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4', '98')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:06:41.695331 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc148b80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4'): ({'sdc'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:06:41.695331 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Removing multipathed devices sdc, sdd {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:06:41.695596 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Flush multipath device 3300000008945c9ca {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:06:41.711224 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-247fca33-5a39-4802-ae01-2c56750461ff tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:06:41.732001 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:06:41.766718 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 90a9853a-2830-42b5-912d-72188187a375] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:06:41.771752 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962801.771499, 90a9853a-2830-42b5-912d-72188187a375 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:06:41.771968 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 90a9853a-2830-42b5-912d-72188187a375] VM Paused (Lifecycle Event)
May 28 10:06:41.788924 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:06:41.832660 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Checking to see if SCSI volumes sdc, sdd have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:06:41.832943 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] SCSI volumes sdc, sdd have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:06:41.834012 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Checking to see if device paths {'sdc', 'sdd'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:06:41.845408 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Device paths {'sdc', 'sdd'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:06:41.845798 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:06:41.857357 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:41.885854 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 99, target: iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4, portal: 192.168.40.100,3260]
May 28 10:06:41.885854 np0000001613 nova-compute[98321]: Logout of [sid: 99, target: iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4, portal: 192.168.40.100,3260] successful.
May 28 10:06:41.885854 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:41.902353 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:41.916380 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:41.950264 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 98, target: iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4, portal: 192.168.50.100,3260]
May 28 10:06:41.950264 np0000001613 nova-compute[98321]: Logout of [sid: 98, target: iqn.2023-03.storpool.com:os--volume-49c2a3b7-24f1-43b2-9576-96031ee600b4, portal: 192.168.50.100,3260] successful.
May 28 10:06:41.950264 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:41.965866 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:41.967118 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:06:41.968129 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] <== disconnect_volume: return (308ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:06:41.969036 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:06:41.969540 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Deleting instance files /opt/stack/data/nova/instances/86c73e57-3c63-4ccf-bff1-9529b5a1c837_del
May 28 10:06:41.972118 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Deletion of /opt/stack/data/nova/instances/86c73e57-3c63-4ccf-bff1-9529b5a1c837_del complete
May 28 10:06:42.079001 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8e86464c-f7fe-4988-82c5-b62bbab23312 req-f68d1678-1bbc-4def-a758-c8aa5b005cef service nova] Releasing lock "refresh_cache-94f83a1a-f61c-49bd-ac96-eefd2e3de22c" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:06:42.220654 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-247fca33-5a39-4802-ae01-2c56750461ff tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.416s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:42.244101 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "11a2b3e7-1061-4a51-b520-113e13221658" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:42.244309 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "11a2b3e7-1061-4a51-b520-113e13221658" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:42.244460 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Unshelving
May 28 10:06:42.274885 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 90a9853a-2830-42b5-912d-72188187a375] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:06:42.279924 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 90a9853a-2830-42b5-912d-72188187a375] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:06:42.291656 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-247fca33-5a39-4802-ae01-2c56750461ff tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Deleted allocations for instance 11fd9dae-9efe-4726-abdd-995998d1df87
May 28 10:06:42.487913 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Took 1.82 seconds to destroy the instance on the hypervisor.
May 28 10:06:42.488618 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:06:42.491557 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:06:42.491557 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:06:42.491557 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:42.563289 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:42.569669 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-36c705c4-9466-410e-a2dd-3542bec5a986 req-9ac7bb8d-df28-415f-8f19-ceb564e3f8af service nova] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Received event network-vif-unplugged-e2f09a77-86d2-4a10-a6fa-8bd359b477ba {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:42.569872 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-36c705c4-9466-410e-a2dd-3542bec5a986 req-9ac7bb8d-df28-415f-8f19-ceb564e3f8af service nova] Acquiring lock "86c73e57-3c63-4ccf-bff1-9529b5a1c837-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:42.570028 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-36c705c4-9466-410e-a2dd-3542bec5a986 req-9ac7bb8d-df28-415f-8f19-ceb564e3f8af service nova] Lock "86c73e57-3c63-4ccf-bff1-9529b5a1c837-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:42.570928 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-36c705c4-9466-410e-a2dd-3542bec5a986 req-9ac7bb8d-df28-415f-8f19-ceb564e3f8af service nova] Lock "86c73e57-3c63-4ccf-bff1-9529b5a1c837-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:42.570928 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-36c705c4-9466-410e-a2dd-3542bec5a986 req-9ac7bb8d-df28-415f-8f19-ceb564e3f8af service nova] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] No waiting events found dispatching network-vif-unplugged-e2f09a77-86d2-4a10-a6fa-8bd359b477ba {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:06:42.570928 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-36c705c4-9466-410e-a2dd-3542bec5a986 req-9ac7bb8d-df28-415f-8f19-ceb564e3f8af service nova] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Received event network-vif-unplugged-e2f09a77-86d2-4a10-a6fa-8bd359b477ba for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:06:42.570928 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-36c705c4-9466-410e-a2dd-3542bec5a986 req-9ac7bb8d-df28-415f-8f19-ceb564e3f8af service nova] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Received event network-vif-unplugged-e2f09a77-86d2-4a10-a6fa-8bd359b477ba {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:42.571125 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-36c705c4-9466-410e-a2dd-3542bec5a986 req-9ac7bb8d-df28-415f-8f19-ceb564e3f8af service nova] Acquiring lock "86c73e57-3c63-4ccf-bff1-9529b5a1c837-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:42.571281 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-36c705c4-9466-410e-a2dd-3542bec5a986 req-9ac7bb8d-df28-415f-8f19-ceb564e3f8af service nova] Lock "86c73e57-3c63-4ccf-bff1-9529b5a1c837-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:42.571407 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-36c705c4-9466-410e-a2dd-3542bec5a986 req-9ac7bb8d-df28-415f-8f19-ceb564e3f8af service nova] Lock "86c73e57-3c63-4ccf-bff1-9529b5a1c837-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:42.571554 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-36c705c4-9466-410e-a2dd-3542bec5a986 req-9ac7bb8d-df28-415f-8f19-ceb564e3f8af service nova] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] No waiting events found dispatching network-vif-unplugged-e2f09a77-86d2-4a10-a6fa-8bd359b477ba {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:06:42.571684 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-36c705c4-9466-410e-a2dd-3542bec5a986 req-9ac7bb8d-df28-415f-8f19-ceb564e3f8af service nova] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Received event network-vif-unplugged-e2f09a77-86d2-4a10-a6fa-8bd359b477ba for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:06:42.788624 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 90a9853a-2830-42b5-912d-72188187a375] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:06:42.895005 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:43.089336 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.000715769000180444 future=<Future at 0x73c1f4210ec0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:43.089932 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] Emitting event <LifecycleEvent: 1779962788.088385, 11a2b3e7-1061-4a51-b520-113e13221658 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:06:43.090313 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] VM Stopped (Lifecycle Event)
May 28 10:06:43.091768 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:43.091768 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=11.695097735999752 future=<Future at 0x73c1f4219700 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:43.091768 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=11.69498336300012 future=<Future at 0x73c1f4219700 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:43.306361 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-247fca33-5a39-4802-ae01-2c56750461ff tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "11fd9dae-9efe-4726-abdd-995998d1df87" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.591s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:43.315521 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:43.315674 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:43.318961 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lazy-loading 'pci_requests' on Instance uuid 11a2b3e7-1061-4a51-b520-113e13221658 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:06:43.347663 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:06:43.593024 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8b917ccb-d6e2-4f89-91f2-c1a1e46ff43b tempest-AttachVolumeMultiAttachTest-1052626787 tempest-AttachVolumeMultiAttachTest-1052626787-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:06:43.822297 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lazy-loading 'numa_topology' on Instance uuid 11a2b3e7-1061-4a51-b520-113e13221658 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:06:43.849993 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Took 1.36 seconds to deallocate network for instance.
May 28 10:06:44.326226 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:06:44.326586 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Claim successful on node np0000001613
May 28 10:06:44.408292 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Took 0.56 seconds to detach 1 volumes for instance.
May 28 10:06:44.637274 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:44.653756 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a6a77c8b-0d88-4ad1-bec1-7933486656d3 req-a80c529b-1938-43a1-a2e4-a7a0ced8902b service nova] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Received event network-vif-deleted-e2f09a77-86d2-4a10-a6fa-8bd359b477ba {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:44.798147 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:44.915099 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:45.585957 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:06:45.586467 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:06:45.805583 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-35043ae1-c6e3-4c0c-ad21-fbc128c2595e req-6ce278bd-448f-4048-b4f1-950556a43668 service nova] [instance: 90a9853a-2830-42b5-912d-72188187a375] Received event network-vif-plugged-b2d3f59b-ddbc-4c8d-871c-e169b41b4241 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:45.805583 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-35043ae1-c6e3-4c0c-ad21-fbc128c2595e req-6ce278bd-448f-4048-b4f1-950556a43668 service nova] Acquiring lock "90a9853a-2830-42b5-912d-72188187a375-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:45.805583 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-35043ae1-c6e3-4c0c-ad21-fbc128c2595e req-6ce278bd-448f-4048-b4f1-950556a43668 service nova] Lock "90a9853a-2830-42b5-912d-72188187a375-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:45.805583 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-35043ae1-c6e3-4c0c-ad21-fbc128c2595e req-6ce278bd-448f-4048-b4f1-950556a43668 service nova] Lock "90a9853a-2830-42b5-912d-72188187a375-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:45.805583 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-35043ae1-c6e3-4c0c-ad21-fbc128c2595e req-6ce278bd-448f-4048-b4f1-950556a43668 service nova] [instance: 90a9853a-2830-42b5-912d-72188187a375] Processing event network-vif-plugged-b2d3f59b-ddbc-4c8d-871c-e169b41b4241 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:06:45.805583 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Instance event wait completed in 4 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:06:45.808855 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962805.8085604, 90a9853a-2830-42b5-912d-72188187a375 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:06:45.809098 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 90a9853a-2830-42b5-912d-72188187a375] VM Resumed (Lifecycle Event)
May 28 10:06:45.813275 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:06:45.816236 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 90a9853a-2830-42b5-912d-72188187a375] Instance spawned successfully.
May 28 10:06:45.816639 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:06:46.089327 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:06:46.312079 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 90a9853a-2830-42b5-912d-72188187a375] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:06:46.323058 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 90a9853a-2830-42b5-912d-72188187a375] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:06:46.327071 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:06:46.327232 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:06:46.327603 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:06:46.329962 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:06:46.334338 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:06:46.340281 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:06:46.561252 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:46.598267 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.282s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:46.598612 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:46.600484 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.685s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:46.678377 np0000001613 nova-compute[98321]: INFO nova.network.neutron [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Updating port fd381175-d629-4ae4-b6a9-860af0c0aebf with attributes {'binding:host_id': 'np0000001613', 'device_owner': 'compute:nova'}
May 28 10:06:46.826805 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 90a9853a-2830-42b5-912d-72188187a375] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:06:46.840098 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Took 12.39 seconds to spawn the instance on the hypervisor.
May 28 10:06:46.840436 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:06:46.856158 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:06:46.856607 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:06:47.305946 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "refresh_cache-11a2b3e7-1061-4a51-b520-113e13221658" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:06:47.306925 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquired lock "refresh_cache-11a2b3e7-1061-4a51-b520-113e13221658" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:06:47.306925 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:06:47.353796 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Took 17.92 seconds to build instance.
May 28 10:06:47.359037 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:06:47.813183 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:47.856833 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2b49eec0-feaf-4a2d-853e-5499c1dab3f1 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "90a9853a-2830-42b5-912d-72188187a375" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.450s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:47.868188 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.265s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:47.875762 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f026b8a3-da8f-499f-866e-8a315b686216 req-bcdbb5cb-de55-4c04-934e-0c1f25ffe34f service nova] [instance: 90a9853a-2830-42b5-912d-72188187a375] Received event network-vif-plugged-b2d3f59b-ddbc-4c8d-871c-e169b41b4241 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:47.875981 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f026b8a3-da8f-499f-866e-8a315b686216 req-bcdbb5cb-de55-4c04-934e-0c1f25ffe34f service nova] Acquiring lock "90a9853a-2830-42b5-912d-72188187a375-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:47.876180 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f026b8a3-da8f-499f-866e-8a315b686216 req-bcdbb5cb-de55-4c04-934e-0c1f25ffe34f service nova] Lock "90a9853a-2830-42b5-912d-72188187a375-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:47.876332 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f026b8a3-da8f-499f-866e-8a315b686216 req-bcdbb5cb-de55-4c04-934e-0c1f25ffe34f service nova] Lock "90a9853a-2830-42b5-912d-72188187a375-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:47.876457 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f026b8a3-da8f-499f-866e-8a315b686216 req-bcdbb5cb-de55-4c04-934e-0c1f25ffe34f service nova] [instance: 90a9853a-2830-42b5-912d-72188187a375] No waiting events found dispatching network-vif-plugged-b2d3f59b-ddbc-4c8d-871c-e169b41b4241 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:06:47.876595 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-f026b8a3-da8f-499f-866e-8a315b686216 req-bcdbb5cb-de55-4c04-934e-0c1f25ffe34f service nova] [instance: 90a9853a-2830-42b5-912d-72188187a375] Received unexpected event network-vif-plugged-b2d3f59b-ddbc-4c8d-871c-e169b41b4241 for instance with vm_state active and task_state None.
May 28 10:06:47.876700 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f026b8a3-da8f-499f-866e-8a315b686216 req-bcdbb5cb-de55-4c04-934e-0c1f25ffe34f service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Received event network-changed-fd381175-d629-4ae4-b6a9-860af0c0aebf {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:47.876828 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f026b8a3-da8f-499f-866e-8a315b686216 req-bcdbb5cb-de55-4c04-934e-0c1f25ffe34f service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Refreshing instance network info cache due to event network-changed-fd381175-d629-4ae4-b6a9-860af0c0aebf. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:06:47.877003 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f026b8a3-da8f-499f-866e-8a315b686216 req-bcdbb5cb-de55-4c04-934e-0c1f25ffe34f service nova] Acquiring lock "refresh_cache-11a2b3e7-1061-4a51-b520-113e13221658" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:06:47.922384 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Deleted allocations for instance 86c73e57-3c63-4ccf-bff1-9529b5a1c837
May 28 10:06:48.180442 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:48.368131 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Updating instance_info_cache with network_info: [{"id": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "address": "fa:16:3e:b5:7a:19", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd381175-d6", "ovs_interfaceid": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:06:48.607073 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5c398de5-ac7b-4213-a812-f65927399c62 req-b3c09673-f554-4f49-bf6f-852ecb6cd385 service nova] [instance: 90a9853a-2830-42b5-912d-72188187a375] Received event network-changed-b2d3f59b-ddbc-4c8d-871c-e169b41b4241 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:48.607638 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5c398de5-ac7b-4213-a812-f65927399c62 req-b3c09673-f554-4f49-bf6f-852ecb6cd385 service nova] [instance: 90a9853a-2830-42b5-912d-72188187a375] Refreshing instance network info cache due to event network-changed-b2d3f59b-ddbc-4c8d-871c-e169b41b4241. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:06:48.607870 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5c398de5-ac7b-4213-a812-f65927399c62 req-b3c09673-f554-4f49-bf6f-852ecb6cd385 service nova] Acquiring lock "refresh_cache-90a9853a-2830-42b5-912d-72188187a375" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:06:48.607997 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5c398de5-ac7b-4213-a812-f65927399c62 req-b3c09673-f554-4f49-bf6f-852ecb6cd385 service nova] Acquired lock "refresh_cache-90a9853a-2830-42b5-912d-72188187a375" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:06:48.608155 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-5c398de5-ac7b-4213-a812-f65927399c62 req-b3c09673-f554-4f49-bf6f-852ecb6cd385 service nova] [instance: 90a9853a-2830-42b5-912d-72188187a375] Refreshing network info cache for port b2d3f59b-ddbc-4c8d-871c-e169b41b4241 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:06:48.870481 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Releasing lock "refresh_cache-11a2b3e7-1061-4a51-b520-113e13221658" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:06:48.871455 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:06:48.871943 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f026b8a3-da8f-499f-866e-8a315b686216 req-bcdbb5cb-de55-4c04-934e-0c1f25ffe34f service nova] Acquired lock "refresh_cache-11a2b3e7-1061-4a51-b520-113e13221658" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:06:48.872181 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-f026b8a3-da8f-499f-866e-8a315b686216 req-bcdbb5cb-de55-4c04-934e-0c1f25ffe34f service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Refreshing network info cache for port fd381175-d629-4ae4-b6a9-860af0c0aebf {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:06:48.873344 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Creating image(s)
May 28 10:06:48.874386 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "/opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:48.874386 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "/opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:48.877718 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "/opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:48.881102 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lazy-loading 'trusted_certs' on Instance uuid 11a2b3e7-1061-4a51-b520-113e13221658 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:06:48.932436 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-338001b8-7b3b-413c-8849-08eb828c0637 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "86c73e57-3c63-4ccf-bff1-9529b5a1c837" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.779s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:49.110526 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-5c398de5-ac7b-4213-a812-f65927399c62 req-b3c09673-f554-4f49-bf6f-852ecb6cd385 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:49.375566 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-f026b8a3-da8f-499f-866e-8a315b686216 req-bcdbb5cb-de55-4c04-934e-0c1f25ffe34f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:49.382310 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Object Instance<11a2b3e7-1061-4a51-b520-113e13221658> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:06:49.382310 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "ddd2e4139bc1e0485dad1cf2025e843c47b1501f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:49.382310 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "ddd2e4139bc1e0485dad1cf2025e843c47b1501f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:49.544751 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-5c398de5-ac7b-4213-a812-f65927399c62 req-b3c09673-f554-4f49-bf6f-852ecb6cd385 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:49.640435 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:49.741072 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-5c398de5-ac7b-4213-a812-f65927399c62 req-b3c09673-f554-4f49-bf6f-852ecb6cd385 service nova] [instance: 90a9853a-2830-42b5-912d-72188187a375] Updated VIF entry in instance network info cache for port b2d3f59b-ddbc-4c8d-871c-e169b41b4241. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:06:49.741072 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-5c398de5-ac7b-4213-a812-f65927399c62 req-b3c09673-f554-4f49-bf6f-852ecb6cd385 service nova] [instance: 90a9853a-2830-42b5-912d-72188187a375] Updating instance_info_cache with network_info: [{"id": "b2d3f59b-ddbc-4c8d-871c-e169b41b4241", "address": "fa:16:3e:59:15:c3", "network": {"id": "cfc0fcd2-826d-4851-bc3e-3f0433d6fbce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1771427851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f2d040c323b4b948803334de7c8ec44", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2d3f59b-dd", "ovs_interfaceid": "b2d3f59b-ddbc-4c8d-871c-e169b41b4241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:06:49.889898 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-f026b8a3-da8f-499f-866e-8a315b686216 req-bcdbb5cb-de55-4c04-934e-0c1f25ffe34f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:50.094920 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Acquiring lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:50.094920 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:50.144436 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-f026b8a3-da8f-499f-866e-8a315b686216 req-bcdbb5cb-de55-4c04-934e-0c1f25ffe34f service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Updated VIF entry in instance network info cache for port fd381175-d629-4ae4-b6a9-860af0c0aebf. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:06:50.145220 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-f026b8a3-da8f-499f-866e-8a315b686216 req-bcdbb5cb-de55-4c04-934e-0c1f25ffe34f service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Updating instance_info_cache with network_info: [{"id": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "address": "fa:16:3e:b5:7a:19", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd381175-d6", "ovs_interfaceid": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:06:50.243393 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5c398de5-ac7b-4213-a812-f65927399c62 req-b3c09673-f554-4f49-bf6f-852ecb6cd385 service nova] Releasing lock "refresh_cache-90a9853a-2830-42b5-912d-72188187a375" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:06:50.333075 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:06:50.336417 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:06:50.336836 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddd2e4139bc1e0485dad1cf2025e843c47b1501f.part --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:06:50.430887 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddd2e4139bc1e0485dad1cf2025e843c47b1501f.part --force-share --output=json" returned: 0 in 0.094s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:06:50.431502 np0000001613 nova-compute[98321]: DEBUG nova.virt.images [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] 3bc5584d-a882-41ca-ba19-ff52b508e44e was qcow2, converting to raw {{(pid=98321) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 10:06:50.432230 np0000001613 nova-compute[98321]: DEBUG nova.privsep.utils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98321) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 10:06:50.432561 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ddd2e4139bc1e0485dad1cf2025e843c47b1501f.part /opt/stack/data/nova/instances/_base/ddd2e4139bc1e0485dad1cf2025e843c47b1501f.converted {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:06:50.598872 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:06:50.622973 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ddd2e4139bc1e0485dad1cf2025e843c47b1501f.part /opt/stack/data/nova/instances/_base/ddd2e4139bc1e0485dad1cf2025e843c47b1501f.converted" returned: 0 in 0.190s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:06:50.644230 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddd2e4139bc1e0485dad1cf2025e843c47b1501f.converted --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:06:50.664769 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f026b8a3-da8f-499f-866e-8a315b686216 req-bcdbb5cb-de55-4c04-934e-0c1f25ffe34f service nova] Releasing lock "refresh_cache-11a2b3e7-1061-4a51-b520-113e13221658" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:06:50.765668 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddd2e4139bc1e0485dad1cf2025e843c47b1501f.converted --force-share --output=json" returned: 0 in 0.122s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:06:50.766395 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "ddd2e4139bc1e0485dad1cf2025e843c47b1501f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.384s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:50.766701 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:06:50.769970 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:06:50.771524 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddd2e4139bc1e0485dad1cf2025e843c47b1501f --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:06:50.871191 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddd2e4139bc1e0485dad1cf2025e843c47b1501f --force-share --output=json" returned: 0 in 0.099s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:06:50.871786 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "ddd2e4139bc1e0485dad1cf2025e843c47b1501f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:50.872437 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "ddd2e4139bc1e0485dad1cf2025e843c47b1501f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:50.873128 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:06:50.877182 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:06:50.877599 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddd2e4139bc1e0485dad1cf2025e843c47b1501f --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:06:50.972458 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddd2e4139bc1e0485dad1cf2025e843c47b1501f --force-share --output=json" returned: 0 in 0.094s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:06:50.975236 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ddd2e4139bc1e0485dad1cf2025e843c47b1501f,backing_fmt=raw /opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:06:51.034422 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ddd2e4139bc1e0485dad1cf2025e843c47b1501f,backing_fmt=raw /opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658/disk 1073741824" returned: 0 in 0.061s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:06:51.037629 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "ddd2e4139bc1e0485dad1cf2025e843c47b1501f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.163s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:51.037629 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddd2e4139bc1e0485dad1cf2025e843c47b1501f --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:06:51.131359 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddd2e4139bc1e0485dad1cf2025e843c47b1501f --force-share --output=json" returned: 0 in 0.096s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:06:51.131821 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lazy-loading 'migration_context' on Instance uuid 11a2b3e7-1061-4a51-b520-113e13221658 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:06:51.199629 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:51.199915 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:51.209666 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:06:51.209666 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Claim successful on node np0000001613
May 28 10:06:51.562497 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:51.635689 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Object Instance<11a2b3e7-1061-4a51-b520-113e13221658> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:06:51.636123 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Rebasing disk image.
May 28 10:06:51.636311 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:06:51.737095 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.100s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:06:51.741181 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 -F raw /opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658/disk {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:06:52.529431 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:06:52.530391 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:06:52.774157 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 -F raw /opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658/disk" returned: 0 in 1.036s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:06:52.774597 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:06:52.774797 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Ensure instance console log exists: /opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:06:52.775177 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:52.775416 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:52.775589 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:52.777689 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Start _get_guest_xml network_info=[{"id": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "address": "fa:16:3e:b5:7a:19", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd381175-d6", "ovs_interfaceid": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b5850f1ea8d09d3419434abc7100bb4e',container_format='bare',created_at=2026-05-28T10:06:26Z,direct_url=<?>,disk_format='qcow2',id=3bc5584d-a882-41ca-ba19-ff52b508e44e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1038469455-shelved',owner='edd64b0e2ce54cac860344420cf9c5b6',properties=ImageMetaProps,protected=<?>,size=53608448,status='active',tags=<?>,updated_at=2026-05-28T10:06:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:06:52.781466 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:06:52.783800 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-1038469455', uuid='11a2b3e7-1061-4a51-b520-113e13221658'), owner=OwnerMeta(userid='bd3def75f0dd411888f23a2f432896b0', username='tempest-AttachVolumeShelveTestJSON-1618900663-project-member', projectid='edd64b0e2ce54cac860344420cf9c5b6', projectname='tempest-AttachVolumeShelveTestJSON-1618900663'), image=ImageMeta(id='3bc5584d-a882-41ca-ba19-ff52b508e44e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "address": "fa:16:3e:b5:7a:19", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd381175-d6", "ovs_interfaceid": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962812.7833977) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:06:52.788723 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:06:52.789460 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:06:52.791001 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:06:52.791250 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:06:52.792478 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:06:52.792821 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b5850f1ea8d09d3419434abc7100bb4e',container_format='bare',created_at=2026-05-28T10:06:26Z,direct_url=<?>,disk_format='qcow2',id=3bc5584d-a882-41ca-ba19-ff52b508e44e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1038469455-shelved',owner='edd64b0e2ce54cac860344420cf9c5b6',properties=ImageMetaProps,protected=<?>,size=53608448,status='active',tags=<?>,updated_at=2026-05-28T10:06:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:06:52.792974 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:06:52.793110 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:06:52.793284 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:06:52.793390 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:06:52.793504 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:06:52.793675 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:06:52.793855 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:06:52.793955 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:06:52.794292 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:06:52.794965 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:06:52.795108 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:06:52.795536 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:06:52.795904 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lazy-loading 'vcpu_model' on Instance uuid 11a2b3e7-1061-4a51-b520-113e13221658 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:06:52.797908 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:06:52.798538 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:06:53.035159 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:06:53.301304 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Object Instance<11a2b3e7-1061-4a51-b520-113e13221658> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:06:53.313380 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T10:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1038469455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumeshelvetestjson-server-1038469455',id=42,image_ref='3bc5584d-a882-41ca-ba19-ff52b508e44e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1521685008',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:05:45Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='edd64b0e2ce54cac860344420cf9c5b6',ramdisk_id='',reservation_id='r-oq6jrgqc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1618900663',owner_user_name='tempest-AttachVolumeShelveTestJSON-1618900663-project-member',shelved_at='2026-05-28T10:06:33.534257',shelved_host='np0000001613',shelved_image_id='3bc5584d-a882-41ca-ba19-ff52b508e44e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:06:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd3def75f0dd411888f23a2f432896b0',uuid=11a2b3e7-1061-4a51-b520-113e13221658,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "address": "fa:16:3e:b5:7a:19", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd381175-d6", "ovs_interfaceid": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:06:53.313670 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Converting VIF {"id": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "address": "fa:16:3e:b5:7a:19", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd381175-d6", "ovs_interfaceid": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:06:53.314210 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:7a:19,bridge_name='br-int',has_traffic_filtering=True,id=fd381175-d629-4ae4-b6a9-860af0c0aebf,network=Network(d262816b-8751-4e64-8f19-7d59ddaabc41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd381175-d6') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:06:53.314984 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lazy-loading 'pci_devices' on Instance uuid 11a2b3e7-1061-4a51-b520-113e13221658 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:06:53.541631 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.341s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:53.541991 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:06:53.792254 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:06:53.820792 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Object Instance<11a2b3e7-1061-4a51-b520-113e13221658> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:06:53.822001 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] End _get_guest_xml xml=<domain type="qemu">
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:   <uuid>11a2b3e7-1061-4a51-b520-113e13221658</uuid>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:   <name>instance-0000002a</name>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1038469455</nova:name>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:06:52</nova:creationTime>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:         <nova:user uuid="bd3def75f0dd411888f23a2f432896b0">tempest-AttachVolumeShelveTestJSON-1618900663-project-member</nova:user>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:         <nova:project uuid="edd64b0e2ce54cac860344420cf9c5b6">tempest-AttachVolumeShelveTestJSON-1618900663</nova:project>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:         <nova:port uuid="fd381175-d629-4ae4-b6a9-860af0c0aebf">
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:     <system>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:       <entry name="serial">11a2b3e7-1061-4a51-b520-113e13221658</entry>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:       <entry name="uuid">11a2b3e7-1061-4a51-b520-113e13221658</entry>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:     </system>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:   <os>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:   </os>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:   <features>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:   </features>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:   <devices>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658/disk"/>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:     </disk>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658/disk.config"/>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:     </disk>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:b5:7a:19"/>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:       <target dev="tapfd381175-d6"/>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:     </interface>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658/console.log" append="off"/>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:     </serial>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:     <video>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:     </video>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:     </rng>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:   </devices>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]: </domain>
May 28 10:06:53.822001 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:06:53.824567 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Preparing to wait for external event network-vif-plugged-fd381175-d629-4ae4-b6a9-860af0c0aebf {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:06:53.824567 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "11a2b3e7-1061-4a51-b520-113e13221658-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:53.824567 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "11a2b3e7-1061-4a51-b520-113e13221658-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:53.824567 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "11a2b3e7-1061-4a51-b520-113e13221658-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:53.827224 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T10:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1038469455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumeshelvetestjson-server-1038469455',id=42,image_ref='3bc5584d-a882-41ca-ba19-ff52b508e44e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1521685008',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:05:45Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='edd64b0e2ce54cac860344420cf9c5b6',ramdisk_id='',reservation_id='r-oq6jrgqc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1618900663',owner_user_name='tempest-AttachVolumeShelveTestJSON-1618900663-project-member',shelved_at='2026-05-28T10:06:33.534257',shelved_host='np0000001613',shelved_image_id='3bc5584d-a882-41ca-ba19-ff52b508e44e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:06:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd3def75f0dd411888f23a2f432896b0',uuid=11a2b3e7-1061-4a51-b520-113e13221658,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "address": "fa:16:3e:b5:7a:19", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd381175-d6", "ovs_interfaceid": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:06:53.827734 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Converting VIF {"id": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "address": "fa:16:3e:b5:7a:19", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd381175-d6", "ovs_interfaceid": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:06:53.828639 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:7a:19,bridge_name='br-int',has_traffic_filtering=True,id=fd381175-d629-4ae4-b6a9-860af0c0aebf,network=Network(d262816b-8751-4e64-8f19-7d59ddaabc41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd381175-d6') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:06:53.828904 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:7a:19,bridge_name='br-int',has_traffic_filtering=True,id=fd381175-d629-4ae4-b6a9-860af0c0aebf,network=Network(d262816b-8751-4e64-8f19-7d59ddaabc41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd381175-d6') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:06:53.829526 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:53.830035 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:06:53.830444 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:06:53.833564 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:53.833853 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '15093e86-d2ef-5332-91e5-5eb90d72240f', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:06:53.837138 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:53.837706 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:06:53.840327 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:53.840609 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd381175-d6, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:06:53.841095 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfd381175-d6, col_values=(('qos', UUID('31170344-3aad-42c4-a8d9-dd42185e2c09')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:06:53.841177 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfd381175-d6, col_values=(('external_ids', {'iface-id': 'fd381175-d629-4ae4-b6a9-860af0c0aebf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:7a:19', 'vm-uuid': '11a2b3e7-1061-4a51-b520-113e13221658'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:06:53.843536 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:53.845373 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:06:53.849349 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:53.850821 np0000001613 nova-compute[98321]: INFO os_vif [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:7a:19,bridge_name='br-int',has_traffic_filtering=True,id=fd381175-d629-4ae4-b6a9-860af0c0aebf,network=Network(d262816b-8751-4e64-8f19-7d59ddaabc41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd381175-d6')
May 28 10:06:54.049743 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:06:54.050027 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:06:54.050444 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:54.050766 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:54.139802 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd05aead48ddb43b6b4e52469338207ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92aad30ae7cf45cbb0233727a1e77316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:06:54.296573 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:54.296852 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:54.297082 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:54.297241 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Auditing locally available compute resources for np0000001613 (node: np0000001613) {{(pid=98321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 10:06:54.549240 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:06:54.646832 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:54.771275 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Successfully created port: 5724dc5f-94cc-45c9-ac48-670de0fa781f {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:06:54.787259 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0004483820002860739 future=<Future at 0x73c1f4219700 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:54.787846 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Emitting event <LifecycleEvent: 1779962799.7866616, 11fd9dae-9efe-4726-abdd-995998d1df87 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:06:54.788002 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:54.788198 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] VM Stopped (Lifecycle Event)
May 28 10:06:54.789340 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=1.2476433439996981 future=<Future at 0x73c1f4313860 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:54.789481 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=1.2474848389997533 future=<Future at 0x73c1f4313860 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:55.000345 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "4bf236ff-8072-4c54-acbe-dfe41add8500" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:55.000668 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "4bf236ff-8072-4c54-acbe-dfe41add8500" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:55.057216 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:06:55.290950 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: 11fd9dae-9efe-4726-abdd-995998d1df87] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:06:55.342656 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a9853a-2830-42b5-912d-72188187a375/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:06:55.379335 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:06:55.379537 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:06:55.379785 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] No VIF found with MAC fa:16:3e:b5:7a:19, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:06:55.381011 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Using config drive
May 28 10:06:55.427206 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Successfully updated port: 5724dc5f-94cc-45c9-ac48-670de0fa781f {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:06:55.438581 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a9853a-2830-42b5-912d-72188187a375/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:06:55.440132 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a9853a-2830-42b5-912d-72188187a375/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:06:55.493552 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4cd5f525-9642-436f-ac6f-9f8b122d8157 req-b9528943-66d9-4f51-90ee-2977ddeabf4c service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Received event network-changed-5724dc5f-94cc-45c9-ac48-670de0fa781f {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:55.494417 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4cd5f525-9642-436f-ac6f-9f8b122d8157 req-b9528943-66d9-4f51-90ee-2977ddeabf4c service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Refreshing instance network info cache due to event network-changed-5724dc5f-94cc-45c9-ac48-670de0fa781f. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:06:55.495484 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4cd5f525-9642-436f-ac6f-9f8b122d8157 req-b9528943-66d9-4f51-90ee-2977ddeabf4c service nova] Acquiring lock "refresh_cache-742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:06:55.495484 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4cd5f525-9642-436f-ac6f-9f8b122d8157 req-b9528943-66d9-4f51-90ee-2977ddeabf4c service nova] Acquired lock "refresh_cache-742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:06:55.495484 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-4cd5f525-9642-436f-ac6f-9f8b122d8157 req-b9528943-66d9-4f51-90ee-2977ddeabf4c service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Refreshing network info cache for port 5724dc5f-94cc-45c9-ac48-670de0fa781f {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:06:55.514251 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:06:55.556187 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90a9853a-2830-42b5-912d-72188187a375/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:06:55.560804 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:06:55.582825 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Booting with volume ec1e6963-9189-4750-a397-d2bc2ab54efc at /dev/vda
May 28 10:06:55.659534 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:06:55.677280 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:06:55.678225 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:06:55.704821 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:06:55.734287 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:06:55.786495 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:06:55.787570 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:06:55.794353 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:06:55.795544 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Periodic task is updating the host stat, it is trying to get disk instance-0000002a, but disk file was removed by concurrent operations such as resize.: FileNotFoundError: [Errno 2] No such file or directory: '/opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658/disk.config'
May 28 10:06:55.797559 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:06:55.800243 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fec4:581f', 'fe80::ec4e:cbff:fea7:f945', 'fe80::fc16:3eff:fe59:15c3', 'fe80::e02b:1cff:fec7:1a41'] 
May 28 10:06:55.800243 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:06:55.800243 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:06:55.800243 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:06:55.800243 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Updating existing volume attachment record: 32746a98-ea2a-4b1c-9c2a-72e8b88e727a {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:06:55.804488 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f83a1a-f61c-49bd-ac96-eefd2e3de22c/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:06:55.886750 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lazy-loading 'ec2_ids' on Instance uuid 11a2b3e7-1061-4a51-b520-113e13221658 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:06:55.907918 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f83a1a-f61c-49bd-ac96-eefd2e3de22c/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:06:55.908482 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f83a1a-f61c-49bd-ac96-eefd2e3de22c/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:06:55.949509 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Acquiring lock "refresh_cache-742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:06:55.997670 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-4cd5f525-9642-436f-ac6f-9f8b122d8157 req-b9528943-66d9-4f51-90ee-2977ddeabf4c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:56.008812 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f83a1a-f61c-49bd-ac96-eefd2e3de22c/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:06:56.019137 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:06:56.020173 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:06:56.051657 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.014612969000154408 future=<Future at 0x73c1f4313860 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:56.051804 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:06:56.056942 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Emitting event <LifecycleEvent: 1779962801.0368927, 86c73e57-3c63-4ccf-bff1-9529b5a1c837 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:06:56.057496 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] VM Stopped (Lifecycle Event)
May 28 10:06:56.067476 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "env LANG=C uptime" returned: 0 in 0.047s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:06:56.067851 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Hypervisor/Node resource view: name=np0000001613 free_ram=12872MB free_disk=73.8294677734375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 10:06:56.068048 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:56.069582 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:56.122087 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:56.127924 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-4cd5f525-9642-436f-ac6f-9f8b122d8157 req-b9528943-66d9-4f51-90ee-2977ddeabf4c service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:06:56.280867 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-4cd5f525-9642-436f-ac6f-9f8b122d8157 req-b9528943-66d9-4f51-90ee-2977ddeabf4c service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:06:56.396999 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Object Instance<11a2b3e7-1061-4a51-b520-113e13221658> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:06:56.397324 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lazy-loading 'keypairs' on Instance uuid 11a2b3e7-1061-4a51-b520-113e13221658 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:06:56.563782 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: 86c73e57-3c63-4ccf-bff1-9529b5a1c837] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:06:56.783719 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4cd5f525-9642-436f-ac6f-9f8b122d8157 req-b9528943-66d9-4f51-90ee-2977ddeabf4c service nova] Releasing lock "refresh_cache-742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:06:56.784308 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Acquired lock "refresh_cache-742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:06:56.784525 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:06:56.910839 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Object Instance<11a2b3e7-1061-4a51-b520-113e13221658> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:06:56.913602 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:57.057377 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Creating config drive at /opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658/disk.config
May 28 10:06:57.061817 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp64q5owmw {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:06:57.136075 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp64q5owmw" returned: 0 in 0.074s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:06:57.146498 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 94f83a1a-f61c-49bd-ac96-eefd2e3de22c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:06:57.146808 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 90a9853a-2830-42b5-912d-72188187a375 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:06:57.146996 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 11a2b3e7-1061-4a51-b520-113e13221658 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:06:57.147175 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:06:57.361353 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:06:57.616914 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:06:57.651386 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 4bf236ff-8072-4c54-acbe-dfe41add8500 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 28 10:06:57.651623 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 10:06:57.651806 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Final resource view: name=np0000001613 phys_ram=24030MB used_ram=1280MB phys_disk=95GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 10:06:56 up 39 min,  2 users,  load average: 8.24, 7.95, 4.77\n', 'num_instances': '4', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '4', 'num_proj_c7563a83d33d4bc1a6610ccf53c18dc1': '1', 'io_workload': '1', 'num_proj_6f2d040c323b4b948803334de7c8ec44': '1', 'num_vm_building': '1', 'num_task_block_device_mapping': '1', 'num_proj_92aad30ae7cf45cbb0233727a1e77316': '1', 'num_vm_shelved_offloaded': '1', 'num_task_spawning': '1', 'num_proj_edd64b0e2ce54cac860344420cf9c5b6': '1'} {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 10:06:57.679443 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:57.717620 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:57.857976 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:57.929375 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Updating instance_info_cache with network_info: [{"id": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "address": "fa:16:3e:b6:e0:3d", "network": {"id": "5264d7e4-aeaa-4172-8f4e-f2845bb783e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1746959726-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92aad30ae7cf45cbb0233727a1e77316", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5724dc5f-94", "ovs_interfaceid": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:06:57.948174 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:06:57.951213 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:06:57.951333 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Creating image(s)
May 28 10:06:57.951865 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Did not create local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 10:06:57.952049 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Ensure instance console log exists: /opt/stack/data/nova/instances/742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:06:57.952452 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:57.952628 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:57.952985 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:58.044212 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b7c73483-d579-4a87-9099-fe0704b898a3 req-80ef7e5e-e23e-422f-8fd8-e87f0ab6c731 service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Received event network-vif-plugged-fd381175-d629-4ae4-b6a9-860af0c0aebf {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:06:58.044477 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b7c73483-d579-4a87-9099-fe0704b898a3 req-80ef7e5e-e23e-422f-8fd8-e87f0ab6c731 service nova] Acquiring lock "11a2b3e7-1061-4a51-b520-113e13221658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:06:58.045202 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b7c73483-d579-4a87-9099-fe0704b898a3 req-80ef7e5e-e23e-422f-8fd8-e87f0ab6c731 service nova] Lock "11a2b3e7-1061-4a51-b520-113e13221658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:58.045202 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b7c73483-d579-4a87-9099-fe0704b898a3 req-80ef7e5e-e23e-422f-8fd8-e87f0ab6c731 service nova] Lock "11a2b3e7-1061-4a51-b520-113e13221658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:58.045202 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b7c73483-d579-4a87-9099-fe0704b898a3 req-80ef7e5e-e23e-422f-8fd8-e87f0ab6c731 service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Processing event network-vif-plugged-fd381175-d629-4ae4-b6a9-860af0c0aebf {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:06:58.107725 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:06:58.107938 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:06:58.172333 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:58.175697 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:58.179751 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:58.181341 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:58.209280 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:58.444130 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Releasing lock "refresh_cache-742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:06:58.444323 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Instance network_info: |[{"id": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "address": "fa:16:3e:b6:e0:3d", "network": {"id": "5264d7e4-aeaa-4172-8f4e-f2845bb783e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1746959726-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92aad30ae7cf45cbb0233727a1e77316", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5724dc5f-94", "ovs_interfaceid": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:06:58.445212 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Start _get_guest_xml network_info=[{"id": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "address": "fa:16:3e:b6:e0:3d", "network": {"id": "5264d7e4-aeaa-4172-8f4e-f2845bb783e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1746959726-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92aad30ae7cf45cbb0233727a1e77316", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5724dc5f-94", "ovs_interfaceid": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc', 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ec1e6963-9189-4750-a397-d2bc2ab54efc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f', 'attached_at': '', 'detached_at': '', 'volume_id': 'ec1e6963-9189-4750-a397-d2bc2ab54efc', 'serial': 'ec1e6963-9189-4750-a397-d2bc2ab54efc'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '32746a98-ea2a-4b1c-9c2a-72e8b88e727a', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:06:58.449010 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:06:58.450519 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestShelveInstance-server-969313737', uuid='742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f'), owner=OwnerMeta(userid='d05aead48ddb43b6b4e52469338207ae', username='tempest-TestShelveInstance-793753334-project-member', projectid='92aad30ae7cf45cbb0233727a1e77316', projectname='tempest-TestShelveInstance-793753334'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "address": "fa:16:3e:b6:e0:3d", "network": {"id": "5264d7e4-aeaa-4172-8f4e-f2845bb783e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1746959726-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92aad30ae7cf45cbb0233727a1e77316", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5724dc5f-94", "ovs_interfaceid": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962818.4500232) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:06:58.452224 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:06:58.452641 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:06:58.454956 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:06:58.455228 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:06:58.456409 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:06:58.456758 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:06:58.456894 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:06:58.457002 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:06:58.457112 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:06:58.457205 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:06:58.457303 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:06:58.457441 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:06:58.457528 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:06:58.457634 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:06:58.457813 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:06:58.457979 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:06:58.468102 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:06:58.468511 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc', 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ec1e6963-9189-4750-a397-d2bc2ab54efc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:06:58.468726 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:06:58.469084 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:06:58.469296 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc', 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ec1e6963-9189-4750-a397-d2bc2ab54efc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:06:58.487617 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:06:58.488515 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:06:58.489213 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:06:58.489500 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:06:58.490081 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:06:58.490584 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:06:58.510190 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:06:58.510190 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:58.521546 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:06:58.521546 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:58.529434 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc] added
May 28 10:06:58.529434 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:06:58.529434 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:06:58.529434 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:06:58.529434 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:06:58.529434 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:06:58.529434 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:58.529759 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:06:58.532210 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0406(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:06:58.532210 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:06:58.543357 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc] added
May 28 10:06:58.543357 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:06:58.543357 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:06:58.543357 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:06:58.543357 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:06:58.543357 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:06:58.543357 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:58.543702 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:06:58.543861 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0535(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:06:58.544064 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:06:58.611380 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:06:58.752774 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:06:58.753332 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962818.7529182, 11a2b3e7-1061-4a51-b520-113e13221658 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:06:58.753510 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] VM Started (Lifecycle Event)
May 28 10:06:58.756153 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:06:58.762273 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Instance spawned successfully.
May 28 10:06:58.842353 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:59.134382 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Compute_service record updated for np0000001613:np0000001613 {{(pid=98321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 10:06:59.134591 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.066s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:06:59.135040 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.013s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:06:59.135377 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:06:59.138452 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:06:59.138587 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Claim successful on node np0000001613
May 28 10:06:59.258910 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:06:59.261285 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:06:59.323826 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:06:59.530773 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:06:59.544540 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:06:59.550969 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:06:59.550969 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:06:59.561659 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:06:59.561659 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:59.570605 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:59.583144 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:59.588489 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cd2f57e-0bb5-4aad-8478-b9ab6c2d46bb (non-flash)
May 28 10:06:59.588489 np0000001613 nova-compute[98321]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfe09876-247f-4318-8f11-817482a3c005 (non-flash)
May 28 10:06:59.588489 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:06:59.588663 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cd2f57e-0bb5-4aad-8478-b9ab6c2d46bb (non-flash)
May 28 10:06:59.588663 np0000001613 nova-compute[98321]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfe09876-247f-4318-8f11-817482a3c005 (non-flash)
May 28 10:06:59.588663 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:06:59.604011 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cd2f57e-0bb5-4aad-8478-b9ab6c2d46bb (non-flash)
May 28 10:06:59.604011 np0000001613 nova-compute[98321]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfe09876-247f-4318-8f11-817482a3c005 (non-flash)
May 28 10:06:59.604011 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:06:59.604951 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cd2f57e-0bb5-4aad-8478-b9ab6c2d46bb (non-flash)
May 28 10:06:59.604951 np0000001613 nova-compute[98321]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfe09876-247f-4318-8f11-817482a3c005 (non-flash)
May 28 10:06:59.604951 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:06:59.643253 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc, portal: 192.168.40.100,3260]
May 28 10:06:59.643253 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc, portal: 192.168.40.100,3260] successful.
May 28 10:06:59.643253 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:59.657314 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:06:59.658484 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:06:59.672099 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cd2f57e-0bb5-4aad-8478-b9ab6c2d46bb (non-flash)
May 28 10:06:59.672099 np0000001613 nova-compute[98321]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfe09876-247f-4318-8f11-817482a3c005 (non-flash)
May 28 10:06:59.672099 np0000001613 nova-compute[98321]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:06:59.672099 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:06:59.672701 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cd2f57e-0bb5-4aad-8478-b9ab6c2d46bb (non-flash)
May 28 10:06:59.672701 np0000001613 nova-compute[98321]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfe09876-247f-4318-8f11-817482a3c005 (non-flash)
May 28 10:06:59.672701 np0000001613 nova-compute[98321]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:06:59.672701 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:06:59.674469 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.183s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:06:59.674469 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:06:59.674469 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] HCTL ('9', '-', '-', 0) found on session 106 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:06:59.674469 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:06:59.694352 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Searching for a device in session 106 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:06:59.694352 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ec1e6963-9189-4750-a397-d2bc2ab54efc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:06:59.779282 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:06:59.779282 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962819.7783337, 11a2b3e7-1061-4a51-b520-113e13221658 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:06:59.779282 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] VM Paused (Lifecycle Event)
May 28 10:06:59.845336 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e478526c-36fb-4ead-91b0-5c4375f6251b tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "11a2b3e7-1061-4a51-b520-113e13221658" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 17.601s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:00.135921 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4ba13e5e-1842-496b-8e68-13add3313ad2 req-cc35d136-c409-43f8-a9f0-f7a265caac3a service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Received event network-vif-plugged-fd381175-d629-4ae4-b6a9-860af0c0aebf {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:07:00.137219 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:07:00.137430 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4ba13e5e-1842-496b-8e68-13add3313ad2 req-cc35d136-c409-43f8-a9f0-f7a265caac3a service nova] Acquiring lock "11a2b3e7-1061-4a51-b520-113e13221658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:00.138235 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:07:00.138531 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4ba13e5e-1842-496b-8e68-13add3313ad2 req-cc35d136-c409-43f8-a9f0-f7a265caac3a service nova] Lock "11a2b3e7-1061-4a51-b520-113e13221658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:00.138884 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:07:00.139117 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4ba13e5e-1842-496b-8e68-13add3313ad2 req-cc35d136-c409-43f8-a9f0-f7a265caac3a service nova] Lock "11a2b3e7-1061-4a51-b520-113e13221658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:00.139338 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4ba13e5e-1842-496b-8e68-13add3313ad2 req-cc35d136-c409-43f8-a9f0-f7a265caac3a service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] No waiting events found dispatching network-vif-plugged-fd381175-d629-4ae4-b6a9-860af0c0aebf {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:07:00.139559 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-4ba13e5e-1842-496b-8e68-13add3313ad2 req-cc35d136-c409-43f8-a9f0-f7a265caac3a service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Received unexpected event network-vif-plugged-fd381175-d629-4ae4-b6a9-860af0c0aebf for instance with vm_state active and task_state None.
May 28 10:07:00.140051 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:07:00.140314 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 10:07:00.140570 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.65 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:07:00.282122 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:07:00.289813 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962820.2893472, 11a2b3e7-1061-4a51-b520-113e13221658 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:07:00.289956 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] VM Resumed (Lifecycle Event)
May 28 10:07:00.512813 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:07:00.513235 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:07:00.654310 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc, portal: 192.168.50.100,3260]
May 28 10:07:00.654310 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc, portal: 192.168.50.100,3260] successful.
May 28 10:07:00.654310 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:00.665645 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:00.684388 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cd2f57e-0bb5-4aad-8478-b9ab6c2d46bb (non-flash)
May 28 10:07:00.684388 np0000001613 nova-compute[98321]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfe09876-247f-4318-8f11-817482a3c005 (non-flash)
May 28 10:07:00.684388 np0000001613 nova-compute[98321]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:00.684388 np0000001613 nova-compute[98321]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:00.684388 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:07:00.684579 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cd2f57e-0bb5-4aad-8478-b9ab6c2d46bb (non-flash)
May 28 10:07:00.684579 np0000001613 nova-compute[98321]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfe09876-247f-4318-8f11-817482a3c005 (non-flash)
May 28 10:07:00.684579 np0000001613 nova-compute[98321]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:00.684579 np0000001613 nova-compute[98321]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:00.684579 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:07:00.684832 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.196s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:07:00.684971 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:07:00.685744 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] HCTL ('10', '-', '-', 0) found on session 107 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:07:00.685899 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:07:00.707146 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Searching for a device in session 107 and hctl ['10', '*', '*', 0] yield: None {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:07:00.791930 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:07:00.792792 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:07:00.793713 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 52.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:07:00.798750 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:07:01.018248 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:07:01.525612 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.391s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:01.526099 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:07:01.707924 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Searching for a device in session 107 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:07:01.708254 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ec1e6963-9189-4750-a397-d2bc2ab54efc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:07:02.036559 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:07:02.037086 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:07:02.037613 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:07:02.041773 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:07:02.159432 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec58233d3b2848bbb2e0b00650398cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e9651268114327a9cc6c6c59bef01e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:07:02.539228 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:07:02.543875 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Found WWN SStorPool_iSCSI_DISK_1034578903445799038 for multipath device dm-0 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:07:02.544132 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.075s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:07:02.544322 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] <== connect_volume: return (4075ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799038', 'path': '/dev/dm-0', 'multipath_id': 'SStorPool_iSCSI_DISK_1034578903445799038'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:07:02.544443 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799038', 'path': '/dev/dm-0', 'multipath_id': 'SStorPool_iSCSI_DISK_1034578903445799038'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:07:02.713247 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Successfully created port: 190dc367-d313-445f-b96c-4a9cbc6116bd {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:07:03.044424 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:07:03.052350 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:06:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-969313737',display_name='tempest-TestShelveInstance-server-969313737',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testshelveinstance-server-969313737',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMc5vWcPj8o1zbNh8BWbgPG9pn6dL+GHSCWT99UnDlhu/5IpqN2TRKtEuk4+HsJOYf9KLTLz6y4Wh5WSsvPh4I6FKx2iXP7xTr8JCS9CqOW5AvvlIE1O/+p2kUreJErTw==',key_name='tempest-TestShelveInstance-444905061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92aad30ae7cf45cbb0233727a1e77316',ramdisk_id='',reservation_id='r-nvd0lh0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-793753334',owner_user_name='tempest-TestShelveInstance-793753334-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:06:55Z,user_data=None,user_id='d05aead48ddb43b6b4e52469338207ae',uuid=742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "address": "fa:16:3e:b6:e0:3d", "network": {"id": "5264d7e4-aeaa-4172-8f4e-f2845bb783e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1746959726-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92aad30ae7cf45cbb0233727a1e77316", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5724dc5f-94", "ovs_interfaceid": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:07:03.052350 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Converting VIF {"id": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "address": "fa:16:3e:b6:e0:3d", "network": {"id": "5264d7e4-aeaa-4172-8f4e-f2845bb783e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1746959726-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92aad30ae7cf45cbb0233727a1e77316", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5724dc5f-94", "ovs_interfaceid": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:07:03.052350 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:e0:3d,bridge_name='br-int',has_traffic_filtering=True,id=5724dc5f-94cc-45c9-ac48-670de0fa781f,network=Network(5264d7e4-aeaa-4172-8f4e-f2845bb783e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5724dc5f-94') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:07:03.052715 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lazy-loading 'pci_devices' on Instance uuid 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:07:03.354505 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Successfully updated port: 190dc367-d313-445f-b96c-4a9cbc6116bd {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:07:03.424422 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-fe7fb5c7-8376-4754-9843-fe5aa0d48cae req-f00f6428-9674-4876-a495-f236b1c84c40 service nova] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Received event network-changed-190dc367-d313-445f-b96c-4a9cbc6116bd {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:07:03.428748 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-fe7fb5c7-8376-4754-9843-fe5aa0d48cae req-f00f6428-9674-4876-a495-f236b1c84c40 service nova] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Refreshing instance network info cache due to event network-changed-190dc367-d313-445f-b96c-4a9cbc6116bd. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:07:03.428975 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-fe7fb5c7-8376-4754-9843-fe5aa0d48cae req-f00f6428-9674-4876-a495-f236b1c84c40 service nova] Acquiring lock "refresh_cache-4bf236ff-8072-4c54-acbe-dfe41add8500" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:07:03.429103 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-fe7fb5c7-8376-4754-9843-fe5aa0d48cae req-f00f6428-9674-4876-a495-f236b1c84c40 service nova] Acquired lock "refresh_cache-4bf236ff-8072-4c54-acbe-dfe41add8500" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:07:03.429278 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-fe7fb5c7-8376-4754-9843-fe5aa0d48cae req-f00f6428-9674-4876-a495-f236b1c84c40 service nova] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Refreshing network info cache for port 190dc367-d313-445f-b96c-4a9cbc6116bd {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:07:03.550476 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Booting with volume 12f2ea6f-7391-4cba-87bc-b6d1e7d9028b at /dev/vda
May 28 10:07:03.559633 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] End _get_guest_xml xml=<domain type="qemu">
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:   <uuid>742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f</uuid>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:   <name>instance-0000002f</name>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:       <nova:name>tempest-TestShelveInstance-server-969313737</nova:name>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:06:58</nova:creationTime>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:       <nova:image uuid="">
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:         <nova:user uuid="d05aead48ddb43b6b4e52469338207ae">tempest-TestShelveInstance-793753334-project-member</nova:user>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:         <nova:project uuid="92aad30ae7cf45cbb0233727a1e77316">tempest-TestShelveInstance-793753334</nova:project>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:       <nova:root type="volume" uuid=""/>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:         <nova:port uuid="5724dc5f-94cc-45c9-ac48-670de0fa781f">
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:     <system>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:       <entry name="serial">742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f</entry>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:       <entry name="uuid">742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f</entry>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:     </system>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:   <os>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:   </os>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:   <features>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:   </features>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:   <devices>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f/disk.config"/>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:     </disk>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:       <alias name="ua-ec1e6963-9189-4750-a397-d2bc2ab54efc"/>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-0"/>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:       <serial>ec1e6963-9189-4750-a397-d2bc2ab54efc</serial>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:     </disk>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:b6:e0:3d"/>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:       <target dev="tap5724dc5f-94"/>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:     </interface>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f/console.log" append="off"/>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:     </serial>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:     <video>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:     </video>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:     </rng>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:   </devices>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]: </domain>
May 28 10:07:03.559633 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:07:03.563757 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Preparing to wait for external event network-vif-plugged-5724dc5f-94cc-45c9-ac48-670de0fa781f {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:07:03.569530 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Acquiring lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:03.569530 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:03.569530 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:03.569530 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:06:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-969313737',display_name='tempest-TestShelveInstance-server-969313737',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testshelveinstance-server-969313737',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMc5vWcPj8o1zbNh8BWbgPG9pn6dL+GHSCWT99UnDlhu/5IpqN2TRKtEuk4+HsJOYf9KLTLz6y4Wh5WSsvPh4I6FKx2iXP7xTr8JCS9CqOW5AvvlIE1O/+p2kUreJErTw==',key_name='tempest-TestShelveInstance-444905061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92aad30ae7cf45cbb0233727a1e77316',ramdisk_id='',reservation_id='r-nvd0lh0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-793753334',owner_user_name='tempest-TestShelveInstance-793753334-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:06:55Z,user_data=None,user_id='d05aead48ddb43b6b4e52469338207ae',uuid=742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "address": "fa:16:3e:b6:e0:3d", "network": {"id": "5264d7e4-aeaa-4172-8f4e-f2845bb783e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1746959726-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92aad30ae7cf45cbb0233727a1e77316", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5724dc5f-94", "ovs_interfaceid": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:07:03.572435 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Converting VIF {"id": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "address": "fa:16:3e:b6:e0:3d", "network": {"id": "5264d7e4-aeaa-4172-8f4e-f2845bb783e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1746959726-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92aad30ae7cf45cbb0233727a1e77316", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5724dc5f-94", "ovs_interfaceid": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:07:03.572435 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:e0:3d,bridge_name='br-int',has_traffic_filtering=True,id=5724dc5f-94cc-45c9-ac48-670de0fa781f,network=Network(5264d7e4-aeaa-4172-8f4e-f2845bb783e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5724dc5f-94') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:07:03.572435 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:e0:3d,bridge_name='br-int',has_traffic_filtering=True,id=5724dc5f-94cc-45c9-ac48-670de0fa781f,network=Network(5264d7e4-aeaa-4172-8f4e-f2845bb783e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5724dc5f-94') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:07:03.572435 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:03.573094 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:07:03.573312 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:07:03.574193 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:03.574345 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '914ebac9-254f-592f-87aa-00dc9eb5fc61', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:07:03.575624 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:03.576321 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:07:03.576532 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:03.579653 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:03.579653 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5724dc5f-94, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:07:03.579955 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5724dc5f-94, col_values=(('qos', UUID('e062f69a-726b-470b-af3d-2b22f5f8542b')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:07:03.580058 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5724dc5f-94, col_values=(('external_ids', {'iface-id': '5724dc5f-94cc-45c9-ac48-670de0fa781f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:e0:3d', 'vm-uuid': '742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:07:03.580745 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:03.581822 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:07:03.586890 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:03.588809 np0000001613 nova-compute[98321]: INFO os_vif [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:e0:3d,bridge_name='br-int',has_traffic_filtering=True,id=5724dc5f-94cc-45c9-ac48-670de0fa781f,network=Network(5264d7e4-aeaa-4172-8f4e-f2845bb783e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5724dc5f-94')
May 28 10:07:03.593844 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:07:03.604177 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:07:03.631124 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:07:03.680945 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:07:03.681233 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:07:03.691049 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:07:03.692103 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fec4:581f', 'fe80::ec4e:cbff:fea7:f945', 'fe80::fc16:3eff:fe59:15c3', 'fe80::e02b:1cff:fec7:1a41', 'fe80::fc16:3eff:feb5:7a19', 'fe80::d42a:61ff:fe18:5003'] 
May 28 10:07:03.693977 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:07:03.694096 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:07:03.694398 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] <== get_connector_properties: return (101ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:07:03.694588 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Updating existing volume attachment record: 6dd1a262-d5e2-470d-8db4-4d4cfa39d6c0 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:07:03.858512 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "refresh_cache-4bf236ff-8072-4c54-acbe-dfe41add8500" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:07:03.936384 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-fe7fb5c7-8376-4754-9843-fe5aa0d48cae req-f00f6428-9674-4876-a495-f236b1c84c40 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:07:04.039713 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-fe7fb5c7-8376-4754-9843-fe5aa0d48cae req-f00f6428-9674-4876-a495-f236b1c84c40 service nova] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:07:04.252562 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-fe7fb5c7-8376-4754-9843-fe5aa0d48cae req-f00f6428-9674-4876-a495-f236b1c84c40 service nova] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:07:04.660379 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:04.759299 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-fe7fb5c7-8376-4754-9843-fe5aa0d48cae req-f00f6428-9674-4876-a495-f236b1c84c40 service nova] Releasing lock "refresh_cache-4bf236ff-8072-4c54-acbe-dfe41add8500" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:07:04.761999 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquired lock "refresh_cache-4bf236ff-8072-4c54-acbe-dfe41add8500" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:07:04.762484 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:07:05.113515 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:07:05.113743 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:07:05.113915 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] No VIF found with MAC fa:16:3e:b6:e0:3d, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:07:05.114416 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Using config drive
May 28 10:07:05.344698 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:07:05.540805 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:07:05.627653 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:07:05.738863 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Updating instance_info_cache with network_info: [{"id": "190dc367-d313-445f-b96c-4a9cbc6116bd", "address": "fa:16:3e:e8:37:58", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap190dc367-d3", "ovs_interfaceid": "190dc367-d313-445f-b96c-4a9cbc6116bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:07:05.807824 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Creating config drive at /opt/stack/data/nova/instances/742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f/disk.config
May 28 10:07:05.810958 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpb06ti4xz {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:07:05.831393 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:07:05.833094 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:07:05.833406 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Creating image(s)
May 28 10:07:05.833774 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Did not create local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 10:07:05.833947 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Ensure instance console log exists: /opt/stack/data/nova/instances/4bf236ff-8072-4c54-acbe-dfe41add8500/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:07:05.834360 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:05.834757 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:05.834956 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:05.861644 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpb06ti4xz" returned: 0 in 0.051s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:07:06.240512 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Releasing lock "refresh_cache-4bf236ff-8072-4c54-acbe-dfe41add8500" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:07:06.241204 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Instance network_info: |[{"id": "190dc367-d313-445f-b96c-4a9cbc6116bd", "address": "fa:16:3e:e8:37:58", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap190dc367-d3", "ovs_interfaceid": "190dc367-d313-445f-b96c-4a9cbc6116bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:07:06.242104 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Start _get_guest_xml network_info=[{"id": "190dc367-d313-445f-b96c-4a9cbc6116bd", "address": "fa:16:3e:e8:37:58", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap190dc367-d3", "ovs_interfaceid": "190dc367-d313-445f-b96c-4a9cbc6116bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b', 'iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '12f2ea6f-7391-4cba-87bc-b6d1e7d9028b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '4bf236ff-8072-4c54-acbe-dfe41add8500', 'attached_at': '', 'detached_at': '', 'volume_id': '12f2ea6f-7391-4cba-87bc-b6d1e7d9028b', 'serial': '12f2ea6f-7391-4cba-87bc-b6d1e7d9028b'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '6dd1a262-d5e2-470d-8db4-4d4cfa39d6c0', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:07:06.245809 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:07:06.247392 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-563169662', uuid='4bf236ff-8072-4c54-acbe-dfe41add8500'), owner=OwnerMeta(userid='ec58233d3b2848bbb2e0b00650398cd1', username='tempest-TestVolumeBootPattern-327944304-project-member', projectid='23e9651268114327a9cc6c6c59bef01e', projectname='tempest-TestVolumeBootPattern-327944304'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "190dc367-d313-445f-b96c-4a9cbc6116bd", "address": "fa:16:3e:e8:37:58", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap190dc367-d3", "ovs_interfaceid": "190dc367-d313-445f-b96c-4a9cbc6116bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962826.246878) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:07:06.251386 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:07:06.251855 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:07:06.253774 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:07:06.254139 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:07:06.255531 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:07:06.255987 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:07:06.256343 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:07:06.256502 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:07:06.256732 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:07:06.256862 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:07:06.257008 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:07:06.257252 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:07:06.257415 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:07:06.257584 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:07:06.257776 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:07:06.257945 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:07:06.276491 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:07:06.276973 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b', 'iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '12f2ea6f-7391-4cba-87bc-b6d1e7d9028b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:07:06.277192 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:07:06.277688 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:07:06.277994 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b', 'iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '12f2ea6f-7391-4cba-87bc-b6d1e7d9028b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:07:06.291064 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:06.296369 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:07:06.296916 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:07:06.297338 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:07:06.298634 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:07:06.298634 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:07:06.298634 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:07:06.310921 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:07:06.310921 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:06.320927 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:07:06.320927 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:06.328362 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:06.331702 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b] added
May 28 10:07:06.331702 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:07:06.331702 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:07:06.331702 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:07:06.331702 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:07:06.331702 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:07:06.331702 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:06.331880 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:07:06.333915 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0345(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:07:06.333915 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:07:06.342872 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b] added
May 28 10:07:06.342872 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:07:06.342872 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:07:06.342872 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:07:06.342872 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:07:06.342872 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:07:06.342872 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:06.343149 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:07:06.343258 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0447(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:07:06.343438 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:07:06.420608 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:06.505526 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b2a722f1-66a5-4032-8bcb-7605841729c1 req-6ad740a5-64e9-4efa-bf6c-f58db705dcae service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Received event network-vif-plugged-5724dc5f-94cc-45c9-ac48-670de0fa781f {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:07:06.505526 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b2a722f1-66a5-4032-8bcb-7605841729c1 req-6ad740a5-64e9-4efa-bf6c-f58db705dcae service nova] Acquiring lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:06.506910 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b2a722f1-66a5-4032-8bcb-7605841729c1 req-6ad740a5-64e9-4efa-bf6c-f58db705dcae service nova] Lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:06.506910 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b2a722f1-66a5-4032-8bcb-7605841729c1 req-6ad740a5-64e9-4efa-bf6c-f58db705dcae service nova] Lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:06.507020 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b2a722f1-66a5-4032-8bcb-7605841729c1 req-6ad740a5-64e9-4efa-bf6c-f58db705dcae service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Processing event network-vif-plugged-5724dc5f-94cc-45c9-ac48-670de0fa781f {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:07:06.670814 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:06.674833 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:06.699896 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:07.140331 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:07:07.140331 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962827.1374142, 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:07:07.140331 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] VM Started (Lifecycle Event)
May 28 10:07:07.145061 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:07:07.147457 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Instance spawned successfully.
May 28 10:07:07.149065 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:07:07.334193 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:07:07.344044 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:07:07.346559 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:07:07.346559 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:07:07.357636 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:07:07.357636 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:07.363800 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:07.374526 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:07.381076 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfe09876-247f-4318-8f11-817482a3c005 (non-flash)
May 28 10:07:07.381076 np0000001613 nova-compute[98321]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:07.381076 np0000001613 nova-compute[98321]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:07.381076 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:07:07.381076 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfe09876-247f-4318-8f11-817482a3c005 (non-flash)
May 28 10:07:07.381076 np0000001613 nova-compute[98321]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:07.381076 np0000001613 nova-compute[98321]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:07.381076 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:07:07.390041 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfe09876-247f-4318-8f11-817482a3c005 (non-flash)
May 28 10:07:07.390041 np0000001613 nova-compute[98321]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:07.390041 np0000001613 nova-compute[98321]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:07.390041 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:07:07.390041 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfe09876-247f-4318-8f11-817482a3c005 (non-flash)
May 28 10:07:07.390041 np0000001613 nova-compute[98321]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:07.390041 np0000001613 nova-compute[98321]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:07.390041 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:07:07.424688 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b, portal: 192.168.50.100,3260]
May 28 10:07:07.424688 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b, portal: 192.168.50.100,3260] successful.
May 28 10:07:07.424688 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:07.437960 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:07.440611 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b, portal: 192.168.40.100,3260]
May 28 10:07:07.440611 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b, portal: 192.168.40.100,3260] successful.
May 28 10:07:07.440611 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:07.455551 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfe09876-247f-4318-8f11-817482a3c005 (non-flash)
May 28 10:07:07.455551 np0000001613 nova-compute[98321]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:07.455551 np0000001613 nova-compute[98321]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:07.455551 np0000001613 nova-compute[98321]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:07.455551 np0000001613 nova-compute[98321]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:07.455551 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:07:07.455880 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfe09876-247f-4318-8f11-817482a3c005 (non-flash)
May 28 10:07:07.455880 np0000001613 nova-compute[98321]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:07.455880 np0000001613 nova-compute[98321]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:07.455880 np0000001613 nova-compute[98321]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:07.455880 np0000001613 nova-compute[98321]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:07.455880 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:07:07.456390 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:07.459929 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.159s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:07:07.459929 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:07:07.461081 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] HCTL ('7', '-', '-', 0) found on session 108 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:07:07.461210 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:07:07.472543 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfe09876-247f-4318-8f11-817482a3c005 (non-flash)
May 28 10:07:07.472543 np0000001613 nova-compute[98321]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:07.472543 np0000001613 nova-compute[98321]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:07.472543 np0000001613 nova-compute[98321]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:07.472543 np0000001613 nova-compute[98321]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:07.472543 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:07:07.472543 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfe09876-247f-4318-8f11-817482a3c005 (non-flash)
May 28 10:07:07.472543 np0000001613 nova-compute[98321]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:07.472543 np0000001613 nova-compute[98321]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:07.472543 np0000001613 nova-compute[98321]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:07.472543 np0000001613 nova-compute[98321]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:07.472543 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:07:07.473715 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.174s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:07:07.474523 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:07:07.474790 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] HCTL ('11', '-', '-', 0) found on session 109 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:07:07.474983 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:07:07.483325 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching for a device in session 108 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:07:07.483325 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '12f2ea6f-7391-4cba-87bc-b6d1e7d9028b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:07:07.496721 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching for a device in session 109 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:07:07.496721 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '12f2ea6f-7391-4cba-87bc-b6d1e7d9028b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:07:07.648997 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:07:07.660794 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:07:07.664741 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:07:07.664888 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:07:07.665405 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:07:07.665679 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:07:07.665986 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:07:07.666819 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:07:08.162464 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:07:08.162742 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962828.1625314, 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:07:08.162883 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] VM Paused (Lifecycle Event)
May 28 10:07:08.181195 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Took 10.23 seconds to spawn the instance on the hypervisor.
May 28 10:07:08.181195 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:07:08.298119 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:07:08.567965 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8b152d1e-609b-45b5-bfc1-4e8cb3316d4d req-78634af6-5650-425a-8baa-d89b69253c13 service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Received event network-vif-plugged-5724dc5f-94cc-45c9-ac48-670de0fa781f {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:07:08.568351 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8b152d1e-609b-45b5-bfc1-4e8cb3316d4d req-78634af6-5650-425a-8baa-d89b69253c13 service nova] Acquiring lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:08.568351 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8b152d1e-609b-45b5-bfc1-4e8cb3316d4d req-78634af6-5650-425a-8baa-d89b69253c13 service nova] Lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:08.568445 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8b152d1e-609b-45b5-bfc1-4e8cb3316d4d req-78634af6-5650-425a-8baa-d89b69253c13 service nova] Lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:08.568503 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8b152d1e-609b-45b5-bfc1-4e8cb3316d4d req-78634af6-5650-425a-8baa-d89b69253c13 service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] No waiting events found dispatching network-vif-plugged-5724dc5f-94cc-45c9-ac48-670de0fa781f {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:07:08.568623 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-8b152d1e-609b-45b5-bfc1-4e8cb3316d4d req-78634af6-5650-425a-8baa-d89b69253c13 service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Received unexpected event network-vif-plugged-5724dc5f-94cc-45c9-ac48-670de0fa781f for instance with vm_state active and task_state None.
May 28 10:07:08.583534 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:08.665133 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:07:08.666932 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962828.6667619, 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:07:08.667050 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] VM Resumed (Lifecycle Event)
May 28 10:07:08.690491 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Took 17.58 seconds to build instance.
May 28 10:07:09.171183 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:07:09.171183 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:07:09.192604 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.098s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:09.232265 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:07:09.315556 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Found WWN 3300000006369c836 for multipath device dm-3 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:07:09.315869 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:07:09.319187 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '3300000006369c836', 'path': '/dev/dm-3', 'multipath_id': '3300000006369c836'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:07:09.319187 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006369c836', 'path': '/dev/dm-3', 'multipath_id': '3300000006369c836'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:07:09.661692 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:09.836785 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-563169662',display_name='tempest-TestVolumeBootPattern-server-563169662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpattern-server-563169662',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDs54Ij9XFUF6tRV5b5bEDXre210mTz8/6r5idMEptiDTrfpudxGYW9wHj5Wtoi+AHTlKSnGQ+4g6kAwxCoZui4NBEucM8fxkVwkXyc1uSBWV2xxJzwDk4J6e+ozSWW2A==',key_name='tempest-keypair-556676766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23e9651268114327a9cc6c6c59bef01e',ramdisk_id='',reservation_id='r-90w7ea1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-327944304',owner_user_name='tempest-TestVolumeBootPattern-327944304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:07:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec58233d3b2848bbb2e0b00650398cd1',uuid=4bf236ff-8072-4c54-acbe-dfe41add8500,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "190dc367-d313-445f-b96c-4a9cbc6116bd", "address": "fa:16:3e:e8:37:58", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap190dc367-d3", "ovs_interfaceid": "190dc367-d313-445f-b96c-4a9cbc6116bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:07:09.836785 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converting VIF {"id": "190dc367-d313-445f-b96c-4a9cbc6116bd", "address": "fa:16:3e:e8:37:58", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap190dc367-d3", "ovs_interfaceid": "190dc367-d313-445f-b96c-4a9cbc6116bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:07:09.836785 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:37:58,bridge_name='br-int',has_traffic_filtering=True,id=190dc367-d313-445f-b96c-4a9cbc6116bd,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap190dc367-d3') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:07:09.838099 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lazy-loading 'pci_devices' on Instance uuid 4bf236ff-8072-4c54-acbe-dfe41add8500 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:07:10.353226 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] End _get_guest_xml xml=<domain type="qemu">
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:   <uuid>4bf236ff-8072-4c54-acbe-dfe41add8500</uuid>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:   <name>instance-00000030</name>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:       <nova:name>tempest-TestVolumeBootPattern-server-563169662</nova:name>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:07:06</nova:creationTime>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:       <nova:image uuid="">
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:         <nova:user uuid="ec58233d3b2848bbb2e0b00650398cd1">tempest-TestVolumeBootPattern-327944304-project-member</nova:user>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:         <nova:project uuid="23e9651268114327a9cc6c6c59bef01e">tempest-TestVolumeBootPattern-327944304</nova:project>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:       <nova:root type="volume" uuid=""/>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:         <nova:port uuid="190dc367-d313-445f-b96c-4a9cbc6116bd">
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:     <system>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:       <entry name="serial">4bf236ff-8072-4c54-acbe-dfe41add8500</entry>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:       <entry name="uuid">4bf236ff-8072-4c54-acbe-dfe41add8500</entry>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:     </system>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:   <os>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:   </os>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:   <features>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:   </features>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:   <devices>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/4bf236ff-8072-4c54-acbe-dfe41add8500/disk.config"/>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:     </disk>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:       <alias name="ua-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b"/>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-3"/>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:       <serial>12f2ea6f-7391-4cba-87bc-b6d1e7d9028b</serial>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:     </disk>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:e8:37:58"/>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:       <target dev="tap190dc367-d3"/>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:     </interface>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/4bf236ff-8072-4c54-acbe-dfe41add8500/console.log" append="off"/>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:     </serial>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:     <video>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:     </video>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:     </rng>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:   </devices>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]: </domain>
May 28 10:07:10.353226 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:07:10.354922 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Preparing to wait for external event network-vif-plugged-190dc367-d313-445f-b96c-4a9cbc6116bd {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:07:10.354922 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "4bf236ff-8072-4c54-acbe-dfe41add8500-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:10.354922 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "4bf236ff-8072-4c54-acbe-dfe41add8500-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:10.354922 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "4bf236ff-8072-4c54-acbe-dfe41add8500-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:10.354922 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-563169662',display_name='tempest-TestVolumeBootPattern-server-563169662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpattern-server-563169662',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDs54Ij9XFUF6tRV5b5bEDXre210mTz8/6r5idMEptiDTrfpudxGYW9wHj5Wtoi+AHTlKSnGQ+4g6kAwxCoZui4NBEucM8fxkVwkXyc1uSBWV2xxJzwDk4J6e+ozSWW2A==',key_name='tempest-keypair-556676766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23e9651268114327a9cc6c6c59bef01e',ramdisk_id='',reservation_id='r-90w7ea1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-327944304',owner_user_name='tempest-TestVolumeBootPattern-327944304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:07:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec58233d3b2848bbb2e0b00650398cd1',uuid=4bf236ff-8072-4c54-acbe-dfe41add8500,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "190dc367-d313-445f-b96c-4a9cbc6116bd", "address": "fa:16:3e:e8:37:58", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap190dc367-d3", "ovs_interfaceid": "190dc367-d313-445f-b96c-4a9cbc6116bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:07:10.354922 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converting VIF {"id": "190dc367-d313-445f-b96c-4a9cbc6116bd", "address": "fa:16:3e:e8:37:58", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap190dc367-d3", "ovs_interfaceid": "190dc367-d313-445f-b96c-4a9cbc6116bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:07:10.354922 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:37:58,bridge_name='br-int',has_traffic_filtering=True,id=190dc367-d313-445f-b96c-4a9cbc6116bd,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap190dc367-d3') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:07:10.355186 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:37:58,bridge_name='br-int',has_traffic_filtering=True,id=190dc367-d313-445f-b96c-4a9cbc6116bd,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap190dc367-d3') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:07:10.356440 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:10.356728 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:07:10.356924 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:07:10.357604 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:10.357799 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5c1ae06c-553f-53e8-8282-f599e255e009', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:07:10.359368 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:10.359854 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:07:10.361530 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:10.363652 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:10.363841 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap190dc367-d3, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:07:10.364176 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap190dc367-d3, col_values=(('qos', UUID('fbd84c76-427f-4801-bdb7-bb6e977a749c')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:07:10.364330 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap190dc367-d3, col_values=(('external_ids', {'iface-id': '190dc367-d313-445f-b96c-4a9cbc6116bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:37:58', 'vm-uuid': '4bf236ff-8072-4c54-acbe-dfe41add8500'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:07:10.365064 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:10.367002 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:07:10.372999 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:10.374107 np0000001613 nova-compute[98321]: INFO os_vif [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:37:58,bridge_name='br-int',has_traffic_filtering=True,id=190dc367-d313-445f-b96c-4a9cbc6116bd,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap190dc367-d3')
May 28 10:07:10.577563 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-65cf7172-db0d-46ca-9132-793fa20bfc36 req-1ac2c5bf-a373-48bd-afa1-e2880a9c0382 service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Received event network-changed-5724dc5f-94cc-45c9-ac48-670de0fa781f {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:07:10.577715 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-65cf7172-db0d-46ca-9132-793fa20bfc36 req-1ac2c5bf-a373-48bd-afa1-e2880a9c0382 service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Refreshing instance network info cache due to event network-changed-5724dc5f-94cc-45c9-ac48-670de0fa781f. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:07:10.577892 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-65cf7172-db0d-46ca-9132-793fa20bfc36 req-1ac2c5bf-a373-48bd-afa1-e2880a9c0382 service nova] Acquiring lock "refresh_cache-742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:07:10.578000 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-65cf7172-db0d-46ca-9132-793fa20bfc36 req-1ac2c5bf-a373-48bd-afa1-e2880a9c0382 service nova] Acquired lock "refresh_cache-742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:07:10.578106 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-65cf7172-db0d-46ca-9132-793fa20bfc36 req-1ac2c5bf-a373-48bd-afa1-e2880a9c0382 service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Refreshing network info cache for port 5724dc5f-94cc-45c9-ac48-670de0fa781f {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:07:11.080094 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-65cf7172-db0d-46ca-9132-793fa20bfc36 req-1ac2c5bf-a373-48bd-afa1-e2880a9c0382 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:07:11.396291 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-65cf7172-db0d-46ca-9132-793fa20bfc36 req-1ac2c5bf-a373-48bd-afa1-e2880a9c0382 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:07:11.516819 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-65cf7172-db0d-46ca-9132-793fa20bfc36 req-1ac2c5bf-a373-48bd-afa1-e2880a9c0382 service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Updated VIF entry in instance network info cache for port 5724dc5f-94cc-45c9-ac48-670de0fa781f. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:07:11.517078 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-65cf7172-db0d-46ca-9132-793fa20bfc36 req-1ac2c5bf-a373-48bd-afa1-e2880a9c0382 service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Updating instance_info_cache with network_info: [{"id": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "address": "fa:16:3e:b6:e0:3d", "network": {"id": "5264d7e4-aeaa-4172-8f4e-f2845bb783e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1746959726-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92aad30ae7cf45cbb0233727a1e77316", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5724dc5f-94", "ovs_interfaceid": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:07:11.890711 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:07:11.890857 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:07:11.890857 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] No VIF found with MAC fa:16:3e:e8:37:58, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:07:11.891220 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Using config drive
May 28 10:07:12.018967 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-65cf7172-db0d-46ca-9132-793fa20bfc36 req-1ac2c5bf-a373-48bd-afa1-e2880a9c0382 service nova] Releasing lock "refresh_cache-742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:07:12.398046 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:07:12.538637 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Creating config drive at /opt/stack/data/nova/instances/4bf236ff-8072-4c54-acbe-dfe41add8500/disk.config
May 28 10:07:12.543178 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4bf236ff-8072-4c54-acbe-dfe41add8500/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpy4rb7h_z {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:07:12.601088 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4bf236ff-8072-4c54-acbe-dfe41add8500/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpy4rb7h_z" returned: 0 in 0.057s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:07:13.025101 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:13.046735 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:13.049346 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:13.138664 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:13.226033 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cb0e03ab-a33a-48ca-beac-7d87cbba339b req-b4132503-2f7e-4196-9728-973cd80abca0 service nova] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Received event network-vif-plugged-190dc367-d313-445f-b96c-4a9cbc6116bd {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:07:13.226421 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cb0e03ab-a33a-48ca-beac-7d87cbba339b req-b4132503-2f7e-4196-9728-973cd80abca0 service nova] Acquiring lock "4bf236ff-8072-4c54-acbe-dfe41add8500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:13.227368 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cb0e03ab-a33a-48ca-beac-7d87cbba339b req-b4132503-2f7e-4196-9728-973cd80abca0 service nova] Lock "4bf236ff-8072-4c54-acbe-dfe41add8500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:13.227368 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cb0e03ab-a33a-48ca-beac-7d87cbba339b req-b4132503-2f7e-4196-9728-973cd80abca0 service nova] Lock "4bf236ff-8072-4c54-acbe-dfe41add8500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:13.227368 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cb0e03ab-a33a-48ca-beac-7d87cbba339b req-b4132503-2f7e-4196-9728-973cd80abca0 service nova] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Processing event network-vif-plugged-190dc367-d313-445f-b96c-4a9cbc6116bd {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:07:13.394755 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:13.400487 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:13.404983 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:13.405795 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:13.435750 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:13.896211 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962833.8956718, 4bf236ff-8072-4c54-acbe-dfe41add8500 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:07:13.896571 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] VM Started (Lifecycle Event)
May 28 10:07:13.898086 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:07:13.901529 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:07:13.903987 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Instance spawned successfully.
May 28 10:07:13.905662 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:07:14.400043 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:07:14.403961 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:07:14.415613 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:07:14.415807 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:07:14.416197 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:07:14.416752 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:07:14.417046 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:07:14.417319 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:07:14.634505 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "94f83a1a-f61c-49bd-ac96-eefd2e3de22c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:14.635091 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "94f83a1a-f61c-49bd-ac96-eefd2e3de22c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:14.663474 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:14.909690 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:07:14.909978 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962834.9097848, 4bf236ff-8072-4c54-acbe-dfe41add8500 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:07:14.910096 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] VM Paused (Lifecycle Event)
May 28 10:07:14.924074 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Took 9.09 seconds to spawn the instance on the hypervisor.
May 28 10:07:14.924275 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:07:15.138938 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lazy-loading 'flavor' on Instance uuid 94f83a1a-f61c-49bd-ac96-eefd2e3de22c {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:07:15.290183 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-eb9ca91f-03dd-4a5a-b869-d5639943dc21 req-13b4701c-787c-4e94-929e-6f42474c5e0e service nova] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Received event network-vif-plugged-190dc367-d313-445f-b96c-4a9cbc6116bd {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:07:15.290763 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-eb9ca91f-03dd-4a5a-b869-d5639943dc21 req-13b4701c-787c-4e94-929e-6f42474c5e0e service nova] Acquiring lock "4bf236ff-8072-4c54-acbe-dfe41add8500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:15.291051 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-eb9ca91f-03dd-4a5a-b869-d5639943dc21 req-13b4701c-787c-4e94-929e-6f42474c5e0e service nova] Lock "4bf236ff-8072-4c54-acbe-dfe41add8500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:15.291316 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-eb9ca91f-03dd-4a5a-b869-d5639943dc21 req-13b4701c-787c-4e94-929e-6f42474c5e0e service nova] Lock "4bf236ff-8072-4c54-acbe-dfe41add8500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:15.291606 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-eb9ca91f-03dd-4a5a-b869-d5639943dc21 req-13b4701c-787c-4e94-929e-6f42474c5e0e service nova] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] No waiting events found dispatching network-vif-plugged-190dc367-d313-445f-b96c-4a9cbc6116bd {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:07:15.291899 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-eb9ca91f-03dd-4a5a-b869-d5639943dc21 req-13b4701c-787c-4e94-929e-6f42474c5e0e service nova] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Received unexpected event network-vif-plugged-190dc367-d313-445f-b96c-4a9cbc6116bd for instance with vm_state active and task_state None.
May 28 10:07:15.371642 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:15.412576 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:07:15.415549 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962835.4152036, 4bf236ff-8072-4c54-acbe-dfe41add8500 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:07:15.415903 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] VM Resumed (Lifecycle Event)
May 28 10:07:15.445468 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Took 19.40 seconds to build instance.
May 28 10:07:15.919173 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:07:15.924476 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:07:15.947794 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "4bf236ff-8072-4c54-acbe-dfe41add8500" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.947s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:16.148490 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "94f83a1a-f61c-49bd-ac96-eefd2e3de22c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:16.857234 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-558c79e4-bcd4-43d2-9c1c-ed28df401a97 req-13f32576-8a67-4e9b-abbc-b2aa4931e371 service nova] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Received event network-changed-190dc367-d313-445f-b96c-4a9cbc6116bd {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:07:16.857703 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-558c79e4-bcd4-43d2-9c1c-ed28df401a97 req-13f32576-8a67-4e9b-abbc-b2aa4931e371 service nova] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Refreshing instance network info cache due to event network-changed-190dc367-d313-445f-b96c-4a9cbc6116bd. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:07:16.857703 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-558c79e4-bcd4-43d2-9c1c-ed28df401a97 req-13f32576-8a67-4e9b-abbc-b2aa4931e371 service nova] Acquiring lock "refresh_cache-4bf236ff-8072-4c54-acbe-dfe41add8500" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:07:16.857703 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-558c79e4-bcd4-43d2-9c1c-ed28df401a97 req-13f32576-8a67-4e9b-abbc-b2aa4931e371 service nova] Acquired lock "refresh_cache-4bf236ff-8072-4c54-acbe-dfe41add8500" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:07:16.857824 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-558c79e4-bcd4-43d2-9c1c-ed28df401a97 req-13f32576-8a67-4e9b-abbc-b2aa4931e371 service nova] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Refreshing network info cache for port 190dc367-d313-445f-b96c-4a9cbc6116bd {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:07:17.232395 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "94f83a1a-f61c-49bd-ac96-eefd2e3de22c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:17.232557 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "94f83a1a-f61c-49bd-ac96-eefd2e3de22c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:17.232749 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Attaching volume 0cbb5bcb-d0d8-41df-81da-d7fefa332624 to /dev/vdb
May 28 10:07:17.282380 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:07:17.295028 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:07:17.316039 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:07:17.356815 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:07:17.357201 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:07:17.361186 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-558c79e4-bcd4-43d2-9c1c-ed28df401a97 req-13f32576-8a67-4e9b-abbc-b2aa4931e371 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:07:17.367177 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:07:17.368342 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fec4:581f', 'fe80::ec4e:cbff:fea7:f945', 'fe80::fc16:3eff:fe59:15c3', 'fe80::e02b:1cff:fec7:1a41', 'fe80::fc16:3eff:feb5:7a19', 'fe80::d42a:61ff:fe18:5003', 'fe80::fc16:3eff:feb6:e03d', 'fe80::c4f8:89ff:fef6:4009', 'fe80::fc16:3eff:fee8:3758', 'fe80::e4eb:4cff:fe5c:5eb7'] 
May 28 10:07:17.368429 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:07:17.368539 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:07:17.368763 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:07:17.369744 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Updating existing volume attachment record: 00156685-7e91-4730-afd9-2803092bb516 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:07:17.719468 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-558c79e4-bcd4-43d2-9c1c-ed28df401a97 req-13f32576-8a67-4e9b-abbc-b2aa4931e371 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:07:17.867669 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-558c79e4-bcd4-43d2-9c1c-ed28df401a97 req-13f32576-8a67-4e9b-abbc-b2aa4931e371 service nova] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Updated VIF entry in instance network info cache for port 190dc367-d313-445f-b96c-4a9cbc6116bd. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:07:17.868146 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-558c79e4-bcd4-43d2-9c1c-ed28df401a97 req-13f32576-8a67-4e9b-abbc-b2aa4931e371 service nova] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Updating instance_info_cache with network_info: [{"id": "190dc367-d313-445f-b96c-4a9cbc6116bd", "address": "fa:16:3e:e8:37:58", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap190dc367-d3", "ovs_interfaceid": "190dc367-d313-445f-b96c-4a9cbc6116bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:07:17.979472 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624', 'iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0cbb5bcb-d0d8-41df-81da-d7fefa332624', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '94f83a1a-f61c-49bd-ac96-eefd2e3de22c', 'attached_at': '', 'detached_at': '', 'volume_id': '0cbb5bcb-d0d8-41df-81da-d7fefa332624', 'serial': '0cbb5bcb-d0d8-41df-81da-d7fefa332624'} {{(pid=98321) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 10:07:17.983118 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:07:17.983725 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624', 'iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0cbb5bcb-d0d8-41df-81da-d7fefa332624', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:07:17.984024 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:07:17.984707 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:07:17.985637 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624', 'iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0cbb5bcb-d0d8-41df-81da-d7fefa332624', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:07:17.996795 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:07:17.997385 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:07:17.997871 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:07:17.998382 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:07:17.998822 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:07:17.999032 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:07:18.011746 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:07:18.011746 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:18.020393 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:07:18.020393 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:18.026279 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624] added
May 28 10:07:18.026279 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:07:18.026279 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:07:18.026279 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:07:18.026279 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:07:18.026279 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:07:18.026279 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:18.026279 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:07:18.026279 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0277(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:07:18.026279 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:07:18.035036 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624] added
May 28 10:07:18.035036 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:07:18.035036 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:07:18.035036 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:07:18.035036 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:07:18.035036 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:07:18.035036 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:18.035394 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:07:18.035394 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0368(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:07:18.035550 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:07:18.370239 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-558c79e4-bcd4-43d2-9c1c-ed28df401a97 req-13f32576-8a67-4e9b-abbc-b2aa4931e371 service nova] Releasing lock "refresh_cache-4bf236ff-8072-4c54-acbe-dfe41add8500" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:07:19.026914 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:07:19.036142 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:07:19.044098 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:07:19.044098 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:07:19.052335 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:07:19.052335 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:19.059524 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:19.065661 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:19.079480 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:19.079480 np0000001613 nova-compute[98321]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:19.079480 np0000001613 nova-compute[98321]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:19.079480 np0000001613 nova-compute[98321]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:19.079480 np0000001613 nova-compute[98321]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98b0c799-2696-4e9c-a53b-aa5c1837c78b (non-flash)
May 28 10:07:19.079480 np0000001613 nova-compute[98321]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a5d2f99-7571-4663-85a0-f4502116222d (non-flash)
May 28 10:07:19.079480 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:07:19.079480 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:19.079480 np0000001613 nova-compute[98321]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:19.079480 np0000001613 nova-compute[98321]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:19.079480 np0000001613 nova-compute[98321]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:19.079480 np0000001613 nova-compute[98321]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98b0c799-2696-4e9c-a53b-aa5c1837c78b (non-flash)
May 28 10:07:19.079480 np0000001613 nova-compute[98321]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a5d2f99-7571-4663-85a0-f4502116222d (non-flash)
May 28 10:07:19.079480 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:07:19.080095 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:19.080095 np0000001613 nova-compute[98321]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:19.080095 np0000001613 nova-compute[98321]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:19.080095 np0000001613 nova-compute[98321]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:19.080095 np0000001613 nova-compute[98321]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98b0c799-2696-4e9c-a53b-aa5c1837c78b (non-flash)
May 28 10:07:19.080095 np0000001613 nova-compute[98321]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a5d2f99-7571-4663-85a0-f4502116222d (non-flash)
May 28 10:07:19.080095 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:07:19.080322 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:19.080322 np0000001613 nova-compute[98321]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:19.080322 np0000001613 nova-compute[98321]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:19.080322 np0000001613 nova-compute[98321]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:19.080322 np0000001613 nova-compute[98321]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98b0c799-2696-4e9c-a53b-aa5c1837c78b (non-flash)
May 28 10:07:19.080322 np0000001613 nova-compute[98321]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a5d2f99-7571-4663-85a0-f4502116222d (non-flash)
May 28 10:07:19.080322 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:07:19.128338 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624, portal: 192.168.40.100,3260]
May 28 10:07:19.128338 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624, portal: 192.168.40.100,3260] successful.
May 28 10:07:19.128338 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:19.139513 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624, portal: 192.168.50.100,3260]
May 28 10:07:19.139513 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624, portal: 192.168.50.100,3260] successful.
May 28 10:07:19.139513 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:19.145214 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:19.154404 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:19.169480 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:19.169480 np0000001613 nova-compute[98321]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:19.169480 np0000001613 nova-compute[98321]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:19.169480 np0000001613 nova-compute[98321]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:19.169480 np0000001613 nova-compute[98321]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98b0c799-2696-4e9c-a53b-aa5c1837c78b (non-flash)
May 28 10:07:19.169480 np0000001613 nova-compute[98321]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a5d2f99-7571-4663-85a0-f4502116222d (non-flash)
May 28 10:07:19.169480 np0000001613 nova-compute[98321]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624 (non-flash)
May 28 10:07:19.169480 np0000001613 nova-compute[98321]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624 (non-flash)
May 28 10:07:19.169480 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:07:19.169805 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:19.169805 np0000001613 nova-compute[98321]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:19.169805 np0000001613 nova-compute[98321]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:19.169805 np0000001613 nova-compute[98321]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:19.169805 np0000001613 nova-compute[98321]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98b0c799-2696-4e9c-a53b-aa5c1837c78b (non-flash)
May 28 10:07:19.169805 np0000001613 nova-compute[98321]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a5d2f99-7571-4663-85a0-f4502116222d (non-flash)
May 28 10:07:19.169805 np0000001613 nova-compute[98321]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624 (non-flash)
May 28 10:07:19.169805 np0000001613 nova-compute[98321]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624 (non-flash)
May 28 10:07:19.169805 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:07:19.170355 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.172s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:07:19.170494 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:07:19.171995 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] HCTL ('13', '-', '-', 0) found on session 112 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:07:19.172222 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:07:19.181004 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:19.181004 np0000001613 nova-compute[98321]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:19.181004 np0000001613 nova-compute[98321]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:19.181004 np0000001613 nova-compute[98321]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:19.181004 np0000001613 nova-compute[98321]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98b0c799-2696-4e9c-a53b-aa5c1837c78b (non-flash)
May 28 10:07:19.181004 np0000001613 nova-compute[98321]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a5d2f99-7571-4663-85a0-f4502116222d (non-flash)
May 28 10:07:19.181004 np0000001613 nova-compute[98321]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624 (non-flash)
May 28 10:07:19.181004 np0000001613 nova-compute[98321]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624 (non-flash)
May 28 10:07:19.181004 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:07:19.181340 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:19.181340 np0000001613 nova-compute[98321]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:19.181340 np0000001613 nova-compute[98321]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:19.181340 np0000001613 nova-compute[98321]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:19.181340 np0000001613 nova-compute[98321]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-98b0c799-2696-4e9c-a53b-aa5c1837c78b (non-flash)
May 28 10:07:19.181340 np0000001613 nova-compute[98321]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a5d2f99-7571-4663-85a0-f4502116222d (non-flash)
May 28 10:07:19.181340 np0000001613 nova-compute[98321]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624 (non-flash)
May 28 10:07:19.181340 np0000001613 nova-compute[98321]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624 (non-flash)
May 28 10:07:19.181340 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:07:19.181584 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.183s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:07:19.181750 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:07:19.182698 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] HCTL ('14', '-', '-', 0) found on session 113 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:07:19.182874 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:07:19.195028 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Searching for a device in session 112 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:07:19.195298 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0cbb5bcb-d0d8-41df-81da-d7fefa332624', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:07:19.214578 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Searching for a device in session 113 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:07:19.214578 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0cbb5bcb-d0d8-41df-81da-d7fefa332624', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:07:19.666346 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:19.998621 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:07:20.375007 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:21.015729 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Found WWN 330000000d6bec082 for multipath device dm-6 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:07:21.015729 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:07:21.017652 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '330000000d6bec082', 'path': '/dev/disk/by-id/os-brick+dev+dm-6', 'multipath_id': '330000000d6bec082'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:07:21.017652 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d6bec082', 'path': '/dev/disk/by-id/os-brick+dev+dm-6', 'multipath_id': '330000000d6bec082'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:07:21.019306 np0000001613 nova-compute[98321]: WARNING stevedore.named [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 10:07:21.019597 np0000001613 nova-compute[98321]: WARNING castellan.key_manager [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 10:07:21.019931 np0000001613 nova-compute[98321]: WARNING nova.keymgr.conf_key_mgr [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 10:07:21.038387 np0000001613 nova-compute[98321]: WARNING os_brick.encryptors.luks [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 28 10:07:21.038937 np0000001613 nova-compute[98321]: WARNING stevedore.named [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 10:07:21.039299 np0000001613 nova-compute[98321]: WARNING castellan.key_manager [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 10:07:21.039569 np0000001613 nova-compute[98321]: WARNING nova.keymgr.conf_key_mgr [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 10:07:21.040390 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x73c1f41fc5c0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624', 'iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0cbb5bcb-d0d8-41df-81da-d7fefa332624', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, 'status': 'reserved', 'instance': '94f83a1a-f61c-49bd-ac96-eefd2e3de22c', 'attached_at': '', 'detached_at': '', 'volume_id': '0cbb5bcb-d0d8-41df-81da-d7fefa332624', 'serial': '0cbb5bcb-d0d8-41df-81da-d7fefa332624'} {{(pid=98321) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 10:07:21.040850 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors.luks [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] formatting encrypted volume /dev/dm-6 {{(pid=98321) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 28 10:07:24.669006 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:25.320126 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 10:07:25.320126 np0000001613 nova-compute[98321]:   <usage type="volume">
May 28 10:07:25.320126 np0000001613 nova-compute[98321]:     <volume>0cbb5bcb-d0d8-41df-81da-d7fefa332624</volume>
May 28 10:07:25.320126 np0000001613 nova-compute[98321]:   </usage>
May 28 10:07:25.320126 np0000001613 nova-compute[98321]: </secret>
May 28 10:07:25.320126 np0000001613 nova-compute[98321]:  {{(pid=98321) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 10:07:25.329834 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lazy-loading 'flavor' on Instance uuid 94f83a1a-f61c-49bd-ac96-eefd2e3de22c {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:07:25.377315 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:25.835114 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Attempting to attach volume 0cbb5bcb-d0d8-41df-81da-d7fefa332624 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 10:07:25.838555 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] attach device xml: <disk type="block" device="disk">
May 28 10:07:25.838555 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:07:25.838555 np0000001613 nova-compute[98321]:   <alias name="ua-0cbb5bcb-d0d8-41df-81da-d7fefa332624"/>
May 28 10:07:25.838555 np0000001613 nova-compute[98321]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-6"/>
May 28 10:07:25.838555 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:07:25.838555 np0000001613 nova-compute[98321]:   <serial>0cbb5bcb-d0d8-41df-81da-d7fefa332624</serial>
May 28 10:07:25.838555 np0000001613 nova-compute[98321]:   <encryption format="luks">
May 28 10:07:25.838555 np0000001613 nova-compute[98321]:     <secret type="passphrase" uuid="320b18c7-0218-4975-86c7-c98459ab383b"/>
May 28 10:07:25.838555 np0000001613 nova-compute[98321]:   </encryption>
May 28 10:07:25.838555 np0000001613 nova-compute[98321]: </disk>
May 28 10:07:25.838555 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 10:07:25.994129 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "90a9853a-2830-42b5-912d-72188187a375" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:25.994358 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "90a9853a-2830-42b5-912d-72188187a375" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:26.500598 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lazy-loading 'flavor' on Instance uuid 90a9853a-2830-42b5-912d-72188187a375 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:07:27.506828 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "90a9853a-2830-42b5-912d-72188187a375" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:28.394003 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:07:28.394197 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:07:28.394197 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:07:28.394301 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] No VIF found with MAC fa:16:3e:c4:58:1f, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:07:28.575009 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "90a9853a-2830-42b5-912d-72188187a375" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:28.575349 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "90a9853a-2830-42b5-912d-72188187a375" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:28.575385 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Attaching volume 3597de89-817d-47ab-8322-def547c0175d to /dev/vdb
May 28 10:07:28.624347 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:07:28.640364 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:07:28.666687 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:07:28.710304 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:07:28.710713 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:07:28.723301 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:07:28.726756 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fec4:581f', 'fe80::ec4e:cbff:fea7:f945', 'fe80::fc16:3eff:fe59:15c3', 'fe80::e02b:1cff:fec7:1a41', 'fe80::fc16:3eff:feb5:7a19', 'fe80::d42a:61ff:fe18:5003', 'fe80::fc16:3eff:feb6:e03d', 'fe80::c4f8:89ff:fef6:4009', 'fe80::fc16:3eff:fee8:3758', 'fe80::e4eb:4cff:fe5c:5eb7'] 
May 28 10:07:28.726969 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:07:28.727218 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:07:28.727661 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] <== get_connector_properties: return (102ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:07:28.728029 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Updating existing volume attachment record: c1c04a3f-4730-4c74-932c-a4ab29b90f89 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:07:29.284547 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:07:29.284913 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d', 'iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3597de89-817d-47ab-8322-def547c0175d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:07:29.285136 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:07:29.285763 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:07:29.285968 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d', 'iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3597de89-817d-47ab-8322-def547c0175d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:07:29.296113 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:07:29.296888 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:07:29.297343 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:07:29.297546 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:07:29.298078 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:07:29.298397 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:07:29.309633 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:07:29.309633 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:29.313964 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:07:29.313964 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:29.322183 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d] added
May 28 10:07:29.322183 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:07:29.322183 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:07:29.322183 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:07:29.322183 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:07:29.322183 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:07:29.322183 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:29.322183 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:07:29.322183 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0227(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:07:29.322183 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:07:29.327030 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d] added
May 28 10:07:29.327030 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:07:29.327030 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:07:29.327030 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:07:29.327030 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:07:29.327030 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:07:29.327030 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:29.327256 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:07:29.327382 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.029(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:07:29.327528 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:07:29.680800 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:29.946703 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3cf8d7a2-016b-4d3c-83a2-cb3ad89442cb tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "94f83a1a-f61c-49bd-ac96-eefd2e3de22c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.714s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:30.320850 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:07:30.327930 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:07:30.333351 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:07:30.333351 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:07:30.343115 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:07:30.343115 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:30.348847 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:30.357641 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:30.363940 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:30.363940 np0000001613 nova-compute[98321]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:30.363940 np0000001613 nova-compute[98321]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:30.363940 np0000001613 nova-compute[98321]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:30.363940 np0000001613 nova-compute[98321]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624 (non-flash)
May 28 10:07:30.363940 np0000001613 nova-compute[98321]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624 (non-flash)
May 28 10:07:30.363940 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:07:30.364251 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:30.364251 np0000001613 nova-compute[98321]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:30.364251 np0000001613 nova-compute[98321]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:30.364251 np0000001613 nova-compute[98321]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:30.364251 np0000001613 nova-compute[98321]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624 (non-flash)
May 28 10:07:30.364251 np0000001613 nova-compute[98321]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624 (non-flash)
May 28 10:07:30.364251 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:07:30.372183 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:30.372183 np0000001613 nova-compute[98321]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:30.372183 np0000001613 nova-compute[98321]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:30.372183 np0000001613 nova-compute[98321]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:30.372183 np0000001613 nova-compute[98321]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624 (non-flash)
May 28 10:07:30.372183 np0000001613 nova-compute[98321]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624 (non-flash)
May 28 10:07:30.372183 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:07:30.372434 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:30.372434 np0000001613 nova-compute[98321]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:30.372434 np0000001613 nova-compute[98321]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:30.372434 np0000001613 nova-compute[98321]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:30.372434 np0000001613 nova-compute[98321]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624 (non-flash)
May 28 10:07:30.372434 np0000001613 nova-compute[98321]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624 (non-flash)
May 28 10:07:30.372434 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:07:30.378947 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:30.411769 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d, portal: 192.168.40.100,3260]
May 28 10:07:30.411769 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d, portal: 192.168.40.100,3260] successful.
May 28 10:07:30.411769 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:30.423797 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:30.428941 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d, portal: 192.168.50.100,3260]
May 28 10:07:30.428941 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d, portal: 192.168.50.100,3260] successful.
May 28 10:07:30.428941 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:30.441665 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:30.441665 np0000001613 nova-compute[98321]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:30.441665 np0000001613 nova-compute[98321]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:30.441665 np0000001613 nova-compute[98321]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:30.441665 np0000001613 nova-compute[98321]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624 (non-flash)
May 28 10:07:30.441665 np0000001613 nova-compute[98321]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624 (non-flash)
May 28 10:07:30.441665 np0000001613 nova-compute[98321]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d (non-flash)
May 28 10:07:30.441665 np0000001613 nova-compute[98321]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d (non-flash)
May 28 10:07:30.441665 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:07:30.441921 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:30.441921 np0000001613 nova-compute[98321]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:30.441921 np0000001613 nova-compute[98321]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:30.441921 np0000001613 nova-compute[98321]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:30.441921 np0000001613 nova-compute[98321]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624 (non-flash)
May 28 10:07:30.441921 np0000001613 nova-compute[98321]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624 (non-flash)
May 28 10:07:30.441921 np0000001613 nova-compute[98321]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d (non-flash)
May 28 10:07:30.441921 np0000001613 nova-compute[98321]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d (non-flash)
May 28 10:07:30.441921 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:07:30.442117 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.145s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:07:30.442285 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:07:30.443346 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] HCTL ('8', '-', '-', 0) found on session 114 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:07:30.443471 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:07:30.445078 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:30.445660 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "94f83a1a-f61c-49bd-ac96-eefd2e3de22c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:30.445882 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "94f83a1a-f61c-49bd-ac96-eefd2e3de22c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:30.462107 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Searching for a device in session 114 and hctl ['8', '*', '*', 0] yield: None {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:07:30.468912 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:30.468912 np0000001613 nova-compute[98321]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:30.468912 np0000001613 nova-compute[98321]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:30.468912 np0000001613 nova-compute[98321]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:30.468912 np0000001613 nova-compute[98321]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624 (non-flash)
May 28 10:07:30.468912 np0000001613 nova-compute[98321]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624 (non-flash)
May 28 10:07:30.468912 np0000001613 nova-compute[98321]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d (non-flash)
May 28 10:07:30.468912 np0000001613 nova-compute[98321]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d (non-flash)
May 28 10:07:30.468912 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:07:30.469221 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:30.469221 np0000001613 nova-compute[98321]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:30.469221 np0000001613 nova-compute[98321]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:30.469221 np0000001613 nova-compute[98321]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:30.469221 np0000001613 nova-compute[98321]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624 (non-flash)
May 28 10:07:30.469221 np0000001613 nova-compute[98321]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624 (non-flash)
May 28 10:07:30.469221 np0000001613 nova-compute[98321]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d (non-flash)
May 28 10:07:30.469221 np0000001613 nova-compute[98321]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d (non-flash)
May 28 10:07:30.469221 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:07:30.469381 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.171s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:07:30.469447 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:07:30.470193 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] HCTL ('12', '-', '-', 0) found on session 115 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:07:30.470302 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:07:30.489553 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Searching for a device in session 115 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:07:30.489773 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3597de89-817d-47ab-8322-def547c0175d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:07:30.949304 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Detaching volume 0cbb5bcb-d0d8-41df-81da-d7fefa332624
May 28 10:07:31.000478 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Attempting to driver detach volume 0cbb5bcb-d0d8-41df-81da-d7fefa332624 from mountpoint /dev/vdb
May 28 10:07:31.042009 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624', 'iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0cbb5bcb-d0d8-41df-81da-d7fefa332624', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, 'status': 'reserved', 'instance': '94f83a1a-f61c-49bd-ac96-eefd2e3de22c', 'attached_at': '', 'detached_at': '', 'volume_id': '0cbb5bcb-d0d8-41df-81da-d7fefa332624', 'serial': '0cbb5bcb-d0d8-41df-81da-d7fefa332624'} {{(pid=98321) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 10:07:31.046108 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Found disk vdb by alias ua-0cbb5bcb-d0d8-41df-81da-d7fefa332624 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:07:31.047374 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Found disk vdb by alias ua-0cbb5bcb-d0d8-41df-81da-d7fefa332624 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:07:31.047531 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Attempting to detach device vdb from instance 94f83a1a-f61c-49bd-ac96-eefd2e3de22c from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 10:07:31.047907 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:07:31.047907 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:07:31.047907 np0000001613 nova-compute[98321]:   <alias name="ua-0cbb5bcb-d0d8-41df-81da-d7fefa332624"/>
May 28 10:07:31.047907 np0000001613 nova-compute[98321]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-6"/>
May 28 10:07:31.047907 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:07:31.047907 np0000001613 nova-compute[98321]:   <serial>0cbb5bcb-d0d8-41df-81da-d7fefa332624</serial>
May 28 10:07:31.047907 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:07:31.047907 np0000001613 nova-compute[98321]:   <encryption format="luks">
May 28 10:07:31.047907 np0000001613 nova-compute[98321]:     <secret type="passphrase" uuid="320b18c7-0218-4975-86c7-c98459ab383b"/>
May 28 10:07:31.047907 np0000001613 nova-compute[98321]:   </encryption>
May 28 10:07:31.047907 np0000001613 nova-compute[98321]: </disk>
May 28 10:07:31.047907 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:07:31.055034 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Successfully detached device vdb from instance 94f83a1a-f61c-49bd-ac96-eefd2e3de22c from the persistent domain config.
May 28 10:07:31.055306 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] (1/8): Attempting to detach device vdb with device alias ua-0cbb5bcb-d0d8-41df-81da-d7fefa332624 from instance 94f83a1a-f61c-49bd-ac96-eefd2e3de22c from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 10:07:31.055626 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:07:31.055626 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:07:31.055626 np0000001613 nova-compute[98321]:   <alias name="ua-0cbb5bcb-d0d8-41df-81da-d7fefa332624"/>
May 28 10:07:31.055626 np0000001613 nova-compute[98321]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-6"/>
May 28 10:07:31.055626 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:07:31.055626 np0000001613 nova-compute[98321]:   <serial>0cbb5bcb-d0d8-41df-81da-d7fefa332624</serial>
May 28 10:07:31.055626 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:07:31.055626 np0000001613 nova-compute[98321]:   <encryption format="luks">
May 28 10:07:31.055626 np0000001613 nova-compute[98321]:     <secret type="passphrase" uuid="320b18c7-0218-4975-86c7-c98459ab383b"/>
May 28 10:07:31.055626 np0000001613 nova-compute[98321]:   </encryption>
May 28 10:07:31.055626 np0000001613 nova-compute[98321]: </disk>
May 28 10:07:31.055626 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:07:31.462022 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Searching for a device in session 114 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:07:31.462201 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3597de89-817d-47ab-8322-def547c0175d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:07:31.523590 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779962851.5229995, 94f83a1a-f61c-49bd-ac96-eefd2e3de22c => ua-0cbb5bcb-d0d8-41df-81da-d7fefa332624> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 10:07:31.524515 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-0cbb5bcb-d0d8-41df-81da-d7fefa332624 for instance 94f83a1a-f61c-49bd-ac96-eefd2e3de22c {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 10:07:31.527707 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Successfully detached device vdb from instance 94f83a1a-f61c-49bd-ac96-eefd2e3de22c from the live domain config.
May 28 10:07:31.530740 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:07:31.531133 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624', 'iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0cbb5bcb-d0d8-41df-81da-d7fefa332624', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:07:31.531326 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:07:32.311505 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Found WWN 3300000005ca70563 for multipath device dm-7 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:07:32.312143 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.026s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:07:32.312143 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] <== connect_volume: return (3027ms) {'type': 'block', 'scsi_wwn': '3300000005ca70563', 'path': '/dev/dm-7', 'multipath_id': '3300000005ca70563'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:07:32.312143 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005ca70563', 'path': '/dev/dm-7', 'multipath_id': '3300000005ca70563'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:07:32.312803 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.782s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:07:32.313110 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624', 'iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0cbb5bcb-d0d8-41df-81da-d7fefa332624', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:07:32.313247 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:07:32.315393 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lazy-loading 'flavor' on Instance uuid 90a9853a-2830-42b5-912d-72188187a375 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:07:32.341248 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:32.341248 np0000001613 nova-compute[98321]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:32.341248 np0000001613 nova-compute[98321]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:32.341248 np0000001613 nova-compute[98321]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:32.341248 np0000001613 nova-compute[98321]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624 (non-flash)
May 28 10:07:32.341248 np0000001613 nova-compute[98321]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624 (non-flash)
May 28 10:07:32.341248 np0000001613 nova-compute[98321]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d (non-flash)
May 28 10:07:32.341248 np0000001613 nova-compute[98321]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d (non-flash)
May 28 10:07:32.341248 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:07:32.341631 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:32.341631 np0000001613 nova-compute[98321]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:32.341631 np0000001613 nova-compute[98321]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:32.341631 np0000001613 nova-compute[98321]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:32.341631 np0000001613 nova-compute[98321]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624 (non-flash)
May 28 10:07:32.341631 np0000001613 nova-compute[98321]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624 (non-flash)
May 28 10:07:32.341631 np0000001613 nova-compute[98321]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d (non-flash)
May 28 10:07:32.341631 np0000001613 nova-compute[98321]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d (non-flash)
May 28 10:07:32.341631 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:07:32.341631 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc', '107'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b', '108'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b', '109'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624', '112'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624', '113'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d', '115')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:07:32.341631 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624', '112')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:07:32.342631 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624', '113')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:07:32.343538 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc7cac00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624'): ({'sdi'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:07:32.343750 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Removing multipathed devices sdh, sdi {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:07:32.343959 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Flush multipath device 330000000d6bec082 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:07:32.383589 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:07:32.425695 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:07:32.463412 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:07:32.463590 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:07:32.464599 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:07:32.475975 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:07:32.476156 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:07:32.486288 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:32.516086 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 112, target: iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624, portal: 192.168.40.100,3260]
May 28 10:07:32.516086 np0000001613 nova-compute[98321]: Logout of [sid: 112, target: iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624, portal: 192.168.40.100,3260] successful.
May 28 10:07:32.516086 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:32.537311 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:32.551156 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:32.585527 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 113, target: iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624, portal: 192.168.50.100,3260]
May 28 10:07:32.585527 np0000001613 nova-compute[98321]: Logout of [sid: 113, target: iqn.2023-03.storpool.com:os--volume-0cbb5bcb-d0d8-41df-81da-d7fefa332624, portal: 192.168.50.100,3260] successful.
May 28 10:07:32.585527 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:32.601694 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:32.604213 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:07:32.604405 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] <== disconnect_volume: return (1072ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:07:32.604573 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:07:32.818297 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Attempting to attach volume 3597de89-817d-47ab-8322-def547c0175d with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 10:07:32.819724 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] attach device xml: <disk type="block" device="disk">
May 28 10:07:32.819724 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:07:32.819724 np0000001613 nova-compute[98321]:   <alias name="ua-3597de89-817d-47ab-8322-def547c0175d"/>
May 28 10:07:32.819724 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-7"/>
May 28 10:07:32.819724 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:07:32.819724 np0000001613 nova-compute[98321]:   <serial>3597de89-817d-47ab-8322-def547c0175d</serial>
May 28 10:07:32.819724 np0000001613 nova-compute[98321]: </disk>
May 28 10:07:32.819724 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 10:07:33.188944 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lazy-loading 'flavor' on Instance uuid 94f83a1a-f61c-49bd-ac96-eefd2e3de22c {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:07:34.197050 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc7b4e6e-00c8-40c9-a235-667e6e20c391 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "94f83a1a-f61c-49bd-ac96-eefd2e3de22c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.751s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:34.478112 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:07:34.478234 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:07:34.478331 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:07:34.478414 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] No VIF found with MAC fa:16:3e:59:15:c3, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:07:34.682815 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:34.778820 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b022982a-4d26-4f2d-8765-61c948fcd50d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "94f83a1a-f61c-49bd-ac96-eefd2e3de22c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:34.779005 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b022982a-4d26-4f2d-8765-61c948fcd50d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "94f83a1a-f61c-49bd-ac96-eefd2e3de22c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:34.779211 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b022982a-4d26-4f2d-8765-61c948fcd50d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "94f83a1a-f61c-49bd-ac96-eefd2e3de22c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:34.779383 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b022982a-4d26-4f2d-8765-61c948fcd50d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "94f83a1a-f61c-49bd-ac96-eefd2e3de22c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:34.779553 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b022982a-4d26-4f2d-8765-61c948fcd50d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "94f83a1a-f61c-49bd-ac96-eefd2e3de22c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:34.781541 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-b022982a-4d26-4f2d-8765-61c948fcd50d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Terminating instance
May 28 10:07:35.284694 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-b022982a-4d26-4f2d-8765-61c948fcd50d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:07:35.315038 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:35.319003 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:35.339500 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:35.346941 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:35.370497 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:35.373084 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:35.382575 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:35.515759 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d2244ab8-9ae7-4c2c-9038-501275c8d66a req-378eb7f7-d8e4-474c-89fc-f805601a40c1 service nova] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Received event network-vif-unplugged-c00621f0-d21c-42ae-85e1-4aba5aaa265b {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:07:35.515759 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d2244ab8-9ae7-4c2c-9038-501275c8d66a req-378eb7f7-d8e4-474c-89fc-f805601a40c1 service nova] Acquiring lock "94f83a1a-f61c-49bd-ac96-eefd2e3de22c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:35.515759 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d2244ab8-9ae7-4c2c-9038-501275c8d66a req-378eb7f7-d8e4-474c-89fc-f805601a40c1 service nova] Lock "94f83a1a-f61c-49bd-ac96-eefd2e3de22c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:35.515759 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d2244ab8-9ae7-4c2c-9038-501275c8d66a req-378eb7f7-d8e4-474c-89fc-f805601a40c1 service nova] Lock "94f83a1a-f61c-49bd-ac96-eefd2e3de22c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:35.515759 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d2244ab8-9ae7-4c2c-9038-501275c8d66a req-378eb7f7-d8e4-474c-89fc-f805601a40c1 service nova] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] No waiting events found dispatching network-vif-unplugged-c00621f0-d21c-42ae-85e1-4aba5aaa265b {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:07:35.515759 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d2244ab8-9ae7-4c2c-9038-501275c8d66a req-378eb7f7-d8e4-474c-89fc-f805601a40c1 service nova] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Received event network-vif-unplugged-c00621f0-d21c-42ae-85e1-4aba5aaa265b for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:07:35.579555 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:35.643411 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.9997113430004 future=<Future at 0x73c1fc21ef00 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:07:35.643732 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999353006000092 future=<Future at 0x73c1fc21ef00 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:07:35.643943 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999136013000225 future=<Future at 0x73c1fc21ef00 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:07:35.646298 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Instance destroyed successfully.
May 28 10:07:35.646594 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-b022982a-4d26-4f2d-8765-61c948fcd50d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lazy-loading 'resources' on Instance uuid 94f83a1a-f61c-49bd-ac96-eefd2e3de22c {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:07:36.056366 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-10981bd0-66bb-44c8-bdc4-36e1dd5dc6c8 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "90a9853a-2830-42b5-912d-72188187a375" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.481s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:36.149364 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-b022982a-4d26-4f2d-8765-61c948fcd50d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:06:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-407405005',display_name='tempest-TestEncryptedCinderVolumes-server-407405005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testencryptedcindervolumes-server-407405005',id=45,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCVXrBq2Y6aeSfYUUMKJV8DMtxkJTzOOVxewh+xanq9+vtQN8VDyuUFwqgJI9tX01tcYQbol/ypCw5qe//1oGbfUjUfN/C1vVKZIpeK8TYWxk25lhzTdTnxFASMYGFRxDA==',key_name='tempest-keypair-1932720706',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:06:35Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7563a83d33d4bc1a6610ccf53c18dc1',ramdisk_id='',reservation_id='r-lgqqf5py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-297752033',owner_user_name='tempest-TestEncryptedCinderVolumes-297752033-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:06:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='961948be669c4a18a29398d53015f03b',uuid=94f83a1a-f61c-49bd-ac96-eefd2e3de22c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c00621f0-d21c-42ae-85e1-4aba5aaa265b", "address": "fa:16:3e:c4:58:1f", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc00621f0-d2", "ovs_interfaceid": "c00621f0-d21c-42ae-85e1-4aba5aaa265b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:07:36.149592 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-b022982a-4d26-4f2d-8765-61c948fcd50d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Converting VIF {"id": "c00621f0-d21c-42ae-85e1-4aba5aaa265b", "address": "fa:16:3e:c4:58:1f", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc00621f0-d2", "ovs_interfaceid": "c00621f0-d21c-42ae-85e1-4aba5aaa265b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:07:36.150238 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-b022982a-4d26-4f2d-8765-61c948fcd50d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:58:1f,bridge_name='br-int',has_traffic_filtering=True,id=c00621f0-d21c-42ae-85e1-4aba5aaa265b,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc00621f0-d2') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:07:36.150530 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-b022982a-4d26-4f2d-8765-61c948fcd50d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:58:1f,bridge_name='br-int',has_traffic_filtering=True,id=c00621f0-d21c-42ae-85e1-4aba5aaa265b,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc00621f0-d2') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:07:36.152082 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:36.152439 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc00621f0-d2, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:07:36.153834 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:36.154898 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:07:36.155568 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:36.155794 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2465e91f-222f-49eb-8dca-d31b68c8eb43) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:07:36.156729 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:36.157695 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:07:36.159380 np0000001613 nova-compute[98321]: INFO os_vif [None req-b022982a-4d26-4f2d-8765-61c948fcd50d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:58:1f,bridge_name='br-int',has_traffic_filtering=True,id=c00621f0-d21c-42ae-85e1-4aba5aaa265b,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc00621f0-d2')
May 28 10:07:36.159923 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-b022982a-4d26-4f2d-8765-61c948fcd50d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Deleting instance files /opt/stack/data/nova/instances/94f83a1a-f61c-49bd-ac96-eefd2e3de22c_del
May 28 10:07:36.160557 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-b022982a-4d26-4f2d-8765-61c948fcd50d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Deletion of /opt/stack/data/nova/instances/94f83a1a-f61c-49bd-ac96-eefd2e3de22c_del complete
May 28 10:07:36.669278 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-b022982a-4d26-4f2d-8765-61c948fcd50d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Took 1.38 seconds to destroy the instance on the hypervisor.
May 28 10:07:36.669866 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-b022982a-4d26-4f2d-8765-61c948fcd50d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:07:36.670094 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:07:36.670233 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:07:36.670740 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:07:36.768800 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:07:37.252506 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f37aa81e-5800-4464-929f-9eb2611e389d req-04cc8e98-6086-40d5-819d-73957e1ec1c1 service nova] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Received event network-vif-deleted-c00621f0-d21c-42ae-85e1-4aba5aaa265b {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:07:37.252506 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-f37aa81e-5800-4464-929f-9eb2611e389d req-04cc8e98-6086-40d5-819d-73957e1ec1c1 service nova] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Neutron deleted interface c00621f0-d21c-42ae-85e1-4aba5aaa265b; detaching it from the instance and deleting it from the info cache
May 28 10:07:37.254093 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f37aa81e-5800-4464-929f-9eb2611e389d req-04cc8e98-6086-40d5-819d-73957e1ec1c1 service nova] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Detach interface failed, port_id=c00621f0-d21c-42ae-85e1-4aba5aaa265b, reason: Instance 94f83a1a-f61c-49bd-ac96-eefd2e3de22c could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:07:37.340894 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "90a9853a-2830-42b5-912d-72188187a375" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:37.342503 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "90a9853a-2830-42b5-912d-72188187a375" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:37.428148 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95889dfb-9d31-47b5-a5dd-ca7db0cc893f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "11a2b3e7-1061-4a51-b520-113e13221658" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:37.428415 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95889dfb-9d31-47b5-a5dd-ca7db0cc893f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "11a2b3e7-1061-4a51-b520-113e13221658" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:37.428484 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95889dfb-9d31-47b5-a5dd-ca7db0cc893f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "11a2b3e7-1061-4a51-b520-113e13221658-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:37.428663 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95889dfb-9d31-47b5-a5dd-ca7db0cc893f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "11a2b3e7-1061-4a51-b520-113e13221658-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:37.428710 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95889dfb-9d31-47b5-a5dd-ca7db0cc893f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "11a2b3e7-1061-4a51-b520-113e13221658-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:37.430381 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-95889dfb-9d31-47b5-a5dd-ca7db0cc893f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Terminating instance
May 28 10:07:37.663317 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ab806cc3-d8d9-4476-ac2e-70df5e598c45 req-ed1b0e64-22cc-4e40-ad44-44bf47d2ec29 service nova] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Received event network-vif-unplugged-c00621f0-d21c-42ae-85e1-4aba5aaa265b {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:07:37.664432 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ab806cc3-d8d9-4476-ac2e-70df5e598c45 req-ed1b0e64-22cc-4e40-ad44-44bf47d2ec29 service nova] Acquiring lock "94f83a1a-f61c-49bd-ac96-eefd2e3de22c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:37.664432 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ab806cc3-d8d9-4476-ac2e-70df5e598c45 req-ed1b0e64-22cc-4e40-ad44-44bf47d2ec29 service nova] Lock "94f83a1a-f61c-49bd-ac96-eefd2e3de22c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:37.664432 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ab806cc3-d8d9-4476-ac2e-70df5e598c45 req-ed1b0e64-22cc-4e40-ad44-44bf47d2ec29 service nova] Lock "94f83a1a-f61c-49bd-ac96-eefd2e3de22c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:37.664432 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ab806cc3-d8d9-4476-ac2e-70df5e598c45 req-ed1b0e64-22cc-4e40-ad44-44bf47d2ec29 service nova] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] No waiting events found dispatching network-vif-unplugged-c00621f0-d21c-42ae-85e1-4aba5aaa265b {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:07:37.664432 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ab806cc3-d8d9-4476-ac2e-70df5e598c45 req-ed1b0e64-22cc-4e40-ad44-44bf47d2ec29 service nova] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Received event network-vif-unplugged-c00621f0-d21c-42ae-85e1-4aba5aaa265b for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:07:37.687602 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:07:37.845339 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lazy-loading 'flavor' on Instance uuid 90a9853a-2830-42b5-912d-72188187a375 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:07:37.932727 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-95889dfb-9d31-47b5-a5dd-ca7db0cc893f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:07:37.953622 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:37.955592 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:37.985969 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:37.985969 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:38.017647 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:38.190435 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Took 1.52 seconds to deallocate network for instance.
May 28 10:07:38.205591 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2c389f06-8049-4297-aedd-f62d4198f94f req-7291ecf8-590d-435a-a65f-76f4ae4363e2 service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Received event network-vif-unplugged-fd381175-d629-4ae4-b6a9-860af0c0aebf {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:07:38.205726 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2c389f06-8049-4297-aedd-f62d4198f94f req-7291ecf8-590d-435a-a65f-76f4ae4363e2 service nova] Acquiring lock "11a2b3e7-1061-4a51-b520-113e13221658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:38.206195 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2c389f06-8049-4297-aedd-f62d4198f94f req-7291ecf8-590d-435a-a65f-76f4ae4363e2 service nova] Lock "11a2b3e7-1061-4a51-b520-113e13221658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:38.208177 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2c389f06-8049-4297-aedd-f62d4198f94f req-7291ecf8-590d-435a-a65f-76f4ae4363e2 service nova] Lock "11a2b3e7-1061-4a51-b520-113e13221658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:38.208274 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2c389f06-8049-4297-aedd-f62d4198f94f req-7291ecf8-590d-435a-a65f-76f4ae4363e2 service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] No waiting events found dispatching network-vif-unplugged-fd381175-d629-4ae4-b6a9-860af0c0aebf {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:07:38.208913 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2c389f06-8049-4297-aedd-f62d4198f94f req-7291ecf8-590d-435a-a65f-76f4ae4363e2 service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Received event network-vif-unplugged-fd381175-d629-4ae4-b6a9-860af0c0aebf for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:07:38.227720 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:38.241200 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:38.271015 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999749383999642 future=<Future at 0x73c1fc21cf20 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:07:38.273778 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Instance destroyed successfully.
May 28 10:07:38.274261 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-95889dfb-9d31-47b5-a5dd-ca7db0cc893f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lazy-loading 'resources' on Instance uuid 11a2b3e7-1061-4a51-b520-113e13221658 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:07:38.710183 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b022982a-4d26-4f2d-8765-61c948fcd50d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:38.710183 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b022982a-4d26-4f2d-8765-61c948fcd50d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:38.779829 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-95889dfb-9d31-47b5-a5dd-ca7db0cc893f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T10:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1038469455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumeshelvetestjson-server-1038469455',id=42,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMY7kXjSfENddJg92HGAKjem9WrDThMi6I8TEBeHwoDzPui0P24CmO2SMbVIQkyN1o3DhCenQzSIsgKtBFuRyVtQHpeEnNk6L6E9kYszZ+Qxlovl7JB7OKSIEGTWV9SmQQ==',key_name='tempest-keypair-1521685008',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:06:59Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='edd64b0e2ce54cac860344420cf9c5b6',ramdisk_id='',reservation_id='r-oq6jrgqc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1618900663',owner_user_name='tempest-AttachVolumeShelveTestJSON-1618900663-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:06:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd3def75f0dd411888f23a2f432896b0',uuid=11a2b3e7-1061-4a51-b520-113e13221658,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "address": "fa:16:3e:b5:7a:19", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd381175-d6", "ovs_interfaceid": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:07:38.779829 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-95889dfb-9d31-47b5-a5dd-ca7db0cc893f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Converting VIF {"id": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "address": "fa:16:3e:b5:7a:19", "network": {"id": "d262816b-8751-4e64-8f19-7d59ddaabc41", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-998938527-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "edd64b0e2ce54cac860344420cf9c5b6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd381175-d6", "ovs_interfaceid": "fd381175-d629-4ae4-b6a9-860af0c0aebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:07:38.779829 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-95889dfb-9d31-47b5-a5dd-ca7db0cc893f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:7a:19,bridge_name='br-int',has_traffic_filtering=True,id=fd381175-d629-4ae4-b6a9-860af0c0aebf,network=Network(d262816b-8751-4e64-8f19-7d59ddaabc41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd381175-d6') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:07:38.779829 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-95889dfb-9d31-47b5-a5dd-ca7db0cc893f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:7a:19,bridge_name='br-int',has_traffic_filtering=True,id=fd381175-d629-4ae4-b6a9-860af0c0aebf,network=Network(d262816b-8751-4e64-8f19-7d59ddaabc41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd381175-d6') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:07:38.780242 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:38.780419 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd381175-d6, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:07:38.781289 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:38.782257 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:07:38.782397 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:38.783106 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:38.783269 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=31170344-3aad-42c4-a8d9-dd42185e2c09) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:07:38.783679 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:38.784220 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:07:38.784744 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:38.791190 np0000001613 nova-compute[98321]: INFO os_vif [None req-95889dfb-9d31-47b5-a5dd-ca7db0cc893f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:7a:19,bridge_name='br-int',has_traffic_filtering=True,id=fd381175-d629-4ae4-b6a9-860af0c0aebf,network=Network(d262816b-8751-4e64-8f19-7d59ddaabc41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd381175-d6')
May 28 10:07:38.791190 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-95889dfb-9d31-47b5-a5dd-ca7db0cc893f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Deleting instance files /opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658_del
May 28 10:07:38.796572 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-95889dfb-9d31-47b5-a5dd-ca7db0cc893f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Deletion of /opt/stack/data/nova/instances/11a2b3e7-1061-4a51-b520-113e13221658_del complete
May 28 10:07:38.853925 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "90a9853a-2830-42b5-912d-72188187a375" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:39.026326 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b022982a-4d26-4f2d-8765-61c948fcd50d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:07:39.026524 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-b022982a-4d26-4f2d-8765-61c948fcd50d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:07:39.306184 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-95889dfb-9d31-47b5-a5dd-ca7db0cc893f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Took 1.37 seconds to destroy the instance on the hypervisor.
May 28 10:07:39.306385 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-95889dfb-9d31-47b5-a5dd-ca7db0cc893f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:07:39.306632 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:07:39.306739 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:07:39.306935 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:07:39.371704 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:07:39.530701 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-b022982a-4d26-4f2d-8765-61c948fcd50d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:07:39.685456 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:39.933319 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-fc06bbcc-fcca-46ed-b986-0eaaef4d9f5e req-44b09ae8-9314-4594-b88c-4ceec7d30f3d service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Received event network-vif-deleted-fd381175-d629-4ae4-b6a9-860af0c0aebf {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:07:39.933749 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-fc06bbcc-fcca-46ed-b986-0eaaef4d9f5e req-44b09ae8-9314-4594-b88c-4ceec7d30f3d service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Neutron deleted interface fd381175-d629-4ae4-b6a9-860af0c0aebf; detaching it from the instance and deleting it from the info cache
May 28 10:07:39.935148 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-fc06bbcc-fcca-46ed-b986-0eaaef4d9f5e req-44b09ae8-9314-4594-b88c-4ceec7d30f3d service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Detach interface failed, port_id=fd381175-d629-4ae4-b6a9-860af0c0aebf, reason: Instance 11a2b3e7-1061-4a51-b520-113e13221658 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:07:39.953128 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "90a9853a-2830-42b5-912d-72188187a375" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:39.953128 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "90a9853a-2830-42b5-912d-72188187a375" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:39.953128 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Attaching volume 86fdd88f-65c7-470f-a246-ed1cb75bf5da to /dev/vdc
May 28 10:07:39.994431 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:07:40.005536 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:07:40.025746 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:07:40.046394 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b022982a-4d26-4f2d-8765-61c948fcd50d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.336s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:40.078150 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:07:40.078150 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:07:40.089049 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:07:40.090177 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe59:15c3', 'fe80::e02b:1cff:fec7:1a41', 'fe80::fc16:3eff:feb6:e03d', 'fe80::c4f8:89ff:fef6:4009', 'fe80::fc16:3eff:fee8:3758', 'fe80::e4eb:4cff:fe5c:5eb7'] 
May 28 10:07:40.090177 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:07:40.090429 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:07:40.090541 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] <== get_connector_properties: return (95ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:07:40.090855 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Updating existing volume attachment record: e01a1f39-38b8-411e-9dfb-850aa7d46a4f {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:07:40.128856 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-b022982a-4d26-4f2d-8765-61c948fcd50d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Deleted allocations for instance 94f83a1a-f61c-49bd-ac96-eefd2e3de22c
May 28 10:07:40.289826 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e826f81d-69a3-4a06-b546-805f899d786b req-78c6004a-0325-4efe-9d90-885fab74455f service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Received event network-vif-unplugged-fd381175-d629-4ae4-b6a9-860af0c0aebf {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:07:40.292194 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e826f81d-69a3-4a06-b546-805f899d786b req-78c6004a-0325-4efe-9d90-885fab74455f service nova] Acquiring lock "11a2b3e7-1061-4a51-b520-113e13221658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:40.295762 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e826f81d-69a3-4a06-b546-805f899d786b req-78c6004a-0325-4efe-9d90-885fab74455f service nova] Lock "11a2b3e7-1061-4a51-b520-113e13221658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:40.296017 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e826f81d-69a3-4a06-b546-805f899d786b req-78c6004a-0325-4efe-9d90-885fab74455f service nova] Lock "11a2b3e7-1061-4a51-b520-113e13221658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:40.298143 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e826f81d-69a3-4a06-b546-805f899d786b req-78c6004a-0325-4efe-9d90-885fab74455f service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] No waiting events found dispatching network-vif-unplugged-fd381175-d629-4ae4-b6a9-860af0c0aebf {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:07:40.299058 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e826f81d-69a3-4a06-b546-805f899d786b req-78c6004a-0325-4efe-9d90-885fab74455f service nova] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Received event network-vif-unplugged-fd381175-d629-4ae4-b6a9-860af0c0aebf for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:07:40.387460 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:07:40.643923 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:07:40.644259 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da', 'iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '86fdd88f-65c7-470f-a246-ed1cb75bf5da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:07:40.644411 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:07:40.644785 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:07:40.644969 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da', 'iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '86fdd88f-65c7-470f-a246-ed1cb75bf5da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:07:40.660128 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:07:40.661938 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:07:40.662563 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:07:40.662966 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:07:40.663836 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:07:40.663836 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:07:40.680048 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:07:40.680048 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:40.684008 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:07:40.684008 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:40.699744 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da] added
May 28 10:07:40.699744 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:07:40.699744 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:07:40.699744 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:07:40.699744 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:07:40.699744 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:07:40.699744 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:40.700194 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:07:40.700194 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0372(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:07:40.700194 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:07:40.709705 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da] added
May 28 10:07:40.709705 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:07:40.709705 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:07:40.709705 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:07:40.709705 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:07:40.709705 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:07:40.709705 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:40.710693 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:07:40.710693 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0464(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:07:40.710693 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:07:40.890016 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Took 1.58 seconds to deallocate network for instance.
May 28 10:07:41.141181 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b022982a-4d26-4f2d-8765-61c948fcd50d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "94f83a1a-f61c-49bd-ac96-eefd2e3de22c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.362s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:41.403196 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95889dfb-9d31-47b5-a5dd-ca7db0cc893f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:41.403395 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95889dfb-9d31-47b5-a5dd-ca7db0cc893f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:41.700702 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:07:41.702577 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-95889dfb-9d31-47b5-a5dd-ca7db0cc893f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:07:41.703050 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-95889dfb-9d31-47b5-a5dd-ca7db0cc893f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:07:41.710593 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:07:41.718863 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:07:41.718863 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:07:41.731374 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:07:41.731374 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:41.753279 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:41.755472 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:41.769869 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:41.769869 np0000001613 nova-compute[98321]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:41.769869 np0000001613 nova-compute[98321]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:41.769869 np0000001613 nova-compute[98321]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:41.769869 np0000001613 nova-compute[98321]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d (non-flash)
May 28 10:07:41.769869 np0000001613 nova-compute[98321]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d (non-flash)
May 28 10:07:41.769869 np0000001613 nova-compute[98321]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-616bd307-3da2-4928-8a78-a725133f9314 (non-flash)
May 28 10:07:41.769869 np0000001613 nova-compute[98321]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f9c2b41-c18e-4171-888e-cb612ada3213 (non-flash)
May 28 10:07:41.769869 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:07:41.770191 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:41.770191 np0000001613 nova-compute[98321]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:41.770191 np0000001613 nova-compute[98321]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:41.770191 np0000001613 nova-compute[98321]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:41.770191 np0000001613 nova-compute[98321]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d (non-flash)
May 28 10:07:41.770191 np0000001613 nova-compute[98321]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d (non-flash)
May 28 10:07:41.770191 np0000001613 nova-compute[98321]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-616bd307-3da2-4928-8a78-a725133f9314 (non-flash)
May 28 10:07:41.770191 np0000001613 nova-compute[98321]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f9c2b41-c18e-4171-888e-cb612ada3213 (non-flash)
May 28 10:07:41.770191 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:07:41.775544 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:41.775544 np0000001613 nova-compute[98321]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:41.775544 np0000001613 nova-compute[98321]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:41.775544 np0000001613 nova-compute[98321]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:41.775544 np0000001613 nova-compute[98321]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d (non-flash)
May 28 10:07:41.775544 np0000001613 nova-compute[98321]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d (non-flash)
May 28 10:07:41.775544 np0000001613 nova-compute[98321]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-616bd307-3da2-4928-8a78-a725133f9314 (non-flash)
May 28 10:07:41.775544 np0000001613 nova-compute[98321]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f9c2b41-c18e-4171-888e-cb612ada3213 (non-flash)
May 28 10:07:41.775544 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:07:41.775752 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:41.775752 np0000001613 nova-compute[98321]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:41.775752 np0000001613 nova-compute[98321]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:41.775752 np0000001613 nova-compute[98321]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:41.775752 np0000001613 nova-compute[98321]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d (non-flash)
May 28 10:07:41.775752 np0000001613 nova-compute[98321]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d (non-flash)
May 28 10:07:41.775752 np0000001613 nova-compute[98321]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-616bd307-3da2-4928-8a78-a725133f9314 (non-flash)
May 28 10:07:41.775752 np0000001613 nova-compute[98321]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f9c2b41-c18e-4171-888e-cb612ada3213 (non-flash)
May 28 10:07:41.775752 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:07:41.810802 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da, portal: 192.168.40.100,3260]
May 28 10:07:41.810802 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da, portal: 192.168.40.100,3260] successful.
May 28 10:07:41.810802 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:41.823634 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da, portal: 192.168.50.100,3260]
May 28 10:07:41.823634 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da, portal: 192.168.50.100,3260] successful.
May 28 10:07:41.823634 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:41.825637 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:41.840353 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:41.850377 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:41.850377 np0000001613 nova-compute[98321]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:41.850377 np0000001613 nova-compute[98321]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:41.850377 np0000001613 nova-compute[98321]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:41.850377 np0000001613 nova-compute[98321]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d (non-flash)
May 28 10:07:41.850377 np0000001613 nova-compute[98321]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d (non-flash)
May 28 10:07:41.850377 np0000001613 nova-compute[98321]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-616bd307-3da2-4928-8a78-a725133f9314 (non-flash)
May 28 10:07:41.850377 np0000001613 nova-compute[98321]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f9c2b41-c18e-4171-888e-cb612ada3213 (non-flash)
May 28 10:07:41.850377 np0000001613 nova-compute[98321]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da (non-flash)
May 28 10:07:41.850377 np0000001613 nova-compute[98321]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da (non-flash)
May 28 10:07:41.850377 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:07:41.851107 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:41.851107 np0000001613 nova-compute[98321]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:41.851107 np0000001613 nova-compute[98321]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:41.851107 np0000001613 nova-compute[98321]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:41.851107 np0000001613 nova-compute[98321]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d (non-flash)
May 28 10:07:41.851107 np0000001613 nova-compute[98321]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d (non-flash)
May 28 10:07:41.851107 np0000001613 nova-compute[98321]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-616bd307-3da2-4928-8a78-a725133f9314 (non-flash)
May 28 10:07:41.851107 np0000001613 nova-compute[98321]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f9c2b41-c18e-4171-888e-cb612ada3213 (non-flash)
May 28 10:07:41.851107 np0000001613 nova-compute[98321]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da (non-flash)
May 28 10:07:41.851107 np0000001613 nova-compute[98321]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da (non-flash)
May 28 10:07:41.851107 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:07:41.851107 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.188s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:07:41.851107 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:07:41.852362 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] HCTL ('15', '-', '-', 0) found on session 118 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:07:41.852518 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:07:41.860398 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:41.860398 np0000001613 nova-compute[98321]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:41.860398 np0000001613 nova-compute[98321]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:41.860398 np0000001613 nova-compute[98321]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:41.860398 np0000001613 nova-compute[98321]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d (non-flash)
May 28 10:07:41.860398 np0000001613 nova-compute[98321]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d (non-flash)
May 28 10:07:41.860398 np0000001613 nova-compute[98321]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-616bd307-3da2-4928-8a78-a725133f9314 (non-flash)
May 28 10:07:41.860398 np0000001613 nova-compute[98321]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f9c2b41-c18e-4171-888e-cb612ada3213 (non-flash)
May 28 10:07:41.860398 np0000001613 nova-compute[98321]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da (non-flash)
May 28 10:07:41.860398 np0000001613 nova-compute[98321]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da (non-flash)
May 28 10:07:41.860398 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:07:41.861358 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:41.861358 np0000001613 nova-compute[98321]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:41.861358 np0000001613 nova-compute[98321]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:41.861358 np0000001613 nova-compute[98321]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:41.861358 np0000001613 nova-compute[98321]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d (non-flash)
May 28 10:07:41.861358 np0000001613 nova-compute[98321]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d (non-flash)
May 28 10:07:41.861358 np0000001613 nova-compute[98321]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-616bd307-3da2-4928-8a78-a725133f9314 (non-flash)
May 28 10:07:41.861358 np0000001613 nova-compute[98321]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f9c2b41-c18e-4171-888e-cb612ada3213 (non-flash)
May 28 10:07:41.861358 np0000001613 nova-compute[98321]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da (non-flash)
May 28 10:07:41.861358 np0000001613 nova-compute[98321]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da (non-flash)
May 28 10:07:41.861358 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:07:41.861358 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.198s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:07:41.861358 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:07:41.862697 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] HCTL ('16', '-', '-', 0) found on session 119 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:07:41.862857 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:07:41.869276 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Searching for a device in session 118 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:07:41.869519 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '86fdd88f-65c7-470f-a246-ed1cb75bf5da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:07:41.880677 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Searching for a device in session 119 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:07:41.880677 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '86fdd88f-65c7-470f-a246-ed1cb75bf5da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:07:42.208773 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-95889dfb-9d31-47b5-a5dd-ca7db0cc893f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:07:42.663035 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:07:42.721003 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95889dfb-9d31-47b5-a5dd-ca7db0cc893f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.317s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:42.776783 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-95889dfb-9d31-47b5-a5dd-ca7db0cc893f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Deleted allocations for instance 11a2b3e7-1061-4a51-b520-113e13221658
May 28 10:07:43.682221 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Found WWN 330000000edbbb52d for multipath device dm-6 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:07:43.682796 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:07:43.682796 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '330000000edbbb52d', 'path': '/dev/dm-6', 'multipath_id': '330000000edbbb52d'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:07:43.682960 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000edbbb52d', 'path': '/dev/dm-6', 'multipath_id': '330000000edbbb52d'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:07:43.687593 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lazy-loading 'flavor' on Instance uuid 90a9853a-2830-42b5-912d-72188187a375 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:07:43.785196 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:43.788748 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-95889dfb-9d31-47b5-a5dd-ca7db0cc893f tempest-AttachVolumeShelveTestJSON-1618900663 tempest-AttachVolumeShelveTestJSON-1618900663-project-member] Lock "11a2b3e7-1061-4a51-b520-113e13221658" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.360s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:44.191477 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Attempting to attach volume 86fdd88f-65c7-470f-a246-ed1cb75bf5da with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 10:07:44.192882 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] attach device xml: <disk type="block" device="disk">
May 28 10:07:44.192882 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:07:44.192882 np0000001613 nova-compute[98321]:   <alias name="ua-86fdd88f-65c7-470f-a246-ed1cb75bf5da"/>
May 28 10:07:44.192882 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-6"/>
May 28 10:07:44.192882 np0000001613 nova-compute[98321]:   <target dev="vdc" bus="virtio"/>
May 28 10:07:44.192882 np0000001613 nova-compute[98321]:   <serial>86fdd88f-65c7-470f-a246-ed1cb75bf5da</serial>
May 28 10:07:44.192882 np0000001613 nova-compute[98321]: </disk>
May 28 10:07:44.192882 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 10:07:44.687304 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:45.849751 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:07:45.849751 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:07:45.849751 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:07:45.849751 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:07:45.849751 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] No VIF found with MAC fa:16:3e:59:15:c3, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:07:46.002419 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "8dd03b27-b9a0-4260-94db-b3aec44b8faa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:46.002727 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "8dd03b27-b9a0-4260-94db-b3aec44b8faa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:46.513200 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:07:47.066214 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:47.066731 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:47.070978 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:07:47.071100 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Claim successful on node np0000001613
May 28 10:07:47.406704 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-448bb904-ec6f-44b3-ba81-650230d97b62 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "90a9853a-2830-42b5-912d-72188187a375" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.454s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:47.709213 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Acquiring lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:47.709213 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:47.709213 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Shelve offloading
May 28 10:07:48.117754 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "90a9853a-2830-42b5-912d-72188187a375" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:48.118186 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "90a9853a-2830-42b5-912d-72188187a375" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:48.292816 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:07:48.293031 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:07:48.597544 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:48.624613 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Detaching volume 3597de89-817d-47ab-8322-def547c0175d
May 28 10:07:48.671004 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Attempting to driver detach volume 3597de89-817d-47ab-8322-def547c0175d from mountpoint /dev/vdb
May 28 10:07:48.677682 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Found disk vdb by alias ua-3597de89-817d-47ab-8322-def547c0175d {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:07:48.678792 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Found disk vdb by alias ua-3597de89-817d-47ab-8322-def547c0175d {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:07:48.678930 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Attempting to detach device vdb from instance 90a9853a-2830-42b5-912d-72188187a375 from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 10:07:48.679131 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:07:48.679131 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:07:48.679131 np0000001613 nova-compute[98321]:   <alias name="ua-3597de89-817d-47ab-8322-def547c0175d"/>
May 28 10:07:48.679131 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-7"/>
May 28 10:07:48.679131 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:07:48.679131 np0000001613 nova-compute[98321]:   <serial>3597de89-817d-47ab-8322-def547c0175d</serial>
May 28 10:07:48.679131 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:07:48.679131 np0000001613 nova-compute[98321]: </disk>
May 28 10:07:48.679131 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:07:48.687305 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Successfully detached device vdb from instance 90a9853a-2830-42b5-912d-72188187a375 from the persistent domain config.
May 28 10:07:48.687379 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] (1/8): Attempting to detach device vdb with device alias ua-3597de89-817d-47ab-8322-def547c0175d from instance 90a9853a-2830-42b5-912d-72188187a375 from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 10:07:48.689385 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:07:48.689385 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:07:48.689385 np0000001613 nova-compute[98321]:   <alias name="ua-3597de89-817d-47ab-8322-def547c0175d"/>
May 28 10:07:48.689385 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-7"/>
May 28 10:07:48.689385 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:07:48.689385 np0000001613 nova-compute[98321]:   <serial>3597de89-817d-47ab-8322-def547c0175d</serial>
May 28 10:07:48.689385 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:07:48.689385 np0000001613 nova-compute[98321]: </disk>
May 28 10:07:48.689385 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:07:48.745712 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:48.771232 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:48.779421 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:48.786982 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:48.796095 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:07:48.807464 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:49.035203 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:49.040312 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:49.061908 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.99968914200008 future=<Future at 0x73c1fc528fb0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:07:49.070034 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Instance destroyed successfully.
May 28 10:07:49.070034 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lazy-loading 'numa_topology' on Instance uuid 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:07:49.115490 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-71551b9d-1601-4055-8fa2-81ec06dd5890 req-b9264934-16dc-477a-8d84-c4494ef5b2e0 service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Received event network-vif-unplugged-5724dc5f-94cc-45c9-ac48-670de0fa781f {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:07:49.115867 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-71551b9d-1601-4055-8fa2-81ec06dd5890 req-b9264934-16dc-477a-8d84-c4494ef5b2e0 service nova] Acquiring lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:49.115867 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-71551b9d-1601-4055-8fa2-81ec06dd5890 req-b9264934-16dc-477a-8d84-c4494ef5b2e0 service nova] Lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:49.115966 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-71551b9d-1601-4055-8fa2-81ec06dd5890 req-b9264934-16dc-477a-8d84-c4494ef5b2e0 service nova] Lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:49.116072 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-71551b9d-1601-4055-8fa2-81ec06dd5890 req-b9264934-16dc-477a-8d84-c4494ef5b2e0 service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] No waiting events found dispatching network-vif-unplugged-5724dc5f-94cc-45c9-ac48-670de0fa781f {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:07:49.116524 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-71551b9d-1601-4055-8fa2-81ec06dd5890 req-b9264934-16dc-477a-8d84-c4494ef5b2e0 service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Received unexpected event network-vif-unplugged-5724dc5f-94cc-45c9-ac48-670de0fa781f for instance with vm_state active and task_state shelving.
May 28 10:07:49.297092 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779962869.2967038, 90a9853a-2830-42b5-912d-72188187a375 => ua-3597de89-817d-47ab-8322-def547c0175d> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 10:07:49.297537 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-3597de89-817d-47ab-8322-def547c0175d for instance 90a9853a-2830-42b5-912d-72188187a375 {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 10:07:49.300553 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Successfully detached device vdb from instance 90a9853a-2830-42b5-912d-72188187a375 from the live domain config.
May 28 10:07:49.301770 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:07:49.302096 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d', 'iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3597de89-817d-47ab-8322-def547c0175d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:07:49.302281 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:07:49.302597 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:07:49.302929 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d', 'iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3597de89-817d-47ab-8322-def547c0175d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:07:49.303091 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:07:49.307302 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.241s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:49.307980 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:07:49.335617 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:49.335617 np0000001613 nova-compute[98321]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:49.335617 np0000001613 nova-compute[98321]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:49.335617 np0000001613 nova-compute[98321]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:49.335617 np0000001613 nova-compute[98321]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d (non-flash)
May 28 10:07:49.335617 np0000001613 nova-compute[98321]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d (non-flash)
May 28 10:07:49.335617 np0000001613 nova-compute[98321]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f9c2b41-c18e-4171-888e-cb612ada3213 (non-flash)
May 28 10:07:49.335617 np0000001613 nova-compute[98321]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da (non-flash)
May 28 10:07:49.335617 np0000001613 nova-compute[98321]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da (non-flash)
May 28 10:07:49.335617 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:07:49.335968 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:49.335968 np0000001613 nova-compute[98321]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:49.335968 np0000001613 nova-compute[98321]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:49.335968 np0000001613 nova-compute[98321]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:49.335968 np0000001613 nova-compute[98321]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d (non-flash)
May 28 10:07:49.335968 np0000001613 nova-compute[98321]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d (non-flash)
May 28 10:07:49.335968 np0000001613 nova-compute[98321]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f9c2b41-c18e-4171-888e-cb612ada3213 (non-flash)
May 28 10:07:49.335968 np0000001613 nova-compute[98321]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da (non-flash)
May 28 10:07:49.335968 np0000001613 nova-compute[98321]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da (non-flash)
May 28 10:07:49.335968 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:07:49.336154 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc', '107'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b', '108'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b', '109'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d', '115'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6f9c2b41-c18e-4171-888e-cb612ada3213', '117'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da', '118'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da', '119')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:07:49.336154 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d', '114')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:07:49.337396 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d', '115')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:07:49.338256 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1f4493560>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d'): ({'sdg'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:07:49.338435 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Removing multipathed devices sdg, sdc {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:07:49.338679 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Flush multipath device 3300000005ca70563 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:07:49.379934 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:07:49.433783 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:07:49.484708 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Checking to see if SCSI volumes sdg, sdc have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:07:49.484855 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] SCSI volumes sdg, sdc have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:07:49.485937 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Checking to see if device paths {'sdg', 'sdc'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:07:49.499325 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Device paths {'sdg', 'sdc'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:07:49.499493 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:07:49.512574 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:49.546866 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 114, target: iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d, portal: 192.168.40.100,3260]
May 28 10:07:49.546866 np0000001613 nova-compute[98321]: Logout of [sid: 114, target: iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d, portal: 192.168.40.100,3260] successful.
May 28 10:07:49.546866 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:49.572129 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:07:49.573674 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:49.574939 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Acquiring lock "refresh_cache-742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:07:49.575092 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Acquired lock "refresh_cache-742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:07:49.575293 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:07:49.588436 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:49.621752 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 115, target: iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d, portal: 192.168.50.100,3260]
May 28 10:07:49.621752 np0000001613 nova-compute[98321]: Logout of [sid: 115, target: iqn.2023-03.storpool.com:os--volume-3597de89-817d-47ab-8322-def547c0175d, portal: 192.168.50.100,3260] successful.
May 28 10:07:49.621752 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:49.643190 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:49.643490 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:07:49.643704 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] <== disconnect_volume: return (340ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:07:49.643885 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:07:49.688800 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:49.815391 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:07:49.815724 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:07:49.816058 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:07:49.817140 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:07:49.902901 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '961948be669c4a18a29398d53015f03b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7563a83d33d4bc1a6610ccf53c18dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:07:50.079498 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:07:50.211546 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lazy-loading 'flavor' on Instance uuid 90a9853a-2830-42b5-912d-72188187a375 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:07:50.319567 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:07:50.576757 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:07:50.643964 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0008517559999745572 future=<Future at 0x73c1fc21ef00 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:07:50.644103 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:07:50.644245 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=2.6263719839998885 future=<Future at 0x73c1fc21cf20 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:07:50.644779 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=2.625898022000001 future=<Future at 0x73c1fc21cf20 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:07:50.646434 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Emitting event <LifecycleEvent: 1779962855.6430185, 94f83a1a-f61c-49bd-ac96-eefd2e3de22c => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:07:50.646755 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] VM Stopped (Lifecycle Event)
May 28 10:07:50.716398 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Updating instance_info_cache with network_info: [{"id": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "address": "fa:16:3e:b6:e0:3d", "network": {"id": "5264d7e4-aeaa-4172-8f4e-f2845bb783e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1746959726-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92aad30ae7cf45cbb0233727a1e77316", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5724dc5f-94", "ovs_interfaceid": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:07:50.826104 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:07:51.004448 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Successfully created port: 89ba5187-e41f-4177-acdd-6f3586ba93ef {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:07:51.150932 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 94f83a1a-f61c-49bd-ac96-eefd2e3de22c] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:07:51.186519 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d26512e9-6661-460d-b1c8-163ffbc452a8 req-0011e87d-a03a-4adf-97db-f0ddb15c4116 service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Received event network-vif-unplugged-5724dc5f-94cc-45c9-ac48-670de0fa781f {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:07:51.187103 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d26512e9-6661-460d-b1c8-163ffbc452a8 req-0011e87d-a03a-4adf-97db-f0ddb15c4116 service nova] Acquiring lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:51.187306 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d26512e9-6661-460d-b1c8-163ffbc452a8 req-0011e87d-a03a-4adf-97db-f0ddb15c4116 service nova] Lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:51.187576 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d26512e9-6661-460d-b1c8-163ffbc452a8 req-0011e87d-a03a-4adf-97db-f0ddb15c4116 service nova] Lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:51.188031 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d26512e9-6661-460d-b1c8-163ffbc452a8 req-0011e87d-a03a-4adf-97db-f0ddb15c4116 service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] No waiting events found dispatching network-vif-unplugged-5724dc5f-94cc-45c9-ac48-670de0fa781f {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:07:51.188250 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-d26512e9-6661-460d-b1c8-163ffbc452a8 req-0011e87d-a03a-4adf-97db-f0ddb15c4116 service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Received unexpected event network-vif-unplugged-5724dc5f-94cc-45c9-ac48-670de0fa781f for instance with vm_state active and task_state shelving.
May 28 10:07:51.218762 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Releasing lock "refresh_cache-742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:07:51.219072 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:07:51.219353 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:07:51.220931 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-10d32581-07fc-4cc1-b40e-73ddba248655 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "90a9853a-2830-42b5-912d-72188187a375" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.103s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:51.543959 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Successfully updated port: 89ba5187-e41f-4177-acdd-6f3586ba93ef {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:07:51.550886 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "90a9853a-2830-42b5-912d-72188187a375" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:51.550979 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "90a9853a-2830-42b5-912d-72188187a375" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:51.663331 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-14bee18f-d982-459d-94ff-1c8ebd4d1b98 req-555f3442-484e-417f-ad71-32f277bb5478 service nova] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Received event network-changed-89ba5187-e41f-4177-acdd-6f3586ba93ef {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:07:51.663655 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-14bee18f-d982-459d-94ff-1c8ebd4d1b98 req-555f3442-484e-417f-ad71-32f277bb5478 service nova] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Refreshing instance network info cache due to event network-changed-89ba5187-e41f-4177-acdd-6f3586ba93ef. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:07:51.663992 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-14bee18f-d982-459d-94ff-1c8ebd4d1b98 req-555f3442-484e-417f-ad71-32f277bb5478 service nova] Acquiring lock "refresh_cache-8dd03b27-b9a0-4260-94db-b3aec44b8faa" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:07:51.663992 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-14bee18f-d982-459d-94ff-1c8ebd4d1b98 req-555f3442-484e-417f-ad71-32f277bb5478 service nova] Acquired lock "refresh_cache-8dd03b27-b9a0-4260-94db-b3aec44b8faa" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:07:51.664142 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-14bee18f-d982-459d-94ff-1c8ebd4d1b98 req-555f3442-484e-417f-ad71-32f277bb5478 service nova] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Refreshing network info cache for port 89ba5187-e41f-4177-acdd-6f3586ba93ef {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:07:51.705285 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Instance destroyed successfully.
May 28 10:07:51.705604 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lazy-loading 'resources' on Instance uuid 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:07:51.781527 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e5f61c15-6d10-47e4-b5cf-65d81d4cbe60 req-ec65a4ad-5613-4b46-819d-8f6e46eac37b service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Received event network-changed-5724dc5f-94cc-45c9-ac48-670de0fa781f {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:07:51.781749 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e5f61c15-6d10-47e4-b5cf-65d81d4cbe60 req-ec65a4ad-5613-4b46-819d-8f6e46eac37b service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Refreshing instance network info cache due to event network-changed-5724dc5f-94cc-45c9-ac48-670de0fa781f. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:07:51.781990 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e5f61c15-6d10-47e4-b5cf-65d81d4cbe60 req-ec65a4ad-5613-4b46-819d-8f6e46eac37b service nova] Acquiring lock "refresh_cache-742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:07:51.782409 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e5f61c15-6d10-47e4-b5cf-65d81d4cbe60 req-ec65a4ad-5613-4b46-819d-8f6e46eac37b service nova] Acquired lock "refresh_cache-742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:07:51.782654 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-e5f61c15-6d10-47e4-b5cf-65d81d4cbe60 req-ec65a4ad-5613-4b46-819d-8f6e46eac37b service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Refreshing network info cache for port 5724dc5f-94cc-45c9-ac48-670de0fa781f {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:07:51.843436 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:07:51.844673 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:07:51.845028 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Creating image(s)
May 28 10:07:51.845906 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "/opt/stack/data/nova/instances/8dd03b27-b9a0-4260-94db-b3aec44b8faa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:51.846074 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "/opt/stack/data/nova/instances/8dd03b27-b9a0-4260-94db-b3aec44b8faa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:51.846655 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "/opt/stack/data/nova/instances/8dd03b27-b9a0-4260-94db-b3aec44b8faa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:51.847234 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:07:51.849902 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:07:51.850854 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:07:51.939829 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.089s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:07:51.940433 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:51.941003 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:51.941549 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:07:51.944954 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:07:51.945461 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:07:52.041045 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.095s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:07:52.041458 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/8dd03b27-b9a0-4260-94db-b3aec44b8faa/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:07:52.053014 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "refresh_cache-8dd03b27-b9a0-4260-94db-b3aec44b8faa" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:07:52.054995 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Detaching volume 86fdd88f-65c7-470f-a246-ed1cb75bf5da
May 28 10:07:52.096092 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/8dd03b27-b9a0-4260-94db-b3aec44b8faa/disk 1073741824" returned: 0 in 0.054s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:07:52.096624 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.156s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:52.096930 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:07:52.112004 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Attempting to driver detach volume 86fdd88f-65c7-470f-a246-ed1cb75bf5da from mountpoint /dev/vdc
May 28 10:07:52.124267 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Found disk vdc by alias ua-86fdd88f-65c7-470f-a246-ed1cb75bf5da {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:07:52.125773 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Found disk vdc by alias ua-86fdd88f-65c7-470f-a246-ed1cb75bf5da {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:07:52.125909 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Attempting to detach device vdc from instance 90a9853a-2830-42b5-912d-72188187a375 from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 10:07:52.126350 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:07:52.126350 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:07:52.126350 np0000001613 nova-compute[98321]:   <alias name="ua-86fdd88f-65c7-470f-a246-ed1cb75bf5da"/>
May 28 10:07:52.126350 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-6"/>
May 28 10:07:52.126350 np0000001613 nova-compute[98321]:   <target dev="vdc" bus="virtio"/>
May 28 10:07:52.126350 np0000001613 nova-compute[98321]:   <serial>86fdd88f-65c7-470f-a246-ed1cb75bf5da</serial>
May 28 10:07:52.126350 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 10:07:52.126350 np0000001613 nova-compute[98321]: </disk>
May 28 10:07:52.126350 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:07:52.133377 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Successfully detached device vdc from instance 90a9853a-2830-42b5-912d-72188187a375 from the persistent domain config.
May 28 10:07:52.133566 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] (1/8): Attempting to detach device vdc with device alias ua-86fdd88f-65c7-470f-a246-ed1cb75bf5da from instance 90a9853a-2830-42b5-912d-72188187a375 from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 10:07:52.134027 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:07:52.134027 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:07:52.134027 np0000001613 nova-compute[98321]:   <alias name="ua-86fdd88f-65c7-470f-a246-ed1cb75bf5da"/>
May 28 10:07:52.134027 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-6"/>
May 28 10:07:52.134027 np0000001613 nova-compute[98321]:   <target dev="vdc" bus="virtio"/>
May 28 10:07:52.134027 np0000001613 nova-compute[98321]:   <serial>86fdd88f-65c7-470f-a246-ed1cb75bf5da</serial>
May 28 10:07:52.134027 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 10:07:52.134027 np0000001613 nova-compute[98321]: </disk>
May 28 10:07:52.134027 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:07:52.166730 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-14bee18f-d982-459d-94ff-1c8ebd4d1b98 req-555f3442-484e-417f-ad71-32f277bb5478 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:07:52.201740 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.105s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:07:52.202147 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8dd03b27-b9a0-4260-94db-b3aec44b8faa/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:07:52.202394 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd03b27-b9a0-4260-94db-b3aec44b8faa/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:07:52.214622 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Object Instance<742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f> lazy-loaded attributes: numa_topology,resources {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:07:52.216819 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:06:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-969313737',display_name='tempest-TestShelveInstance-server-969313737',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testshelveinstance-server-969313737',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMc5vWcPj8o1zbNh8BWbgPG9pn6dL+GHSCWT99UnDlhu/5IpqN2TRKtEuk4+HsJOYf9KLTLz6y4Wh5WSsvPh4I6FKx2iXP7xTr8JCS9CqOW5AvvlIE1O/+p2kUreJErTw==',key_name='tempest-TestShelveInstance-444905061',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:07:08Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92aad30ae7cf45cbb0233727a1e77316',ramdisk_id='',reservation_id='r-nvd0lh0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-793753334',owner_user_name='tempest-TestShelveInstance-793753334-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:07:08Z,user_data=None,user_id='d05aead48ddb43b6b4e52469338207ae',uuid=742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "address": "fa:16:3e:b6:e0:3d", "network": {"id": "5264d7e4-aeaa-4172-8f4e-f2845bb783e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1746959726-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92aad30ae7cf45cbb0233727a1e77316", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5724dc5f-94", "ovs_interfaceid": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:07:52.217141 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Converting VIF {"id": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "address": "fa:16:3e:b6:e0:3d", "network": {"id": "5264d7e4-aeaa-4172-8f4e-f2845bb783e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1746959726-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92aad30ae7cf45cbb0233727a1e77316", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5724dc5f-94", "ovs_interfaceid": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:07:52.218519 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:e0:3d,bridge_name='br-int',has_traffic_filtering=True,id=5724dc5f-94cc-45c9-ac48-670de0fa781f,network=Network(5264d7e4-aeaa-4172-8f4e-f2845bb783e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5724dc5f-94') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:07:52.219380 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:e0:3d,bridge_name='br-int',has_traffic_filtering=True,id=5724dc5f-94cc-45c9-ac48-670de0fa781f,network=Network(5264d7e4-aeaa-4172-8f4e-f2845bb783e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5724dc5f-94') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:07:52.221984 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:52.222724 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5724dc5f-94, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:07:52.225289 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:52.227335 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:07:52.228821 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:52.228821 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e062f69a-726b-470b-af3d-2b22f5f8542b) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:07:52.229751 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:52.229915 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:07:52.230252 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:52.232370 np0000001613 nova-compute[98321]: INFO os_vif [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:e0:3d,bridge_name='br-int',has_traffic_filtering=True,id=5724dc5f-94cc-45c9-ac48-670de0fa781f,network=Network(5264d7e4-aeaa-4172-8f4e-f2845bb783e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5724dc5f-94')
May 28 10:07:52.242717 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-14bee18f-d982-459d-94ff-1c8ebd4d1b98 req-555f3442-484e-417f-ad71-32f277bb5478 service nova] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:07:52.245854 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:07:52.246329 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc', 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ec1e6963-9189-4750-a397-d2bc2ab54efc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:07:52.246682 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:07:52.247500 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:07:52.247926 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc', 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ec1e6963-9189-4750-a397-d2bc2ab54efc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:07:52.248020 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:07:52.281579 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:52.281579 np0000001613 nova-compute[98321]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:52.281579 np0000001613 nova-compute[98321]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:52.281579 np0000001613 nova-compute[98321]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:52.281579 np0000001613 nova-compute[98321]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da (non-flash)
May 28 10:07:52.281579 np0000001613 nova-compute[98321]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da (non-flash)
May 28 10:07:52.281579 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:07:52.281806 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:52.281806 np0000001613 nova-compute[98321]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:07:52.281806 np0000001613 nova-compute[98321]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:52.281806 np0000001613 nova-compute[98321]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:52.281806 np0000001613 nova-compute[98321]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da (non-flash)
May 28 10:07:52.281806 np0000001613 nova-compute[98321]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da (non-flash)
May 28 10:07:52.281806 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:07:52.281806 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc', '107'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b', '108'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b', '109'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da', '118'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da', '119')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:07:52.281975 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc', '106')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:07:52.282837 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc', '107')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:07:52.283555 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1f4717880>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc'): ({'sde'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:07:52.283779 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Removing multipathed devices sdd, sde {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:07:52.284008 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Flush multipath device 330000000d664e648 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:07:52.285908 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-e5f61c15-6d10-47e4-b5cf-65d81d4cbe60 req-ec65a4ad-5613-4b46-819d-8f6e46eac37b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:07:52.301666 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd03b27-b9a0-4260-94db-b3aec44b8faa/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:07:52.302032 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Cannot resize image /opt/stack/data/nova/instances/8dd03b27-b9a0-4260-94db-b3aec44b8faa/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:07:52.302712 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:07:52.302893 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Ensure instance console log exists: /opt/stack/data/nova/instances/8dd03b27-b9a0-4260-94db-b3aec44b8faa/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:07:52.305955 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:52.307076 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:52.307076 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:52.344965 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:07:52.409071 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:07:52.439350 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-14bee18f-d982-459d-94ff-1c8ebd4d1b98 req-555f3442-484e-417f-ad71-32f277bb5478 service nova] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:07:52.464867 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:07:52.465292 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:07:52.466264 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:07:52.482885 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:07:52.483107 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:07:52.495764 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:52.530751 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 106, target: iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc, portal: 192.168.40.100,3260]
May 28 10:07:52.530751 np0000001613 nova-compute[98321]: Logout of [sid: 106, target: iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc, portal: 192.168.40.100,3260] successful.
May 28 10:07:52.530751 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:52.547115 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:52.559781 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:52.591799 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 107, target: iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc, portal: 192.168.50.100,3260]
May 28 10:07:52.591799 np0000001613 nova-compute[98321]: Logout of [sid: 107, target: iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc, portal: 192.168.50.100,3260] successful.
May 28 10:07:52.591799 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:52.605387 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:52.605755 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:07:52.605907 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] <== disconnect_volume: return (359ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:07:52.606022 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:07:52.606320 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Deleting instance files /opt/stack/data/nova/instances/742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f_del
May 28 10:07:52.607015 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Deletion of /opt/stack/data/nova/instances/742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f_del complete
May 28 10:07:52.631323 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-e5f61c15-6d10-47e4-b5cf-65d81d4cbe60 req-ec65a4ad-5613-4b46-819d-8f6e46eac37b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:07:52.693423 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779962872.6930192, 90a9853a-2830-42b5-912d-72188187a375 => ua-86fdd88f-65c7-470f-a246-ed1cb75bf5da> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 10:07:52.693868 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-86fdd88f-65c7-470f-a246-ed1cb75bf5da for instance 90a9853a-2830-42b5-912d-72188187a375 {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 10:07:52.697310 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Successfully detached device vdc from instance 90a9853a-2830-42b5-912d-72188187a375 from the live domain config.
May 28 10:07:52.698346 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:07:52.699232 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da', 'iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '86fdd88f-65c7-470f-a246-ed1cb75bf5da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:07:52.699408 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:07:52.702444 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:07:52.702918 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da', 'iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '86fdd88f-65c7-470f-a246-ed1cb75bf5da', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:07:52.703097 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:07:52.728688 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:52.728688 np0000001613 nova-compute[98321]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:52.728688 np0000001613 nova-compute[98321]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da (non-flash)
May 28 10:07:52.728688 np0000001613 nova-compute[98321]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da (non-flash)
May 28 10:07:52.728688 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:07:52.728890 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsi session list stdout=tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:52.728890 np0000001613 nova-compute[98321]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:07:52.728890 np0000001613 nova-compute[98321]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da (non-flash)
May 28 10:07:52.728890 np0000001613 nova-compute[98321]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da (non-flash)
May 28 10:07:52.728890 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:07:52.728985 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b', '108'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b', '109'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da', '118'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da', '119')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:07:52.729109 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da', '118')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:07:52.730240 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da', '119')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:07:52.730869 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1f4716f20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da'): ({'sdk'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:07:52.731052 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Removing multipathed devices sdj, sdk {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:07:52.731301 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Flush multipath device 330000000edbbb52d {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:07:52.766773 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-e5f61c15-6d10-47e4-b5cf-65d81d4cbe60 req-ec65a4ad-5613-4b46-819d-8f6e46eac37b service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Updated VIF entry in instance network info cache for port 5724dc5f-94cc-45c9-ac48-670de0fa781f. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:07:52.767053 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-e5f61c15-6d10-47e4-b5cf-65d81d4cbe60 req-ec65a4ad-5613-4b46-819d-8f6e46eac37b service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Updating instance_info_cache with network_info: [{"id": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "address": "fa:16:3e:b6:e0:3d", "network": {"id": "5264d7e4-aeaa-4172-8f4e-f2845bb783e6", "bridge": null, "label": "tempest-TestShelveInstance-1746959726-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92aad30ae7cf45cbb0233727a1e77316", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap5724dc5f-94", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:07:52.777022 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:07:52.791688 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:07:52.792111 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:07:52.828913 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:07:52.887710 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:07:52.887866 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:07:52.888636 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:07:52.900232 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:07:52.900464 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:07:52.912113 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:52.940692 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-14bee18f-d982-459d-94ff-1c8ebd4d1b98 req-555f3442-484e-417f-ad71-32f277bb5478 service nova] Releasing lock "refresh_cache-8dd03b27-b9a0-4260-94db-b3aec44b8faa" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:07:52.941288 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquired lock "refresh_cache-8dd03b27-b9a0-4260-94db-b3aec44b8faa" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:07:52.941475 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:07:52.953748 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 118, target: iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da, portal: 192.168.40.100,3260]
May 28 10:07:52.953748 np0000001613 nova-compute[98321]: Logout of [sid: 118, target: iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da, portal: 192.168.40.100,3260] successful.
May 28 10:07:52.953748 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:52.968367 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:52.980249 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:53.008227 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 119, target: iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da, portal: 192.168.50.100,3260]
May 28 10:07:53.008227 np0000001613 nova-compute[98321]: Logout of [sid: 119, target: iqn.2023-03.storpool.com:os--volume-86fdd88f-65c7-470f-a246-ed1cb75bf5da, portal: 192.168.50.100,3260] successful.
May 28 10:07:53.008227 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:53.023368 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:07:53.023553 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:07:53.023678 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] <== disconnect_volume: return (324ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:07:53.023935 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:07:53.268860 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e5f61c15-6d10-47e4-b5cf-65d81d4cbe60 req-ec65a4ad-5613-4b46-819d-8f6e46eac37b service nova] Releasing lock "refresh_cache-742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:07:53.271106 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0004648290000659472 future=<Future at 0x73c1fc21cf20 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:07:53.271199 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:07:53.271296 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=10.79016013599994 future=<Future at 0x73c1fc528fb0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:07:53.271358 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=10.790089153999816 future=<Future at 0x73c1fc528fb0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:07:53.271729 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Emitting event <LifecycleEvent: 1779962858.2705598, 11a2b3e7-1061-4a51-b520-113e13221658 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:07:53.271861 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] VM Stopped (Lifecycle Event)
May 28 10:07:53.505017 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:07:53.568468 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lazy-loading 'flavor' on Instance uuid 90a9853a-2830-42b5-912d-72188187a375 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:07:53.683950 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:07:53.774546 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 11a2b3e7-1061-4a51-b520-113e13221658] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:07:53.788193 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:07:53.788562 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:07:53.791263 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:07:53.791572 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:07:53.827862 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Updating instance_info_cache with network_info: [{"id": "89ba5187-e41f-4177-acdd-6f3586ba93ef", "address": "fa:16:3e:05:51:2a", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ba5187-e4", "ovs_interfaceid": "89ba5187-e41f-4177-acdd-6f3586ba93ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:07:54.304037 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Deleted allocations for instance 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f
May 28 10:07:54.329831 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Releasing lock "refresh_cache-8dd03b27-b9a0-4260-94db-b3aec44b8faa" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:07:54.330180 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Instance network_info: |[{"id": "89ba5187-e41f-4177-acdd-6f3586ba93ef", "address": "fa:16:3e:05:51:2a", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ba5187-e4", "ovs_interfaceid": "89ba5187-e41f-4177-acdd-6f3586ba93ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:07:54.331962 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Start _get_guest_xml network_info=[{"id": "89ba5187-e41f-4177-acdd-6f3586ba93ef", "address": "fa:16:3e:05:51:2a", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ba5187-e4", "ovs_interfaceid": "89ba5187-e41f-4177-acdd-6f3586ba93ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:07:54.334626 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:07:54.336046 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-543879227', uuid='8dd03b27-b9a0-4260-94db-b3aec44b8faa'), owner=OwnerMeta(userid='961948be669c4a18a29398d53015f03b', username='tempest-TestEncryptedCinderVolumes-297752033-project-member', projectid='c7563a83d33d4bc1a6610ccf53c18dc1', projectname='tempest-TestEncryptedCinderVolumes-297752033'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "89ba5187-e41f-4177-acdd-6f3586ba93ef", "address": "fa:16:3e:05:51:2a", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ba5187-e4", "ovs_interfaceid": "89ba5187-e41f-4177-acdd-6f3586ba93ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962874.335642) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:07:54.337374 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:07:54.337679 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:07:54.339033 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:07:54.339200 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:07:54.340261 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:07:54.340563 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:07:54.340942 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:07:54.341062 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:07:54.341190 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:07:54.341277 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:07:54.341364 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:07:54.341522 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:07:54.341664 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:07:54.341782 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:07:54.341913 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:07:54.342085 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:07:54.352497 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:07:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-543879227',display_name='tempest-TestEncryptedCinderVolumes-server-543879227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testencryptedcindervolumes-server-543879227',id=49,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhD8MxtW4RijbsKwVkG76SNAeOnfVZvduCNZcLVoQoADLqIAynSMviek4psdSW8NAGLJK/69jV6BnHokZz6cKk5DpAZ+sNEacIwyW9D+d8FkFNRW7loXw2z71arEVjk3Q==',key_name='tempest-keypair-1926094233',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7563a83d33d4bc1a6610ccf53c18dc1',ramdisk_id='',reservation_id='r-wl8ca4td',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-297752033',owner_user_name='tempest-TestEncryptedCinderVolumes-297752033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:07:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='961948be669c4a18a29398d53015f03b',uuid=8dd03b27-b9a0-4260-94db-b3aec44b8faa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89ba5187-e41f-4177-acdd-6f3586ba93ef", "address": "fa:16:3e:05:51:2a", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ba5187-e4", "ovs_interfaceid": "89ba5187-e41f-4177-acdd-6f3586ba93ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:07:54.353133 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Converting VIF {"id": "89ba5187-e41f-4177-acdd-6f3586ba93ef", "address": "fa:16:3e:05:51:2a", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ba5187-e4", "ovs_interfaceid": "89ba5187-e41f-4177-acdd-6f3586ba93ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:07:54.353700 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:51:2a,bridge_name='br-int',has_traffic_filtering=True,id=89ba5187-e41f-4177-acdd-6f3586ba93ef,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89ba5187-e4') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:07:54.354550 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lazy-loading 'pci_devices' on Instance uuid 8dd03b27-b9a0-4260-94db-b3aec44b8faa {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:07:54.578574 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d8847079-70b4-4bd0-af79-217659d6d901 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "90a9853a-2830-42b5-912d-72188187a375" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.027s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:54.690593 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:54.791487 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:07:54.808944 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:54.809654 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:54.857783 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] End _get_guest_xml xml=<domain type="qemu">
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:   <uuid>8dd03b27-b9a0-4260-94db-b3aec44b8faa</uuid>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:   <name>instance-00000031</name>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-543879227</nova:name>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:07:54</nova:creationTime>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:         <nova:user uuid="961948be669c4a18a29398d53015f03b">tempest-TestEncryptedCinderVolumes-297752033-project-member</nova:user>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:         <nova:project uuid="c7563a83d33d4bc1a6610ccf53c18dc1">tempest-TestEncryptedCinderVolumes-297752033</nova:project>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:         <nova:port uuid="89ba5187-e41f-4177-acdd-6f3586ba93ef">
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:     <system>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:       <entry name="serial">8dd03b27-b9a0-4260-94db-b3aec44b8faa</entry>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:       <entry name="uuid">8dd03b27-b9a0-4260-94db-b3aec44b8faa</entry>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:     </system>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:   <os>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:   </os>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:   <features>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:   </features>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:   <devices>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/8dd03b27-b9a0-4260-94db-b3aec44b8faa/disk"/>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:     </disk>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/8dd03b27-b9a0-4260-94db-b3aec44b8faa/disk.config"/>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:     </disk>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:05:51:2a"/>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:       <target dev="tap89ba5187-e4"/>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:     </interface>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/8dd03b27-b9a0-4260-94db-b3aec44b8faa/console.log" append="off"/>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:     </serial>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:     <video>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:     </video>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:     </rng>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:   </devices>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]: </domain>
May 28 10:07:54.857783 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:07:54.859593 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Preparing to wait for external event network-vif-plugged-89ba5187-e41f-4177-acdd-6f3586ba93ef {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:07:54.859593 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "8dd03b27-b9a0-4260-94db-b3aec44b8faa-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:54.859593 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "8dd03b27-b9a0-4260-94db-b3aec44b8faa-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:54.859593 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "8dd03b27-b9a0-4260-94db-b3aec44b8faa-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:54.859593 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:07:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-543879227',display_name='tempest-TestEncryptedCinderVolumes-server-543879227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testencryptedcindervolumes-server-543879227',id=49,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhD8MxtW4RijbsKwVkG76SNAeOnfVZvduCNZcLVoQoADLqIAynSMviek4psdSW8NAGLJK/69jV6BnHokZz6cKk5DpAZ+sNEacIwyW9D+d8FkFNRW7loXw2z71arEVjk3Q==',key_name='tempest-keypair-1926094233',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7563a83d33d4bc1a6610ccf53c18dc1',ramdisk_id='',reservation_id='r-wl8ca4td',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-297752033',owner_user_name='tempest-TestEncryptedCinderVolumes-297752033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:07:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='961948be669c4a18a29398d53015f03b',uuid=8dd03b27-b9a0-4260-94db-b3aec44b8faa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89ba5187-e41f-4177-acdd-6f3586ba93ef", "address": "fa:16:3e:05:51:2a", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ba5187-e4", "ovs_interfaceid": "89ba5187-e41f-4177-acdd-6f3586ba93ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:07:54.859593 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Converting VIF {"id": "89ba5187-e41f-4177-acdd-6f3586ba93ef", "address": "fa:16:3e:05:51:2a", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ba5187-e4", "ovs_interfaceid": "89ba5187-e41f-4177-acdd-6f3586ba93ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:07:54.860035 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:51:2a,bridge_name='br-int',has_traffic_filtering=True,id=89ba5187-e41f-4177-acdd-6f3586ba93ef,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89ba5187-e4') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:07:54.860259 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:51:2a,bridge_name='br-int',has_traffic_filtering=True,id=89ba5187-e41f-4177-acdd-6f3586ba93ef,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89ba5187-e4') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:07:54.860615 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:54.860911 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:07:54.861175 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:07:54.862057 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:54.862501 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b3de13f8-e909-53a8-829f-ad6d0d47299f', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:07:54.863251 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:54.864410 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:07:54.864788 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:54.866604 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:54.866786 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89ba5187-e4, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:07:54.867190 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap89ba5187-e4, col_values=(('qos', UUID('d4c9f98e-a0e2-4cea-b930-83a545d89180')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:07:54.867420 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap89ba5187-e4, col_values=(('external_ids', {'iface-id': '89ba5187-e41f-4177-acdd-6f3586ba93ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:51:2a', 'vm-uuid': '8dd03b27-b9a0-4260-94db-b3aec44b8faa'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:07:54.868672 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:54.870063 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:07:54.875231 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:54.876271 np0000001613 nova-compute[98321]: INFO os_vif [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:51:2a,bridge_name='br-int',has_traffic_filtering=True,id=89ba5187-e41f-4177-acdd-6f3586ba93ef,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89ba5187-e4')
May 28 10:07:54.968812 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-833e204e-1c98-4e47-bb1f-12042afc8c55 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "90a9853a-2830-42b5-912d-72188187a375" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:54.968992 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-833e204e-1c98-4e47-bb1f-12042afc8c55 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "90a9853a-2830-42b5-912d-72188187a375" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:54.969175 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-833e204e-1c98-4e47-bb1f-12042afc8c55 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "90a9853a-2830-42b5-912d-72188187a375-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:54.969326 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-833e204e-1c98-4e47-bb1f-12042afc8c55 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "90a9853a-2830-42b5-912d-72188187a375-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:54.969445 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-833e204e-1c98-4e47-bb1f-12042afc8c55 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "90a9853a-2830-42b5-912d-72188187a375-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:54.971330 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-833e204e-1c98-4e47-bb1f-12042afc8c55 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Terminating instance
May 28 10:07:55.001772 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:07:55.002054 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:07:55.297755 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:55.475866 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-833e204e-1c98-4e47-bb1f-12042afc8c55 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:07:55.500410 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:55.505693 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:07:55.521678 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:55.551643 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:55.655257 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-02493ca4-576d-4763-a592-4c5bdb7d3e9a req-fa1148bd-b4ec-4458-b184-a4fa9196e5b5 service nova] [instance: 90a9853a-2830-42b5-912d-72188187a375] Received event network-vif-unplugged-b2d3f59b-ddbc-4c8d-871c-e169b41b4241 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:07:55.655721 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-02493ca4-576d-4763-a592-4c5bdb7d3e9a req-fa1148bd-b4ec-4458-b184-a4fa9196e5b5 service nova] Acquiring lock "90a9853a-2830-42b5-912d-72188187a375-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:55.655831 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-02493ca4-576d-4763-a592-4c5bdb7d3e9a req-fa1148bd-b4ec-4458-b184-a4fa9196e5b5 service nova] Lock "90a9853a-2830-42b5-912d-72188187a375-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:55.655929 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-02493ca4-576d-4763-a592-4c5bdb7d3e9a req-fa1148bd-b4ec-4458-b184-a4fa9196e5b5 service nova] Lock "90a9853a-2830-42b5-912d-72188187a375-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:55.656062 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-02493ca4-576d-4763-a592-4c5bdb7d3e9a req-fa1148bd-b4ec-4458-b184-a4fa9196e5b5 service nova] [instance: 90a9853a-2830-42b5-912d-72188187a375] No waiting events found dispatching network-vif-unplugged-b2d3f59b-ddbc-4c8d-871c-e169b41b4241 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:07:55.656201 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-02493ca4-576d-4763-a592-4c5bdb7d3e9a req-fa1148bd-b4ec-4458-b184-a4fa9196e5b5 service nova] [instance: 90a9853a-2830-42b5-912d-72188187a375] Received event network-vif-unplugged-b2d3f59b-ddbc-4c8d-871c-e169b41b4241 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:07:55.832567 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999608652000006 future=<Future at 0x73c1f418f830 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:07:55.834591 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 90a9853a-2830-42b5-912d-72188187a375] Instance destroyed successfully.
May 28 10:07:55.835401 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-833e204e-1c98-4e47-bb1f-12042afc8c55 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lazy-loading 'resources' on Instance uuid 90a9853a-2830-42b5-912d-72188187a375 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:07:56.014410 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.205s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:56.016692 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.719s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:56.016901 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:56.017114 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Auditing locally available compute resources for np0000001613 (node: np0000001613) {{(pid=98321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 10:07:56.078156 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Acquiring lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:56.337803 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-833e204e-1c98-4e47-bb1f-12042afc8c55 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:06:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-960398528',display_name='tempest-AttachVolumeTestJSON-server-960398528',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-attachvolumetestjson-server-960398528',id=46,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGc8jy6qlktFOlu4FSKfsI8iNg23Far8omcyRNXidV2sz+82AOt/P767HJGln5GU3WJ/VpsWOAWYg0rUbVBiC2aLaqarSBoy78+d0r2HWDkJCuYYq5u/WF9GMLYwHjHnKw==',key_name='tempest-keypair-1262128770',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:06:46Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f2d040c323b4b948803334de7c8ec44',ramdisk_id='',reservation_id='r-86c1v5ko',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1743003640',owner_user_name='tempest-AttachVolumeTestJSON-1743003640-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:06:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c88efa7ed26463d928a0e4228dca6cf',uuid=90a9853a-2830-42b5-912d-72188187a375,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2d3f59b-ddbc-4c8d-871c-e169b41b4241", "address": "fa:16:3e:59:15:c3", "network": {"id": "cfc0fcd2-826d-4851-bc3e-3f0433d6fbce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1771427851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f2d040c323b4b948803334de7c8ec44", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2d3f59b-dd", "ovs_interfaceid": "b2d3f59b-ddbc-4c8d-871c-e169b41b4241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:07:56.338060 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-833e204e-1c98-4e47-bb1f-12042afc8c55 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Converting VIF {"id": "b2d3f59b-ddbc-4c8d-871c-e169b41b4241", "address": "fa:16:3e:59:15:c3", "network": {"id": "cfc0fcd2-826d-4851-bc3e-3f0433d6fbce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1771427851-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6f2d040c323b4b948803334de7c8ec44", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2d3f59b-dd", "ovs_interfaceid": "b2d3f59b-ddbc-4c8d-871c-e169b41b4241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:07:56.338520 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-833e204e-1c98-4e47-bb1f-12042afc8c55 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:15:c3,bridge_name='br-int',has_traffic_filtering=True,id=b2d3f59b-ddbc-4c8d-871c-e169b41b4241,network=Network(cfc0fcd2-826d-4851-bc3e-3f0433d6fbce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2d3f59b-dd') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:07:56.338735 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-833e204e-1c98-4e47-bb1f-12042afc8c55 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:15:c3,bridge_name='br-int',has_traffic_filtering=True,id=b2d3f59b-ddbc-4c8d-871c-e169b41b4241,network=Network(cfc0fcd2-826d-4851-bc3e-3f0433d6fbce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2d3f59b-dd') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:07:56.339487 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:56.339672 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2d3f59b-dd, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:07:56.340710 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:56.341469 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:07:56.346938 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:56.347713 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:56.347867 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed65c334-6b08-49d7-952a-c977eb43d3b4) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:07:56.348376 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:56.348901 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:07:56.354147 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:56.356365 np0000001613 nova-compute[98321]: INFO os_vif [None req-833e204e-1c98-4e47-bb1f-12042afc8c55 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:15:c3,bridge_name='br-int',has_traffic_filtering=True,id=b2d3f59b-ddbc-4c8d-871c-e169b41b4241,network=Network(cfc0fcd2-826d-4851-bc3e-3f0433d6fbce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2d3f59b-dd')
May 28 10:07:56.356711 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-833e204e-1c98-4e47-bb1f-12042afc8c55 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Deleting instance files /opt/stack/data/nova/instances/90a9853a-2830-42b5-912d-72188187a375_del
May 28 10:07:56.357566 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-833e204e-1c98-4e47-bb1f-12042afc8c55 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Deletion of /opt/stack/data/nova/instances/90a9853a-2830-42b5-912d-72188187a375_del complete
May 28 10:07:56.395959 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:07:56.396119 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:07:56.396216 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] No VIF found with MAC fa:16:3e:05:51:2a, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:07:56.396710 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Using config drive
May 28 10:07:56.520452 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc1e3bd0-2898-47fa-be21-48423c5b37af tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 8.812s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:56.521068 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.443s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:56.521310 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Unshelving
May 28 10:07:56.673790 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8943d546-56b5-438b-9250-6b819a14f245 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "4bf236ff-8072-4c54-acbe-dfe41add8500" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:56.674408 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8943d546-56b5-438b-9250-6b819a14f245 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "4bf236ff-8072-4c54-acbe-dfe41add8500" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:56.674408 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8943d546-56b5-438b-9250-6b819a14f245 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:07:56.676296 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8943d546-56b5-438b-9250-6b819a14f245 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98321) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 28 10:07:56.676790 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-8943d546-56b5-438b-9250-6b819a14f245 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lazy-loading 'flavor' on Instance uuid 4bf236ff-8072-4c54-acbe-dfe41add8500 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:07:56.863857 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-833e204e-1c98-4e47-bb1f-12042afc8c55 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Took 1.39 seconds to destroy the instance on the hypervisor.
May 28 10:07:56.864470 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-833e204e-1c98-4e47-bb1f-12042afc8c55 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:07:56.864677 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 90a9853a-2830-42b5-912d-72188187a375] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:07:56.864755 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 90a9853a-2830-42b5-912d-72188187a375] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:07:56.864972 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:07:56.904559 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:07:56.928962 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:07:57.038362 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Error from libvirt while getting description of instance-0000002e: [Error Code 42] Domain not found: no domain with matching uuid '90a9853a-2830-42b5-912d-72188187a375' (instance-0000002e): libvirt.libvirtError: Domain not found: no domain with matching uuid '90a9853a-2830-42b5-912d-72188187a375' (instance-0000002e)
May 28 10:07:57.040655 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd03b27-b9a0-4260-94db-b3aec44b8faa/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:07:57.063720 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Creating config drive at /opt/stack/data/nova/instances/8dd03b27-b9a0-4260-94db-b3aec44b8faa/disk.config
May 28 10:07:57.072767 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8dd03b27-b9a0-4260-94db-b3aec44b8faa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpn6dcgwf_ {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:07:57.132480 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8dd03b27-b9a0-4260-94db-b3aec44b8faa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpn6dcgwf_" returned: 0 in 0.059s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:07:57.133207 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd03b27-b9a0-4260-94db-b3aec44b8faa/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:07:57.134033 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd03b27-b9a0-4260-94db-b3aec44b8faa/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:07:57.222821 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd03b27-b9a0-4260-94db-b3aec44b8faa/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:07:57.226141 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:07:57.228291 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:07:57.229358 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:07:57.276223 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "env LANG=C uptime" returned: 0 in 0.047s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:07:57.276641 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Hypervisor/Node resource view: name=np0000001613 free_ram=13484MB free_disk=73.88469314575195GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 10:07:57.276804 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:57.277089 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:57.530827 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Booting with volume ec1e6963-9189-4750-a397-d2bc2ab54efc at /dev/vda
May 28 10:07:57.581698 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:07:57.597426 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:07:57.621301 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:57.628414 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:07:57.649083 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:57.678893 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:07:57.679294 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:07:57.695817 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:07:57.701859 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fee8:3758', 'fe80::e4eb:4cff:fe5c:5eb7', 'fe80::fc16:3eff:fe05:512a'] 
May 28 10:07:57.701859 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:07:57.701859 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:07:57.701859 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:07:57.701859 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Updating existing volume attachment record: 769ee94c-d552-41c5-996b-0d209c88a7c2 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:07:57.738974 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:57.741523 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:57.749410 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f9154b1e-9a5c-4097-9576-f5060cbf8089 req-4c22d2a9-a620-4aee-bc9b-e1932cc43f5f service nova] [instance: 90a9853a-2830-42b5-912d-72188187a375] Received event network-vif-unplugged-b2d3f59b-ddbc-4c8d-871c-e169b41b4241 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:07:57.749410 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f9154b1e-9a5c-4097-9576-f5060cbf8089 req-4c22d2a9-a620-4aee-bc9b-e1932cc43f5f service nova] Acquiring lock "90a9853a-2830-42b5-912d-72188187a375-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:57.750751 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f9154b1e-9a5c-4097-9576-f5060cbf8089 req-4c22d2a9-a620-4aee-bc9b-e1932cc43f5f service nova] Lock "90a9853a-2830-42b5-912d-72188187a375-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:57.752680 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f9154b1e-9a5c-4097-9576-f5060cbf8089 req-4c22d2a9-a620-4aee-bc9b-e1932cc43f5f service nova] Lock "90a9853a-2830-42b5-912d-72188187a375-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:57.753062 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f9154b1e-9a5c-4097-9576-f5060cbf8089 req-4c22d2a9-a620-4aee-bc9b-e1932cc43f5f service nova] [instance: 90a9853a-2830-42b5-912d-72188187a375] No waiting events found dispatching network-vif-unplugged-b2d3f59b-ddbc-4c8d-871c-e169b41b4241 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:07:57.753232 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f9154b1e-9a5c-4097-9576-f5060cbf8089 req-4c22d2a9-a620-4aee-bc9b-e1932cc43f5f service nova] [instance: 90a9853a-2830-42b5-912d-72188187a375] Received event network-vif-unplugged-b2d3f59b-ddbc-4c8d-871c-e169b41b4241 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:07:57.753395 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f9154b1e-9a5c-4097-9576-f5060cbf8089 req-4c22d2a9-a620-4aee-bc9b-e1932cc43f5f service nova] [instance: 90a9853a-2830-42b5-912d-72188187a375] Received event network-vif-deleted-b2d3f59b-ddbc-4c8d-871c-e169b41b4241 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:07:57.753543 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-f9154b1e-9a5c-4097-9576-f5060cbf8089 req-4c22d2a9-a620-4aee-bc9b-e1932cc43f5f service nova] [instance: 90a9853a-2830-42b5-912d-72188187a375] Neutron deleted interface b2d3f59b-ddbc-4c8d-871c-e169b41b4241; detaching it from the instance and deleting it from the info cache
May 28 10:07:57.767568 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f9154b1e-9a5c-4097-9576-f5060cbf8089 req-4c22d2a9-a620-4aee-bc9b-e1932cc43f5f service nova] [instance: 90a9853a-2830-42b5-912d-72188187a375] Detach interface failed, port_id=b2d3f59b-ddbc-4c8d-871c-e169b41b4241, reason: Instance 90a9853a-2830-42b5-912d-72188187a375 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:07:57.774196 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:57.779549 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:57.871770 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-77ef5c4d-4d66-433a-ac84-a779d2c38859 req-018b9ec5-6acb-49e5-bccb-0ab94e186c03 service nova] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Received event network-vif-plugged-89ba5187-e41f-4177-acdd-6f3586ba93ef {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:07:57.872008 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-77ef5c4d-4d66-433a-ac84-a779d2c38859 req-018b9ec5-6acb-49e5-bccb-0ab94e186c03 service nova] Acquiring lock "8dd03b27-b9a0-4260-94db-b3aec44b8faa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:57.872226 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-77ef5c4d-4d66-433a-ac84-a779d2c38859 req-018b9ec5-6acb-49e5-bccb-0ab94e186c03 service nova] Lock "8dd03b27-b9a0-4260-94db-b3aec44b8faa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:57.873008 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-77ef5c4d-4d66-433a-ac84-a779d2c38859 req-018b9ec5-6acb-49e5-bccb-0ab94e186c03 service nova] Lock "8dd03b27-b9a0-4260-94db-b3aec44b8faa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:57.873134 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-77ef5c4d-4d66-433a-ac84-a779d2c38859 req-018b9ec5-6acb-49e5-bccb-0ab94e186c03 service nova] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Processing event network-vif-plugged-89ba5187-e41f-4177-acdd-6f3586ba93ef {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:07:57.932292 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 90a9853a-2830-42b5-912d-72188187a375] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:07:58.035381 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:58.043913 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:58.046124 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999724568999682 future=<Future at 0x73c1f43e08c0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:07:58.048711 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Instance destroyed successfully.
May 28 10:07:58.049792 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-8943d546-56b5-438b-9250-6b819a14f245 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lazy-loading 'numa_topology' on Instance uuid 4bf236ff-8072-4c54-acbe-dfe41add8500 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:07:58.050089 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:58.077091 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:58.084880 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:58.233554 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:58.266063 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:58.357431 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 90a9853a-2830-42b5-912d-72188187a375 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:07:58.357431 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 4bf236ff-8072-4c54-acbe-dfe41add8500 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:07:58.357431 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 8dd03b27-b9a0-4260-94db-b3aec44b8faa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:07:58.436320 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 90a9853a-2830-42b5-912d-72188187a375] Took 1.57 seconds to deallocate network for instance.
May 28 10:07:58.511626 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962878.5112429, 8dd03b27-b9a0-4260-94db-b3aec44b8faa => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:07:58.511808 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] VM Started (Lifecycle Event)
May 28 10:07:58.513360 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:07:58.516197 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:07:58.518864 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Instance spawned successfully.
May 28 10:07:58.519302 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:07:58.552142 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-8943d546-56b5-438b-9250-6b819a14f245 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Object Instance<4bf236ff-8072-4c54-acbe-dfe41add8500> lazy-loaded attributes: flavor,numa_topology {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:07:58.552477 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8943d546-56b5-438b-9250-6b819a14f245 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:07:58.860393 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 28 10:07:58.861889 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 10:07:58.861889 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Final resource view: name=np0000001613 phys_ram=24030MB used_ram=1088MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 10:07:57 up 40 min,  2 users,  load average: 6.22, 7.44, 4.80\n', 'num_instances': '3', 'num_vm_active': '2', 'num_task_powering-off': '1', 'num_os_type_None': '3', 'num_proj_23e9651268114327a9cc6c6c59bef01e': '1', 'io_workload': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_c7563a83d33d4bc1a6610ccf53c18dc1': '1', 'num_task_deleting': '1', 'num_proj_6f2d040c323b4b948803334de7c8ec44': '1'} {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 10:07:58.946051 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-833e204e-1c98-4e47-bb1f-12042afc8c55 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:59.014509 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:07:59.016778 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:07:59.025564 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:07:59.025564 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:07:59.025953 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:07:59.026246 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:07:59.026547 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:07:59.026852 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:07:59.061137 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8943d546-56b5-438b-9250-6b819a14f245 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "4bf236ff-8072-4c54-acbe-dfe41add8500" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.387s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:59.147588 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:07:59.148128 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:07:59.388714 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:59.519220 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:07:59.519740 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962879.519444, 8dd03b27-b9a0-4260-94db-b3aec44b8faa => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:07:59.519900 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] VM Paused (Lifecycle Event)
May 28 10:07:59.533241 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Took 7.69 seconds to spawn the instance on the hypervisor.
May 28 10:07:59.533241 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:07:59.650585 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:07:59.692699 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:07:59.947519 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ec5dda33-3b93-417b-b085-de9a2ef7b36b req-6260c4b7-f5f1-4c21-89a9-de8e60f402a5 service nova] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Received event network-vif-plugged-89ba5187-e41f-4177-acdd-6f3586ba93ef {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:07:59.947519 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ec5dda33-3b93-417b-b085-de9a2ef7b36b req-6260c4b7-f5f1-4c21-89a9-de8e60f402a5 service nova] Acquiring lock "8dd03b27-b9a0-4260-94db-b3aec44b8faa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:59.947519 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ec5dda33-3b93-417b-b085-de9a2ef7b36b req-6260c4b7-f5f1-4c21-89a9-de8e60f402a5 service nova] Lock "8dd03b27-b9a0-4260-94db-b3aec44b8faa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:59.947519 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ec5dda33-3b93-417b-b085-de9a2ef7b36b req-6260c4b7-f5f1-4c21-89a9-de8e60f402a5 service nova] Lock "8dd03b27-b9a0-4260-94db-b3aec44b8faa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:59.947519 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ec5dda33-3b93-417b-b085-de9a2ef7b36b req-6260c4b7-f5f1-4c21-89a9-de8e60f402a5 service nova] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] No waiting events found dispatching network-vif-plugged-89ba5187-e41f-4177-acdd-6f3586ba93ef {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:07:59.947519 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-ec5dda33-3b93-417b-b085-de9a2ef7b36b req-6260c4b7-f5f1-4c21-89a9-de8e60f402a5 service nova] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Received unexpected event network-vif-plugged-89ba5187-e41f-4177-acdd-6f3586ba93ef for instance with vm_state active and task_state None.
May 28 10:07:59.947519 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ec5dda33-3b93-417b-b085-de9a2ef7b36b req-6260c4b7-f5f1-4c21-89a9-de8e60f402a5 service nova] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Received event network-vif-unplugged-190dc367-d313-445f-b96c-4a9cbc6116bd {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:07:59.947519 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ec5dda33-3b93-417b-b085-de9a2ef7b36b req-6260c4b7-f5f1-4c21-89a9-de8e60f402a5 service nova] Acquiring lock "4bf236ff-8072-4c54-acbe-dfe41add8500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:59.947519 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ec5dda33-3b93-417b-b085-de9a2ef7b36b req-6260c4b7-f5f1-4c21-89a9-de8e60f402a5 service nova] Lock "4bf236ff-8072-4c54-acbe-dfe41add8500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:59.947519 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ec5dda33-3b93-417b-b085-de9a2ef7b36b req-6260c4b7-f5f1-4c21-89a9-de8e60f402a5 service nova] Lock "4bf236ff-8072-4c54-acbe-dfe41add8500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:59.948488 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ec5dda33-3b93-417b-b085-de9a2ef7b36b req-6260c4b7-f5f1-4c21-89a9-de8e60f402a5 service nova] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] No waiting events found dispatching network-vif-unplugged-190dc367-d313-445f-b96c-4a9cbc6116bd {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:07:59.948984 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-ec5dda33-3b93-417b-b085-de9a2ef7b36b req-6260c4b7-f5f1-4c21-89a9-de8e60f402a5 service nova] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Received unexpected event network-vif-unplugged-190dc367-d313-445f-b96c-4a9cbc6116bd for instance with vm_state stopped and task_state None.
May 28 10:07:59.949220 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ec5dda33-3b93-417b-b085-de9a2ef7b36b req-6260c4b7-f5f1-4c21-89a9-de8e60f402a5 service nova] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Received event network-vif-unplugged-190dc367-d313-445f-b96c-4a9cbc6116bd {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:07:59.949473 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ec5dda33-3b93-417b-b085-de9a2ef7b36b req-6260c4b7-f5f1-4c21-89a9-de8e60f402a5 service nova] Acquiring lock "4bf236ff-8072-4c54-acbe-dfe41add8500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:07:59.950277 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ec5dda33-3b93-417b-b085-de9a2ef7b36b req-6260c4b7-f5f1-4c21-89a9-de8e60f402a5 service nova] Lock "4bf236ff-8072-4c54-acbe-dfe41add8500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:07:59.950277 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ec5dda33-3b93-417b-b085-de9a2ef7b36b req-6260c4b7-f5f1-4c21-89a9-de8e60f402a5 service nova] Lock "4bf236ff-8072-4c54-acbe-dfe41add8500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:07:59.950277 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ec5dda33-3b93-417b-b085-de9a2ef7b36b req-6260c4b7-f5f1-4c21-89a9-de8e60f402a5 service nova] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] No waiting events found dispatching network-vif-unplugged-190dc367-d313-445f-b96c-4a9cbc6116bd {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:07:59.950277 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-ec5dda33-3b93-417b-b085-de9a2ef7b36b req-6260c4b7-f5f1-4c21-89a9-de8e60f402a5 service nova] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Received unexpected event network-vif-unplugged-190dc367-d313-445f-b96c-4a9cbc6116bd for instance with vm_state stopped and task_state None.
May 28 10:08:00.022536 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:08:00.025612 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962880.0253358, 8dd03b27-b9a0-4260-94db-b3aec44b8faa => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:08:00.025750 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] VM Resumed (Lifecycle Event)
May 28 10:08:00.043788 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Took 13.03 seconds to build instance.
May 28 10:08:00.160938 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Compute_service record updated for np0000001613:np0000001613 {{(pid=98321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 10:08:00.161128 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.884s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:00.161602 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-833e204e-1c98-4e47-bb1f-12042afc8c55 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.215s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:00.162019 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:08:00.411560 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-833e204e-1c98-4e47-bb1f-12042afc8c55 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:08:00.411777 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-833e204e-1c98-4e47-bb1f-12042afc8c55 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:08:00.528078 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:08:00.529897 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:08:00.545470 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "8dd03b27-b9a0-4260-94db-b3aec44b8faa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.543s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:00.914448 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-833e204e-1c98-4e47-bb1f-12042afc8c55 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:08:01.162016 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:08:01.162433 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:08:01.162627 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:08:01.162777 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 10:08:01.162962 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.63 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:08:01.348695 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:01.421634 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-833e204e-1c98-4e47-bb1f-12042afc8c55 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.260s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:01.423181 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.035s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:01.425102 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lazy-loading 'pci_requests' on Instance uuid 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:08:01.478000 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-833e204e-1c98-4e47-bb1f-12042afc8c55 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Deleted allocations for instance 90a9853a-2830-42b5-912d-72188187a375
May 28 10:08:01.793956 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:08:01.794239 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 51.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:08:01.813359 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b06f7876-01a9-4af4-a9fb-5c4bddbf81af req-51e6fea7-0892-4063-b300-a61fef3f10b0 service nova] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Received event network-changed-89ba5187-e41f-4177-acdd-6f3586ba93ef {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:08:01.813444 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b06f7876-01a9-4af4-a9fb-5c4bddbf81af req-51e6fea7-0892-4063-b300-a61fef3f10b0 service nova] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Refreshing instance network info cache due to event network-changed-89ba5187-e41f-4177-acdd-6f3586ba93ef. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:08:01.813615 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b06f7876-01a9-4af4-a9fb-5c4bddbf81af req-51e6fea7-0892-4063-b300-a61fef3f10b0 service nova] Acquiring lock "refresh_cache-8dd03b27-b9a0-4260-94db-b3aec44b8faa" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:08:01.813754 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b06f7876-01a9-4af4-a9fb-5c4bddbf81af req-51e6fea7-0892-4063-b300-a61fef3f10b0 service nova] Acquired lock "refresh_cache-8dd03b27-b9a0-4260-94db-b3aec44b8faa" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:08:01.813903 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-b06f7876-01a9-4af4-a9fb-5c4bddbf81af req-51e6fea7-0892-4063-b300-a61fef3f10b0 service nova] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Refreshing network info cache for port 89ba5187-e41f-4177-acdd-6f3586ba93ef {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:08:01.930948 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lazy-loading 'numa_topology' on Instance uuid 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:08:02.319152 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-b06f7876-01a9-4af4-a9fb-5c4bddbf81af req-51e6fea7-0892-4063-b300-a61fef3f10b0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:02.433359 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:08:02.433470 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Claim successful on node np0000001613
May 28 10:08:02.489482 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-833e204e-1c98-4e47-bb1f-12042afc8c55 tempest-AttachVolumeTestJSON-1743003640 tempest-AttachVolumeTestJSON-1743003640-project-member] Lock "90a9853a-2830-42b5-912d-72188187a375" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.520s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:02.654106 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-b06f7876-01a9-4af4-a9fb-5c4bddbf81af req-51e6fea7-0892-4063-b300-a61fef3f10b0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:02.784079 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-b06f7876-01a9-4af4-a9fb-5c4bddbf81af req-51e6fea7-0892-4063-b300-a61fef3f10b0 service nova] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Updated VIF entry in instance network info cache for port 89ba5187-e41f-4177-acdd-6f3586ba93ef. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:08:02.784384 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-b06f7876-01a9-4af4-a9fb-5c4bddbf81af req-51e6fea7-0892-4063-b300-a61fef3f10b0 service nova] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Updating instance_info_cache with network_info: [{"id": "89ba5187-e41f-4177-acdd-6f3586ba93ef", "address": "fa:16:3e:05:51:2a", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ba5187-e4", "ovs_interfaceid": "89ba5187-e41f-4177-acdd-6f3586ba93ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:08:02.835016 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "4bf236ff-8072-4c54-acbe-dfe41add8500" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:02.835226 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "4bf236ff-8072-4c54-acbe-dfe41add8500" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:02.835404 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "4bf236ff-8072-4c54-acbe-dfe41add8500-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:02.835534 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "4bf236ff-8072-4c54-acbe-dfe41add8500-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:02.835649 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "4bf236ff-8072-4c54-acbe-dfe41add8500-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:02.837684 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Terminating instance
May 28 10:08:03.286495 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b06f7876-01a9-4af4-a9fb-5c4bddbf81af req-51e6fea7-0892-4063-b300-a61fef3f10b0 service nova] Releasing lock "refresh_cache-8dd03b27-b9a0-4260-94db-b3aec44b8faa" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:08:03.340526 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:08:03.344820 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Instance destroyed successfully.
May 28 10:08:03.346312 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lazy-loading 'resources' on Instance uuid 4bf236ff-8072-4c54-acbe-dfe41add8500 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:08:03.630823 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:08:03.631004 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:08:03.849389 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-563169662',display_name='tempest-TestVolumeBootPattern-server-563169662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpattern-server-563169662',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDs54Ij9XFUF6tRV5b5bEDXre210mTz8/6r5idMEptiDTrfpudxGYW9wHj5Wtoi+AHTlKSnGQ+4g6kAwxCoZui4NBEucM8fxkVwkXyc1uSBWV2xxJzwDk4J6e+ozSWW2A==',key_name='tempest-keypair-556676766',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:07:14Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='23e9651268114327a9cc6c6c59bef01e',ramdisk_id='',reservation_id='r-90w7ea1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-327944304',owner_user_name='tempest-TestVolumeBootPattern-327944304-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:07:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec58233d3b2848bbb2e0b00650398cd1',uuid=4bf236ff-8072-4c54-acbe-dfe41add8500,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "190dc367-d313-445f-b96c-4a9cbc6116bd", "address": "fa:16:3e:e8:37:58", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap190dc367-d3", "ovs_interfaceid": "190dc367-d313-445f-b96c-4a9cbc6116bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:08:03.852219 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converting VIF {"id": "190dc367-d313-445f-b96c-4a9cbc6116bd", "address": "fa:16:3e:e8:37:58", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap190dc367-d3", "ovs_interfaceid": "190dc367-d313-445f-b96c-4a9cbc6116bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:08:03.852219 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:37:58,bridge_name='br-int',has_traffic_filtering=True,id=190dc367-d313-445f-b96c-4a9cbc6116bd,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap190dc367-d3') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:08:03.852219 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:37:58,bridge_name='br-int',has_traffic_filtering=True,id=190dc367-d313-445f-b96c-4a9cbc6116bd,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap190dc367-d3') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:08:03.853178 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:03.853863 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap190dc367-d3, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:08:03.854933 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:03.855725 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:08:03.856397 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:03.856538 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fbd84c76-427f-4801-bdb7-bb6e977a749c) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:08:03.856974 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:03.857415 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:08:03.857604 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:03.860125 np0000001613 nova-compute[98321]: INFO os_vif [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:37:58,bridge_name='br-int',has_traffic_filtering=True,id=190dc367-d313-445f-b96c-4a9cbc6116bd,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap190dc367-d3')
May 28 10:08:03.861004 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:08:03.861392 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b', 'iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '12f2ea6f-7391-4cba-87bc-b6d1e7d9028b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:08:03.861678 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:08:03.862184 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:08:03.862725 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b', 'iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '12f2ea6f-7391-4cba-87bc-b6d1e7d9028b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:08:03.862986 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:08:03.886212 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:08:03.886212 np0000001613 nova-compute[98321]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:08:03.886212 np0000001613 nova-compute[98321]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-29c027a1-df3e-4ef0-a45a-285c519b5fd2 (non-flash)
May 28 10:08:03.886212 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:08:03.889185 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:08:03.889185 np0000001613 nova-compute[98321]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b (non-flash)
May 28 10:08:03.889185 np0000001613 nova-compute[98321]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-29c027a1-df3e-4ef0-a45a-285c519b5fd2 (non-flash)
May 28 10:08:03.889185 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:08:03.889185 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b', '108'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b', '109'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-29c027a1-df3e-4ef0-a45a-285c519b5fd2', '120')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:08:03.889185 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b', '109')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:08:03.889185 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b', '108')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:08:03.889185 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc22c5e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b'): ({'sdb'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:08:03.889185 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Removing multipathed devices sdf, sdb {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:08:03.889185 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Flush multipath device 3300000006369c836 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:08:03.951990 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:08:03.995795 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:08:04.038136 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Checking to see if SCSI volumes sdf, sdb have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:08:04.041986 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] SCSI volumes sdf, sdb have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:08:04.042306 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Checking to see if device paths {'sdf', 'sdb'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:08:04.055094 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Device paths {'sdf', 'sdb'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:08:04.055094 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:08:04.062073 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.000562967999940156 future=<Future at 0x73c1fc528fb0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:08:04.062288 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:08:04.062482 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=6.769673077999869 future=<Future at 0x73c1f418f830 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:08:04.062573 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=6.769538005999948 future=<Future at 0x73c1f418f830 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:08:04.062963 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Emitting event <LifecycleEvent: 1779962869.0613763, 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:08:04.063155 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] VM Stopped (Lifecycle Event)
May 28 10:08:04.070505 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:04.104830 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 109, target: iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b, portal: 192.168.40.100,3260]
May 28 10:08:04.104830 np0000001613 nova-compute[98321]: Logout of [sid: 109, target: iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b, portal: 192.168.40.100,3260] successful.
May 28 10:08:04.104830 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:04.123621 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:04.133472 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:08:04.139088 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:04.164690 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 108, target: iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b, portal: 192.168.50.100,3260]
May 28 10:08:04.164690 np0000001613 nova-compute[98321]: Logout of [sid: 108, target: iqn.2023-03.storpool.com:os--volume-12f2ea6f-7391-4cba-87bc-b6d1e7d9028b, portal: 192.168.50.100,3260] successful.
May 28 10:08:04.164690 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:04.176430 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:04.176644 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:08:04.176760 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] <== disconnect_volume: return (315ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:08:04.176870 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:08:04.177099 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Deleting instance files /opt/stack/data/nova/instances/4bf236ff-8072-4c54-acbe-dfe41add8500_del
May 28 10:08:04.177610 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Deletion of /opt/stack/data/nova/instances/4bf236ff-8072-4c54-acbe-dfe41add8500_del complete
May 28 10:08:04.565611 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-6ab6620c-2843-4eca-b521-12081acf33e4 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:08:04.642755 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.217s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:04.642755 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:04.685609 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Took 1.34 seconds to destroy the instance on the hypervisor.
May 28 10:08:04.686359 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:08:04.686888 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:08:04.687023 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:08:04.687311 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:04.693953 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:04.706311 np0000001613 nova-compute[98321]: INFO nova.network.neutron [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Updating port 5724dc5f-94cc-45c9-ac48-670de0fa781f with attributes {'binding:host_id': 'np0000001613', 'device_owner': 'compute:nova'}
May 28 10:08:04.767296 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:05.269655 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Acquiring lock "refresh_cache-742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:08:05.269775 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Acquired lock "refresh_cache-742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:08:05.269896 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:08:05.341894 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a4f1c43c-714c-4251-a342-b75bd4aca0b0 req-3340da60-49a0-437e-ac67-8234dd4a18b3 service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Received event network-changed-5724dc5f-94cc-45c9-ac48-670de0fa781f {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:08:05.345444 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a4f1c43c-714c-4251-a342-b75bd4aca0b0 req-3340da60-49a0-437e-ac67-8234dd4a18b3 service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Refreshing instance network info cache due to event network-changed-5724dc5f-94cc-45c9-ac48-670de0fa781f. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:08:05.345629 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a4f1c43c-714c-4251-a342-b75bd4aca0b0 req-3340da60-49a0-437e-ac67-8234dd4a18b3 service nova] Acquiring lock "refresh_cache-742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:08:05.352812 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-66579a6a-3581-4de3-9d16-26a87d519f4b req-95eb5664-58f6-484b-a748-0aa86ac4e3ba service nova] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Received event network-vif-deleted-190dc367-d313-445f-b96c-4a9cbc6116bd {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:08:05.352990 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-66579a6a-3581-4de3-9d16-26a87d519f4b req-95eb5664-58f6-484b-a748-0aa86ac4e3ba service nova] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Neutron deleted interface 190dc367-d313-445f-b96c-4a9cbc6116bd; detaching it from the instance and deleting it from the info cache
May 28 10:08:05.354901 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-66579a6a-3581-4de3-9d16-26a87d519f4b req-95eb5664-58f6-484b-a748-0aa86ac4e3ba service nova] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Detach interface failed, port_id=190dc367-d313-445f-b96c-4a9cbc6116bd, reason: Instance 4bf236ff-8072-4c54-acbe-dfe41add8500 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:08:05.772586 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:05.782393 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:08:06.090156 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:06.212264 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Updating instance_info_cache with network_info: [{"id": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "address": "fa:16:3e:b6:e0:3d", "network": {"id": "5264d7e4-aeaa-4172-8f4e-f2845bb783e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1746959726-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92aad30ae7cf45cbb0233727a1e77316", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5724dc5f-94", "ovs_interfaceid": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:08:06.284320 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Took 1.60 seconds to deallocate network for instance.
May 28 10:08:06.714186 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Releasing lock "refresh_cache-742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:08:06.715173 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:08:06.715597 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a4f1c43c-714c-4251-a342-b75bd4aca0b0 req-3340da60-49a0-437e-ac67-8234dd4a18b3 service nova] Acquired lock "refresh_cache-742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:08:06.715891 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Creating image(s)
May 28 10:08:06.716315 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-a4f1c43c-714c-4251-a342-b75bd4aca0b0 req-3340da60-49a0-437e-ac67-8234dd4a18b3 service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Refreshing network info cache for port 5724dc5f-94cc-45c9-ac48-670de0fa781f {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:08:06.717320 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Did not create local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 10:08:06.717459 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Ensure instance console log exists: /opt/stack/data/nova/instances/742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:08:06.717820 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:06.717960 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:06.718075 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:06.718474 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Start _get_guest_xml network_info=[{"id": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "address": "fa:16:3e:b6:e0:3d", "network": {"id": "5264d7e4-aeaa-4172-8f4e-f2845bb783e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1746959726-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92aad30ae7cf45cbb0233727a1e77316", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5724dc5f-94", "ovs_interfaceid": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc', 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ec1e6963-9189-4750-a397-d2bc2ab54efc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f', 'attached_at': '', 'detached_at': '', 'volume_id': 'ec1e6963-9189-4750-a397-d2bc2ab54efc', 'serial': 'ec1e6963-9189-4750-a397-d2bc2ab54efc'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '769ee94c-d552-41c5-996b-0d209c88a7c2', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:08:06.722874 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:08:06.724672 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestShelveInstance-server-969313737', uuid='742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f'), owner=OwnerMeta(userid='d05aead48ddb43b6b4e52469338207ae', username='tempest-TestShelveInstance-793753334-project-member', projectid='92aad30ae7cf45cbb0233727a1e77316', projectname='tempest-TestShelveInstance-793753334'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "address": "fa:16:3e:b6:e0:3d", "network": {"id": "5264d7e4-aeaa-4172-8f4e-f2845bb783e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1746959726-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92aad30ae7cf45cbb0233727a1e77316", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5724dc5f-94", "ovs_interfaceid": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962886.7236714) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:08:06.726130 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:08:06.726415 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:08:06.727599 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:08:06.727741 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:08:06.728494 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:08:06.728731 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:08:06.728877 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:08:06.728964 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:08:06.729076 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:08:06.729155 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:08:06.729265 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:08:06.729400 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:08:06.729493 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:08:06.729613 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:08:06.729736 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:08:06.729894 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:08:06.729990 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lazy-loading 'vcpu_model' on Instance uuid 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:08:06.827663 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Took 0.54 seconds to detach 1 volumes for instance.
May 28 10:08:07.219818 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-a4f1c43c-714c-4251-a342-b75bd4aca0b0 req-3340da60-49a0-437e-ac67-8234dd4a18b3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:07.231912 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Object Instance<742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:08:07.242991 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:08:07.243263 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc', 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ec1e6963-9189-4750-a397-d2bc2ab54efc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:08:07.243369 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:08:07.243672 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:08:07.243851 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc', 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ec1e6963-9189-4750-a397-d2bc2ab54efc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:08:07.260056 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:08:07.260769 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:08:07.261370 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:08:07.262210 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:08:07.262520 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:08:07.262875 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:08:07.275156 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:08:07.275156 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:07.280016 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:08:07.280016 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:07.287386 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc] added
May 28 10:08:07.287386 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:08:07.287386 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:08:07.287386 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:08:07.287386 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:08:07.287386 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:08:07.287386 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:07.287714 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:08:07.288010 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0254(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:08:07.288318 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:08:07.292187 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc] added
May 28 10:08:07.292187 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:08:07.292187 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:08:07.292187 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:08:07.292187 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:08:07.292187 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:08:07.292187 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:07.292449 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:08:07.292490 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0305(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:08:07.292608 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:08:07.333050 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:07.333310 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:07.588056 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:08:07.589403 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:08:07.618053 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-a4f1c43c-714c-4251-a342-b75bd4aca0b0 req-3340da60-49a0-437e-ac67-8234dd4a18b3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:07.770487 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-a4f1c43c-714c-4251-a342-b75bd4aca0b0 req-3340da60-49a0-437e-ac67-8234dd4a18b3 service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Updated VIF entry in instance network info cache for port 5724dc5f-94cc-45c9-ac48-670de0fa781f. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:08:07.770791 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-a4f1c43c-714c-4251-a342-b75bd4aca0b0 req-3340da60-49a0-437e-ac67-8234dd4a18b3 service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Updating instance_info_cache with network_info: [{"id": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "address": "fa:16:3e:b6:e0:3d", "network": {"id": "5264d7e4-aeaa-4172-8f4e-f2845bb783e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1746959726-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92aad30ae7cf45cbb0233727a1e77316", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5724dc5f-94", "ovs_interfaceid": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:08:08.031741 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:08.095245 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:08:08.274145 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a4f1c43c-714c-4251-a342-b75bd4aca0b0 req-3340da60-49a0-437e-ac67-8234dd4a18b3 service nova] Releasing lock "refresh_cache-742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:08:08.288745 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:08:08.293098 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:08:08.303470 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:08:08.303470 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:08:08.312038 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:08:08.312038 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:08.318662 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:08.326522 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:08.333640 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 10:08:08.333640 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:08:08.333640 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 10:08:08.333640 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:08:08.333640 np0000001613 nova-compute[98321]: WARNING os_brick.initiator.connectors.iscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 10:08:08.333640 np0000001613 nova-compute[98321]: 
May 28 10:08:08.340057 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 10:08:08.340057 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:08:08.340204 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 10:08:08.340204 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:08:08.340340 np0000001613 nova-compute[98321]: WARNING os_brick.initiator.connectors.iscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 10:08:08.340340 np0000001613 nova-compute[98321]: 
May 28 10:08:08.362681 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc, portal: 192.168.40.100,3260]
May 28 10:08:08.362681 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc, portal: 192.168.40.100,3260] successful.
May 28 10:08:08.362681 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:08.376890 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc, portal: 192.168.50.100,3260]
May 28 10:08:08.376890 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc, portal: 192.168.50.100,3260] successful.
May 28 10:08:08.376890 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:08.377950 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:08.389526 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:08.395360 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:08.395360 np0000001613 nova-compute[98321]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:08.395360 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:08:08.395780 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsi session list stdout=tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:08.395780 np0000001613 nova-compute[98321]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:08.395780 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:08:08.397090 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.135s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:08:08.397090 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:08:08.397090 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] HCTL ('7', '-', '-', 0) found on session 121 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:08:08.397090 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:08:08.404925 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:08.404925 np0000001613 nova-compute[98321]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:08.404925 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:08:08.405284 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsi session list stdout=tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:08.405284 np0000001613 nova-compute[98321]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:08.405284 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:08:08.405441 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.144s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:08:08.405668 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:08:08.406066 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] HCTL ('8', '-', '-', 0) found on session 122 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:08:08.406338 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:08:08.413391 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Searching for a device in session 121 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:08:08.414007 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ec1e6963-9189-4750-a397-d2bc2ab54efc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:08:08.429736 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Searching for a device in session 122 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:08:08.430764 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ec1e6963-9189-4750-a397-d2bc2ab54efc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:08:08.611150 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.277s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:08.675287 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Deleted allocations for instance 4bf236ff-8072-4c54-acbe-dfe41add8500
May 28 10:08:08.857005 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:09.263794 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:08:09.686318 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-336e31d1-53f7-46c4-a1a6-72ffd00383a5 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "4bf236ff-8072-4c54-acbe-dfe41add8500" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.851s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:09.695508 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:10.282974 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Found WWN 330000000d664e648 for multipath device dm-0 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:08:10.283361 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:08:10.283361 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '330000000d664e648', 'path': '/dev/dm-0', 'multipath_id': '330000000d664e648'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:08:10.283523 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d664e648', 'path': '/dev/dm-0', 'multipath_id': '330000000d664e648'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:08:10.789516 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T10:06:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-969313737',display_name='tempest-TestShelveInstance-server-969313737',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testshelveinstance-server-969313737',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-444905061',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:07:08Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='92aad30ae7cf45cbb0233727a1e77316',ramdisk_id='',reservation_id='r-nvd0lh0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-793753334',owner_user_name='tempest-TestShelveInstance-793753334-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:07:57Z,user_data=None,user_id='d05aead48ddb43b6b4e52469338207ae',uuid=742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "address": "fa:16:3e:b6:e0:3d", "network": {"id": "5264d7e4-aeaa-4172-8f4e-f2845bb783e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1746959726-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92aad30ae7cf45cbb0233727a1e77316", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5724dc5f-94", "ovs_interfaceid": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:08:10.789768 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Converting VIF {"id": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "address": "fa:16:3e:b6:e0:3d", "network": {"id": "5264d7e4-aeaa-4172-8f4e-f2845bb783e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1746959726-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92aad30ae7cf45cbb0233727a1e77316", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5724dc5f-94", "ovs_interfaceid": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:08:10.790385 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:e0:3d,bridge_name='br-int',has_traffic_filtering=True,id=5724dc5f-94cc-45c9-ac48-670de0fa781f,network=Network(5264d7e4-aeaa-4172-8f4e-f2845bb783e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5724dc5f-94') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:08:10.791119 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lazy-loading 'pci_devices' on Instance uuid 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:08:10.832519 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0003724909997799841 future=<Future at 0x73c1f418f830 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:08:10.832880 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:08:10.833021 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=2.212816829000076 future=<Future at 0x73c1f43e08c0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:08:10.833119 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=2.2127047300000413 future=<Future at 0x73c1f43e08c0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:08:10.833989 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Emitting event <LifecycleEvent: 1779962875.832022, 90a9853a-2830-42b5-912d-72188187a375 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:08:10.834334 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] VM Stopped (Lifecycle Event)
May 28 10:08:11.296016 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Object Instance<742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:08:11.296861 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] End _get_guest_xml xml=<domain type="qemu">
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:   <uuid>742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f</uuid>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:   <name>instance-0000002f</name>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:       <nova:name>tempest-TestShelveInstance-server-969313737</nova:name>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:08:06</nova:creationTime>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:       <nova:image uuid="">
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:         <nova:user uuid="d05aead48ddb43b6b4e52469338207ae">tempest-TestShelveInstance-793753334-project-member</nova:user>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:         <nova:project uuid="92aad30ae7cf45cbb0233727a1e77316">tempest-TestShelveInstance-793753334</nova:project>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:       <nova:root type="volume" uuid=""/>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:         <nova:port uuid="5724dc5f-94cc-45c9-ac48-670de0fa781f">
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:     <system>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:       <entry name="serial">742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f</entry>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:       <entry name="uuid">742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f</entry>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:     </system>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:   <os>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:   </os>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:   <features>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:   </features>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:   <devices>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f/disk.config"/>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:     </disk>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:       <alias name="ua-ec1e6963-9189-4750-a397-d2bc2ab54efc"/>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-0"/>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:       <serial>ec1e6963-9189-4750-a397-d2bc2ab54efc</serial>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:     </disk>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:b6:e0:3d"/>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:       <target dev="tap5724dc5f-94"/>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:     </interface>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f/console.log" append="off"/>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:     </serial>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:     <video>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:     </video>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:     </rng>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:   </devices>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]: </domain>
May 28 10:08:11.296861 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:08:11.298663 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Preparing to wait for external event network-vif-plugged-5724dc5f-94cc-45c9-ac48-670de0fa781f {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:08:11.298663 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Acquiring lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:11.298663 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:11.298663 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:11.298663 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T10:06:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-969313737',display_name='tempest-TestShelveInstance-server-969313737',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testshelveinstance-server-969313737',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-444905061',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:07:08Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='92aad30ae7cf45cbb0233727a1e77316',ramdisk_id='',reservation_id='r-nvd0lh0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-793753334',owner_user_name='tempest-TestShelveInstance-793753334-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:07:57Z,user_data=None,user_id='d05aead48ddb43b6b4e52469338207ae',uuid=742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "address": "fa:16:3e:b6:e0:3d", "network": {"id": "5264d7e4-aeaa-4172-8f4e-f2845bb783e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1746959726-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92aad30ae7cf45cbb0233727a1e77316", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5724dc5f-94", "ovs_interfaceid": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:08:11.298663 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Converting VIF {"id": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "address": "fa:16:3e:b6:e0:3d", "network": {"id": "5264d7e4-aeaa-4172-8f4e-f2845bb783e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1746959726-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92aad30ae7cf45cbb0233727a1e77316", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5724dc5f-94", "ovs_interfaceid": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:08:11.298663 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:e0:3d,bridge_name='br-int',has_traffic_filtering=True,id=5724dc5f-94cc-45c9-ac48-670de0fa781f,network=Network(5264d7e4-aeaa-4172-8f4e-f2845bb783e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5724dc5f-94') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:08:11.298663 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:e0:3d,bridge_name='br-int',has_traffic_filtering=True,id=5724dc5f-94cc-45c9-ac48-670de0fa781f,network=Network(5264d7e4-aeaa-4172-8f4e-f2845bb783e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5724dc5f-94') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:08:11.298963 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:11.299297 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:08:11.299627 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:08:11.300203 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:11.300411 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '914ebac9-254f-592f-87aa-00dc9eb5fc61', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:08:11.301051 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:11.301593 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:08:11.302445 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:11.304079 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:11.304208 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5724dc5f-94, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:08:11.304452 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5724dc5f-94, col_values=(('qos', UUID('2c4e479d-f9b7-4c35-9df9-26e622da0e47')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:08:11.304591 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5724dc5f-94, col_values=(('external_ids', {'iface-id': '5724dc5f-94cc-45c9-ac48-670de0fa781f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:e0:3d', 'vm-uuid': '742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:08:11.305237 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:11.306210 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:08:11.311153 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:11.312193 np0000001613 nova-compute[98321]: INFO os_vif [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:e0:3d,bridge_name='br-int',has_traffic_filtering=True,id=5724dc5f-94cc-45c9-ac48-670de0fa781f,network=Network(5264d7e4-aeaa-4172-8f4e-f2845bb783e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5724dc5f-94')
May 28 10:08:11.336801 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a1d46a30-43dd-4c8e-b781-b6356b11dacc tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 90a9853a-2830-42b5-912d-72188187a375] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:08:12.830500 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:08:12.831111 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:08:12.831111 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] No VIF found with MAC fa:16:3e:b6:e0:3d, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:08:12.831348 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Using config drive
May 28 10:08:13.046832 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0009607880001567537 future=<Future at 0x73c1f43e08c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:08:13.047316 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Emitting event <LifecycleEvent: 1779962878.0457633, 4bf236ff-8072-4c54-acbe-dfe41add8500 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:08:13.047452 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] VM Stopped (Lifecycle Event)
May 28 10:08:13.047917 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:08:13.334400 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lazy-loading 'ec2_ids' on Instance uuid 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:08:13.550058 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8dfd3789-144f-4f1a-902d-86c93bf11731 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 4bf236ff-8072-4c54-acbe-dfe41add8500] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:08:13.839639 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Object Instance<742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices,ec2_ids {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:08:13.840114 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lazy-loading 'keypairs' on Instance uuid 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:08:14.343060 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Object Instance<742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:08:14.346239 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:14.498519 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Creating config drive at /opt/stack/data/nova/instances/742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f/disk.config
May 28 10:08:14.507151 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpebjzazpu {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:08:14.574803 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpebjzazpu" returned: 0 in 0.070s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:08:14.627082 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Acquiring lock "1ffe54bd-ad37-40a8-adfa-04e2ea9c9554" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:14.627379 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "1ffe54bd-ad37-40a8-adfa-04e2ea9c9554" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:14.701481 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:15.036643 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:15.069722 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:15.131917 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:08:15.148889 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:15.271280 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-0fc0308c-dbc2-4ff1-a679-67e3c1c743bc req-7f122a19-1d5d-424d-a704-6037a4b6d27a service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Received event network-vif-plugged-5724dc5f-94cc-45c9-ac48-670de0fa781f {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:08:15.274218 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0fc0308c-dbc2-4ff1-a679-67e3c1c743bc req-7f122a19-1d5d-424d-a704-6037a4b6d27a service nova] Acquiring lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:15.274539 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0fc0308c-dbc2-4ff1-a679-67e3c1c743bc req-7f122a19-1d5d-424d-a704-6037a4b6d27a service nova] Lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:15.274725 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0fc0308c-dbc2-4ff1-a679-67e3c1c743bc req-7f122a19-1d5d-424d-a704-6037a4b6d27a service nova] Lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:15.274920 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-0fc0308c-dbc2-4ff1-a679-67e3c1c743bc req-7f122a19-1d5d-424d-a704-6037a4b6d27a service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Processing event network-vif-plugged-5724dc5f-94cc-45c9-ac48-670de0fa781f {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:08:15.328101 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "ca57808c-4f51-4a26-8724-d28394efab9f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:15.328101 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "ca57808c-4f51-4a26-8724-d28394efab9f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:15.427463 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:15.431258 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:15.433567 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:15.434703 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:15.456561 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:15.707072 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:15.707072 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:15.712041 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:08:15.712266 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Claim successful on node np0000001613
May 28 10:08:15.834126 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:08:15.926724 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:08:15.927740 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962895.9273245, 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:08:15.927887 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] VM Started (Lifecycle Event)
May 28 10:08:15.934540 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:08:15.937131 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Instance spawned successfully.
May 28 10:08:15.937560 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:08:16.305194 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:16.416770 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:16.434383 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:08:16.437815 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:08:16.448689 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d94eb13f-bbd7-40d1-8e70-c484a8c4e430 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 19.928s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:16.944411 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962896.9405708, 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:08:16.944411 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] VM Paused (Lifecycle Event)
May 28 10:08:17.013064 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:08:17.013344 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:08:17.362960 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-24a285ab-6fe1-4f04-aedb-b7178e769f8a req-c2460188-2bff-444f-a16b-de6632863ef8 service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Received event network-vif-plugged-5724dc5f-94cc-45c9-ac48-670de0fa781f {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:08:17.364231 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-24a285ab-6fe1-4f04-aedb-b7178e769f8a req-c2460188-2bff-444f-a16b-de6632863ef8 service nova] Acquiring lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:17.365050 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-24a285ab-6fe1-4f04-aedb-b7178e769f8a req-c2460188-2bff-444f-a16b-de6632863ef8 service nova] Lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:17.365419 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-24a285ab-6fe1-4f04-aedb-b7178e769f8a req-c2460188-2bff-444f-a16b-de6632863ef8 service nova] Lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:17.365637 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-24a285ab-6fe1-4f04-aedb-b7178e769f8a req-c2460188-2bff-444f-a16b-de6632863ef8 service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] No waiting events found dispatching network-vif-plugged-5724dc5f-94cc-45c9-ac48-670de0fa781f {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:08:17.367206 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-24a285ab-6fe1-4f04-aedb-b7178e769f8a req-c2460188-2bff-444f-a16b-de6632863ef8 service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Received unexpected event network-vif-plugged-5724dc5f-94cc-45c9-ac48-670de0fa781f for instance with vm_state active and task_state None.
May 28 10:08:17.443757 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:08:17.446268 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962897.4459455, 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:08:17.446790 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] VM Resumed (Lifecycle Event)
May 28 10:08:17.517185 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:08:17.948720 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:08:17.951960 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:08:18.026995 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.320s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:18.028451 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.612s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:18.028451 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:08:18.033938 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:08:18.034368 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Claim successful on node np0000001613
May 28 10:08:18.178324 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:18.541319 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:08:18.541319 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:08:18.541319 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:18.541319 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:18.661617 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '655e1aff31fe454ab046a71daad5a888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b5a6b6c4514b76a651b71280c093f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:08:19.044412 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:08:19.302234 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:08:19.302468 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:08:19.534724 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Successfully created port: aecaae00-e4ff-458c-9255-8e7026a57820 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:08:19.548872 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:08:19.703090 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:19.805776 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:08:20.159063 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Successfully updated port: aecaae00-e4ff-458c-9255-8e7026a57820 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:08:20.208207 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c0c81d16-a84c-4dae-ab51-11de7d661e78 req-0994386a-c61f-43d4-9403-2725e8fddc8b service nova] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Received event network-changed-aecaae00-e4ff-458c-9255-8e7026a57820 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:08:20.208364 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c0c81d16-a84c-4dae-ab51-11de7d661e78 req-0994386a-c61f-43d4-9403-2725e8fddc8b service nova] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Refreshing instance network info cache due to event network-changed-aecaae00-e4ff-458c-9255-8e7026a57820. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:08:20.208520 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c0c81d16-a84c-4dae-ab51-11de7d661e78 req-0994386a-c61f-43d4-9403-2725e8fddc8b service nova] Acquiring lock "refresh_cache-1ffe54bd-ad37-40a8-adfa-04e2ea9c9554" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:08:20.208798 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c0c81d16-a84c-4dae-ab51-11de7d661e78 req-0994386a-c61f-43d4-9403-2725e8fddc8b service nova] Acquired lock "refresh_cache-1ffe54bd-ad37-40a8-adfa-04e2ea9c9554" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:08:20.209132 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-c0c81d16-a84c-4dae-ab51-11de7d661e78 req-0994386a-c61f-43d4-9403-2725e8fddc8b service nova] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Refreshing network info cache for port aecaae00-e4ff-458c-9255-8e7026a57820 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:08:20.315097 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.288s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:20.315810 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:08:20.563365 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:08:20.564555 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:08:20.564859 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Creating image(s)
May 28 10:08:20.565463 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Acquiring lock "/opt/stack/data/nova/instances/1ffe54bd-ad37-40a8-adfa-04e2ea9c9554/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:20.565669 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "/opt/stack/data/nova/instances/1ffe54bd-ad37-40a8-adfa-04e2ea9c9554/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:20.566265 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "/opt/stack/data/nova/instances/1ffe54bd-ad37-40a8-adfa-04e2ea9c9554/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:20.566832 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:08:20.571551 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:08:20.572998 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:08:20.661877 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Acquiring lock "refresh_cache-1ffe54bd-ad37-40a8-adfa-04e2ea9c9554" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:08:20.665249 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.092s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:08:20.665840 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:20.666464 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:20.667067 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:08:20.670490 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:08:20.670944 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:08:20.712713 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-c0c81d16-a84c-4dae-ab51-11de7d661e78 req-0994386a-c61f-43d4-9403-2725e8fddc8b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:20.771935 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.101s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:08:20.772769 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/1ffe54bd-ad37-40a8-adfa-04e2ea9c9554/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:08:20.799766 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-c0c81d16-a84c-4dae-ab51-11de7d661e78 req-0994386a-c61f-43d4-9403-2725e8fddc8b service nova] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:08:20.830090 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:08:20.830090 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:08:20.830090 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:20.832020 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:20.851903 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/1ffe54bd-ad37-40a8-adfa-04e2ea9c9554/disk 1073741824" returned: 0 in 0.079s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:08:20.855001 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.186s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:20.855001 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:08:20.965989 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec58233d3b2848bbb2e0b00650398cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e9651268114327a9cc6c6c59bef01e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:08:20.978262 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.123s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:08:20.978515 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1ffe54bd-ad37-40a8-adfa-04e2ea9c9554/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:08:20.978843 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ffe54bd-ad37-40a8-adfa-04e2ea9c9554/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:08:21.026939 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-c0c81d16-a84c-4dae-ab51-11de7d661e78 req-0994386a-c61f-43d4-9403-2725e8fddc8b service nova] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:08:21.044752 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:21.101730 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ffe54bd-ad37-40a8-adfa-04e2ea9c9554/disk --force-share --output=json" returned: 0 in 0.123s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:08:21.102084 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Cannot resize image /opt/stack/data/nova/instances/1ffe54bd-ad37-40a8-adfa-04e2ea9c9554/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:08:21.102455 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:08:21.102637 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Ensure instance console log exists: /opt/stack/data/nova/instances/1ffe54bd-ad37-40a8-adfa-04e2ea9c9554/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:08:21.102929 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:21.103116 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:21.103270 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:21.306778 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:21.336620 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:08:21.532942 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Successfully created port: fca4901d-c1d5-4b95-8e64-2d88cd94725f {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:08:21.534759 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c0c81d16-a84c-4dae-ab51-11de7d661e78 req-0994386a-c61f-43d4-9403-2725e8fddc8b service nova] Releasing lock "refresh_cache-1ffe54bd-ad37-40a8-adfa-04e2ea9c9554" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:08:21.536287 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Acquired lock "refresh_cache-1ffe54bd-ad37-40a8-adfa-04e2ea9c9554" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:08:21.537553 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:08:21.840768 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:08:22.054804 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Successfully updated port: fca4901d-c1d5-4b95-8e64-2d88cd94725f {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:08:22.096186 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:08:22.244184 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:22.270362 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-75c1ef5b-bdfe-400a-a6f6-7982e9554f60 req-0bb1b22b-9d59-4538-ba0a-2148c5fa703f service nova] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Received event network-changed-fca4901d-c1d5-4b95-8e64-2d88cd94725f {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:08:22.270362 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-75c1ef5b-bdfe-400a-a6f6-7982e9554f60 req-0bb1b22b-9d59-4538-ba0a-2148c5fa703f service nova] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Refreshing instance network info cache due to event network-changed-fca4901d-c1d5-4b95-8e64-2d88cd94725f. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:08:22.270561 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-75c1ef5b-bdfe-400a-a6f6-7982e9554f60 req-0bb1b22b-9d59-4538-ba0a-2148c5fa703f service nova] Acquiring lock "refresh_cache-ca57808c-4f51-4a26-8724-d28394efab9f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:08:22.270755 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-75c1ef5b-bdfe-400a-a6f6-7982e9554f60 req-0bb1b22b-9d59-4538-ba0a-2148c5fa703f service nova] Acquired lock "refresh_cache-ca57808c-4f51-4a26-8724-d28394efab9f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:08:22.270929 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-75c1ef5b-bdfe-400a-a6f6-7982e9554f60 req-0bb1b22b-9d59-4538-ba0a-2148c5fa703f service nova] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Refreshing network info cache for port fca4901d-c1d5-4b95-8e64-2d88cd94725f {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:08:22.345636 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Booting with volume 7c1c1ea0-2af9-4573-95bb-c79b28880b7b at /dev/vda
May 28 10:08:22.389254 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:08:22.391740 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Updating instance_info_cache with network_info: [{"id": "aecaae00-e4ff-458c-9255-8e7026a57820", "address": "fa:16:3e:1a:d1:df", "network": {"id": "6b4547f5-30ae-4bcf-b4e5-b7ffc2bcd25d", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1107528011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "42b5a6b6c4514b76a651b71280c093f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaecaae00-e4", "ovs_interfaceid": "aecaae00-e4ff-458c-9255-8e7026a57820", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:08:22.404034 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:08:22.429337 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:08:22.470975 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:08:22.471332 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:08:22.482014 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:08:22.483588 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe05:512a', 'fe80::ec4e:cbff:fea7:f945', 'fe80::fc16:3eff:feb6:e03d', 'fe80::c4f8:89ff:fef6:4009'] 
May 28 10:08:22.483588 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:08:22.483726 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:08:22.484047 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] <== get_connector_properties: return (94ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:08:22.484399 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Updating existing volume attachment record: a49bdb8a-6bee-41bb-b2c1-5050acd4e7d9 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:08:22.557177 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "refresh_cache-ca57808c-4f51-4a26-8724-d28394efab9f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:08:22.773122 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-75c1ef5b-bdfe-400a-a6f6-7982e9554f60 req-0bb1b22b-9d59-4538-ba0a-2148c5fa703f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:22.859187 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-75c1ef5b-bdfe-400a-a6f6-7982e9554f60 req-0bb1b22b-9d59-4538-ba0a-2148c5fa703f service nova] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:08:22.896892 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Releasing lock "refresh_cache-1ffe54bd-ad37-40a8-adfa-04e2ea9c9554" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:08:22.896892 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Instance network_info: |[{"id": "aecaae00-e4ff-458c-9255-8e7026a57820", "address": "fa:16:3e:1a:d1:df", "network": {"id": "6b4547f5-30ae-4bcf-b4e5-b7ffc2bcd25d", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1107528011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "42b5a6b6c4514b76a651b71280c093f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaecaae00-e4", "ovs_interfaceid": "aecaae00-e4ff-458c-9255-8e7026a57820", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:08:22.900759 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Start _get_guest_xml network_info=[{"id": "aecaae00-e4ff-458c-9255-8e7026a57820", "address": "fa:16:3e:1a:d1:df", "network": {"id": "6b4547f5-30ae-4bcf-b4e5-b7ffc2bcd25d", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1107528011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "42b5a6b6c4514b76a651b71280c093f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaecaae00-e4", "ovs_interfaceid": "aecaae00-e4ff-458c-9255-8e7026a57820", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:08:22.907667 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:08:22.909652 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-VolumesBackupsTest-instance-1535374086', uuid='1ffe54bd-ad37-40a8-adfa-04e2ea9c9554'), owner=OwnerMeta(userid='655e1aff31fe454ab046a71daad5a888', username='tempest-VolumesBackupsTest-1901675516-project-member', projectid='42b5a6b6c4514b76a651b71280c093f5', projectname='tempest-VolumesBackupsTest-1901675516'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "aecaae00-e4ff-458c-9255-8e7026a57820", "address": "fa:16:3e:1a:d1:df", "network": {"id": "6b4547f5-30ae-4bcf-b4e5-b7ffc2bcd25d", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1107528011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "42b5a6b6c4514b76a651b71280c093f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaecaae00-e4", "ovs_interfaceid": "aecaae00-e4ff-458c-9255-8e7026a57820", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962902.909084) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:08:22.911377 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:08:22.911854 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:08:22.913004 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:08:22.913321 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:08:22.914761 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:08:22.915214 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:08:22.915422 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:08:22.915692 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:08:22.915860 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:08:22.916000 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:08:22.916147 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:08:22.916385 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:08:22.916539 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:08:22.916702 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:08:22.916854 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:08:22.917026 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:08:22.938213 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:08:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-1535374086',display_name='tempest-VolumesBackupsTest-instance-1535374086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumesbackupstest-instance-1535374086',id=50,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlD6Xkf+iVp8XkesmEA5ZcWSWd93QfIFV1WWnAb6VaYxJ8IbMQ1VfOuVjOK3r0w6k587SaA/OHTCZQRTW5BV2+Bj8BdXACZtM5UYMESAXfYtjMa+MTgntg05vMEyJjaew==',key_name='tempest-keypair-461790367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42b5a6b6c4514b76a651b71280c093f5',ramdisk_id='',reservation_id='r-2q9sbxdb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-1901675516',owner_user_name='tempest-VolumesBackupsTest-1901675516-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:08:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='655e1aff31fe454ab046a71daad5a888',uuid=1ffe54bd-ad37-40a8-adfa-04e2ea9c9554,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aecaae00-e4ff-458c-9255-8e7026a57820", "address": "fa:16:3e:1a:d1:df", "network": {"id": "6b4547f5-30ae-4bcf-b4e5-b7ffc2bcd25d", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1107528011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "42b5a6b6c4514b76a651b71280c093f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaecaae00-e4", "ovs_interfaceid": "aecaae00-e4ff-458c-9255-8e7026a57820", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:08:22.938428 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Converting VIF {"id": "aecaae00-e4ff-458c-9255-8e7026a57820", "address": "fa:16:3e:1a:d1:df", "network": {"id": "6b4547f5-30ae-4bcf-b4e5-b7ffc2bcd25d", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1107528011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "42b5a6b6c4514b76a651b71280c093f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaecaae00-e4", "ovs_interfaceid": "aecaae00-e4ff-458c-9255-8e7026a57820", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:08:22.939950 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:d1:df,bridge_name='br-int',has_traffic_filtering=True,id=aecaae00-e4ff-458c-9255-8e7026a57820,network=Network(6b4547f5-30ae-4bcf-b4e5-b7ffc2bcd25d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaecaae00-e4') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:08:22.940572 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:08:23.047503 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-75c1ef5b-bdfe-400a-a6f6-7982e9554f60 req-0bb1b22b-9d59-4538-ba0a-2148c5fa703f service nova] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:08:23.444519 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] End _get_guest_xml xml=<domain type="qemu">
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:   <uuid>1ffe54bd-ad37-40a8-adfa-04e2ea9c9554</uuid>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:   <name>instance-00000032</name>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:       <nova:name>tempest-VolumesBackupsTest-instance-1535374086</nova:name>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:08:22</nova:creationTime>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:         <nova:user uuid="655e1aff31fe454ab046a71daad5a888">tempest-VolumesBackupsTest-1901675516-project-member</nova:user>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:         <nova:project uuid="42b5a6b6c4514b76a651b71280c093f5">tempest-VolumesBackupsTest-1901675516</nova:project>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:         <nova:port uuid="aecaae00-e4ff-458c-9255-8e7026a57820">
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:     <system>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:       <entry name="serial">1ffe54bd-ad37-40a8-adfa-04e2ea9c9554</entry>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:       <entry name="uuid">1ffe54bd-ad37-40a8-adfa-04e2ea9c9554</entry>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:     </system>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:   <os>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:   </os>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:   <features>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:   </features>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:   <devices>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/1ffe54bd-ad37-40a8-adfa-04e2ea9c9554/disk"/>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:     </disk>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/1ffe54bd-ad37-40a8-adfa-04e2ea9c9554/disk.config"/>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:     </disk>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:1a:d1:df"/>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:       <target dev="tapaecaae00-e4"/>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:     </interface>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/1ffe54bd-ad37-40a8-adfa-04e2ea9c9554/console.log" append="off"/>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:     </serial>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:     <video>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:     </video>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:     </rng>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:   </devices>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]: </domain>
May 28 10:08:23.444519 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:08:23.448106 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Preparing to wait for external event network-vif-plugged-aecaae00-e4ff-458c-9255-8e7026a57820 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:08:23.448106 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Acquiring lock "1ffe54bd-ad37-40a8-adfa-04e2ea9c9554-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:23.448106 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "1ffe54bd-ad37-40a8-adfa-04e2ea9c9554-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:23.448106 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "1ffe54bd-ad37-40a8-adfa-04e2ea9c9554-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:23.448106 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:08:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-1535374086',display_name='tempest-VolumesBackupsTest-instance-1535374086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumesbackupstest-instance-1535374086',id=50,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlD6Xkf+iVp8XkesmEA5ZcWSWd93QfIFV1WWnAb6VaYxJ8IbMQ1VfOuVjOK3r0w6k587SaA/OHTCZQRTW5BV2+Bj8BdXACZtM5UYMESAXfYtjMa+MTgntg05vMEyJjaew==',key_name='tempest-keypair-461790367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42b5a6b6c4514b76a651b71280c093f5',ramdisk_id='',reservation_id='r-2q9sbxdb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-1901675516',owner_user_name='tempest-VolumesBackupsTest-1901675516-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:08:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='655e1aff31fe454ab046a71daad5a888',uuid=1ffe54bd-ad37-40a8-adfa-04e2ea9c9554,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aecaae00-e4ff-458c-9255-8e7026a57820", "address": "fa:16:3e:1a:d1:df", "network": {"id": "6b4547f5-30ae-4bcf-b4e5-b7ffc2bcd25d", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1107528011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "42b5a6b6c4514b76a651b71280c093f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaecaae00-e4", "ovs_interfaceid": "aecaae00-e4ff-458c-9255-8e7026a57820", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:08:23.448106 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Converting VIF {"id": "aecaae00-e4ff-458c-9255-8e7026a57820", "address": "fa:16:3e:1a:d1:df", "network": {"id": "6b4547f5-30ae-4bcf-b4e5-b7ffc2bcd25d", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1107528011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "42b5a6b6c4514b76a651b71280c093f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaecaae00-e4", "ovs_interfaceid": "aecaae00-e4ff-458c-9255-8e7026a57820", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:08:23.448106 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:d1:df,bridge_name='br-int',has_traffic_filtering=True,id=aecaae00-e4ff-458c-9255-8e7026a57820,network=Network(6b4547f5-30ae-4bcf-b4e5-b7ffc2bcd25d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaecaae00-e4') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:08:23.449686 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:d1:df,bridge_name='br-int',has_traffic_filtering=True,id=aecaae00-e4ff-458c-9255-8e7026a57820,network=Network(6b4547f5-30ae-4bcf-b4e5-b7ffc2bcd25d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaecaae00-e4') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:08:23.449686 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:23.449686 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:08:23.449686 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:08:23.452201 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:23.452201 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0006e58c-6232-52c6-8b95-28ea883c8478', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:08:23.452201 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:23.452346 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:23.454572 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:23.455220 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaecaae00-e4, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:08:23.455490 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaecaae00-e4, col_values=(('qos', UUID('7b40cbb4-5b69-4461-ae33-9e34f10d4265')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:08:23.455707 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaecaae00-e4, col_values=(('external_ids', {'iface-id': 'aecaae00-e4ff-458c-9255-8e7026a57820', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:d1:df', 'vm-uuid': '1ffe54bd-ad37-40a8-adfa-04e2ea9c9554'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:08:23.457006 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:23.458794 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:08:23.463038 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:23.464107 np0000001613 nova-compute[98321]: INFO os_vif [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:d1:df,bridge_name='br-int',has_traffic_filtering=True,id=aecaae00-e4ff-458c-9255-8e7026a57820,network=Network(6b4547f5-30ae-4bcf-b4e5-b7ffc2bcd25d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaecaae00-e4')
May 28 10:08:23.551299 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-75c1ef5b-bdfe-400a-a6f6-7982e9554f60 req-0bb1b22b-9d59-4538-ba0a-2148c5fa703f service nova] Releasing lock "refresh_cache-ca57808c-4f51-4a26-8724-d28394efab9f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:08:23.554324 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquired lock "refresh_cache-ca57808c-4f51-4a26-8724-d28394efab9f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:08:23.554324 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:08:23.862677 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Acquiring lock "d517f598-221a-40bb-91e6-b9c34260ca40" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:23.863347 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Lock "d517f598-221a-40bb-91e6-b9c34260ca40" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:24.171697 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:08:24.352220 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:24.365353 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:08:24.514822 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Updating instance_info_cache with network_info: [{"id": "fca4901d-c1d5-4b95-8e64-2d88cd94725f", "address": "fa:16:3e:51:37:8d", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca4901d-c1", "ovs_interfaceid": "fca4901d-c1d5-4b95-8e64-2d88cd94725f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:08:24.607703 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:08:24.608687 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:08:24.608963 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Creating image(s)
May 28 10:08:24.609220 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Did not create local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 10:08:24.609345 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Ensure instance console log exists: /opt/stack/data/nova/instances/ca57808c-4f51-4a26-8724-d28394efab9f/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:08:24.609667 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:24.609749 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:24.609963 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:24.702353 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:24.913605 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:24.913973 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:24.917200 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:08:24.917441 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Claim successful on node np0000001613
May 28 10:08:24.980890 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:08:24.981106 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:08:24.981314 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] No VIF found with MAC fa:16:3e:1a:d1:df, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:08:24.981913 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Using config drive
May 28 10:08:25.017792 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Releasing lock "refresh_cache-ca57808c-4f51-4a26-8724-d28394efab9f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:08:25.017792 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Instance network_info: |[{"id": "fca4901d-c1d5-4b95-8e64-2d88cd94725f", "address": "fa:16:3e:51:37:8d", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca4901d-c1", "ovs_interfaceid": "fca4901d-c1d5-4b95-8e64-2d88cd94725f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:08:25.019172 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Start _get_guest_xml network_info=[{"id": "fca4901d-c1d5-4b95-8e64-2d88cd94725f", "address": "fa:16:3e:51:37:8d", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca4901d-c1", "ovs_interfaceid": "fca4901d-c1d5-4b95-8e64-2d88cd94725f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'ca57808c-4f51-4a26-8724-d28394efab9f', 'attached_at': '', 'detached_at': '', 'volume_id': '7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 'serial': '7c1c1ea0-2af9-4573-95bb-c79b28880b7b'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'a49bdb8a-6bee-41bb-b2c1-5050acd4e7d9', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:08:25.025033 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:08:25.026379 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1045213354', uuid='ca57808c-4f51-4a26-8724-d28394efab9f'), owner=OwnerMeta(userid='ec58233d3b2848bbb2e0b00650398cd1', username='tempest-TestVolumeBootPattern-327944304-project-member', projectid='23e9651268114327a9cc6c6c59bef01e', projectname='tempest-TestVolumeBootPattern-327944304'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fca4901d-c1d5-4b95-8e64-2d88cd94725f", "address": "fa:16:3e:51:37:8d", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca4901d-c1", "ovs_interfaceid": "fca4901d-c1d5-4b95-8e64-2d88cd94725f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962905.0259762) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:08:25.027734 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:08:25.028124 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:08:25.029340 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:08:25.029511 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:08:25.030511 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:08:25.030848 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:08:25.030996 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:08:25.031123 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:08:25.031283 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:08:25.031389 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:08:25.031489 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:08:25.031674 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:08:25.031876 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:08:25.031934 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:08:25.032036 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:08:25.032173 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:08:25.046344 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:08:25.046872 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:08:25.047054 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:08:25.047476 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:08:25.047726 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:08:25.063235 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:08:25.064006 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:08:25.065516 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:08:25.065844 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:08:25.066310 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:08:25.066574 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:08:25.085306 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:08:25.085306 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:25.092345 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:08:25.092345 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:25.100016 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b] added
May 28 10:08:25.100016 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:08:25.100016 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:08:25.100016 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:08:25.100016 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:08:25.100016 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:08:25.100016 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:25.100433 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:08:25.100433 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0339(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:08:25.100633 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:08:25.105623 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b] added
May 28 10:08:25.105623 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:08:25.105623 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:08:25.105623 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:08:25.105623 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:08:25.105623 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:08:25.105623 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:25.105904 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:08:25.106051 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0401(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:08:25.106245 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:08:25.492440 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:25.658234 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Creating config drive at /opt/stack/data/nova/instances/1ffe54bd-ad37-40a8-adfa-04e2ea9c9554/disk.config
May 28 10:08:25.661977 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1ffe54bd-ad37-40a8-adfa-04e2ea9c9554/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzoes5plm {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:08:25.719671 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1ffe54bd-ad37-40a8-adfa-04e2ea9c9554/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzoes5plm" returned: 0 in 0.057s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:08:26.101586 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:08:26.106823 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:08:26.118219 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:08:26.118219 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:08:26.121983 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:08:26.121983 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:26.133568 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:26.140222 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:26.152204 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:26.152204 np0000001613 nova-compute[98321]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:26.152204 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:08:26.152204 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:26.152204 np0000001613 nova-compute[98321]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:26.152204 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:08:26.156348 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:26.156348 np0000001613 nova-compute[98321]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:26.156348 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:08:26.156579 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:26.156579 np0000001613 nova-compute[98321]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:26.156579 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:08:26.192345 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b, portal: 192.168.50.100,3260]
May 28 10:08:26.192345 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b, portal: 192.168.50.100,3260] successful.
May 28 10:08:26.192345 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:26.200644 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b, portal: 192.168.40.100,3260]
May 28 10:08:26.200644 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b, portal: 192.168.40.100,3260] successful.
May 28 10:08:26.200644 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:26.205789 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:26.212738 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:26.223637 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:26.223637 np0000001613 nova-compute[98321]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:26.223637 np0000001613 nova-compute[98321]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:08:26.223637 np0000001613 nova-compute[98321]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:08:26.223637 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:08:26.223637 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:26.223637 np0000001613 nova-compute[98321]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:26.223637 np0000001613 nova-compute[98321]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:08:26.223637 np0000001613 nova-compute[98321]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:08:26.223637 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:08:26.223637 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.156s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:08:26.223637 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:08:26.223637 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] HCTL ('9', '-', '-', 0) found on session 123 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:08:26.223637 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:08:26.232120 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:26.232120 np0000001613 nova-compute[98321]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:26.232120 np0000001613 nova-compute[98321]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:08:26.232120 np0000001613 nova-compute[98321]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:08:26.232120 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:08:26.232120 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:26.232120 np0000001613 nova-compute[98321]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:26.232120 np0000001613 nova-compute[98321]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:08:26.232120 np0000001613 nova-compute[98321]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:08:26.232120 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:08:26.233348 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:08:26.233488 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:08:26.234152 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] HCTL ('10', '-', '-', 0) found on session 124 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:08:26.234393 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:08:26.246323 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching for a device in session 123 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:08:26.246323 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:08:26.251037 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching for a device in session 124 and hctl ['10', '*', '*', 0] yield: None {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:08:26.254570 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:26.295202 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:26.301032 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:26.320757 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:08:26.321007 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:08:26.383049 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:26.695604 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:26.700385 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:26.727835 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:26.825799 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:08:27.000051 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-32994e9e-3b44-4e2c-8c76-d18f068baca1 req-5b27c1eb-2919-4bbd-9bd9-098b9fba81e5 service nova] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Received event network-vif-plugged-aecaae00-e4ff-458c-9255-8e7026a57820 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:08:27.002042 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-32994e9e-3b44-4e2c-8c76-d18f068baca1 req-5b27c1eb-2919-4bbd-9bd9-098b9fba81e5 service nova] Acquiring lock "1ffe54bd-ad37-40a8-adfa-04e2ea9c9554-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:27.003406 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-32994e9e-3b44-4e2c-8c76-d18f068baca1 req-5b27c1eb-2919-4bbd-9bd9-098b9fba81e5 service nova] Lock "1ffe54bd-ad37-40a8-adfa-04e2ea9c9554-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:27.003627 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-32994e9e-3b44-4e2c-8c76-d18f068baca1 req-5b27c1eb-2919-4bbd-9bd9-098b9fba81e5 service nova] Lock "1ffe54bd-ad37-40a8-adfa-04e2ea9c9554-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:27.003803 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-32994e9e-3b44-4e2c-8c76-d18f068baca1 req-5b27c1eb-2919-4bbd-9bd9-098b9fba81e5 service nova] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Processing event network-vif-plugged-aecaae00-e4ff-458c-9255-8e7026a57820 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:08:27.196339 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962907.1959867, 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:08:27.198434 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:08:27.198434 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] VM Started (Lifecycle Event)
May 28 10:08:27.202183 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:08:27.207534 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Instance spawned successfully.
May 28 10:08:27.208069 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:08:27.251764 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching for a device in session 124 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:08:27.251970 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:08:27.334648 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.421s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:27.335074 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:08:27.704466 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:08:27.706100 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:08:27.715940 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:08:27.716406 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:08:27.716842 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:08:27.717138 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:08:27.717490 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:08:27.717821 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:08:27.843623 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:08:27.843623 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:08:27.843623 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:27.843623 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:27.938803 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d6c4c0c65114263bdf7b9d657c80a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b696dba3e04fc1a6b1b1c792ca0508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:08:28.081247 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Found WWN 3300000006f417ccb for multipath device dm-3 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:08:28.081608 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:08:28.081830 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '3300000006f417ccb', 'path': '/dev/dm-3', 'multipath_id': '3300000006f417ccb'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:08:28.081981 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006f417ccb', 'path': '/dev/dm-3', 'multipath_id': '3300000006f417ccb'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:08:28.208949 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:08:28.210217 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962908.209852, 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:08:28.210217 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] VM Paused (Lifecycle Event)
May 28 10:08:28.226225 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Took 7.66 seconds to spawn the instance on the hypervisor.
May 28 10:08:28.228080 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:08:28.345695 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:08:28.438989 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Successfully created port: c2f0cd1a-3778-4996-8150-1c9cb1afc473 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:08:28.459179 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:28.587786 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:08:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1045213354',display_name='tempest-TestVolumeBootPattern-server-1045213354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpattern-server-1045213354',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXijNEVpHlU0fcHSajVe0wLb7tE6aVVeudGfxc7rHURQeMUmzIENcCsTLjBsfytzyxfL8Ns1nEjQaGLVbBThbKgoJfLjVwVzizrBq9/Hj7rtGIFoStaV7wwOeDN2YJenw==',key_name='tempest-keypair-161619853',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23e9651268114327a9cc6c6c59bef01e',ramdisk_id='',reservation_id='r-80yxhf2a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-327944304',owner_user_name='tempest-TestVolumeBootPattern-327944304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:08:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec58233d3b2848bbb2e0b00650398cd1',uuid=ca57808c-4f51-4a26-8724-d28394efab9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fca4901d-c1d5-4b95-8e64-2d88cd94725f", "address": "fa:16:3e:51:37:8d", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca4901d-c1", "ovs_interfaceid": "fca4901d-c1d5-4b95-8e64-2d88cd94725f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:08:28.588001 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converting VIF {"id": "fca4901d-c1d5-4b95-8e64-2d88cd94725f", "address": "fa:16:3e:51:37:8d", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca4901d-c1", "ovs_interfaceid": "fca4901d-c1d5-4b95-8e64-2d88cd94725f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:08:28.588626 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:37:8d,bridge_name='br-int',has_traffic_filtering=True,id=fca4901d-c1d5-4b95-8e64-2d88cd94725f,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfca4901d-c1') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:08:28.589645 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lazy-loading 'pci_devices' on Instance uuid ca57808c-4f51-4a26-8724-d28394efab9f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:08:28.715900 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:08:28.718018 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962908.7177615, 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:08:28.718188 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] VM Resumed (Lifecycle Event)
May 28 10:08:28.746018 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Took 13.11 seconds to build instance.
May 28 10:08:28.848877 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:08:29.033329 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Successfully updated port: c2f0cd1a-3778-4996-8150-1c9cb1afc473 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:08:29.092863 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] End _get_guest_xml xml=<domain type="qemu">
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:   <uuid>ca57808c-4f51-4a26-8724-d28394efab9f</uuid>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:   <name>instance-00000033</name>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:       <nova:name>tempest-TestVolumeBootPattern-server-1045213354</nova:name>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:08:25</nova:creationTime>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:       <nova:image uuid="">
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:         <nova:user uuid="ec58233d3b2848bbb2e0b00650398cd1">tempest-TestVolumeBootPattern-327944304-project-member</nova:user>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:         <nova:project uuid="23e9651268114327a9cc6c6c59bef01e">tempest-TestVolumeBootPattern-327944304</nova:project>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:       <nova:root type="volume" uuid=""/>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:         <nova:port uuid="fca4901d-c1d5-4b95-8e64-2d88cd94725f">
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:     <system>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:       <entry name="serial">ca57808c-4f51-4a26-8724-d28394efab9f</entry>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:       <entry name="uuid">ca57808c-4f51-4a26-8724-d28394efab9f</entry>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:     </system>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:   <os>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:   </os>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:   <features>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:   </features>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:   <devices>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/ca57808c-4f51-4a26-8724-d28394efab9f/disk.config"/>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:     </disk>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:       <alias name="ua-7c1c1ea0-2af9-4573-95bb-c79b28880b7b"/>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-3"/>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:       <serial>7c1c1ea0-2af9-4573-95bb-c79b28880b7b</serial>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:     </disk>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:51:37:8d"/>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:       <target dev="tapfca4901d-c1"/>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:     </interface>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/ca57808c-4f51-4a26-8724-d28394efab9f/console.log" append="off"/>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:     </serial>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:     <video>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:     </video>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:     </rng>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:   </devices>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]: </domain>
May 28 10:08:29.092863 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:08:29.094892 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Preparing to wait for external event network-vif-plugged-fca4901d-c1d5-4b95-8e64-2d88cd94725f {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:08:29.094892 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "ca57808c-4f51-4a26-8724-d28394efab9f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:29.094892 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "ca57808c-4f51-4a26-8724-d28394efab9f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:29.094892 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "ca57808c-4f51-4a26-8724-d28394efab9f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:29.094892 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:08:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1045213354',display_name='tempest-TestVolumeBootPattern-server-1045213354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpattern-server-1045213354',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXijNEVpHlU0fcHSajVe0wLb7tE6aVVeudGfxc7rHURQeMUmzIENcCsTLjBsfytzyxfL8Ns1nEjQaGLVbBThbKgoJfLjVwVzizrBq9/Hj7rtGIFoStaV7wwOeDN2YJenw==',key_name='tempest-keypair-161619853',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23e9651268114327a9cc6c6c59bef01e',ramdisk_id='',reservation_id='r-80yxhf2a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-327944304',owner_user_name='tempest-TestVolumeBootPattern-327944304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:08:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec58233d3b2848bbb2e0b00650398cd1',uuid=ca57808c-4f51-4a26-8724-d28394efab9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fca4901d-c1d5-4b95-8e64-2d88cd94725f", "address": "fa:16:3e:51:37:8d", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca4901d-c1", "ovs_interfaceid": "fca4901d-c1d5-4b95-8e64-2d88cd94725f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:08:29.096533 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converting VIF {"id": "fca4901d-c1d5-4b95-8e64-2d88cd94725f", "address": "fa:16:3e:51:37:8d", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca4901d-c1", "ovs_interfaceid": "fca4901d-c1d5-4b95-8e64-2d88cd94725f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:08:29.097545 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:37:8d,bridge_name='br-int',has_traffic_filtering=True,id=fca4901d-c1d5-4b95-8e64-2d88cd94725f,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfca4901d-c1') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:08:29.098306 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:37:8d,bridge_name='br-int',has_traffic_filtering=True,id=fca4901d-c1d5-4b95-8e64-2d88cd94725f,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfca4901d-c1') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:08:29.099896 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:29.100144 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:08:29.101098 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:08:29.103685 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-bd365823-267f-4e90-8ed9-f2ab509ccea7 req-d03c6696-3669-4c7d-ba99-6479beb7a092 service nova] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Received event network-vif-plugged-aecaae00-e4ff-458c-9255-8e7026a57820 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:08:29.103885 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-bd365823-267f-4e90-8ed9-f2ab509ccea7 req-d03c6696-3669-4c7d-ba99-6479beb7a092 service nova] Acquiring lock "1ffe54bd-ad37-40a8-adfa-04e2ea9c9554-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:29.105361 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:29.105616 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-bd365823-267f-4e90-8ed9-f2ab509ccea7 req-d03c6696-3669-4c7d-ba99-6479beb7a092 service nova] Lock "1ffe54bd-ad37-40a8-adfa-04e2ea9c9554-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:29.105795 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-bd365823-267f-4e90-8ed9-f2ab509ccea7 req-d03c6696-3669-4c7d-ba99-6479beb7a092 service nova] Lock "1ffe54bd-ad37-40a8-adfa-04e2ea9c9554-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:29.105950 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-bd365823-267f-4e90-8ed9-f2ab509ccea7 req-d03c6696-3669-4c7d-ba99-6479beb7a092 service nova] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] No waiting events found dispatching network-vif-plugged-aecaae00-e4ff-458c-9255-8e7026a57820 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:08:29.106885 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-bd365823-267f-4e90-8ed9-f2ab509ccea7 req-d03c6696-3669-4c7d-ba99-6479beb7a092 service nova] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Received unexpected event network-vif-plugged-aecaae00-e4ff-458c-9255-8e7026a57820 for instance with vm_state active and task_state None.
May 28 10:08:29.107647 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3d27e4b4-aba2-5bce-8484-e35d02f4e98c', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:08:29.108770 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:29.109695 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:29.114540 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:29.114699 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfca4901d-c1, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:08:29.115123 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfca4901d-c1, col_values=(('qos', UUID('1236b2d8-59c0-4731-960a-302d63343c0c')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:08:29.115123 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfca4901d-c1, col_values=(('external_ids', {'iface-id': 'fca4901d-c1d5-4b95-8e64-2d88cd94725f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:37:8d', 'vm-uuid': 'ca57808c-4f51-4a26-8724-d28394efab9f'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:08:29.116207 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:29.117544 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:08:29.126836 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:29.128185 np0000001613 nova-compute[98321]: INFO os_vif [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:37:8d,bridge_name='br-int',has_traffic_filtering=True,id=fca4901d-c1d5-4b95-8e64-2d88cd94725f,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfca4901d-c1')
May 28 10:08:29.137582 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8d7b01d0-85b5-4b7f-ad9d-bf067f93465b req-7f8e53a4-efba-4332-93f9-48e8b08c8258 service nova] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Received event network-changed-c2f0cd1a-3778-4996-8150-1c9cb1afc473 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:08:29.137912 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8d7b01d0-85b5-4b7f-ad9d-bf067f93465b req-7f8e53a4-efba-4332-93f9-48e8b08c8258 service nova] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Refreshing instance network info cache due to event network-changed-c2f0cd1a-3778-4996-8150-1c9cb1afc473. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:08:29.138176 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8d7b01d0-85b5-4b7f-ad9d-bf067f93465b req-7f8e53a4-efba-4332-93f9-48e8b08c8258 service nova] Acquiring lock "refresh_cache-d517f598-221a-40bb-91e6-b9c34260ca40" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:08:29.138242 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8d7b01d0-85b5-4b7f-ad9d-bf067f93465b req-7f8e53a4-efba-4332-93f9-48e8b08c8258 service nova] Acquired lock "refresh_cache-d517f598-221a-40bb-91e6-b9c34260ca40" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:08:29.138354 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-8d7b01d0-85b5-4b7f-ad9d-bf067f93465b req-7f8e53a4-efba-4332-93f9-48e8b08c8258 service nova] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Refreshing network info cache for port c2f0cd1a-3778-4996-8150-1c9cb1afc473 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:08:29.223579 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:08:29.227769 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:08:29.248811 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7003cf01-db28-47f9-b482-8ce879e35764 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "1ffe54bd-ad37-40a8-adfa-04e2ea9c9554" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.621s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:29.490397 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-9667631f-b04c-4ed3-a8eb-3a442bfe65c7 req-c45dbceb-43fb-48b5-80dd-748f8c8440cd service nova] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Received event network-changed-aecaae00-e4ff-458c-9255-8e7026a57820 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:08:29.490879 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-9667631f-b04c-4ed3-a8eb-3a442bfe65c7 req-c45dbceb-43fb-48b5-80dd-748f8c8440cd service nova] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Refreshing instance network info cache due to event network-changed-aecaae00-e4ff-458c-9255-8e7026a57820. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:08:29.491088 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9667631f-b04c-4ed3-a8eb-3a442bfe65c7 req-c45dbceb-43fb-48b5-80dd-748f8c8440cd service nova] Acquiring lock "refresh_cache-1ffe54bd-ad37-40a8-adfa-04e2ea9c9554" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:08:29.491241 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9667631f-b04c-4ed3-a8eb-3a442bfe65c7 req-c45dbceb-43fb-48b5-80dd-748f8c8440cd service nova] Acquired lock "refresh_cache-1ffe54bd-ad37-40a8-adfa-04e2ea9c9554" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:08:29.491390 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-9667631f-b04c-4ed3-a8eb-3a442bfe65c7 req-c45dbceb-43fb-48b5-80dd-748f8c8440cd service nova] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Refreshing network info cache for port aecaae00-e4ff-458c-9255-8e7026a57820 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:08:29.535364 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Acquiring lock "refresh_cache-d517f598-221a-40bb-91e6-b9c34260ca40" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:08:29.645375 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-8d7b01d0-85b5-4b7f-ad9d-bf067f93465b req-7f8e53a4-efba-4332-93f9-48e8b08c8258 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:29.703624 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:29.738272 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-8d7b01d0-85b5-4b7f-ad9d-bf067f93465b req-7f8e53a4-efba-4332-93f9-48e8b08c8258 service nova] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:08:29.857886 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:08:29.859850 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:08:29.859850 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Creating image(s)
May 28 10:08:29.863901 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Acquiring lock "/opt/stack/data/nova/instances/d517f598-221a-40bb-91e6-b9c34260ca40/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:29.863901 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Lock "/opt/stack/data/nova/instances/d517f598-221a-40bb-91e6-b9c34260ca40/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:29.863901 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Lock "/opt/stack/data/nova/instances/d517f598-221a-40bb-91e6-b9c34260ca40/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:29.863901 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:08:29.868304 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:08:29.869853 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:08:29.926075 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-8d7b01d0-85b5-4b7f-ad9d-bf067f93465b req-7f8e53a4-efba-4332-93f9-48e8b08c8258 service nova] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:08:29.980274 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.110s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:08:29.980673 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:29.981089 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:29.981514 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:08:29.984043 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:08:29.984362 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:08:29.997637 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-9667631f-b04c-4ed3-a8eb-3a442bfe65c7 req-c45dbceb-43fb-48b5-80dd-748f8c8440cd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:30.077531 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.093s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:08:30.078068 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/d517f598-221a-40bb-91e6-b9c34260ca40/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:08:30.139993 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/d517f598-221a-40bb-91e6-b9c34260ca40/disk 1073741824" returned: 0 in 0.062s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:08:30.140465 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.159s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:30.140922 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:08:30.254989 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.114s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:08:30.255839 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d517f598-221a-40bb-91e6-b9c34260ca40/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:08:30.256148 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d517f598-221a-40bb-91e6-b9c34260ca40/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:08:30.360795 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d517f598-221a-40bb-91e6-b9c34260ca40/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:08:30.361039 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Cannot resize image /opt/stack/data/nova/instances/d517f598-221a-40bb-91e6-b9c34260ca40/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:08:30.361458 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:08:30.361694 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Ensure instance console log exists: /opt/stack/data/nova/instances/d517f598-221a-40bb-91e6-b9c34260ca40/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:08:30.362117 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:30.362240 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:30.362421 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:30.431283 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8d7b01d0-85b5-4b7f-ad9d-bf067f93465b req-7f8e53a4-efba-4332-93f9-48e8b08c8258 service nova] Releasing lock "refresh_cache-d517f598-221a-40bb-91e6-b9c34260ca40" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:08:30.432334 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Acquired lock "refresh_cache-d517f598-221a-40bb-91e6-b9c34260ca40" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:08:30.432334 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:08:30.483444 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-9667631f-b04c-4ed3-a8eb-3a442bfe65c7 req-c45dbceb-43fb-48b5-80dd-748f8c8440cd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:30.628054 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-9667631f-b04c-4ed3-a8eb-3a442bfe65c7 req-c45dbceb-43fb-48b5-80dd-748f8c8440cd service nova] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Updated VIF entry in instance network info cache for port aecaae00-e4ff-458c-9255-8e7026a57820. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:08:30.628401 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-9667631f-b04c-4ed3-a8eb-3a442bfe65c7 req-c45dbceb-43fb-48b5-80dd-748f8c8440cd service nova] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Updating instance_info_cache with network_info: [{"id": "aecaae00-e4ff-458c-9255-8e7026a57820", "address": "fa:16:3e:1a:d1:df", "network": {"id": "6b4547f5-30ae-4bcf-b4e5-b7ffc2bcd25d", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1107528011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "42b5a6b6c4514b76a651b71280c093f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaecaae00-e4", "ovs_interfaceid": "aecaae00-e4ff-458c-9255-8e7026a57820", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:08:30.672461 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:08:30.672891 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:08:30.673063 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] No VIF found with MAC fa:16:3e:51:37:8d, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:08:30.673967 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Using config drive
May 28 10:08:31.027120 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:08:31.130539 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9667631f-b04c-4ed3-a8eb-3a442bfe65c7 req-c45dbceb-43fb-48b5-80dd-748f8c8440cd service nova] Releasing lock "refresh_cache-1ffe54bd-ad37-40a8-adfa-04e2ea9c9554" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:08:31.186290 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:31.223931 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:31.379015 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Creating config drive at /opt/stack/data/nova/instances/ca57808c-4f51-4a26-8724-d28394efab9f/disk.config
May 28 10:08:31.383468 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ca57808c-4f51-4a26-8724-d28394efab9f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp81kjnclb {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:08:31.406388 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Updating instance_info_cache with network_info: [{"id": "c2f0cd1a-3778-4996-8150-1c9cb1afc473", "address": "fa:16:3e:ff:2d:ad", "network": {"id": "ccb2b68f-6c87-4fee-860c-83e09053a83e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1057861432-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7b696dba3e04fc1a6b1b1c792ca0508", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f0cd1a-37", "ovs_interfaceid": "c2f0cd1a-3778-4996-8150-1c9cb1afc473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:08:31.448251 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ca57808c-4f51-4a26-8724-d28394efab9f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp81kjnclb" returned: 0 in 0.065s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:08:31.910246 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Releasing lock "refresh_cache-d517f598-221a-40bb-91e6-b9c34260ca40" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:08:31.910719 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Instance network_info: |[{"id": "c2f0cd1a-3778-4996-8150-1c9cb1afc473", "address": "fa:16:3e:ff:2d:ad", "network": {"id": "ccb2b68f-6c87-4fee-860c-83e09053a83e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1057861432-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7b696dba3e04fc1a6b1b1c792ca0508", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f0cd1a-37", "ovs_interfaceid": "c2f0cd1a-3778-4996-8150-1c9cb1afc473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:08:31.913573 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Start _get_guest_xml network_info=[{"id": "c2f0cd1a-3778-4996-8150-1c9cb1afc473", "address": "fa:16:3e:ff:2d:ad", "network": {"id": "ccb2b68f-6c87-4fee-860c-83e09053a83e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1057861432-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7b696dba3e04fc1a6b1b1c792ca0508", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f0cd1a-37", "ovs_interfaceid": "c2f0cd1a-3778-4996-8150-1c9cb1afc473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:08:31.920363 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:08:31.922386 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-727293952', uuid='d517f598-221a-40bb-91e6-b9c34260ca40'), owner=OwnerMeta(userid='3d6c4c0c65114263bdf7b9d657c80a51', username='tempest-VolumesActionsTest-33912954-project-member', projectid='e7b696dba3e04fc1a6b1b1c792ca0508', projectname='tempest-VolumesActionsTest-33912954'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c2f0cd1a-3778-4996-8150-1c9cb1afc473", "address": "fa:16:3e:ff:2d:ad", "network": {"id": "ccb2b68f-6c87-4fee-860c-83e09053a83e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1057861432-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7b696dba3e04fc1a6b1b1c792ca0508", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f0cd1a-37", "ovs_interfaceid": "c2f0cd1a-3778-4996-8150-1c9cb1afc473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962911.9217033) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:08:31.924048 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:08:31.924525 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:08:31.926020 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:08:31.927783 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:08:31.928489 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:08:31.929143 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:08:31.929402 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:08:31.929580 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:08:31.929784 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:08:31.929925 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:08:31.930180 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:08:31.930450 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:08:31.930661 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:08:31.930790 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:08:31.930958 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:08:31.931200 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:08:31.937032 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:31.956579 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:08:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-727293952',display_name='tempest-VolumesActionsTest-instance-727293952',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumesactionstest-instance-727293952',id=52,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7b696dba3e04fc1a6b1b1c792ca0508',ramdisk_id='',reservation_id='r-pcg98l5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-33912954',owner_user_name='tempest-VolumesActionsTest-33912954-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:08:29Z,user_data=None,user_id='3d6c4c0c65114263bdf7b9d657c80a51',uuid=d517f598-221a-40bb-91e6-b9c34260ca40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2f0cd1a-3778-4996-8150-1c9cb1afc473", "address": "fa:16:3e:ff:2d:ad", "network": {"id": "ccb2b68f-6c87-4fee-860c-83e09053a83e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1057861432-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7b696dba3e04fc1a6b1b1c792ca0508", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f0cd1a-37", "ovs_interfaceid": "c2f0cd1a-3778-4996-8150-1c9cb1afc473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:08:31.956579 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Converting VIF {"id": "c2f0cd1a-3778-4996-8150-1c9cb1afc473", "address": "fa:16:3e:ff:2d:ad", "network": {"id": "ccb2b68f-6c87-4fee-860c-83e09053a83e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1057861432-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7b696dba3e04fc1a6b1b1c792ca0508", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f0cd1a-37", "ovs_interfaceid": "c2f0cd1a-3778-4996-8150-1c9cb1afc473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:08:31.956770 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:2d:ad,bridge_name='br-int',has_traffic_filtering=True,id=c2f0cd1a-3778-4996-8150-1c9cb1afc473,network=Network(ccb2b68f-6c87-4fee-860c-83e09053a83e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2f0cd1a-37') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:08:31.961238 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Lazy-loading 'pci_devices' on Instance uuid d517f598-221a-40bb-91e6-b9c34260ca40 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:08:31.974207 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:32.078827 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:32.169823 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-0f7502bc-5cfa-4340-9974-1fa3c6d7a788 req-37dca3f5-0103-4cc8-b44a-a8244910cb53 service nova] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Received event network-vif-plugged-fca4901d-c1d5-4b95-8e64-2d88cd94725f {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:08:32.170098 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0f7502bc-5cfa-4340-9974-1fa3c6d7a788 req-37dca3f5-0103-4cc8-b44a-a8244910cb53 service nova] Acquiring lock "ca57808c-4f51-4a26-8724-d28394efab9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:32.173338 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0f7502bc-5cfa-4340-9974-1fa3c6d7a788 req-37dca3f5-0103-4cc8-b44a-a8244910cb53 service nova] Lock "ca57808c-4f51-4a26-8724-d28394efab9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:32.174149 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0f7502bc-5cfa-4340-9974-1fa3c6d7a788 req-37dca3f5-0103-4cc8-b44a-a8244910cb53 service nova] Lock "ca57808c-4f51-4a26-8724-d28394efab9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:32.174270 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-0f7502bc-5cfa-4340-9974-1fa3c6d7a788 req-37dca3f5-0103-4cc8-b44a-a8244910cb53 service nova] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Processing event network-vif-plugged-fca4901d-c1d5-4b95-8e64-2d88cd94725f {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:08:32.327546 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:32.330124 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:32.355193 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:32.355493 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:32.466424 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] End _get_guest_xml xml=<domain type="qemu">
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:   <uuid>d517f598-221a-40bb-91e6-b9c34260ca40</uuid>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:   <name>instance-00000034</name>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:       <nova:name>tempest-VolumesActionsTest-instance-727293952</nova:name>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:08:31</nova:creationTime>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:         <nova:user uuid="3d6c4c0c65114263bdf7b9d657c80a51">tempest-VolumesActionsTest-33912954-project-member</nova:user>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:         <nova:project uuid="e7b696dba3e04fc1a6b1b1c792ca0508">tempest-VolumesActionsTest-33912954</nova:project>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:         <nova:port uuid="c2f0cd1a-3778-4996-8150-1c9cb1afc473">
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:     <system>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:       <entry name="serial">d517f598-221a-40bb-91e6-b9c34260ca40</entry>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:       <entry name="uuid">d517f598-221a-40bb-91e6-b9c34260ca40</entry>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:     </system>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:   <os>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:   </os>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:   <features>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:   </features>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:   <devices>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/d517f598-221a-40bb-91e6-b9c34260ca40/disk"/>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:     </disk>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/d517f598-221a-40bb-91e6-b9c34260ca40/disk.config"/>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:     </disk>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:ff:2d:ad"/>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:       <target dev="tapc2f0cd1a-37"/>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:     </interface>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/d517f598-221a-40bb-91e6-b9c34260ca40/console.log" append="off"/>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:     </serial>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:     <video>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:     </video>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:     </rng>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:   </devices>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]: </domain>
May 28 10:08:32.466424 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:08:32.466424 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Preparing to wait for external event network-vif-plugged-c2f0cd1a-3778-4996-8150-1c9cb1afc473 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:08:32.466424 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Acquiring lock "d517f598-221a-40bb-91e6-b9c34260ca40-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:32.466424 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Lock "d517f598-221a-40bb-91e6-b9c34260ca40-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:32.466424 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Lock "d517f598-221a-40bb-91e6-b9c34260ca40-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:32.472244 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:08:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-727293952',display_name='tempest-VolumesActionsTest-instance-727293952',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumesactionstest-instance-727293952',id=52,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7b696dba3e04fc1a6b1b1c792ca0508',ramdisk_id='',reservation_id='r-pcg98l5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-33912954',owner_user_name='tempest-VolumesActionsTest-33912954-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:08:29Z,user_data=None,user_id='3d6c4c0c65114263bdf7b9d657c80a51',uuid=d517f598-221a-40bb-91e6-b9c34260ca40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2f0cd1a-3778-4996-8150-1c9cb1afc473", "address": "fa:16:3e:ff:2d:ad", "network": {"id": "ccb2b68f-6c87-4fee-860c-83e09053a83e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1057861432-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7b696dba3e04fc1a6b1b1c792ca0508", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f0cd1a-37", "ovs_interfaceid": "c2f0cd1a-3778-4996-8150-1c9cb1afc473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:08:32.472244 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Converting VIF {"id": "c2f0cd1a-3778-4996-8150-1c9cb1afc473", "address": "fa:16:3e:ff:2d:ad", "network": {"id": "ccb2b68f-6c87-4fee-860c-83e09053a83e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1057861432-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7b696dba3e04fc1a6b1b1c792ca0508", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f0cd1a-37", "ovs_interfaceid": "c2f0cd1a-3778-4996-8150-1c9cb1afc473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:08:32.472244 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:2d:ad,bridge_name='br-int',has_traffic_filtering=True,id=c2f0cd1a-3778-4996-8150-1c9cb1afc473,network=Network(ccb2b68f-6c87-4fee-860c-83e09053a83e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2f0cd1a-37') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:08:32.472244 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:2d:ad,bridge_name='br-int',has_traffic_filtering=True,id=c2f0cd1a-3778-4996-8150-1c9cb1afc473,network=Network(ccb2b68f-6c87-4fee-860c-83e09053a83e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2f0cd1a-37') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:08:32.472244 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:32.472244 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:08:32.472244 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:08:32.472244 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:32.472244 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9e246609-6b7f-5c3c-bbfe-cebf32f4d24f', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:08:32.478418 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:32.479670 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:08:32.484693 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:32.485442 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2f0cd1a-37, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:08:32.486600 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2f0cd1a-37, col_values=(('qos', UUID('81b51cf0-c682-4601-a784-21ed4c0043e6')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:08:32.486928 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2f0cd1a-37, col_values=(('external_ids', {'iface-id': 'c2f0cd1a-3778-4996-8150-1c9cb1afc473', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:2d:ad', 'vm-uuid': 'd517f598-221a-40bb-91e6-b9c34260ca40'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:08:32.488283 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:32.489794 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:08:32.494363 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:32.495545 np0000001613 nova-compute[98321]: INFO os_vif [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:2d:ad,bridge_name='br-int',has_traffic_filtering=True,id=c2f0cd1a-3778-4996-8150-1c9cb1afc473,network=Network(ccb2b68f-6c87-4fee-860c-83e09053a83e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2f0cd1a-37')
May 28 10:08:32.848236 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962912.8478136, ca57808c-4f51-4a26-8724-d28394efab9f => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:08:32.848334 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] VM Started (Lifecycle Event)
May 28 10:08:32.850042 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:08:32.852981 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:08:32.859995 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Instance spawned successfully.
May 28 10:08:32.860343 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:08:33.353297 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:08:33.353824 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:08:33.367866 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:08:33.367866 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:08:33.367866 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:08:33.367866 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:08:33.367866 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:08:33.368086 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:08:33.856635 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:08:33.857150 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962913.8567417, ca57808c-4f51-4a26-8724-d28394efab9f => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:08:33.857150 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] VM Paused (Lifecycle Event)
May 28 10:08:33.873764 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Took 9.27 seconds to spawn the instance on the hypervisor.
May 28 10:08:33.873925 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:08:34.024334 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:08:34.024451 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:08:34.024592 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] No VIF found with MAC fa:16:3e:ff:2d:ad, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:08:34.024989 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Using config drive
May 28 10:08:34.235621 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-dd19f2e3-373b-42ef-95bf-f28bc4b901dc req-a515e9cd-6d50-4607-86ef-e6832b6712fe service nova] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Received event network-vif-plugged-fca4901d-c1d5-4b95-8e64-2d88cd94725f {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:08:34.236135 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-dd19f2e3-373b-42ef-95bf-f28bc4b901dc req-a515e9cd-6d50-4607-86ef-e6832b6712fe service nova] Acquiring lock "ca57808c-4f51-4a26-8724-d28394efab9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:34.236990 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-dd19f2e3-373b-42ef-95bf-f28bc4b901dc req-a515e9cd-6d50-4607-86ef-e6832b6712fe service nova] Lock "ca57808c-4f51-4a26-8724-d28394efab9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:34.237138 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-dd19f2e3-373b-42ef-95bf-f28bc4b901dc req-a515e9cd-6d50-4607-86ef-e6832b6712fe service nova] Lock "ca57808c-4f51-4a26-8724-d28394efab9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:34.237296 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-dd19f2e3-373b-42ef-95bf-f28bc4b901dc req-a515e9cd-6d50-4607-86ef-e6832b6712fe service nova] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] No waiting events found dispatching network-vif-plugged-fca4901d-c1d5-4b95-8e64-2d88cd94725f {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:08:34.237443 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-dd19f2e3-373b-42ef-95bf-f28bc4b901dc req-a515e9cd-6d50-4607-86ef-e6832b6712fe service nova] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Received unexpected event network-vif-plugged-fca4901d-c1d5-4b95-8e64-2d88cd94725f for instance with vm_state active and task_state None.
May 28 10:08:34.359744 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:08:34.362330 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962914.362096, ca57808c-4f51-4a26-8724-d28394efab9f => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:08:34.362521 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] VM Resumed (Lifecycle Event)
May 28 10:08:34.383185 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Took 18.04 seconds to build instance.
May 28 10:08:34.530405 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:34.664699 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Creating config drive at /opt/stack/data/nova/instances/d517f598-221a-40bb-91e6-b9c34260ca40/disk.config
May 28 10:08:34.667758 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d517f598-221a-40bb-91e6-b9c34260ca40/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvb65n5dh {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:08:34.705803 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:34.730934 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d517f598-221a-40bb-91e6-b9c34260ca40/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvb65n5dh" returned: 0 in 0.063s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:08:34.865357 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:08:34.876059 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:08:34.886906 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "ca57808c-4f51-4a26-8724-d28394efab9f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.559s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:35.152283 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-1d20e871-1748-4d1d-a0f4-5ad6ea806ba7 req-fd6854a4-b1a9-483c-8d8d-d14f2d37b805 service nova] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Received event network-changed-fca4901d-c1d5-4b95-8e64-2d88cd94725f {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:08:35.152927 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-1d20e871-1748-4d1d-a0f4-5ad6ea806ba7 req-fd6854a4-b1a9-483c-8d8d-d14f2d37b805 service nova] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Refreshing instance network info cache due to event network-changed-fca4901d-c1d5-4b95-8e64-2d88cd94725f. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:08:35.153219 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1d20e871-1748-4d1d-a0f4-5ad6ea806ba7 req-fd6854a4-b1a9-483c-8d8d-d14f2d37b805 service nova] Acquiring lock "refresh_cache-ca57808c-4f51-4a26-8724-d28394efab9f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:08:35.153367 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1d20e871-1748-4d1d-a0f4-5ad6ea806ba7 req-fd6854a4-b1a9-483c-8d8d-d14f2d37b805 service nova] Acquired lock "refresh_cache-ca57808c-4f51-4a26-8724-d28394efab9f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:08:35.153639 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-1d20e871-1748-4d1d-a0f4-5ad6ea806ba7 req-fd6854a4-b1a9-483c-8d8d-d14f2d37b805 service nova] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Refreshing network info cache for port fca4901d-c1d5-4b95-8e64-2d88cd94725f {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:08:35.168560 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:35.196026 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:35.201751 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:35.296347 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:35.535839 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:35.539255 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:35.541869 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:35.573529 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:35.576180 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:35.656414 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-1d20e871-1748-4d1d-a0f4-5ad6ea806ba7 req-fd6854a4-b1a9-483c-8d8d-d14f2d37b805 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:36.009884 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-1d20e871-1748-4d1d-a0f4-5ad6ea806ba7 req-fd6854a4-b1a9-483c-8d8d-d14f2d37b805 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:36.011919 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962916.011592, d517f598-221a-40bb-91e6-b9c34260ca40 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:08:36.012081 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] VM Started (Lifecycle Event)
May 28 10:08:36.147709 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-1d20e871-1748-4d1d-a0f4-5ad6ea806ba7 req-fd6854a4-b1a9-483c-8d8d-d14f2d37b805 service nova] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Updated VIF entry in instance network info cache for port fca4901d-c1d5-4b95-8e64-2d88cd94725f. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:08:36.148095 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-1d20e871-1748-4d1d-a0f4-5ad6ea806ba7 req-fd6854a4-b1a9-483c-8d8d-d14f2d37b805 service nova] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Updating instance_info_cache with network_info: [{"id": "fca4901d-c1d5-4b95-8e64-2d88cd94725f", "address": "fa:16:3e:51:37:8d", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca4901d-c1", "ovs_interfaceid": "fca4901d-c1d5-4b95-8e64-2d88cd94725f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:08:36.299956 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5261e70a-f5b2-497c-9ac9-634701e3811a req-646f1b3d-56a0-4c60-bf24-107df8e7d54d service nova] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Received event network-vif-plugged-c2f0cd1a-3778-4996-8150-1c9cb1afc473 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:08:36.300221 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5261e70a-f5b2-497c-9ac9-634701e3811a req-646f1b3d-56a0-4c60-bf24-107df8e7d54d service nova] Acquiring lock "d517f598-221a-40bb-91e6-b9c34260ca40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:36.300415 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5261e70a-f5b2-497c-9ac9-634701e3811a req-646f1b3d-56a0-4c60-bf24-107df8e7d54d service nova] Lock "d517f598-221a-40bb-91e6-b9c34260ca40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:36.300583 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5261e70a-f5b2-497c-9ac9-634701e3811a req-646f1b3d-56a0-4c60-bf24-107df8e7d54d service nova] Lock "d517f598-221a-40bb-91e6-b9c34260ca40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:36.300752 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5261e70a-f5b2-497c-9ac9-634701e3811a req-646f1b3d-56a0-4c60-bf24-107df8e7d54d service nova] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Processing event network-vif-plugged-c2f0cd1a-3778-4996-8150-1c9cb1afc473 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:08:36.300927 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5261e70a-f5b2-497c-9ac9-634701e3811a req-646f1b3d-56a0-4c60-bf24-107df8e7d54d service nova] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Received event network-vif-plugged-c2f0cd1a-3778-4996-8150-1c9cb1afc473 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:08:36.301097 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5261e70a-f5b2-497c-9ac9-634701e3811a req-646f1b3d-56a0-4c60-bf24-107df8e7d54d service nova] Acquiring lock "d517f598-221a-40bb-91e6-b9c34260ca40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:36.301288 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5261e70a-f5b2-497c-9ac9-634701e3811a req-646f1b3d-56a0-4c60-bf24-107df8e7d54d service nova] Lock "d517f598-221a-40bb-91e6-b9c34260ca40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:36.301479 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5261e70a-f5b2-497c-9ac9-634701e3811a req-646f1b3d-56a0-4c60-bf24-107df8e7d54d service nova] Lock "d517f598-221a-40bb-91e6-b9c34260ca40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:36.301964 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:08:36.302139 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5261e70a-f5b2-497c-9ac9-634701e3811a req-646f1b3d-56a0-4c60-bf24-107df8e7d54d service nova] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] No waiting events found dispatching network-vif-plugged-c2f0cd1a-3778-4996-8150-1c9cb1afc473 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:08:36.302288 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-5261e70a-f5b2-497c-9ac9-634701e3811a req-646f1b3d-56a0-4c60-bf24-107df8e7d54d service nova] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Received unexpected event network-vif-plugged-c2f0cd1a-3778-4996-8150-1c9cb1afc473 for instance with vm_state building and task_state spawning.
May 28 10:08:36.307624 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:08:36.310116 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Instance spawned successfully.
May 28 10:08:36.310417 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:08:36.514984 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:08:36.522199 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:08:36.650344 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1d20e871-1748-4d1d-a0f4-5ad6ea806ba7 req-fd6854a4-b1a9-483c-8d8d-d14f2d37b805 service nova] Releasing lock "refresh_cache-ca57808c-4f51-4a26-8724-d28394efab9f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:08:36.819577 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:08:36.822500 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:08:36.822973 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:08:36.823386 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:08:36.823752 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:08:36.824252 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:08:37.027064 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:08:37.027462 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962917.027187, d517f598-221a-40bb-91e6-b9c34260ca40 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:08:37.028251 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] VM Paused (Lifecycle Event)
May 28 10:08:37.330184 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Took 7.47 seconds to spawn the instance on the hypervisor.
May 28 10:08:37.330184 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:08:37.490975 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:37.529984 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:08:37.533278 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962917.5329845, d517f598-221a-40bb-91e6-b9c34260ca40 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:08:37.533401 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] VM Resumed (Lifecycle Event)
May 28 10:08:37.844292 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Took 12.97 seconds to build instance.
May 28 10:08:38.036898 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:08:38.042639 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:08:38.275422 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:38.345617 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Lock "d517f598-221a-40bb-91e6-b9c34260ca40" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.483s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:38.354241 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "8dd03b27-b9a0-4260-94db-b3aec44b8faa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:38.354417 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "8dd03b27-b9a0-4260-94db-b3aec44b8faa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:38.857529 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lazy-loading 'flavor' on Instance uuid 8dd03b27-b9a0-4260-94db-b3aec44b8faa {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:08:39.686867 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-721d1c01-7ff1-4452-bc85-2e59dd854465 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Acquiring lock "d517f598-221a-40bb-91e6-b9c34260ca40" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:39.686867 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-721d1c01-7ff1-4452-bc85-2e59dd854465 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Lock "d517f598-221a-40bb-91e6-b9c34260ca40" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:39.686867 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-721d1c01-7ff1-4452-bc85-2e59dd854465 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Acquiring lock "d517f598-221a-40bb-91e6-b9c34260ca40-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:39.686867 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-721d1c01-7ff1-4452-bc85-2e59dd854465 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Lock "d517f598-221a-40bb-91e6-b9c34260ca40-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:39.686867 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-721d1c01-7ff1-4452-bc85-2e59dd854465 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Lock "d517f598-221a-40bb-91e6-b9c34260ca40-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:39.687569 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-721d1c01-7ff1-4452-bc85-2e59dd854465 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Terminating instance
May 28 10:08:39.708560 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:39.866244 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "8dd03b27-b9a0-4260-94db-b3aec44b8faa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:40.195010 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-721d1c01-7ff1-4452-bc85-2e59dd854465 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:08:40.225794 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:40.251952 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:40.256466 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:40.277315 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:40.283138 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:40.523851 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c92f6bdc-e68d-4acb-bf76-ad741e70eabb req-e32316c2-57e3-48eb-b06b-6da80d3c44f5 service nova] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Received event network-vif-unplugged-c2f0cd1a-3778-4996-8150-1c9cb1afc473 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:08:40.524303 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c92f6bdc-e68d-4acb-bf76-ad741e70eabb req-e32316c2-57e3-48eb-b06b-6da80d3c44f5 service nova] Acquiring lock "d517f598-221a-40bb-91e6-b9c34260ca40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:40.524545 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c92f6bdc-e68d-4acb-bf76-ad741e70eabb req-e32316c2-57e3-48eb-b06b-6da80d3c44f5 service nova] Lock "d517f598-221a-40bb-91e6-b9c34260ca40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:40.524717 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c92f6bdc-e68d-4acb-bf76-ad741e70eabb req-e32316c2-57e3-48eb-b06b-6da80d3c44f5 service nova] Lock "d517f598-221a-40bb-91e6-b9c34260ca40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:40.524938 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c92f6bdc-e68d-4acb-bf76-ad741e70eabb req-e32316c2-57e3-48eb-b06b-6da80d3c44f5 service nova] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] No waiting events found dispatching network-vif-unplugged-c2f0cd1a-3778-4996-8150-1c9cb1afc473 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:08:40.525046 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c92f6bdc-e68d-4acb-bf76-ad741e70eabb req-e32316c2-57e3-48eb-b06b-6da80d3c44f5 service nova] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Received event network-vif-unplugged-c2f0cd1a-3778-4996-8150-1c9cb1afc473 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:08:40.555455 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999631645000136 future=<Future at 0x73c1f43ae4b0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:08:40.555730 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999328901000354 future=<Future at 0x73c1f43ae4b0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:08:40.555859 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.99918625600003 future=<Future at 0x73c1f43ae4b0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:08:40.558080 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Instance destroyed successfully.
May 28 10:08:40.558575 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-721d1c01-7ff1-4452-bc85-2e59dd854465 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Lazy-loading 'resources' on Instance uuid d517f598-221a-40bb-91e6-b9c34260ca40 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:08:40.969454 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "8dd03b27-b9a0-4260-94db-b3aec44b8faa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:40.969820 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "8dd03b27-b9a0-4260-94db-b3aec44b8faa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:40.969904 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Attaching volume 17f8efc4-1fb9-4292-9d7d-1757634ecf14 to /dev/vdb
May 28 10:08:41.021070 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:08:41.032866 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:08:41.056214 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:08:41.069720 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-721d1c01-7ff1-4452-bc85-2e59dd854465 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:08:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-727293952',display_name='tempest-VolumesActionsTest-instance-727293952',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumesactionstest-instance-727293952',id=52,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:08:37Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7b696dba3e04fc1a6b1b1c792ca0508',ramdisk_id='',reservation_id='r-pcg98l5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-33912954',owner_user_name='tempest-VolumesActionsTest-33912954-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:08:37Z,user_data=None,user_id='3d6c4c0c65114263bdf7b9d657c80a51',uuid=d517f598-221a-40bb-91e6-b9c34260ca40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2f0cd1a-3778-4996-8150-1c9cb1afc473", "address": "fa:16:3e:ff:2d:ad", "network": {"id": "ccb2b68f-6c87-4fee-860c-83e09053a83e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1057861432-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7b696dba3e04fc1a6b1b1c792ca0508", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f0cd1a-37", "ovs_interfaceid": "c2f0cd1a-3778-4996-8150-1c9cb1afc473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:08:41.070032 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-721d1c01-7ff1-4452-bc85-2e59dd854465 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Converting VIF {"id": "c2f0cd1a-3778-4996-8150-1c9cb1afc473", "address": "fa:16:3e:ff:2d:ad", "network": {"id": "ccb2b68f-6c87-4fee-860c-83e09053a83e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1057861432-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7b696dba3e04fc1a6b1b1c792ca0508", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f0cd1a-37", "ovs_interfaceid": "c2f0cd1a-3778-4996-8150-1c9cb1afc473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:08:41.071274 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-721d1c01-7ff1-4452-bc85-2e59dd854465 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:2d:ad,bridge_name='br-int',has_traffic_filtering=True,id=c2f0cd1a-3778-4996-8150-1c9cb1afc473,network=Network(ccb2b68f-6c87-4fee-860c-83e09053a83e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2f0cd1a-37') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:08:41.071680 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-721d1c01-7ff1-4452-bc85-2e59dd854465 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:2d:ad,bridge_name='br-int',has_traffic_filtering=True,id=c2f0cd1a-3778-4996-8150-1c9cb1afc473,network=Network(ccb2b68f-6c87-4fee-860c-83e09053a83e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2f0cd1a-37') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:08:41.074242 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:41.074815 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2f0cd1a-37, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:08:41.076653 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:41.078196 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:08:41.079438 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:41.079710 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=81b51cf0-c682-4601-a784-21ed4c0043e6) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:08:41.080842 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:08:41.081406 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:41.083969 np0000001613 nova-compute[98321]: INFO os_vif [None req-721d1c01-7ff1-4452-bc85-2e59dd854465 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:2d:ad,bridge_name='br-int',has_traffic_filtering=True,id=c2f0cd1a-3778-4996-8150-1c9cb1afc473,network=Network(ccb2b68f-6c87-4fee-860c-83e09053a83e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2f0cd1a-37')
May 28 10:08:41.084457 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-721d1c01-7ff1-4452-bc85-2e59dd854465 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Deleting instance files /opt/stack/data/nova/instances/d517f598-221a-40bb-91e6-b9c34260ca40_del
May 28 10:08:41.085318 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-721d1c01-7ff1-4452-bc85-2e59dd854465 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Deletion of /opt/stack/data/nova/instances/d517f598-221a-40bb-91e6-b9c34260ca40_del complete
May 28 10:08:41.100188 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:08:41.100447 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:08:41.111641 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:08:41.112742 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe05:512a', 'fe80::ec4e:cbff:fea7:f945', 'fe80::fc16:3eff:feb6:e03d', 'fe80::c4f8:89ff:fef6:4009', 'fe80::fc16:3eff:fe1a:d1df', 'fe80::1c9e:daff:fee5:c4bc', 'fe80::fc16:3eff:fe51:378d', 'fe80::e4eb:4cff:fe5c:5eb7'] 
May 28 10:08:41.112895 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:08:41.112999 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:08:41.113240 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] <== get_connector_properties: return (91ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:08:41.113438 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Updating existing volume attachment record: 585abd8e-b71c-445f-8c96-f87ebb21fe13 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:08:41.595601 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-721d1c01-7ff1-4452-bc85-2e59dd854465 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Took 1.40 seconds to destroy the instance on the hypervisor.
May 28 10:08:41.596542 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-721d1c01-7ff1-4452-bc85-2e59dd854465 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:08:41.596874 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:08:41.596988 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:08:41.597298 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:41.690653 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14', 'iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '17f8efc4-1fb9-4292-9d7d-1757634ecf14', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '8dd03b27-b9a0-4260-94db-b3aec44b8faa', 'attached_at': '', 'detached_at': '', 'volume_id': '17f8efc4-1fb9-4292-9d7d-1757634ecf14', 'serial': '17f8efc4-1fb9-4292-9d7d-1757634ecf14'} {{(pid=98321) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 10:08:41.692010 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:08:41.692376 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14', 'iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '17f8efc4-1fb9-4292-9d7d-1757634ecf14', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:08:41.692568 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:08:41.692964 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:08:41.693213 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14', 'iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '17f8efc4-1fb9-4292-9d7d-1757634ecf14', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:08:41.700837 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:41.704026 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:08:41.704565 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:08:41.705300 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:08:41.705300 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:08:41.705300 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:08:41.705300 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:08:41.721752 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:08:41.721752 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:41.725273 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:08:41.725273 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:41.738251 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14] added
May 28 10:08:41.738251 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:08:41.738251 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:08:41.738251 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:08:41.738251 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:08:41.738251 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:08:41.738251 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:41.738251 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:08:41.738251 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0333(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:08:41.739489 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:08:41.739489 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14] added
May 28 10:08:41.739489 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:08:41.739489 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:08:41.739489 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:08:41.739489 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:08:41.739489 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:08:41.739489 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:41.739489 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:08:41.739489 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0339(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:08:41.739489 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:08:42.084442 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:42.454023 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:08:42.600308 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4e6567be-34eb-473b-8e62-24262f4352ed req-17e8394f-702e-4383-b9b2-4f26081142dd service nova] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Received event network-vif-unplugged-c2f0cd1a-3778-4996-8150-1c9cb1afc473 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:08:42.601138 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4e6567be-34eb-473b-8e62-24262f4352ed req-17e8394f-702e-4383-b9b2-4f26081142dd service nova] Acquiring lock "d517f598-221a-40bb-91e6-b9c34260ca40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:42.601354 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4e6567be-34eb-473b-8e62-24262f4352ed req-17e8394f-702e-4383-b9b2-4f26081142dd service nova] Lock "d517f598-221a-40bb-91e6-b9c34260ca40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:42.601531 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4e6567be-34eb-473b-8e62-24262f4352ed req-17e8394f-702e-4383-b9b2-4f26081142dd service nova] Lock "d517f598-221a-40bb-91e6-b9c34260ca40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:42.601709 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4e6567be-34eb-473b-8e62-24262f4352ed req-17e8394f-702e-4383-b9b2-4f26081142dd service nova] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] No waiting events found dispatching network-vif-unplugged-c2f0cd1a-3778-4996-8150-1c9cb1afc473 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:08:42.601867 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4e6567be-34eb-473b-8e62-24262f4352ed req-17e8394f-702e-4383-b9b2-4f26081142dd service nova] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Received event network-vif-unplugged-c2f0cd1a-3778-4996-8150-1c9cb1afc473 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:08:42.602068 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4e6567be-34eb-473b-8e62-24262f4352ed req-17e8394f-702e-4383-b9b2-4f26081142dd service nova] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Received event network-vif-deleted-c2f0cd1a-3778-4996-8150-1c9cb1afc473 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:08:42.738854 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:08:42.742270 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:08:42.754427 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:08:42.754427 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:08:42.758536 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:08:42.758536 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:42.770804 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:42.774398 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:42.786590 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:42.786590 np0000001613 nova-compute[98321]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:42.786590 np0000001613 nova-compute[98321]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:08:42.786590 np0000001613 nova-compute[98321]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:08:42.786590 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:08:42.786590 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsi session list stdout=tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:42.786590 np0000001613 nova-compute[98321]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:42.786590 np0000001613 nova-compute[98321]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:08:42.786590 np0000001613 nova-compute[98321]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:08:42.786590 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:08:42.792903 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:42.792903 np0000001613 nova-compute[98321]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:42.792903 np0000001613 nova-compute[98321]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:08:42.792903 np0000001613 nova-compute[98321]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:08:42.792903 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:08:42.793082 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsi session list stdout=tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:42.793082 np0000001613 nova-compute[98321]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:42.793082 np0000001613 nova-compute[98321]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:08:42.793082 np0000001613 nova-compute[98321]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:08:42.793082 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:08:42.829233 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14, portal: 192.168.50.100,3260]
May 28 10:08:42.829233 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14, portal: 192.168.50.100,3260] successful.
May 28 10:08:42.829233 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:42.838863 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14, portal: 192.168.40.100,3260]
May 28 10:08:42.838863 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14, portal: 192.168.40.100,3260] successful.
May 28 10:08:42.838863 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:42.848571 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:42.856420 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:42.868245 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:42.868245 np0000001613 nova-compute[98321]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:42.868245 np0000001613 nova-compute[98321]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:08:42.868245 np0000001613 nova-compute[98321]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:08:42.868245 np0000001613 nova-compute[98321]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14 (non-flash)
May 28 10:08:42.868245 np0000001613 nova-compute[98321]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14 (non-flash)
May 28 10:08:42.868245 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:08:42.868585 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsi session list stdout=tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:42.868585 np0000001613 nova-compute[98321]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:42.868585 np0000001613 nova-compute[98321]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:08:42.868585 np0000001613 nova-compute[98321]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:08:42.868585 np0000001613 nova-compute[98321]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14 (non-flash)
May 28 10:08:42.868585 np0000001613 nova-compute[98321]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14 (non-flash)
May 28 10:08:42.868585 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:08:42.868799 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.164s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:08:42.868919 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:08:42.871782 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] HCTL ('11', '-', '-', 0) found on session 125 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:08:42.871929 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:08:42.878271 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:42.878271 np0000001613 nova-compute[98321]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:42.878271 np0000001613 nova-compute[98321]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:08:42.878271 np0000001613 nova-compute[98321]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:08:42.878271 np0000001613 nova-compute[98321]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14 (non-flash)
May 28 10:08:42.878271 np0000001613 nova-compute[98321]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14 (non-flash)
May 28 10:08:42.878271 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:08:42.878833 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsi session list stdout=tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:42.878833 np0000001613 nova-compute[98321]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:42.878833 np0000001613 nova-compute[98321]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:08:42.878833 np0000001613 nova-compute[98321]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:08:42.878833 np0000001613 nova-compute[98321]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14 (non-flash)
May 28 10:08:42.878833 np0000001613 nova-compute[98321]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14 (non-flash)
May 28 10:08:42.878833 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:08:42.879422 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.174s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:08:42.879737 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:08:42.880759 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] HCTL ('12', '-', '-', 0) found on session 126 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:08:42.881223 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:08:42.889837 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Searching for a device in session 125 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:08:42.889837 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '17f8efc4-1fb9-4292-9d7d-1757634ecf14', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:08:42.898371 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Searching for a device in session 126 and hctl ['12', '*', '*', 0] yield: None {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:08:42.957880 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Took 1.36 seconds to deallocate network for instance.
May 28 10:08:43.474947 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-721d1c01-7ff1-4452-bc85-2e59dd854465 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:43.474947 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-721d1c01-7ff1-4452-bc85-2e59dd854465 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:43.777590 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-721d1c01-7ff1-4452-bc85-2e59dd854465 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:08:43.777890 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-721d1c01-7ff1-4452-bc85-2e59dd854465 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:08:43.898021 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Searching for a device in session 126 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:08:43.898279 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '17f8efc4-1fb9-4292-9d7d-1757634ecf14', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:08:44.280702 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-721d1c01-7ff1-4452-bc85-2e59dd854465 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:08:44.650719 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:44.710116 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:44.721101 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Found WWN 3300000007d5b40ef for multipath device dm-6 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:08:44.721365 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.028s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:08:44.722314 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] <== connect_volume: return (3029ms) {'type': 'block', 'scsi_wwn': '3300000007d5b40ef', 'path': '/dev/disk/by-id/os-brick+dev+dm-6', 'multipath_id': '3300000007d5b40ef'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:08:44.722449 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007d5b40ef', 'path': '/dev/disk/by-id/os-brick+dev+dm-6', 'multipath_id': '3300000007d5b40ef'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:08:44.724884 np0000001613 nova-compute[98321]: WARNING stevedore.named [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 10:08:44.725145 np0000001613 nova-compute[98321]: WARNING castellan.key_manager [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 10:08:44.725411 np0000001613 nova-compute[98321]: WARNING nova.keymgr.conf_key_mgr [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 10:08:44.725933 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x73c205a6c5c0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14', 'iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '17f8efc4-1fb9-4292-9d7d-1757634ecf14', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, 'status': 'reserved', 'instance': '8dd03b27-b9a0-4260-94db-b3aec44b8faa', 'attached_at': '', 'detached_at': '', 'volume_id': '17f8efc4-1fb9-4292-9d7d-1757634ecf14', 'serial': '17f8efc4-1fb9-4292-9d7d-1757634ecf14'} {{(pid=98321) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 10:08:44.726075 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=98321) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 28 10:08:44.726211 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors.luks [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] opening encrypted volume /dev/dm-6 {{(pid=98321) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 28 10:08:44.755040 np0000001613 nova-compute[98321]: WARNING os_brick.encryptors.luks [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 28 10:08:44.755151 np0000001613 nova-compute[98321]: INFO os_brick.encryptors.luks [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] /dev/dm-6 is not a valid LUKS device; formatting device for first use
May 28 10:08:44.755290 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors.luks [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] formatting encrypted volume /dev/dm-6 {{(pid=98321) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 28 10:08:44.787781 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-721d1c01-7ff1-4452-bc85-2e59dd854465 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.314s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:44.842787 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-721d1c01-7ff1-4452-bc85-2e59dd854465 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Deleted allocations for instance d517f598-221a-40bb-91e6-b9c34260ca40
May 28 10:08:45.852111 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-721d1c01-7ff1-4452-bc85-2e59dd854465 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Lock "d517f598-221a-40bb-91e6-b9c34260ca40" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.167s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:46.085193 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:47.867528 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:48.113410 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Acquiring lock "e4215271-8b48-4661-bc06-eb3f276c2b80" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:48.113752 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Lock "e4215271-8b48-4661-bc06-eb3f276c2b80" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:48.622494 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:08:49.217934 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:49.217934 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:49.226032 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:08:49.226317 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Claim successful on node np0000001613
May 28 10:08:49.710360 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:50.611222 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:08:50.611668 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:08:50.657132 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:51.092410 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:51.115386 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:08:51.374291 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors.luks [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] opening encrypted volume /dev/dm-6 {{(pid=98321) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 28 10:08:51.625228 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.407s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:51.625803 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:08:52.142067 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:08:52.142067 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:08:52.142067 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:52.142067 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:52.221612 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d6c4c0c65114263bdf7b9d657c80a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b696dba3e04fc1a6b1b1c792ca0508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:08:52.256309 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Acquiring lock "9106964d-dcd7-4628-9cd7-c09b0739e749" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:52.256465 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Lock "9106964d-dcd7-4628-9cd7-c09b0739e749" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:52.614092 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Successfully created port: 10374d15-c1a4-4c1d-90a3-dba7f0348952 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:08:52.643848 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:08:52.758081 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:08:52.792021 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:08:52.792436 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:08:53.150185 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:08:53.190306 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Successfully updated port: 10374d15-c1a4-4c1d-90a3-dba7f0348952 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:08:53.235332 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-46454bb5-4057-4226-a549-e1e8da1c07be req-392d7793-623d-414e-b8fe-2394ded5692d service nova] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Received event network-changed-10374d15-c1a4-4c1d-90a3-dba7f0348952 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:08:53.235502 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-46454bb5-4057-4226-a549-e1e8da1c07be req-392d7793-623d-414e-b8fe-2394ded5692d service nova] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Refreshing instance network info cache due to event network-changed-10374d15-c1a4-4c1d-90a3-dba7f0348952. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:08:53.235663 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-46454bb5-4057-4226-a549-e1e8da1c07be req-392d7793-623d-414e-b8fe-2394ded5692d service nova] Acquiring lock "refresh_cache-e4215271-8b48-4661-bc06-eb3f276c2b80" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:08:53.235821 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-46454bb5-4057-4226-a549-e1e8da1c07be req-392d7793-623d-414e-b8fe-2394ded5692d service nova] Acquired lock "refresh_cache-e4215271-8b48-4661-bc06-eb3f276c2b80" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:08:53.235960 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-46454bb5-4057-4226-a549-e1e8da1c07be req-392d7793-623d-414e-b8fe-2394ded5692d service nova] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Refreshing network info cache for port 10374d15-c1a4-4c1d-90a3-dba7f0348952 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:08:53.331102 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:53.331501 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:53.334898 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:08:53.335131 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Claim successful on node np0000001613
May 28 10:08:53.346335 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lazy-loading 'flavor' on Instance uuid 8dd03b27-b9a0-4260-94db-b3aec44b8faa {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:08:53.694932 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Acquiring lock "refresh_cache-e4215271-8b48-4661-bc06-eb3f276c2b80" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:08:53.738237 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-46454bb5-4057-4226-a549-e1e8da1c07be req-392d7793-623d-414e-b8fe-2394ded5692d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:53.804178 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-46454bb5-4057-4226-a549-e1e8da1c07be req-392d7793-623d-414e-b8fe-2394ded5692d service nova] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:08:53.855933 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Attempting to attach volume 17f8efc4-1fb9-4292-9d7d-1757634ecf14 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 10:08:53.857304 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] attach device xml: <disk type="block" device="disk">
May 28 10:08:53.857304 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:08:53.857304 np0000001613 nova-compute[98321]:   <alias name="ua-17f8efc4-1fb9-4292-9d7d-1757634ecf14"/>
May 28 10:08:53.857304 np0000001613 nova-compute[98321]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-6"/>
May 28 10:08:53.857304 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:08:53.857304 np0000001613 nova-compute[98321]:   <serial>17f8efc4-1fb9-4292-9d7d-1757634ecf14</serial>
May 28 10:08:53.857304 np0000001613 nova-compute[98321]: </disk>
May 28 10:08:53.857304 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 10:08:53.968672 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-46454bb5-4057-4226-a549-e1e8da1c07be req-392d7793-623d-414e-b8fe-2394ded5692d service nova] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:08:54.158419 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:08:54.159704 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:08:54.160045 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Creating image(s)
May 28 10:08:54.160783 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4215271-8b48-4661-bc06-eb3f276c2b80/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:54.160983 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Lock "/opt/stack/data/nova/instances/e4215271-8b48-4661-bc06-eb3f276c2b80/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:54.161586 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Lock "/opt/stack/data/nova/instances/e4215271-8b48-4661-bc06-eb3f276c2b80/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:54.162266 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:08:54.165947 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:08:54.167288 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:08:54.261806 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.094s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:08:54.262504 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:54.263864 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:54.264411 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:08:54.267616 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:08:54.267981 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:08:54.332624 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-16ab0d9d-12bd-43f2-8ebc-f567c4554c2a req-86fd77cf-e46f-43c1-999a-1c735c43b029 service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Received event network-changed-5724dc5f-94cc-45c9-ac48-670de0fa781f {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:08:54.332795 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-16ab0d9d-12bd-43f2-8ebc-f567c4554c2a req-86fd77cf-e46f-43c1-999a-1c735c43b029 service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Refreshing instance network info cache due to event network-changed-5724dc5f-94cc-45c9-ac48-670de0fa781f. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:08:54.333042 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-16ab0d9d-12bd-43f2-8ebc-f567c4554c2a req-86fd77cf-e46f-43c1-999a-1c735c43b029 service nova] Acquiring lock "refresh_cache-742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:08:54.333130 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-16ab0d9d-12bd-43f2-8ebc-f567c4554c2a req-86fd77cf-e46f-43c1-999a-1c735c43b029 service nova] Acquired lock "refresh_cache-742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:08:54.333292 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-16ab0d9d-12bd-43f2-8ebc-f567c4554c2a req-86fd77cf-e46f-43c1-999a-1c735c43b029 service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Refreshing network info cache for port 5724dc5f-94cc-45c9-ac48-670de0fa781f {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:08:54.368080 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.100s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:08:54.368683 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/e4215271-8b48-4661-bc06-eb3f276c2b80/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:08:54.443841 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/e4215271-8b48-4661-bc06-eb3f276c2b80/disk 1073741824" returned: 0 in 0.075s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:08:54.444289 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.180s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:54.444623 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:08:54.475291 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-46454bb5-4057-4226-a549-e1e8da1c07be req-392d7793-623d-414e-b8fe-2394ded5692d service nova] Releasing lock "refresh_cache-e4215271-8b48-4661-bc06-eb3f276c2b80" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:08:54.478493 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Acquired lock "refresh_cache-e4215271-8b48-4661-bc06-eb3f276c2b80" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:08:54.478939 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:08:54.556027 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.111s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:08:54.556429 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e4215271-8b48-4661-bc06-eb3f276c2b80/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:08:54.556674 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4215271-8b48-4661-bc06-eb3f276c2b80/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:08:54.659020 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4215271-8b48-4661-bc06-eb3f276c2b80/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:08:54.659769 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Cannot resize image /opt/stack/data/nova/instances/e4215271-8b48-4661-bc06-eb3f276c2b80/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:08:54.660427 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:08:54.660678 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Ensure instance console log exists: /opt/stack/data/nova/instances/e4215271-8b48-4661-bc06-eb3f276c2b80/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:08:54.661017 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:54.661277 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:54.661588 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:54.721742 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:54.791774 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:08:54.793236 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:08:54.794353 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:08:54.794799 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:08:54.836073 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-16ab0d9d-12bd-43f2-8ebc-f567c4554c2a req-86fd77cf-e46f-43c1-999a-1c735c43b029 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:54.861717 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Acquiring lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:54.861896 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:54.862147 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Acquiring lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:54.862307 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:54.862456 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:54.864719 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Terminating instance
May 28 10:08:55.100190 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:08:55.172413 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-16ab0d9d-12bd-43f2-8ebc-f567c4554c2a req-86fd77cf-e46f-43c1-999a-1c735c43b029 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:55.285583 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:55.298737 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:08:55.308663 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:55.370193 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:08:55.393184 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:55.416322 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:55.422309 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:55.445474 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Updating instance_info_cache with network_info: [{"id": "10374d15-c1a4-4c1d-90a3-dba7f0348952", "address": "fa:16:3e:c7:6d:47", "network": {"id": "ccb2b68f-6c87-4fee-860c-83e09053a83e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1057861432-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7b696dba3e04fc1a6b1b1c792ca0508", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap10374d15-c1", "ovs_interfaceid": "10374d15-c1a4-4c1d-90a3-dba7f0348952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:08:55.445746 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:55.450789 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:55.487947 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-16ab0d9d-12bd-43f2-8ebc-f567c4554c2a req-86fd77cf-e46f-43c1-999a-1c735c43b029 service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Updated VIF entry in instance network info cache for port 5724dc5f-94cc-45c9-ac48-670de0fa781f. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:08:55.488156 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-16ab0d9d-12bd-43f2-8ebc-f567c4554c2a req-86fd77cf-e46f-43c1-999a-1c735c43b029 service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Updating instance_info_cache with network_info: [{"id": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "address": "fa:16:3e:b6:e0:3d", "network": {"id": "5264d7e4-aeaa-4172-8f4e-f2845bb783e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1746959726-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92aad30ae7cf45cbb0233727a1e77316", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5724dc5f-94", "ovs_interfaceid": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:08:55.518007 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-802dd463-6726-4b84-a8ac-ec8c704de86c req-a8686b56-c39a-4048-bb9e-9b6fe104317f service nova] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Received event network-vif-unplugged-10374d15-c1a4-4c1d-90a3-dba7f0348952 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:08:55.518380 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-802dd463-6726-4b84-a8ac-ec8c704de86c req-a8686b56-c39a-4048-bb9e-9b6fe104317f service nova] Acquiring lock "e4215271-8b48-4661-bc06-eb3f276c2b80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:55.518559 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-802dd463-6726-4b84-a8ac-ec8c704de86c req-a8686b56-c39a-4048-bb9e-9b6fe104317f service nova] Lock "e4215271-8b48-4661-bc06-eb3f276c2b80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:55.518756 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-802dd463-6726-4b84-a8ac-ec8c704de86c req-a8686b56-c39a-4048-bb9e-9b6fe104317f service nova] Lock "e4215271-8b48-4661-bc06-eb3f276c2b80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:55.518849 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-802dd463-6726-4b84-a8ac-ec8c704de86c req-a8686b56-c39a-4048-bb9e-9b6fe104317f service nova] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] No waiting events found dispatching network-vif-unplugged-10374d15-c1a4-4c1d-90a3-dba7f0348952 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:08:55.519011 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-802dd463-6726-4b84-a8ac-ec8c704de86c req-a8686b56-c39a-4048-bb9e-9b6fe104317f service nova] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Received unexpected event network-vif-unplugged-10374d15-c1a4-4c1d-90a3-dba7f0348952 for instance with vm_state building and task_state spawning.
May 28 10:08:55.551619 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:08:55.551786 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:08:55.551902 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:08:55.552015 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] No VIF found with MAC fa:16:3e:05:51:2a, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:08:55.555592 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.00045473199998014024 future=<Future at 0x73c1f43ae4b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:08:55.555716 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:08:55.555913 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-4ebe5eac-5fbf-4b5d-b47d-693e5a8cdb01 None None] Emitting event <LifecycleEvent: 1779962920.5549679, d517f598-221a-40bb-91e6-b9c34260ca40 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:08:55.556115 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-4ebe5eac-5fbf-4b5d-b47d-693e5a8cdb01 None None] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] VM Stopped (Lifecycle Event)
May 28 10:08:55.722839 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999673421999887 future=<Future at 0x73c1f41c2810 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:08:55.724500 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.997990771999866 future=<Future at 0x73c1f41c2810 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:08:55.724617 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.997848195999723 future=<Future at 0x73c1f41c2810 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:08:55.728337 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Instance destroyed successfully.
May 28 10:08:55.728798 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lazy-loading 'resources' on Instance uuid 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:08:55.820332 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.489s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:55.820909 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.512s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:55.821111 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:08:55.823101 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:55.823515 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Auditing locally available compute resources for np0000001613 (node: np0000001613) {{(pid=98321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 10:08:55.947252 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Releasing lock "refresh_cache-e4215271-8b48-4661-bc06-eb3f276c2b80" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:08:55.947498 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Instance network_info: |[{"id": "10374d15-c1a4-4c1d-90a3-dba7f0348952", "address": "fa:16:3e:c7:6d:47", "network": {"id": "ccb2b68f-6c87-4fee-860c-83e09053a83e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1057861432-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7b696dba3e04fc1a6b1b1c792ca0508", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap10374d15-c1", "ovs_interfaceid": "10374d15-c1a4-4c1d-90a3-dba7f0348952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:08:55.952543 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Start _get_guest_xml network_info=[{"id": "10374d15-c1a4-4c1d-90a3-dba7f0348952", "address": "fa:16:3e:c7:6d:47", "network": {"id": "ccb2b68f-6c87-4fee-860c-83e09053a83e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1057861432-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7b696dba3e04fc1a6b1b1c792ca0508", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap10374d15-c1", "ovs_interfaceid": "10374d15-c1a4-4c1d-90a3-dba7f0348952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:08:55.954466 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:08:55.954953 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-1757261744', uuid='e4215271-8b48-4661-bc06-eb3f276c2b80'), owner=OwnerMeta(userid='3d6c4c0c65114263bdf7b9d657c80a51', username='tempest-VolumesActionsTest-33912954-project-member', projectid='e7b696dba3e04fc1a6b1b1c792ca0508', projectname='tempest-VolumesActionsTest-33912954'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "10374d15-c1a4-4c1d-90a3-dba7f0348952", "address": "fa:16:3e:c7:6d:47", "network": {"id": "ccb2b68f-6c87-4fee-860c-83e09053a83e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1057861432-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7b696dba3e04fc1a6b1b1c792ca0508", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap10374d15-c1", "ovs_interfaceid": "10374d15-c1a4-4c1d-90a3-dba7f0348952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962935.9546313) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:08:55.956699 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:08:55.956699 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:08:55.958505 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:08:55.958677 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:08:55.959775 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:08:55.960198 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:08:55.960442 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:08:55.960631 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:08:55.960908 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:08:55.961085 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:08:55.961246 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:08:55.961433 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:08:55.961690 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:08:55.961915 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:08:55.962026 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:08:55.962225 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:08:55.973419 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1757261744',display_name='tempest-VolumesActionsTest-instance-1757261744',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumesactionstest-instance-1757261744',id=53,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7b696dba3e04fc1a6b1b1c792ca0508',ramdisk_id='',reservation_id='r-n1fdalk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-33912954',owner_user_name='tempest-VolumesActionsTest-33912954-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:08:53Z,user_data=None,user_id='3d6c4c0c65114263bdf7b9d657c80a51',uuid=e4215271-8b48-4661-bc06-eb3f276c2b80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10374d15-c1a4-4c1d-90a3-dba7f0348952", "address": "fa:16:3e:c7:6d:47", "network": {"id": "ccb2b68f-6c87-4fee-860c-83e09053a83e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1057861432-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7b696dba3e04fc1a6b1b1c792ca0508", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap10374d15-c1", "ovs_interfaceid": "10374d15-c1a4-4c1d-90a3-dba7f0348952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:08:55.973593 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Converting VIF {"id": "10374d15-c1a4-4c1d-90a3-dba7f0348952", "address": "fa:16:3e:c7:6d:47", "network": {"id": "ccb2b68f-6c87-4fee-860c-83e09053a83e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1057861432-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7b696dba3e04fc1a6b1b1c792ca0508", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap10374d15-c1", "ovs_interfaceid": "10374d15-c1a4-4c1d-90a3-dba7f0348952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:08:55.974205 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:6d:47,bridge_name='br-int',has_traffic_filtering=True,id=10374d15-c1a4-4c1d-90a3-dba7f0348952,network=Network(ccb2b68f-6c87-4fee-860c-83e09053a83e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10374d15-c1') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:08:55.974935 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Lazy-loading 'pci_devices' on Instance uuid e4215271-8b48-4661-bc06-eb3f276c2b80 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:08:55.990589 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-16ab0d9d-12bd-43f2-8ebc-f567c4554c2a req-86fd77cf-e46f-43c1-999a-1c735c43b029 service nova] Releasing lock "refresh_cache-742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:08:56.058316 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-4ebe5eac-5fbf-4b5d-b47d-693e5a8cdb01 None None] [instance: d517f598-221a-40bb-91e6-b9c34260ca40] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:08:56.093709 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:56.231448 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T10:06:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-969313737',display_name='tempest-TestShelveInstance-server-969313737',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testshelveinstance-server-969313737',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMc5vWcPj8o1zbNh8BWbgPG9pn6dL+GHSCWT99UnDlhu/5IpqN2TRKtEuk4+HsJOYf9KLTLz6y4Wh5WSsvPh4I6FKx2iXP7xTr8JCS9CqOW5AvvlIE1O/+p2kUreJErTw==',key_name='tempest-TestShelveInstance-444905061',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:08:15Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92aad30ae7cf45cbb0233727a1e77316',ramdisk_id='',reservation_id='r-nvd0lh0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-793753334',owner_user_name='tempest-TestShelveInstance-793753334-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:08:16Z,user_data=None,user_id='d05aead48ddb43b6b4e52469338207ae',uuid=742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "address": "fa:16:3e:b6:e0:3d", "network": {"id": "5264d7e4-aeaa-4172-8f4e-f2845bb783e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1746959726-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92aad30ae7cf45cbb0233727a1e77316", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5724dc5f-94", "ovs_interfaceid": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:08:56.231647 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Converting VIF {"id": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "address": "fa:16:3e:b6:e0:3d", "network": {"id": "5264d7e4-aeaa-4172-8f4e-f2845bb783e6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1746959726-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92aad30ae7cf45cbb0233727a1e77316", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5724dc5f-94", "ovs_interfaceid": "5724dc5f-94cc-45c9-ac48-670de0fa781f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:08:56.232140 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:e0:3d,bridge_name='br-int',has_traffic_filtering=True,id=5724dc5f-94cc-45c9-ac48-670de0fa781f,network=Network(5264d7e4-aeaa-4172-8f4e-f2845bb783e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5724dc5f-94') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:08:56.232391 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:e0:3d,bridge_name='br-int',has_traffic_filtering=True,id=5724dc5f-94cc-45c9-ac48-670de0fa781f,network=Network(5264d7e4-aeaa-4172-8f4e-f2845bb783e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5724dc5f-94') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:08:56.236740 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:56.236924 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5724dc5f-94, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:08:56.237804 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:56.238750 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:08:56.239427 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:56.239584 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2c4e479d-f9b7-4c35-9df9-26e622da0e47) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:08:56.240308 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:56.240558 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:08:56.242059 np0000001613 nova-compute[98321]: INFO os_vif [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:e0:3d,bridge_name='br-int',has_traffic_filtering=True,id=5724dc5f-94cc-45c9-ac48-670de0fa781f,network=Network(5264d7e4-aeaa-4172-8f4e-f2845bb783e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5724dc5f-94')
May 28 10:08:56.243314 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:08:56.243648 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc', 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ec1e6963-9189-4750-a397-d2bc2ab54efc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:08:56.243838 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:08:56.244150 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:08:56.244576 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc', 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ec1e6963-9189-4750-a397-d2bc2ab54efc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:08:56.244758 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:08:56.268768 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:56.268768 np0000001613 nova-compute[98321]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:56.268768 np0000001613 nova-compute[98321]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:08:56.268768 np0000001613 nova-compute[98321]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:08:56.268768 np0000001613 nova-compute[98321]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14 (non-flash)
May 28 10:08:56.268768 np0000001613 nova-compute[98321]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14 (non-flash)
May 28 10:08:56.268768 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:08:56.269037 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsi session list stdout=tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:56.269037 np0000001613 nova-compute[98321]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc (non-flash)
May 28 10:08:56.269037 np0000001613 nova-compute[98321]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:08:56.269037 np0000001613 nova-compute[98321]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:08:56.269037 np0000001613 nova-compute[98321]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14 (non-flash)
May 28 10:08:56.269037 np0000001613 nova-compute[98321]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14 (non-flash)
May 28 10:08:56.269037 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:08:56.269203 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc', '121'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc', '122'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b', '123'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b', '124'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14', '125'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14', '126')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:08:56.269331 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc', '121')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:08:56.270792 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc', '122')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:08:56.271397 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc4707c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc'): ({'sdc'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:08:56.271644 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Removing multipathed devices sdb, sdc {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:08:56.271882 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Flush multipath device 330000000d664e648 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:08:56.327269 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:08:56.327341 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:08:56.327606 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:56.327822 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:56.331338 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:08:56.380408 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:08:56.404947 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '89055f093b284972ae2ba1196f59d3ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2033897f986640b489037e19aaf9e9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:08:56.442804 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:08:56.442964 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:08:56.443870 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:08:56.456637 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:08:56.456857 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:08:56.471514 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:56.477613 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] End _get_guest_xml xml=<domain type="qemu">
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:   <uuid>e4215271-8b48-4661-bc06-eb3f276c2b80</uuid>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:   <name>instance-00000035</name>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:       <nova:name>tempest-VolumesActionsTest-instance-1757261744</nova:name>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:08:55</nova:creationTime>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:         <nova:user uuid="3d6c4c0c65114263bdf7b9d657c80a51">tempest-VolumesActionsTest-33912954-project-member</nova:user>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:         <nova:project uuid="e7b696dba3e04fc1a6b1b1c792ca0508">tempest-VolumesActionsTest-33912954</nova:project>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:         <nova:port uuid="10374d15-c1a4-4c1d-90a3-dba7f0348952">
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:     <system>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:       <entry name="serial">e4215271-8b48-4661-bc06-eb3f276c2b80</entry>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:       <entry name="uuid">e4215271-8b48-4661-bc06-eb3f276c2b80</entry>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:     </system>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:   <os>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:   </os>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:   <features>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:   </features>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:   <devices>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/e4215271-8b48-4661-bc06-eb3f276c2b80/disk"/>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:     </disk>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/e4215271-8b48-4661-bc06-eb3f276c2b80/disk.config"/>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:     </disk>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:c7:6d:47"/>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:       <target dev="tap10374d15-c1"/>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:     </interface>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/e4215271-8b48-4661-bc06-eb3f276c2b80/console.log" append="off"/>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:     </serial>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:     <video>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:     </video>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:     </rng>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:   </devices>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]: </domain>
May 28 10:08:56.477613 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:08:56.480756 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Preparing to wait for external event network-vif-plugged-10374d15-c1a4-4c1d-90a3-dba7f0348952 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:08:56.480756 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Acquiring lock "e4215271-8b48-4661-bc06-eb3f276c2b80-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:56.480756 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Lock "e4215271-8b48-4661-bc06-eb3f276c2b80-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:56.480756 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Lock "e4215271-8b48-4661-bc06-eb3f276c2b80-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:56.481179 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1757261744',display_name='tempest-VolumesActionsTest-instance-1757261744',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumesactionstest-instance-1757261744',id=53,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7b696dba3e04fc1a6b1b1c792ca0508',ramdisk_id='',reservation_id='r-n1fdalk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-33912954',owner_user_name='tempest-VolumesActionsTest-33912954-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:08:53Z,user_data=None,user_id='3d6c4c0c65114263bdf7b9d657c80a51',uuid=e4215271-8b48-4661-bc06-eb3f276c2b80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10374d15-c1a4-4c1d-90a3-dba7f0348952", "address": "fa:16:3e:c7:6d:47", "network": {"id": "ccb2b68f-6c87-4fee-860c-83e09053a83e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1057861432-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7b696dba3e04fc1a6b1b1c792ca0508", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap10374d15-c1", "ovs_interfaceid": "10374d15-c1a4-4c1d-90a3-dba7f0348952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:08:56.481846 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Converting VIF {"id": "10374d15-c1a4-4c1d-90a3-dba7f0348952", "address": "fa:16:3e:c7:6d:47", "network": {"id": "ccb2b68f-6c87-4fee-860c-83e09053a83e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1057861432-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7b696dba3e04fc1a6b1b1c792ca0508", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap10374d15-c1", "ovs_interfaceid": "10374d15-c1a4-4c1d-90a3-dba7f0348952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:08:56.482530 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:6d:47,bridge_name='br-int',has_traffic_filtering=True,id=10374d15-c1a4-4c1d-90a3-dba7f0348952,network=Network(ccb2b68f-6c87-4fee-860c-83e09053a83e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10374d15-c1') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:08:56.482825 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:6d:47,bridge_name='br-int',has_traffic_filtering=True,id=10374d15-c1a4-4c1d-90a3-dba7f0348952,network=Network(ccb2b68f-6c87-4fee-860c-83e09053a83e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10374d15-c1') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:08:56.483272 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:56.483549 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:08:56.483773 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:08:56.484541 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:56.484707 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b6152f0b-9b43-5c8b-af37-ff4546eeb1fb', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:08:56.485577 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:56.486377 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:08:56.486536 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:56.488980 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:56.489202 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10374d15-c1, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:08:56.489619 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap10374d15-c1, col_values=(('qos', UUID('ae474df0-2c9e-4583-a0ae-1b6071a94e10')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:08:56.489813 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap10374d15-c1, col_values=(('external_ids', {'iface-id': '10374d15-c1a4-4c1d-90a3-dba7f0348952', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:6d:47', 'vm-uuid': 'e4215271-8b48-4661-bc06-eb3f276c2b80'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:08:56.491139 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:56.492199 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:08:56.496063 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:56.496989 np0000001613 nova-compute[98321]: INFO os_vif [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:6d:47,bridge_name='br-int',has_traffic_filtering=True,id=10374d15-c1a4-4c1d-90a3-dba7f0348952,network=Network(ccb2b68f-6c87-4fee-860c-83e09053a83e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10374d15-c1')
May 28 10:08:56.503062 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 121, target: iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc, portal: 192.168.40.100,3260]
May 28 10:08:56.503062 np0000001613 nova-compute[98321]: Logout of [sid: 121, target: iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc, portal: 192.168.40.100,3260] successful.
May 28 10:08:56.503062 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:56.520128 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:56.534041 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:56.571097 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 122, target: iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc, portal: 192.168.50.100,3260]
May 28 10:08:56.571097 np0000001613 nova-compute[98321]: Logout of [sid: 122, target: iqn.2023-03.storpool.com:os--volume-ec1e6963-9189-4750-a397-d2bc2ab54efc, portal: 192.168.50.100,3260] successful.
May 28 10:08:56.571097 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:56.589144 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:56.589331 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:08:56.589503 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] <== disconnect_volume: return (345ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:08:56.589602 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:08:56.591969 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Deleting instance files /opt/stack/data/nova/instances/742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f_del
May 28 10:08:56.591969 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Deletion of /opt/stack/data/nova/instances/742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f_del complete
May 28 10:08:56.829686 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:08:56.861570 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Successfully created port: 49c03abc-4bac-4296-b0ec-9ac9127814e9 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:08:56.866993 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Periodic task is updating the host stat, it is trying to get disk instance-0000002f, but disk file was removed by concurrent operations such as resize.: FileNotFoundError: [Errno 2] No such file or directory: '/opt/stack/data/nova/instances/742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f/disk.config'
May 28 10:08:56.868761 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd03b27-b9a0-4260-94db-b3aec44b8faa/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:08:56.956855 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd03b27-b9a0-4260-94db-b3aec44b8faa/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:08:56.957429 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd03b27-b9a0-4260-94db-b3aec44b8faa/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:08:57.061766 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd03b27-b9a0-4260-94db-b3aec44b8faa/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:08:57.062085 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-6 (vdb) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:08:57.070184 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:08:57.070184 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ffe54bd-ad37-40a8-adfa-04e2ea9c9554/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:08:57.104916 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Took 1.73 seconds to destroy the instance on the hypervisor.
May 28 10:08:57.105150 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:08:57.113764 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:08:57.113764 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:08:57.113835 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:57.121847 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a5103a88-8017-45e4-8d8c-aa24db7e1ef8 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "8dd03b27-b9a0-4260-94db-b3aec44b8faa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.150s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:57.177077 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ffe54bd-ad37-40a8-adfa-04e2ea9c9554/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:08:57.177637 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ffe54bd-ad37-40a8-adfa-04e2ea9c9554/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:08:57.212649 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:57.269315 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ffe54bd-ad37-40a8-adfa-04e2ea9c9554/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:08:57.273791 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:08:57.277214 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:08:57.286826 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "8dd03b27-b9a0-4260-94db-b3aec44b8faa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:57.287222 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "8dd03b27-b9a0-4260-94db-b3aec44b8faa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:57.325681 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "env LANG=C uptime" returned: 0 in 0.050s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:08:57.325681 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Hypervisor/Node resource view: name=np0000001613 free_ram=12444MB free_disk=73.8177261352539GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 10:08:57.325681 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:57.325944 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:57.335565 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:08:57.442573 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Successfully updated port: 49c03abc-4bac-4296-b0ec-9ac9127814e9 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:08:57.506017 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-9d3824aa-3a2d-4693-b17a-ab0d9fcd61f8 req-7108525a-934f-4d76-987f-f6c8c9db062e service nova] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Received event network-changed-49c03abc-4bac-4296-b0ec-9ac9127814e9 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:08:57.506238 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-9d3824aa-3a2d-4693-b17a-ab0d9fcd61f8 req-7108525a-934f-4d76-987f-f6c8c9db062e service nova] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Refreshing instance network info cache due to event network-changed-49c03abc-4bac-4296-b0ec-9ac9127814e9. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:08:57.506468 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9d3824aa-3a2d-4693-b17a-ab0d9fcd61f8 req-7108525a-934f-4d76-987f-f6c8c9db062e service nova] Acquiring lock "refresh_cache-9106964d-dcd7-4628-9cd7-c09b0739e749" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:08:57.507193 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9d3824aa-3a2d-4693-b17a-ab0d9fcd61f8 req-7108525a-934f-4d76-987f-f6c8c9db062e service nova] Acquired lock "refresh_cache-9106964d-dcd7-4628-9cd7-c09b0739e749" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:08:57.507193 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-9d3824aa-3a2d-4693-b17a-ab0d9fcd61f8 req-7108525a-934f-4d76-987f-f6c8c9db062e service nova] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Refreshing network info cache for port 49c03abc-4bac-4296-b0ec-9ac9127814e9 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:08:57.587061 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-96af26c1-9635-47ff-81cd-0665c5293a9f req-db2131d0-0c0e-4e7f-a790-4cc536a1c340 service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Received event network-vif-unplugged-5724dc5f-94cc-45c9-ac48-670de0fa781f {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:08:57.587621 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-96af26c1-9635-47ff-81cd-0665c5293a9f req-db2131d0-0c0e-4e7f-a790-4cc536a1c340 service nova] Acquiring lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:57.587621 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-96af26c1-9635-47ff-81cd-0665c5293a9f req-db2131d0-0c0e-4e7f-a790-4cc536a1c340 service nova] Lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:57.587741 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-96af26c1-9635-47ff-81cd-0665c5293a9f req-db2131d0-0c0e-4e7f-a790-4cc536a1c340 service nova] Lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:57.587885 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-96af26c1-9635-47ff-81cd-0665c5293a9f req-db2131d0-0c0e-4e7f-a790-4cc536a1c340 service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] No waiting events found dispatching network-vif-unplugged-5724dc5f-94cc-45c9-ac48-670de0fa781f {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:08:57.588053 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-96af26c1-9635-47ff-81cd-0665c5293a9f req-db2131d0-0c0e-4e7f-a790-4cc536a1c340 service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Received event network-vif-unplugged-5724dc5f-94cc-45c9-ac48-670de0fa781f for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:08:57.588288 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-96af26c1-9635-47ff-81cd-0665c5293a9f req-db2131d0-0c0e-4e7f-a790-4cc536a1c340 service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Received event network-vif-unplugged-5724dc5f-94cc-45c9-ac48-670de0fa781f {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:08:57.588687 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-96af26c1-9635-47ff-81cd-0665c5293a9f req-db2131d0-0c0e-4e7f-a790-4cc536a1c340 service nova] Acquiring lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:57.588975 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-96af26c1-9635-47ff-81cd-0665c5293a9f req-db2131d0-0c0e-4e7f-a790-4cc536a1c340 service nova] Lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:57.589259 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-96af26c1-9635-47ff-81cd-0665c5293a9f req-db2131d0-0c0e-4e7f-a790-4cc536a1c340 service nova] Lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:57.589532 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-96af26c1-9635-47ff-81cd-0665c5293a9f req-db2131d0-0c0e-4e7f-a790-4cc536a1c340 service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] No waiting events found dispatching network-vif-unplugged-5724dc5f-94cc-45c9-ac48-670de0fa781f {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:08:57.589692 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-96af26c1-9635-47ff-81cd-0665c5293a9f req-db2131d0-0c0e-4e7f-a790-4cc536a1c340 service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Received event network-vif-unplugged-5724dc5f-94cc-45c9-ac48-670de0fa781f for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:08:57.590454 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-96af26c1-9635-47ff-81cd-0665c5293a9f req-db2131d0-0c0e-4e7f-a790-4cc536a1c340 service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Received event network-vif-deleted-5724dc5f-94cc-45c9-ac48-670de0fa781f {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:08:57.590454 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-96af26c1-9635-47ff-81cd-0665c5293a9f req-db2131d0-0c0e-4e7f-a790-4cc536a1c340 service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Neutron deleted interface 5724dc5f-94cc-45c9-ac48-670de0fa781f; detaching it from the instance and deleting it from the info cache
May 28 10:08:57.591841 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-96af26c1-9635-47ff-81cd-0665c5293a9f req-db2131d0-0c0e-4e7f-a790-4cc536a1c340 service nova] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Detach interface failed, port_id=5724dc5f-94cc-45c9-ac48-670de0fa781f, reason: Instance 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:08:57.792457 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Detaching volume 17f8efc4-1fb9-4292-9d7d-1757634ecf14
May 28 10:08:57.840044 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Attempting to driver detach volume 17f8efc4-1fb9-4292-9d7d-1757634ecf14 from mountpoint /dev/vdb
May 28 10:08:57.886783 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14', 'iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '17f8efc4-1fb9-4292-9d7d-1757634ecf14', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, 'status': 'reserved', 'instance': '8dd03b27-b9a0-4260-94db-b3aec44b8faa', 'attached_at': '', 'detached_at': '', 'volume_id': '17f8efc4-1fb9-4292-9d7d-1757634ecf14', 'serial': '17f8efc4-1fb9-4292-9d7d-1757634ecf14'} {{(pid=98321) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 10:08:57.893838 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Found disk vdb by alias ua-17f8efc4-1fb9-4292-9d7d-1757634ecf14 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:08:57.895006 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Found disk vdb by alias ua-17f8efc4-1fb9-4292-9d7d-1757634ecf14 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:08:57.895120 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Attempting to detach device vdb from instance 8dd03b27-b9a0-4260-94db-b3aec44b8faa from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 10:08:57.895372 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:08:57.895372 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:08:57.895372 np0000001613 nova-compute[98321]:   <alias name="ua-17f8efc4-1fb9-4292-9d7d-1757634ecf14"/>
May 28 10:08:57.895372 np0000001613 nova-compute[98321]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-6"/>
May 28 10:08:57.895372 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:08:57.895372 np0000001613 nova-compute[98321]:   <serial>17f8efc4-1fb9-4292-9d7d-1757634ecf14</serial>
May 28 10:08:57.895372 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:08:57.895372 np0000001613 nova-compute[98321]: </disk>
May 28 10:08:57.895372 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:08:57.902827 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Successfully detached device vdb from instance 8dd03b27-b9a0-4260-94db-b3aec44b8faa from the persistent domain config.
May 28 10:08:57.903006 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] (1/8): Attempting to detach device vdb with device alias ua-17f8efc4-1fb9-4292-9d7d-1757634ecf14 from instance 8dd03b27-b9a0-4260-94db-b3aec44b8faa from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 10:08:57.903298 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:08:57.903298 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:08:57.903298 np0000001613 nova-compute[98321]:   <alias name="ua-17f8efc4-1fb9-4292-9d7d-1757634ecf14"/>
May 28 10:08:57.903298 np0000001613 nova-compute[98321]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-6"/>
May 28 10:08:57.903298 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:08:57.903298 np0000001613 nova-compute[98321]:   <serial>17f8efc4-1fb9-4292-9d7d-1757634ecf14</serial>
May 28 10:08:57.903298 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:08:57.903298 np0000001613 nova-compute[98321]: </disk>
May 28 10:08:57.903298 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:08:57.926490 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:08:57.945016 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Acquiring lock "refresh_cache-9106964d-dcd7-4628-9cd7-c09b0739e749" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:08:58.010234 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-9d3824aa-3a2d-4693-b17a-ab0d9fcd61f8 req-7108525a-934f-4d76-987f-f6c8c9db062e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:58.018887 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:08:58.019002 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:08:58.019074 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] No VIF found with MAC fa:16:3e:c7:6d:47, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:08:58.019600 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Using config drive
May 28 10:08:58.078995 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-9d3824aa-3a2d-4693-b17a-ab0d9fcd61f8 req-7108525a-934f-4d76-987f-f6c8c9db062e service nova] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:08:58.264399 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-9d3824aa-3a2d-4693-b17a-ab0d9fcd61f8 req-7108525a-934f-4d76-987f-f6c8c9db062e service nova] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:08:58.355544 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:08:58.356789 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:08:58.357090 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Creating image(s)
May 28 10:08:58.357647 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Acquiring lock "/opt/stack/data/nova/instances/9106964d-dcd7-4628-9cd7-c09b0739e749/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:58.357863 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Lock "/opt/stack/data/nova/instances/9106964d-dcd7-4628-9cd7-c09b0739e749/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:58.358427 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Lock "/opt/stack/data/nova/instances/9106964d-dcd7-4628-9cd7-c09b0739e749/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:58.359403 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:08:58.364612 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:08:58.365857 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:08:58.405814 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 8dd03b27-b9a0-4260-94db-b3aec44b8faa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:08:58.409952 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:08:58.409952 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:08:58.409952 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance ca57808c-4f51-4a26-8724-d28394efab9f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:08:58.409952 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance e4215271-8b48-4661-bc06-eb3f276c2b80 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:08:58.409952 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 9106964d-dcd7-4628-9cd7-c09b0739e749 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:08:58.409952 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 10:08:58.409952 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Final resource view: name=np0000001613 phys_ram=24030MB used_ram=1664MB phys_disk=95GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 10:08:57 up 41 min,  2 users,  load average: 6.20, 7.26, 4.90\n', 'num_instances': '6', 'num_vm_active': '4', 'num_task_deleting': '1', 'num_os_type_None': '6', 'num_proj_92aad30ae7cf45cbb0233727a1e77316': '1', 'io_workload': '2', 'num_task_None': '3', 'num_proj_c7563a83d33d4bc1a6610ccf53c18dc1': '1', 'num_proj_42b5a6b6c4514b76a651b71280c093f5': '1', 'num_proj_23e9651268114327a9cc6c6c59bef01e': '1', 'num_vm_building': '2', 'num_task_spawning': '1', 'num_proj_e7b696dba3e04fc1a6b1b1c792ca0508': '1', 'num_task_networking': '1', 'num_proj_2033897f986640b489037e19aaf9e9f4': '1'} {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 10:08:58.430177 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Took 1.32 seconds to deallocate network for instance.
May 28 10:08:58.465409 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.098s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:08:58.465409 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:58.465409 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:58.465409 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:08:58.471350 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:08:58.471695 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:08:58.527220 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:58.549533 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779962938.5490613, 8dd03b27-b9a0-4260-94db-b3aec44b8faa => ua-17f8efc4-1fb9-4292-9d7d-1757634ecf14> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 10:08:58.550568 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-17f8efc4-1fb9-4292-9d7d-1757634ecf14 for instance 8dd03b27-b9a0-4260-94db-b3aec44b8faa {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 10:08:58.557304 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Successfully detached device vdb from instance 8dd03b27-b9a0-4260-94db-b3aec44b8faa from the live domain config.
May 28 10:08:58.559997 np0000001613 nova-compute[98321]: WARNING stevedore.named [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 10:08:58.561573 np0000001613 nova-compute[98321]: WARNING castellan.key_manager [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 10:08:58.562194 np0000001613 nova-compute[98321]: WARNING nova.keymgr.conf_key_mgr [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 10:08:58.562840 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.091s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:08:58.563296 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/9106964d-dcd7-4628-9cd7-c09b0739e749/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:08:58.565328 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x73c1f433baa0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14', 'iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '17f8efc4-1fb9-4292-9d7d-1757634ecf14', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, 'status': 'reserved', 'instance': '8dd03b27-b9a0-4260-94db-b3aec44b8faa', 'attached_at': '', 'detached_at': '', 'volume_id': '17f8efc4-1fb9-4292-9d7d-1757634ecf14', 'serial': '17f8efc4-1fb9-4292-9d7d-1757634ecf14'} {{(pid=98321) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 10:08:58.565328 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors.luks [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] closing encrypted volume /dev/dm-7 {{(pid=98321) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:207}}
May 28 10:08:58.600909 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:08:58.601538 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14', 'iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '17f8efc4-1fb9-4292-9d7d-1757634ecf14', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:08:58.601857 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:08:58.604158 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:08:58.604158 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14', 'iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '17f8efc4-1fb9-4292-9d7d-1757634ecf14', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:08:58.604158 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:08:58.624603 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/9106964d-dcd7-4628-9cd7-c09b0739e749/disk 1073741824" returned: 0 in 0.061s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:08:58.625094 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.160s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:58.625488 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:08:58.655685 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:08:58.655685 np0000001613 nova-compute[98321]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:08:58.655685 np0000001613 nova-compute[98321]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14 (non-flash)
May 28 10:08:58.655685 np0000001613 nova-compute[98321]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14 (non-flash)
May 28 10:08:58.655685 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:08:58.655933 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsi session list stdout=tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:08:58.655933 np0000001613 nova-compute[98321]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:08:58.655933 np0000001613 nova-compute[98321]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14 (non-flash)
May 28 10:08:58.655933 np0000001613 nova-compute[98321]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14 (non-flash)
May 28 10:08:58.655933 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:08:58.656107 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b', '123'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b', '124'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14', '125'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14', '126')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:08:58.656273 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14', '126')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:08:58.658194 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14', '125')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:08:58.658925 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc209d00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14'): ({'sdf'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:08:58.659364 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Removing multipathed devices sdg, sdf {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:08:58.659691 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Flush multipath device 3300000007d5b40ef {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:08:58.692501 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:08:58.714032 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.088s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:08:58.714433 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9106964d-dcd7-4628-9cd7-c09b0739e749/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:08:58.714670 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9106964d-dcd7-4628-9cd7-c09b0739e749/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:08:58.737569 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Creating config drive at /opt/stack/data/nova/instances/e4215271-8b48-4661-bc06-eb3f276c2b80/disk.config
May 28 10:08:58.741071 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:08:58.743580 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e4215271-8b48-4661-bc06-eb3f276c2b80/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkyyvq490 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:08:58.769225 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9d3824aa-3a2d-4693-b17a-ab0d9fcd61f8 req-7108525a-934f-4d76-987f-f6c8c9db062e service nova] Releasing lock "refresh_cache-9106964d-dcd7-4628-9cd7-c09b0739e749" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:08:58.770122 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Acquired lock "refresh_cache-9106964d-dcd7-4628-9cd7-c09b0739e749" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:08:58.770401 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:08:58.794778 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:08:58.794778 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:08:58.794778 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:08:58.797647 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e4215271-8b48-4661-bc06-eb3f276c2b80/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkyyvq490" returned: 0 in 0.054s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:08:58.808638 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:08:58.809221 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:08:58.817522 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9106964d-dcd7-4628-9cd7-c09b0739e749/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:08:58.817812 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Cannot resize image /opt/stack/data/nova/instances/9106964d-dcd7-4628-9cd7-c09b0739e749/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:08:58.818176 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:08:58.818339 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Ensure instance console log exists: /opt/stack/data/nova/instances/9106964d-dcd7-4628-9cd7-c09b0739e749/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:08:58.818584 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:58.818776 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:58.818922 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:58.822619 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:58.854042 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 126, target: iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14, portal: 192.168.40.100,3260]
May 28 10:08:58.854042 np0000001613 nova-compute[98321]: Logout of [sid: 126, target: iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14, portal: 192.168.40.100,3260] successful.
May 28 10:08:58.854042 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:58.866549 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:58.881017 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:58.908091 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:08:58.908409 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:08:58.911673 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 125, target: iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14, portal: 192.168.50.100,3260]
May 28 10:08:58.911673 np0000001613 nova-compute[98321]: Logout of [sid: 125, target: iqn.2023-03.storpool.com:os--volume-17f8efc4-1fb9-4292-9d7d-1757634ecf14, portal: 192.168.50.100,3260] successful.
May 28 10:08:58.911673 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:58.923393 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:08:58.927213 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:08:58.927213 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] <== disconnect_volume: return (322ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:08:58.927213 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:08:58.978369 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Took 0.55 seconds to detach 1 volumes for instance.
May 28 10:08:58.980814 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Deleting volume: ec1e6963-9189-4750-a397-d2bc2ab54efc {{(pid=98321) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 10:08:59.229756 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:59.255092 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:59.359315 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:59.396063 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:08:59.414195 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:08:59.496225 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lazy-loading 'flavor' on Instance uuid 8dd03b27-b9a0-4260-94db-b3aec44b8faa {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:08:59.522181 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:59.661720 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:08:59.665552 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:59.672938 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:59.681056 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:59.681056 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:59.692298 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a2d90386-1e7a-45a1-a124-a4af6044a486 req-e74a6e6b-2396-4450-8ba1-bc2d23388a10 service nova] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Received event network-vif-plugged-10374d15-c1a4-4c1d-90a3-dba7f0348952 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:08:59.693330 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a2d90386-1e7a-45a1-a124-a4af6044a486 req-e74a6e6b-2396-4450-8ba1-bc2d23388a10 service nova] Acquiring lock "e4215271-8b48-4661-bc06-eb3f276c2b80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:08:59.693516 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a2d90386-1e7a-45a1-a124-a4af6044a486 req-e74a6e6b-2396-4450-8ba1-bc2d23388a10 service nova] Lock "e4215271-8b48-4661-bc06-eb3f276c2b80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:59.693646 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a2d90386-1e7a-45a1-a124-a4af6044a486 req-e74a6e6b-2396-4450-8ba1-bc2d23388a10 service nova] Lock "e4215271-8b48-4661-bc06-eb3f276c2b80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:59.693767 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a2d90386-1e7a-45a1-a124-a4af6044a486 req-e74a6e6b-2396-4450-8ba1-bc2d23388a10 service nova] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Processing event network-vif-plugged-10374d15-c1a4-4c1d-90a3-dba7f0348952 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:08:59.702294 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:59.723868 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:08:59.835583 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Updating instance_info_cache with network_info: [{"id": "49c03abc-4bac-4296-b0ec-9ac9127814e9", "address": "fa:16:3e:2b:fb:44", "network": {"id": "cef39ad9-95ea-4e75-81ee-5ee61758d095", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1228058603-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2033897f986640b489037e19aaf9e9f4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c03abc-4b", "ovs_interfaceid": "49c03abc-4bac-4296-b0ec-9ac9127814e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:08:59.924732 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Compute_service record updated for np0000001613:np0000001613 {{(pid=98321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 10:08:59.924732 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.599s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:08:59.925234 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.404s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:08:59.926066 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:09:00.126664 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:09:00.127578 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962940.127139, e4215271-8b48-4661-bc06-eb3f276c2b80 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:09:00.128007 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] VM Started (Lifecycle Event)
May 28 10:09:00.129734 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:09:00.133518 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Instance spawned successfully.
May 28 10:09:00.133832 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:09:00.299565 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:09:00.299869 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:09:00.338574 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Releasing lock "refresh_cache-9106964d-dcd7-4628-9cd7-c09b0739e749" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:09:00.338863 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Instance network_info: |[{"id": "49c03abc-4bac-4296-b0ec-9ac9127814e9", "address": "fa:16:3e:2b:fb:44", "network": {"id": "cef39ad9-95ea-4e75-81ee-5ee61758d095", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1228058603-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2033897f986640b489037e19aaf9e9f4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c03abc-4b", "ovs_interfaceid": "49c03abc-4bac-4296-b0ec-9ac9127814e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:09:00.340774 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Start _get_guest_xml network_info=[{"id": "49c03abc-4bac-4296-b0ec-9ac9127814e9", "address": "fa:16:3e:2b:fb:44", "network": {"id": "cef39ad9-95ea-4e75-81ee-5ee61758d095", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1228058603-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2033897f986640b489037e19aaf9e9f4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c03abc-4b", "ovs_interfaceid": "49c03abc-4bac-4296-b0ec-9ac9127814e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:09:00.343575 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:09:00.344960 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-517278017', uuid='9106964d-dcd7-4628-9cd7-c09b0739e749'), owner=OwnerMeta(userid='89055f093b284972ae2ba1196f59d3ba', username='tempest-VolumesActionsTest-1182166418-project-member', projectid='2033897f986640b489037e19aaf9e9f4', projectname='tempest-VolumesActionsTest-1182166418'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "49c03abc-4bac-4296-b0ec-9ac9127814e9", "address": "fa:16:3e:2b:fb:44", "network": {"id": "cef39ad9-95ea-4e75-81ee-5ee61758d095", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1228058603-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2033897f986640b489037e19aaf9e9f4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c03abc-4b", "ovs_interfaceid": "49c03abc-4bac-4296-b0ec-9ac9127814e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962940.344599) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:09:00.346067 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:09:00.346465 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:09:00.347505 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:09:00.347660 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:09:00.348729 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:09:00.349075 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:09:00.349243 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:09:00.349357 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:09:00.349525 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:09:00.349626 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:09:00.349723 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:09:00.349890 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:09:00.350008 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:09:00.350137 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:09:00.350297 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:09:00.350421 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:09:00.364203 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:08:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-517278017',display_name='tempest-VolumesActionsTest-instance-517278017',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumesactionstest-instance-517278017',id=54,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2033897f986640b489037e19aaf9e9f4',ramdisk_id='',reservation_id='r-khbq66l4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1182166418',owner_user_name='tempest-VolumesActionsTest-1182166418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:08:57Z,user_data=None,user_id='89055f093b284972ae2ba1196f59d3ba',uuid=9106964d-dcd7-4628-9cd7-c09b0739e749,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49c03abc-4bac-4296-b0ec-9ac9127814e9", "address": "fa:16:3e:2b:fb:44", "network": {"id": "cef39ad9-95ea-4e75-81ee-5ee61758d095", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1228058603-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2033897f986640b489037e19aaf9e9f4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c03abc-4b", "ovs_interfaceid": "49c03abc-4bac-4296-b0ec-9ac9127814e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:09:00.364509 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Converting VIF {"id": "49c03abc-4bac-4296-b0ec-9ac9127814e9", "address": "fa:16:3e:2b:fb:44", "network": {"id": "cef39ad9-95ea-4e75-81ee-5ee61758d095", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1228058603-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2033897f986640b489037e19aaf9e9f4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c03abc-4b", "ovs_interfaceid": "49c03abc-4bac-4296-b0ec-9ac9127814e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:09:00.365030 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:fb:44,bridge_name='br-int',has_traffic_filtering=True,id=49c03abc-4bac-4296-b0ec-9ac9127814e9,network=Network(cef39ad9-95ea-4e75-81ee-5ee61758d095),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49c03abc-4b') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:09:00.365927 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Lazy-loading 'pci_devices' on Instance uuid 9106964d-dcd7-4628-9cd7-c09b0739e749 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:09:00.500692 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-154e4a70-4a5e-4be3-a647-9c22d75ac4d6 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "8dd03b27-b9a0-4260-94db-b3aec44b8faa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.213s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:00.631054 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:09:00.632994 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:09:00.641948 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:09:00.641948 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:09:00.641948 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:09:00.641948 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:09:00.641948 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:09:00.641948 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:09:00.802507 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:09:00.868932 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] End _get_guest_xml xml=<domain type="qemu">
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:   <uuid>9106964d-dcd7-4628-9cd7-c09b0739e749</uuid>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:   <name>instance-00000036</name>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:       <nova:name>tempest-VolumesActionsTest-instance-517278017</nova:name>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:09:00</nova:creationTime>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:         <nova:user uuid="89055f093b284972ae2ba1196f59d3ba">tempest-VolumesActionsTest-1182166418-project-member</nova:user>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:         <nova:project uuid="2033897f986640b489037e19aaf9e9f4">tempest-VolumesActionsTest-1182166418</nova:project>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:         <nova:port uuid="49c03abc-4bac-4296-b0ec-9ac9127814e9">
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:     <system>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:       <entry name="serial">9106964d-dcd7-4628-9cd7-c09b0739e749</entry>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:       <entry name="uuid">9106964d-dcd7-4628-9cd7-c09b0739e749</entry>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:     </system>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:   <os>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:   </os>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:   <features>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:   </features>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:   <devices>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/9106964d-dcd7-4628-9cd7-c09b0739e749/disk"/>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:     </disk>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/9106964d-dcd7-4628-9cd7-c09b0739e749/disk.config"/>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:     </disk>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:2b:fb:44"/>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:       <target dev="tap49c03abc-4b"/>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:     </interface>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/9106964d-dcd7-4628-9cd7-c09b0739e749/console.log" append="off"/>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:     </serial>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:     <video>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:     </video>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:     </rng>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:   </devices>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]: </domain>
May 28 10:09:00.868932 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:09:00.870970 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Preparing to wait for external event network-vif-plugged-49c03abc-4bac-4296-b0ec-9ac9127814e9 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:09:00.870970 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Acquiring lock "9106964d-dcd7-4628-9cd7-c09b0739e749-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:00.870970 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Lock "9106964d-dcd7-4628-9cd7-c09b0739e749-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:00.870970 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Lock "9106964d-dcd7-4628-9cd7-c09b0739e749-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:00.870970 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:08:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-517278017',display_name='tempest-VolumesActionsTest-instance-517278017',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumesactionstest-instance-517278017',id=54,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2033897f986640b489037e19aaf9e9f4',ramdisk_id='',reservation_id='r-khbq66l4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1182166418',owner_user_name='tempest-VolumesActionsTest-1182166418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:08:57Z,user_data=None,user_id='89055f093b284972ae2ba1196f59d3ba',uuid=9106964d-dcd7-4628-9cd7-c09b0739e749,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49c03abc-4bac-4296-b0ec-9ac9127814e9", "address": "fa:16:3e:2b:fb:44", "network": {"id": "cef39ad9-95ea-4e75-81ee-5ee61758d095", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1228058603-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2033897f986640b489037e19aaf9e9f4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c03abc-4b", "ovs_interfaceid": "49c03abc-4bac-4296-b0ec-9ac9127814e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:09:00.870970 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Converting VIF {"id": "49c03abc-4bac-4296-b0ec-9ac9127814e9", "address": "fa:16:3e:2b:fb:44", "network": {"id": "cef39ad9-95ea-4e75-81ee-5ee61758d095", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1228058603-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2033897f986640b489037e19aaf9e9f4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c03abc-4b", "ovs_interfaceid": "49c03abc-4bac-4296-b0ec-9ac9127814e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:09:00.871220 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:fb:44,bridge_name='br-int',has_traffic_filtering=True,id=49c03abc-4bac-4296-b0ec-9ac9127814e9,network=Network(cef39ad9-95ea-4e75-81ee-5ee61758d095),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49c03abc-4b') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:09:00.871505 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:fb:44,bridge_name='br-int',has_traffic_filtering=True,id=49c03abc-4bac-4296-b0ec-9ac9127814e9,network=Network(cef39ad9-95ea-4e75-81ee-5ee61758d095),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49c03abc-4b') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:09:00.871955 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:00.872243 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:09:00.872508 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:09:00.873413 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:00.873590 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f7dddf3e-2bad-59f6-b8b6-460e3ee67aca', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:09:00.874261 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:00.874887 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:09:00.875815 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:00.877502 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:00.877641 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49c03abc-4b, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:09:00.877927 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap49c03abc-4b, col_values=(('qos', UUID('f37738c8-d26e-4ac2-8f08-1b2c0c8d8c4a')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:09:00.878102 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap49c03abc-4b, col_values=(('external_ids', {'iface-id': '49c03abc-4bac-4296-b0ec-9ac9127814e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:fb:44', 'vm-uuid': '9106964d-dcd7-4628-9cd7-c09b0739e749'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:09:00.878737 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:00.880028 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:09:00.885546 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:00.886401 np0000001613 nova-compute[98321]: INFO os_vif [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:fb:44,bridge_name='br-int',has_traffic_filtering=True,id=49c03abc-4bac-4296-b0ec-9ac9127814e9,network=Network(cef39ad9-95ea-4e75-81ee-5ee61758d095),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49c03abc-4b')
May 28 10:09:00.921836 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:09:00.922137 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:09:00.922405 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:09:00.922627 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:09:00.922771 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 10:09:00.922965 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.87 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:09:01.135333 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:09:01.135780 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962941.1354578, e4215271-8b48-4661-bc06-eb3f276c2b80 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:09:01.135910 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] VM Paused (Lifecycle Event)
May 28 10:09:01.146528 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Took 6.99 seconds to spawn the instance on the hypervisor.
May 28 10:09:01.146746 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:09:01.309814 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.385s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:01.392577 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Deleted allocations for instance 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f
May 28 10:09:01.639877 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:09:01.642428 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962941.642145, e4215271-8b48-4661-bc06-eb3f276c2b80 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:09:01.642622 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] VM Resumed (Lifecycle Event)
May 28 10:09:01.660769 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Took 12.53 seconds to build instance.
May 28 10:09:01.687620 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8bd2ef54-9d8e-47db-b611-a2973cfea5e4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "8dd03b27-b9a0-4260-94db-b3aec44b8faa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:01.687842 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8bd2ef54-9d8e-47db-b611-a2973cfea5e4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "8dd03b27-b9a0-4260-94db-b3aec44b8faa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:01.688061 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8bd2ef54-9d8e-47db-b611-a2973cfea5e4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "8dd03b27-b9a0-4260-94db-b3aec44b8faa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:01.688231 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8bd2ef54-9d8e-47db-b611-a2973cfea5e4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "8dd03b27-b9a0-4260-94db-b3aec44b8faa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:01.688381 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8bd2ef54-9d8e-47db-b611-a2973cfea5e4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "8dd03b27-b9a0-4260-94db-b3aec44b8faa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:01.690420 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-8bd2ef54-9d8e-47db-b611-a2973cfea5e4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Terminating instance
May 28 10:09:01.752400 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8a24f6da-d301-4ddb-951f-98634936c404 req-698bc73e-d884-4613-8b32-fea6d4c3f818 service nova] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Received event network-vif-plugged-10374d15-c1a4-4c1d-90a3-dba7f0348952 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:09:01.752623 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8a24f6da-d301-4ddb-951f-98634936c404 req-698bc73e-d884-4613-8b32-fea6d4c3f818 service nova] Acquiring lock "e4215271-8b48-4661-bc06-eb3f276c2b80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:01.752822 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8a24f6da-d301-4ddb-951f-98634936c404 req-698bc73e-d884-4613-8b32-fea6d4c3f818 service nova] Lock "e4215271-8b48-4661-bc06-eb3f276c2b80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:01.752976 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8a24f6da-d301-4ddb-951f-98634936c404 req-698bc73e-d884-4613-8b32-fea6d4c3f818 service nova] Lock "e4215271-8b48-4661-bc06-eb3f276c2b80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:01.753134 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8a24f6da-d301-4ddb-951f-98634936c404 req-698bc73e-d884-4613-8b32-fea6d4c3f818 service nova] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] No waiting events found dispatching network-vif-plugged-10374d15-c1a4-4c1d-90a3-dba7f0348952 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:09:01.753323 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-8a24f6da-d301-4ddb-951f-98634936c404 req-698bc73e-d884-4613-8b32-fea6d4c3f818 service nova] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Received unexpected event network-vif-plugged-10374d15-c1a4-4c1d-90a3-dba7f0348952 for instance with vm_state active and task_state None.
May 28 10:09:01.791964 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:09:01.793327 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:09:02.145678 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:09:02.147940 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:09:02.162415 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-143d8ccf-3ca7-4001-8ab9-a2131210b8be tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Lock "e4215271-8b48-4661-bc06-eb3f276c2b80" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.048s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:02.193372 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8bd2ef54-9d8e-47db-b611-a2973cfea5e4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:09:02.218579 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:02.222724 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:02.243384 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:02.247930 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:02.275719 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:02.286304 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:02.381257 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-31c1855f-5da6-488d-aa90-801ab67fbc10 req-0b9aa6e1-a36e-47ce-aeae-54777de0df0d service nova] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Received event network-vif-unplugged-89ba5187-e41f-4177-acdd-6f3586ba93ef {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:09:02.381389 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-31c1855f-5da6-488d-aa90-801ab67fbc10 req-0b9aa6e1-a36e-47ce-aeae-54777de0df0d service nova] Acquiring lock "8dd03b27-b9a0-4260-94db-b3aec44b8faa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:02.381654 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-31c1855f-5da6-488d-aa90-801ab67fbc10 req-0b9aa6e1-a36e-47ce-aeae-54777de0df0d service nova] Lock "8dd03b27-b9a0-4260-94db-b3aec44b8faa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:02.381751 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-31c1855f-5da6-488d-aa90-801ab67fbc10 req-0b9aa6e1-a36e-47ce-aeae-54777de0df0d service nova] Lock "8dd03b27-b9a0-4260-94db-b3aec44b8faa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:02.381879 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-31c1855f-5da6-488d-aa90-801ab67fbc10 req-0b9aa6e1-a36e-47ce-aeae-54777de0df0d service nova] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] No waiting events found dispatching network-vif-unplugged-89ba5187-e41f-4177-acdd-6f3586ba93ef {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:09:02.382025 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-31c1855f-5da6-488d-aa90-801ab67fbc10 req-0b9aa6e1-a36e-47ce-aeae-54777de0df0d service nova] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Received event network-vif-unplugged-89ba5187-e41f-4177-acdd-6f3586ba93ef for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:09:02.407291 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cf9e5e95-e619-41be-a749-793cc782f648 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Lock "742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.545s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:02.420138 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:09:02.420392 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:09:02.420602 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] No VIF found with MAC fa:16:3e:2b:fb:44, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:09:02.421280 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Using config drive
May 28 10:09:02.543503 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Instance destroyed successfully.
May 28 10:09:02.544122 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-8bd2ef54-9d8e-47db-b611-a2973cfea5e4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lazy-loading 'resources' on Instance uuid 8dd03b27-b9a0-4260-94db-b3aec44b8faa {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:09:02.650607 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999605846000122 future=<Future at 0x73c1f4092d20 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:09:02.929687 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:09:03.046667 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-8bd2ef54-9d8e-47db-b611-a2973cfea5e4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:07:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-543879227',display_name='tempest-TestEncryptedCinderVolumes-server-543879227',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testencryptedcindervolumes-server-543879227',id=49,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhD8MxtW4RijbsKwVkG76SNAeOnfVZvduCNZcLVoQoADLqIAynSMviek4psdSW8NAGLJK/69jV6BnHokZz6cKk5DpAZ+sNEacIwyW9D+d8FkFNRW7loXw2z71arEVjk3Q==',key_name='tempest-keypair-1926094233',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:07:59Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7563a83d33d4bc1a6610ccf53c18dc1',ramdisk_id='',reservation_id='r-wl8ca4td',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-297752033',owner_user_name='tempest-TestEncryptedCinderVolumes-297752033-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:08:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='961948be669c4a18a29398d53015f03b',uuid=8dd03b27-b9a0-4260-94db-b3aec44b8faa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89ba5187-e41f-4177-acdd-6f3586ba93ef", "address": "fa:16:3e:05:51:2a", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ba5187-e4", "ovs_interfaceid": "89ba5187-e41f-4177-acdd-6f3586ba93ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:09:03.047105 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-8bd2ef54-9d8e-47db-b611-a2973cfea5e4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Converting VIF {"id": "89ba5187-e41f-4177-acdd-6f3586ba93ef", "address": "fa:16:3e:05:51:2a", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ba5187-e4", "ovs_interfaceid": "89ba5187-e41f-4177-acdd-6f3586ba93ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:09:03.047676 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-8bd2ef54-9d8e-47db-b611-a2973cfea5e4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:51:2a,bridge_name='br-int',has_traffic_filtering=True,id=89ba5187-e41f-4177-acdd-6f3586ba93ef,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89ba5187-e4') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:09:03.047676 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-8bd2ef54-9d8e-47db-b611-a2973cfea5e4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:51:2a,bridge_name='br-int',has_traffic_filtering=True,id=89ba5187-e41f-4177-acdd-6f3586ba93ef,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89ba5187-e4') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:09:03.048746 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:03.048914 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89ba5187-e4, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:09:03.061808 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:03.062917 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:09:03.069021 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:03.070094 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:03.070334 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d4c9f98e-a0e2-4cea-b930-83a545d89180) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:09:03.071777 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:09:03.076421 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:03.078289 np0000001613 nova-compute[98321]: INFO os_vif [None req-8bd2ef54-9d8e-47db-b611-a2973cfea5e4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:51:2a,bridge_name='br-int',has_traffic_filtering=True,id=89ba5187-e41f-4177-acdd-6f3586ba93ef,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89ba5187-e4')
May 28 10:09:03.078593 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-8bd2ef54-9d8e-47db-b611-a2973cfea5e4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Deleting instance files /opt/stack/data/nova/instances/8dd03b27-b9a0-4260-94db-b3aec44b8faa_del
May 28 10:09:03.079294 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-8bd2ef54-9d8e-47db-b611-a2973cfea5e4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Deletion of /opt/stack/data/nova/instances/8dd03b27-b9a0-4260-94db-b3aec44b8faa_del complete
May 28 10:09:03.099880 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Creating config drive at /opt/stack/data/nova/instances/9106964d-dcd7-4628-9cd7-c09b0739e749/disk.config
May 28 10:09:03.108442 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9106964d-dcd7-4628-9cd7-c09b0739e749/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgdlzccaj {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:09:03.161804 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9106964d-dcd7-4628-9cd7-c09b0739e749/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgdlzccaj" returned: 0 in 0.054s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:09:03.600868 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-8bd2ef54-9d8e-47db-b611-a2973cfea5e4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Took 1.41 seconds to destroy the instance on the hypervisor.
May 28 10:09:03.601620 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-8bd2ef54-9d8e-47db-b611-a2973cfea5e4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:09:03.602036 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:09:03.602209 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:09:03.602635 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:09:03.611391 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:03.645219 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:03.765256 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:03.776961 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:09:03.935290 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-88cc1e21-f9a2-4895-9070-6b8bee0771c9 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Acquiring lock "e4215271-8b48-4661-bc06-eb3f276c2b80" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:03.935290 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-88cc1e21-f9a2-4895-9070-6b8bee0771c9 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Lock "e4215271-8b48-4661-bc06-eb3f276c2b80" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:03.935516 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-88cc1e21-f9a2-4895-9070-6b8bee0771c9 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Acquiring lock "e4215271-8b48-4661-bc06-eb3f276c2b80-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:03.935676 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-88cc1e21-f9a2-4895-9070-6b8bee0771c9 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Lock "e4215271-8b48-4661-bc06-eb3f276c2b80-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:03.935809 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-88cc1e21-f9a2-4895-9070-6b8bee0771c9 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Lock "e4215271-8b48-4661-bc06-eb3f276c2b80-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:03.942695 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-88cc1e21-f9a2-4895-9070-6b8bee0771c9 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Terminating instance
May 28 10:09:03.988428 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e08ceabf-9f71-452a-8500-7c665df0a14e req-9c0aadbd-c37c-4723-817b-3e6f87bdf640 service nova] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Received event network-vif-plugged-49c03abc-4bac-4296-b0ec-9ac9127814e9 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:09:03.988428 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e08ceabf-9f71-452a-8500-7c665df0a14e req-9c0aadbd-c37c-4723-817b-3e6f87bdf640 service nova] Acquiring lock "9106964d-dcd7-4628-9cd7-c09b0739e749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:03.988428 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e08ceabf-9f71-452a-8500-7c665df0a14e req-9c0aadbd-c37c-4723-817b-3e6f87bdf640 service nova] Lock "9106964d-dcd7-4628-9cd7-c09b0739e749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:03.990010 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e08ceabf-9f71-452a-8500-7c665df0a14e req-9c0aadbd-c37c-4723-817b-3e6f87bdf640 service nova] Lock "9106964d-dcd7-4628-9cd7-c09b0739e749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:03.990399 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e08ceabf-9f71-452a-8500-7c665df0a14e req-9c0aadbd-c37c-4723-817b-3e6f87bdf640 service nova] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Processing event network-vif-plugged-49c03abc-4bac-4296-b0ec-9ac9127814e9 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:09:04.066460 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:04.075767 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:04.098697 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:04.449826 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-88cc1e21-f9a2-4895-9070-6b8bee0771c9 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:09:04.456062 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-af8edcf2-5b11-4b7f-b47f-8f8e2ce2b24a req-95eb533d-f8a4-46f3-a2e6-90983e8fe3ff service nova] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Received event network-vif-unplugged-89ba5187-e41f-4177-acdd-6f3586ba93ef {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:09:04.456482 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-af8edcf2-5b11-4b7f-b47f-8f8e2ce2b24a req-95eb533d-f8a4-46f3-a2e6-90983e8fe3ff service nova] Acquiring lock "8dd03b27-b9a0-4260-94db-b3aec44b8faa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:04.456623 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-af8edcf2-5b11-4b7f-b47f-8f8e2ce2b24a req-95eb533d-f8a4-46f3-a2e6-90983e8fe3ff service nova] Lock "8dd03b27-b9a0-4260-94db-b3aec44b8faa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:04.456766 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-af8edcf2-5b11-4b7f-b47f-8f8e2ce2b24a req-95eb533d-f8a4-46f3-a2e6-90983e8fe3ff service nova] Lock "8dd03b27-b9a0-4260-94db-b3aec44b8faa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:04.456943 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-af8edcf2-5b11-4b7f-b47f-8f8e2ce2b24a req-95eb533d-f8a4-46f3-a2e6-90983e8fe3ff service nova] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] No waiting events found dispatching network-vif-unplugged-89ba5187-e41f-4177-acdd-6f3586ba93ef {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:09:04.456982 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-af8edcf2-5b11-4b7f-b47f-8f8e2ce2b24a req-95eb533d-f8a4-46f3-a2e6-90983e8fe3ff service nova] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Received event network-vif-unplugged-89ba5187-e41f-4177-acdd-6f3586ba93ef for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:09:04.457074 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-af8edcf2-5b11-4b7f-b47f-8f8e2ce2b24a req-95eb533d-f8a4-46f3-a2e6-90983e8fe3ff service nova] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Received event network-vif-deleted-89ba5187-e41f-4177-acdd-6f3586ba93ef {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:09:04.457211 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-af8edcf2-5b11-4b7f-b47f-8f8e2ce2b24a req-95eb533d-f8a4-46f3-a2e6-90983e8fe3ff service nova] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Neutron deleted interface 89ba5187-e41f-4177-acdd-6f3586ba93ef; detaching it from the instance and deleting it from the info cache
May 28 10:09:04.461913 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-af8edcf2-5b11-4b7f-b47f-8f8e2ce2b24a req-95eb533d-f8a4-46f3-a2e6-90983e8fe3ff service nova] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Detach interface failed, port_id=89ba5187-e41f-4177-acdd-6f3586ba93ef, reason: Instance 8dd03b27-b9a0-4260-94db-b3aec44b8faa could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:09:04.474193 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:04.476792 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:04.503192 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:04.505939 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:04.528387 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:04.532991 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:04.650342 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962944.6497543, 9106964d-dcd7-4628-9cd7-c09b0739e749 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:09:04.650858 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:09:04.651131 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] VM Started (Lifecycle Event)
May 28 10:09:04.654874 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-282e75de-d627-4111-ac03-9cef28efaf96 req-19305666-1834-4e5e-af25-74fa016fd2e4 service nova] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Received event network-vif-unplugged-10374d15-c1a4-4c1d-90a3-dba7f0348952 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:09:04.655432 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-282e75de-d627-4111-ac03-9cef28efaf96 req-19305666-1834-4e5e-af25-74fa016fd2e4 service nova] Acquiring lock "e4215271-8b48-4661-bc06-eb3f276c2b80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:04.656182 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-282e75de-d627-4111-ac03-9cef28efaf96 req-19305666-1834-4e5e-af25-74fa016fd2e4 service nova] Lock "e4215271-8b48-4661-bc06-eb3f276c2b80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:04.656182 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-282e75de-d627-4111-ac03-9cef28efaf96 req-19305666-1834-4e5e-af25-74fa016fd2e4 service nova] Lock "e4215271-8b48-4661-bc06-eb3f276c2b80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:04.656182 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-282e75de-d627-4111-ac03-9cef28efaf96 req-19305666-1834-4e5e-af25-74fa016fd2e4 service nova] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] No waiting events found dispatching network-vif-unplugged-10374d15-c1a4-4c1d-90a3-dba7f0348952 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:09:04.656182 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-282e75de-d627-4111-ac03-9cef28efaf96 req-19305666-1834-4e5e-af25-74fa016fd2e4 service nova] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Received event network-vif-unplugged-10374d15-c1a4-4c1d-90a3-dba7f0348952 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:09:04.667876 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:09:04.675017 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Instance spawned successfully.
May 28 10:09:04.676637 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:09:04.725198 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:04.752931 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:04.761813 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:04.783202 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Instance destroyed successfully.
May 28 10:09:04.783768 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-88cc1e21-f9a2-4895-9070-6b8bee0771c9 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Lazy-loading 'resources' on Instance uuid e4215271-8b48-4661-bc06-eb3f276c2b80 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:09:04.789660 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:09:04.790105 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 46.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:09:04.816601 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:09:05.029434 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:05.157155 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:09:05.159426 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:09:05.186375 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:09:05.186489 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:09:05.186757 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:09:05.187805 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:09:05.187805 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:09:05.187805 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:09:05.286560 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-88cc1e21-f9a2-4895-9070-6b8bee0771c9 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1757261744',display_name='tempest-VolumesActionsTest-instance-1757261744',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumesactionstest-instance-1757261744',id=53,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:09:01Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7b696dba3e04fc1a6b1b1c792ca0508',ramdisk_id='',reservation_id='r-n1fdalk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-33912954',owner_user_name='tempest-VolumesActionsTest-33912954-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:09:01Z,user_data=None,user_id='3d6c4c0c65114263bdf7b9d657c80a51',uuid=e4215271-8b48-4661-bc06-eb3f276c2b80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10374d15-c1a4-4c1d-90a3-dba7f0348952", "address": "fa:16:3e:c7:6d:47", "network": {"id": "ccb2b68f-6c87-4fee-860c-83e09053a83e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1057861432-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7b696dba3e04fc1a6b1b1c792ca0508", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap10374d15-c1", "ovs_interfaceid": "10374d15-c1a4-4c1d-90a3-dba7f0348952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:09:05.286825 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-88cc1e21-f9a2-4895-9070-6b8bee0771c9 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Converting VIF {"id": "10374d15-c1a4-4c1d-90a3-dba7f0348952", "address": "fa:16:3e:c7:6d:47", "network": {"id": "ccb2b68f-6c87-4fee-860c-83e09053a83e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1057861432-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e7b696dba3e04fc1a6b1b1c792ca0508", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap10374d15-c1", "ovs_interfaceid": "10374d15-c1a4-4c1d-90a3-dba7f0348952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:09:05.287689 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-88cc1e21-f9a2-4895-9070-6b8bee0771c9 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:6d:47,bridge_name='br-int',has_traffic_filtering=True,id=10374d15-c1a4-4c1d-90a3-dba7f0348952,network=Network(ccb2b68f-6c87-4fee-860c-83e09053a83e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10374d15-c1') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:09:05.288078 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-88cc1e21-f9a2-4895-9070-6b8bee0771c9 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:6d:47,bridge_name='br-int',has_traffic_filtering=True,id=10374d15-c1a4-4c1d-90a3-dba7f0348952,network=Network(ccb2b68f-6c87-4fee-860c-83e09053a83e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10374d15-c1') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:09:05.290936 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:05.291224 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10374d15-c1, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:09:05.293408 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:05.294663 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:09:05.296052 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:05.296219 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ae474df0-2c9e-4583-a0ae-1b6071a94e10) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:09:05.296779 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:05.297706 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:09:05.298126 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:05.300684 np0000001613 nova-compute[98321]: INFO os_vif [None req-88cc1e21-f9a2-4895-9070-6b8bee0771c9 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:6d:47,bridge_name='br-int',has_traffic_filtering=True,id=10374d15-c1a4-4c1d-90a3-dba7f0348952,network=Network(ccb2b68f-6c87-4fee-860c-83e09053a83e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10374d15-c1')
May 28 10:09:05.300945 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-88cc1e21-f9a2-4895-9070-6b8bee0771c9 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Deleting instance files /opt/stack/data/nova/instances/e4215271-8b48-4661-bc06-eb3f276c2b80_del
May 28 10:09:05.301582 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-88cc1e21-f9a2-4895-9070-6b8bee0771c9 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Deletion of /opt/stack/data/nova/instances/e4215271-8b48-4661-bc06-eb3f276c2b80_del complete
May 28 10:09:05.326029 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Took 1.72 seconds to deallocate network for instance.
May 28 10:09:05.663278 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:09:05.663278 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962945.6615777, 9106964d-dcd7-4628-9cd7-c09b0739e749 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:09:05.663278 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] VM Paused (Lifecycle Event)
May 28 10:09:05.701084 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Took 7.35 seconds to spawn the instance on the hypervisor.
May 28 10:09:05.701318 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:09:05.808030 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-88cc1e21-f9a2-4895-9070-6b8bee0771c9 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Took 1.36 seconds to destroy the instance on the hypervisor.
May 28 10:09:05.808670 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-88cc1e21-f9a2-4895-9070-6b8bee0771c9 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:09:05.809000 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:09:05.809258 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:09:05.809517 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:09:05.828332 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Acquiring lock "1ffe54bd-ad37-40a8-adfa-04e2ea9c9554" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:05.831340 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "1ffe54bd-ad37-40a8-adfa-04e2ea9c9554" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:05.834019 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8bd2ef54-9d8e-47db-b611-a2973cfea5e4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:05.835532 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8bd2ef54-9d8e-47db-b611-a2973cfea5e4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:05.926286 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:09:06.164905 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:09:06.169459 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962946.169194, 9106964d-dcd7-4628-9cd7-c09b0739e749 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:09:06.169664 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] VM Resumed (Lifecycle Event)
May 28 10:09:06.189680 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8bd2ef54-9d8e-47db-b611-a2973cfea5e4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:09:06.189680 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-8bd2ef54-9d8e-47db-b611-a2973cfea5e4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:09:06.212176 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Took 12.95 seconds to build instance.
May 28 10:09:06.225442 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-72ba10d6-6d21-44c7-add9-614f52043ea9 req-2b358505-adaf-4123-a6f9-fb501f8cd046 service nova] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Received event network-vif-plugged-49c03abc-4bac-4296-b0ec-9ac9127814e9 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:09:06.225961 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-72ba10d6-6d21-44c7-add9-614f52043ea9 req-2b358505-adaf-4123-a6f9-fb501f8cd046 service nova] Acquiring lock "9106964d-dcd7-4628-9cd7-c09b0739e749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:06.225961 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-72ba10d6-6d21-44c7-add9-614f52043ea9 req-2b358505-adaf-4123-a6f9-fb501f8cd046 service nova] Lock "9106964d-dcd7-4628-9cd7-c09b0739e749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:06.226109 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-72ba10d6-6d21-44c7-add9-614f52043ea9 req-2b358505-adaf-4123-a6f9-fb501f8cd046 service nova] Lock "9106964d-dcd7-4628-9cd7-c09b0739e749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:06.226209 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-72ba10d6-6d21-44c7-add9-614f52043ea9 req-2b358505-adaf-4123-a6f9-fb501f8cd046 service nova] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] No waiting events found dispatching network-vif-plugged-49c03abc-4bac-4296-b0ec-9ac9127814e9 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:09:06.226357 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-72ba10d6-6d21-44c7-add9-614f52043ea9 req-2b358505-adaf-4123-a6f9-fb501f8cd046 service nova] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Received unexpected event network-vif-plugged-49c03abc-4bac-4296-b0ec-9ac9127814e9 for instance with vm_state active and task_state None.
May 28 10:09:06.335993 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lazy-loading 'flavor' on Instance uuid 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:09:06.672702 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:09:06.675958 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:09:06.691490 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-8bd2ef54-9d8e-47db-b611-a2973cfea5e4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:09:06.713976 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f482fe2d-dd73-4156-a091-c52fc12ec9e1 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Lock "9106964d-dcd7-4628-9cd7-c09b0739e749" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.457s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:06.723281 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-9f8ef4f4-89c5-44fd-be16-a19fb900762e req-47040027-dbba-4267-9577-4dbba7b94e68 service nova] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Received event network-vif-unplugged-10374d15-c1a4-4c1d-90a3-dba7f0348952 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:09:06.724535 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9f8ef4f4-89c5-44fd-be16-a19fb900762e req-47040027-dbba-4267-9577-4dbba7b94e68 service nova] Acquiring lock "e4215271-8b48-4661-bc06-eb3f276c2b80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:06.724535 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9f8ef4f4-89c5-44fd-be16-a19fb900762e req-47040027-dbba-4267-9577-4dbba7b94e68 service nova] Lock "e4215271-8b48-4661-bc06-eb3f276c2b80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:06.724535 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9f8ef4f4-89c5-44fd-be16-a19fb900762e req-47040027-dbba-4267-9577-4dbba7b94e68 service nova] Lock "e4215271-8b48-4661-bc06-eb3f276c2b80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:06.724535 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-9f8ef4f4-89c5-44fd-be16-a19fb900762e req-47040027-dbba-4267-9577-4dbba7b94e68 service nova] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] No waiting events found dispatching network-vif-unplugged-10374d15-c1a4-4c1d-90a3-dba7f0348952 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:09:06.724535 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-9f8ef4f4-89c5-44fd-be16-a19fb900762e req-47040027-dbba-4267-9577-4dbba7b94e68 service nova] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Received event network-vif-unplugged-10374d15-c1a4-4c1d-90a3-dba7f0348952 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:09:06.778946 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:09:06.838906 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Ignoring supplied device name: /dev/vdb
May 28 10:09:07.076779 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:07.181325 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999512061999667 future=<Future at 0x73c1fc35fbc0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:09:07.201632 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8bd2ef54-9d8e-47db-b611-a2973cfea5e4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.366s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:07.266588 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-8bd2ef54-9d8e-47db-b611-a2973cfea5e4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Deleted allocations for instance 8dd03b27-b9a0-4260-94db-b3aec44b8faa
May 28 10:09:07.281664 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Took 1.47 seconds to deallocate network for instance.
May 28 10:09:07.341251 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "1ffe54bd-ad37-40a8-adfa-04e2ea9c9554" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:07.793854 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-88cc1e21-f9a2-4895-9070-6b8bee0771c9 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:07.794654 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-88cc1e21-f9a2-4895-9070-6b8bee0771c9 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:08.081949 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-88cc1e21-f9a2-4895-9070-6b8bee0771c9 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:09:08.082896 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-88cc1e21-f9a2-4895-9070-6b8bee0771c9 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:09:08.285314 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8bd2ef54-9d8e-47db-b611-a2973cfea5e4 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "8dd03b27-b9a0-4260-94db-b3aec44b8faa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.597s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:08.296278 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-05549339-b108-4a59-9f96-29e7193855ce req-dedd05d0-f103-4ffb-9a5c-4299830d7976 service nova] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Received event network-vif-deleted-10374d15-c1a4-4c1d-90a3-dba7f0348952 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:09:08.585345 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-88cc1e21-f9a2-4895-9070-6b8bee0771c9 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:09:08.679614 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Acquiring lock "1ffe54bd-ad37-40a8-adfa-04e2ea9c9554" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:08.679783 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "1ffe54bd-ad37-40a8-adfa-04e2ea9c9554" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:08.679976 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Attaching volume 783442cf-b315-459d-9489-3289c8ac0fc0 to /dev/vdb
May 28 10:09:08.730955 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:09:08.743307 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:09:08.768421 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:09:08.819634 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:09:08.820228 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:09:08.830206 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:09:08.831614 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe1a:d1df', 'fe80::1c9e:daff:fee5:c4bc', 'fe80::fc16:3eff:fe51:378d', 'fe80::e4eb:4cff:fe5c:5eb7', 'fe80::fc16:3eff:fe2b:fb44', 'fe80::e025:35ff:fe60:28cd'] 
May 28 10:09:08.831762 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:09:08.831831 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:09:08.832113 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] <== get_connector_properties: return (101ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:09:08.832406 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Updating existing volume attachment record: 39da297c-8f14-4b05-afe0-9681cc061447 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:09:09.093266 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-88cc1e21-f9a2-4895-9070-6b8bee0771c9 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.299s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:09.171316 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-88cc1e21-f9a2-4895-9070-6b8bee0771c9 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Deleted allocations for instance e4215271-8b48-4661-bc06-eb3f276c2b80
May 28 10:09:09.235097 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:09:09.421369 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:09:09.421728 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0', 'iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '783442cf-b315-459d-9489-3289c8ac0fc0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:09:09.421919 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:09:09.423245 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:09:09.423516 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0', 'iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '783442cf-b315-459d-9489-3289c8ac0fc0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:09:09.435878 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:09:09.436463 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:09:09.436831 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:09:09.437713 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:09:09.438092 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:09:09.438523 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:09:09.449609 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:09:09.449609 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:09.453781 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:09:09.453781 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:09.462485 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0] added
May 28 10:09:09.462485 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:09:09.462485 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:09:09.462485 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:09:09.462485 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:09:09.462485 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:09:09.462485 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:09.462706 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:09:09.462925 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0246(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:09:09.463112 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:09:09.464055 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0] added
May 28 10:09:09.464055 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:09:09.464055 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:09:09.464055 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:09:09.464055 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:09:09.464055 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:09:09.464055 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:09.464215 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:09:09.464328 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0273(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:09:09.464437 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:09:09.736949 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:10.182377 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-88cc1e21-f9a2-4895-9070-6b8bee0771c9 tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Lock "e4215271-8b48-4661-bc06-eb3f276c2b80" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.247s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:10.298725 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:10.463667 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:09:10.465120 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:09:10.479183 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:09:10.479183 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:09:10.490825 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:09:10.490825 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:10.494006 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:10.507304 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:10.519208 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:09:10.519208 np0000001613 nova-compute[98321]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:09:10.519208 np0000001613 nova-compute[98321]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d6c8ab9-6fd0-4ed1-b314-d09cbc4e546f (non-flash)
May 28 10:09:10.519208 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:09:10.520143 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsi session list stdout=tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:09:10.520143 np0000001613 nova-compute[98321]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:09:10.520143 np0000001613 nova-compute[98321]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d6c8ab9-6fd0-4ed1-b314-d09cbc4e546f (non-flash)
May 28 10:09:10.520143 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:09:10.527496 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:09:10.527496 np0000001613 nova-compute[98321]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:09:10.527496 np0000001613 nova-compute[98321]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d6c8ab9-6fd0-4ed1-b314-d09cbc4e546f (non-flash)
May 28 10:09:10.527496 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:09:10.527673 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsi session list stdout=tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:09:10.527673 np0000001613 nova-compute[98321]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:09:10.527673 np0000001613 nova-compute[98321]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d6c8ab9-6fd0-4ed1-b314-d09cbc4e546f (non-flash)
May 28 10:09:10.527673 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:09:10.551057 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0, portal: 192.168.50.100,3260]
May 28 10:09:10.551057 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0, portal: 192.168.50.100,3260] successful.
May 28 10:09:10.551057 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:10.562966 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:10.571649 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0, portal: 192.168.40.100,3260]
May 28 10:09:10.571649 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0, portal: 192.168.40.100,3260] successful.
May 28 10:09:10.571649 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:10.581016 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:09:10.581016 np0000001613 nova-compute[98321]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:09:10.581016 np0000001613 nova-compute[98321]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d6c8ab9-6fd0-4ed1-b314-d09cbc4e546f (non-flash)
May 28 10:09:10.581016 np0000001613 nova-compute[98321]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:10.581016 np0000001613 nova-compute[98321]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:10.581016 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:09:10.581016 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsi session list stdout=tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:09:10.581016 np0000001613 nova-compute[98321]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:09:10.581016 np0000001613 nova-compute[98321]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d6c8ab9-6fd0-4ed1-b314-d09cbc4e546f (non-flash)
May 28 10:09:10.581016 np0000001613 nova-compute[98321]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:10.581016 np0000001613 nova-compute[98321]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:10.581016 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:09:10.581328 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.143s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:09:10.581442 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:09:10.585273 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] HCTL ('8', '-', '-', 0) found on session 128 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:09:10.585392 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:09:10.587091 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:10.603327 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Searching for a device in session 128 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:09:10.603327 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '783442cf-b315-459d-9489-3289c8ac0fc0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:09:10.607151 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:09:10.607151 np0000001613 nova-compute[98321]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:09:10.607151 np0000001613 nova-compute[98321]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d6c8ab9-6fd0-4ed1-b314-d09cbc4e546f (non-flash)
May 28 10:09:10.607151 np0000001613 nova-compute[98321]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:10.607151 np0000001613 nova-compute[98321]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:10.607151 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:09:10.607417 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsi session list stdout=tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:09:10.607417 np0000001613 nova-compute[98321]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:09:10.607417 np0000001613 nova-compute[98321]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d6c8ab9-6fd0-4ed1-b314-d09cbc4e546f (non-flash)
May 28 10:09:10.607417 np0000001613 nova-compute[98321]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:10.607417 np0000001613 nova-compute[98321]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:10.607417 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:09:10.607790 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.171s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:09:10.607942 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:09:10.609099 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] HCTL ('11', '-', '-', 0) found on session 129 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:09:10.609099 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:09:10.625718 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Searching for a device in session 129 and hctl ['11', '*', '*', 0] yield: None {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:09:10.722937 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0004095510003025993 future=<Future at 0x73c1f41c2810 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:09:10.723936 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Emitting event <LifecycleEvent: 1779962935.7224126, 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:09:10.723936 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] VM Stopped (Lifecycle Event)
May 28 10:09:10.725028 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:09:10.725422 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=6.924804429000233 future=<Future at 0x73c1f4092d20 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:09:10.725422 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=6.924706366000009 future=<Future at 0x73c1f4092d20 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:09:11.228014 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: 742c2b03-7f0a-4e56-84f4-2fe5f3fd0e6f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:09:11.628191 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Searching for a device in session 129 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:09:11.628191 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '783442cf-b315-459d-9489-3289c8ac0fc0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:09:12.035210 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:12.124995 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d9ab73c6-2a36-47cc-b84c-320493273652 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Acquiring lock "9106964d-dcd7-4628-9cd7-c09b0739e749" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:12.131111 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d9ab73c6-2a36-47cc-b84c-320493273652 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Lock "9106964d-dcd7-4628-9cd7-c09b0739e749" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.007s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:12.131383 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d9ab73c6-2a36-47cc-b84c-320493273652 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Acquiring lock "9106964d-dcd7-4628-9cd7-c09b0739e749-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:12.135106 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d9ab73c6-2a36-47cc-b84c-320493273652 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Lock "9106964d-dcd7-4628-9cd7-c09b0739e749-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:12.135904 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d9ab73c6-2a36-47cc-b84c-320493273652 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Lock "9106964d-dcd7-4628-9cd7-c09b0739e749-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:12.143907 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-d9ab73c6-2a36-47cc-b84c-320493273652 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Terminating instance
May 28 10:09:12.342668 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6c7eaf59-d6b0-4a6c-a85c-bdb5af51ecae tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "ca57808c-4f51-4a26-8724-d28394efab9f" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:12.343053 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6c7eaf59-d6b0-4a6c-a85c-bdb5af51ecae tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "ca57808c-4f51-4a26-8724-d28394efab9f" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:12.343089 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-6c7eaf59-d6b0-4a6c-a85c-bdb5af51ecae tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:09:12.348195 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-6c7eaf59-d6b0-4a6c-a85c-bdb5af51ecae tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98321) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 28 10:09:12.348651 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-6c7eaf59-d6b0-4a6c-a85c-bdb5af51ecae tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lazy-loading 'flavor' on Instance uuid ca57808c-4f51-4a26-8724-d28394efab9f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:09:12.458052 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Found WWN 330000000ee77c9a5 for multipath device dm-0 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:09:12.458301 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:09:12.458512 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '330000000ee77c9a5', 'path': '/dev/dm-0', 'multipath_id': '330000000ee77c9a5'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:09:12.458686 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ee77c9a5', 'path': '/dev/dm-0', 'multipath_id': '330000000ee77c9a5'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:09:12.462669 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lazy-loading 'flavor' on Instance uuid 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:09:12.656327 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d9ab73c6-2a36-47cc-b84c-320493273652 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:09:12.676135 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:12.699532 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:12.704665 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:12.730799 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:12.918899 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7423c7c9-90b6-403d-886e-6992113c5e2c req-325903c4-ce4f-4c38-9c9c-b6b27db4cd36 service nova] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Received event network-vif-unplugged-49c03abc-4bac-4296-b0ec-9ac9127814e9 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:09:12.919057 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7423c7c9-90b6-403d-886e-6992113c5e2c req-325903c4-ce4f-4c38-9c9c-b6b27db4cd36 service nova] Acquiring lock "9106964d-dcd7-4628-9cd7-c09b0739e749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:12.919227 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7423c7c9-90b6-403d-886e-6992113c5e2c req-325903c4-ce4f-4c38-9c9c-b6b27db4cd36 service nova] Lock "9106964d-dcd7-4628-9cd7-c09b0739e749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:12.919567 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7423c7c9-90b6-403d-886e-6992113c5e2c req-325903c4-ce4f-4c38-9c9c-b6b27db4cd36 service nova] Lock "9106964d-dcd7-4628-9cd7-c09b0739e749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:12.919567 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7423c7c9-90b6-403d-886e-6992113c5e2c req-325903c4-ce4f-4c38-9c9c-b6b27db4cd36 service nova] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] No waiting events found dispatching network-vif-unplugged-49c03abc-4bac-4296-b0ec-9ac9127814e9 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:09:12.919635 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7423c7c9-90b6-403d-886e-6992113c5e2c req-325903c4-ce4f-4c38-9c9c-b6b27db4cd36 service nova] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Received event network-vif-unplugged-49c03abc-4bac-4296-b0ec-9ac9127814e9 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:09:12.967658 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Attempting to attach volume 783442cf-b315-459d-9489-3289c8ac0fc0 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 10:09:12.973183 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] attach device xml: <disk type="block" device="disk">
May 28 10:09:12.973183 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:09:12.973183 np0000001613 nova-compute[98321]:   <alias name="ua-783442cf-b315-459d-9489-3289c8ac0fc0"/>
May 28 10:09:12.973183 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-0"/>
May 28 10:09:12.973183 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:09:12.973183 np0000001613 nova-compute[98321]:   <serial>783442cf-b315-459d-9489-3289c8ac0fc0</serial>
May 28 10:09:12.973183 np0000001613 nova-compute[98321]: </disk>
May 28 10:09:12.973183 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 10:09:13.107681 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999684543000058 future=<Future at 0x73c1f43538c0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:09:13.112933 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Instance destroyed successfully.
May 28 10:09:13.113490 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-d9ab73c6-2a36-47cc-b84c-320493273652 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Lazy-loading 'resources' on Instance uuid 9106964d-dcd7-4628-9cd7-c09b0739e749 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:09:13.386851 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:13.388539 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:13.418831 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:13.422664 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:13.454273 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:13.618789 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-d9ab73c6-2a36-47cc-b84c-320493273652 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:08:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-517278017',display_name='tempest-VolumesActionsTest-instance-517278017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumesactionstest-instance-517278017',id=54,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:09:05Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2033897f986640b489037e19aaf9e9f4',ramdisk_id='',reservation_id='r-khbq66l4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1182166418',owner_user_name='tempest-VolumesActionsTest-1182166418-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:09:06Z,user_data=None,user_id='89055f093b284972ae2ba1196f59d3ba',uuid=9106964d-dcd7-4628-9cd7-c09b0739e749,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49c03abc-4bac-4296-b0ec-9ac9127814e9", "address": "fa:16:3e:2b:fb:44", "network": {"id": "cef39ad9-95ea-4e75-81ee-5ee61758d095", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1228058603-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2033897f986640b489037e19aaf9e9f4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c03abc-4b", "ovs_interfaceid": "49c03abc-4bac-4296-b0ec-9ac9127814e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:09:13.619562 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d9ab73c6-2a36-47cc-b84c-320493273652 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Converting VIF {"id": "49c03abc-4bac-4296-b0ec-9ac9127814e9", "address": "fa:16:3e:2b:fb:44", "network": {"id": "cef39ad9-95ea-4e75-81ee-5ee61758d095", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1228058603-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2033897f986640b489037e19aaf9e9f4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c03abc-4b", "ovs_interfaceid": "49c03abc-4bac-4296-b0ec-9ac9127814e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:09:13.620591 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d9ab73c6-2a36-47cc-b84c-320493273652 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:fb:44,bridge_name='br-int',has_traffic_filtering=True,id=49c03abc-4bac-4296-b0ec-9ac9127814e9,network=Network(cef39ad9-95ea-4e75-81ee-5ee61758d095),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49c03abc-4b') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:09:13.620967 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-d9ab73c6-2a36-47cc-b84c-320493273652 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:fb:44,bridge_name='br-int',has_traffic_filtering=True,id=49c03abc-4bac-4296-b0ec-9ac9127814e9,network=Network(cef39ad9-95ea-4e75-81ee-5ee61758d095),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49c03abc-4b') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:09:13.623177 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:13.623369 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49c03abc-4b, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:09:13.624487 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:13.625434 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:09:13.632419 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:13.634013 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:13.634220 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f37738c8-d26e-4ac2-8f08-1b2c0c8d8c4a) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:09:13.634960 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:13.635214 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:09:13.641340 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:13.644704 np0000001613 nova-compute[98321]: INFO os_vif [None req-d9ab73c6-2a36-47cc-b84c-320493273652 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:fb:44,bridge_name='br-int',has_traffic_filtering=True,id=49c03abc-4bac-4296-b0ec-9ac9127814e9,network=Network(cef39ad9-95ea-4e75-81ee-5ee61758d095),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49c03abc-4b')
May 28 10:09:13.645215 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-d9ab73c6-2a36-47cc-b84c-320493273652 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Deleting instance files /opt/stack/data/nova/instances/9106964d-dcd7-4628-9cd7-c09b0739e749_del
May 28 10:09:13.646354 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-d9ab73c6-2a36-47cc-b84c-320493273652 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Deletion of /opt/stack/data/nova/instances/9106964d-dcd7-4628-9cd7-c09b0739e749_del complete
May 28 10:09:13.703530 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999644449000243 future=<Future at 0x73c1f4208ad0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:09:13.709427 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Instance destroyed successfully.
May 28 10:09:13.709427 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-6c7eaf59-d6b0-4a6c-a85c-bdb5af51ecae tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lazy-loading 'numa_topology' on Instance uuid ca57808c-4f51-4a26-8724-d28394efab9f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:09:13.784995 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:13.785301 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:14.118568 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:14.154109 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-d9ab73c6-2a36-47cc-b84c-320493273652 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Took 1.50 seconds to destroy the instance on the hypervisor.
May 28 10:09:14.154645 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-d9ab73c6-2a36-47cc-b84c-320493273652 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:09:14.154972 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:09:14.155084 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:09:14.155373 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:09:14.211539 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:09:14.215182 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-6c7eaf59-d6b0-4a6c-a85c-bdb5af51ecae tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Object Instance<ca57808c-4f51-4a26-8724-d28394efab9f> lazy-loaded attributes: flavor,numa_topology {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:09:14.215182 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-6c7eaf59-d6b0-4a6c-a85c-bdb5af51ecae tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:09:14.287547 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:09:14.527932 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e7ee1d12-4861-4fe0-bf64-c64b5a76857d req-6ca4f9ec-0234-4797-bec9-bf9ef10cd690 service nova] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Received event network-vif-deleted-49c03abc-4bac-4296-b0ec-9ac9127814e9 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:09:14.529073 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-e7ee1d12-4861-4fe0-bf64-c64b5a76857d req-6ca4f9ec-0234-4797-bec9-bf9ef10cd690 service nova] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Neutron deleted interface 49c03abc-4bac-4296-b0ec-9ac9127814e9; detaching it from the instance and deleting it from the info cache
May 28 10:09:14.530959 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e7ee1d12-4861-4fe0-bf64-c64b5a76857d req-6ca4f9ec-0234-4797-bec9-bf9ef10cd690 service nova] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Detach interface failed, port_id=49c03abc-4bac-4296-b0ec-9ac9127814e9, reason: Instance 9106964d-dcd7-4628-9cd7-c09b0739e749 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:09:14.650595 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:09:14.650716 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:09:14.650783 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:09:14.650879 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] No VIF found with MAC fa:16:3e:1a:d1:df, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:09:14.722831 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6c7eaf59-d6b0-4a6c-a85c-bdb5af51ecae tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "ca57808c-4f51-4a26-8724-d28394efab9f" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.380s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:14.733625 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:14.832977 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:14.833156 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:14.836171 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:09:14.836320 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Claim successful on node np0000001613
May 28 10:09:14.976885 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ada5f009-76f0-4f4d-907b-536b06af0a1d req-c4d4f812-0bba-4199-bc97-384c3eb9f172 service nova] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Received event network-vif-unplugged-49c03abc-4bac-4296-b0ec-9ac9127814e9 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:09:14.977326 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ada5f009-76f0-4f4d-907b-536b06af0a1d req-c4d4f812-0bba-4199-bc97-384c3eb9f172 service nova] Acquiring lock "9106964d-dcd7-4628-9cd7-c09b0739e749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:14.977516 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ada5f009-76f0-4f4d-907b-536b06af0a1d req-c4d4f812-0bba-4199-bc97-384c3eb9f172 service nova] Lock "9106964d-dcd7-4628-9cd7-c09b0739e749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:14.977647 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ada5f009-76f0-4f4d-907b-536b06af0a1d req-c4d4f812-0bba-4199-bc97-384c3eb9f172 service nova] Lock "9106964d-dcd7-4628-9cd7-c09b0739e749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:14.977757 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ada5f009-76f0-4f4d-907b-536b06af0a1d req-c4d4f812-0bba-4199-bc97-384c3eb9f172 service nova] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] No waiting events found dispatching network-vif-unplugged-49c03abc-4bac-4296-b0ec-9ac9127814e9 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:09:14.978538 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ada5f009-76f0-4f4d-907b-536b06af0a1d req-c4d4f812-0bba-4199-bc97-384c3eb9f172 service nova] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Received event network-vif-unplugged-49c03abc-4bac-4296-b0ec-9ac9127814e9 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:09:14.979873 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:09:15.217224 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b55a6f3b-ea8a-4c8e-8b8f-bac444e92cc8 req-54612720-efcb-41af-a4fa-4aa6353a6332 service nova] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Received event network-vif-unplugged-fca4901d-c1d5-4b95-8e64-2d88cd94725f {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:09:15.217224 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b55a6f3b-ea8a-4c8e-8b8f-bac444e92cc8 req-54612720-efcb-41af-a4fa-4aa6353a6332 service nova] Acquiring lock "ca57808c-4f51-4a26-8724-d28394efab9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:15.217353 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b55a6f3b-ea8a-4c8e-8b8f-bac444e92cc8 req-54612720-efcb-41af-a4fa-4aa6353a6332 service nova] Lock "ca57808c-4f51-4a26-8724-d28394efab9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:15.217484 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b55a6f3b-ea8a-4c8e-8b8f-bac444e92cc8 req-54612720-efcb-41af-a4fa-4aa6353a6332 service nova] Lock "ca57808c-4f51-4a26-8724-d28394efab9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:15.217595 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b55a6f3b-ea8a-4c8e-8b8f-bac444e92cc8 req-54612720-efcb-41af-a4fa-4aa6353a6332 service nova] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] No waiting events found dispatching network-vif-unplugged-fca4901d-c1d5-4b95-8e64-2d88cd94725f {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:09:15.217711 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-b55a6f3b-ea8a-4c8e-8b8f-bac444e92cc8 req-54612720-efcb-41af-a4fa-4aa6353a6332 service nova] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Received unexpected event network-vif-unplugged-fca4901d-c1d5-4b95-8e64-2d88cd94725f for instance with vm_state stopped and task_state None.
May 28 10:09:15.481521 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Took 1.33 seconds to deallocate network for instance.
May 28 10:09:15.989899 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d9ab73c6-2a36-47cc-b84c-320493273652 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:16.110585 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:09:16.110907 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:09:16.225568 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-1193d01d-6387-4198-855d-6175f81b3845 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "1ffe54bd-ad37-40a8-adfa-04e2ea9c9554" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.546s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:16.280943 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lazy-loading 'flavor' on Instance uuid ca57808c-4f51-4a26-8724-d28394efab9f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:09:16.613639 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:09:16.788053 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "refresh_cache-ca57808c-4f51-4a26-8724-d28394efab9f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:09:16.788202 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquired lock "refresh_cache-ca57808c-4f51-4a26-8724-d28394efab9f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:09:16.788291 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:09:16.788412 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lazy-loading 'info_cache' on Instance uuid ca57808c-4f51-4a26-8724-d28394efab9f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:09:17.043156 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:17.121255 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.288s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:17.121732 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:09:17.123955 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d9ab73c6-2a36-47cc-b84c-320493273652 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.133s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:17.296636 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Object Instance<ca57808c-4f51-4a26-8724-d28394efab9f> lazy-loaded attributes: flavor,info_cache {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:09:17.405122 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d9ab73c6-2a36-47cc-b84c-320493273652 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:09:17.405279 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-d9ab73c6-2a36-47cc-b84c-320493273652 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:09:17.628341 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:09:17.628687 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:09:17.629299 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:09:17.629648 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:09:17.650468 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0003535219998411776 future=<Future at 0x73c1f4092d20 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:09:17.650812 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:09:17.650905 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=4.52968397099994 future=<Future at 0x73c1fc35fbc0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:09:17.650978 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=4.5296039019999625 future=<Future at 0x73c1fc35fbc0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:09:17.654520 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Emitting event <LifecycleEvent: 1779962942.6499994, 8dd03b27-b9a0-4260-94db-b3aec44b8faa => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:09:17.654766 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] VM Stopped (Lifecycle Event)
May 28 10:09:17.731509 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '961948be669c4a18a29398d53015f03b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7563a83d33d4bc1a6610ccf53c18dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:09:17.799904 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:09:17.882917 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3214fbd4-3d78-4111-af43-8dbfa5eedf73 req-dc20933f-6076-4d8f-9b7d-b87d4eaa64f0 service nova] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Received event network-vif-unplugged-fca4901d-c1d5-4b95-8e64-2d88cd94725f {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:09:17.883813 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3214fbd4-3d78-4111-af43-8dbfa5eedf73 req-dc20933f-6076-4d8f-9b7d-b87d4eaa64f0 service nova] Acquiring lock "ca57808c-4f51-4a26-8724-d28394efab9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:17.884701 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3214fbd4-3d78-4111-af43-8dbfa5eedf73 req-dc20933f-6076-4d8f-9b7d-b87d4eaa64f0 service nova] Lock "ca57808c-4f51-4a26-8724-d28394efab9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:17.884842 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3214fbd4-3d78-4111-af43-8dbfa5eedf73 req-dc20933f-6076-4d8f-9b7d-b87d4eaa64f0 service nova] Lock "ca57808c-4f51-4a26-8724-d28394efab9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:17.885738 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3214fbd4-3d78-4111-af43-8dbfa5eedf73 req-dc20933f-6076-4d8f-9b7d-b87d4eaa64f0 service nova] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] No waiting events found dispatching network-vif-unplugged-fca4901d-c1d5-4b95-8e64-2d88cd94725f {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:09:17.885896 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-3214fbd4-3d78-4111-af43-8dbfa5eedf73 req-dc20933f-6076-4d8f-9b7d-b87d4eaa64f0 service nova] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Received unexpected event network-vif-unplugged-fca4901d-c1d5-4b95-8e64-2d88cd94725f for instance with vm_state stopped and task_state powering-on.
May 28 10:09:17.908504 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-d9ab73c6-2a36-47cc-b84c-320493273652 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:09:18.128670 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:09:18.157968 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: 8dd03b27-b9a0-4260-94db-b3aec44b8faa] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:09:18.337874 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Successfully created port: 6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:09:18.411456 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:09:18.420844 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d9ab73c6-2a36-47cc-b84c-320493273652 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.297s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:18.514859 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-d9ab73c6-2a36-47cc-b84c-320493273652 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Deleted allocations for instance 9106964d-dcd7-4628-9cd7-c09b0739e749
May 28 10:09:18.634604 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:09:18.642421 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:18.723960 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Updating instance_info_cache with network_info: [{"id": "fca4901d-c1d5-4b95-8e64-2d88cd94725f", "address": "fa:16:3e:51:37:8d", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca4901d-c1", "ovs_interfaceid": "fca4901d-c1d5-4b95-8e64-2d88cd94725f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:09:19.051652 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Successfully updated port: 6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:09:19.104944 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-953c6e7e-8432-4033-831a-27bf7f24b666 req-c6aae050-1139-419c-9f7b-8b9605efd463 service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Received event network-changed-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:09:19.108083 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-953c6e7e-8432-4033-831a-27bf7f24b666 req-c6aae050-1139-419c-9f7b-8b9605efd463 service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Refreshing instance network info cache due to event network-changed-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:09:19.108353 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-953c6e7e-8432-4033-831a-27bf7f24b666 req-c6aae050-1139-419c-9f7b-8b9605efd463 service nova] Acquiring lock "refresh_cache-edd8dcff-3440-445a-b4a2-8c56863e7ca3" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:09:19.108424 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-953c6e7e-8432-4033-831a-27bf7f24b666 req-c6aae050-1139-419c-9f7b-8b9605efd463 service nova] Acquired lock "refresh_cache-edd8dcff-3440-445a-b4a2-8c56863e7ca3" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:09:19.108588 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-953c6e7e-8432-4033-831a-27bf7f24b666 req-c6aae050-1139-419c-9f7b-8b9605efd463 service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Refreshing network info cache for port 6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:09:19.233427 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Releasing lock "refresh_cache-ca57808c-4f51-4a26-8724-d28394efab9f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:09:19.478721 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-aa3e351d-e3ff-49df-a9d4-ad039cd8680d req-e11ee40b-3fd1-4279-9089-4228b562db69 service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Received event network-vif-unplugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:09:19.478881 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-aa3e351d-e3ff-49df-a9d4-ad039cd8680d req-e11ee40b-3fd1-4279-9089-4228b562db69 service nova] Acquiring lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:19.479064 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-aa3e351d-e3ff-49df-a9d4-ad039cd8680d req-e11ee40b-3fd1-4279-9089-4228b562db69 service nova] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:19.479235 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-aa3e351d-e3ff-49df-a9d4-ad039cd8680d req-e11ee40b-3fd1-4279-9089-4228b562db69 service nova] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:19.479701 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-aa3e351d-e3ff-49df-a9d4-ad039cd8680d req-e11ee40b-3fd1-4279-9089-4228b562db69 service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] No waiting events found dispatching network-vif-unplugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:09:19.479701 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-aa3e351d-e3ff-49df-a9d4-ad039cd8680d req-e11ee40b-3fd1-4279-9089-4228b562db69 service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Received unexpected event network-vif-unplugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc for instance with vm_state building and task_state spawning.
May 28 10:09:19.525131 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d9ab73c6-2a36-47cc-b84c-320493273652 tempest-VolumesActionsTest-1182166418 tempest-VolumesActionsTest-1182166418-project-member] Lock "9106964d-dcd7-4628-9cd7-c09b0739e749" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.395s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:19.556083 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "refresh_cache-edd8dcff-3440-445a-b4a2-8c56863e7ca3" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:09:19.616432 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-953c6e7e-8432-4033-831a-27bf7f24b666 req-c6aae050-1139-419c-9f7b-8b9605efd463 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:09:19.649719 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:09:19.651559 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:09:19.651559 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Creating image(s)
May 28 10:09:19.652552 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "/opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:19.653957 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "/opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:19.654796 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "/opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:19.656644 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:09:19.659219 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:19.663695 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:09:19.664420 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:09:19.705941 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-953c6e7e-8432-4033-831a-27bf7f24b666 req-c6aae050-1139-419c-9f7b-8b9605efd463 service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:09:19.735464 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:19.793908 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.129s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:09:19.794427 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:19.794974 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:19.795414 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:09:19.799223 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:09:19.799223 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:09:19.930122 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.131s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:09:19.932670 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:09:19.958840 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-953c6e7e-8432-4033-831a-27bf7f24b666 req-c6aae050-1139-419c-9f7b-8b9605efd463 service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:09:20.028660 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk 1073741824" returned: 0 in 0.097s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:09:20.032640 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:20.032640 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:09:20.151666 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.119s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:09:20.152855 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Checking if we can resize image /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:09:20.153214 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:09:20.262787 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Instance destroyed successfully.
May 28 10:09:20.263372 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lazy-loading 'numa_topology' on Instance uuid ca57808c-4f51-4a26-8724-d28394efab9f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:09:20.287951 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:09:20.288357 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Cannot resize image /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:09:20.288749 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:09:20.288970 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Ensure instance console log exists: /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:09:20.289415 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:20.289664 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:20.289796 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:20.464755 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-953c6e7e-8432-4033-831a-27bf7f24b666 req-c6aae050-1139-419c-9f7b-8b9605efd463 service nova] Releasing lock "refresh_cache-edd8dcff-3440-445a-b4a2-8c56863e7ca3" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:09:20.465264 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquired lock "refresh_cache-edd8dcff-3440-445a-b4a2-8c56863e7ca3" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:09:20.465603 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:09:20.768064 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Object Instance<ca57808c-4f51-4a26-8724-d28394efab9f> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:09:20.768464 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lazy-loading 'resources' on Instance uuid ca57808c-4f51-4a26-8724-d28394efab9f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:09:21.073599 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:09:21.270471 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Object Instance<ca57808c-4f51-4a26-8724-d28394efab9f> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:09:21.271916 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:08:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1045213354',display_name='tempest-TestVolumeBootPattern-server-1045213354',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpattern-server-1045213354',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXijNEVpHlU0fcHSajVe0wLb7tE6aVVeudGfxc7rHURQeMUmzIENcCsTLjBsfytzyxfL8Ns1nEjQaGLVbBThbKgoJfLjVwVzizrBq9/Hj7rtGIFoStaV7wwOeDN2YJenw==',key_name='tempest-keypair-161619853',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:08:33Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='23e9651268114327a9cc6c6c59bef01e',ramdisk_id='',reservation_id='r-80yxhf2a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-327944304',owner_user_name='tempest-TestVolumeBootPattern-327944304-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:09:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec58233d3b2848bbb2e0b00650398cd1',uuid=ca57808c-4f51-4a26-8724-d28394efab9f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "fca4901d-c1d5-4b95-8e64-2d88cd94725f", "address": "fa:16:3e:51:37:8d", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca4901d-c1", "ovs_interfaceid": "fca4901d-c1d5-4b95-8e64-2d88cd94725f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:09:21.271916 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converting VIF {"id": "fca4901d-c1d5-4b95-8e64-2d88cd94725f", "address": "fa:16:3e:51:37:8d", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca4901d-c1", "ovs_interfaceid": "fca4901d-c1d5-4b95-8e64-2d88cd94725f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:09:21.272676 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:37:8d,bridge_name='br-int',has_traffic_filtering=True,id=fca4901d-c1d5-4b95-8e64-2d88cd94725f,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfca4901d-c1') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:09:21.273142 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:37:8d,bridge_name='br-int',has_traffic_filtering=True,id=fca4901d-c1d5-4b95-8e64-2d88cd94725f,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfca4901d-c1') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:09:21.275152 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:21.275975 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfca4901d-c1, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:09:21.283873 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:21.287547 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:09:21.292913 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:21.293581 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1236b2d8-59c0-4731-960a-302d63343c0c) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:09:21.295852 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:21.296044 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:09:21.302900 np0000001613 nova-compute[98321]: INFO os_vif [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:37:8d,bridge_name='br-int',has_traffic_filtering=True,id=fca4901d-c1d5-4b95-8e64-2d88cd94725f,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfca4901d-c1')
May 28 10:09:21.306771 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:09:21.307878 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:09:21.308073 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:09:21.308490 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:09:21.309062 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:09:21.309062 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:09:21.328397 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:09:21.357192 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:09:21.357192 np0000001613 nova-compute[98321]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:09:21.357192 np0000001613 nova-compute[98321]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:21.357192 np0000001613 nova-compute[98321]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:21.357192 np0000001613 nova-compute[98321]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6651cabf-3fbc-4423-9ae7-01fa2dbbf5c5 (non-flash)
May 28 10:09:21.357192 np0000001613 nova-compute[98321]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6651cabf-3fbc-4423-9ae7-01fa2dbbf5c5 (non-flash)
May 28 10:09:21.357192 np0000001613 nova-compute[98321]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c4baa7e-d209-4c65-b1fd-00d38dcc5a01 (non-flash)
May 28 10:09:21.357192 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:09:21.358567 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:09:21.358567 np0000001613 nova-compute[98321]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:09:21.358567 np0000001613 nova-compute[98321]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:21.358567 np0000001613 nova-compute[98321]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:21.358567 np0000001613 nova-compute[98321]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6651cabf-3fbc-4423-9ae7-01fa2dbbf5c5 (non-flash)
May 28 10:09:21.358567 np0000001613 nova-compute[98321]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6651cabf-3fbc-4423-9ae7-01fa2dbbf5c5 (non-flash)
May 28 10:09:21.358567 np0000001613 nova-compute[98321]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c4baa7e-d209-4c65-b1fd-00d38dcc5a01 (non-flash)
May 28 10:09:21.358567 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:09:21.358904 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b', '123'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b', '124'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0', '128'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0', '129'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6651cabf-3fbc-4423-9ae7-01fa2dbbf5c5', '130'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6651cabf-3fbc-4423-9ae7-01fa2dbbf5c5', '131'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c4baa7e-d209-4c65-b1fd-00d38dcc5a01', '132')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:09:21.358904 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b', '124')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:09:21.360412 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b', '123')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:09:21.361533 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc391bc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b'): ({'sdd'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:09:21.361928 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Removing multipathed devices sdd, sde {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:09:21.362220 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Flush multipath device 3300000006f417ccb {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:09:21.410010 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:09:21.467313 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:09:21.519535 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:09:21.519738 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:09:21.520960 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:09:21.536031 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:09:21.536383 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:09:21.552573 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:21.561134 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Updating instance_info_cache with network_info: [{"id": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "address": "fa:16:3e:5c:9e:66", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb80648-bd", "ovs_interfaceid": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:09:21.593993 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 124, target: iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b, portal: 192.168.40.100,3260]
May 28 10:09:21.593993 np0000001613 nova-compute[98321]: Logout of [sid: 124, target: iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b, portal: 192.168.40.100,3260] successful.
May 28 10:09:21.593993 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:21.617972 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:21.636340 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:21.678242 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 123, target: iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b, portal: 192.168.50.100,3260]
May 28 10:09:21.678242 np0000001613 nova-compute[98321]: Logout of [sid: 123, target: iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b, portal: 192.168.50.100,3260] successful.
May 28 10:09:21.678242 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:21.703751 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:21.703751 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:09:21.703751 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] <== disconnect_volume: return (395ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:09:21.703751 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:09:21.708342 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Start _get_guest_xml network_info=[{"id": "fca4901d-c1d5-4b95-8e64-2d88cd94725f", "address": "fa:16:3e:51:37:8d", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca4901d-c1", "ovs_interfaceid": "fca4901d-c1d5-4b95-8e64-2d88cd94725f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, 'status': 'reserved', 'instance': 'ca57808c-4f51-4a26-8724-d28394efab9f', 'attached_at': '', 'detached_at': '', 'volume_id': '7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 'serial': '7c1c1ea0-2af9-4573-95bb-c79b28880b7b'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'a49bdb8a-6bee-41bb-b2c1-5050acd4e7d9', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:09:21.712642 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:09:21.714683 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1045213354', uuid='ca57808c-4f51-4a26-8724-d28394efab9f'), owner=OwnerMeta(userid='ec58233d3b2848bbb2e0b00650398cd1', username='tempest-TestVolumeBootPattern-327944304-project-member', projectid='23e9651268114327a9cc6c6c59bef01e', projectname='tempest-TestVolumeBootPattern-327944304'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fca4901d-c1d5-4b95-8e64-2d88cd94725f", "address": "fa:16:3e:51:37:8d", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca4901d-c1", "ovs_interfaceid": "fca4901d-c1d5-4b95-8e64-2d88cd94725f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962961.7142634) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:09:21.719652 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:09:21.719652 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:09:21.720585 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:09:21.721012 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:09:21.722304 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:09:21.722989 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:09:21.723609 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:09:21.723609 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:09:21.723883 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:09:21.724087 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:09:21.724270 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:09:21.724488 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:09:21.724617 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:09:21.724726 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:09:21.725073 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:09:21.725431 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:09:21.725702 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lazy-loading 'vcpu_model' on Instance uuid ca57808c-4f51-4a26-8724-d28394efab9f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:09:22.063907 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Releasing lock "refresh_cache-edd8dcff-3440-445a-b4a2-8c56863e7ca3" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:09:22.064270 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Instance network_info: |[{"id": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "address": "fa:16:3e:5c:9e:66", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb80648-bd", "ovs_interfaceid": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:09:22.067361 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Start _get_guest_xml network_info=[{"id": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "address": "fa:16:3e:5c:9e:66", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb80648-bd", "ovs_interfaceid": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:09:22.073178 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:09:22.074690 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1080199311', uuid='edd8dcff-3440-445a-b4a2-8c56863e7ca3'), owner=OwnerMeta(userid='961948be669c4a18a29398d53015f03b', username='tempest-TestEncryptedCinderVolumes-297752033-project-member', projectid='c7563a83d33d4bc1a6610ccf53c18dc1', projectname='tempest-TestEncryptedCinderVolumes-297752033'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "address": "fa:16:3e:5c:9e:66", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb80648-bd", "ovs_interfaceid": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962962.0743034) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:09:22.076326 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:09:22.076716 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:09:22.080031 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:09:22.080290 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:09:22.081652 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:09:22.081652 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:09:22.082249 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:09:22.082249 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:09:22.082249 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:09:22.082249 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:09:22.082619 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:09:22.082619 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:09:22.082619 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:09:22.082771 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:09:22.084353 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:09:22.084353 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:09:22.098494 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:09:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1080199311',display_name='tempest-TestEncryptedCinderVolumes-server-1080199311',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testencryptedcindervolumes-server-1080199311',id=55,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPEA8+uxSyCsgS6j+focPk4QpOVZVeAFK2kV4ErBJfCH5RkIc3vXvdGbsr44pZ3e0kq61KVrhwaHdQPmC2IB37UUcRSn+zMS1bh2okKRJrj9i8mJQASjzRzDfrAxUyWcQ==',key_name='tempest-keypair-831862139',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7563a83d33d4bc1a6610ccf53c18dc1',ramdisk_id='',reservation_id='r-34tgbqip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-297752033',owner_user_name='tempest-TestEncryptedCinderVolumes-297752033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:09:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='961948be669c4a18a29398d53015f03b',uuid=edd8dcff-3440-445a-b4a2-8c56863e7ca3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "address": "fa:16:3e:5c:9e:66", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb80648-bd", "ovs_interfaceid": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:09:22.098494 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Converting VIF {"id": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "address": "fa:16:3e:5c:9e:66", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb80648-bd", "ovs_interfaceid": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:09:22.099408 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:9e:66,bridge_name='br-int',has_traffic_filtering=True,id=6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb80648-bd') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:09:22.099639 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lazy-loading 'pci_devices' on Instance uuid edd8dcff-3440-445a-b4a2-8c56863e7ca3 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:09:22.182372 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0017400340002495795 future=<Future at 0x73c1fc35fbc0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:09:22.182958 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Emitting event <LifecycleEvent: 1779962947.1805208, e4215271-8b48-4661-bc06-eb3f276c2b80 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:09:22.183176 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] VM Stopped (Lifecycle Event)
May 28 10:09:22.185802 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:09:22.186001 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=5.921305586000017 future=<Future at 0x73c1f43538c0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:09:22.186759 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=5.920528921000368 future=<Future at 0x73c1f43538c0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:09:22.229864 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Object Instance<ca57808c-4f51-4a26-8724-d28394efab9f> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:09:22.244157 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca57808c-4f51-4a26-8724-d28394efab9f/disk.config --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:09:22.369468 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca57808c-4f51-4a26-8724-d28394efab9f/disk.config --force-share --output=json" returned: 0 in 0.125s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:09:22.369975 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "/opt/stack/data/nova/instances/ca57808c-4f51-4a26-8724-d28394efab9f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:22.370031 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "/opt/stack/data/nova/instances/ca57808c-4f51-4a26-8724-d28394efab9f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:22.371060 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "/opt/stack/data/nova/instances/ca57808c-4f51-4a26-8724-d28394efab9f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:22.371544 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:09:22.372101 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:09:22.372231 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:09:22.375729 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:09:22.376106 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:09:22.393323 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:09:22.394666 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:09:22.395185 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:09:22.395622 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:09:22.396482 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:09:22.402311 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:09:22.419517 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:09:22.419517 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:22.426363 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:09:22.426363 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:22.438037 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b] added
May 28 10:09:22.438037 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:09:22.438037 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:09:22.438037 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:09:22.438037 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:09:22.438037 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:09:22.438037 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:22.438762 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:09:22.438762 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0431(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:09:22.438910 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:09:22.443709 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b] added
May 28 10:09:22.443709 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:09:22.443709 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:09:22.443709 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:09:22.443709 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:09:22.443709 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:09:22.443709 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:22.444202 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:09:22.444202 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0472(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:09:22.444341 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:09:22.607847 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] End _get_guest_xml xml=<domain type="qemu">
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:   <uuid>edd8dcff-3440-445a-b4a2-8c56863e7ca3</uuid>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:   <name>instance-00000037</name>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1080199311</nova:name>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:09:22</nova:creationTime>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:         <nova:user uuid="961948be669c4a18a29398d53015f03b">tempest-TestEncryptedCinderVolumes-297752033-project-member</nova:user>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:         <nova:project uuid="c7563a83d33d4bc1a6610ccf53c18dc1">tempest-TestEncryptedCinderVolumes-297752033</nova:project>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:         <nova:port uuid="6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc">
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:     <system>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:       <entry name="serial">edd8dcff-3440-445a-b4a2-8c56863e7ca3</entry>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:       <entry name="uuid">edd8dcff-3440-445a-b4a2-8c56863e7ca3</entry>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:     </system>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:   <os>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:   </os>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:   <features>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:   </features>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:   <devices>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk"/>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:     </disk>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk.config"/>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:     </disk>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:5c:9e:66"/>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:       <target dev="tap6eb80648-bd"/>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:     </interface>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/console.log" append="off"/>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:     </serial>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:     <video>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:     </video>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:     </rng>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:   </devices>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]: </domain>
May 28 10:09:22.607847 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:09:22.607847 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Preparing to wait for external event network-vif-plugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:09:22.607847 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:22.607847 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:22.607847 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:22.610221 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:09:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1080199311',display_name='tempest-TestEncryptedCinderVolumes-server-1080199311',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testencryptedcindervolumes-server-1080199311',id=55,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPEA8+uxSyCsgS6j+focPk4QpOVZVeAFK2kV4ErBJfCH5RkIc3vXvdGbsr44pZ3e0kq61KVrhwaHdQPmC2IB37UUcRSn+zMS1bh2okKRJrj9i8mJQASjzRzDfrAxUyWcQ==',key_name='tempest-keypair-831862139',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7563a83d33d4bc1a6610ccf53c18dc1',ramdisk_id='',reservation_id='r-34tgbqip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-297752033',owner_user_name='tempest-TestEncryptedCinderVolumes-297752033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:09:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='961948be669c4a18a29398d53015f03b',uuid=edd8dcff-3440-445a-b4a2-8c56863e7ca3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "address": "fa:16:3e:5c:9e:66", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb80648-bd", "ovs_interfaceid": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:09:22.610221 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Converting VIF {"id": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "address": "fa:16:3e:5c:9e:66", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb80648-bd", "ovs_interfaceid": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:09:22.610221 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:9e:66,bridge_name='br-int',has_traffic_filtering=True,id=6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb80648-bd') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:09:22.610221 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:9e:66,bridge_name='br-int',has_traffic_filtering=True,id=6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb80648-bd') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:09:22.610413 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:22.610691 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:09:22.610996 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:09:22.613099 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:22.613655 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4e5d4490-3b21-57fb-832b-c708b9cf403f', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:09:22.614770 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:22.615715 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:09:22.615990 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:22.619754 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:22.620126 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6eb80648-bd, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:09:22.620693 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6eb80648-bd, col_values=(('qos', UUID('7005c000-9c59-4d79-8b26-4e258609c3f3')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:09:22.620944 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6eb80648-bd, col_values=(('external_ids', {'iface-id': '6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:9e:66', 'vm-uuid': 'edd8dcff-3440-445a-b4a2-8c56863e7ca3'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:09:22.622212 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:22.623712 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:09:22.628762 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:22.630253 np0000001613 nova-compute[98321]: INFO os_vif [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:9e:66,bridge_name='br-int',has_traffic_filtering=True,id=6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb80648-bd')
May 28 10:09:22.688073 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: e4215271-8b48-4661-bc06-eb3f276c2b80] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:09:23.440901 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:09:23.449560 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:09:23.467071 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:09:23.467071 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:09:23.477995 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:09:23.477995 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:23.487222 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:23.502648 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:23.517635 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:23.517635 np0000001613 nova-compute[98321]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:23.517635 np0000001613 nova-compute[98321]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6651cabf-3fbc-4423-9ae7-01fa2dbbf5c5 (non-flash)
May 28 10:09:23.517635 np0000001613 nova-compute[98321]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6651cabf-3fbc-4423-9ae7-01fa2dbbf5c5 (non-flash)
May 28 10:09:23.517635 np0000001613 nova-compute[98321]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c4baa7e-d209-4c65-b1fd-00d38dcc5a01 (non-flash)
May 28 10:09:23.517635 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:09:23.517886 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:23.517886 np0000001613 nova-compute[98321]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:23.517886 np0000001613 nova-compute[98321]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6651cabf-3fbc-4423-9ae7-01fa2dbbf5c5 (non-flash)
May 28 10:09:23.517886 np0000001613 nova-compute[98321]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6651cabf-3fbc-4423-9ae7-01fa2dbbf5c5 (non-flash)
May 28 10:09:23.517886 np0000001613 nova-compute[98321]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c4baa7e-d209-4c65-b1fd-00d38dcc5a01 (non-flash)
May 28 10:09:23.517886 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:09:23.529488 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:23.529488 np0000001613 nova-compute[98321]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:23.529488 np0000001613 nova-compute[98321]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6651cabf-3fbc-4423-9ae7-01fa2dbbf5c5 (non-flash)
May 28 10:09:23.529488 np0000001613 nova-compute[98321]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6651cabf-3fbc-4423-9ae7-01fa2dbbf5c5 (non-flash)
May 28 10:09:23.529488 np0000001613 nova-compute[98321]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c4baa7e-d209-4c65-b1fd-00d38dcc5a01 (non-flash)
May 28 10:09:23.529488 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:09:23.529654 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:23.529654 np0000001613 nova-compute[98321]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:23.529654 np0000001613 nova-compute[98321]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6651cabf-3fbc-4423-9ae7-01fa2dbbf5c5 (non-flash)
May 28 10:09:23.529654 np0000001613 nova-compute[98321]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6651cabf-3fbc-4423-9ae7-01fa2dbbf5c5 (non-flash)
May 28 10:09:23.529654 np0000001613 nova-compute[98321]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c4baa7e-d209-4c65-b1fd-00d38dcc5a01 (non-flash)
May 28 10:09:23.529654 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:09:23.569025 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b, portal: 192.168.50.100,3260]
May 28 10:09:23.569025 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b, portal: 192.168.50.100,3260] successful.
May 28 10:09:23.569025 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:23.578840 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b, portal: 192.168.40.100,3260]
May 28 10:09:23.578840 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b, portal: 192.168.40.100,3260] successful.
May 28 10:09:23.578840 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:23.585963 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:23.593498 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:23.604349 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:23.604349 np0000001613 nova-compute[98321]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:23.604349 np0000001613 nova-compute[98321]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6651cabf-3fbc-4423-9ae7-01fa2dbbf5c5 (non-flash)
May 28 10:09:23.604349 np0000001613 nova-compute[98321]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6651cabf-3fbc-4423-9ae7-01fa2dbbf5c5 (non-flash)
May 28 10:09:23.604349 np0000001613 nova-compute[98321]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c4baa7e-d209-4c65-b1fd-00d38dcc5a01 (non-flash)
May 28 10:09:23.604349 np0000001613 nova-compute[98321]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:09:23.604349 np0000001613 nova-compute[98321]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:09:23.604349 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:09:23.604349 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:23.604349 np0000001613 nova-compute[98321]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:23.604349 np0000001613 nova-compute[98321]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6651cabf-3fbc-4423-9ae7-01fa2dbbf5c5 (non-flash)
May 28 10:09:23.604349 np0000001613 nova-compute[98321]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6651cabf-3fbc-4423-9ae7-01fa2dbbf5c5 (non-flash)
May 28 10:09:23.604349 np0000001613 nova-compute[98321]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c4baa7e-d209-4c65-b1fd-00d38dcc5a01 (non-flash)
May 28 10:09:23.604349 np0000001613 nova-compute[98321]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:09:23.604349 np0000001613 nova-compute[98321]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:09:23.604349 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:09:23.606416 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.209s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:09:23.606416 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:09:23.606416 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] HCTL ('9', '-', '-', 0) found on session 133 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:09:23.606416 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:09:23.612737 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:23.612737 np0000001613 nova-compute[98321]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:23.612737 np0000001613 nova-compute[98321]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6651cabf-3fbc-4423-9ae7-01fa2dbbf5c5 (non-flash)
May 28 10:09:23.612737 np0000001613 nova-compute[98321]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6651cabf-3fbc-4423-9ae7-01fa2dbbf5c5 (non-flash)
May 28 10:09:23.612737 np0000001613 nova-compute[98321]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c4baa7e-d209-4c65-b1fd-00d38dcc5a01 (non-flash)
May 28 10:09:23.612737 np0000001613 nova-compute[98321]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:09:23.612737 np0000001613 nova-compute[98321]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:09:23.612737 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:09:23.612737 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:23.612737 np0000001613 nova-compute[98321]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:23.612737 np0000001613 nova-compute[98321]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6651cabf-3fbc-4423-9ae7-01fa2dbbf5c5 (non-flash)
May 28 10:09:23.612737 np0000001613 nova-compute[98321]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6651cabf-3fbc-4423-9ae7-01fa2dbbf5c5 (non-flash)
May 28 10:09:23.612737 np0000001613 nova-compute[98321]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c4baa7e-d209-4c65-b1fd-00d38dcc5a01 (non-flash)
May 28 10:09:23.612737 np0000001613 nova-compute[98321]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:09:23.612737 np0000001613 nova-compute[98321]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:09:23.612737 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:09:23.612737 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.217s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:09:23.613254 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:09:23.613783 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] HCTL ('10', '-', '-', 0) found on session 134 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:09:23.613931 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:09:23.625898 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching for a device in session 133 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:09:23.626231 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:09:23.634645 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching for a device in session 134 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:09:23.634715 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:09:23.866873 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Acquiring lock "f42f06fc-5b0c-4973-98db-cd594815f317" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:23.867079 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "f42f06fc-5b0c-4973-98db-cd594815f317" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:24.155147 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:09:24.156928 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:09:24.156928 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] No VIF found with MAC fa:16:3e:5c:9e:66, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:09:24.157948 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Using config drive
May 28 10:09:24.372920 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:09:24.395017 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:09:24.667029 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:09:24.735266 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:24.784062 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Creating config drive at /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk.config
May 28 10:09:24.788071 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptdurqwhn {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:09:24.842478 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptdurqwhn" returned: 0 in 0.054s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:09:24.952054 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:24.952468 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:24.960051 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:09:24.960051 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Claim successful on node np0000001613
May 28 10:09:25.345489 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:25.377307 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:25.426694 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Found WWN 3300000006f417ccb for multipath device dm-2 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:09:25.426694 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.050s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:09:25.426694 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] <== connect_volume: return (3054ms) {'type': 'block', 'scsi_wwn': '3300000006f417ccb', 'path': '/dev/dm-2', 'multipath_id': '3300000006f417ccb'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:09:25.426694 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006f417ccb', 'path': '/dev/dm-2', 'multipath_id': '3300000006f417ccb'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:09:25.499212 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:25.673330 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c905e671-a9a9-4c96-9146-2923cb3006a3 req-c9dbe418-9f4b-4909-9912-89ccc30e9fb5 service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Received event network-vif-plugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:09:25.673875 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c905e671-a9a9-4c96-9146-2923cb3006a3 req-c9dbe418-9f4b-4909-9912-89ccc30e9fb5 service nova] Acquiring lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:25.674037 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c905e671-a9a9-4c96-9146-2923cb3006a3 req-c9dbe418-9f4b-4909-9912-89ccc30e9fb5 service nova] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:25.674873 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c905e671-a9a9-4c96-9146-2923cb3006a3 req-c9dbe418-9f4b-4909-9912-89ccc30e9fb5 service nova] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:25.674873 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c905e671-a9a9-4c96-9146-2923cb3006a3 req-c9dbe418-9f4b-4909-9912-89ccc30e9fb5 service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Processing event network-vif-plugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:09:25.860782 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:25.864186 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:25.864186 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:25.891071 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:25.941320 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:08:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1045213354',display_name='tempest-TestVolumeBootPattern-server-1045213354',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpattern-server-1045213354',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXijNEVpHlU0fcHSajVe0wLb7tE6aVVeudGfxc7rHURQeMUmzIENcCsTLjBsfytzyxfL8Ns1nEjQaGLVbBThbKgoJfLjVwVzizrBq9/Hj7rtGIFoStaV7wwOeDN2YJenw==',key_name='tempest-keypair-161619853',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:08:33Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='23e9651268114327a9cc6c6c59bef01e',ramdisk_id='',reservation_id='r-80yxhf2a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-327944304',owner_user_name='tempest-TestVolumeBootPattern-327944304-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:09:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec58233d3b2848bbb2e0b00650398cd1',uuid=ca57808c-4f51-4a26-8724-d28394efab9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "fca4901d-c1d5-4b95-8e64-2d88cd94725f", "address": "fa:16:3e:51:37:8d", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca4901d-c1", "ovs_interfaceid": "fca4901d-c1d5-4b95-8e64-2d88cd94725f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:09:25.941696 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converting VIF {"id": "fca4901d-c1d5-4b95-8e64-2d88cd94725f", "address": "fa:16:3e:51:37:8d", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca4901d-c1", "ovs_interfaceid": "fca4901d-c1d5-4b95-8e64-2d88cd94725f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:09:25.942492 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:37:8d,bridge_name='br-int',has_traffic_filtering=True,id=fca4901d-c1d5-4b95-8e64-2d88cd94725f,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfca4901d-c1') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:09:25.945574 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lazy-loading 'pci_devices' on Instance uuid ca57808c-4f51-4a26-8724-d28394efab9f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:09:26.229766 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Acquiring lock "c1dea755-6fa1-4d68-8194-2be27b092c1c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:26.229766 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Lock "c1dea755-6fa1-4d68-8194-2be27b092c1c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:26.317708 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:09:26.317708 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:09:26.449300 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Object Instance<ca57808c-4f51-4a26-8724-d28394efab9f> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:09:26.450356 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] End _get_guest_xml xml=<domain type="qemu">
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:   <uuid>ca57808c-4f51-4a26-8724-d28394efab9f</uuid>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:   <name>instance-00000033</name>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:       <nova:name>tempest-TestVolumeBootPattern-server-1045213354</nova:name>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:09:21</nova:creationTime>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:       <nova:image uuid="">
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:         <nova:user uuid="ec58233d3b2848bbb2e0b00650398cd1">tempest-TestVolumeBootPattern-327944304-project-member</nova:user>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:         <nova:project uuid="23e9651268114327a9cc6c6c59bef01e">tempest-TestVolumeBootPattern-327944304</nova:project>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:       <nova:root type="volume" uuid=""/>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:         <nova:port uuid="fca4901d-c1d5-4b95-8e64-2d88cd94725f">
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:     <system>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:       <entry name="serial">ca57808c-4f51-4a26-8724-d28394efab9f</entry>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:       <entry name="uuid">ca57808c-4f51-4a26-8724-d28394efab9f</entry>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:     </system>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:   <os>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:   </os>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:   <features>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:   </features>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:   <devices>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/ca57808c-4f51-4a26-8724-d28394efab9f/disk.config"/>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:     </disk>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:       <alias name="ua-7c1c1ea0-2af9-4573-95bb-c79b28880b7b"/>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-2"/>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:       <serial>7c1c1ea0-2af9-4573-95bb-c79b28880b7b</serial>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:     </disk>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:51:37:8d"/>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:       <target dev="tapfca4901d-c1"/>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:     </interface>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/ca57808c-4f51-4a26-8724-d28394efab9f/console.log" append="off"/>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:     </serial>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:     <video>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:     </video>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:     </rng>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:   </devices>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]: </domain>
May 28 10:09:26.450356 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:09:26.452212 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:09:26.452212 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:08:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1045213354',display_name='tempest-TestVolumeBootPattern-server-1045213354',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpattern-server-1045213354',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXijNEVpHlU0fcHSajVe0wLb7tE6aVVeudGfxc7rHURQeMUmzIENcCsTLjBsfytzyxfL8Ns1nEjQaGLVbBThbKgoJfLjVwVzizrBq9/Hj7rtGIFoStaV7wwOeDN2YJenw==',key_name='tempest-keypair-161619853',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:08:33Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='23e9651268114327a9cc6c6c59bef01e',ramdisk_id='',reservation_id='r-80yxhf2a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-327944304',owner_user_name='tempest-TestVolumeBootPattern-327944304-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:09:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec58233d3b2848bbb2e0b00650398cd1',uuid=ca57808c-4f51-4a26-8724-d28394efab9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "fca4901d-c1d5-4b95-8e64-2d88cd94725f", "address": "fa:16:3e:51:37:8d", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca4901d-c1", "ovs_interfaceid": "fca4901d-c1d5-4b95-8e64-2d88cd94725f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:09:26.452212 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converting VIF {"id": "fca4901d-c1d5-4b95-8e64-2d88cd94725f", "address": "fa:16:3e:51:37:8d", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca4901d-c1", "ovs_interfaceid": "fca4901d-c1d5-4b95-8e64-2d88cd94725f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:09:26.454692 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:37:8d,bridge_name='br-int',has_traffic_filtering=True,id=fca4901d-c1d5-4b95-8e64-2d88cd94725f,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfca4901d-c1') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:09:26.455135 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:09:26.455578 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:37:8d,bridge_name='br-int',has_traffic_filtering=True,id=fca4901d-c1d5-4b95-8e64-2d88cd94725f,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfca4901d-c1') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:09:26.456195 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962966.455219, edd8dcff-3440-445a-b4a2-8c56863e7ca3 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:09:26.456519 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] VM Started (Lifecycle Event)
May 28 10:09:26.458704 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:26.460384 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:09:26.460384 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:09:26.460384 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:09:26.460828 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:26.461223 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3d27e4b4-aba2-5bce-8484-e35d02f4e98c', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:09:26.462013 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:26.462577 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:09:26.463714 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:26.464193 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Instance spawned successfully.
May 28 10:09:26.467932 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:09:26.468779 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:26.468832 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfca4901d-c1, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:09:26.469291 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfca4901d-c1, col_values=(('qos', UUID('f9f881e3-82f5-4e0d-b9c1-6d24a0157b42')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:09:26.469719 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfca4901d-c1, col_values=(('external_ids', {'iface-id': 'fca4901d-c1d5-4b95-8e64-2d88cd94725f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:37:8d', 'vm-uuid': 'ca57808c-4f51-4a26-8724-d28394efab9f'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:09:26.470580 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:26.472106 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:09:26.479982 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:26.481007 np0000001613 nova-compute[98321]: INFO os_vif [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:37:8d,bridge_name='br-int',has_traffic_filtering=True,id=fca4901d-c1d5-4b95-8e64-2d88cd94725f,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfca4901d-c1')
May 28 10:09:26.733190 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:09:26.820316 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:09:26.959061 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:09:26.962411 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:09:26.976238 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:09:26.976379 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:09:26.976683 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:09:26.976917 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:09:26.977158 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:09:26.977446 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:09:27.018876 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:27.049911 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:27.174259 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:27.262811 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-078f8e8b-c340-4706-8cb3-245e8255c199 req-79c265a0-8754-4361-95ea-e03299b96f30 service nova] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Received event network-vif-plugged-fca4901d-c1d5-4b95-8e64-2d88cd94725f {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:09:27.267145 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-078f8e8b-c340-4706-8cb3-245e8255c199 req-79c265a0-8754-4361-95ea-e03299b96f30 service nova] Acquiring lock "ca57808c-4f51-4a26-8724-d28394efab9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:27.267396 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-078f8e8b-c340-4706-8cb3-245e8255c199 req-79c265a0-8754-4361-95ea-e03299b96f30 service nova] Lock "ca57808c-4f51-4a26-8724-d28394efab9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:27.267476 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-078f8e8b-c340-4706-8cb3-245e8255c199 req-79c265a0-8754-4361-95ea-e03299b96f30 service nova] Lock "ca57808c-4f51-4a26-8724-d28394efab9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:27.269694 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-078f8e8b-c340-4706-8cb3-245e8255c199 req-79c265a0-8754-4361-95ea-e03299b96f30 service nova] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] No waiting events found dispatching network-vif-plugged-fca4901d-c1d5-4b95-8e64-2d88cd94725f {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:09:27.271018 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-078f8e8b-c340-4706-8cb3-245e8255c199 req-79c265a0-8754-4361-95ea-e03299b96f30 service nova] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Received unexpected event network-vif-plugged-fca4901d-c1d5-4b95-8e64-2d88cd94725f for instance with vm_state stopped and task_state powering-on.
May 28 10:09:27.315961 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:27.337878 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.385s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:27.338568 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:09:27.341959 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.026s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:27.349127 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:09:27.350480 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Claim successful on node np0000001613
May 28 10:09:27.470341 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:09:27.470701 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962967.4704003, edd8dcff-3440-445a-b4a2-8c56863e7ca3 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:09:27.470701 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] VM Paused (Lifecycle Event)
May 28 10:09:27.482198 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Took 7.83 seconds to spawn the instance on the hypervisor.
May 28 10:09:27.482594 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:09:27.502983 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:27.506342 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:27.506342 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:27.530524 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:27.769280 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7c938694-8cee-4b91-9948-5f1c7fae45c8 req-44b49724-d237-4b41-ac02-36e17c15d078 service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Received event network-vif-plugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:09:27.769638 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7c938694-8cee-4b91-9948-5f1c7fae45c8 req-44b49724-d237-4b41-ac02-36e17c15d078 service nova] Acquiring lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:27.769638 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7c938694-8cee-4b91-9948-5f1c7fae45c8 req-44b49724-d237-4b41-ac02-36e17c15d078 service nova] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:27.770310 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7c938694-8cee-4b91-9948-5f1c7fae45c8 req-44b49724-d237-4b41-ac02-36e17c15d078 service nova] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:27.770310 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7c938694-8cee-4b91-9948-5f1c7fae45c8 req-44b49724-d237-4b41-ac02-36e17c15d078 service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] No waiting events found dispatching network-vif-plugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:09:27.770310 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-7c938694-8cee-4b91-9948-5f1c7fae45c8 req-44b49724-d237-4b41-ac02-36e17c15d078 service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Received unexpected event network-vif-plugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc for instance with vm_state active and task_state None.
May 28 10:09:27.850126 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:09:27.850412 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:09:27.850775 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:09:27.851094 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:09:27.973865 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:09:27.980877 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962967.9800591, edd8dcff-3440-445a-b4a2-8c56863e7ca3 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:09:27.981286 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] VM Resumed (Lifecycle Event)
May 28 10:09:27.998330 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cda3cde4813d436b9f875ba96f496882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba63ea134a6e4fe1992f53a0da46d034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:09:27.998330 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Instance event wait completed in 0 seconds for  {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:09:28.006137 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Took 13.21 seconds to build instance.
May 28 10:09:28.014494 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Instance rebooted successfully.
May 28 10:09:28.108665 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.001347503000033612 future=<Future at 0x73c1f43538c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:09:28.109301 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Emitting event <LifecycleEvent: 1779962953.1072276, 9106964d-dcd7-4628-9cd7-c09b0739e749 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:09:28.109446 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] VM Stopped (Lifecycle Event)
May 28 10:09:28.110469 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:09:28.110883 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=0.5923239070002637 future=<Future at 0x73c1f4208ad0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:09:28.110883 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=0.5922113480000917 future=<Future at 0x73c1f4208ad0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:09:28.354600 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:09:28.485211 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:09:28.497252 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:09:28.514156 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d0328cb6-e524-4ba8-b085-5bb3634d1fd5 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.729s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:28.613346 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: 9106964d-dcd7-4628-9cd7-c09b0739e749] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:09:28.624685 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Successfully created port: 58c8c13b-5e85-402b-9c1b-900748ac5b1a {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:09:28.703422 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.00038059999997130944 future=<Future at 0x73c1f4208ad0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:09:28.704681 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Emitting event <LifecycleEvent: 1779962953.702957, ca57808c-4f51-4a26-8724-d28394efab9f => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:09:28.707843 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:09:28.707843 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] VM Stopped (Lifecycle Event)
May 28 10:09:28.723560 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:09:28.723734 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:09:28.859886 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:09:29.001964 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Removed pending STOPPED event for ca57808c-4f51-4a26-8724-d28394efab9f due to new event <LifecycleEvent: 1779962969.0016227, ca57808c-4f51-4a26-8724-d28394efab9f => Resumed> {{(pid=98321) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 10:09:29.002911 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962969.0016227, ca57808c-4f51-4a26-8724-d28394efab9f => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:09:29.003534 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] VM Resumed (Lifecycle Event)
May 28 10:09:29.210752 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:09:29.226981 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:09:29.291753 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Successfully updated port: 58c8c13b-5e85-402b-9c1b-900748ac5b1a {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:09:29.363822 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b3821a3a-e365-476b-8311-6538e6637fde req-354c1c37-e51d-46fc-9e56-a9df92fa88aa service nova] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Received event network-changed-58c8c13b-5e85-402b-9c1b-900748ac5b1a {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:09:29.367038 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b3821a3a-e365-476b-8311-6538e6637fde req-354c1c37-e51d-46fc-9e56-a9df92fa88aa service nova] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Refreshing instance network info cache due to event network-changed-58c8c13b-5e85-402b-9c1b-900748ac5b1a. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:09:29.367038 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b3821a3a-e365-476b-8311-6538e6637fde req-354c1c37-e51d-46fc-9e56-a9df92fa88aa service nova] Acquiring lock "refresh_cache-f42f06fc-5b0c-4973-98db-cd594815f317" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:09:29.367038 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b3821a3a-e365-476b-8311-6538e6637fde req-354c1c37-e51d-46fc-9e56-a9df92fa88aa service nova] Acquired lock "refresh_cache-f42f06fc-5b0c-4973-98db-cd594815f317" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:09:29.367038 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-b3821a3a-e365-476b-8311-6538e6637fde req-354c1c37-e51d-46fc-9e56-a9df92fa88aa service nova] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Refreshing network info cache for port 58c8c13b-5e85-402b-9c1b-900748ac5b1a {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:09:29.378176 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b2cb34bc-6f05-4b9d-8342-4a992d12eb8d req-6a21f44f-df7d-45ec-b5c3-a64ff8e2996c service nova] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Received event network-vif-plugged-fca4901d-c1d5-4b95-8e64-2d88cd94725f {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:09:29.379482 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b2cb34bc-6f05-4b9d-8342-4a992d12eb8d req-6a21f44f-df7d-45ec-b5c3-a64ff8e2996c service nova] Acquiring lock "ca57808c-4f51-4a26-8724-d28394efab9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:29.379660 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b2cb34bc-6f05-4b9d-8342-4a992d12eb8d req-6a21f44f-df7d-45ec-b5c3-a64ff8e2996c service nova] Lock "ca57808c-4f51-4a26-8724-d28394efab9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:29.379785 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b2cb34bc-6f05-4b9d-8342-4a992d12eb8d req-6a21f44f-df7d-45ec-b5c3-a64ff8e2996c service nova] Lock "ca57808c-4f51-4a26-8724-d28394efab9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:29.380525 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b2cb34bc-6f05-4b9d-8342-4a992d12eb8d req-6a21f44f-df7d-45ec-b5c3-a64ff8e2996c service nova] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] No waiting events found dispatching network-vif-plugged-fca4901d-c1d5-4b95-8e64-2d88cd94725f {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:09:29.380525 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-b2cb34bc-6f05-4b9d-8342-4a992d12eb8d req-6a21f44f-df7d-45ec-b5c3-a64ff8e2996c service nova] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Received unexpected event network-vif-plugged-fca4901d-c1d5-4b95-8e64-2d88cd94725f for instance with vm_state stopped and task_state powering-on.
May 28 10:09:29.508663 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:09:29.511618 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:09:29.525483 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:09:29.525667 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:09:29.525825 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] No VIF found with MAC fa:16:3e:51:37:8d, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:09:29.526201 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-4fa16e97-e7e7-477e-b9d2-1fd21b2f4d05 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:09:29.739053 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.397s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:29.739388 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:09:29.741536 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:29.794617 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Acquiring lock "refresh_cache-f42f06fc-5b0c-4973-98db-cd594815f317" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:09:29.852629 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-046ba30f-fde0-41d8-928b-d33e8931632c req-309924cc-6012-4f70-b1a1-e3d678466bb7 service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Received event network-changed-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:09:29.852792 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-046ba30f-fde0-41d8-928b-d33e8931632c req-309924cc-6012-4f70-b1a1-e3d678466bb7 service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Refreshing instance network info cache due to event network-changed-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:09:29.852935 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-046ba30f-fde0-41d8-928b-d33e8931632c req-309924cc-6012-4f70-b1a1-e3d678466bb7 service nova] Acquiring lock "refresh_cache-edd8dcff-3440-445a-b4a2-8c56863e7ca3" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:09:29.853046 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-046ba30f-fde0-41d8-928b-d33e8931632c req-309924cc-6012-4f70-b1a1-e3d678466bb7 service nova] Acquired lock "refresh_cache-edd8dcff-3440-445a-b4a2-8c56863e7ca3" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:09:29.853387 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-046ba30f-fde0-41d8-928b-d33e8931632c req-309924cc-6012-4f70-b1a1-e3d678466bb7 service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Refreshing network info cache for port 6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:09:29.869381 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-b3821a3a-e365-476b-8311-6538e6637fde req-354c1c37-e51d-46fc-9e56-a9df92fa88aa service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:09:29.882326 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:09:29.883799 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:09:29.884077 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Creating image(s)
May 28 10:09:29.884965 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Acquiring lock "/opt/stack/data/nova/instances/f42f06fc-5b0c-4973-98db-cd594815f317/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:29.885135 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "/opt/stack/data/nova/instances/f42f06fc-5b0c-4973-98db-cd594815f317/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:29.885724 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "/opt/stack/data/nova/instances/f42f06fc-5b0c-4973-98db-cd594815f317/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:29.886300 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:09:29.890188 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:09:29.891583 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:09:29.966303 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-b3821a3a-e365-476b-8311-6538e6637fde req-354c1c37-e51d-46fc-9e56-a9df92fa88aa service nova] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:09:30.000622 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.109s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:09:30.001078 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:30.001705 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:30.002279 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:09:30.005044 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:09:30.005530 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:09:30.021180 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] During sync_power_state the instance has a pending task (powering-on). Skip.
May 28 10:09:30.024574 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962970.0240803, ca57808c-4f51-4a26-8724-d28394efab9f => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:09:30.024784 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] VM Started (Lifecycle Event)
May 28 10:09:30.109549 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.104s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:09:30.110311 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/f42f06fc-5b0c-4973-98db-cd594815f317/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:09:30.172751 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/f42f06fc-5b0c-4973-98db-cd594815f317/disk 1073741824" returned: 0 in 0.062s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:09:30.173909 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.172s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:30.173909 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:09:30.227003 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-b3821a3a-e365-476b-8311-6538e6637fde req-354c1c37-e51d-46fc-9e56-a9df92fa88aa service nova] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:09:30.249484 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:09:30.250669 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:09:30.251226 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:09:30.251620 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:09:30.278414 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.105s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:09:30.279123 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f42f06fc-5b0c-4973-98db-cd594815f317/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:09:30.279379 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f42f06fc-5b0c-4973-98db-cd594815f317/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:09:30.310783 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-323c989f-f8c0-4892-bc7d-91af080d23bd tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Get console output
May 28 10:09:30.325187 np0000001613 nova-compute[98321]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
May 28 10:09:30.356201 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-046ba30f-fde0-41d8-928b-d33e8931632c req-309924cc-6012-4f70-b1a1-e3d678466bb7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:09:30.383766 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f42f06fc-5b0c-4973-98db-cd594815f317/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:09:30.385133 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Cannot resize image /opt/stack/data/nova/instances/f42f06fc-5b0c-4973-98db-cd594815f317/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:09:30.385512 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:09:30.385774 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Ensure instance console log exists: /opt/stack/data/nova/instances/f42f06fc-5b0c-4973-98db-cd594815f317/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:09:30.386071 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:30.386313 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:30.386471 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:30.441981 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '417c73d8573343ff9c70590f66edd97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18b97e2d5d4fa8a51e19e79cde82c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:09:30.533243 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:09:30.538696 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:09:30.731463 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b3821a3a-e365-476b-8311-6538e6637fde req-354c1c37-e51d-46fc-9e56-a9df92fa88aa service nova] Releasing lock "refresh_cache-f42f06fc-5b0c-4973-98db-cd594815f317" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:09:30.732188 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Acquired lock "refresh_cache-f42f06fc-5b0c-4973-98db-cd594815f317" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:09:30.732485 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:09:30.753533 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-046ba30f-fde0-41d8-928b-d33e8931632c req-309924cc-6012-4f70-b1a1-e3d678466bb7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:09:30.753533 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:09:30.964204 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-046ba30f-fde0-41d8-928b-d33e8931632c req-309924cc-6012-4f70-b1a1-e3d678466bb7 service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Updated VIF entry in instance network info cache for port 6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:09:30.964642 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-046ba30f-fde0-41d8-928b-d33e8931632c req-309924cc-6012-4f70-b1a1-e3d678466bb7 service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Updating instance_info_cache with network_info: [{"id": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "address": "fa:16:3e:5c:9e:66", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb80648-bd", "ovs_interfaceid": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:09:31.170109 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Successfully created port: 6c9f4569-56c8-4b49-9988-36f94a6a1bf0 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:09:31.263523 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:09:31.339242 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:09:31.472005 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-046ba30f-fde0-41d8-928b-d33e8931632c req-309924cc-6012-4f70-b1a1-e3d678466bb7 service nova] Releasing lock "refresh_cache-edd8dcff-3440-445a-b4a2-8c56863e7ca3" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:09:31.474411 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:31.514854 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:09:31.687857 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Updating instance_info_cache with network_info: [{"id": "58c8c13b-5e85-402b-9c1b-900748ac5b1a", "address": "fa:16:3e:33:fb:de", "network": {"id": "233ff488-7baf-4369-9054-b24499b82bab", "bridge": "br-int", "label": "tempest-TestStampPattern-854727558-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba63ea134a6e4fe1992f53a0da46d034", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c8c13b-5e", "ovs_interfaceid": "58c8c13b-5e85-402b-9c1b-900748ac5b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:09:31.769788 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Successfully updated port: 6c9f4569-56c8-4b49-9988-36f94a6a1bf0 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:09:31.829063 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4ef88d3d-60e0-47cf-9533-9656678bed94 req-ee2b3e50-2119-4f3c-adad-52416b404a32 service nova] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Received event network-changed-6c9f4569-56c8-4b49-9988-36f94a6a1bf0 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:09:31.829222 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4ef88d3d-60e0-47cf-9533-9656678bed94 req-ee2b3e50-2119-4f3c-adad-52416b404a32 service nova] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Refreshing instance network info cache due to event network-changed-6c9f4569-56c8-4b49-9988-36f94a6a1bf0. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:09:31.829379 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4ef88d3d-60e0-47cf-9533-9656678bed94 req-ee2b3e50-2119-4f3c-adad-52416b404a32 service nova] Acquiring lock "refresh_cache-c1dea755-6fa1-4d68-8194-2be27b092c1c" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:09:31.829490 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4ef88d3d-60e0-47cf-9533-9656678bed94 req-ee2b3e50-2119-4f3c-adad-52416b404a32 service nova] Acquired lock "refresh_cache-c1dea755-6fa1-4d68-8194-2be27b092c1c" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:09:31.829603 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-4ef88d3d-60e0-47cf-9533-9656678bed94 req-ee2b3e50-2119-4f3c-adad-52416b404a32 service nova] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Refreshing network info cache for port 6c9f4569-56c8-4b49-9988-36f94a6a1bf0 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:09:32.192198 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Releasing lock "refresh_cache-f42f06fc-5b0c-4973-98db-cd594815f317" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:09:32.192198 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Instance network_info: |[{"id": "58c8c13b-5e85-402b-9c1b-900748ac5b1a", "address": "fa:16:3e:33:fb:de", "network": {"id": "233ff488-7baf-4369-9054-b24499b82bab", "bridge": "br-int", "label": "tempest-TestStampPattern-854727558-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba63ea134a6e4fe1992f53a0da46d034", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c8c13b-5e", "ovs_interfaceid": "58c8c13b-5e85-402b-9c1b-900748ac5b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:09:32.193085 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Start _get_guest_xml network_info=[{"id": "58c8c13b-5e85-402b-9c1b-900748ac5b1a", "address": "fa:16:3e:33:fb:de", "network": {"id": "233ff488-7baf-4369-9054-b24499b82bab", "bridge": "br-int", "label": "tempest-TestStampPattern-854727558-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba63ea134a6e4fe1992f53a0da46d034", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c8c13b-5e", "ovs_interfaceid": "58c8c13b-5e85-402b-9c1b-900748ac5b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:09:32.196825 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:09:32.199436 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-TestStampPattern-server-1380522586', uuid='f42f06fc-5b0c-4973-98db-cd594815f317'), owner=OwnerMeta(userid='cda3cde4813d436b9f875ba96f496882', username='tempest-TestStampPattern-414594070-project-member', projectid='ba63ea134a6e4fe1992f53a0da46d034', projectname='tempest-TestStampPattern-414594070'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "58c8c13b-5e85-402b-9c1b-900748ac5b1a", "address": "fa:16:3e:33:fb:de", "network": {"id": "233ff488-7baf-4369-9054-b24499b82bab", "bridge": "br-int", "label": "tempest-TestStampPattern-854727558-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba63ea134a6e4fe1992f53a0da46d034", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c8c13b-5e", "ovs_interfaceid": "58c8c13b-5e85-402b-9c1b-900748ac5b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962972.1980135) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:09:32.203402 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:09:32.204659 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:09:32.208420 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:09:32.208760 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:09:32.213509 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:09:32.214589 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:09:32.214834 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:09:32.215944 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:09:32.216124 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:09:32.216268 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:09:32.216406 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:09:32.216634 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:09:32.216935 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:09:32.217102 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:09:32.217230 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:09:32.217399 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:09:32.234192 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:09:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1380522586',display_name='tempest-TestStampPattern-server-1380522586',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-teststamppattern-server-1380522586',id=56,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYM/OccL4UHt9TwzRUM2NoxErdXFvJSjsBY3qW0TdqZb62VjSt3Qhb8ydQXj0m7ruuXson/l4HMWZVUlPSmKQS9NgOeLgHIKDS6cwgmeUrB5A+zdtBT5AYw72WB234Frg==',key_name='tempest-TestStampPattern-550069760',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba63ea134a6e4fe1992f53a0da46d034',ramdisk_id='',reservation_id='r-kno8wxh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-414594070',owner_user_name='tempest-TestStampPattern-414594070-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:09:29Z,user_data=None,user_id='cda3cde4813d436b9f875ba96f496882',uuid=f42f06fc-5b0c-4973-98db-cd594815f317,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58c8c13b-5e85-402b-9c1b-900748ac5b1a", "address": "fa:16:3e:33:fb:de", "network": {"id": "233ff488-7baf-4369-9054-b24499b82bab", "bridge": "br-int", "label": "tempest-TestStampPattern-854727558-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba63ea134a6e4fe1992f53a0da46d034", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c8c13b-5e", "ovs_interfaceid": "58c8c13b-5e85-402b-9c1b-900748ac5b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:09:32.234445 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Converting VIF {"id": "58c8c13b-5e85-402b-9c1b-900748ac5b1a", "address": "fa:16:3e:33:fb:de", "network": {"id": "233ff488-7baf-4369-9054-b24499b82bab", "bridge": "br-int", "label": "tempest-TestStampPattern-854727558-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba63ea134a6e4fe1992f53a0da46d034", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c8c13b-5e", "ovs_interfaceid": "58c8c13b-5e85-402b-9c1b-900748ac5b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:09:32.235040 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:fb:de,bridge_name='br-int',has_traffic_filtering=True,id=58c8c13b-5e85-402b-9c1b-900748ac5b1a,network=Network(233ff488-7baf-4369-9054-b24499b82bab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58c8c13b-5e') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:09:32.235539 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lazy-loading 'pci_devices' on Instance uuid f42f06fc-5b0c-4973-98db-cd594815f317 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:09:32.275416 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:09:32.279961 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Acquiring lock "refresh_cache-c1dea755-6fa1-4d68-8194-2be27b092c1c" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:09:32.282459 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:09:32.283938 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Creating image(s)
May 28 10:09:32.283938 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Acquiring lock "/opt/stack/data/nova/instances/c1dea755-6fa1-4d68-8194-2be27b092c1c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:32.283938 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Lock "/opt/stack/data/nova/instances/c1dea755-6fa1-4d68-8194-2be27b092c1c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:32.285868 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Lock "/opt/stack/data/nova/instances/c1dea755-6fa1-4d68-8194-2be27b092c1c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:32.293187 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:09:32.299021 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:09:32.303190 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:09:32.333618 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-4ef88d3d-60e0-47cf-9533-9656678bed94 req-ee2b3e50-2119-4f3c-adad-52416b404a32 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:09:32.394033 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.094s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:09:32.394557 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:32.395183 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:32.395616 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:09:32.399812 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:09:32.400195 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:09:32.421700 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-4ef88d3d-60e0-47cf-9533-9656678bed94 req-ee2b3e50-2119-4f3c-adad-52416b404a32 service nova] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:09:32.470318 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "ca57808c-4f51-4a26-8724-d28394efab9f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:32.470553 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "ca57808c-4f51-4a26-8724-d28394efab9f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:32.470775 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "ca57808c-4f51-4a26-8724-d28394efab9f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:32.472178 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "ca57808c-4f51-4a26-8724-d28394efab9f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:32.472323 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "ca57808c-4f51-4a26-8724-d28394efab9f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:32.475402 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Terminating instance
May 28 10:09:32.494631 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.094s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:09:32.495065 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/c1dea755-6fa1-4d68-8194-2be27b092c1c/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:09:32.553903 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/c1dea755-6fa1-4d68-8194-2be27b092c1c/disk 1073741824" returned: 0 in 0.059s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:09:32.554373 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.159s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:32.554731 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:09:32.575358 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-4ef88d3d-60e0-47cf-9533-9656678bed94 req-ee2b3e50-2119-4f3c-adad-52416b404a32 service nova] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:09:32.661370 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.106s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:09:32.665181 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c1dea755-6fa1-4d68-8194-2be27b092c1c/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:09:32.665181 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1dea755-6fa1-4d68-8194-2be27b092c1c/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:09:32.740268 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] End _get_guest_xml xml=<domain type="qemu">
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:   <uuid>f42f06fc-5b0c-4973-98db-cd594815f317</uuid>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:   <name>instance-00000038</name>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:       <nova:name>tempest-TestStampPattern-server-1380522586</nova:name>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:09:32</nova:creationTime>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:         <nova:user uuid="cda3cde4813d436b9f875ba96f496882">tempest-TestStampPattern-414594070-project-member</nova:user>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:         <nova:project uuid="ba63ea134a6e4fe1992f53a0da46d034">tempest-TestStampPattern-414594070</nova:project>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:         <nova:port uuid="58c8c13b-5e85-402b-9c1b-900748ac5b1a">
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:     <system>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:       <entry name="serial">f42f06fc-5b0c-4973-98db-cd594815f317</entry>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:       <entry name="uuid">f42f06fc-5b0c-4973-98db-cd594815f317</entry>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:     </system>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:   <os>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:   </os>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:   <features>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:   </features>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:   <devices>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/f42f06fc-5b0c-4973-98db-cd594815f317/disk"/>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:     </disk>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/f42f06fc-5b0c-4973-98db-cd594815f317/disk.config"/>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:     </disk>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:33:fb:de"/>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:       <target dev="tap58c8c13b-5e"/>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:     </interface>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/f42f06fc-5b0c-4973-98db-cd594815f317/console.log" append="off"/>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:     </serial>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:     <video>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:     </video>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:     </rng>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:   </devices>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]: </domain>
May 28 10:09:32.740268 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:09:32.743105 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Preparing to wait for external event network-vif-plugged-58c8c13b-5e85-402b-9c1b-900748ac5b1a {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:09:32.743105 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Acquiring lock "f42f06fc-5b0c-4973-98db-cd594815f317-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:32.743105 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "f42f06fc-5b0c-4973-98db-cd594815f317-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:32.743105 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "f42f06fc-5b0c-4973-98db-cd594815f317-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:32.743105 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:09:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1380522586',display_name='tempest-TestStampPattern-server-1380522586',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-teststamppattern-server-1380522586',id=56,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYM/OccL4UHt9TwzRUM2NoxErdXFvJSjsBY3qW0TdqZb62VjSt3Qhb8ydQXj0m7ruuXson/l4HMWZVUlPSmKQS9NgOeLgHIKDS6cwgmeUrB5A+zdtBT5AYw72WB234Frg==',key_name='tempest-TestStampPattern-550069760',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba63ea134a6e4fe1992f53a0da46d034',ramdisk_id='',reservation_id='r-kno8wxh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-414594070',owner_user_name='tempest-TestStampPattern-414594070-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:09:29Z,user_data=None,user_id='cda3cde4813d436b9f875ba96f496882',uuid=f42f06fc-5b0c-4973-98db-cd594815f317,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58c8c13b-5e85-402b-9c1b-900748ac5b1a", "address": "fa:16:3e:33:fb:de", "network": {"id": "233ff488-7baf-4369-9054-b24499b82bab", "bridge": "br-int", "label": "tempest-TestStampPattern-854727558-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba63ea134a6e4fe1992f53a0da46d034", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c8c13b-5e", "ovs_interfaceid": "58c8c13b-5e85-402b-9c1b-900748ac5b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:09:32.743105 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Converting VIF {"id": "58c8c13b-5e85-402b-9c1b-900748ac5b1a", "address": "fa:16:3e:33:fb:de", "network": {"id": "233ff488-7baf-4369-9054-b24499b82bab", "bridge": "br-int", "label": "tempest-TestStampPattern-854727558-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba63ea134a6e4fe1992f53a0da46d034", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c8c13b-5e", "ovs_interfaceid": "58c8c13b-5e85-402b-9c1b-900748ac5b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:09:32.743718 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:fb:de,bridge_name='br-int',has_traffic_filtering=True,id=58c8c13b-5e85-402b-9c1b-900748ac5b1a,network=Network(233ff488-7baf-4369-9054-b24499b82bab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58c8c13b-5e') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:09:32.743940 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:fb:de,bridge_name='br-int',has_traffic_filtering=True,id=58c8c13b-5e85-402b-9c1b-900748ac5b1a,network=Network(233ff488-7baf-4369-9054-b24499b82bab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58c8c13b-5e') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:09:32.744298 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:32.744642 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:09:32.744929 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:09:32.745840 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:32.746046 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '66366fe0-956b-55e1-9f8c-6c36adf8b7ec', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:09:32.747045 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:32.748823 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:09:32.751107 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:32.751319 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58c8c13b-5e, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:09:32.751701 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap58c8c13b-5e, col_values=(('qos', UUID('b7f03b2f-dace-4e6d-aab7-9c1678f8340c')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:09:32.752509 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap58c8c13b-5e, col_values=(('external_ids', {'iface-id': '58c8c13b-5e85-402b-9c1b-900748ac5b1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:fb:de', 'vm-uuid': 'f42f06fc-5b0c-4973-98db-cd594815f317'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:09:32.753446 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1dea755-6fa1-4d68-8194-2be27b092c1c/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:09:32.754005 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:32.755313 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:09:32.757072 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Cannot resize image /opt/stack/data/nova/instances/c1dea755-6fa1-4d68-8194-2be27b092c1c/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:09:32.757072 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:09:32.757072 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Ensure instance console log exists: /opt/stack/data/nova/instances/c1dea755-6fa1-4d68-8194-2be27b092c1c/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:09:32.757072 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:32.757072 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:32.757072 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:32.760431 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:32.762330 np0000001613 nova-compute[98321]: INFO os_vif [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:fb:de,bridge_name='br-int',has_traffic_filtering=True,id=58c8c13b-5e85-402b-9c1b-900748ac5b1a,network=Network(233ff488-7baf-4369-9054-b24499b82bab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58c8c13b-5e')
May 28 10:09:32.979180 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:09:33.000779 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:33.021481 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:33.030370 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:33.051770 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:33.063065 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:33.078989 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4ef88d3d-60e0-47cf-9533-9656678bed94 req-ee2b3e50-2119-4f3c-adad-52416b404a32 service nova] Releasing lock "refresh_cache-c1dea755-6fa1-4d68-8194-2be27b092c1c" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:09:33.079357 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Acquired lock "refresh_cache-c1dea755-6fa1-4d68-8194-2be27b092c1c" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:09:33.079565 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:09:33.286993 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:33.302662 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:33.322011 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999577674000193 future=<Future at 0x73c1fc2f5e80 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:09:33.322297 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999257818999922 future=<Future at 0x73c1fc2f5e80 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:09:33.322816 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.998741978999988 future=<Future at 0x73c1fc2f5e80 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:09:33.326110 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Instance destroyed successfully.
May 28 10:09:33.328016 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lazy-loading 'resources' on Instance uuid ca57808c-4f51-4a26-8724-d28394efab9f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:09:33.665570 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:09:33.829430 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:08:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1045213354',display_name='tempest-TestVolumeBootPattern-server-1045213354',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpattern-server-1045213354',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXijNEVpHlU0fcHSajVe0wLb7tE6aVVeudGfxc7rHURQeMUmzIENcCsTLjBsfytzyxfL8Ns1nEjQaGLVbBThbKgoJfLjVwVzizrBq9/Hj7rtGIFoStaV7wwOeDN2YJenw==',key_name='tempest-keypair-161619853',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:08:33Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='23e9651268114327a9cc6c6c59bef01e',ramdisk_id='',reservation_id='r-80yxhf2a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-327944304',owner_user_name='tempest-TestVolumeBootPattern-327944304-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:09:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec58233d3b2848bbb2e0b00650398cd1',uuid=ca57808c-4f51-4a26-8724-d28394efab9f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fca4901d-c1d5-4b95-8e64-2d88cd94725f", "address": "fa:16:3e:51:37:8d", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca4901d-c1", "ovs_interfaceid": "fca4901d-c1d5-4b95-8e64-2d88cd94725f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:09:33.830181 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converting VIF {"id": "fca4901d-c1d5-4b95-8e64-2d88cd94725f", "address": "fa:16:3e:51:37:8d", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfca4901d-c1", "ovs_interfaceid": "fca4901d-c1d5-4b95-8e64-2d88cd94725f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:09:33.830509 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:37:8d,bridge_name='br-int',has_traffic_filtering=True,id=fca4901d-c1d5-4b95-8e64-2d88cd94725f,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfca4901d-c1') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:09:33.830832 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:37:8d,bridge_name='br-int',has_traffic_filtering=True,id=fca4901d-c1d5-4b95-8e64-2d88cd94725f,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfca4901d-c1') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:09:33.834464 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:33.834893 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfca4901d-c1, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:09:33.836961 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:33.838313 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:09:33.854855 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:33.856688 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:33.856852 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f9f881e3-82f5-4e0d-b9c1-6d24a0157b42) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:09:33.857467 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:33.858906 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:09:33.862114 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:09:33.866637 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:33.870837 np0000001613 nova-compute[98321]: INFO os_vif [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:37:8d,bridge_name='br-int',has_traffic_filtering=True,id=fca4901d-c1d5-4b95-8e64-2d88cd94725f,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfca4901d-c1')
May 28 10:09:33.873247 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:09:33.873930 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:09:33.874281 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:09:33.875075 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:09:33.876292 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:09:33.876583 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:09:33.920521 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:33.920521 np0000001613 nova-compute[98321]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:33.920521 np0000001613 nova-compute[98321]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c4baa7e-d209-4c65-b1fd-00d38dcc5a01 (non-flash)
May 28 10:09:33.920521 np0000001613 nova-compute[98321]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:09:33.920521 np0000001613 nova-compute[98321]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:09:33.920521 np0000001613 nova-compute[98321]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6651cabf-3fbc-4423-9ae7-01fa2dbbf5c5 (non-flash)
May 28 10:09:33.920521 np0000001613 nova-compute[98321]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6651cabf-3fbc-4423-9ae7-01fa2dbbf5c5 (non-flash)
May 28 10:09:33.920521 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:09:33.920731 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:33.920731 np0000001613 nova-compute[98321]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:33.920731 np0000001613 nova-compute[98321]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c4baa7e-d209-4c65-b1fd-00d38dcc5a01 (non-flash)
May 28 10:09:33.920731 np0000001613 nova-compute[98321]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:09:33.920731 np0000001613 nova-compute[98321]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b (non-flash)
May 28 10:09:33.920731 np0000001613 nova-compute[98321]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6651cabf-3fbc-4423-9ae7-01fa2dbbf5c5 (non-flash)
May 28 10:09:33.920731 np0000001613 nova-compute[98321]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6651cabf-3fbc-4423-9ae7-01fa2dbbf5c5 (non-flash)
May 28 10:09:33.920731 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:09:33.920959 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0', '128'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0', '129'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c4baa7e-d209-4c65-b1fd-00d38dcc5a01', '132'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b', '133'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b', '134'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6651cabf-3fbc-4423-9ae7-01fa2dbbf5c5', '135'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6651cabf-3fbc-4423-9ae7-01fa2dbbf5c5', '136')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:09:33.921057 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b', '134')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:09:33.922313 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b', '133')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:09:33.925467 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-04e9a89e-db7b-4f5a-a250-f51cf017025b req-1e9af50e-b10a-4f4a-a6a7-4a50bba7c304 service nova] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Received event network-vif-unplugged-fca4901d-c1d5-4b95-8e64-2d88cd94725f {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:09:33.927658 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-04e9a89e-db7b-4f5a-a250-f51cf017025b req-1e9af50e-b10a-4f4a-a6a7-4a50bba7c304 service nova] Acquiring lock "ca57808c-4f51-4a26-8724-d28394efab9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:33.927932 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-04e9a89e-db7b-4f5a-a250-f51cf017025b req-1e9af50e-b10a-4f4a-a6a7-4a50bba7c304 service nova] Lock "ca57808c-4f51-4a26-8724-d28394efab9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:33.928697 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-04e9a89e-db7b-4f5a-a250-f51cf017025b req-1e9af50e-b10a-4f4a-a6a7-4a50bba7c304 service nova] Lock "ca57808c-4f51-4a26-8724-d28394efab9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:33.928930 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-04e9a89e-db7b-4f5a-a250-f51cf017025b req-1e9af50e-b10a-4f4a-a6a7-4a50bba7c304 service nova] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] No waiting events found dispatching network-vif-unplugged-fca4901d-c1d5-4b95-8e64-2d88cd94725f {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:09:33.929077 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-04e9a89e-db7b-4f5a-a250-f51cf017025b req-1e9af50e-b10a-4f4a-a6a7-4a50bba7c304 service nova] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Received event network-vif-unplugged-fca4901d-c1d5-4b95-8e64-2d88cd94725f for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:09:33.929245 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-04e9a89e-db7b-4f5a-a250-f51cf017025b req-1e9af50e-b10a-4f4a-a6a7-4a50bba7c304 service nova] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Received event network-vif-unplugged-fca4901d-c1d5-4b95-8e64-2d88cd94725f {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:09:33.929454 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-04e9a89e-db7b-4f5a-a250-f51cf017025b req-1e9af50e-b10a-4f4a-a6a7-4a50bba7c304 service nova] Acquiring lock "ca57808c-4f51-4a26-8724-d28394efab9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:33.929713 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-04e9a89e-db7b-4f5a-a250-f51cf017025b req-1e9af50e-b10a-4f4a-a6a7-4a50bba7c304 service nova] Lock "ca57808c-4f51-4a26-8724-d28394efab9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:33.929931 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-04e9a89e-db7b-4f5a-a250-f51cf017025b req-1e9af50e-b10a-4f4a-a6a7-4a50bba7c304 service nova] Lock "ca57808c-4f51-4a26-8724-d28394efab9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:33.930125 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-04e9a89e-db7b-4f5a-a250-f51cf017025b req-1e9af50e-b10a-4f4a-a6a7-4a50bba7c304 service nova] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] No waiting events found dispatching network-vif-unplugged-fca4901d-c1d5-4b95-8e64-2d88cd94725f {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:09:33.930341 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-04e9a89e-db7b-4f5a-a250-f51cf017025b req-1e9af50e-b10a-4f4a-a6a7-4a50bba7c304 service nova] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Received event network-vif-unplugged-fca4901d-c1d5-4b95-8e64-2d88cd94725f for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:09:33.931357 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1f4735300>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b'): ({'sdd'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:09:33.931765 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Removing multipathed devices sdd, sde {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:09:33.932308 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Flush multipath device 3300000006f417ccb {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:09:33.996821 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:09:34.052341 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:09:34.071059 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Updating instance_info_cache with network_info: [{"id": "6c9f4569-56c8-4b49-9988-36f94a6a1bf0", "address": "fa:16:3e:8b:58:6a", "network": {"id": "f1a1b038-1ab9-40c1-b2d1-a4f95e93c396", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0ee907e07b942d09d375f1b1647d9b3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9f4569-56", "ovs_interfaceid": "6c9f4569-56c8-4b49-9988-36f94a6a1bf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:09:34.122120 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:09:34.122504 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:09:34.123529 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:09:34.138790 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:09:34.139219 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:09:34.161262 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:34.195985 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 134, target: iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b, portal: 192.168.40.100,3260]
May 28 10:09:34.195985 np0000001613 nova-compute[98321]: Logout of [sid: 134, target: iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b, portal: 192.168.40.100,3260] successful.
May 28 10:09:34.195985 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:34.215417 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:34.230783 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:34.267947 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 133, target: iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b, portal: 192.168.50.100,3260]
May 28 10:09:34.267947 np0000001613 nova-compute[98321]: Logout of [sid: 133, target: iqn.2023-03.storpool.com:os--volume-7c1c1ea0-2af9-4573-95bb-c79b28880b7b, portal: 192.168.50.100,3260] successful.
May 28 10:09:34.267947 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:34.287744 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:34.288318 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.413s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:09:34.288318 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] <== disconnect_volume: return (414ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:09:34.288318 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:09:34.288593 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Deleting instance files /opt/stack/data/nova/instances/ca57808c-4f51-4a26-8724-d28394efab9f_del
May 28 10:09:34.290368 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Deletion of /opt/stack/data/nova/instances/ca57808c-4f51-4a26-8724-d28394efab9f_del complete
May 28 10:09:34.298296 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:09:34.298296 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:09:34.298509 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] No VIF found with MAC fa:16:3e:33:fb:de, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:09:34.300720 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Using config drive
May 28 10:09:34.574459 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Releasing lock "refresh_cache-c1dea755-6fa1-4d68-8194-2be27b092c1c" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:09:34.574816 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Instance network_info: |[{"id": "6c9f4569-56c8-4b49-9988-36f94a6a1bf0", "address": "fa:16:3e:8b:58:6a", "network": {"id": "f1a1b038-1ab9-40c1-b2d1-a4f95e93c396", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0ee907e07b942d09d375f1b1647d9b3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9f4569-56", "ovs_interfaceid": "6c9f4569-56c8-4b49-9988-36f94a6a1bf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:09:34.577935 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Start _get_guest_xml network_info=[{"id": "6c9f4569-56c8-4b49-9988-36f94a6a1bf0", "address": "fa:16:3e:8b:58:6a", "network": {"id": "f1a1b038-1ab9-40c1-b2d1-a4f95e93c396", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0ee907e07b942d09d375f1b1647d9b3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9f4569-56", "ovs_interfaceid": "6c9f4569-56c8-4b49-9988-36f94a6a1bf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:09:34.582667 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:09:34.585048 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-VolumesNegativeTest-instance-1866731759', uuid='c1dea755-6fa1-4d68-8194-2be27b092c1c'), owner=OwnerMeta(userid='417c73d8573343ff9c70590f66edd97a', username='tempest-VolumesNegativeTest-34785860-project-member', projectid='ad18b97e2d5d4fa8a51e19e79cde82c1', projectname='tempest-VolumesNegativeTest-34785860'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6c9f4569-56c8-4b49-9988-36f94a6a1bf0", "address": "fa:16:3e:8b:58:6a", "network": {"id": "f1a1b038-1ab9-40c1-b2d1-a4f95e93c396", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0ee907e07b942d09d375f1b1647d9b3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9f4569-56", "ovs_interfaceid": "6c9f4569-56c8-4b49-9988-36f94a6a1bf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962974.5842288) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:09:34.587257 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:09:34.588221 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:09:34.590195 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:09:34.590195 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:09:34.593354 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:09:34.593354 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:09:34.593354 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:09:34.593354 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:09:34.593354 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:09:34.593354 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:09:34.593888 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:09:34.594129 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:09:34.594538 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:09:34.594779 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:09:34.594944 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:09:34.595139 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:09:34.617396 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:09:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1866731759',display_name='tempest-VolumesNegativeTest-instance-1866731759',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumesnegativetest-instance-1866731759',id=57,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad18b97e2d5d4fa8a51e19e79cde82c1',ramdisk_id='',reservation_id='r-bgewrfzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-34785860',owner_user_name='tempest-VolumesNegativeTest-34785860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:09:31Z,user_data=None,user_id='417c73d8573343ff9c70590f66edd97a',uuid=c1dea755-6fa1-4d68-8194-2be27b092c1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c9f4569-56c8-4b49-9988-36f94a6a1bf0", "address": "fa:16:3e:8b:58:6a", "network": {"id": "f1a1b038-1ab9-40c1-b2d1-a4f95e93c396", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0ee907e07b942d09d375f1b1647d9b3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9f4569-56", "ovs_interfaceid": "6c9f4569-56c8-4b49-9988-36f94a6a1bf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:09:34.617619 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Converting VIF {"id": "6c9f4569-56c8-4b49-9988-36f94a6a1bf0", "address": "fa:16:3e:8b:58:6a", "network": {"id": "f1a1b038-1ab9-40c1-b2d1-a4f95e93c396", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0ee907e07b942d09d375f1b1647d9b3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9f4569-56", "ovs_interfaceid": "6c9f4569-56c8-4b49-9988-36f94a6a1bf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:09:34.618300 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:58:6a,bridge_name='br-int',has_traffic_filtering=True,id=6c9f4569-56c8-4b49-9988-36f94a6a1bf0,network=Network(f1a1b038-1ab9-40c1-b2d1-a4f95e93c396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9f4569-56') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:09:34.621970 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Lazy-loading 'pci_devices' on Instance uuid c1dea755-6fa1-4d68-8194-2be27b092c1c {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:09:34.738959 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:34.806374 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:09:34.812837 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Took 1.83 seconds to destroy the instance on the hypervisor.
May 28 10:09:34.813757 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:09:34.813757 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:09:34.814497 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:09:34.814497 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:09:34.968399 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Creating config drive at /opt/stack/data/nova/instances/f42f06fc-5b0c-4973-98db-cd594815f317/disk.config
May 28 10:09:34.971553 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f42f06fc-5b0c-4973-98db-cd594815f317/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_vci0214 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:09:35.021817 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:09:35.048201 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f42f06fc-5b0c-4973-98db-cd594815f317/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_vci0214" returned: 0 in 0.076s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:09:35.135591 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] End _get_guest_xml xml=<domain type="qemu">
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:   <uuid>c1dea755-6fa1-4d68-8194-2be27b092c1c</uuid>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:   <name>instance-00000039</name>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:       <nova:name>tempest-VolumesNegativeTest-instance-1866731759</nova:name>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:09:34</nova:creationTime>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:         <nova:user uuid="417c73d8573343ff9c70590f66edd97a">tempest-VolumesNegativeTest-34785860-project-member</nova:user>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:         <nova:project uuid="ad18b97e2d5d4fa8a51e19e79cde82c1">tempest-VolumesNegativeTest-34785860</nova:project>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:         <nova:port uuid="6c9f4569-56c8-4b49-9988-36f94a6a1bf0">
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="192.168.233.110" ipVersion="4"/>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:     <system>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:       <entry name="serial">c1dea755-6fa1-4d68-8194-2be27b092c1c</entry>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:       <entry name="uuid">c1dea755-6fa1-4d68-8194-2be27b092c1c</entry>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:     </system>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:   <os>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:   </os>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:   <features>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:   </features>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:   <devices>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/c1dea755-6fa1-4d68-8194-2be27b092c1c/disk"/>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:     </disk>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/c1dea755-6fa1-4d68-8194-2be27b092c1c/disk.config"/>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:     </disk>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:8b:58:6a"/>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:       <target dev="tap6c9f4569-56"/>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:     </interface>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/c1dea755-6fa1-4d68-8194-2be27b092c1c/console.log" append="off"/>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:     </serial>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:     <video>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:     </video>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:     </rng>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:   </devices>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]: </domain>
May 28 10:09:35.135591 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:09:35.138904 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Preparing to wait for external event network-vif-plugged-6c9f4569-56c8-4b49-9988-36f94a6a1bf0 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:09:35.138904 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Acquiring lock "c1dea755-6fa1-4d68-8194-2be27b092c1c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:35.138904 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Lock "c1dea755-6fa1-4d68-8194-2be27b092c1c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:35.138904 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Lock "c1dea755-6fa1-4d68-8194-2be27b092c1c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:35.147933 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:09:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1866731759',display_name='tempest-VolumesNegativeTest-instance-1866731759',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumesnegativetest-instance-1866731759',id=57,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad18b97e2d5d4fa8a51e19e79cde82c1',ramdisk_id='',reservation_id='r-bgewrfzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-34785860',owner_user_name='tempest-VolumesNegativeTest-34785860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:09:31Z,user_data=None,user_id='417c73d8573343ff9c70590f66edd97a',uuid=c1dea755-6fa1-4d68-8194-2be27b092c1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c9f4569-56c8-4b49-9988-36f94a6a1bf0", "address": "fa:16:3e:8b:58:6a", "network": {"id": "f1a1b038-1ab9-40c1-b2d1-a4f95e93c396", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0ee907e07b942d09d375f1b1647d9b3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9f4569-56", "ovs_interfaceid": "6c9f4569-56c8-4b49-9988-36f94a6a1bf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:09:35.148205 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Converting VIF {"id": "6c9f4569-56c8-4b49-9988-36f94a6a1bf0", "address": "fa:16:3e:8b:58:6a", "network": {"id": "f1a1b038-1ab9-40c1-b2d1-a4f95e93c396", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0ee907e07b942d09d375f1b1647d9b3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9f4569-56", "ovs_interfaceid": "6c9f4569-56c8-4b49-9988-36f94a6a1bf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:09:35.148910 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:58:6a,bridge_name='br-int',has_traffic_filtering=True,id=6c9f4569-56c8-4b49-9988-36f94a6a1bf0,network=Network(f1a1b038-1ab9-40c1-b2d1-a4f95e93c396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9f4569-56') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:09:35.149178 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:58:6a,bridge_name='br-int',has_traffic_filtering=True,id=6c9f4569-56c8-4b49-9988-36f94a6a1bf0,network=Network(f1a1b038-1ab9-40c1-b2d1-a4f95e93c396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9f4569-56') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:09:35.149762 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:35.150073 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:09:35.150763 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:09:35.151895 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:35.152086 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5a3c9626-eea8-5439-8506-ef223da9e6c8', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:09:35.152923 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:35.153769 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:09:35.161710 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:35.164187 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:35.167207 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:35.167207 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c9f4569-56, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:09:35.167207 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6c9f4569-56, col_values=(('qos', UUID('6aa0fd26-4bb3-46a1-9ccb-021b823dba1b')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:09:35.167464 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6c9f4569-56, col_values=(('external_ids', {'iface-id': '6c9f4569-56c8-4b49-9988-36f94a6a1bf0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:58:6a', 'vm-uuid': 'c1dea755-6fa1-4d68-8194-2be27b092c1c'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:09:35.168697 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:35.169494 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:09:35.181770 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:35.183068 np0000001613 nova-compute[98321]: INFO os_vif [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:58:6a,bridge_name='br-int',has_traffic_filtering=True,id=6c9f4569-56c8-4b49-9988-36f94a6a1bf0,network=Network(f1a1b038-1ab9-40c1-b2d1-a4f95e93c396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9f4569-56')
May 28 10:09:35.625091 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:35.672142 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:35.674978 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:35.781295 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:35.843126 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2898c91c-a8e7-4172-95b5-608f85bdb6bb req-749f168e-1060-49f6-bbc9-b57d3e42d29f service nova] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Received event network-vif-deleted-fca4901d-c1d5-4b95-8e64-2d88cd94725f {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:09:35.843126 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-2898c91c-a8e7-4172-95b5-608f85bdb6bb req-749f168e-1060-49f6-bbc9-b57d3e42d29f service nova] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Neutron deleted interface fca4901d-c1d5-4b95-8e64-2d88cd94725f; detaching it from the instance and deleting it from the info cache
May 28 10:09:35.844456 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2898c91c-a8e7-4172-95b5-608f85bdb6bb req-749f168e-1060-49f6-bbc9-b57d3e42d29f service nova] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Detach interface failed, port_id=fca4901d-c1d5-4b95-8e64-2d88cd94725f, reason: Instance ca57808c-4f51-4a26-8724-d28394efab9f could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:09:36.075574 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:36.084382 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:36.086507 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:36.117464 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:36.131467 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:36.283239 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:09:36.684726 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962976.6840317, f42f06fc-5b0c-4973-98db-cd594815f317 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:09:36.688202 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] VM Started (Lifecycle Event)
May 28 10:09:36.708249 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:09:36.708425 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:09:36.708539 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] No VIF found with MAC fa:16:3e:8b:58:6a, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:09:36.709003 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Using config drive
May 28 10:09:36.791023 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Took 1.97 seconds to deallocate network for instance.
May 28 10:09:37.191911 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:09:37.203798 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962977.203447, f42f06fc-5b0c-4973-98db-cd594815f317 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:09:37.203958 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] VM Paused (Lifecycle Event)
May 28 10:09:37.215277 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:09:37.349923 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Took 0.56 seconds to detach 1 volumes for instance.
May 28 10:09:37.358615 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Creating config drive at /opt/stack/data/nova/instances/c1dea755-6fa1-4d68-8194-2be27b092c1c/disk.config
May 28 10:09:37.362935 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c1dea755-6fa1-4d68-8194-2be27b092c1c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpm07g57cm {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:09:37.419697 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c1dea755-6fa1-4d68-8194-2be27b092c1c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpm07g57cm" returned: 0 in 0.056s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:09:37.544631 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:37.710718 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:09:37.715630 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:09:37.864867 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:37.866881 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:37.920294 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:37.934889 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4329025c-f193-4fb1-a03c-50e1a4bc6b19 req-b2d457cb-1976-4905-9870-8d7b01ac892a service nova] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Received event network-vif-plugged-58c8c13b-5e85-402b-9c1b-900748ac5b1a {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:09:37.935769 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4329025c-f193-4fb1-a03c-50e1a4bc6b19 req-b2d457cb-1976-4905-9870-8d7b01ac892a service nova] Acquiring lock "f42f06fc-5b0c-4973-98db-cd594815f317-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:37.935985 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4329025c-f193-4fb1-a03c-50e1a4bc6b19 req-b2d457cb-1976-4905-9870-8d7b01ac892a service nova] Lock "f42f06fc-5b0c-4973-98db-cd594815f317-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:37.936256 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4329025c-f193-4fb1-a03c-50e1a4bc6b19 req-b2d457cb-1976-4905-9870-8d7b01ac892a service nova] Lock "f42f06fc-5b0c-4973-98db-cd594815f317-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:37.936773 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4329025c-f193-4fb1-a03c-50e1a4bc6b19 req-b2d457cb-1976-4905-9870-8d7b01ac892a service nova] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Processing event network-vif-plugged-58c8c13b-5e85-402b-9c1b-900748ac5b1a {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:09:37.938228 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4329025c-f193-4fb1-a03c-50e1a4bc6b19 req-b2d457cb-1976-4905-9870-8d7b01ac892a service nova] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Received event network-vif-plugged-58c8c13b-5e85-402b-9c1b-900748ac5b1a {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:09:37.938228 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4329025c-f193-4fb1-a03c-50e1a4bc6b19 req-b2d457cb-1976-4905-9870-8d7b01ac892a service nova] Acquiring lock "f42f06fc-5b0c-4973-98db-cd594815f317-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:37.938228 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4329025c-f193-4fb1-a03c-50e1a4bc6b19 req-b2d457cb-1976-4905-9870-8d7b01ac892a service nova] Lock "f42f06fc-5b0c-4973-98db-cd594815f317-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:37.938228 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4329025c-f193-4fb1-a03c-50e1a4bc6b19 req-b2d457cb-1976-4905-9870-8d7b01ac892a service nova] Lock "f42f06fc-5b0c-4973-98db-cd594815f317-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:37.938228 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4329025c-f193-4fb1-a03c-50e1a4bc6b19 req-b2d457cb-1976-4905-9870-8d7b01ac892a service nova] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] No waiting events found dispatching network-vif-plugged-58c8c13b-5e85-402b-9c1b-900748ac5b1a {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:09:37.938228 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-4329025c-f193-4fb1-a03c-50e1a4bc6b19 req-b2d457cb-1976-4905-9870-8d7b01ac892a service nova] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Received unexpected event network-vif-plugged-58c8c13b-5e85-402b-9c1b-900748ac5b1a for instance with vm_state building and task_state spawning.
May 28 10:09:37.938228 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:09:37.943813 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:09:37.957331 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Instance spawned successfully.
May 28 10:09:37.959517 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:09:37.998693 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:38.002319 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:38.033467 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:38.175257 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6cb785d9-ce52-49b9-ae65-9abc629faa0c req-a836f773-4869-4ddd-97e7-a29a153ef9f3 service nova] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Received event network-vif-plugged-6c9f4569-56c8-4b49-9988-36f94a6a1bf0 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:09:38.175481 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6cb785d9-ce52-49b9-ae65-9abc629faa0c req-a836f773-4869-4ddd-97e7-a29a153ef9f3 service nova] Acquiring lock "c1dea755-6fa1-4d68-8194-2be27b092c1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:38.175692 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6cb785d9-ce52-49b9-ae65-9abc629faa0c req-a836f773-4869-4ddd-97e7-a29a153ef9f3 service nova] Lock "c1dea755-6fa1-4d68-8194-2be27b092c1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:38.175818 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6cb785d9-ce52-49b9-ae65-9abc629faa0c req-a836f773-4869-4ddd-97e7-a29a153ef9f3 service nova] Lock "c1dea755-6fa1-4d68-8194-2be27b092c1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:38.175956 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6cb785d9-ce52-49b9-ae65-9abc629faa0c req-a836f773-4869-4ddd-97e7-a29a153ef9f3 service nova] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Processing event network-vif-plugged-6c9f4569-56c8-4b49-9988-36f94a6a1bf0 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:09:38.220941 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:09:38.220941 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962978.2204726, f42f06fc-5b0c-4973-98db-cd594815f317 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:09:38.220941 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] VM Resumed (Lifecycle Event)
May 28 10:09:38.310594 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:09:38.310852 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:09:38.348127 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:38.355099 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:38.357269 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:38.361737 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:38.391953 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:38.392768 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:38.473261 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:09:38.473457 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:09:38.473874 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:09:38.474202 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:09:38.474509 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:09:38.474825 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:09:38.724537 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:09:38.727726 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:09:38.815961 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:09:38.866039 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:09:38.869861 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:09:38.871763 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Instance spawned successfully.
May 28 10:09:38.872122 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:09:38.981523 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Took 9.10 seconds to spawn the instance on the hypervisor.
May 28 10:09:38.981810 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:09:39.230189 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:09:39.230189 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962979.2298622, c1dea755-6fa1-4d68-8194-2be27b092c1c => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:09:39.230281 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] VM Started (Lifecycle Event)
May 28 10:09:39.323838 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.457s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:39.378694 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:09:39.378829 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:09:39.379102 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:09:39.379428 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:09:39.379679 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:09:39.379920 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:09:39.382951 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Deleted allocations for instance ca57808c-4f51-4a26-8724-d28394efab9f
May 28 10:09:39.496214 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Took 14.62 seconds to build instance.
May 28 10:09:39.732782 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:09:39.736214 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:09:39.751472 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:39.886442 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Took 7.61 seconds to spawn the instance on the hypervisor.
May 28 10:09:39.886603 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:09:39.998437 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e2275f73-4679-4625-b513-4441e4fe1990 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "f42f06fc-5b0c-4973-98db-cd594815f317" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.131s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:40.168278 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:40.242462 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:09:40.242462 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962980.2412922, c1dea755-6fa1-4d68-8194-2be27b092c1c => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:09:40.242462 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] VM Paused (Lifecycle Event)
May 28 10:09:40.257376 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-9c971602-a79c-4f86-9672-d95b9cbc6219 req-fd09c638-0a8e-447f-98b3-ceb57e3be24c service nova] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Received event network-vif-plugged-6c9f4569-56c8-4b49-9988-36f94a6a1bf0 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:09:40.257376 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9c971602-a79c-4f86-9672-d95b9cbc6219 req-fd09c638-0a8e-447f-98b3-ceb57e3be24c service nova] Acquiring lock "c1dea755-6fa1-4d68-8194-2be27b092c1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:40.257802 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9c971602-a79c-4f86-9672-d95b9cbc6219 req-fd09c638-0a8e-447f-98b3-ceb57e3be24c service nova] Lock "c1dea755-6fa1-4d68-8194-2be27b092c1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:40.257911 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9c971602-a79c-4f86-9672-d95b9cbc6219 req-fd09c638-0a8e-447f-98b3-ceb57e3be24c service nova] Lock "c1dea755-6fa1-4d68-8194-2be27b092c1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:40.258428 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-9c971602-a79c-4f86-9672-d95b9cbc6219 req-fd09c638-0a8e-447f-98b3-ceb57e3be24c service nova] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] No waiting events found dispatching network-vif-plugged-6c9f4569-56c8-4b49-9988-36f94a6a1bf0 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:09:40.258581 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-9c971602-a79c-4f86-9672-d95b9cbc6219 req-fd09c638-0a8e-447f-98b3-ceb57e3be24c service nova] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Received unexpected event network-vif-plugged-6c9f4569-56c8-4b49-9988-36f94a6a1bf0 for instance with vm_state active and task_state None.
May 28 10:09:40.393319 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b932b77d-310d-41b6-aaa3-4f0fdd0f2fca tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "ca57808c-4f51-4a26-8724-d28394efab9f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.923s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:40.397257 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Took 13.15 seconds to build instance.
May 28 10:09:40.744456 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:09:40.748386 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779962980.7480412, c1dea755-6fa1-4d68-8194-2be27b092c1c => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:09:40.748571 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] VM Resumed (Lifecycle Event)
May 28 10:09:40.856071 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-722f8b1e-1126-4310-81c7-63662b7d0f69 tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Acquiring lock "c1dea755-6fa1-4d68-8194-2be27b092c1c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:40.898145 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Lock "c1dea755-6fa1-4d68-8194-2be27b092c1c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.668s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:40.898510 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-722f8b1e-1126-4310-81c7-63662b7d0f69 tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Lock "c1dea755-6fa1-4d68-8194-2be27b092c1c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.042s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:40.900493 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-722f8b1e-1126-4310-81c7-63662b7d0f69 tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Acquiring lock "c1dea755-6fa1-4d68-8194-2be27b092c1c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:40.900493 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-722f8b1e-1126-4310-81c7-63662b7d0f69 tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Lock "c1dea755-6fa1-4d68-8194-2be27b092c1c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:40.900493 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-722f8b1e-1126-4310-81c7-63662b7d0f69 tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Lock "c1dea755-6fa1-4d68-8194-2be27b092c1c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:40.902870 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-722f8b1e-1126-4310-81c7-63662b7d0f69 tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Terminating instance
May 28 10:09:41.251830 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:09:41.257705 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: deleting, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:09:41.408772 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-722f8b1e-1126-4310-81c7-63662b7d0f69 tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:09:41.431749 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:41.431749 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:41.455369 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:41.459987 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:41.487630 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:41.727768 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:41.735434 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:41.756614 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Instance destroyed successfully.
May 28 10:09:41.759801 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-722f8b1e-1126-4310-81c7-63662b7d0f69 tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Lazy-loading 'resources' on Instance uuid c1dea755-6fa1-4d68-8194-2be27b092c1c {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:09:41.760468 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] During sync_power_state the instance has a pending task (deleting). Skip.
May 28 10:09:41.761188 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999749744999917 future=<Future at 0x73c1f4239f70 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:09:42.261765 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-722f8b1e-1126-4310-81c7-63662b7d0f69 tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:09:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1866731759',display_name='tempest-VolumesNegativeTest-instance-1866731759',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumesnegativetest-instance-1866731759',id=57,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:09:39Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad18b97e2d5d4fa8a51e19e79cde82c1',ramdisk_id='',reservation_id='r-bgewrfzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-34785860',owner_user_name='tempest-VolumesNegativeTest-34785860-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:09:40Z,user_data=None,user_id='417c73d8573343ff9c70590f66edd97a',uuid=c1dea755-6fa1-4d68-8194-2be27b092c1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c9f4569-56c8-4b49-9988-36f94a6a1bf0", "address": "fa:16:3e:8b:58:6a", "network": {"id": "f1a1b038-1ab9-40c1-b2d1-a4f95e93c396", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0ee907e07b942d09d375f1b1647d9b3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9f4569-56", "ovs_interfaceid": "6c9f4569-56c8-4b49-9988-36f94a6a1bf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:09:42.261963 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-722f8b1e-1126-4310-81c7-63662b7d0f69 tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Converting VIF {"id": "6c9f4569-56c8-4b49-9988-36f94a6a1bf0", "address": "fa:16:3e:8b:58:6a", "network": {"id": "f1a1b038-1ab9-40c1-b2d1-a4f95e93c396", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0ee907e07b942d09d375f1b1647d9b3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9f4569-56", "ovs_interfaceid": "6c9f4569-56c8-4b49-9988-36f94a6a1bf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:09:42.262606 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-722f8b1e-1126-4310-81c7-63662b7d0f69 tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:58:6a,bridge_name='br-int',has_traffic_filtering=True,id=6c9f4569-56c8-4b49-9988-36f94a6a1bf0,network=Network(f1a1b038-1ab9-40c1-b2d1-a4f95e93c396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9f4569-56') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:09:42.262849 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-722f8b1e-1126-4310-81c7-63662b7d0f69 tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:58:6a,bridge_name='br-int',has_traffic_filtering=True,id=6c9f4569-56c8-4b49-9988-36f94a6a1bf0,network=Network(f1a1b038-1ab9-40c1-b2d1-a4f95e93c396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9f4569-56') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:09:42.265325 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:42.266420 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c9f4569-56, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:09:42.273308 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:42.273308 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:09:42.273856 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:42.274205 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6aa0fd26-4bb3-46a1-9ccb-021b823dba1b) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:09:42.274916 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:42.275508 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:09:42.277782 np0000001613 nova-compute[98321]: INFO os_vif [None req-722f8b1e-1126-4310-81c7-63662b7d0f69 tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:58:6a,bridge_name='br-int',has_traffic_filtering=True,id=6c9f4569-56c8-4b49-9988-36f94a6a1bf0,network=Network(f1a1b038-1ab9-40c1-b2d1-a4f95e93c396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9f4569-56')
May 28 10:09:42.278132 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-722f8b1e-1126-4310-81c7-63662b7d0f69 tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Deleting instance files /opt/stack/data/nova/instances/c1dea755-6fa1-4d68-8194-2be27b092c1c_del
May 28 10:09:42.279495 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-722f8b1e-1126-4310-81c7-63662b7d0f69 tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Deletion of /opt/stack/data/nova/instances/c1dea755-6fa1-4d68-8194-2be27b092c1c_del complete
May 28 10:09:42.340852 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-368a8528-b185-402a-9228-b4ba7d5c7957 req-b80c0301-aa28-45d7-8c75-d6142240df99 service nova] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Received event network-changed-58c8c13b-5e85-402b-9c1b-900748ac5b1a {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:09:42.340995 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-368a8528-b185-402a-9228-b4ba7d5c7957 req-b80c0301-aa28-45d7-8c75-d6142240df99 service nova] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Refreshing instance network info cache due to event network-changed-58c8c13b-5e85-402b-9c1b-900748ac5b1a. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:09:42.341174 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-368a8528-b185-402a-9228-b4ba7d5c7957 req-b80c0301-aa28-45d7-8c75-d6142240df99 service nova] Acquiring lock "refresh_cache-f42f06fc-5b0c-4973-98db-cd594815f317" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:09:42.341281 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-368a8528-b185-402a-9228-b4ba7d5c7957 req-b80c0301-aa28-45d7-8c75-d6142240df99 service nova] Acquired lock "refresh_cache-f42f06fc-5b0c-4973-98db-cd594815f317" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:09:42.341417 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-368a8528-b185-402a-9228-b4ba7d5c7957 req-b80c0301-aa28-45d7-8c75-d6142240df99 service nova] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Refreshing network info cache for port 58c8c13b-5e85-402b-9c1b-900748ac5b1a {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:09:42.791055 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-722f8b1e-1126-4310-81c7-63662b7d0f69 tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Took 1.38 seconds to destroy the instance on the hypervisor.
May 28 10:09:42.791709 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-722f8b1e-1126-4310-81c7-63662b7d0f69 tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:09:42.792805 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:09:42.792975 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:09:42.793328 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:09:42.848160 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-368a8528-b185-402a-9228-b4ba7d5c7957 req-b80c0301-aa28-45d7-8c75-d6142240df99 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:09:42.869876 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:09:43.242267 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7b795e55-e0f5-4a6f-ae0f-c5e201ea8d1d req-9ab29206-5557-42c6-b512-de2fefebcc2d service nova] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Received event network-vif-deleted-6c9f4569-56c8-4b49-9988-36f94a6a1bf0 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:09:43.242424 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-7b795e55-e0f5-4a6f-ae0f-c5e201ea8d1d req-9ab29206-5557-42c6-b512-de2fefebcc2d service nova] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Neutron deleted interface 6c9f4569-56c8-4b49-9988-36f94a6a1bf0; detaching it from the instance and deleting it from the info cache
May 28 10:09:43.247233 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7b795e55-e0f5-4a6f-ae0f-c5e201ea8d1d req-9ab29206-5557-42c6-b512-de2fefebcc2d service nova] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Detach interface failed, port_id=6c9f4569-56c8-4b49-9988-36f94a6a1bf0, reason: Instance c1dea755-6fa1-4d68-8194-2be27b092c1c could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:09:43.285056 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-368a8528-b185-402a-9228-b4ba7d5c7957 req-b80c0301-aa28-45d7-8c75-d6142240df99 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:09:43.439557 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-368a8528-b185-402a-9228-b4ba7d5c7957 req-b80c0301-aa28-45d7-8c75-d6142240df99 service nova] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Updated VIF entry in instance network info cache for port 58c8c13b-5e85-402b-9c1b-900748ac5b1a. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:09:43.439856 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-368a8528-b185-402a-9228-b4ba7d5c7957 req-b80c0301-aa28-45d7-8c75-d6142240df99 service nova] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Updating instance_info_cache with network_info: [{"id": "58c8c13b-5e85-402b-9c1b-900748ac5b1a", "address": "fa:16:3e:33:fb:de", "network": {"id": "233ff488-7baf-4369-9054-b24499b82bab", "bridge": "br-int", "label": "tempest-TestStampPattern-854727558-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba63ea134a6e4fe1992f53a0da46d034", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c8c13b-5e", "ovs_interfaceid": "58c8c13b-5e85-402b-9c1b-900748ac5b1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:09:43.673181 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:09:43.941956 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-368a8528-b185-402a-9228-b4ba7d5c7957 req-b80c0301-aa28-45d7-8c75-d6142240df99 service nova] Releasing lock "refresh_cache-f42f06fc-5b0c-4973-98db-cd594815f317" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:09:43.942402 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-368a8528-b185-402a-9228-b4ba7d5c7957 req-b80c0301-aa28-45d7-8c75-d6142240df99 service nova] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Received event network-vif-unplugged-6c9f4569-56c8-4b49-9988-36f94a6a1bf0 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:09:43.942402 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-368a8528-b185-402a-9228-b4ba7d5c7957 req-b80c0301-aa28-45d7-8c75-d6142240df99 service nova] Acquiring lock "c1dea755-6fa1-4d68-8194-2be27b092c1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:43.942510 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-368a8528-b185-402a-9228-b4ba7d5c7957 req-b80c0301-aa28-45d7-8c75-d6142240df99 service nova] Lock "c1dea755-6fa1-4d68-8194-2be27b092c1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:43.942649 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-368a8528-b185-402a-9228-b4ba7d5c7957 req-b80c0301-aa28-45d7-8c75-d6142240df99 service nova] Lock "c1dea755-6fa1-4d68-8194-2be27b092c1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:43.942743 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-368a8528-b185-402a-9228-b4ba7d5c7957 req-b80c0301-aa28-45d7-8c75-d6142240df99 service nova] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] No waiting events found dispatching network-vif-unplugged-6c9f4569-56c8-4b49-9988-36f94a6a1bf0 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:09:43.942901 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-368a8528-b185-402a-9228-b4ba7d5c7957 req-b80c0301-aa28-45d7-8c75-d6142240df99 service nova] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Received event network-vif-unplugged-6c9f4569-56c8-4b49-9988-36f94a6a1bf0 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:09:43.943021 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-368a8528-b185-402a-9228-b4ba7d5c7957 req-b80c0301-aa28-45d7-8c75-d6142240df99 service nova] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Received event network-vif-unplugged-6c9f4569-56c8-4b49-9988-36f94a6a1bf0 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:09:43.943138 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-368a8528-b185-402a-9228-b4ba7d5c7957 req-b80c0301-aa28-45d7-8c75-d6142240df99 service nova] Acquiring lock "c1dea755-6fa1-4d68-8194-2be27b092c1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:43.943273 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-368a8528-b185-402a-9228-b4ba7d5c7957 req-b80c0301-aa28-45d7-8c75-d6142240df99 service nova] Lock "c1dea755-6fa1-4d68-8194-2be27b092c1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:43.943410 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-368a8528-b185-402a-9228-b4ba7d5c7957 req-b80c0301-aa28-45d7-8c75-d6142240df99 service nova] Lock "c1dea755-6fa1-4d68-8194-2be27b092c1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:43.943561 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-368a8528-b185-402a-9228-b4ba7d5c7957 req-b80c0301-aa28-45d7-8c75-d6142240df99 service nova] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] No waiting events found dispatching network-vif-unplugged-6c9f4569-56c8-4b49-9988-36f94a6a1bf0 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:09:43.943659 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-368a8528-b185-402a-9228-b4ba7d5c7957 req-b80c0301-aa28-45d7-8c75-d6142240df99 service nova] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Received event network-vif-unplugged-6c9f4569-56c8-4b49-9988-36f94a6a1bf0 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:09:44.175670 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Took 1.38 seconds to deallocate network for instance.
May 28 10:09:44.685535 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-722f8b1e-1126-4310-81c7-63662b7d0f69 tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:44.685666 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-722f8b1e-1126-4310-81c7-63662b7d0f69 tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:44.753770 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:44.973639 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-722f8b1e-1126-4310-81c7-63662b7d0f69 tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:09:44.974034 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-722f8b1e-1126-4310-81c7-63662b7d0f69 tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:09:45.479969 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-722f8b1e-1126-4310-81c7-63662b7d0f69 tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:09:45.655620 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:45.991200 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-722f8b1e-1126-4310-81c7-63662b7d0f69 tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.305s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:46.049689 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-722f8b1e-1126-4310-81c7-63662b7d0f69 tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Deleted allocations for instance c1dea755-6fa1-4d68-8194-2be27b092c1c
May 28 10:09:46.255772 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "46121fe0-6620-41cb-815d-a0a3b037d31f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:46.255941 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "46121fe0-6620-41cb-815d-a0a3b037d31f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:46.757910 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:09:47.060141 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-722f8b1e-1126-4310-81c7-63662b7d0f69 tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Lock "c1dea755-6fa1-4d68-8194-2be27b092c1c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.162s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:47.277505 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:47.304889 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:47.305067 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:47.308148 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:09:47.308306 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Claim successful on node np0000001613
May 28 10:09:48.322088 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.00045103000002200133 future=<Future at 0x73c1fc2f5e80 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:09:48.323176 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Emitting event <LifecycleEvent: 1779962973.321458, ca57808c-4f51-4a26-8724-d28394efab9f => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:09:48.323176 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:09:48.323343 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] VM Stopped (Lifecycle Event)
May 28 10:09:48.323343 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=8.437584815999799 future=<Future at 0x73c1f4239f70 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:09:48.323416 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=8.437484047999988 future=<Future at 0x73c1f4239f70 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:09:48.545243 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:09:48.545492 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:09:48.826733 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: ca57808c-4f51-4a26-8724-d28394efab9f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:09:49.047950 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:09:49.177057 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:49.555426 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.250s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:49.555857 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:09:49.758474 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:50.060887 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:09:50.061039 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:09:50.061299 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:09:50.061542 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:09:50.195761 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec58233d3b2848bbb2e0b00650398cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e9651268114327a9cc6c6c59bef01e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:09:50.567093 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:09:50.793052 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:09:50.793320 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98321) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
May 28 10:09:51.027667 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Successfully created port: dcc81325-0027-4773-8110-f559bfd767f2 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:09:51.081262 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:09:51.194799 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:51.297302 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.49 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:09:51.586380 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Booting with volume snapshot 9cec9b0c-2407-4334-8b91-5898a25d13bb at /dev/vda
May 28 10:09:51.778995 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Successfully updated port: dcc81325-0027-4773-8110-f559bfd767f2 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:09:51.792414 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:09:51.850278 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-74a00fc7-1a5a-45c6-b774-1c4951b9b2f8 req-9a186a67-e93b-414b-acb1-1fda803dc426 service nova] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Received event network-changed-dcc81325-0027-4773-8110-f559bfd767f2 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:09:51.850828 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-74a00fc7-1a5a-45c6-b774-1c4951b9b2f8 req-9a186a67-e93b-414b-acb1-1fda803dc426 service nova] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Refreshing instance network info cache due to event network-changed-dcc81325-0027-4773-8110-f559bfd767f2. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:09:51.850828 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-74a00fc7-1a5a-45c6-b774-1c4951b9b2f8 req-9a186a67-e93b-414b-acb1-1fda803dc426 service nova] Acquiring lock "refresh_cache-46121fe0-6620-41cb-815d-a0a3b037d31f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:09:51.850828 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-74a00fc7-1a5a-45c6-b774-1c4951b9b2f8 req-9a186a67-e93b-414b-acb1-1fda803dc426 service nova] Acquired lock "refresh_cache-46121fe0-6620-41cb-815d-a0a3b037d31f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:09:51.850828 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-74a00fc7-1a5a-45c6-b774-1c4951b9b2f8 req-9a186a67-e93b-414b-acb1-1fda803dc426 service nova] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Refreshing network info cache for port dcc81325-0027-4773-8110-f559bfd767f2 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:09:52.279306 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:52.281631 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "refresh_cache-46121fe0-6620-41cb-815d-a0a3b037d31f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:09:52.295322 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:09:52.354387 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-74a00fc7-1a5a-45c6-b774-1c4951b9b2f8 req-9a186a67-e93b-414b-acb1-1fda803dc426 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:09:52.429324 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-74a00fc7-1a5a-45c6-b774-1c4951b9b2f8 req-9a186a67-e93b-414b-acb1-1fda803dc426 service nova] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:09:52.665822 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-74a00fc7-1a5a-45c6-b774-1c4951b9b2f8 req-9a186a67-e93b-414b-acb1-1fda803dc426 service nova] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:09:53.169483 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-74a00fc7-1a5a-45c6-b774-1c4951b9b2f8 req-9a186a67-e93b-414b-acb1-1fda803dc426 service nova] Releasing lock "refresh_cache-46121fe0-6620-41cb-815d-a0a3b037d31f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:09:53.169899 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquired lock "refresh_cache-46121fe0-6620-41cb-815d-a0a3b037d31f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:09:53.170046 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:09:53.744787 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:09:53.955474 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-754c20b7-519b-4d2a-8ab9-0c6a3c4c6841 req-539862e1-f4d2-419f-b104-e65870ec3e3c service nova] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Received event network-vif-unplugged-dcc81325-0027-4773-8110-f559bfd767f2 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:09:53.955621 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-754c20b7-519b-4d2a-8ab9-0c6a3c4c6841 req-539862e1-f4d2-419f-b104-e65870ec3e3c service nova] Acquiring lock "46121fe0-6620-41cb-815d-a0a3b037d31f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:53.955752 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-754c20b7-519b-4d2a-8ab9-0c6a3c4c6841 req-539862e1-f4d2-419f-b104-e65870ec3e3c service nova] Lock "46121fe0-6620-41cb-815d-a0a3b037d31f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:53.955879 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-754c20b7-519b-4d2a-8ab9-0c6a3c4c6841 req-539862e1-f4d2-419f-b104-e65870ec3e3c service nova] Lock "46121fe0-6620-41cb-815d-a0a3b037d31f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:53.956153 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-754c20b7-519b-4d2a-8ab9-0c6a3c4c6841 req-539862e1-f4d2-419f-b104-e65870ec3e3c service nova] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] No waiting events found dispatching network-vif-unplugged-dcc81325-0027-4773-8110-f559bfd767f2 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:09:53.956153 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-754c20b7-519b-4d2a-8ab9-0c6a3c4c6841 req-539862e1-f4d2-419f-b104-e65870ec3e3c service nova] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Received unexpected event network-vif-unplugged-dcc81325-0027-4773-8110-f559bfd767f2 for instance with vm_state building and task_state block_device_mapping.
May 28 10:09:53.996863 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:09:54.205806 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Updating instance_info_cache with network_info: [{"id": "dcc81325-0027-4773-8110-f559bfd767f2", "address": "fa:16:3e:08:a3:85", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc81325-00", "ovs_interfaceid": "dcc81325-0027-4773-8110-f559bfd767f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:09:54.294621 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:09:54.294973 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.50 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:09:54.709584 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Releasing lock "refresh_cache-46121fe0-6620-41cb-815d-a0a3b037d31f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:09:54.709929 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Instance network_info: |[{"id": "dcc81325-0027-4773-8110-f559bfd767f2", "address": "fa:16:3e:08:a3:85", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc81325-00", "ovs_interfaceid": "dcc81325-0027-4773-8110-f559bfd767f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:09:54.734885 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:54.759595 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:54.792341 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:09:54.792341 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Cleaning up deleted instances {{(pid=98321) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
May 28 10:09:55.156356 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:09:55.171814 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:09:55.199766 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:09:55.251137 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:09:55.251745 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:09:55.266100 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:09:55.273221 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe1a:d1df', 'fe80::1c9e:daff:fee5:c4bc', 'fe80::fc16:3eff:fe5c:9e66', 'fe80::ec4e:cbff:fea7:f945', 'fe80::fc16:3eff:fe33:fbde', 'fe80::6807:fff:fe4c:bed3'] 
May 28 10:09:55.273221 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:09:55.273221 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:09:55.273221 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:09:55.273221 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Updating existing volume attachment record: 7c715a43-29f5-4b8b-a5d6-dc2683691450 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:09:55.297034 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] There are 0 instances to clean {{(pid=98321) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
May 28 10:09:55.297198 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:09:56.297085 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:09:56.297619 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.49 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:09:56.761353 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0004173540000920184 future=<Future at 0x73c1f4239f70 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:09:56.761978 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Emitting event <LifecycleEvent: 1779962981.7608345, c1dea755-6fa1-4d68-8194-2be27b092c1c => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:09:56.762189 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:09:56.762437 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] VM Stopped (Lifecycle Event)
May 28 10:09:56.791720 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:09:57.265094 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: c1dea755-6fa1-4d68-8194-2be27b092c1c] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:09:57.282528 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:57.286809 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:57.298218 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:57.298778 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:57.298778 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:57.298869 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Auditing locally available compute resources for np0000001613 (node: np0000001613) {{(pid=98321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 10:09:57.411194 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:09:57.411194 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:09:57.411421 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Creating image(s)
May 28 10:09:57.413142 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Did not create local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 10:09:57.413142 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Ensure instance console log exists: /opt/stack/data/nova/instances/46121fe0-6620-41cb-815d-a0a3b037d31f/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:09:57.413142 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:57.413142 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:57.413142 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:09:57.413142 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Start _get_guest_xml network_info=[{"id": "dcc81325-0027-4773-8110-f559bfd767f2", "address": "fa:16:3e:08:a3:85", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc81325-00", "ovs_interfaceid": "dcc81325-0027-4773-8110-f559bfd767f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4', 'iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '434449b8-853e-405b-82e6-1ca7b68349b4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '46121fe0-6620-41cb-815d-a0a3b037d31f', 'attached_at': '', 'detached_at': '', 'volume_id': '434449b8-853e-405b-82e6-1ca7b68349b4', 'serial': '434449b8-853e-405b-82e6-1ca7b68349b4'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '7c715a43-29f5-4b8b-a5d6-dc2683691450', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:09:57.418965 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:09:57.418965 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-2111987060', uuid='46121fe0-6620-41cb-815d-a0a3b037d31f'), owner=OwnerMeta(userid='ec58233d3b2848bbb2e0b00650398cd1', username='tempest-TestVolumeBootPattern-327944304-project-member', projectid='23e9651268114327a9cc6c6c59bef01e', projectname='tempest-TestVolumeBootPattern-327944304'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "dcc81325-0027-4773-8110-f559bfd767f2", "address": "fa:16:3e:08:a3:85", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc81325-00", "ovs_interfaceid": "dcc81325-0027-4773-8110-f559bfd767f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779962997.4184942) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:09:57.423434 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:09:57.423434 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:09:57.423434 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:09:57.423434 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:09:57.423434 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:09:57.423731 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:09:57.423908 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:09:57.424028 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:09:57.424198 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:09:57.424342 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:09:57.424498 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:09:57.424682 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:09:57.424817 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:09:57.424962 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:09:57.425098 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:09:57.425333 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:09:57.438645 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:09:57.438963 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4', 'iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '434449b8-853e-405b-82e6-1ca7b68349b4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:09:57.439101 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:09:57.439423 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:09:57.439689 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4', 'iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '434449b8-853e-405b-82e6-1ca7b68349b4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:09:57.455700 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:09:57.456435 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:09:57.457037 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:09:57.457570 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:09:57.457838 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:09:57.458125 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:09:57.472643 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:09:57.472643 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:57.483072 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:09:57.483072 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:57.491137 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4] added
May 28 10:09:57.491137 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:09:57.491137 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:09:57.491137 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:09:57.491137 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:09:57.491137 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:09:57.491137 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:57.491506 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:09:57.491552 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0341(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:09:57.491767 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:09:57.497094 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4] added
May 28 10:09:57.497094 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:09:57.497094 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:09:57.497094 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:09:57.497094 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:09:57.497094 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:09:57.497094 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:57.497367 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:09:57.497479 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0397(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:09:57.497613 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:09:58.336588 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ffe54bd-ad37-40a8-adfa-04e2ea9c9554/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:09:58.438712 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ffe54bd-ad37-40a8-adfa-04e2ea9c9554/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:09:58.439245 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ffe54bd-ad37-40a8-adfa-04e2ea9c9554/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:09:58.479222 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:09:58.492422 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:09:58.500312 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:09:58.514479 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:09:58.514479 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:09:58.516412 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:09:58.516412 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:58.532508 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:58.533098 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ffe54bd-ad37-40a8-adfa-04e2ea9c9554/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:09:58.534346 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:09:58.540176 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:09:58.541837 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:58.556196 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:58.556196 np0000001613 nova-compute[98321]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:58.556196 np0000001613 nova-compute[98321]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a8f1084-938a-4694-b70a-1e6fbe9b159c (non-flash)
May 28 10:09:58.556196 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:09:58.556196 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:58.556196 np0000001613 nova-compute[98321]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:58.556196 np0000001613 nova-compute[98321]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a8f1084-938a-4694-b70a-1e6fbe9b159c (non-flash)
May 28 10:09:58.556196 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:09:58.558258 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:58.558258 np0000001613 nova-compute[98321]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:58.558258 np0000001613 nova-compute[98321]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a8f1084-938a-4694-b70a-1e6fbe9b159c (non-flash)
May 28 10:09:58.558258 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:09:58.558258 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:58.558258 np0000001613 nova-compute[98321]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:58.558258 np0000001613 nova-compute[98321]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a8f1084-938a-4694-b70a-1e6fbe9b159c (non-flash)
May 28 10:09:58.558258 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:09:58.595085 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4, portal: 192.168.50.100,3260]
May 28 10:09:58.595085 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4, portal: 192.168.50.100,3260] successful.
May 28 10:09:58.595085 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:58.603369 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4, portal: 192.168.40.100,3260]
May 28 10:09:58.603369 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4, portal: 192.168.40.100,3260] successful.
May 28 10:09:58.603369 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:58.608725 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:58.616393 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:09:58.627480 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:58.627480 np0000001613 nova-compute[98321]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:58.627480 np0000001613 nova-compute[98321]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a8f1084-938a-4694-b70a-1e6fbe9b159c (non-flash)
May 28 10:09:58.627480 np0000001613 nova-compute[98321]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4 (non-flash)
May 28 10:09:58.627480 np0000001613 nova-compute[98321]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4 (non-flash)
May 28 10:09:58.627480 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:09:58.627680 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:58.627680 np0000001613 nova-compute[98321]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:58.627680 np0000001613 nova-compute[98321]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a8f1084-938a-4694-b70a-1e6fbe9b159c (non-flash)
May 28 10:09:58.627680 np0000001613 nova-compute[98321]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4 (non-flash)
May 28 10:09:58.627680 np0000001613 nova-compute[98321]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4 (non-flash)
May 28 10:09:58.627680 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:09:58.628095 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.171s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:09:58.628256 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:09:58.628967 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] HCTL ('9', '-', '-', 0) found on session 139 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:09:58.629090 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:09:58.632752 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:58.632752 np0000001613 nova-compute[98321]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:58.632752 np0000001613 nova-compute[98321]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a8f1084-938a-4694-b70a-1e6fbe9b159c (non-flash)
May 28 10:09:58.632752 np0000001613 nova-compute[98321]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4 (non-flash)
May 28 10:09:58.632752 np0000001613 nova-compute[98321]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4 (non-flash)
May 28 10:09:58.632752 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:09:58.632923 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:58.632923 np0000001613 nova-compute[98321]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:09:58.632923 np0000001613 nova-compute[98321]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a8f1084-938a-4694-b70a-1e6fbe9b159c (non-flash)
May 28 10:09:58.632923 np0000001613 nova-compute[98321]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4 (non-flash)
May 28 10:09:58.632923 np0000001613 nova-compute[98321]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4 (non-flash)
May 28 10:09:58.632923 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:09:58.633360 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.176s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:09:58.633534 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:09:58.634301 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] HCTL ('10', '-', '-', 0) found on session 140 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:09:58.634456 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:09:58.656010 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching for a device in session 139 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:09:58.656010 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '434449b8-853e-405b-82e6-1ca7b68349b4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:09:58.656010 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching for a device in session 140 and hctl ['10', '*', '*', 0] yield: None {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:09:58.664655 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:09:58.664655 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:09:58.765936 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:09:58.773312 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f42f06fc-5b0c-4973-98db-cd594815f317/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:09:58.880475 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f42f06fc-5b0c-4973-98db-cd594815f317/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:09:58.884181 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f42f06fc-5b0c-4973-98db-cd594815f317/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:09:58.971194 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f42f06fc-5b0c-4973-98db-cd594815f317/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:09:58.979184 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:09:58.979184 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:09:59.019982 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "env LANG=C uptime" returned: 0 in 0.043s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:09:59.023187 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Hypervisor/Node resource view: name=np0000001613 free_ram=12618MB free_disk=72.8470458984375GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 10:09:59.023187 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:09:59.023187 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:09:59.649994 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching for a device in session 140 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:09:59.650442 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '434449b8-853e-405b-82e6-1ca7b68349b4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:09:59.762574 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:00.117703 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:10:00.117907 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance edd8dcff-3440-445a-b4a2-8c56863e7ca3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:10:00.118053 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance f42f06fc-5b0c-4973-98db-cd594815f317 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:10:00.118208 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 46121fe0-6620-41cb-815d-a0a3b037d31f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:10:00.118444 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 10:10:00.118609 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Final resource view: name=np0000001613 phys_ram=24030MB used_ram=1280MB phys_disk=95GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 10:09:59 up 42 min,  2 users,  load average: 7.92, 7.51, 5.14\n', 'num_instances': '4', 'num_vm_active': '3', 'num_task_None': '3', 'num_os_type_None': '4', 'num_proj_42b5a6b6c4514b76a651b71280c093f5': '1', 'io_workload': '1', 'num_proj_c7563a83d33d4bc1a6610ccf53c18dc1': '1', 'num_proj_ba63ea134a6e4fe1992f53a0da46d034': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_23e9651268114327a9cc6c6c59bef01e': '1'} {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 10:10:00.389209 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:10:00.389464 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:10:00.430895 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:00.475739 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Found WWN 330000000ed90592b for multipath device dm-1 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:10:00.476058 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:10:00.476241 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '330000000ed90592b', 'path': '/dev/dm-1', 'multipath_id': '330000000ed90592b'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:10:00.476363 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ed90592b', 'path': '/dev/dm-1', 'multipath_id': '330000000ed90592b'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:10:00.893552 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:10:00.983744 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:09:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2111987060',display_name='tempest-TestVolumeBootPattern-server-2111987060',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpattern-server-2111987060',id=58,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23e9651268114327a9cc6c6c59bef01e',ramdisk_id='',reservation_id='r-zcqxcgiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-327944304',owner_user_name='tempest-TestVolumeBootPattern-327944304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:09:51Z,user_data=None,user_id='ec58233d3b2848bbb2e0b00650398cd1',uuid=46121fe0-6620-41cb-815d-a0a3b037d31f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dcc81325-0027-4773-8110-f559bfd767f2", "address": "fa:16:3e:08:a3:85", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc81325-00", "ovs_interfaceid": "dcc81325-0027-4773-8110-f559bfd767f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:10:00.983961 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converting VIF {"id": "dcc81325-0027-4773-8110-f559bfd767f2", "address": "fa:16:3e:08:a3:85", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc81325-00", "ovs_interfaceid": "dcc81325-0027-4773-8110-f559bfd767f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:10:00.984704 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:a3:85,bridge_name='br-int',has_traffic_filtering=True,id=dcc81325-0027-4773-8110-f559bfd767f2,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc81325-00') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:10:00.985406 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lazy-loading 'pci_devices' on Instance uuid 46121fe0-6620-41cb-815d-a0a3b037d31f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:10:01.404153 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Compute_service record updated for np0000001613:np0000001613 {{(pid=98321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 10:10:01.404331 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.383s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:01.404701 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:10:01.488946 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] End _get_guest_xml xml=<domain type="qemu">
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:   <uuid>46121fe0-6620-41cb-815d-a0a3b037d31f</uuid>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:   <name>instance-0000003a</name>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:       <nova:name>tempest-TestVolumeBootPattern-server-2111987060</nova:name>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:09:57</nova:creationTime>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:       <nova:image uuid="">
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:         <nova:user uuid="ec58233d3b2848bbb2e0b00650398cd1">tempest-TestVolumeBootPattern-327944304-project-member</nova:user>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:         <nova:project uuid="23e9651268114327a9cc6c6c59bef01e">tempest-TestVolumeBootPattern-327944304</nova:project>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:       <nova:root type="volume" uuid=""/>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:         <nova:port uuid="dcc81325-0027-4773-8110-f559bfd767f2">
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:     <system>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:       <entry name="serial">46121fe0-6620-41cb-815d-a0a3b037d31f</entry>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:       <entry name="uuid">46121fe0-6620-41cb-815d-a0a3b037d31f</entry>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:     </system>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:   <os>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:   </os>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:   <features>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:   </features>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:   <devices>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/46121fe0-6620-41cb-815d-a0a3b037d31f/disk.config"/>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:     </disk>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:       <alias name="ua-434449b8-853e-405b-82e6-1ca7b68349b4"/>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-1"/>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:       <serial>434449b8-853e-405b-82e6-1ca7b68349b4</serial>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:     </disk>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:08:a3:85"/>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:       <target dev="tapdcc81325-00"/>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:     </interface>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/46121fe0-6620-41cb-815d-a0a3b037d31f/console.log" append="off"/>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:     </serial>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:     <video>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:     </video>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:     </rng>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:   </devices>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]: </domain>
May 28 10:10:01.488946 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:10:01.493437 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Preparing to wait for external event network-vif-plugged-dcc81325-0027-4773-8110-f559bfd767f2 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:10:01.493725 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "46121fe0-6620-41cb-815d-a0a3b037d31f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:01.494085 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "46121fe0-6620-41cb-815d-a0a3b037d31f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:01.495608 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "46121fe0-6620-41cb-815d-a0a3b037d31f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:01.497410 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:09:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2111987060',display_name='tempest-TestVolumeBootPattern-server-2111987060',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpattern-server-2111987060',id=58,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23e9651268114327a9cc6c6c59bef01e',ramdisk_id='',reservation_id='r-zcqxcgiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-327944304',owner_user_name='tempest-TestVolumeBootPattern-327944304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:09:51Z,user_data=None,user_id='ec58233d3b2848bbb2e0b00650398cd1',uuid=46121fe0-6620-41cb-815d-a0a3b037d31f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dcc81325-0027-4773-8110-f559bfd767f2", "address": "fa:16:3e:08:a3:85", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc81325-00", "ovs_interfaceid": "dcc81325-0027-4773-8110-f559bfd767f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:10:01.497666 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converting VIF {"id": "dcc81325-0027-4773-8110-f559bfd767f2", "address": "fa:16:3e:08:a3:85", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc81325-00", "ovs_interfaceid": "dcc81325-0027-4773-8110-f559bfd767f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:10:01.498516 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:a3:85,bridge_name='br-int',has_traffic_filtering=True,id=dcc81325-0027-4773-8110-f559bfd767f2,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc81325-00') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:10:01.499121 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:a3:85,bridge_name='br-int',has_traffic_filtering=True,id=dcc81325-0027-4773-8110-f559bfd767f2,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc81325-00') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:10:01.500837 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:01.501179 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:10:01.501488 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:10:01.503905 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:01.504135 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f77683af-31ab-5d5e-9f24-e69bdecd4c80', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:10:01.504993 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:01.506546 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:01.510208 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:01.510402 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdcc81325-00, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:10:01.510764 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdcc81325-00, col_values=(('qos', UUID('77be1197-48b8-4bac-be0d-b4a66fe36865')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:10:01.510993 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdcc81325-00, col_values=(('external_ids', {'iface-id': 'dcc81325-0027-4773-8110-f559bfd767f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:a3:85', 'vm-uuid': '46121fe0-6620-41cb-815d-a0a3b037d31f'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:10:01.511978 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:01.513397 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:10:01.521444 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:01.524353 np0000001613 nova-compute[98321]: INFO os_vif [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:a3:85,bridge_name='br-int',has_traffic_filtering=True,id=dcc81325-0027-4773-8110-f559bfd767f2,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc81325-00')
May 28 10:10:02.400841 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:10:02.401595 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:10:02.401595 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:10:02.401595 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:10:02.401595 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 10:10:02.401917 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.39 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:10:02.791955 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:10:02.792711 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 53.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:10:03.048493 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:10:03.048635 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:10:03.048780 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] No VIF found with MAC fa:16:3e:08:a3:85, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:10:03.049183 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Using config drive
May 28 10:10:03.516067 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:03.559223 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:03.745196 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Creating config drive at /opt/stack/data/nova/instances/46121fe0-6620-41cb-815d-a0a3b037d31f/disk.config
May 28 10:10:03.745269 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/46121fe0-6620-41cb-815d-a0a3b037d31f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp549whwnx {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:10:03.806012 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/46121fe0-6620-41cb-815d-a0a3b037d31f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp549whwnx" returned: 0 in 0.060s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:10:04.274277 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:04.308804 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:04.416403 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:04.694773 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:04.697474 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:04.700572 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:04.728431 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:04.762282 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:05.236181 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963005.2356462, 46121fe0-6620-41cb-815d-a0a3b037d31f => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:10:05.239696 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] VM Started (Lifecycle Event)
May 28 10:10:05.314962 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:05.720116 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Acquiring lock "1ffe54bd-ad37-40a8-adfa-04e2ea9c9554" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:05.722274 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "1ffe54bd-ad37-40a8-adfa-04e2ea9c9554" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:05.744237 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:10:05.747201 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963005.7469451, 46121fe0-6620-41cb-815d-a0a3b037d31f => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:10:05.747384 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] VM Paused (Lifecycle Event)
May 28 10:10:06.219023 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-18a1e302-30e1-4122-a3fc-c688c7781f34 req-4c2e4a53-0380-451b-991a-fb5158a7bc1f service nova] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Received event network-vif-plugged-dcc81325-0027-4773-8110-f559bfd767f2 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:10:06.219245 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-18a1e302-30e1-4122-a3fc-c688c7781f34 req-4c2e4a53-0380-451b-991a-fb5158a7bc1f service nova] Acquiring lock "46121fe0-6620-41cb-815d-a0a3b037d31f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:06.219468 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-18a1e302-30e1-4122-a3fc-c688c7781f34 req-4c2e4a53-0380-451b-991a-fb5158a7bc1f service nova] Lock "46121fe0-6620-41cb-815d-a0a3b037d31f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:06.219531 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-18a1e302-30e1-4122-a3fc-c688c7781f34 req-4c2e4a53-0380-451b-991a-fb5158a7bc1f service nova] Lock "46121fe0-6620-41cb-815d-a0a3b037d31f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:06.219603 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-18a1e302-30e1-4122-a3fc-c688c7781f34 req-4c2e4a53-0380-451b-991a-fb5158a7bc1f service nova] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Processing event network-vif-plugged-dcc81325-0027-4773-8110-f559bfd767f2 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:10:06.220117 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:10:06.224525 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Detaching volume 783442cf-b315-459d-9489-3289c8ac0fc0
May 28 10:10:06.228134 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:10:06.233959 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Instance spawned successfully.
May 28 10:10:06.234260 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:10:06.251791 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:10:06.255405 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963006.254979, 46121fe0-6620-41cb-815d-a0a3b037d31f => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:10:06.255405 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] VM Resumed (Lifecycle Event)
May 28 10:10:06.293957 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Attempting to driver detach volume 783442cf-b315-459d-9489-3289c8ac0fc0 from mountpoint /dev/vdb
May 28 10:10:06.302571 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Found disk vdb by alias ua-783442cf-b315-459d-9489-3289c8ac0fc0 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:10:06.304499 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Found disk vdb by alias ua-783442cf-b315-459d-9489-3289c8ac0fc0 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:10:06.304675 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Attempting to detach device vdb from instance 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554 from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 10:10:06.304965 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:10:06.304965 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:10:06.304965 np0000001613 nova-compute[98321]:   <alias name="ua-783442cf-b315-459d-9489-3289c8ac0fc0"/>
May 28 10:10:06.304965 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-0"/>
May 28 10:10:06.304965 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:10:06.304965 np0000001613 nova-compute[98321]:   <serial>783442cf-b315-459d-9489-3289c8ac0fc0</serial>
May 28 10:10:06.304965 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:10:06.304965 np0000001613 nova-compute[98321]: </disk>
May 28 10:10:06.304965 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:10:06.312271 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Successfully detached device vdb from instance 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554 from the persistent domain config.
May 28 10:10:06.312576 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] (1/8): Attempting to detach device vdb with device alias ua-783442cf-b315-459d-9489-3289c8ac0fc0 from instance 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554 from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 10:10:06.312827 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:10:06.312827 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:10:06.312827 np0000001613 nova-compute[98321]:   <alias name="ua-783442cf-b315-459d-9489-3289c8ac0fc0"/>
May 28 10:10:06.312827 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-0"/>
May 28 10:10:06.312827 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:10:06.312827 np0000001613 nova-compute[98321]:   <serial>783442cf-b315-459d-9489-3289c8ac0fc0</serial>
May 28 10:10:06.312827 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:10:06.312827 np0000001613 nova-compute[98321]: </disk>
May 28 10:10:06.312827 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:10:06.349197 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:06.349559 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:06.512945 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:06.744108 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:10:06.746187 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:10:06.746187 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:10:06.748189 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:10:06.748189 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:10:06.748189 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:10:06.757908 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:10:06.762982 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:10:06.853234 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lazy-loading 'flavor' on Instance uuid edd8dcff-3440-445a-b4a2-8c56863e7ca3 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:10:07.023699 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-783442cf-b315-459d-9489-3289c8ac0fc0 for instance 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554 {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 10:10:07.257332 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Took 9.85 seconds to spawn the instance on the hypervisor.
May 28 10:10:07.258810 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:10:07.269353 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:10:07.270579 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779963007.2701063, 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554 => ua-783442cf-b315-459d-9489-3289c8ac0fc0> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 10:10:07.276341 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Successfully detached device vdb from instance 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554 from the live domain config.
May 28 10:10:07.279606 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:10:07.280855 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0', 'iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '783442cf-b315-459d-9489-3289c8ac0fc0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:10:07.281733 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:10:07.282357 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:10:07.284617 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0', 'iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '783442cf-b315-459d-9489-3289c8ac0fc0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:10:07.284617 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:10:07.315676 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:10:07.315676 np0000001613 nova-compute[98321]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:10:07.315676 np0000001613 nova-compute[98321]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4 (non-flash)
May 28 10:10:07.315676 np0000001613 nova-compute[98321]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4 (non-flash)
May 28 10:10:07.315676 np0000001613 nova-compute[98321]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-145b9f35-d27f-434b-9323-c18d7f8607a7 (non-flash)
May 28 10:10:07.315676 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:10:07.315951 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsi session list stdout=tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:10:07.315951 np0000001613 nova-compute[98321]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0 (non-flash)
May 28 10:10:07.315951 np0000001613 nova-compute[98321]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4 (non-flash)
May 28 10:10:07.315951 np0000001613 nova-compute[98321]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4 (non-flash)
May 28 10:10:07.315951 np0000001613 nova-compute[98321]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-145b9f35-d27f-434b-9323-c18d7f8607a7 (non-flash)
May 28 10:10:07.315951 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:10:07.316118 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0', '128'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0', '129'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4', '139'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4', '140'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-145b9f35-d27f-434b-9323-c18d7f8607a7', '141')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:10:07.317984 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0', '129')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:10:07.320099 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0', '128')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:10:07.320099 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1f4490ea0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0'): ({'sdc'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:10:07.320338 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Removing multipathed devices sdf, sdc {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:10:07.320543 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Flush multipath device 330000000ee77c9a5 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:10:07.354144 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:10:07.397066 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:10:07.449660 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Checking to see if SCSI volumes sdf, sdc have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:10:07.449660 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] SCSI volumes sdf, sdc have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:10:07.449660 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Checking to see if device paths {'sdf', 'sdc'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:10:07.466001 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Device paths {'sdf', 'sdc'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:10:07.466242 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:10:07.479973 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:07.518130 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 129, target: iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0, portal: 192.168.40.100,3260]
May 28 10:10:07.518130 np0000001613 nova-compute[98321]: Logout of [sid: 129, target: iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0, portal: 192.168.40.100,3260] successful.
May 28 10:10:07.518130 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:07.539521 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:07.550828 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:07.580494 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 128, target: iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0, portal: 192.168.50.100,3260]
May 28 10:10:07.580494 np0000001613 nova-compute[98321]: Logout of [sid: 128, target: iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0, portal: 192.168.50.100,3260] successful.
May 28 10:10:07.580494 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:07.595298 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:07.595609 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:10:07.595797 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] <== disconnect_volume: return (314ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:10:07.595948 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:10:07.778312 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Took 20.52 seconds to build instance.
May 28 10:10:07.862383 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:08.178694 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lazy-loading 'flavor' on Instance uuid 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:10:08.279876 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d69cc37e-b2db-4bc7-8c00-7e38c1b18b24 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "46121fe0-6620-41cb-815d-a0a3b037d31f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.024s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:08.332047 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d39e206a-3eff-4231-ae48-b5b2190c0431 req-49919bd5-d07d-4944-8625-21a5dc4c2702 service nova] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Received event network-vif-plugged-dcc81325-0027-4773-8110-f559bfd767f2 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:10:08.332298 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d39e206a-3eff-4231-ae48-b5b2190c0431 req-49919bd5-d07d-4944-8625-21a5dc4c2702 service nova] Acquiring lock "46121fe0-6620-41cb-815d-a0a3b037d31f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:08.332520 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d39e206a-3eff-4231-ae48-b5b2190c0431 req-49919bd5-d07d-4944-8625-21a5dc4c2702 service nova] Lock "46121fe0-6620-41cb-815d-a0a3b037d31f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:08.333301 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d39e206a-3eff-4231-ae48-b5b2190c0431 req-49919bd5-d07d-4944-8625-21a5dc4c2702 service nova] Lock "46121fe0-6620-41cb-815d-a0a3b037d31f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:08.333632 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d39e206a-3eff-4231-ae48-b5b2190c0431 req-49919bd5-d07d-4944-8625-21a5dc4c2702 service nova] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] No waiting events found dispatching network-vif-plugged-dcc81325-0027-4773-8110-f559bfd767f2 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:10:08.333909 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-d39e206a-3eff-4231-ae48-b5b2190c0431 req-49919bd5-d07d-4944-8625-21a5dc4c2702 service nova] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Received unexpected event network-vif-plugged-dcc81325-0027-4773-8110-f559bfd767f2 for instance with vm_state active and task_state None.
May 28 10:10:08.931310 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "c0786416-dec3-4610-9ec2-389aa7508148" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:08.933064 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "c0786416-dec3-4610-9ec2-389aa7508148" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:09.021929 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Acquiring lock "1ffe54bd-ad37-40a8-adfa-04e2ea9c9554" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:09.060554 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:09.064186 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:09.064186 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Attaching volume 1ddb1344-a4d2-4480-9818-32c65d8ad963 to /dev/vdb
May 28 10:10:09.128298 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:10:09.141872 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:10:09.168780 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:10:09.188192 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8dfaaf2a-254b-4ae4-96ea-e31a0da246de tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "1ffe54bd-ad37-40a8-adfa-04e2ea9c9554" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.467s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:09.192479 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "1ffe54bd-ad37-40a8-adfa-04e2ea9c9554" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.167s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:09.193278 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Acquiring lock "1ffe54bd-ad37-40a8-adfa-04e2ea9c9554-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:09.193565 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "1ffe54bd-ad37-40a8-adfa-04e2ea9c9554-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:09.193792 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "1ffe54bd-ad37-40a8-adfa-04e2ea9c9554-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:09.199541 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Terminating instance
May 28 10:10:09.216058 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:10:09.217018 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:10:09.226668 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:10:09.229229 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe08:a385', 'fe80::e4eb:4cff:fe5c:5eb7', 'fe80::fc16:3eff:fe1a:d1df', 'fe80::1c9e:daff:fee5:c4bc', 'fe80::fc16:3eff:fe5c:9e66', 'fe80::ec4e:cbff:fea7:f945', 'fe80::fc16:3eff:fe33:fbde', 'fe80::6807:fff:fe4c:bed3'] 
May 28 10:10:09.229229 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:10:09.230518 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:10:09.230518 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] <== get_connector_properties: return (101ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:10:09.230776 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Updating existing volume attachment record: 7c8687d9-0a5c-4bb2-8430-57adca441e14 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:10:09.437113 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:10:09.470299 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "46121fe0-6620-41cb-815d-a0a3b037d31f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:09.470299 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "46121fe0-6620-41cb-815d-a0a3b037d31f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:09.470299 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "46121fe0-6620-41cb-815d-a0a3b037d31f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:09.470299 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "46121fe0-6620-41cb-815d-a0a3b037d31f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:09.470299 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "46121fe0-6620-41cb-815d-a0a3b037d31f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:09.472892 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Terminating instance
May 28 10:10:09.705597 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:10:09.731302 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:09.756748 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:09.760799 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:09.795748 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:09.847880 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ddb1344-a4d2-4480-9818-32c65d8ad963', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'edd8dcff-3440-445a-b4a2-8c56863e7ca3', 'attached_at': '', 'detached_at': '', 'volume_id': '1ddb1344-a4d2-4480-9818-32c65d8ad963', 'serial': '1ddb1344-a4d2-4480-9818-32c65d8ad963'} {{(pid=98321) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 10:10:09.853598 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:10:09.853598 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ddb1344-a4d2-4480-9818-32c65d8ad963', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:10:09.853598 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:10:09.853598 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:10:09.853598 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ddb1344-a4d2-4480-9818-32c65d8ad963', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:10:09.865883 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:10:09.866567 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:10:09.867088 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:10:09.867652 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:10:09.867961 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:10:09.868266 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:10:09.881551 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:10:09.881551 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:09.894103 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:10:09.894103 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:09.905644 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963] added
May 28 10:10:09.905644 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:10:09.905644 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:10:09.905644 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:10:09.905644 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:10:09.905644 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:10:09.905644 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:09.905921 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:10:09.906145 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0382(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:10:09.906406 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:10:09.910065 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963] added
May 28 10:10:09.910065 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:10:09.910065 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:10:09.910065 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:10:09.910065 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:10:09.910065 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:10:09.910065 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:09.910298 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:10:09.910452 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0428(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:10:09.912873 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:10:09.975897 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:10:10.006996 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:10.013674 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:10.035452 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:10.046438 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:10.051900 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999590708000142 future=<Future at 0x73c1f4044980 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:10:10.053206 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.998379243999807 future=<Future at 0x73c1f4044980 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:10:10.053440 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.99800563000008 future=<Future at 0x73c1f4044980 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:10:10.054581 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Instance destroyed successfully.
May 28 10:10:10.054781 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lazy-loading 'resources' on Instance uuid 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:10:10.074036 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:10.081711 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:10.146238 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:10.146458 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:10.150574 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:10:10.150959 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Claim successful on node np0000001613
May 28 10:10:10.296712 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999695554000027 future=<Future at 0x73c1fc334fb0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:10:10.298635 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Instance destroyed successfully.
May 28 10:10:10.299046 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lazy-loading 'resources' on Instance uuid 46121fe0-6620-41cb-815d-a0a3b037d31f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:10:10.404715 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e8931d00-5bed-4193-9e15-330aa205358b req-7a4cf4b4-bcf2-47e7-ab10-292e453c31bf service nova] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Received event network-vif-unplugged-aecaae00-e4ff-458c-9255-8e7026a57820 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:10:10.405253 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e8931d00-5bed-4193-9e15-330aa205358b req-7a4cf4b4-bcf2-47e7-ab10-292e453c31bf service nova] Acquiring lock "1ffe54bd-ad37-40a8-adfa-04e2ea9c9554-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:10.405501 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e8931d00-5bed-4193-9e15-330aa205358b req-7a4cf4b4-bcf2-47e7-ab10-292e453c31bf service nova] Lock "1ffe54bd-ad37-40a8-adfa-04e2ea9c9554-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:10.405663 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e8931d00-5bed-4193-9e15-330aa205358b req-7a4cf4b4-bcf2-47e7-ab10-292e453c31bf service nova] Lock "1ffe54bd-ad37-40a8-adfa-04e2ea9c9554-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:10.405920 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e8931d00-5bed-4193-9e15-330aa205358b req-7a4cf4b4-bcf2-47e7-ab10-292e453c31bf service nova] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] No waiting events found dispatching network-vif-unplugged-aecaae00-e4ff-458c-9255-8e7026a57820 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:10:10.405920 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e8931d00-5bed-4193-9e15-330aa205358b req-7a4cf4b4-bcf2-47e7-ab10-292e453c31bf service nova] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Received event network-vif-unplugged-aecaae00-e4ff-458c-9255-8e7026a57820 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:10:10.406044 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e8931d00-5bed-4193-9e15-330aa205358b req-7a4cf4b4-bcf2-47e7-ab10-292e453c31bf service nova] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Received event network-vif-unplugged-aecaae00-e4ff-458c-9255-8e7026a57820 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:10:10.406213 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e8931d00-5bed-4193-9e15-330aa205358b req-7a4cf4b4-bcf2-47e7-ab10-292e453c31bf service nova] Acquiring lock "1ffe54bd-ad37-40a8-adfa-04e2ea9c9554-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:10.406386 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e8931d00-5bed-4193-9e15-330aa205358b req-7a4cf4b4-bcf2-47e7-ab10-292e453c31bf service nova] Lock "1ffe54bd-ad37-40a8-adfa-04e2ea9c9554-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:10.406549 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e8931d00-5bed-4193-9e15-330aa205358b req-7a4cf4b4-bcf2-47e7-ab10-292e453c31bf service nova] Lock "1ffe54bd-ad37-40a8-adfa-04e2ea9c9554-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:10.406692 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e8931d00-5bed-4193-9e15-330aa205358b req-7a4cf4b4-bcf2-47e7-ab10-292e453c31bf service nova] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] No waiting events found dispatching network-vif-unplugged-aecaae00-e4ff-458c-9255-8e7026a57820 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:10:10.406847 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e8931d00-5bed-4193-9e15-330aa205358b req-7a4cf4b4-bcf2-47e7-ab10-292e453c31bf service nova] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Received event network-vif-unplugged-aecaae00-e4ff-458c-9255-8e7026a57820 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:10:10.406984 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e8931d00-5bed-4193-9e15-330aa205358b req-7a4cf4b4-bcf2-47e7-ab10-292e453c31bf service nova] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Received event network-vif-unplugged-dcc81325-0027-4773-8110-f559bfd767f2 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:10:10.407149 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e8931d00-5bed-4193-9e15-330aa205358b req-7a4cf4b4-bcf2-47e7-ab10-292e453c31bf service nova] Acquiring lock "46121fe0-6620-41cb-815d-a0a3b037d31f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:10.407400 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e8931d00-5bed-4193-9e15-330aa205358b req-7a4cf4b4-bcf2-47e7-ab10-292e453c31bf service nova] Lock "46121fe0-6620-41cb-815d-a0a3b037d31f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:10.407540 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e8931d00-5bed-4193-9e15-330aa205358b req-7a4cf4b4-bcf2-47e7-ab10-292e453c31bf service nova] Lock "46121fe0-6620-41cb-815d-a0a3b037d31f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:10.407864 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e8931d00-5bed-4193-9e15-330aa205358b req-7a4cf4b4-bcf2-47e7-ab10-292e453c31bf service nova] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] No waiting events found dispatching network-vif-unplugged-dcc81325-0027-4773-8110-f559bfd767f2 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:10:10.407995 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e8931d00-5bed-4193-9e15-330aa205358b req-7a4cf4b4-bcf2-47e7-ab10-292e453c31bf service nova] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Received event network-vif-unplugged-dcc81325-0027-4773-8110-f559bfd767f2 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:10:10.408111 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e8931d00-5bed-4193-9e15-330aa205358b req-7a4cf4b4-bcf2-47e7-ab10-292e453c31bf service nova] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Received event network-vif-unplugged-dcc81325-0027-4773-8110-f559bfd767f2 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:10:10.408268 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e8931d00-5bed-4193-9e15-330aa205358b req-7a4cf4b4-bcf2-47e7-ab10-292e453c31bf service nova] Acquiring lock "46121fe0-6620-41cb-815d-a0a3b037d31f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:10.408392 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e8931d00-5bed-4193-9e15-330aa205358b req-7a4cf4b4-bcf2-47e7-ab10-292e453c31bf service nova] Lock "46121fe0-6620-41cb-815d-a0a3b037d31f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:10.408497 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e8931d00-5bed-4193-9e15-330aa205358b req-7a4cf4b4-bcf2-47e7-ab10-292e453c31bf service nova] Lock "46121fe0-6620-41cb-815d-a0a3b037d31f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:10.408588 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e8931d00-5bed-4193-9e15-330aa205358b req-7a4cf4b4-bcf2-47e7-ab10-292e453c31bf service nova] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] No waiting events found dispatching network-vif-unplugged-dcc81325-0027-4773-8110-f559bfd767f2 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:10:10.408679 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e8931d00-5bed-4193-9e15-330aa205358b req-7a4cf4b4-bcf2-47e7-ab10-292e453c31bf service nova] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Received event network-vif-unplugged-dcc81325-0027-4773-8110-f559bfd767f2 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:10:10.560097 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:08:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-1535374086',display_name='tempest-VolumesBackupsTest-instance-1535374086',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumesbackupstest-instance-1535374086',id=50,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlD6Xkf+iVp8XkesmEA5ZcWSWd93QfIFV1WWnAb6VaYxJ8IbMQ1VfOuVjOK3r0w6k587SaA/OHTCZQRTW5BV2+Bj8BdXACZtM5UYMESAXfYtjMa+MTgntg05vMEyJjaew==',key_name='tempest-keypair-461790367',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:08:28Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42b5a6b6c4514b76a651b71280c093f5',ramdisk_id='',reservation_id='r-2q9sbxdb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-1901675516',owner_user_name='tempest-VolumesBackupsTest-1901675516-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:08:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='655e1aff31fe454ab046a71daad5a888',uuid=1ffe54bd-ad37-40a8-adfa-04e2ea9c9554,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aecaae00-e4ff-458c-9255-8e7026a57820", "address": "fa:16:3e:1a:d1:df", "network": {"id": "6b4547f5-30ae-4bcf-b4e5-b7ffc2bcd25d", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1107528011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "42b5a6b6c4514b76a651b71280c093f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaecaae00-e4", "ovs_interfaceid": "aecaae00-e4ff-458c-9255-8e7026a57820", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:10:10.560436 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Converting VIF {"id": "aecaae00-e4ff-458c-9255-8e7026a57820", "address": "fa:16:3e:1a:d1:df", "network": {"id": "6b4547f5-30ae-4bcf-b4e5-b7ffc2bcd25d", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1107528011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "42b5a6b6c4514b76a651b71280c093f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaecaae00-e4", "ovs_interfaceid": "aecaae00-e4ff-458c-9255-8e7026a57820", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:10:10.561134 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:d1:df,bridge_name='br-int',has_traffic_filtering=True,id=aecaae00-e4ff-458c-9255-8e7026a57820,network=Network(6b4547f5-30ae-4bcf-b4e5-b7ffc2bcd25d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaecaae00-e4') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:10:10.561452 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:d1:df,bridge_name='br-int',has_traffic_filtering=True,id=aecaae00-e4ff-458c-9255-8e7026a57820,network=Network(6b4547f5-30ae-4bcf-b4e5-b7ffc2bcd25d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaecaae00-e4') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:10:10.562712 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:10.562938 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaecaae00-e4, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:10:10.563860 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:10.564761 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:10:10.573339 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:10.574044 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:10.574196 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7b40cbb4-5b69-4461-ae33-9e34f10d4265) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:10:10.574626 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:10.575131 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:10:10.581193 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:10.583265 np0000001613 nova-compute[98321]: INFO os_vif [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:d1:df,bridge_name='br-int',has_traffic_filtering=True,id=aecaae00-e4ff-458c-9255-8e7026a57820,network=Network(6b4547f5-30ae-4bcf-b4e5-b7ffc2bcd25d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaecaae00-e4')
May 28 10:10:10.587656 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:10:10.591313 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0', 'iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '783442cf-b315-459d-9489-3289c8ac0fc0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:10:10.591488 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:10:10.802900 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:09:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2111987060',display_name='tempest-TestVolumeBootPattern-server-2111987060',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpattern-server-2111987060',id=58,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:10:07Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='23e9651268114327a9cc6c6c59bef01e',ramdisk_id='',reservation_id='r-zcqxcgiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-327944304',owner_user_name='tempest-TestVolumeBootPattern-327944304-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:10:07Z,user_data=None,user_id='ec58233d3b2848bbb2e0b00650398cd1',uuid=46121fe0-6620-41cb-815d-a0a3b037d31f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dcc81325-0027-4773-8110-f559bfd767f2", "address": "fa:16:3e:08:a3:85", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc81325-00", "ovs_interfaceid": "dcc81325-0027-4773-8110-f559bfd767f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:10:10.803113 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converting VIF {"id": "dcc81325-0027-4773-8110-f559bfd767f2", "address": "fa:16:3e:08:a3:85", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc81325-00", "ovs_interfaceid": "dcc81325-0027-4773-8110-f559bfd767f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:10:10.803618 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:a3:85,bridge_name='br-int',has_traffic_filtering=True,id=dcc81325-0027-4773-8110-f559bfd767f2,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc81325-00') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:10:10.803833 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:a3:85,bridge_name='br-int',has_traffic_filtering=True,id=dcc81325-0027-4773-8110-f559bfd767f2,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc81325-00') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:10:10.804800 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:10.805100 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdcc81325-00, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:10:10.806685 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:10.807585 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:10:10.807988 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:10.808118 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=77be1197-48b8-4bac-be0d-b4a66fe36865) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:10:10.808558 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:10.809109 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:10:10.809294 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:10.811269 np0000001613 nova-compute[98321]: INFO os_vif [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:a3:85,bridge_name='br-int',has_traffic_filtering=True,id=dcc81325-0027-4773-8110-f559bfd767f2,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc81325-00')
May 28 10:10:10.812570 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:10:10.812848 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4', 'iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '434449b8-853e-405b-82e6-1ca7b68349b4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:10:10.812964 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:10:10.906881 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:10:10.911488 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:10:10.920198 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:10:10.920198 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:10:10.928615 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:10:10.928615 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:10.941204 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:10.951074 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:10.958336 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4 (non-flash)
May 28 10:10:10.958336 np0000001613 nova-compute[98321]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4 (non-flash)
May 28 10:10:10.958336 np0000001613 nova-compute[98321]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-145b9f35-d27f-434b-9323-c18d7f8607a7 (non-flash)
May 28 10:10:10.958336 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:10:10.958598 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsi session list stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4 (non-flash)
May 28 10:10:10.958598 np0000001613 nova-compute[98321]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4 (non-flash)
May 28 10:10:10.958598 np0000001613 nova-compute[98321]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-145b9f35-d27f-434b-9323-c18d7f8607a7 (non-flash)
May 28 10:10:10.958598 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:10:10.968051 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4 (non-flash)
May 28 10:10:10.968051 np0000001613 nova-compute[98321]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4 (non-flash)
May 28 10:10:10.968051 np0000001613 nova-compute[98321]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-145b9f35-d27f-434b-9323-c18d7f8607a7 (non-flash)
May 28 10:10:10.968051 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:10:10.968282 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsi session list stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4 (non-flash)
May 28 10:10:10.968282 np0000001613 nova-compute[98321]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4 (non-flash)
May 28 10:10:10.968282 np0000001613 nova-compute[98321]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-145b9f35-d27f-434b-9323-c18d7f8607a7 (non-flash)
May 28 10:10:10.968282 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:10:11.000509 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963, portal: 192.168.50.100,3260]
May 28 10:10:11.000509 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963, portal: 192.168.50.100,3260] successful.
May 28 10:10:11.000509 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:11.011435 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:11.015911 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963, portal: 192.168.40.100,3260]
May 28 10:10:11.015911 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963, portal: 192.168.40.100,3260] successful.
May 28 10:10:11.015911 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:11.026057 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4 (non-flash)
May 28 10:10:11.026057 np0000001613 nova-compute[98321]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4 (non-flash)
May 28 10:10:11.026057 np0000001613 nova-compute[98321]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-145b9f35-d27f-434b-9323-c18d7f8607a7 (non-flash)
May 28 10:10:11.026057 np0000001613 nova-compute[98321]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:11.026057 np0000001613 nova-compute[98321]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:11.026057 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:10:11.026337 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsi session list stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4 (non-flash)
May 28 10:10:11.026337 np0000001613 nova-compute[98321]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4 (non-flash)
May 28 10:10:11.026337 np0000001613 nova-compute[98321]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-145b9f35-d27f-434b-9323-c18d7f8607a7 (non-flash)
May 28 10:10:11.026337 np0000001613 nova-compute[98321]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:11.026337 np0000001613 nova-compute[98321]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:11.026337 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:10:11.026625 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:11.026854 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.160s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:10:11.026970 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:10:11.027783 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] HCTL ('8', '-', '-', 0) found on session 142 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:10:11.027897 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:10:11.040409 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4 (non-flash)
May 28 10:10:11.040409 np0000001613 nova-compute[98321]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4 (non-flash)
May 28 10:10:11.040409 np0000001613 nova-compute[98321]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-145b9f35-d27f-434b-9323-c18d7f8607a7 (non-flash)
May 28 10:10:11.040409 np0000001613 nova-compute[98321]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:11.040409 np0000001613 nova-compute[98321]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:11.040409 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:10:11.040602 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsi session list stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4 (non-flash)
May 28 10:10:11.040602 np0000001613 nova-compute[98321]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4 (non-flash)
May 28 10:10:11.040602 np0000001613 nova-compute[98321]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-145b9f35-d27f-434b-9323-c18d7f8607a7 (non-flash)
May 28 10:10:11.040602 np0000001613 nova-compute[98321]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:11.040602 np0000001613 nova-compute[98321]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:11.040602 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:10:11.040903 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.174s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:10:11.041082 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:10:11.041799 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] HCTL ('11', '-', '-', 0) found on session 143 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:10:11.041909 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:10:11.050721 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Searching for a device in session 142 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:10:11.051453 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '1ddb1344-a4d2-4480-9818-32c65d8ad963', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:10:11.057259 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Searching for a device in session 143 and hctl ['11', '*', '*', 0] yield: None {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:10:11.224568 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Refreshing inventories for resource provider ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 28 10:10:11.267698 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Updating ProviderTree inventory for provider ad4de091-3626-4008-ac9a-3e83de44a510 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 28 10:10:11.267883 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Updating inventory in ProviderTree for provider ad4de091-3626-4008-ac9a-3e83de44a510 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 28 10:10:11.310749 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Refreshing aggregate associations for resource provider ad4de091-3626-4008-ac9a-3e83de44a510, aggregates: None {{(pid=98321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 28 10:10:11.362071 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Refreshing trait associations for resource provider ad4de091-3626-4008-ac9a-3e83de44a510, traits: COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ARCH_PPC64LE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ARCH_RISCV64,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_ARCH_S390X,COMPUTE_VOLUME_EXTEND,COMPUTE_ARCH_AARCH64,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOUND_MODEL_SB16,COMPUTE_ACCELERATORS,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_SOUND_MODEL_AC97,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_ARCH_MIPSEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_LAN9118,HW_ARCH_X86_64,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ARCH_X86_64,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOUND_MODEL_USB,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=98321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 28 10:10:11.626489 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:10:11.626911 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:10:12.057460 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Searching for a device in session 143 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:10:12.057828 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ddb1344-a4d2-4480-9818-32c65d8ad963', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:10:12.129589 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:10:12.636317 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.490s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:12.636696 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:10:12.888336 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Found WWN 330000000e79767bf for multipath device dm-0 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:10:12.888529 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:10:12.888973 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.297s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:10:12.889307 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0', 'iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '783442cf-b315-459d-9489-3289c8ac0fc0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:10:12.889470 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:10:12.890500 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '330000000e79767bf', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000e79767bf'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:10:12.890500 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e79767bf', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000e79767bf'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:10:12.892000 np0000001613 nova-compute[98321]: WARNING stevedore.named [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 10:10:12.892188 np0000001613 nova-compute[98321]: WARNING castellan.key_manager [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 10:10:12.892329 np0000001613 nova-compute[98321]: WARNING nova.keymgr.conf_key_mgr [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 10:10:12.911201 np0000001613 nova-compute[98321]: WARNING os_brick.encryptors.luks [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 28 10:10:12.911471 np0000001613 nova-compute[98321]: WARNING stevedore.named [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 10:10:12.911771 np0000001613 nova-compute[98321]: WARNING castellan.key_manager [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 10:10:12.911924 np0000001613 nova-compute[98321]: WARNING nova.keymgr.conf_key_mgr [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 10:10:12.912457 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x73c1fc294260>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ddb1344-a4d2-4480-9818-32c65d8ad963', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': 'edd8dcff-3440-445a-b4a2-8c56863e7ca3', 'attached_at': '', 'detached_at': '', 'volume_id': '1ddb1344-a4d2-4480-9818-32c65d8ad963', 'serial': '1ddb1344-a4d2-4480-9818-32c65d8ad963'} {{(pid=98321) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 10:10:12.912716 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors.luks [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] formatting encrypted volume /dev/dm-0 {{(pid=98321) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 28 10:10:12.917065 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4 (non-flash)
May 28 10:10:12.917065 np0000001613 nova-compute[98321]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4 (non-flash)
May 28 10:10:12.917065 np0000001613 nova-compute[98321]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-145b9f35-d27f-434b-9323-c18d7f8607a7 (non-flash)
May 28 10:10:12.917065 np0000001613 nova-compute[98321]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:12.917065 np0000001613 nova-compute[98321]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:12.917065 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:10:12.917247 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] iscsi session list stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4 (non-flash)
May 28 10:10:12.917247 np0000001613 nova-compute[98321]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4 (non-flash)
May 28 10:10:12.917247 np0000001613 nova-compute[98321]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-145b9f35-d27f-434b-9323-c18d7f8607a7 (non-flash)
May 28 10:10:12.917247 np0000001613 nova-compute[98321]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:12.917247 np0000001613 nova-compute[98321]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:12.917247 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:10:12.917414 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4', '139'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4', '140'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-145b9f35-d27f-434b-9323-c18d7f8607a7', '141'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', '142'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', '143')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:10:12.917491 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0, 0): [] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:10:12.917661 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0') {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 10:10:12.917778 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0, 0): [] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:10:12.917889 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-783442cf-b315-459d-9489-3289c8ac0fc0') {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 10:10:12.917995 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc1b0ae0>, {}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:10:12.918120 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Disconnecting from: [] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:10:12.918329 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.029s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:10:12.918658 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] <== disconnect_volume: return (2327ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:10:12.918850 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:10:12.919464 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.106s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:10:12.919851 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4', 'iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '434449b8-853e-405b-82e6-1ca7b68349b4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:10:12.920004 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:10:12.920501 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Deleting instance files /opt/stack/data/nova/instances/1ffe54bd-ad37-40a8-adfa-04e2ea9c9554_del
May 28 10:10:12.921500 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Deletion of /opt/stack/data/nova/instances/1ffe54bd-ad37-40a8-adfa-04e2ea9c9554_del complete
May 28 10:10:12.942136 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4 (non-flash)
May 28 10:10:12.942136 np0000001613 nova-compute[98321]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4 (non-flash)
May 28 10:10:12.942136 np0000001613 nova-compute[98321]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-145b9f35-d27f-434b-9323-c18d7f8607a7 (non-flash)
May 28 10:10:12.942136 np0000001613 nova-compute[98321]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:12.942136 np0000001613 nova-compute[98321]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:12.942136 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:10:12.942376 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4 (non-flash)
May 28 10:10:12.942376 np0000001613 nova-compute[98321]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4 (non-flash)
May 28 10:10:12.942376 np0000001613 nova-compute[98321]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-145b9f35-d27f-434b-9323-c18d7f8607a7 (non-flash)
May 28 10:10:12.942376 np0000001613 nova-compute[98321]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:12.942376 np0000001613 nova-compute[98321]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:12.942376 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:10:12.942521 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4', '139'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4', '140'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-145b9f35-d27f-434b-9323-c18d7f8607a7', '141'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', '142'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', '143')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:10:12.942592 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4', '140')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:10:12.943501 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4', '139')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:10:12.944294 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc6f6f20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4'): ({'sdd'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:10:12.944475 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Removing multipathed devices sdd, sde {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:10:12.944719 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Flush multipath device 330000000ed90592b {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:10:12.995463 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:10:13.044002 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:10:13.099643 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:10:13.100109 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:10:13.100873 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:10:13.112401 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:10:13.112615 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:10:13.123529 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:13.143192 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:10:13.143566 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:10:13.144252 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:13.144593 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:13.164061 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 140, target: iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4, portal: 192.168.40.100,3260]
May 28 10:10:13.164061 np0000001613 nova-compute[98321]: Logout of [sid: 140, target: iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4, portal: 192.168.40.100,3260] successful.
May 28 10:10:13.164061 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:13.181603 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:13.192352 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:13.223893 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 139, target: iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4, portal: 192.168.50.100,3260]
May 28 10:10:13.223893 np0000001613 nova-compute[98321]: Logout of [sid: 139, target: iqn.2023-03.storpool.com:os--volume-434449b8-853e-405b-82e6-1ca7b68349b4, portal: 192.168.50.100,3260] successful.
May 28 10:10:13.223893 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:13.240667 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:13.240947 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:10:13.241120 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] <== disconnect_volume: return (2428ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:10:13.241320 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:10:13.241680 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Deleting instance files /opt/stack/data/nova/instances/46121fe0-6620-41cb-815d-a0a3b037d31f_del
May 28 10:10:13.242283 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Deletion of /opt/stack/data/nova/instances/46121fe0-6620-41cb-815d-a0a3b037d31f_del complete
May 28 10:10:13.276468 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4631f2d316394d08825f7c3295412feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f9e47b0cb84ec9a96e9ee54854c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:10:13.428510 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Took 3.72 seconds to destroy the instance on the hypervisor.
May 28 10:10:13.429030 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:10:13.429399 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:10:13.429489 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:10:13.429685 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:13.492930 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:13.648880 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:10:13.656029 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Successfully created port: 19e2cc51-3e82-46f4-8d06-7406f2f72300 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:10:13.752371 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Took 3.78 seconds to destroy the instance on the hypervisor.
May 28 10:10:13.752928 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:10:13.753111 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:10:13.753224 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:10:13.753426 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:13.822095 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:14.050950 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-42d372d3-6958-4737-a572-6753a95be1c7 req-7fbbff08-3205-4725-80f1-ac62ea05506a service nova] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Received event network-vif-deleted-aecaae00-e4ff-458c-9255-8e7026a57820 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:10:14.050950 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-42d372d3-6958-4737-a572-6753a95be1c7 req-7fbbff08-3205-4725-80f1-ac62ea05506a service nova] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Neutron deleted interface aecaae00-e4ff-458c-9255-8e7026a57820; detaching it from the instance and deleting it from the info cache
May 28 10:10:14.053641 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-42d372d3-6958-4737-a572-6753a95be1c7 req-7fbbff08-3205-4725-80f1-ac62ea05506a service nova] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Detach interface failed, port_id=aecaae00-e4ff-458c-9255-8e7026a57820, reason: Instance 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:10:14.155685 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-0d702991-b1a8-4483-ac3e-435d6818961c req-7508f9c0-7994-4d1f-b38b-7c9f02105d67 service nova] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Received event network-vif-deleted-dcc81325-0027-4773-8110-f559bfd767f2 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:10:14.157187 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:10:14.161776 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-0d702991-b1a8-4483-ac3e-435d6818961c req-7508f9c0-7994-4d1f-b38b-7c9f02105d67 service nova] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Neutron deleted interface dcc81325-0027-4773-8110-f559bfd767f2; detaching it from the instance and deleting it from the info cache
May 28 10:10:14.163428 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-0d702991-b1a8-4483-ac3e-435d6818961c req-7508f9c0-7994-4d1f-b38b-7c9f02105d67 service nova] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Detach interface failed, port_id=dcc81325-0027-4773-8110-f559bfd767f2, reason: Instance 46121fe0-6620-41cb-815d-a0a3b037d31f could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:10:14.178903 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Successfully updated port: 19e2cc51-3e82-46f4-8d06-7406f2f72300 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:10:14.233621 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a2ec035b-e4c7-47df-aada-b64be78f3352 req-faa18fca-0fbc-440d-ad32-4ebcc0097a48 service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Received event network-changed-19e2cc51-3e82-46f4-8d06-7406f2f72300 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:10:14.234027 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a2ec035b-e4c7-47df-aada-b64be78f3352 req-faa18fca-0fbc-440d-ad32-4ebcc0097a48 service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Refreshing instance network info cache due to event network-changed-19e2cc51-3e82-46f4-8d06-7406f2f72300. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:10:14.234205 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a2ec035b-e4c7-47df-aada-b64be78f3352 req-faa18fca-0fbc-440d-ad32-4ebcc0097a48 service nova] Acquiring lock "refresh_cache-c0786416-dec3-4610-9ec2-389aa7508148" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:10:14.234306 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a2ec035b-e4c7-47df-aada-b64be78f3352 req-faa18fca-0fbc-440d-ad32-4ebcc0097a48 service nova] Acquired lock "refresh_cache-c0786416-dec3-4610-9ec2-389aa7508148" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:10:14.234465 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-a2ec035b-e4c7-47df-aada-b64be78f3352 req-faa18fca-0fbc-440d-ad32-4ebcc0097a48 service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Refreshing network info cache for port 19e2cc51-3e82-46f4-8d06-7406f2f72300 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:10:14.494242 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:10:14.594728 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:10:14.683397 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "refresh_cache-c0786416-dec3-4610-9ec2-389aa7508148" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:10:14.737893 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-a2ec035b-e4c7-47df-aada-b64be78f3352 req-faa18fca-0fbc-440d-ad32-4ebcc0097a48 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:14.796686 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-a2ec035b-e4c7-47df-aada-b64be78f3352 req-faa18fca-0fbc-440d-ad32-4ebcc0097a48 service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:10:14.817319 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:14.942434 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-a2ec035b-e4c7-47df-aada-b64be78f3352 req-faa18fca-0fbc-440d-ad32-4ebcc0097a48 service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:10:14.996176 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Took 1.57 seconds to deallocate network for instance.
May 28 10:10:15.010870 np0000001613 nova-compute[98321]: WARNING nova.volume.cinder [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Attachment 39da297c-8f14-4b05-afe0-9681cc061447 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 39da297c-8f14-4b05-afe0-9681cc061447. (HTTP 404) (Request-ID: req-c8dfd36c-d605-4ba0-a01a-23e88d3ad79f)
May 28 10:10:15.011144 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Took 0.01 seconds to detach 1 volumes for instance.
May 28 10:10:15.096094 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Took 1.34 seconds to deallocate network for instance.
May 28 10:10:15.170037 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:10:15.170969 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:10:15.171229 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Creating image(s)
May 28 10:10:15.171772 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "/opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:15.171935 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "/opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:15.172349 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "/opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:15.172648 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "86dbb0ae7799bbec701ab74be40d660df13e8048" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:15.172901 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "86dbb0ae7799bbec701ab74be40d660df13e8048" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:15.444195 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a2ec035b-e4c7-47df-aada-b64be78f3352 req-faa18fca-0fbc-440d-ad32-4ebcc0097a48 service nova] Releasing lock "refresh_cache-c0786416-dec3-4610-9ec2-389aa7508148" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:10:15.446802 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquired lock "refresh_cache-c0786416-dec3-4610-9ec2-389aa7508148" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:10:15.446802 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:10:15.517615 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:15.517816 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:15.660028 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Took 0.56 seconds to detach 1 volumes for instance.
May 28 10:10:15.662258 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Deleting volume: 434449b8-853e-405b-82e6-1ca7b68349b4 {{(pid=98321) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 10:10:15.754068 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:10:15.756665 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:10:15.757205 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86dbb0ae7799bbec701ab74be40d660df13e8048.part --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:10:15.810774 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:15.845659 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86dbb0ae7799bbec701ab74be40d660df13e8048.part --force-share --output=json" returned: 0 in 0.088s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:10:15.846221 np0000001613 nova-compute[98321]: DEBUG nova.virt.images [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] 63b9de52-b76c-44d7-9e19-2bbc39bd37e6 was qcow2, converting to raw {{(pid=98321) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 10:10:15.847000 np0000001613 nova-compute[98321]: DEBUG nova.privsep.utils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98321) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 10:10:15.847301 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/86dbb0ae7799bbec701ab74be40d660df13e8048.part /opt/stack/data/nova/instances/_base/86dbb0ae7799bbec701ab74be40d660df13e8048.converted {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:10:15.905506 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:10:15.905799 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:10:15.990222 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/86dbb0ae7799bbec701ab74be40d660df13e8048.part /opt/stack/data/nova/instances/_base/86dbb0ae7799bbec701ab74be40d660df13e8048.converted" returned: 0 in 0.143s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:10:15.997022 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86dbb0ae7799bbec701ab74be40d660df13e8048.converted --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:10:16.052648 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:10:16.096973 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86dbb0ae7799bbec701ab74be40d660df13e8048.converted --force-share --output=json" returned: 0 in 0.100s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:10:16.098049 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "86dbb0ae7799bbec701ab74be40d660df13e8048" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.925s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:16.098709 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:10:16.103125 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:10:16.104280 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86dbb0ae7799bbec701ab74be40d660df13e8048 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:10:16.202962 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86dbb0ae7799bbec701ab74be40d660df13e8048 --force-share --output=json" returned: 0 in 0.098s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:10:16.203415 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "86dbb0ae7799bbec701ab74be40d660df13e8048" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:16.203842 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "86dbb0ae7799bbec701ab74be40d660df13e8048" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:16.204310 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:10:16.207045 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:10:16.207418 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86dbb0ae7799bbec701ab74be40d660df13e8048 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:10:16.228366 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:16.257794 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:16.306981 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86dbb0ae7799bbec701ab74be40d660df13e8048 --force-share --output=json" returned: 0 in 0.099s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:10:16.307468 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/86dbb0ae7799bbec701ab74be40d660df13e8048,backing_fmt=raw /opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:10:16.372459 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/86dbb0ae7799bbec701ab74be40d660df13e8048,backing_fmt=raw /opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148/disk 1073741824" returned: 0 in 0.065s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:10:16.372874 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "86dbb0ae7799bbec701ab74be40d660df13e8048" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.169s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:16.373180 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86dbb0ae7799bbec701ab74be40d660df13e8048 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:10:16.410125 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Updating instance_info_cache with network_info: [{"id": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "address": "fa:16:3e:83:3c:7d", "network": {"id": "db344666-4990-47d9-a3a2-9bebce64e660", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1492927350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44f9e47b0cb84ec9a96e9ee54854c98d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e2cc51-3e", "ovs_interfaceid": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:10:16.417216 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:10:16.469609 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86dbb0ae7799bbec701ab74be40d660df13e8048 --force-share --output=json" returned: 0 in 0.096s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:10:16.470270 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:10:16.470597 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:10:16.568395 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:10:16.568850 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Cannot resize image /opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:10:16.569590 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:10:16.569816 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Ensure instance console log exists: /opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:10:16.570150 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:16.570454 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:16.570645 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:16.928705 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.411s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:16.931776 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Releasing lock "refresh_cache-c0786416-dec3-4610-9ec2-389aa7508148" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:10:16.932135 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.702s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:16.932606 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Instance network_info: |[{"id": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "address": "fa:16:3e:83:3c:7d", "network": {"id": "db344666-4990-47d9-a3a2-9bebce64e660", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1492927350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44f9e47b0cb84ec9a96e9ee54854c98d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e2cc51-3e", "ovs_interfaceid": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:10:16.935411 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Start _get_guest_xml network_info=[{"id": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "address": "fa:16:3e:83:3c:7d", "network": {"id": "db344666-4990-47d9-a3a2-9bebce64e660", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1492927350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44f9e47b0cb84ec9a96e9ee54854c98d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e2cc51-3e", "ovs_interfaceid": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T10:10:06Z,direct_url=<?>,disk_format='qcow2',id=63b9de52-b76c-44d7-9e19-2bbc39bd37e6,min_disk=0,min_ram=0,name='tempest-scenario-img--1648435315',owner='44f9e47b0cb84ec9a96e9ee54854c98d',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T10:10:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': '63b9de52-b76c-44d7-9e19-2bbc39bd37e6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:10:16.944603 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:10:16.946040 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='63b9de52-b76c-44d7-9e19-2bbc39bd37e6', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-1785992036', uuid='c0786416-dec3-4610-9ec2-389aa7508148'), owner=OwnerMeta(userid='4631f2d316394d08825f7c3295412feb', username='tempest-TestMinimumBasicScenario-63484617-project-member', projectid='44f9e47b0cb84ec9a96e9ee54854c98d', projectname='tempest-TestMinimumBasicScenario-63484617'), image=ImageMeta(id='63b9de52-b76c-44d7-9e19-2bbc39bd37e6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "address": "fa:16:3e:83:3c:7d", "network": {"id": "db344666-4990-47d9-a3a2-9bebce64e660", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1492927350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44f9e47b0cb84ec9a96e9ee54854c98d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e2cc51-3e", "ovs_interfaceid": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779963016.945575) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:10:16.948727 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:10:16.948873 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:10:16.950365 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:10:16.950745 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:10:16.952257 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:10:16.952747 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T10:10:06Z,direct_url=<?>,disk_format='qcow2',id=63b9de52-b76c-44d7-9e19-2bbc39bd37e6,min_disk=0,min_ram=0,name='tempest-scenario-img--1648435315',owner='44f9e47b0cb84ec9a96e9ee54854c98d',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T10:10:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:10:16.953277 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:10:16.953547 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:10:16.953686 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:10:16.953868 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:10:16.954010 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:10:16.954240 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:10:16.954418 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:10:16.954584 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:10:16.954733 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:10:16.954909 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:10:16.969289 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:10:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1785992036',display_name='tempest-TestMinimumBasicScenario-server-1785992036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testminimumbasicscenario-server-1785992036',id=59,image_ref='63b9de52-b76c-44d7-9e19-2bbc39bd37e6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLiX2kC72bgYbEtDTMsYzL9SD3voo9GX+cDAL0WmMYth6F/EEwHtRxRiF7vbmxiGKhT5mQtsmFOUJpBjXEXu5cbRVXGqFCdGspdUukikdpy3iovlWAZ00U6u/U2VnwRLtQ==',key_name='tempest-TestMinimumBasicScenario-1728575637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44f9e47b0cb84ec9a96e9ee54854c98d',ramdisk_id='',reservation_id='r-8k0nmdmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='63b9de52-b76c-44d7-9e19-2bbc39bd37e6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-63484617',owner_user_name='tempest-TestMinimumBasicScenario-63484617-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:10:14Z,user_data=None,user_id='4631f2d316394d08825f7c3295412feb',uuid=c0786416-dec3-4610-9ec2-389aa7508148,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "address": "fa:16:3e:83:3c:7d", "network": {"id": "db344666-4990-47d9-a3a2-9bebce64e660", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1492927350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44f9e47b0cb84ec9a96e9ee54854c98d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e2cc51-3e", "ovs_interfaceid": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:10:16.969289 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Converting VIF {"id": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "address": "fa:16:3e:83:3c:7d", "network": {"id": "db344666-4990-47d9-a3a2-9bebce64e660", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1492927350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44f9e47b0cb84ec9a96e9ee54854c98d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e2cc51-3e", "ovs_interfaceid": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:10:16.969887 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:3c:7d,bridge_name='br-int',has_traffic_filtering=True,id=19e2cc51-3e82-46f4-8d06-7406f2f72300,network=Network(db344666-4990-47d9-a3a2-9bebce64e660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19e2cc51-3e') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:10:16.970900 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lazy-loading 'pci_devices' on Instance uuid c0786416-dec3-4610-9ec2-389aa7508148 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:10:16.972001 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 10:10:16.972001 np0000001613 nova-compute[98321]:   <usage type="volume">
May 28 10:10:16.972001 np0000001613 nova-compute[98321]:     <volume>1ddb1344-a4d2-4480-9818-32c65d8ad963</volume>
May 28 10:10:16.972001 np0000001613 nova-compute[98321]:   </usage>
May 28 10:10:16.972001 np0000001613 nova-compute[98321]: </secret>
May 28 10:10:16.972001 np0000001613 nova-compute[98321]:  {{(pid=98321) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 10:10:16.980747 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lazy-loading 'flavor' on Instance uuid edd8dcff-3440-445a-b4a2-8c56863e7ca3 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:10:16.997311 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Deleted allocations for instance 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554
May 28 10:10:17.149824 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:10:17.150084 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:10:17.326703 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Acquiring lock "f42f06fc-5b0c-4973-98db-cd594815f317" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:17.327003 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "f42f06fc-5b0c-4973-98db-cd594815f317" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:17.474308 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] End _get_guest_xml xml=<domain type="qemu">
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:   <uuid>c0786416-dec3-4610-9ec2-389aa7508148</uuid>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:   <name>instance-0000003b</name>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:       <nova:name>tempest-TestMinimumBasicScenario-server-1785992036</nova:name>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:10:16</nova:creationTime>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:       <nova:image uuid="63b9de52-b76c-44d7-9e19-2bbc39bd37e6">
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:         <nova:properties/>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:         <nova:user uuid="4631f2d316394d08825f7c3295412feb">tempest-TestMinimumBasicScenario-63484617-project-member</nova:user>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:         <nova:project uuid="44f9e47b0cb84ec9a96e9ee54854c98d">tempest-TestMinimumBasicScenario-63484617</nova:project>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="63b9de52-b76c-44d7-9e19-2bbc39bd37e6"/>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:         <nova:port uuid="19e2cc51-3e82-46f4-8d06-7406f2f72300">
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:     <system>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:       <entry name="serial">c0786416-dec3-4610-9ec2-389aa7508148</entry>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:       <entry name="uuid">c0786416-dec3-4610-9ec2-389aa7508148</entry>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:     </system>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:   <os>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:   </os>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:   <features>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:   </features>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:   <devices>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148/disk"/>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:     </disk>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148/disk.config"/>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:     </disk>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:83:3c:7d"/>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:       <target dev="tap19e2cc51-3e"/>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:     </interface>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148/console.log" append="off"/>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:     </serial>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:     <video>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:     </video>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:     </rng>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:   </devices>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]: </domain>
May 28 10:10:17.474308 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:10:17.477186 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Preparing to wait for external event network-vif-plugged-19e2cc51-3e82-46f4-8d06-7406f2f72300 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:10:17.477186 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "c0786416-dec3-4610-9ec2-389aa7508148-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:17.477186 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "c0786416-dec3-4610-9ec2-389aa7508148-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:17.477186 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "c0786416-dec3-4610-9ec2-389aa7508148-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:17.477186 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:10:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1785992036',display_name='tempest-TestMinimumBasicScenario-server-1785992036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testminimumbasicscenario-server-1785992036',id=59,image_ref='63b9de52-b76c-44d7-9e19-2bbc39bd37e6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLiX2kC72bgYbEtDTMsYzL9SD3voo9GX+cDAL0WmMYth6F/EEwHtRxRiF7vbmxiGKhT5mQtsmFOUJpBjXEXu5cbRVXGqFCdGspdUukikdpy3iovlWAZ00U6u/U2VnwRLtQ==',key_name='tempest-TestMinimumBasicScenario-1728575637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44f9e47b0cb84ec9a96e9ee54854c98d',ramdisk_id='',reservation_id='r-8k0nmdmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='63b9de52-b76c-44d7-9e19-2bbc39bd37e6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-63484617',owner_user_name='tempest-TestMinimumBasicScenario-63484617-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:10:14Z,user_data=None,user_id='4631f2d316394d08825f7c3295412feb',uuid=c0786416-dec3-4610-9ec2-389aa7508148,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "address": "fa:16:3e:83:3c:7d", "network": {"id": "db344666-4990-47d9-a3a2-9bebce64e660", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1492927350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44f9e47b0cb84ec9a96e9ee54854c98d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e2cc51-3e", "ovs_interfaceid": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:10:17.477186 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Converting VIF {"id": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "address": "fa:16:3e:83:3c:7d", "network": {"id": "db344666-4990-47d9-a3a2-9bebce64e660", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1492927350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44f9e47b0cb84ec9a96e9ee54854c98d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e2cc51-3e", "ovs_interfaceid": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:10:17.477186 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:3c:7d,bridge_name='br-int',has_traffic_filtering=True,id=19e2cc51-3e82-46f4-8d06-7406f2f72300,network=Network(db344666-4990-47d9-a3a2-9bebce64e660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19e2cc51-3e') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:10:17.477186 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:3c:7d,bridge_name='br-int',has_traffic_filtering=True,id=19e2cc51-3e82-46f4-8d06-7406f2f72300,network=Network(db344666-4990-47d9-a3a2-9bebce64e660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19e2cc51-3e') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:10:17.477186 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:17.477776 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:10:17.477776 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:10:17.478417 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:17.478552 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e7b23654-68cc-5e1d-ba8d-2ab2234b240c', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:10:17.479240 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:17.480033 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:10:17.481769 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:17.481916 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19e2cc51-3e, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:10:17.482249 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap19e2cc51-3e, col_values=(('qos', UUID('c3b803af-e53f-4ed5-9328-975eb510fc24')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:10:17.482404 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap19e2cc51-3e, col_values=(('external_ids', {'iface-id': '19e2cc51-3e82-46f4-8d06-7406f2f72300', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:3c:7d', 'vm-uuid': 'c0786416-dec3-4610-9ec2-389aa7508148'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:10:17.484198 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Attempting to attach volume 1ddb1344-a4d2-4480-9818-32c65d8ad963 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 10:10:17.485179 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:10:17.485608 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] attach device xml: <disk type="block" device="disk">
May 28 10:10:17.485608 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:10:17.485608 np0000001613 nova-compute[98321]:   <alias name="ua-1ddb1344-a4d2-4480-9818-32c65d8ad963"/>
May 28 10:10:17.485608 np0000001613 nova-compute[98321]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 28 10:10:17.485608 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:10:17.485608 np0000001613 nova-compute[98321]:   <serial>1ddb1344-a4d2-4480-9818-32c65d8ad963</serial>
May 28 10:10:17.485608 np0000001613 nova-compute[98321]:   <encryption format="luks">
May 28 10:10:17.485608 np0000001613 nova-compute[98321]:     <secret type="passphrase" uuid="26b71148-0b76-4e29-826b-722f4812fca0"/>
May 28 10:10:17.485608 np0000001613 nova-compute[98321]:   </encryption>
May 28 10:10:17.485608 np0000001613 nova-compute[98321]: </disk>
May 28 10:10:17.485608 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 10:10:17.488549 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:17.489459 np0000001613 nova-compute[98321]: INFO os_vif [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:3c:7d,bridge_name='br-int',has_traffic_filtering=True,id=19e2cc51-3e82-46f4-8d06-7406f2f72300,network=Network(db344666-4990-47d9-a3a2-9bebce64e660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19e2cc51-3e')
May 28 10:10:17.652500 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:10:17.829699 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lazy-loading 'flavor' on Instance uuid f42f06fc-5b0c-4973-98db-cd594815f317 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:10:18.005418 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-069d698a-16ab-43d1-ac99-139579db0401 tempest-VolumesBackupsTest-1901675516 tempest-VolumesBackupsTest-1901675516-project-member] Lock "1ffe54bd-ad37-40a8-adfa-04e2ea9c9554" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.817s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:18.158174 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.229s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:18.218135 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Deleted allocations for instance 46121fe0-6620-41cb-815d-a0a3b037d31f
May 28 10:10:18.834143 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "f42f06fc-5b0c-4973-98db-cd594815f317" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.507s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:19.008982 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:10:19.009105 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:10:19.009265 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] No VIF found with MAC fa:16:3e:83:3c:7d, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:10:19.009624 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Using config drive
May 28 10:10:19.226740 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-287676cf-629c-4abe-bbf8-5d5175cd7d22 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "46121fe0-6620-41cb-815d-a0a3b037d31f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.758s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:19.514620 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:19.627125 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Creating config drive at /opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148/disk.config
May 28 10:10:19.630467 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpr58_c5vy {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:10:19.693179 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpr58_c5vy" returned: 0 in 0.062s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:10:19.836716 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:19.891603 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Acquiring lock "f42f06fc-5b0c-4973-98db-cd594815f317" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:19.891876 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "f42f06fc-5b0c-4973-98db-cd594815f317" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:19.892046 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Attaching volume db1c0833-c0b8-418c-90a2-a069b76be9c4 to /dev/vdb
May 28 10:10:19.933223 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:10:19.945150 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:10:19.969667 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:10:20.013427 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:10:20.013774 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:10:20.024908 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:10:20.025852 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe5c:9e66', 'fe80::ec4e:cbff:fea7:f945', 'fe80::fc16:3eff:fe33:fbde', 'fe80::6807:fff:fe4c:bed3'] 
May 28 10:10:20.025992 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:10:20.026101 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:10:20.026371 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:10:20.026626 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Updating existing volume attachment record: dfff817f-b1f3-494e-921e-a6264c61b6e3 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:10:20.103655 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:10:20.103655 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:10:20.103655 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:10:20.103655 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] No VIF found with MAC fa:16:3e:5c:9e:66, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:10:20.107343 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:20.135538 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:20.216147 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:20.413601 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5223332b-7b6a-4ffe-86c4-09160cdc712f req-9994d6e9-caf5-4dac-9c4e-1cc256056eec service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Received event network-vif-plugged-19e2cc51-3e82-46f4-8d06-7406f2f72300 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:10:20.413863 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5223332b-7b6a-4ffe-86c4-09160cdc712f req-9994d6e9-caf5-4dac-9c4e-1cc256056eec service nova] Acquiring lock "c0786416-dec3-4610-9ec2-389aa7508148-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:20.414105 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5223332b-7b6a-4ffe-86c4-09160cdc712f req-9994d6e9-caf5-4dac-9c4e-1cc256056eec service nova] Lock "c0786416-dec3-4610-9ec2-389aa7508148-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:20.414291 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5223332b-7b6a-4ffe-86c4-09160cdc712f req-9994d6e9-caf5-4dac-9c4e-1cc256056eec service nova] Lock "c0786416-dec3-4610-9ec2-389aa7508148-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:20.414464 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5223332b-7b6a-4ffe-86c4-09160cdc712f req-9994d6e9-caf5-4dac-9c4e-1cc256056eec service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Processing event network-vif-plugged-19e2cc51-3e82-46f4-8d06-7406f2f72300 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:10:20.453307 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:20.457965 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:20.483613 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:20.595232 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:10:20.595680 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4', 'iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'db1c0833-c0b8-418c-90a2-a069b76be9c4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:10:20.595965 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:10:20.596380 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:10:20.596588 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4', 'iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'db1c0833-c0b8-418c-90a2-a069b76be9c4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:10:20.613738 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:10:20.614712 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:10:20.615460 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:10:20.616833 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:10:20.617064 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:10:20.617395 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:10:20.630188 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:10:20.630188 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:20.636290 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:10:20.636290 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:20.644728 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4] added
May 28 10:10:20.644728 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:10:20.644728 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:10:20.644728 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:10:20.644728 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:10:20.644728 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:10:20.644728 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:20.645055 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:10:20.645687 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0287(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:10:20.645687 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:10:20.648587 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4] added
May 28 10:10:20.648587 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:10:20.648587 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:10:20.648587 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:10:20.648587 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:10:20.648587 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:10:20.648587 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:20.648894 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:10:20.649223 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0322(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:10:20.649290 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:10:20.913250 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963020.9128258, c0786416-dec3-4610-9ec2-389aa7508148 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:10:20.914249 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:10:20.915038 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c0786416-dec3-4610-9ec2-389aa7508148] VM Started (Lifecycle Event)
May 28 10:10:20.918239 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:10:20.922898 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Instance spawned successfully.
May 28 10:10:20.923225 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:10:21.370516 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:21.424580 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:10:21.430752 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:10:21.430885 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:10:21.431181 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:10:21.431408 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:10:21.432123 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:10:21.433137 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:10:21.433558 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:10:21.645912 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:10:21.651375 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:10:21.662612 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:10:21.662612 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:21.664993 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bf71fe09-a154-4b0f-b21d-547a427a4e6b tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.601s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:10:21.675748 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:10:21.675748 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:21.679671 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:21.689995 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:21.696028 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:21.696028 np0000001613 nova-compute[98321]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:21.696028 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:10:21.696179 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsi session list stdout=tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:21.696179 np0000001613 nova-compute[98321]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:21.696179 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:10:21.703743 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:21.703743 np0000001613 nova-compute[98321]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:21.703743 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:10:21.703911 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsi session list stdout=tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:21.703911 np0000001613 nova-compute[98321]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:21.703911 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:10:21.732193 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4, portal: 192.168.50.100,3260]
May 28 10:10:21.732193 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4, portal: 192.168.50.100,3260] successful.
May 28 10:10:21.732193 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:21.744724 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:21.752154 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4, portal: 192.168.40.100,3260]
May 28 10:10:21.752154 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4, portal: 192.168.40.100,3260] successful.
May 28 10:10:21.752154 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:21.764048 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:21.769738 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:21.769738 np0000001613 nova-compute[98321]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:21.769738 np0000001613 nova-compute[98321]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4 (non-flash)
May 28 10:10:21.769738 np0000001613 nova-compute[98321]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4 (non-flash)
May 28 10:10:21.769738 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:10:21.770003 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsi session list stdout=tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:21.770003 np0000001613 nova-compute[98321]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:21.770003 np0000001613 nova-compute[98321]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4 (non-flash)
May 28 10:10:21.770003 np0000001613 nova-compute[98321]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4 (non-flash)
May 28 10:10:21.770003 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:10:21.770179 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.155s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:10:21.770269 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:10:21.774190 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] HCTL ('7', '-', '-', 0) found on session 144 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:10:21.774190 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:10:21.781905 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:21.781905 np0000001613 nova-compute[98321]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:21.781905 np0000001613 nova-compute[98321]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4 (non-flash)
May 28 10:10:21.781905 np0000001613 nova-compute[98321]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4 (non-flash)
May 28 10:10:21.781905 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:10:21.782218 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsi session list stdout=tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:21.782218 np0000001613 nova-compute[98321]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:21.782218 np0000001613 nova-compute[98321]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4 (non-flash)
May 28 10:10:21.782218 np0000001613 nova-compute[98321]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4 (non-flash)
May 28 10:10:21.782218 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:10:21.782383 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.167s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:10:21.782497 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:10:21.786938 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] HCTL ('9', '-', '-', 0) found on session 145 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:10:21.786938 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:10:21.786938 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Searching for a device in session 144 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:10:21.786938 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'db1c0833-c0b8-418c-90a2-a069b76be9c4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:10:21.800235 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Searching for a device in session 145 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:10:21.800235 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'db1c0833-c0b8-418c-90a2-a069b76be9c4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:10:21.938690 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c0786416-dec3-4610-9ec2-389aa7508148] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:10:21.939132 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963021.9388096, c0786416-dec3-4610-9ec2-389aa7508148 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:10:21.939633 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c0786416-dec3-4610-9ec2-389aa7508148] VM Paused (Lifecycle Event)
May 28 10:10:21.942753 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Took 6.77 seconds to spawn the instance on the hypervisor.
May 28 10:10:21.945460 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:10:22.445822 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:10:22.449533 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963022.4484785, c0786416-dec3-4610-9ec2-389aa7508148 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:10:22.449533 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c0786416-dec3-4610-9ec2-389aa7508148] VM Resumed (Lifecycle Event)
May 28 10:10:22.457666 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Took 12.52 seconds to build instance.
May 28 10:10:22.485175 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:22.510218 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-12d07e94-f413-41c0-81c5-ece03adb0a55 req-40724ac9-6c50-4c67-b025-849417f4241d service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Received event network-vif-plugged-19e2cc51-3e82-46f4-8d06-7406f2f72300 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:10:22.515155 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-12d07e94-f413-41c0-81c5-ece03adb0a55 req-40724ac9-6c50-4c67-b025-849417f4241d service nova] Acquiring lock "c0786416-dec3-4610-9ec2-389aa7508148-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:22.515471 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-12d07e94-f413-41c0-81c5-ece03adb0a55 req-40724ac9-6c50-4c67-b025-849417f4241d service nova] Lock "c0786416-dec3-4610-9ec2-389aa7508148-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:22.515689 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-12d07e94-f413-41c0-81c5-ece03adb0a55 req-40724ac9-6c50-4c67-b025-849417f4241d service nova] Lock "c0786416-dec3-4610-9ec2-389aa7508148-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:22.518065 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-12d07e94-f413-41c0-81c5-ece03adb0a55 req-40724ac9-6c50-4c67-b025-849417f4241d service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] No waiting events found dispatching network-vif-plugged-19e2cc51-3e82-46f4-8d06-7406f2f72300 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:10:22.518065 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-12d07e94-f413-41c0-81c5-ece03adb0a55 req-40724ac9-6c50-4c67-b025-849417f4241d service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Received unexpected event network-vif-plugged-19e2cc51-3e82-46f4-8d06-7406f2f72300 for instance with vm_state active and task_state None.
May 28 10:10:22.616146 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:10:22.951992 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:10:22.955028 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:10:22.960012 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0deea595-cce8-4c8a-9afa-802899b4cba9 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "c0786416-dec3-4610-9ec2-389aa7508148" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.028s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:23.285573 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Stashing vm_state: active {{(pid=98321) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 28 10:10:23.644814 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Found WWN 330000000cc576b7c for multipath device dm-1 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:10:23.646177 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.050s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:10:23.646383 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] <== connect_volume: return (3050ms) {'type': 'block', 'scsi_wwn': '330000000cc576b7c', 'path': '/dev/dm-1', 'multipath_id': '330000000cc576b7c'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:10:23.646808 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000cc576b7c', 'path': '/dev/dm-1', 'multipath_id': '330000000cc576b7c'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:10:23.652079 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lazy-loading 'flavor' on Instance uuid f42f06fc-5b0c-4973-98db-cd594815f317 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:10:23.857209 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:23.857209 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:24.156003 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Attempting to attach volume db1c0833-c0b8-418c-90a2-a069b76be9c4 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 10:10:24.157846 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] attach device xml: <disk type="block" device="disk">
May 28 10:10:24.157846 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:10:24.157846 np0000001613 nova-compute[98321]:   <alias name="ua-db1c0833-c0b8-418c-90a2-a069b76be9c4"/>
May 28 10:10:24.157846 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-1"/>
May 28 10:10:24.157846 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:10:24.157846 np0000001613 nova-compute[98321]:   <serial>db1c0833-c0b8-418c-90a2-a069b76be9c4</serial>
May 28 10:10:24.157846 np0000001613 nova-compute[98321]: </disk>
May 28 10:10:24.157846 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 10:10:24.364302 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:10:24.364793 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Claim successful on node np0000001613
May 28 10:10:24.850180 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:24.872593 np0000001613 nova-compute[98321]: INFO nova.compute.resource_tracker [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Updating resource usage from migration e7fa3c5c-a528-4946-b370-2dc2ccd8a06f
May 28 10:10:24.899217 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "c0786416-dec3-4610-9ec2-389aa7508148" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:24.899217 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "c0786416-dec3-4610-9ec2-389aa7508148" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:25.051897 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0004055780000271625 future=<Future at 0x73c1f4044980 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:10:25.052027 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:10:25.052201 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=0.24423014500007412 future=<Future at 0x73c1fc334fb0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:10:25.052588 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-4ebe5eac-5fbf-4b5d-b47d-693e5a8cdb01 None None] Emitting event <LifecycleEvent: 1779963010.0513468, 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:10:25.052907 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=0.2436749029998282 future=<Future at 0x73c1fc334fb0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:10:25.052907 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-4ebe5eac-5fbf-4b5d-b47d-693e5a8cdb01 None None] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] VM Stopped (Lifecycle Event)
May 28 10:10:25.143631 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:10:25.143910 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:10:25.296950 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0005363529999158345 future=<Future at 0x73c1fc334fb0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:10:25.297471 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] Emitting event <LifecycleEvent: 1779963010.2963078, 46121fe0-6620-41cb-815d-a0a3b037d31f => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:10:25.297654 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:10:25.297799 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] VM Stopped (Lifecycle Event)
May 28 10:10:25.399990 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lazy-loading 'flavor' on Instance uuid c0786416-dec3-4610-9ec2-389aa7508148 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:10:25.555044 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-4ebe5eac-5fbf-4b5d-b47d-693e5a8cdb01 None None] [instance: 1ffe54bd-ad37-40a8-adfa-04e2ea9c9554] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:10:25.646648 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:10:25.800039 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-fad5f0ef-036a-4aeb-be1c-a9ffe656ea2d tempest-VolumesActionsTest-33912954 tempest-VolumesActionsTest-33912954-project-member] [instance: 46121fe0-6620-41cb-815d-a0a3b037d31f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:10:25.806771 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:25.806976 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:25.809505 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:10:25.809608 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:10:25.809705 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:10:25.809797 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] No VIF found with MAC fa:16:3e:33:fb:de, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:10:26.154093 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.298s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:26.154226 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Migrating
May 28 10:10:26.154441 np0000001613 nova-compute[98321]: DEBUG nova.compute.rpcapi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98321) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 10:10:26.309235 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:10:26.407892 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "c0786416-dec3-4610-9ec2-389aa7508148" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:26.671534 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "refresh_cache-edd8dcff-3440-445a-b4a2-8c56863e7ca3" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:10:26.671661 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquired lock "refresh_cache-edd8dcff-3440-445a-b4a2-8c56863e7ca3" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:10:26.671823 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:10:26.918183 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:26.918183 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:26.918950 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:10:26.919064 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Claim successful on node np0000001613
May 28 10:10:27.173911 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:27.377509 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f0fa2875-a48b-4eee-8c03-1c3152895bb2 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "f42f06fc-5b0c-4973-98db-cd594815f317" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.486s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:27.471738 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "c0786416-dec3-4610-9ec2-389aa7508148" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:27.471962 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "c0786416-dec3-4610-9ec2-389aa7508148" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:27.472177 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Attaching volume 27d30a68-d569-4696-bcc3-6b1ed57ab61d to /dev/vdb
May 28 10:10:27.488221 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:27.518462 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:10:27.534980 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:10:27.563641 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:10:27.582386 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:27.603830 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:10:27.604109 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:10:27.613901 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:10:27.616380 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe83:3c7d', 'fe80::e03f:79ff:fe2f:2d97', 'fe80::fc16:3eff:fe5c:9e66', 'fe80::ec4e:cbff:fea7:f945', 'fe80::fc16:3eff:fe33:fbde', 'fe80::6807:fff:fe4c:bed3'] 
May 28 10:10:27.616587 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:10:27.616714 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:10:27.617025 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:10:27.617308 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Updating existing volume attachment record: 3c531e05-69cc-4ee7-8ce0-d956ae0859de {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:10:27.771646 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Updating instance_info_cache with network_info: [{"id": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "address": "fa:16:3e:5c:9e:66", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb80648-bd", "ovs_interfaceid": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:10:28.185051 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:10:28.185545 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27d30a68-d569-4696-bcc3-6b1ed57ab61d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:10:28.185741 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:10:28.225031 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:10:28.225250 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:10:28.273182 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Releasing lock "refresh_cache-edd8dcff-3440-445a-b4a2-8c56863e7ca3" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:10:28.468228 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.282s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:10:28.468228 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27d30a68-d569-4696-bcc3-6b1ed57ab61d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:10:28.483190 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:10:28.484295 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:10:28.485535 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:10:28.485782 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:10:28.486305 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:10:28.486526 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:10:28.498387 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:10:28.498387 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:28.504000 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:10:28.504000 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:28.513428 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d] added
May 28 10:10:28.513428 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:10:28.513428 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:10:28.513428 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:10:28.513428 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:10:28.513428 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:10:28.513428 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:28.513712 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:10:28.513891 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0273(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:10:28.514089 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:10:28.517426 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d] added
May 28 10:10:28.517426 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:10:28.517426 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:10:28.517426 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:10:28.517426 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:10:28.517426 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:10:28.517426 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:28.517587 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:10:28.517819 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.032(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:10:28.518001 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:10:28.728182 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:10:29.235350 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.319s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:29.235664 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:10:29.514554 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:10:29.518785 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:10:29.530102 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:10:29.530102 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:10:29.534867 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:10:29.534867 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:29.555145 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:29.559730 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:29.570848 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:29.570848 np0000001613 nova-compute[98321]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:29.570848 np0000001613 nova-compute[98321]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4 (non-flash)
May 28 10:10:29.570848 np0000001613 nova-compute[98321]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4 (non-flash)
May 28 10:10:29.570848 np0000001613 nova-compute[98321]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:10:29.570848 np0000001613 nova-compute[98321]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef6b904f-a3a4-49d9-9f44-0d05b0b05f29 (non-flash)
May 28 10:10:29.570848 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:10:29.571063 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsi session list stdout=tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:29.571063 np0000001613 nova-compute[98321]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:29.571063 np0000001613 nova-compute[98321]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4 (non-flash)
May 28 10:10:29.571063 np0000001613 nova-compute[98321]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4 (non-flash)
May 28 10:10:29.571063 np0000001613 nova-compute[98321]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:10:29.571063 np0000001613 nova-compute[98321]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef6b904f-a3a4-49d9-9f44-0d05b0b05f29 (non-flash)
May 28 10:10:29.571063 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:10:29.582014 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:29.582014 np0000001613 nova-compute[98321]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:29.582014 np0000001613 nova-compute[98321]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4 (non-flash)
May 28 10:10:29.582014 np0000001613 nova-compute[98321]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4 (non-flash)
May 28 10:10:29.582014 np0000001613 nova-compute[98321]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:10:29.582014 np0000001613 nova-compute[98321]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef6b904f-a3a4-49d9-9f44-0d05b0b05f29 (non-flash)
May 28 10:10:29.582014 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:10:29.582203 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsi session list stdout=tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:29.582203 np0000001613 nova-compute[98321]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:29.582203 np0000001613 nova-compute[98321]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4 (non-flash)
May 28 10:10:29.582203 np0000001613 nova-compute[98321]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4 (non-flash)
May 28 10:10:29.582203 np0000001613 nova-compute[98321]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:10:29.582203 np0000001613 nova-compute[98321]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef6b904f-a3a4-49d9-9f44-0d05b0b05f29 (non-flash)
May 28 10:10:29.582203 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:10:29.630218 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d, portal: 192.168.40.100,3260]
May 28 10:10:29.630218 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d, portal: 192.168.40.100,3260] successful.
May 28 10:10:29.630218 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:29.631582 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d, portal: 192.168.50.100,3260]
May 28 10:10:29.631582 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d, portal: 192.168.50.100,3260] successful.
May 28 10:10:29.631582 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:29.650738 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:29.650966 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:29.657298 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:29.672636 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:29.672636 np0000001613 nova-compute[98321]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:29.672636 np0000001613 nova-compute[98321]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4 (non-flash)
May 28 10:10:29.672636 np0000001613 nova-compute[98321]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4 (non-flash)
May 28 10:10:29.672636 np0000001613 nova-compute[98321]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:10:29.672636 np0000001613 nova-compute[98321]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef6b904f-a3a4-49d9-9f44-0d05b0b05f29 (non-flash)
May 28 10:10:29.672636 np0000001613 nova-compute[98321]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:29.672636 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:29.672636 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:10:29.672908 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsi session list stdout=tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:29.672908 np0000001613 nova-compute[98321]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:29.672908 np0000001613 nova-compute[98321]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4 (non-flash)
May 28 10:10:29.672908 np0000001613 nova-compute[98321]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4 (non-flash)
May 28 10:10:29.672908 np0000001613 nova-compute[98321]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:10:29.672908 np0000001613 nova-compute[98321]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef6b904f-a3a4-49d9-9f44-0d05b0b05f29 (non-flash)
May 28 10:10:29.672908 np0000001613 nova-compute[98321]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:29.672908 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:29.672908 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:10:29.673119 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.187s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:10:29.673940 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:10:29.674686 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:29.674686 np0000001613 nova-compute[98321]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:29.674686 np0000001613 nova-compute[98321]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4 (non-flash)
May 28 10:10:29.674686 np0000001613 nova-compute[98321]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4 (non-flash)
May 28 10:10:29.674686 np0000001613 nova-compute[98321]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:10:29.674686 np0000001613 nova-compute[98321]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef6b904f-a3a4-49d9-9f44-0d05b0b05f29 (non-flash)
May 28 10:10:29.674686 np0000001613 nova-compute[98321]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:29.674686 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:29.674686 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:10:29.674854 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsi session list stdout=tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:29.674854 np0000001613 nova-compute[98321]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:29.674854 np0000001613 nova-compute[98321]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4 (non-flash)
May 28 10:10:29.674854 np0000001613 nova-compute[98321]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4 (non-flash)
May 28 10:10:29.674854 np0000001613 nova-compute[98321]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:10:29.674854 np0000001613 nova-compute[98321]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef6b904f-a3a4-49d9-9f44-0d05b0b05f29 (non-flash)
May 28 10:10:29.674854 np0000001613 nova-compute[98321]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:29.674854 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:29.674854 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:10:29.675217 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.191s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:10:29.675649 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:10:29.677103 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] HCTL ('14', '-', '-', 0) found on session 149 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:10:29.677245 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:10:29.680066 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] HCTL ('13', '-', '-', 0) found on session 148 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:10:29.680066 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:10:29.695158 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Searching for a device in session 149 and hctl ['14', '*', '*', 0] yield: sdh {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:10:29.695158 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '27d30a68-d569-4696-bcc3-6b1ed57ab61d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:10:29.703519 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Searching for a device in session 148 and hctl ['13', '*', '*', 0] yield: sdi {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:10:29.703701 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27d30a68-d569-4696-bcc3-6b1ed57ab61d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:10:29.741479 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:10:29.741704 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:10:29.742767 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:29.743874 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:29.799404 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Starting migrate_disk_and_power_off {{(pid=98321) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 28 10:10:29.824393 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:29.829276 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:29.859766 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:29.872704 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:29.887302 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec58233d3b2848bbb2e0b00650398cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e9651268114327a9cc6c6c59bef01e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:10:29.904452 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:30.139953 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-68b89391-8b2e-4e59-8d9f-8f8b095e4df3 req-9e6f6f12-8c55-431b-a3db-cd74559b8cf0 service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Received event network-vif-unplugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:10:30.139953 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-68b89391-8b2e-4e59-8d9f-8f8b095e4df3 req-9e6f6f12-8c55-431b-a3db-cd74559b8cf0 service nova] Acquiring lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:30.139953 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-68b89391-8b2e-4e59-8d9f-8f8b095e4df3 req-9e6f6f12-8c55-431b-a3db-cd74559b8cf0 service nova] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:30.139953 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-68b89391-8b2e-4e59-8d9f-8f8b095e4df3 req-9e6f6f12-8c55-431b-a3db-cd74559b8cf0 service nova] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:30.139953 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-68b89391-8b2e-4e59-8d9f-8f8b095e4df3 req-9e6f6f12-8c55-431b-a3db-cd74559b8cf0 service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] No waiting events found dispatching network-vif-unplugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:10:30.139953 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-68b89391-8b2e-4e59-8d9f-8f8b095e4df3 req-9e6f6f12-8c55-431b-a3db-cd74559b8cf0 service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Received unexpected event network-vif-unplugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc for instance with vm_state active and task_state resize_migrating.
May 28 10:10:30.150362 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999661180000203 future=<Future at 0x73c1f41b9760 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:10:30.151130 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.998917346000326 future=<Future at 0x73c1f41b9760 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:10:30.152062 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.997919489000196 future=<Future at 0x73c1f41b9760 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:10:30.153945 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Instance destroyed successfully.
May 28 10:10:30.156222 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:09:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1080199311',display_name='tempest-TestEncryptedCinderVolumes-server-1080199311',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testencryptedcindervolumes-server-1080199311',id=55,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPEA8+uxSyCsgS6j+focPk4QpOVZVeAFK2kV4ErBJfCH5RkIc3vXvdGbsr44pZ3e0kq61KVrhwaHdQPmC2IB37UUcRSn+zMS1bh2okKRJrj9i8mJQASjzRzDfrAxUyWcQ==',key_name='tempest-keypair-831862139',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:09:27Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(13),node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c7563a83d33d4bc1a6610ccf53c18dc1',ramdisk_id='',reservation_id='r-34tgbqip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-297752033',owner_user_name='tempest-TestEncryptedCinderVolumes-297752033-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:10:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='961948be669c4a18a29398d53015f03b',uuid=edd8dcff-3440-445a-b4a2-8c56863e7ca3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "address": "fa:16:3e:5c:9e:66", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.216", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "vif_mac": "fa:16:3e:5c:9e:66"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb80648-bd", "ovs_interfaceid": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:10:30.156222 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Converting VIF {"id": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "address": "fa:16:3e:5c:9e:66", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.216", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "vif_mac": "fa:16:3e:5c:9e:66"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb80648-bd", "ovs_interfaceid": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:10:30.156222 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:9e:66,bridge_name='br-int',has_traffic_filtering=True,id=6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb80648-bd') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:10:30.156222 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:9e:66,bridge_name='br-int',has_traffic_filtering=True,id=6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb80648-bd') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:10:30.160216 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:30.161434 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6eb80648-bd, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:10:30.163658 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:30.165580 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:10:30.166814 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:30.166814 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7005c000-9c59-4d79-8b26-4e258609c3f3) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:10:30.168207 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:30.168868 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:10:30.174797 np0000001613 nova-compute[98321]: INFO os_vif [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:9e:66,bridge_name='br-int',has_traffic_filtering=True,id=6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb80648-bd')
May 28 10:10:30.177659 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:10:30.179282 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ddb1344-a4d2-4480-9818-32c65d8ad963', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:10:30.179282 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:10:30.247009 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:10:30.446560 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Successfully created port: f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:10:30.487117 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:10:30.760924 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:10:31.050702 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Successfully updated port: f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:10:31.116337 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-57cc3d38-d43b-4642-8613-279d21833d08 req-116fc833-787f-4060-a3ac-050548ba1345 service nova] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Received event network-changed-f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:10:31.116942 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-57cc3d38-d43b-4642-8613-279d21833d08 req-116fc833-787f-4060-a3ac-050548ba1345 service nova] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Refreshing instance network info cache due to event network-changed-f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:10:31.117277 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-57cc3d38-d43b-4642-8613-279d21833d08 req-116fc833-787f-4060-a3ac-050548ba1345 service nova] Acquiring lock "refresh_cache-5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:10:31.117525 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-57cc3d38-d43b-4642-8613-279d21833d08 req-116fc833-787f-4060-a3ac-050548ba1345 service nova] Acquired lock "refresh_cache-5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:10:31.117694 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-57cc3d38-d43b-4642-8613-279d21833d08 req-116fc833-787f-4060-a3ac-050548ba1345 service nova] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Refreshing network info cache for port f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:10:31.269220 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Booting with volume 73471d14-2d44-4513-afbe-2a601903e623 at /dev/vda
May 28 10:10:31.325336 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:10:31.341309 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:10:31.368382 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:10:31.415414 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:10:31.415815 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:10:31.425148 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:10:31.426465 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe83:3c7d', 'fe80::e03f:79ff:fe2f:2d97', 'fe80::fc16:3eff:fe33:fbde', 'fe80::6807:fff:fe4c:bed3'] 
May 28 10:10:31.426630 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:10:31.426702 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:10:31.426955 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] <== get_connector_properties: return (102ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:10:31.427226 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Updating existing volume attachment record: 9e315952-8faf-4413-9d5c-86687e3e648a {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:10:31.506788 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Found WWN 330000000e1557434 for multipath device dm-2 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:10:31.506989 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:10:31.507195 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] <== connect_volume: return (3321ms) {'type': 'block', 'scsi_wwn': '330000000e1557434', 'path': '/dev/dm-2', 'multipath_id': '330000000e1557434'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:10:31.508049 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e1557434', 'path': '/dev/dm-2', 'multipath_id': '330000000e1557434'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:10:31.508688 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.330s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:10:31.511592 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ddb1344-a4d2-4480-9818-32c65d8ad963', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:10:31.511592 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:10:31.520121 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lazy-loading 'flavor' on Instance uuid c0786416-dec3-4610-9ec2-389aa7508148 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:10:31.541028 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:31.549731 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:31.549731 np0000001613 nova-compute[98321]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:31.549731 np0000001613 nova-compute[98321]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4 (non-flash)
May 28 10:10:31.549731 np0000001613 nova-compute[98321]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4 (non-flash)
May 28 10:10:31.549731 np0000001613 nova-compute[98321]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:10:31.549731 np0000001613 nova-compute[98321]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef6b904f-a3a4-49d9-9f44-0d05b0b05f29 (non-flash)
May 28 10:10:31.549731 np0000001613 nova-compute[98321]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:31.549731 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:31.549731 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:10:31.549731 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsi session list stdout=tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:31.549731 np0000001613 nova-compute[98321]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:31.549731 np0000001613 nova-compute[98321]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4 (non-flash)
May 28 10:10:31.549731 np0000001613 nova-compute[98321]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4 (non-flash)
May 28 10:10:31.549731 np0000001613 nova-compute[98321]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:10:31.549731 np0000001613 nova-compute[98321]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef6b904f-a3a4-49d9-9f44-0d05b0b05f29 (non-flash)
May 28 10:10:31.549731 np0000001613 nova-compute[98321]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:31.549731 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:31.549731 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:10:31.549731 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', '142'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', '143'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4', '144'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4', '145'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d', '146'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef6b904f-a3a4-49d9-9f44-0d05b0b05f29', '147'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', '148'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', '149')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:10:31.549731 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', '143')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:10:31.549731 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', '142')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:10:31.549731 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc223ce0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963'): ({'sdc'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:10:31.549731 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Removing multipathed devices sdf, sdc {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:10:31.549731 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Flush multipath device 330000000e79767bf {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:10:31.554780 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "refresh_cache-5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:10:31.589469 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:10:31.621104 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-57cc3d38-d43b-4642-8613-279d21833d08 req-116fc833-787f-4060-a3ac-050548ba1345 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:31.643016 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:10:31.695862 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-57cc3d38-d43b-4642-8613-279d21833d08 req-116fc833-787f-4060-a3ac-050548ba1345 service nova] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:10:31.700767 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Checking to see if SCSI volumes sdf, sdc have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:10:31.700767 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] SCSI volumes sdf, sdc have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:10:31.700767 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Checking to see if device paths {'sdf', 'sdc'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:10:31.713994 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Device paths {'sdf', 'sdc'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:10:31.715414 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:10:31.736400 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:31.765766 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Acquiring lock "f42f06fc-5b0c-4973-98db-cd594815f317" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:31.765766 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "f42f06fc-5b0c-4973-98db-cd594815f317" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:31.768058 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 143, target: iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963, portal: 192.168.40.100,3260]
May 28 10:10:31.768058 np0000001613 nova-compute[98321]: Logout of [sid: 143, target: iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963, portal: 192.168.40.100,3260] successful.
May 28 10:10:31.768058 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:31.785577 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:31.797386 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:31.836621 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 142, target: iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963, portal: 192.168.50.100,3260]
May 28 10:10:31.836621 np0000001613 nova-compute[98321]: Logout of [sid: 142, target: iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963, portal: 192.168.50.100,3260] successful.
May 28 10:10:31.836621 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:31.857707 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:31.860247 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:10:31.860426 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] <== disconnect_volume: return (1682ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:10:31.860599 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:10:31.870754 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-57cc3d38-d43b-4642-8613-279d21833d08 req-116fc833-787f-4060-a3ac-050548ba1345 service nova] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:10:31.878898 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:10:31.976712 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:10:31.978759 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:10:32.026889 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Attempting to attach volume 27d30a68-d569-4696-bcc3-6b1ed57ab61d with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 10:10:32.030611 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] attach device xml: <disk type="block" device="disk">
May 28 10:10:32.030611 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:10:32.030611 np0000001613 nova-compute[98321]:   <alias name="ua-27d30a68-d569-4696-bcc3-6b1ed57ab61d"/>
May 28 10:10:32.030611 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-2"/>
May 28 10:10:32.030611 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:10:32.030611 np0000001613 nova-compute[98321]:   <serial>27d30a68-d569-4696-bcc3-6b1ed57ab61d</serial>
May 28 10:10:32.030611 np0000001613 nova-compute[98321]: </disk>
May 28 10:10:32.030611 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 10:10:32.079531 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:10:32.079943 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] skipping disk /dev/disk/by-id/os-brick+dev+dm-0 (vdb) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:10:32.080614 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3_resize/disk /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:10:32.194918 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CMD "cp -r /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3_resize/disk /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk" returned: 0 in 0.114s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:10:32.196247 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3_resize/disk.config /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk.config {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:10:32.228185 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-28643a01-0925-4a43-a004-7f53dc9e6fe0 req-35fbee6b-fea8-4d09-bc89-68d73428c3e6 service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Received event network-vif-unplugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:10:32.228631 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-28643a01-0925-4a43-a004-7f53dc9e6fe0 req-35fbee6b-fea8-4d09-bc89-68d73428c3e6 service nova] Acquiring lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:32.228945 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-28643a01-0925-4a43-a004-7f53dc9e6fe0 req-35fbee6b-fea8-4d09-bc89-68d73428c3e6 service nova] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:32.229107 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-28643a01-0925-4a43-a004-7f53dc9e6fe0 req-35fbee6b-fea8-4d09-bc89-68d73428c3e6 service nova] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:32.231439 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-28643a01-0925-4a43-a004-7f53dc9e6fe0 req-35fbee6b-fea8-4d09-bc89-68d73428c3e6 service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] No waiting events found dispatching network-vif-unplugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:10:32.231620 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-28643a01-0925-4a43-a004-7f53dc9e6fe0 req-35fbee6b-fea8-4d09-bc89-68d73428c3e6 service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Received unexpected event network-vif-unplugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc for instance with vm_state active and task_state resize_migrating.
May 28 10:10:32.245899 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CMD "cp -r /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3_resize/disk.config /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk.config" returned: 0 in 0.049s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:10:32.246637 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3_resize/disk.info /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk.info {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:10:32.271378 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Detaching volume db1c0833-c0b8-418c-90a2-a069b76be9c4
May 28 10:10:32.297717 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CMD "cp -r /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3_resize/disk.info /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk.info" returned: 0 in 0.052s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:10:32.339984 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Attempting to driver detach volume db1c0833-c0b8-418c-90a2-a069b76be9c4 from mountpoint /dev/vdb
May 28 10:10:32.348027 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Found disk vdb by alias ua-db1c0833-c0b8-418c-90a2-a069b76be9c4 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:10:32.352443 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Found disk vdb by alias ua-db1c0833-c0b8-418c-90a2-a069b76be9c4 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:10:32.352708 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Attempting to detach device vdb from instance f42f06fc-5b0c-4973-98db-cd594815f317 from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 10:10:32.353046 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:10:32.353046 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:10:32.353046 np0000001613 nova-compute[98321]:   <alias name="ua-db1c0833-c0b8-418c-90a2-a069b76be9c4"/>
May 28 10:10:32.353046 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-1"/>
May 28 10:10:32.353046 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:10:32.353046 np0000001613 nova-compute[98321]:   <serial>db1c0833-c0b8-418c-90a2-a069b76be9c4</serial>
May 28 10:10:32.353046 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:10:32.353046 np0000001613 nova-compute[98321]: </disk>
May 28 10:10:32.353046 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:10:32.364736 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Successfully detached device vdb from instance f42f06fc-5b0c-4973-98db-cd594815f317 from the persistent domain config.
May 28 10:10:32.365286 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] (1/8): Attempting to detach device vdb with device alias ua-db1c0833-c0b8-418c-90a2-a069b76be9c4 from instance f42f06fc-5b0c-4973-98db-cd594815f317 from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 10:10:32.365459 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:10:32.365459 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:10:32.365459 np0000001613 nova-compute[98321]:   <alias name="ua-db1c0833-c0b8-418c-90a2-a069b76be9c4"/>
May 28 10:10:32.365459 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-1"/>
May 28 10:10:32.365459 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:10:32.365459 np0000001613 nova-compute[98321]:   <serial>db1c0833-c0b8-418c-90a2-a069b76be9c4</serial>
May 28 10:10:32.365459 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:10:32.365459 np0000001613 nova-compute[98321]: </disk>
May 28 10:10:32.365459 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:10:32.376846 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-57cc3d38-d43b-4642-8613-279d21833d08 req-116fc833-787f-4060-a3ac-050548ba1345 service nova] Releasing lock "refresh_cache-5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:10:32.377585 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquired lock "refresh_cache-5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:10:32.377822 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:10:32.913889 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779963032.913253, f42f06fc-5b0c-4973-98db-cd594815f317 => ua-db1c0833-c0b8-418c-90a2-a069b76be9c4> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 10:10:32.915200 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-db1c0833-c0b8-418c-90a2-a069b76be9c4 for instance f42f06fc-5b0c-4973-98db-cd594815f317 {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 10:10:32.917332 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Successfully detached device vdb from instance f42f06fc-5b0c-4973-98db-cd594815f317 from the live domain config.
May 28 10:10:32.918522 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:10:32.918943 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4', 'iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'db1c0833-c0b8-418c-90a2-a069b76be9c4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:10:32.921177 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:10:32.921177 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:10:32.921177 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4', 'iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'db1c0833-c0b8-418c-90a2-a069b76be9c4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:10:32.921177 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:10:32.946692 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4 (non-flash)
May 28 10:10:32.946692 np0000001613 nova-compute[98321]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4 (non-flash)
May 28 10:10:32.946692 np0000001613 nova-compute[98321]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:10:32.946692 np0000001613 nova-compute[98321]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef6b904f-a3a4-49d9-9f44-0d05b0b05f29 (non-flash)
May 28 10:10:32.946692 np0000001613 nova-compute[98321]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:32.946692 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:32.946692 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:10:32.947007 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsi session list stdout=tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4 (non-flash)
May 28 10:10:32.947007 np0000001613 nova-compute[98321]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4 (non-flash)
May 28 10:10:32.947007 np0000001613 nova-compute[98321]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:10:32.947007 np0000001613 nova-compute[98321]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef6b904f-a3a4-49d9-9f44-0d05b0b05f29 (non-flash)
May 28 10:10:32.947007 np0000001613 nova-compute[98321]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:32.947007 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:32.947007 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:10:32.947214 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4', '144'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4', '145'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d', '146'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef6b904f-a3a4-49d9-9f44-0d05b0b05f29', '147'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', '148'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', '149')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:10:32.947549 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4', '145')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:10:32.948802 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4', '144')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:10:32.949829 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc2ab9c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4'): ({'sdb'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:10:32.950100 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Removing multipathed devices sdb, sdd {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:10:32.954695 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Flush multipath device 330000000cc576b7c {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:10:32.976716 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:10:32.985315 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:10:33.026734 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:10:33.090278 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Checking to see if SCSI volumes sdb, sdd have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:10:33.090541 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] SCSI volumes sdb, sdd have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:10:33.091947 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Checking to see if device paths {'sdb', 'sdd'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:10:33.109191 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Device paths {'sdb', 'sdd'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:10:33.109989 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:10:33.127460 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:33.157226 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 145, target: iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4, portal: 192.168.40.100,3260]
May 28 10:10:33.157226 np0000001613 nova-compute[98321]: Logout of [sid: 145, target: iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4, portal: 192.168.40.100,3260] successful.
May 28 10:10:33.157226 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:33.172590 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:33.179110 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:33.184526 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:33.225445 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 144, target: iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4, portal: 192.168.50.100,3260]
May 28 10:10:33.225445 np0000001613 nova-compute[98321]: Logout of [sid: 144, target: iqn.2023-03.storpool.com:os--volume-db1c0833-c0b8-418c-90a2-a069b76be9c4, portal: 192.168.50.100,3260] successful.
May 28 10:10:33.225445 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:33.243239 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:33.243771 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:10:33.243771 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] <== disconnect_volume: return (325ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:10:33.243771 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:10:33.341564 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Updating instance_info_cache with network_info: [{"id": "f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b", "address": "fa:16:3e:e7:8c:eb", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e7bd1f-7b", "ovs_interfaceid": "f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:10:33.468087 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:33.471181 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:33.545982 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Port 6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc binding to destination host np0000001613 is already ACTIVE {{(pid=98321) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 28 10:10:33.583981 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:10:33.585194 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:10:33.585464 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Creating image(s)
May 28 10:10:33.585732 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Did not create local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 10:10:33.585860 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Ensure instance console log exists: /opt/stack/data/nova/instances/5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:10:33.586084 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:33.586455 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:33.586591 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:33.699183 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:10:33.699369 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:10:33.699527 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:10:33.699681 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] No VIF found with MAC fa:16:3e:83:3c:7d, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:10:33.800492 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lazy-loading 'flavor' on Instance uuid f42f06fc-5b0c-4973-98db-cd594815f317 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:10:33.843741 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Releasing lock "refresh_cache-5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:10:33.843959 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Instance network_info: |[{"id": "f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b", "address": "fa:16:3e:e7:8c:eb", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e7bd1f-7b", "ovs_interfaceid": "f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:10:33.844492 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Start _get_guest_xml network_info=[{"id": "f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b", "address": "fa:16:3e:e7:8c:eb", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e7bd1f-7b", "ovs_interfaceid": "f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623', 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '73471d14-2d44-4513-afbe-2a601903e623', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9', 'attached_at': '', 'detached_at': '', 'volume_id': '73471d14-2d44-4513-afbe-2a601903e623', 'serial': '73471d14-2d44-4513-afbe-2a601903e623'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '9e315952-8faf-4413-9d5c-86687e3e648a', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:10:33.847753 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:10:33.848808 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-volume-backed-server-1154159386', uuid='5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9'), owner=OwnerMeta(userid='ec58233d3b2848bbb2e0b00650398cd1', username='tempest-TestVolumeBootPattern-327944304-project-member', projectid='23e9651268114327a9cc6c6c59bef01e', projectname='tempest-TestVolumeBootPattern-327944304'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b", "address": "fa:16:3e:e7:8c:eb", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e7bd1f-7b", "ovs_interfaceid": "f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779963033.8485143) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:10:33.849752 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:10:33.850040 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:10:33.850927 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:10:33.851098 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:10:33.851902 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:10:33.852133 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:10:33.852276 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:10:33.852375 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:10:33.852509 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:10:33.852592 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:10:33.852681 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:10:33.852822 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:10:33.852915 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:10:33.853016 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:10:33.853113 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:10:33.853242 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:10:33.861880 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:10:33.862101 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623', 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '73471d14-2d44-4513-afbe-2a601903e623', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:10:33.862227 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:10:33.862494 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:10:33.862657 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623', 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '73471d14-2d44-4513-afbe-2a601903e623', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:10:33.875015 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:10:33.875877 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:10:33.884412 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:10:33.889001 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.013s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:10:33.889290 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:10:33.889560 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:10:33.899876 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:10:33.899876 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:33.903652 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:10:33.903652 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:33.911280 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623] added
May 28 10:10:33.911280 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:10:33.911280 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:10:33.911280 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:10:33.911280 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:10:33.911280 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:10:33.911280 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:33.911526 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:10:33.911747 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0225(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:10:33.911983 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:10:33.915094 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623] added
May 28 10:10:33.915094 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:10:33.915094 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:10:33.915094 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:10:33.915094 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:10:33.915094 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:10:33.915094 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:33.915564 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:10:33.915564 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0265(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:10:33.915564 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:10:34.553433 np0000001613 nova-compute[98321]: DEBUG nova.compute.rpcapi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98321) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 10:10:34.572735 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:34.572910 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:34.573052 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:34.810472 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-1c26ff08-3995-4d6b-9d4b-ba292c4e821a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "f42f06fc-5b0c-4973-98db-cd594815f317" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.046s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:34.860006 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:34.912986 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:10:34.916486 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:10:34.927129 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:10:34.927129 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:10:34.931640 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:10:34.931640 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:34.937713 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:34.948240 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:34.955522 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:10:34.955522 np0000001613 nova-compute[98321]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef6b904f-a3a4-49d9-9f44-0d05b0b05f29 (non-flash)
May 28 10:10:34.955522 np0000001613 nova-compute[98321]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:34.955522 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:34.955522 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:10:34.955860 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:10:34.955860 np0000001613 nova-compute[98321]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef6b904f-a3a4-49d9-9f44-0d05b0b05f29 (non-flash)
May 28 10:10:34.955860 np0000001613 nova-compute[98321]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:34.955860 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:34.955860 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:10:34.995875 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:10:34.995875 np0000001613 nova-compute[98321]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef6b904f-a3a4-49d9-9f44-0d05b0b05f29 (non-flash)
May 28 10:10:34.995875 np0000001613 nova-compute[98321]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:34.995875 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:34.995875 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:10:34.996104 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:10:34.996104 np0000001613 nova-compute[98321]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef6b904f-a3a4-49d9-9f44-0d05b0b05f29 (non-flash)
May 28 10:10:34.996104 np0000001613 nova-compute[98321]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:34.996104 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:34.996104 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:10:35.004227 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623, portal: 192.168.50.100,3260]
May 28 10:10:35.004227 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623, portal: 192.168.50.100,3260] successful.
May 28 10:10:35.004227 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:35.015522 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:35.029221 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:10:35.029221 np0000001613 nova-compute[98321]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef6b904f-a3a4-49d9-9f44-0d05b0b05f29 (non-flash)
May 28 10:10:35.029221 np0000001613 nova-compute[98321]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:35.029221 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:35.029221 np0000001613 nova-compute[98321]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:35.029221 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:10:35.029497 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:10:35.029497 np0000001613 nova-compute[98321]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef6b904f-a3a4-49d9-9f44-0d05b0b05f29 (non-flash)
May 28 10:10:35.029497 np0000001613 nova-compute[98321]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:35.029497 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:35.029497 np0000001613 nova-compute[98321]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:35.029497 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:10:35.029696 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.141s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:10:35.029696 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:10:35.030380 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] HCTL ('7', '-', '-', 0) found on session 150 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:10:35.030517 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:10:35.053733 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching for a device in session 150 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:10:35.053928 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '73471d14-2d44-4513-afbe-2a601903e623', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:10:35.069048 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623, portal: 192.168.40.100,3260]
May 28 10:10:35.069048 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623, portal: 192.168.40.100,3260] successful.
May 28 10:10:35.069048 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:35.082277 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:35.098265 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:10:35.098265 np0000001613 nova-compute[98321]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef6b904f-a3a4-49d9-9f44-0d05b0b05f29 (non-flash)
May 28 10:10:35.098265 np0000001613 nova-compute[98321]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:35.098265 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:35.098265 np0000001613 nova-compute[98321]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:35.098265 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:35.098265 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:10:35.098524 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:10:35.098524 np0000001613 nova-compute[98321]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef6b904f-a3a4-49d9-9f44-0d05b0b05f29 (non-flash)
May 28 10:10:35.098524 np0000001613 nova-compute[98321]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:35.098524 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:35.098524 np0000001613 nova-compute[98321]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:35.098524 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:35.098524 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:10:35.098720 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.223s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:10:35.098821 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:10:35.099614 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] HCTL ('8', '-', '-', 0) found on session 151 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:10:35.099716 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:10:35.113089 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching for a device in session 151 and hctl ['8', '*', '*', 0] yield: None {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:10:35.167484 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:35.258790 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-15f9f52e-8fb6-48b9-bff7-6f4829588b0e tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "c0786416-dec3-4610-9ec2-389aa7508148" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.786s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:35.581543 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:35.654565 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "refresh_cache-edd8dcff-3440-445a-b4a2-8c56863e7ca3" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:10:35.654565 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquired lock "refresh_cache-edd8dcff-3440-445a-b4a2-8c56863e7ca3" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:10:35.654565 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:10:36.113818 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching for a device in session 151 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:10:36.114222 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '73471d14-2d44-4513-afbe-2a601903e623', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:10:36.157013 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:36.898574 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Found WWN 33000000033a15670 for multipath device dm-0 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:10:36.899179 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:10:36.899179 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '33000000033a15670', 'path': '/dev/dm-0', 'multipath_id': '33000000033a15670'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:10:36.899179 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000033a15670', 'path': '/dev/dm-0', 'multipath_id': '33000000033a15670'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:10:37.002190 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:37.154601 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Updating instance_info_cache with network_info: [{"id": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "address": "fa:16:3e:5c:9e:66", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb80648-bd", "ovs_interfaceid": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:10:37.262806 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-1adf1480-b7f2-4db4-bf23-d9619f12ab94 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:10:37.405665 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:10:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1154159386',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1154159386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpattern-volume-backed-server-1154159386',id=60,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSGdGDTpkrfeA5bxTBraSUAdxFaEI225UG+XhKLS/HXxUQ2rB9uEiU5bBBTd7sBRG6A4cYQs3Jv4Yyb7HHlgmDWttsOJBcveq/4gyM/RNwXAYVDIGRikZqLT6mOn3+p9Q==',key_name='tempest-keypair-138210009',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23e9651268114327a9cc6c6c59bef01e',ramdisk_id='',reservation_id='r-exvv2blf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-327944304',owner_user_name='tempest-TestVolumeBootPattern-327944304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:10:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec58233d3b2848bbb2e0b00650398cd1',uuid=5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b", "address": "fa:16:3e:e7:8c:eb", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e7bd1f-7b", "ovs_interfaceid": "f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:10:37.405916 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converting VIF {"id": "f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b", "address": "fa:16:3e:e7:8c:eb", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e7bd1f-7b", "ovs_interfaceid": "f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:10:37.406776 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:8c:eb,bridge_name='br-int',has_traffic_filtering=True,id=f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e7bd1f-7b') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:10:37.407596 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:10:37.659225 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Releasing lock "refresh_cache-edd8dcff-3440-445a-b4a2-8c56863e7ca3" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:10:37.769594 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-1adf1480-b7f2-4db4-bf23-d9619f12ab94 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] instance snapshotting
May 28 10:10:37.905105 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-1adf1480-b7f2-4db4-bf23-d9619f12ab94 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Beginning live snapshot process
May 28 10:10:37.911026 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] End _get_guest_xml xml=<domain type="qemu">
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:   <uuid>5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9</uuid>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:   <name>instance-0000003c</name>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1154159386</nova:name>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:10:33</nova:creationTime>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:       <nova:image uuid="">
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:         <nova:user uuid="ec58233d3b2848bbb2e0b00650398cd1">tempest-TestVolumeBootPattern-327944304-project-member</nova:user>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:         <nova:project uuid="23e9651268114327a9cc6c6c59bef01e">tempest-TestVolumeBootPattern-327944304</nova:project>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:       <nova:root type="volume" uuid=""/>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:         <nova:port uuid="f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b">
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:     <system>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:       <entry name="serial">5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9</entry>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:       <entry name="uuid">5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9</entry>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:     </system>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:   <os>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:   </os>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:   <features>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:   </features>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:   <devices>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9/disk.config"/>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:     </disk>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:       <alias name="ua-73471d14-2d44-4513-afbe-2a601903e623"/>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-0"/>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:       <serial>73471d14-2d44-4513-afbe-2a601903e623</serial>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:     </disk>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:e7:8c:eb"/>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:       <target dev="tapf9e7bd1f-7b"/>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:     </interface>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9/console.log" append="off"/>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:     </serial>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:     <video>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:     </video>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:     </rng>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:   </devices>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]: </domain>
May 28 10:10:37.911026 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:10:37.913031 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Preparing to wait for external event network-vif-plugged-f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:10:37.913031 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:37.913031 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:37.913031 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:37.913031 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:10:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1154159386',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1154159386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpattern-volume-backed-server-1154159386',id=60,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSGdGDTpkrfeA5bxTBraSUAdxFaEI225UG+XhKLS/HXxUQ2rB9uEiU5bBBTd7sBRG6A4cYQs3Jv4Yyb7HHlgmDWttsOJBcveq/4gyM/RNwXAYVDIGRikZqLT6mOn3+p9Q==',key_name='tempest-keypair-138210009',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23e9651268114327a9cc6c6c59bef01e',ramdisk_id='',reservation_id='r-exvv2blf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-327944304',owner_user_name='tempest-TestVolumeBootPattern-327944304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:10:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec58233d3b2848bbb2e0b00650398cd1',uuid=5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b", "address": "fa:16:3e:e7:8c:eb", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e7bd1f-7b", "ovs_interfaceid": "f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:10:37.913031 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converting VIF {"id": "f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b", "address": "fa:16:3e:e7:8c:eb", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e7bd1f-7b", "ovs_interfaceid": "f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:10:37.913357 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:8c:eb,bridge_name='br-int',has_traffic_filtering=True,id=f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e7bd1f-7b') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:10:37.913413 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:8c:eb,bridge_name='br-int',has_traffic_filtering=True,id=f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e7bd1f-7b') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:10:37.916301 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:37.920179 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:10:37.920434 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:10:37.921294 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:37.921689 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ea1cea32-2864-5d2e-854e-72d828feb0d3', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:10:37.922637 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:37.923746 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:10:37.923746 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:37.925734 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:37.925904 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9e7bd1f-7b, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:10:37.926270 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf9e7bd1f-7b, col_values=(('qos', UUID('ce208a3e-4ea0-4058-ab0f-cb364ecfe115')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:10:37.926497 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf9e7bd1f-7b, col_values=(('external_ids', {'iface-id': 'f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:8c:eb', 'vm-uuid': '5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:10:37.927682 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:37.928829 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:10:37.933069 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:37.934476 np0000001613 nova-compute[98321]: INFO os_vif [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:8c:eb,bridge_name='br-int',has_traffic_filtering=True,id=f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e7bd1f-7b')
May 28 10:10:38.167774 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:10:38.187488 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:10:38.217521 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:10:38.268029 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:10:38.268382 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:10:38.276598 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:10:38.277559 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe83:3c7d', 'fe80::e03f:79ff:fe2f:2d97', 'fe80::fc16:3eff:fe33:fbde', 'fe80::6807:fff:fe4c:bed3'] 
May 28 10:10:38.277669 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:10:38.277775 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:10:38.278006 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:10:38.802266 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:39.194802 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-445568c6-94a7-48c2-84ec-b41a20e9aeb6 req-133d62ac-76aa-461f-9c4e-f94a6ad93236 service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Received event network-changed-19e2cc51-3e82-46f4-8d06-7406f2f72300 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:10:39.196551 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-445568c6-94a7-48c2-84ec-b41a20e9aeb6 req-133d62ac-76aa-461f-9c4e-f94a6ad93236 service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Refreshing instance network info cache due to event network-changed-19e2cc51-3e82-46f4-8d06-7406f2f72300. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:10:39.196918 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-445568c6-94a7-48c2-84ec-b41a20e9aeb6 req-133d62ac-76aa-461f-9c4e-f94a6ad93236 service nova] Acquiring lock "refresh_cache-c0786416-dec3-4610-9ec2-389aa7508148" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:10:39.197026 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-445568c6-94a7-48c2-84ec-b41a20e9aeb6 req-133d62ac-76aa-461f-9c4e-f94a6ad93236 service nova] Acquired lock "refresh_cache-c0786416-dec3-4610-9ec2-389aa7508148" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:10:39.197156 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-445568c6-94a7-48c2-84ec-b41a20e9aeb6 req-133d62ac-76aa-461f-9c4e-f94a6ad93236 service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Refreshing network info cache for port 19e2cc51-3e82-46f4-8d06-7406f2f72300 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:10:39.429393 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-1adf1480-b7f2-4db4-bf23-d9619f12ab94 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f42f06fc-5b0c-4973-98db-cd594815f317/disk --force-share --output=json -f qcow2 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:10:39.450495 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Starting finish_migration {{(pid=98321) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 28 10:10:39.454108 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Instance directory exists: not creating {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 10:10:39.454320 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Creating image(s)
May 28 10:10:39.457846 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:10:39.482651 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:10:39.482870 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:10:39.483056 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] No VIF found with MAC fa:16:3e:e7:8c:eb, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:10:39.486182 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Using config drive
May 28 10:10:39.536549 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-1adf1480-b7f2-4db4-bf23-d9619f12ab94 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f42f06fc-5b0c-4973-98db-cd594815f317/disk --force-share --output=json -f qcow2" returned: 0 in 0.107s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:10:39.536991 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-1adf1480-b7f2-4db4-bf23-d9619f12ab94 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f42f06fc-5b0c-4973-98db-cd594815f317/disk --force-share --output=json -f qcow2 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:10:39.568174 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.109s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:10:39.569072 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Checking if we can resize image /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:10:39.569522 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:10:39.645691 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-1adf1480-b7f2-4db4-bf23-d9619f12ab94 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f42f06fc-5b0c-4973-98db-cd594815f317/disk --force-share --output=json -f qcow2" returned: 0 in 0.108s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:10:39.646638 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-1adf1480-b7f2-4db4-bf23-d9619f12ab94 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:10:39.700448 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-1adf1480-b7f2-4db4-bf23-d9619f12ab94 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:10:39.700448 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-1adf1480-b7f2-4db4-bf23-d9619f12ab94 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:10:39.700448 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:10:39.700448 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Cannot resize image /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:10:39.701570 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-445568c6-94a7-48c2-84ec-b41a20e9aeb6 req-133d62ac-76aa-461f-9c4e-f94a6ad93236 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:39.776395 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-1adf1480-b7f2-4db4-bf23-d9619f12ab94 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.113s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:10:39.777184 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-1adf1480-b7f2-4db4-bf23-d9619f12ab94 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpotx9ryze/e9f6b3e8a5e543018c6e2e0b2281be98.delta 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:10:39.848697 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-1adf1480-b7f2-4db4-bf23-d9619f12ab94 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpotx9ryze/e9f6b3e8a5e543018c6e2e0b2281be98.delta 1073741824" returned: 0 in 0.071s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:10:39.849264 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-1adf1480-b7f2-4db4-bf23-d9619f12ab94 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Quiescing instance not available: QEMU guest agent is not enabled.
May 28 10:10:39.862243 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:39.999298 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:40.106130 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-1adf1480-b7f2-4db4-bf23-d9619f12ab94 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] COPY block job progress, current cursor: 0 final cursor: 76808192 {{(pid=98321) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 28 10:10:40.148577 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Creating config drive at /opt/stack/data/nova/instances/5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9/disk.config
May 28 10:10:40.156037 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcyd106_z {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:10:40.177337 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-445568c6-94a7-48c2-84ec-b41a20e9aeb6 req-133d62ac-76aa-461f-9c4e-f94a6ad93236 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:40.195364 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Did not create local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 10:10:40.195856 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Ensure instance console log exists: /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:10:40.199777 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:40.200679 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:40.200778 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:40.206975 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Start _get_guest_xml network_info=[{"id": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "address": "fa:16:3e:5c:9e:66", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.216", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "vif_mac": "fa:16:3e:5c:9e:66"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb80648-bd", "ovs_interfaceid": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ddb1344-a4d2-4480-9818-32c65d8ad963', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'edd8dcff-3440-445a-b4a2-8c56863e7ca3', 'attached_at': '2026-05-28T10:10:38.000000', 'detached_at': '', 'volume_id': '1ddb1344-a4d2-4480-9818-32c65d8ad963', 'serial': '1ddb1344-a4d2-4480-9818-32c65d8ad963'}, 'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': '2b5392a0-c6cf-4c4a-afc8-75193606550f', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:10:40.210275 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:10:40.211588 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1080199311', uuid='edd8dcff-3440-445a-b4a2-8c56863e7ca3'), owner=OwnerMeta(userid='961948be669c4a18a29398d53015f03b', username='tempest-TestEncryptedCinderVolumes-297752033-project-member', projectid='c7563a83d33d4bc1a6610ccf53c18dc1', projectname='tempest-TestEncryptedCinderVolumes-297752033'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='tempest-804599202', flavorid='b6c0d6a6-fe1c-4891-9a59-4a219864aa6f', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={}, swap=0), network_info=[{"id": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "address": "fa:16:3e:5c:9e:66", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.216", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "vif_mac": "fa:16:3e:5c:9e:66"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb80648-bd", "ovs_interfaceid": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779963040.2111967) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:10:40.212942 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:10:40.213264 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:10:40.214295 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:10:40.215948 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:10:40.215948 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:10:40.215948 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T10:10:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={},flavorid='b6c0d6a6-fe1c-4891-9a59-4a219864aa6f',id=13,is_public=True,memory_mb=192,name='tempest-804599202',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:10:40.215948 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:10:40.215948 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:10:40.216189 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:10:40.216189 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:10:40.216253 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:10:40.216472 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:10:40.216597 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:10:40.216727 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:10:40.216837 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:10:40.216959 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:10:40.229448 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcyd106_z" returned: 0 in 0.074s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:10:40.236423 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk.config --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:10:40.331004 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk.config --force-share --output=json" returned: 0 in 0.094s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:10:40.334383 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-445568c6-94a7-48c2-84ec-b41a20e9aeb6 req-133d62ac-76aa-461f-9c4e-f94a6ad93236 service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Updated VIF entry in instance network info cache for port 19e2cc51-3e82-46f4-8d06-7406f2f72300. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:10:40.335185 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "/opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:40.335185 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-445568c6-94a7-48c2-84ec-b41a20e9aeb6 req-133d62ac-76aa-461f-9c4e-f94a6ad93236 service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Updating instance_info_cache with network_info: [{"id": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "address": "fa:16:3e:83:3c:7d", "network": {"id": "db344666-4990-47d9-a3a2-9bebce64e660", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1492927350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44f9e47b0cb84ec9a96e9ee54854c98d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e2cc51-3e", "ovs_interfaceid": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:10:40.336452 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "/opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:40.337284 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "/opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:40.337643 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:10:40.339245 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ddb1344-a4d2-4480-9818-32c65d8ad963', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:10:40.339245 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:10:40.339245 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:10:40.339245 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ddb1344-a4d2-4480-9818-32c65d8ad963', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:10:40.354474 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:10:40.355289 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:10:40.355566 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:10:40.357378 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:10:40.357866 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:10:40.358117 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:10:40.373042 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:10:40.373042 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:40.381182 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:10:40.381182 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:40.388179 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963] added
May 28 10:10:40.388179 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:10:40.388179 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:10:40.388179 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:10:40.388179 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:10:40.388179 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:10:40.388179 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:40.388464 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:10:40.388578 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.033(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:10:40.388719 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:10:40.396756 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963] added
May 28 10:10:40.396756 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:10:40.396756 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:10:40.396756 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:10:40.396756 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:10:40.396756 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:10:40.396756 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:40.396996 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:10:40.397044 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0391(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:10:40.397224 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:10:40.610181 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-1adf1480-b7f2-4db4-bf23-d9619f12ab94 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] COPY block job progress, current cursor: 76808192 final cursor: 76808192 {{(pid=98321) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 28 10:10:40.614188 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-1adf1480-b7f2-4db4-bf23-d9619f12ab94 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Skipping quiescing instance: QEMU guest agent is not enabled.
May 28 10:10:40.740671 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:40.770607 np0000001613 nova-compute[98321]: DEBUG nova.privsep.utils [None req-1adf1480-b7f2-4db4-bf23-d9619f12ab94 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98321) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 10:10:40.771194 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-1adf1480-b7f2-4db4-bf23-d9619f12ab94 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpotx9ryze/e9f6b3e8a5e543018c6e2e0b2281be98.delta /opt/stack/data/nova/instances/snapshots/tmpotx9ryze/e9f6b3e8a5e543018c6e2e0b2281be98 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:10:40.771194 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:40.772654 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:40.843155 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-445568c6-94a7-48c2-84ec-b41a20e9aeb6 req-133d62ac-76aa-461f-9c4e-f94a6ad93236 service nova] Releasing lock "refresh_cache-c0786416-dec3-4610-9ec2-389aa7508148" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:10:40.881706 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:41.080761 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-1adf1480-b7f2-4db4-bf23-d9619f12ab94 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpotx9ryze/e9f6b3e8a5e543018c6e2e0b2281be98.delta /opt/stack/data/nova/instances/snapshots/tmpotx9ryze/e9f6b3e8a5e543018c6e2e0b2281be98" returned: 0 in 0.310s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:10:41.087531 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-1adf1480-b7f2-4db4-bf23-d9619f12ab94 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Snapshot extracted, beginning image upload
May 28 10:10:41.131697 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:41.132749 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:41.135042 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:41.139134 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:41.146586 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ca3d5b77-67fb-45ec-9fd1-222d67b5acf4 req-7b7ef671-56f3-4871-b4b9-d8abbfbc674b service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Received event network-changed-19e2cc51-3e82-46f4-8d06-7406f2f72300 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:10:41.146845 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ca3d5b77-67fb-45ec-9fd1-222d67b5acf4 req-7b7ef671-56f3-4871-b4b9-d8abbfbc674b service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Refreshing instance network info cache due to event network-changed-19e2cc51-3e82-46f4-8d06-7406f2f72300. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:10:41.148980 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ca3d5b77-67fb-45ec-9fd1-222d67b5acf4 req-7b7ef671-56f3-4871-b4b9-d8abbfbc674b service nova] Acquiring lock "refresh_cache-c0786416-dec3-4610-9ec2-389aa7508148" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:10:41.149065 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ca3d5b77-67fb-45ec-9fd1-222d67b5acf4 req-7b7ef671-56f3-4871-b4b9-d8abbfbc674b service nova] Acquired lock "refresh_cache-c0786416-dec3-4610-9ec2-389aa7508148" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:10:41.149342 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-ca3d5b77-67fb-45ec-9fd1-222d67b5acf4 req-7b7ef671-56f3-4871-b4b9-d8abbfbc674b service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Refreshing network info cache for port 19e2cc51-3e82-46f4-8d06-7406f2f72300 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:10:41.182027 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:41.276125 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3a88f397-dcec-4d30-9c33-e053fc5b1fe0 req-88d3f18a-c9e2-468b-80c7-4d554a938623 service nova] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Received event network-vif-plugged-f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:10:41.277998 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3a88f397-dcec-4d30-9c33-e053fc5b1fe0 req-88d3f18a-c9e2-468b-80c7-4d554a938623 service nova] Acquiring lock "5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:41.277998 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3a88f397-dcec-4d30-9c33-e053fc5b1fe0 req-88d3f18a-c9e2-468b-80c7-4d554a938623 service nova] Lock "5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:41.277998 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3a88f397-dcec-4d30-9c33-e053fc5b1fe0 req-88d3f18a-c9e2-468b-80c7-4d554a938623 service nova] Lock "5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:41.277998 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3a88f397-dcec-4d30-9c33-e053fc5b1fe0 req-88d3f18a-c9e2-468b-80c7-4d554a938623 service nova] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Processing event network-vif-plugged-f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:10:41.342647 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Acquiring lock "b51e6cdd-7556-41bf-ab93-24495d4e3d03" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:41.342800 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Lock "b51e6cdd-7556-41bf-ab93-24495d4e3d03" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:41.389336 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:10:41.397627 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:10:41.404289 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:10:41.404289 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:10:41.411896 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:10:41.411896 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:41.418622 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:41.428412 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:41.441656 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef6b904f-a3a4-49d9-9f44-0d05b0b05f29 (non-flash)
May 28 10:10:41.441656 np0000001613 nova-compute[98321]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:41.441656 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:41.441656 np0000001613 nova-compute[98321]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:41.441656 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:41.441656 np0000001613 nova-compute[98321]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f5f6b79-9e13-44be-a9b8-10cafe3288ec (non-flash)
May 28 10:10:41.441656 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:10:41.441656 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsi session list stdout=tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef6b904f-a3a4-49d9-9f44-0d05b0b05f29 (non-flash)
May 28 10:10:41.441656 np0000001613 nova-compute[98321]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:41.441656 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:41.441656 np0000001613 nova-compute[98321]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:41.441656 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:41.441656 np0000001613 nova-compute[98321]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f5f6b79-9e13-44be-a9b8-10cafe3288ec (non-flash)
May 28 10:10:41.441656 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:10:41.458031 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef6b904f-a3a4-49d9-9f44-0d05b0b05f29 (non-flash)
May 28 10:10:41.458031 np0000001613 nova-compute[98321]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:41.458031 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:41.458031 np0000001613 nova-compute[98321]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:41.458031 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:41.458031 np0000001613 nova-compute[98321]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f5f6b79-9e13-44be-a9b8-10cafe3288ec (non-flash)
May 28 10:10:41.458031 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:10:41.458308 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsi session list stdout=tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef6b904f-a3a4-49d9-9f44-0d05b0b05f29 (non-flash)
May 28 10:10:41.458308 np0000001613 nova-compute[98321]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:41.458308 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:41.458308 np0000001613 nova-compute[98321]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:41.458308 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:41.458308 np0000001613 nova-compute[98321]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f5f6b79-9e13-44be-a9b8-10cafe3288ec (non-flash)
May 28 10:10:41.458308 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:10:41.493473 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963, portal: 192.168.40.100,3260]
May 28 10:10:41.493473 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963, portal: 192.168.40.100,3260] successful.
May 28 10:10:41.493473 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:41.504532 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963, portal: 192.168.50.100,3260]
May 28 10:10:41.504532 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963, portal: 192.168.50.100,3260] successful.
May 28 10:10:41.504532 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:41.505351 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:41.517547 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:41.535097 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef6b904f-a3a4-49d9-9f44-0d05b0b05f29 (non-flash)
May 28 10:10:41.535097 np0000001613 nova-compute[98321]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:41.535097 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:41.535097 np0000001613 nova-compute[98321]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:41.535097 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:41.535097 np0000001613 nova-compute[98321]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f5f6b79-9e13-44be-a9b8-10cafe3288ec (non-flash)
May 28 10:10:41.535097 np0000001613 nova-compute[98321]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:41.535097 np0000001613 nova-compute[98321]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:41.535097 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:10:41.535495 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsi session list stdout=tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef6b904f-a3a4-49d9-9f44-0d05b0b05f29 (non-flash)
May 28 10:10:41.535495 np0000001613 nova-compute[98321]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:41.535495 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:41.535495 np0000001613 nova-compute[98321]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:41.535495 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:41.535495 np0000001613 nova-compute[98321]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f5f6b79-9e13-44be-a9b8-10cafe3288ec (non-flash)
May 28 10:10:41.535495 np0000001613 nova-compute[98321]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:41.535495 np0000001613 nova-compute[98321]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:41.535495 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:10:41.535495 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.178s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:10:41.535852 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:10:41.537127 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] HCTL ('11', '-', '-', 0) found on session 154 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:10:41.537274 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:10:41.566705 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Searching for a device in session 154 and hctl ['11', '*', '*', 0] yield: None {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:10:41.578065 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef6b904f-a3a4-49d9-9f44-0d05b0b05f29 (non-flash)
May 28 10:10:41.578065 np0000001613 nova-compute[98321]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:41.578065 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:41.578065 np0000001613 nova-compute[98321]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:41.578065 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:41.578065 np0000001613 nova-compute[98321]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f5f6b79-9e13-44be-a9b8-10cafe3288ec (non-flash)
May 28 10:10:41.578065 np0000001613 nova-compute[98321]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:41.578065 np0000001613 nova-compute[98321]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:41.578065 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:10:41.578065 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsi session list stdout=tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef6b904f-a3a4-49d9-9f44-0d05b0b05f29 (non-flash)
May 28 10:10:41.578065 np0000001613 nova-compute[98321]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:41.578065 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:41.578065 np0000001613 nova-compute[98321]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:41.578065 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:41.578065 np0000001613 nova-compute[98321]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f5f6b79-9e13-44be-a9b8-10cafe3288ec (non-flash)
May 28 10:10:41.578065 np0000001613 nova-compute[98321]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:41.578065 np0000001613 nova-compute[98321]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:41.578065 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:10:41.578522 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.223s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:10:41.578522 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:10:41.579116 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] HCTL ('10', '-', '-', 0) found on session 153 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:10:41.579241 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:10:41.596144 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Searching for a device in session 153 and hctl ['10', '*', '*', 0] yield: sdf {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:10:41.596144 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ddb1344-a4d2-4480-9818-32c65d8ad963', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:10:41.657399 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-ca3d5b77-67fb-45ec-9fd1-222d67b5acf4 req-7b7ef671-56f3-4871-b4b9-d8abbfbc674b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:41.686367 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:10:41.687769 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963041.6873436, 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:10:41.687921 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] VM Started (Lifecycle Event)
May 28 10:10:41.696655 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:10:41.702894 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Instance spawned successfully.
May 28 10:10:41.703511 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:10:41.845182 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:10:42.059276 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-ca3d5b77-67fb-45ec-9fd1-222d67b5acf4 req-7b7ef671-56f3-4871-b4b9-d8abbfbc674b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:42.198948 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:10:42.203070 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:10:42.219212 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:10:42.219348 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:10:42.219611 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:10:42.219786 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:10:42.220008 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:10:42.220263 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:10:42.236976 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-ca3d5b77-67fb-45ec-9fd1-222d67b5acf4 req-7b7ef671-56f3-4871-b4b9-d8abbfbc674b service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Updated VIF entry in instance network info cache for port 19e2cc51-3e82-46f4-8d06-7406f2f72300. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:10:42.237658 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-ca3d5b77-67fb-45ec-9fd1-222d67b5acf4 req-7b7ef671-56f3-4871-b4b9-d8abbfbc674b service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Updating instance_info_cache with network_info: [{"id": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "address": "fa:16:3e:83:3c:7d", "network": {"id": "db344666-4990-47d9-a3a2-9bebce64e660", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1492927350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44f9e47b0cb84ec9a96e9ee54854c98d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e2cc51-3e", "ovs_interfaceid": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:10:42.401500 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:42.401500 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:42.407641 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:10:42.407780 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Claim successful on node np0000001613
May 28 10:10:42.556537 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Searching for a device in session 154 and hctl ['11', '*', '*', 0] yield: sde {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:10:42.556746 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '1ddb1344-a4d2-4480-9818-32c65d8ad963', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:10:42.707863 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:10:42.708436 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963042.7079186, 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:10:42.709398 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] VM Paused (Lifecycle Event)
May 28 10:10:42.725209 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Took 9.14 seconds to spawn the instance on the hypervisor.
May 28 10:10:42.725538 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:10:42.742413 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ca3d5b77-67fb-45ec-9fd1-222d67b5acf4 req-7b7ef671-56f3-4871-b4b9-d8abbfbc674b service nova] Releasing lock "refresh_cache-c0786416-dec3-4610-9ec2-389aa7508148" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:10:42.928702 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:43.212479 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:10:43.214807 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963043.214598, 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:10:43.214927 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] VM Resumed (Lifecycle Event)
May 28 10:10:43.242656 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Took 16.43 seconds to build instance.
May 28 10:10:43.348616 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6b14cf94-de27-43ae-bf82-7cfa73595ee4 req-8bd36e54-2dd5-419c-905a-31b835f49f1e service nova] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Received event network-vif-plugged-f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:10:43.352649 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6b14cf94-de27-43ae-bf82-7cfa73595ee4 req-8bd36e54-2dd5-419c-905a-31b835f49f1e service nova] Acquiring lock "5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:43.352649 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6b14cf94-de27-43ae-bf82-7cfa73595ee4 req-8bd36e54-2dd5-419c-905a-31b835f49f1e service nova] Lock "5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:43.352724 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6b14cf94-de27-43ae-bf82-7cfa73595ee4 req-8bd36e54-2dd5-419c-905a-31b835f49f1e service nova] Lock "5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:43.353389 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6b14cf94-de27-43ae-bf82-7cfa73595ee4 req-8bd36e54-2dd5-419c-905a-31b835f49f1e service nova] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] No waiting events found dispatching network-vif-plugged-f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:10:43.353389 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-6b14cf94-de27-43ae-bf82-7cfa73595ee4 req-8bd36e54-2dd5-419c-905a-31b835f49f1e service nova] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Received unexpected event network-vif-plugged-f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b for instance with vm_state active and task_state None.
May 28 10:10:43.383316 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Found WWN 330000000e79767bf for multipath device dm-4 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:10:43.383851 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.045s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:10:43.384604 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] <== connect_volume: return (3045ms) {'type': 'block', 'scsi_wwn': '330000000e79767bf', 'path': '/dev/disk/by-id/os-brick+dev+dm-4', 'multipath_id': '330000000e79767bf'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:10:43.384727 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e79767bf', 'path': '/dev/disk/by-id/os-brick+dev+dm-4', 'multipath_id': '330000000e79767bf'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:10:43.414026 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ddb1344-a4d2-4480-9818-32c65d8ad963', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, 'status': 'attaching', 'instance': 'edd8dcff-3440-445a-b4a2-8c56863e7ca3', 'attached_at': '2026-05-28T10:10:38.000000', 'detached_at': '', 'volume_id': '1ddb1344-a4d2-4480-9818-32c65d8ad963', 'serial': '1ddb1344-a4d2-4480-9818-32c65d8ad963'} {{(pid=98321) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 10:10:43.416971 np0000001613 nova-compute[98321]: WARNING stevedore.named [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 10:10:43.417918 np0000001613 nova-compute[98321]: WARNING castellan.key_manager [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 10:10:43.422876 np0000001613 nova-compute[98321]: WARNING nova.keymgr.conf_key_mgr [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 10:10:43.442077 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 10:10:43.442077 np0000001613 nova-compute[98321]:   <usage type="volume">
May 28 10:10:43.442077 np0000001613 nova-compute[98321]:     <volume>1ddb1344-a4d2-4480-9818-32c65d8ad963</volume>
May 28 10:10:43.442077 np0000001613 nova-compute[98321]:   </usage>
May 28 10:10:43.442077 np0000001613 nova-compute[98321]: </secret>
May 28 10:10:43.442077 np0000001613 nova-compute[98321]:  {{(pid=98321) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 10:10:43.719093 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:10:43.721399 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:10:43.744247 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7356eb29-7007-4ba1-afa6-40248156ef31 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.937s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:43.801133 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:10:43.801427 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:10:43.954985 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:09:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1080199311',display_name='tempest-TestEncryptedCinderVolumes-server-1080199311',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(13),hidden=False,host='np0000001613',hostname='tempest-testencryptedcindervolumes-server-1080199311',id=55,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=13,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPEA8+uxSyCsgS6j+focPk4QpOVZVeAFK2kV4ErBJfCH5RkIc3vXvdGbsr44pZ3e0kq61KVrhwaHdQPmC2IB37UUcRSn+zMS1bh2okKRJrj9i8mJQASjzRzDfrAxUyWcQ==',key_name='tempest-keypair-831862139',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:09:27Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(13),node='np0000001613',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c7563a83d33d4bc1a6610ccf53c18dc1',ramdisk_id='',reservation_id='r-34tgbqip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-297752033',owner_user_name='tempest-TestEncryptedCinderVolumes-297752033-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:10:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='961948be669c4a18a29398d53015f03b',uuid=edd8dcff-3440-445a-b4a2-8c56863e7ca3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "address": "fa:16:3e:5c:9e:66", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.216", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "vif_mac": "fa:16:3e:5c:9e:66"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb80648-bd", "ovs_interfaceid": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:10:43.955194 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Converting VIF {"id": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "address": "fa:16:3e:5c:9e:66", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.216", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "vif_mac": "fa:16:3e:5c:9e:66"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb80648-bd", "ovs_interfaceid": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:10:43.955913 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:9e:66,bridge_name='br-int',has_traffic_filtering=True,id=6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb80648-bd') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:10:43.957474 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] End _get_guest_xml xml=<domain type="qemu">
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:   <uuid>edd8dcff-3440-445a-b4a2-8c56863e7ca3</uuid>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:   <name>instance-00000037</name>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1080199311</nova:name>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:10:40</nova:creationTime>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:       <nova:flavor name="tempest-804599202" id="b6c0d6a6-fe1c-4891-9a59-4a219864aa6f">
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:         <nova:extraSpecs/>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:         <nova:user uuid="961948be669c4a18a29398d53015f03b">tempest-TestEncryptedCinderVolumes-297752033-project-member</nova:user>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:         <nova:project uuid="c7563a83d33d4bc1a6610ccf53c18dc1">tempest-TestEncryptedCinderVolumes-297752033</nova:project>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:         <nova:port uuid="6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc">
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:     <system>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:       <entry name="serial">edd8dcff-3440-445a-b4a2-8c56863e7ca3</entry>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:       <entry name="uuid">edd8dcff-3440-445a-b4a2-8c56863e7ca3</entry>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:     </system>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:   <os>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:   </os>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:   <features>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:   </features>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:   <devices>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk"/>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:     </disk>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk.config"/>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:     </disk>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:       <alias name="ua-1ddb1344-a4d2-4480-9818-32c65d8ad963"/>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-4"/>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:       <target dev="vdb" bus="virtio"/>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:       <serial>1ddb1344-a4d2-4480-9818-32c65d8ad963</serial>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:       <encryption format="luks">
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:         <secret type="passphrase" uuid="d05b8e5b-08ae-48c4-a674-d43fd09cc354"/>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:       </encryption>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:     </disk>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:5c:9e:66"/>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:       <target dev="tap6eb80648-bd"/>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:     </interface>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/console.log" append="off"/>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:     </serial>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:     <video>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:     </video>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:     </rng>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:   </devices>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]: </domain>
May 28 10:10:43.957474 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:10:43.961895 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:09:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1080199311',display_name='tempest-TestEncryptedCinderVolumes-server-1080199311',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(13),hidden=False,host='np0000001613',hostname='tempest-testencryptedcindervolumes-server-1080199311',id=55,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=13,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPEA8+uxSyCsgS6j+focPk4QpOVZVeAFK2kV4ErBJfCH5RkIc3vXvdGbsr44pZ3e0kq61KVrhwaHdQPmC2IB37UUcRSn+zMS1bh2okKRJrj9i8mJQASjzRzDfrAxUyWcQ==',key_name='tempest-keypair-831862139',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:09:27Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(13),node='np0000001613',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c7563a83d33d4bc1a6610ccf53c18dc1',ramdisk_id='',reservation_id='r-34tgbqip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-297752033',owner_user_name='tempest-TestEncryptedCinderVolumes-297752033-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:10:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='961948be669c4a18a29398d53015f03b',uuid=edd8dcff-3440-445a-b4a2-8c56863e7ca3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "address": "fa:16:3e:5c:9e:66", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.216", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "vif_mac": "fa:16:3e:5c:9e:66"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb80648-bd", "ovs_interfaceid": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:10:43.961895 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Converting VIF {"id": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "address": "fa:16:3e:5c:9e:66", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.216", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "vif_mac": "fa:16:3e:5c:9e:66"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb80648-bd", "ovs_interfaceid": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:10:43.961895 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:9e:66,bridge_name='br-int',has_traffic_filtering=True,id=6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb80648-bd') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:10:43.961895 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:9e:66,bridge_name='br-int',has_traffic_filtering=True,id=6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb80648-bd') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:10:43.961895 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:43.961895 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:10:43.961895 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:10:43.961895 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:43.961895 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4e5d4490-3b21-57fb-832b-c708b9cf403f', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:10:43.962227 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-1adf1480-b7f2-4db4-bf23-d9619f12ab94 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Snapshot image upload complete
May 28 10:10:43.962227 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-1adf1480-b7f2-4db4-bf23-d9619f12ab94 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Took 6.19 seconds to snapshot the instance on the hypervisor.
May 28 10:10:43.965105 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:43.966128 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:10:43.968854 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:43.968854 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6eb80648-bd, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:10:43.968854 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6eb80648-bd, col_values=(('qos', UUID('da39a126-999b-467c-94f5-c87132632ad8')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:10:43.968854 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6eb80648-bd, col_values=(('external_ids', {'iface-id': '6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:9e:66', 'vm-uuid': 'edd8dcff-3440-445a-b4a2-8c56863e7ca3'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:10:43.969234 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:43.970298 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:10:43.975397 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:43.976999 np0000001613 nova-compute[98321]: INFO os_vif [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:9e:66,bridge_name='br-int',has_traffic_filtering=True,id=6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb80648-bd')
May 28 10:10:44.304944 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:10:44.566879 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e7ff3019-3698-418b-b9d4-560ddc73ac07 req-611971e5-1528-434a-b041-6b476456b22f service nova] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Received event network-changed-f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:10:44.567214 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e7ff3019-3698-418b-b9d4-560ddc73ac07 req-611971e5-1528-434a-b041-6b476456b22f service nova] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Refreshing instance network info cache due to event network-changed-f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:10:44.567214 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e7ff3019-3698-418b-b9d4-560ddc73ac07 req-611971e5-1528-434a-b041-6b476456b22f service nova] Acquiring lock "refresh_cache-5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:10:44.567352 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e7ff3019-3698-418b-b9d4-560ddc73ac07 req-611971e5-1528-434a-b041-6b476456b22f service nova] Acquired lock "refresh_cache-5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:10:44.567478 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-e7ff3019-3698-418b-b9d4-560ddc73ac07 req-611971e5-1528-434a-b041-6b476456b22f service nova] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Refreshing network info cache for port f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:10:44.813807 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.412s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:44.814236 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:10:44.862397 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:45.072218 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-e7ff3019-3698-418b-b9d4-560ddc73ac07 req-611971e5-1528-434a-b041-6b476456b22f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:45.150459 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.00042767700006152154 future=<Future at 0x73c1f41b9760 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:10:45.150593 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:10:45.150961 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Emitting event <LifecycleEvent: 1779963030.1499157, edd8dcff-3440-445a-b4a2-8c56863e7ca3 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:10:45.151089 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] VM Stopped (Lifecycle Event)
May 28 10:10:45.319390 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:10:45.319735 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:10:45.320027 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:45.320353 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:45.413051 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa5dd2b739b04d2c97c592939c03a2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a7b4447be44babbc8cb7d9d09c1e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:10:45.417783 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-e7ff3019-3698-418b-b9d4-560ddc73ac07 req-611971e5-1528-434a-b041-6b476456b22f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:45.497753 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:10:45.497885 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:10:45.497963 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:10:45.498091 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] No VIF found with MAC fa:16:3e:5c:9e:66, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:10:45.498650 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Using config drive
May 28 10:10:45.601157 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-e7ff3019-3698-418b-b9d4-560ddc73ac07 req-611971e5-1528-434a-b041-6b476456b22f service nova] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Updated VIF entry in instance network info cache for port f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:10:45.601591 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-e7ff3019-3698-418b-b9d4-560ddc73ac07 req-611971e5-1528-434a-b041-6b476456b22f service nova] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Updating instance_info_cache with network_info: [{"id": "f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b", "address": "fa:16:3e:e7:8c:eb", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e7bd1f-7b", "ovs_interfaceid": "f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:10:45.653572 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ea7058ba-dbed-4cf4-b78f-b749bb264c68 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:10:45.821993 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:10:45.967681 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Successfully created port: d9ced81c-77d5-4b25-a984-054f5dd0a4ac {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:10:45.980512 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:46.015340 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:46.021119 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:46.109043 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e7ff3019-3698-418b-b9d4-560ddc73ac07 req-611971e5-1528-434a-b041-6b476456b22f service nova] Releasing lock "refresh_cache-5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:10:46.112426 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:46.217837 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Acquiring lock "b4c26c83-b122-4b4a-a517-1701b23caf03" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:46.217837 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "b4c26c83-b122-4b4a-a517-1701b23caf03" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:46.225750 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4b1373d7-2223-42fd-9c3d-52e4e9e03ea1 req-233ca7a1-9cee-4e09-a5fb-6a438fbc6257 service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Received event network-vif-plugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:10:46.225899 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4b1373d7-2223-42fd-9c3d-52e4e9e03ea1 req-233ca7a1-9cee-4e09-a5fb-6a438fbc6257 service nova] Acquiring lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:46.226034 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4b1373d7-2223-42fd-9c3d-52e4e9e03ea1 req-233ca7a1-9cee-4e09-a5fb-6a438fbc6257 service nova] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:46.226240 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4b1373d7-2223-42fd-9c3d-52e4e9e03ea1 req-233ca7a1-9cee-4e09-a5fb-6a438fbc6257 service nova] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:46.226289 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4b1373d7-2223-42fd-9c3d-52e4e9e03ea1 req-233ca7a1-9cee-4e09-a5fb-6a438fbc6257 service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] No waiting events found dispatching network-vif-plugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:10:46.227456 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-4b1373d7-2223-42fd-9c3d-52e4e9e03ea1 req-233ca7a1-9cee-4e09-a5fb-6a438fbc6257 service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Received unexpected event network-vif-plugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc for instance with vm_state active and task_state resize_finish.
May 28 10:10:46.325510 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:10:46.396933 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:46.404229 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:46.406999 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:46.430107 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:46.644536 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Successfully updated port: d9ced81c-77d5-4b25-a984-054f5dd0a4ac {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:10:46.705435 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-615a35f9-c6af-44d1-b405-9356a1126f70 req-853688e5-8d65-4912-8251-c84a30b99847 service nova] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Received event network-changed-d9ced81c-77d5-4b25-a984-054f5dd0a4ac {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:10:46.705435 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-615a35f9-c6af-44d1-b405-9356a1126f70 req-853688e5-8d65-4912-8251-c84a30b99847 service nova] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Refreshing instance network info cache due to event network-changed-d9ced81c-77d5-4b25-a984-054f5dd0a4ac. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:10:46.705735 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-615a35f9-c6af-44d1-b405-9356a1126f70 req-853688e5-8d65-4912-8251-c84a30b99847 service nova] Acquiring lock "refresh_cache-b51e6cdd-7556-41bf-ab93-24495d4e3d03" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:10:46.705735 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-615a35f9-c6af-44d1-b405-9356a1126f70 req-853688e5-8d65-4912-8251-c84a30b99847 service nova] Acquired lock "refresh_cache-b51e6cdd-7556-41bf-ab93-24495d4e3d03" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:10:46.705910 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-615a35f9-c6af-44d1-b405-9356a1126f70 req-853688e5-8d65-4912-8251-c84a30b99847 service nova] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Refreshing network info cache for port d9ced81c-77d5-4b25-a984-054f5dd0a4ac {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:10:46.722408 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:10:46.833468 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Booting with volume 31209469-afde-4316-8798-ce950e49a11d at /dev/vda
May 28 10:10:46.889649 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:10:46.907596 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:10:46.939630 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:10:46.997425 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:10:46.997718 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:10:47.009355 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:10:47.012929 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe83:3c7d', 'fe80::e03f:79ff:fe2f:2d97', 'fe80::fc16:3eff:fee7:8ceb', 'fe80::e4eb:4cff:fe5c:5eb7', 'fe80::fc16:3eff:fe5c:9e66', 'fe80::ec4e:cbff:fea7:f945', 'fe80::fc16:3eff:fe33:fbde', 'fe80::6807:fff:fe4c:bed3'] 
May 28 10:10:47.012929 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:10:47.012929 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:10:47.012929 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:10:47.013279 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Updating existing volume attachment record: acec47ea-df85-44ef-98b0-6654d67118a6 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:10:47.146705 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Acquiring lock "refresh_cache-b51e6cdd-7556-41bf-ab93-24495d4e3d03" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:10:47.208500 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-615a35f9-c6af-44d1-b405-9356a1126f70 req-853688e5-8d65-4912-8251-c84a30b99847 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:47.295764 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:47.296056 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:47.301277 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-615a35f9-c6af-44d1-b405-9356a1126f70 req-853688e5-8d65-4912-8251-c84a30b99847 service nova] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:10:47.310196 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:10:47.310403 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Claim successful on node np0000001613
May 28 10:10:47.518031 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-615a35f9-c6af-44d1-b405-9356a1126f70 req-853688e5-8d65-4912-8251-c84a30b99847 service nova] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:10:48.020831 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-615a35f9-c6af-44d1-b405-9356a1126f70 req-853688e5-8d65-4912-8251-c84a30b99847 service nova] Releasing lock "refresh_cache-b51e6cdd-7556-41bf-ab93-24495d4e3d03" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:10:48.021584 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Acquired lock "refresh_cache-b51e6cdd-7556-41bf-ab93-24495d4e3d03" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:10:48.021913 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:10:48.044487 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963048.0440707, edd8dcff-3440-445a-b4a2-8c56863e7ca3 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:10:48.044639 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] VM Resumed (Lifecycle Event)
May 28 10:10:48.050084 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Instance event wait completed in 0 seconds for  {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:10:48.052990 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Instance running successfully.
May 28 10:10:48.054419 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Failed to set time: agent not configured {{(pid=98321) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 28 10:10:48.054419 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d9c1abea-13d7-4e97-8128-99cc5cbc41c1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] finish_migration finished successfully. {{(pid=98321) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 28 10:10:48.296021 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5754b7c6-4096-4494-bcb9-840b13022ce1 req-7431344d-e84c-4f8b-9d78-ef1777f452e6 service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Received event network-vif-plugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:10:48.297618 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5754b7c6-4096-4494-bcb9-840b13022ce1 req-7431344d-e84c-4f8b-9d78-ef1777f452e6 service nova] Acquiring lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:48.298039 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5754b7c6-4096-4494-bcb9-840b13022ce1 req-7431344d-e84c-4f8b-9d78-ef1777f452e6 service nova] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:48.298987 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5754b7c6-4096-4494-bcb9-840b13022ce1 req-7431344d-e84c-4f8b-9d78-ef1777f452e6 service nova] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:48.299431 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5754b7c6-4096-4494-bcb9-840b13022ce1 req-7431344d-e84c-4f8b-9d78-ef1777f452e6 service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] No waiting events found dispatching network-vif-plugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:10:48.301647 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-5754b7c6-4096-4494-bcb9-840b13022ce1 req-7431344d-e84c-4f8b-9d78-ef1777f452e6 service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Received unexpected event network-vif-plugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc for instance with vm_state active and task_state resize_finish.
May 28 10:10:48.548530 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:10:48.554850 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:10:48.645878 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:10:48.802570 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:10:48.802761 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:10:48.858478 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:48.968980 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:49.016461 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Updating instance_info_cache with network_info: [{"id": "d9ced81c-77d5-4b25-a984-054f5dd0a4ac", "address": "fa:16:3e:88:d1:c6", "network": {"id": "4638034a-36e0-4524-a643-bd5fb2c5d03a", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1792230061-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "24a7b4447be44babbc8cb7d9d09c1e76", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ced81c-77", "ovs_interfaceid": "d9ced81c-77d5-4b25-a984-054f5dd0a4ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:10:49.059491 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 28 10:10:49.060058 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963049.0595849, edd8dcff-3440-445a-b4a2-8c56863e7ca3 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:10:49.060058 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] VM Started (Lifecycle Event)
May 28 10:10:49.153781 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:10:49.154462 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:10:49.154920 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Creating image(s)
May 28 10:10:49.154967 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Did not create local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 10:10:49.155082 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Ensure instance console log exists: /opt/stack/data/nova/instances/b51e6cdd-7556-41bf-ab93-24495d4e3d03/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:10:49.155308 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:49.155765 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:49.155765 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:49.305734 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:10:49.518201 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Releasing lock "refresh_cache-b51e6cdd-7556-41bf-ab93-24495d4e3d03" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:10:49.518651 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Instance network_info: |[{"id": "d9ced81c-77d5-4b25-a984-054f5dd0a4ac", "address": "fa:16:3e:88:d1:c6", "network": {"id": "4638034a-36e0-4524-a643-bd5fb2c5d03a", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1792230061-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "24a7b4447be44babbc8cb7d9d09c1e76", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ced81c-77", "ovs_interfaceid": "d9ced81c-77d5-4b25-a984-054f5dd0a4ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:10:49.519580 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Start _get_guest_xml network_info=[{"id": "d9ced81c-77d5-4b25-a984-054f5dd0a4ac", "address": "fa:16:3e:88:d1:c6", "network": {"id": "4638034a-36e0-4524-a643-bd5fb2c5d03a", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1792230061-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "24a7b4447be44babbc8cb7d9d09c1e76", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ced81c-77", "ovs_interfaceid": "d9ced81c-77d5-4b25-a984-054f5dd0a4ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d', 'iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '31209469-afde-4316-8798-ce950e49a11d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'b51e6cdd-7556-41bf-ab93-24495d4e3d03', 'attached_at': '', 'detached_at': '', 'volume_id': '31209469-afde-4316-8798-ce950e49a11d', 'serial': '31209469-afde-4316-8798-ce950e49a11d'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'acec47ea-df85-44ef-98b0-6654d67118a6', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:10:49.523599 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:10:49.525071 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBackupRestore-server-1239841217', uuid='b51e6cdd-7556-41bf-ab93-24495d4e3d03'), owner=OwnerMeta(userid='aa5dd2b739b04d2c97c592939c03a2c8', username='tempest-TestVolumeBackupRestore-1977101720-project-member', projectid='24a7b4447be44babbc8cb7d9d09c1e76', projectname='tempest-TestVolumeBackupRestore-1977101720'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d9ced81c-77d5-4b25-a984-054f5dd0a4ac", "address": "fa:16:3e:88:d1:c6", "network": {"id": "4638034a-36e0-4524-a643-bd5fb2c5d03a", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1792230061-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "24a7b4447be44babbc8cb7d9d09c1e76", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ced81c-77", "ovs_interfaceid": "d9ced81c-77d5-4b25-a984-054f5dd0a4ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779963049.5246131) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:10:49.527112 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:10:49.527560 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:10:49.529065 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:10:49.529292 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:10:49.531237 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:10:49.531237 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:10:49.531237 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:10:49.531444 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:10:49.531495 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:10:49.531720 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:10:49.531720 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:10:49.531910 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:10:49.532029 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:10:49.532180 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:10:49.532350 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:10:49.532496 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:10:49.547948 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:10:49.548584 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d', 'iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '31209469-afde-4316-8798-ce950e49a11d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:10:49.548584 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:10:49.549220 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:10:49.549268 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d', 'iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '31209469-afde-4316-8798-ce950e49a11d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:10:49.566123 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:10:49.567072 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:10:49.567662 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:10:49.567989 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:10:49.568863 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:10:49.569989 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:10:49.570179 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:10:49.571060 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:10:49.584428 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:10:49.584428 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:49.594569 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:10:49.594569 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:49.604190 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d] added
May 28 10:10:49.604190 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:10:49.604190 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:10:49.604190 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:10:49.604190 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:10:49.604190 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:10:49.604190 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:49.604190 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:10:49.604190 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0347(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:10:49.604190 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:10:49.607493 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d] added
May 28 10:10:49.607493 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:10:49.607493 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:10:49.607493 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:10:49.607493 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:10:49.607493 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:10:49.607493 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:49.607890 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:10:49.607890 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0376(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:10:49.607997 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:10:49.816380 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.518s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:49.816380 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:10:49.864563 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:50.162092 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:50.249585 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:50.249843 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:50.250012 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:50.316650 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Port 6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc binding to destination host np0000001613 is already ACTIVE {{(pid=98321) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 28 10:10:50.316893 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "refresh_cache-edd8dcff-3440-445a-b4a2-8c56863e7ca3" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:10:50.317018 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquired lock "refresh_cache-edd8dcff-3440-445a-b4a2-8c56863e7ca3" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:10:50.317130 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:10:50.325241 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:10:50.325241 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:10:50.325241 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:50.325241 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:50.400188 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cda3cde4813d436b9f875ba96f496882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba63ea134a6e4fe1992f53a0da46d034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:10:50.603642 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:10:50.608389 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:10:50.622479 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:10:50.622479 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:10:50.633930 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:10:50.633930 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:50.640889 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:50.646990 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:50.658279 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:50.658279 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:50.658279 np0000001613 nova-compute[98321]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:50.658279 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:50.658279 np0000001613 nova-compute[98321]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f5f6b79-9e13-44be-a9b8-10cafe3288ec (non-flash)
May 28 10:10:50.658279 np0000001613 nova-compute[98321]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:50.658279 np0000001613 nova-compute[98321]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:50.658279 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:10:50.659595 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] iscsi session list stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:50.659595 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:50.659595 np0000001613 nova-compute[98321]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:50.659595 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:50.659595 np0000001613 nova-compute[98321]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f5f6b79-9e13-44be-a9b8-10cafe3288ec (non-flash)
May 28 10:10:50.659595 np0000001613 nova-compute[98321]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:50.659595 np0000001613 nova-compute[98321]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:50.659595 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:10:50.672336 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:50.672336 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:50.672336 np0000001613 nova-compute[98321]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:50.672336 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:50.672336 np0000001613 nova-compute[98321]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f5f6b79-9e13-44be-a9b8-10cafe3288ec (non-flash)
May 28 10:10:50.672336 np0000001613 nova-compute[98321]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:50.672336 np0000001613 nova-compute[98321]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:50.672336 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:10:50.672572 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] iscsi session list stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:50.672572 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:50.672572 np0000001613 nova-compute[98321]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:50.672572 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:50.672572 np0000001613 nova-compute[98321]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f5f6b79-9e13-44be-a9b8-10cafe3288ec (non-flash)
May 28 10:10:50.672572 np0000001613 nova-compute[98321]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:50.672572 np0000001613 nova-compute[98321]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:50.672572 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:10:50.706102 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d, portal: 192.168.40.100,3260]
May 28 10:10:50.706102 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d, portal: 192.168.40.100,3260] successful.
May 28 10:10:50.706102 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:50.713651 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d, portal: 192.168.50.100,3260]
May 28 10:10:50.713651 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d, portal: 192.168.50.100,3260] successful.
May 28 10:10:50.713651 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:50.719887 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:50.728945 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:50.741519 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:50.741519 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:50.741519 np0000001613 nova-compute[98321]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:50.741519 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:50.741519 np0000001613 nova-compute[98321]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f5f6b79-9e13-44be-a9b8-10cafe3288ec (non-flash)
May 28 10:10:50.741519 np0000001613 nova-compute[98321]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:50.741519 np0000001613 nova-compute[98321]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:50.741519 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:10:50.741519 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:10:50.741519 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:10:50.741851 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] iscsi session list stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:50.741851 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:50.741851 np0000001613 nova-compute[98321]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:50.741851 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:50.741851 np0000001613 nova-compute[98321]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f5f6b79-9e13-44be-a9b8-10cafe3288ec (non-flash)
May 28 10:10:50.741851 np0000001613 nova-compute[98321]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:50.741851 np0000001613 nova-compute[98321]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:50.741851 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:10:50.741851 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:10:50.741851 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:10:50.742170 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.175s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:10:50.742326 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:10:50.744114 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] HCTL ('12', '-', '-', 0) found on session 155 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:10:50.744266 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:10:50.753007 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:50.753007 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:50.753007 np0000001613 nova-compute[98321]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:50.753007 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:50.753007 np0000001613 nova-compute[98321]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f5f6b79-9e13-44be-a9b8-10cafe3288ec (non-flash)
May 28 10:10:50.753007 np0000001613 nova-compute[98321]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:50.753007 np0000001613 nova-compute[98321]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:50.753007 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:10:50.753007 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:10:50.753007 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:10:50.753318 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] iscsi session list stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:50.753318 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:50.753318 np0000001613 nova-compute[98321]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:50.753318 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:50.753318 np0000001613 nova-compute[98321]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f5f6b79-9e13-44be-a9b8-10cafe3288ec (non-flash)
May 28 10:10:50.753318 np0000001613 nova-compute[98321]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:50.753318 np0000001613 nova-compute[98321]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:50.753318 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:10:50.753318 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:10:50.753318 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:10:50.753702 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.184s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:10:50.753855 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:10:50.755311 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] HCTL ('15', '-', '-', 0) found on session 156 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:10:50.755480 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:10:50.766212 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Searching for a device in session 155 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:10:50.766803 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '31209469-afde-4316-8798-ce950e49a11d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:10:50.773227 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Searching for a device in session 156 and hctl ['15', '*', '*', 0] yield: None {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:10:50.820203 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:50.826149 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:10:51.052317 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Successfully created port: a00c63db-98a2-46e6-ac78-c54d73edf1e8 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:10:51.272062 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:51.333653 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:10:51.433538 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Updating instance_info_cache with network_info: [{"id": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "address": "fa:16:3e:5c:9e:66", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb80648-bd", "ovs_interfaceid": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:10:51.738687 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Successfully updated port: a00c63db-98a2-46e6-ac78-c54d73edf1e8 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:10:51.772312 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Searching for a device in session 156 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:10:51.772558 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '31209469-afde-4316-8798-ce950e49a11d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:10:51.810615 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ff3c03b2-12af-4363-a60b-96a0e1e0ba3a req-62c2c1c3-ca68-47d9-8c3b-3e5727bc195d service nova] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Received event network-changed-a00c63db-98a2-46e6-ac78-c54d73edf1e8 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:10:51.810772 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ff3c03b2-12af-4363-a60b-96a0e1e0ba3a req-62c2c1c3-ca68-47d9-8c3b-3e5727bc195d service nova] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Refreshing instance network info cache due to event network-changed-a00c63db-98a2-46e6-ac78-c54d73edf1e8. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:10:51.814369 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ff3c03b2-12af-4363-a60b-96a0e1e0ba3a req-62c2c1c3-ca68-47d9-8c3b-3e5727bc195d service nova] Acquiring lock "refresh_cache-b4c26c83-b122-4b4a-a517-1701b23caf03" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:10:51.814369 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ff3c03b2-12af-4363-a60b-96a0e1e0ba3a req-62c2c1c3-ca68-47d9-8c3b-3e5727bc195d service nova] Acquired lock "refresh_cache-b4c26c83-b122-4b4a-a517-1701b23caf03" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:10:51.814498 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-ff3c03b2-12af-4363-a60b-96a0e1e0ba3a req-62c2c1c3-ca68-47d9-8c3b-3e5727bc195d service nova] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Refreshing network info cache for port a00c63db-98a2-46e6-ac78-c54d73edf1e8 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:10:51.935467 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Releasing lock "refresh_cache-edd8dcff-3440-445a-b4a2-8c56863e7ca3" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:10:52.241380 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Acquiring lock "refresh_cache-b4c26c83-b122-4b4a-a517-1701b23caf03" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:10:52.318396 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-ff3c03b2-12af-4363-a60b-96a0e1e0ba3a req-62c2c1c3-ca68-47d9-8c3b-3e5727bc195d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:52.344506 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:10:52.345693 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:10:52.345934 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Creating image(s)
May 28 10:10:52.346444 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Acquiring lock "/opt/stack/data/nova/instances/b4c26c83-b122-4b4a-a517-1701b23caf03/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:52.346689 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "/opt/stack/data/nova/instances/b4c26c83-b122-4b4a-a517-1701b23caf03/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:52.347096 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "/opt/stack/data/nova/instances/b4c26c83-b122-4b4a-a517-1701b23caf03/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:52.347464 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Acquiring lock "6619fff7ebcede354d1d90be188e5d75e8699444" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:52.347748 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "6619fff7ebcede354d1d90be188e5d75e8699444" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:52.407478 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-ff3c03b2-12af-4363-a60b-96a0e1e0ba3a req-62c2c1c3-ca68-47d9-8c3b-3e5727bc195d service nova] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:10:52.439022 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Creating tmpfile /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/tmpiinqufz3 to verify with other compute node that the instance is on the same shared storage. {{(pid=98321) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:10552}}
May 28 10:10:52.439470 np0000001613 nova-compute[98321]: DEBUG nova.compute.rpcapi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98321) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 10:10:52.584324 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-ff3c03b2-12af-4363-a60b-96a0e1e0ba3a req-62c2c1c3-ca68-47d9-8c3b-3e5727bc195d service nova] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:10:52.595764 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Found WWN 330000000dfc66705 for multipath device dm-5 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:10:52.596149 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.047s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:10:52.597340 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] <== connect_volume: return (3047ms) {'type': 'block', 'scsi_wwn': '330000000dfc66705', 'path': '/dev/dm-5', 'multipath_id': '330000000dfc66705'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:10:52.597500 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000dfc66705', 'path': '/dev/dm-5', 'multipath_id': '330000000dfc66705'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:10:52.976418 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:53.006122 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:53.035881 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:53.089410 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ff3c03b2-12af-4363-a60b-96a0e1e0ba3a req-62c2c1c3-ca68-47d9-8c3b-3e5727bc195d service nova] Releasing lock "refresh_cache-b4c26c83-b122-4b4a-a517-1701b23caf03" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:10:53.090826 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Acquired lock "refresh_cache-b4c26c83-b122-4b4a-a517-1701b23caf03" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:10:53.091010 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:10:53.109191 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:10:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-1239841217',display_name='tempest-TestVolumeBackupRestore-server-1239841217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebackuprestore-server-1239841217',id=61,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1IKD7EdkNHiiDyibS2/QThQNCvbbv5Lj6MAY6q4XRGAXzGZF7E8Ie6LU1Z0lEzgwmtr+C6tzix+eQniG7QVaeYOag0OQIb8MLZcYjS/Z/j674exChHmL//AUvemK4sRw==',key_name='tempest-TestVolumeBackupRestore-39710801',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24a7b4447be44babbc8cb7d9d09c1e76',ramdisk_id='',reservation_id='r-p9d0fbrk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBackupRestore-1977101720',owner_user_name='tempest-TestVolumeBackupRestore-1977101720-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:10:46Z,user_data=None,user_id='aa5dd2b739b04d2c97c592939c03a2c8',uuid=b51e6cdd-7556-41bf-ab93-24495d4e3d03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9ced81c-77d5-4b25-a984-054f5dd0a4ac", "address": "fa:16:3e:88:d1:c6", "network": {"id": "4638034a-36e0-4524-a643-bd5fb2c5d03a", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1792230061-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "24a7b4447be44babbc8cb7d9d09c1e76", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ced81c-77", "ovs_interfaceid": "d9ced81c-77d5-4b25-a984-054f5dd0a4ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:10:53.109453 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Converting VIF {"id": "d9ced81c-77d5-4b25-a984-054f5dd0a4ac", "address": "fa:16:3e:88:d1:c6", "network": {"id": "4638034a-36e0-4524-a643-bd5fb2c5d03a", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1792230061-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "24a7b4447be44babbc8cb7d9d09c1e76", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ced81c-77", "ovs_interfaceid": "d9ced81c-77d5-4b25-a984-054f5dd0a4ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:10:53.110031 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:d1:c6,bridge_name='br-int',has_traffic_filtering=True,id=d9ced81c-77d5-4b25-a984-054f5dd0a4ac,network=Network(4638034a-36e0-4524-a643-bd5fb2c5d03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9ced81c-77') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:10:53.111435 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Lazy-loading 'pci_devices' on Instance uuid b51e6cdd-7556-41bf-ab93-24495d4e3d03 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:10:53.158406 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3b3eabb5-6c91-4a44-b577-6f4a8f690f4d req-b21fe1c2-28a3-4990-82f5-8880467e2a42 service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Received event network-vif-unplugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:10:53.158600 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3b3eabb5-6c91-4a44-b577-6f4a8f690f4d req-b21fe1c2-28a3-4990-82f5-8880467e2a42 service nova] Acquiring lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:53.158776 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3b3eabb5-6c91-4a44-b577-6f4a8f690f4d req-b21fe1c2-28a3-4990-82f5-8880467e2a42 service nova] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:53.158908 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3b3eabb5-6c91-4a44-b577-6f4a8f690f4d req-b21fe1c2-28a3-4990-82f5-8880467e2a42 service nova] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:53.159565 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3b3eabb5-6c91-4a44-b577-6f4a8f690f4d req-b21fe1c2-28a3-4990-82f5-8880467e2a42 service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] No waiting events found dispatching network-vif-unplugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:10:53.159709 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-3b3eabb5-6c91-4a44-b577-6f4a8f690f4d req-b21fe1c2-28a3-4990-82f5-8880467e2a42 service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Received unexpected event network-vif-unplugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc for instance with vm_state resized and task_state resize_reverting.
May 28 10:10:53.185739 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:10:53.191874 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:10:53.191874 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6619fff7ebcede354d1d90be188e5d75e8699444.part --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:10:53.254517 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:53.289415 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:53.296900 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:53.302511 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999496394000289 future=<Future at 0x73c1f4074410 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:10:53.302735 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999242301000322 future=<Future at 0x73c1f4074410 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:10:53.302924 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999049933000151 future=<Future at 0x73c1f4074410 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:10:53.306305 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6619fff7ebcede354d1d90be188e5d75e8699444.part --force-share --output=json" returned: 0 in 0.115s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:10:53.306936 np0000001613 nova-compute[98321]: DEBUG nova.virt.images [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] a4df893b-9c4b-42ac-aeec-7933f9c3f012 was qcow2, converting to raw {{(pid=98321) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 10:10:53.307696 np0000001613 nova-compute[98321]: DEBUG nova.privsep.utils [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98321) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 10:10:53.308046 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6619fff7ebcede354d1d90be188e5d75e8699444.part /opt/stack/data/nova/instances/_base/6619fff7ebcede354d1d90be188e5d75e8699444.converted {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:10:53.308795 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Instance destroyed successfully.
May 28 10:10:53.325243 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:53.328255 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lazy-loading 'resources' on Instance uuid edd8dcff-3440-445a-b4a2-8c56863e7ca3 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:10:53.500868 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6619fff7ebcede354d1d90be188e5d75e8699444.part /opt/stack/data/nova/instances/_base/6619fff7ebcede354d1d90be188e5d75e8699444.converted" returned: 0 in 0.193s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:10:53.517736 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6619fff7ebcede354d1d90be188e5d75e8699444.converted --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:10:53.612850 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6619fff7ebcede354d1d90be188e5d75e8699444.converted --force-share --output=json" returned: 0 in 0.095s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:10:53.613599 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "6619fff7ebcede354d1d90be188e5d75e8699444" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.266s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:53.614044 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:10:53.619774 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:10:53.620786 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6619fff7ebcede354d1d90be188e5d75e8699444 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:10:53.637219 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] End _get_guest_xml xml=<domain type="qemu">
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:   <uuid>b51e6cdd-7556-41bf-ab93-24495d4e3d03</uuid>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:   <name>instance-0000003d</name>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:       <nova:name>tempest-TestVolumeBackupRestore-server-1239841217</nova:name>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:10:49</nova:creationTime>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:       <nova:image uuid="">
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:         <nova:user uuid="aa5dd2b739b04d2c97c592939c03a2c8">tempest-TestVolumeBackupRestore-1977101720-project-member</nova:user>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:         <nova:project uuid="24a7b4447be44babbc8cb7d9d09c1e76">tempest-TestVolumeBackupRestore-1977101720</nova:project>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:       <nova:root type="volume" uuid=""/>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:         <nova:port uuid="d9ced81c-77d5-4b25-a984-054f5dd0a4ac">
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:     <system>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:       <entry name="serial">b51e6cdd-7556-41bf-ab93-24495d4e3d03</entry>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:       <entry name="uuid">b51e6cdd-7556-41bf-ab93-24495d4e3d03</entry>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:     </system>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:   <os>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:   </os>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:   <features>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:   </features>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:   <devices>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/b51e6cdd-7556-41bf-ab93-24495d4e3d03/disk.config"/>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:     </disk>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:       <alias name="ua-31209469-afde-4316-8798-ce950e49a11d"/>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-5"/>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:       <serial>31209469-afde-4316-8798-ce950e49a11d</serial>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:     </disk>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:88:d1:c6"/>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:       <target dev="tapd9ced81c-77"/>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:     </interface>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/b51e6cdd-7556-41bf-ab93-24495d4e3d03/console.log" append="off"/>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:     </serial>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:     <video>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:     </video>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:     </rng>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:   </devices>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]: </domain>
May 28 10:10:53.637219 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:10:53.639947 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:53.647185 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Preparing to wait for external event network-vif-plugged-d9ced81c-77d5-4b25-a984-054f5dd0a4ac {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:10:53.650124 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Acquiring lock "b51e6cdd-7556-41bf-ab93-24495d4e3d03-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:53.650709 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Lock "b51e6cdd-7556-41bf-ab93-24495d4e3d03-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:53.651115 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Lock "b51e6cdd-7556-41bf-ab93-24495d4e3d03-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:53.652892 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:10:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-1239841217',display_name='tempest-TestVolumeBackupRestore-server-1239841217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebackuprestore-server-1239841217',id=61,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1IKD7EdkNHiiDyibS2/QThQNCvbbv5Lj6MAY6q4XRGAXzGZF7E8Ie6LU1Z0lEzgwmtr+C6tzix+eQniG7QVaeYOag0OQIb8MLZcYjS/Z/j674exChHmL//AUvemK4sRw==',key_name='tempest-TestVolumeBackupRestore-39710801',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24a7b4447be44babbc8cb7d9d09c1e76',ramdisk_id='',reservation_id='r-p9d0fbrk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBackupRestore-1977101720',owner_user_name='tempest-TestVolumeBackupRestore-1977101720-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:10:46Z,user_data=None,user_id='aa5dd2b739b04d2c97c592939c03a2c8',uuid=b51e6cdd-7556-41bf-ab93-24495d4e3d03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9ced81c-77d5-4b25-a984-054f5dd0a4ac", "address": "fa:16:3e:88:d1:c6", "network": {"id": "4638034a-36e0-4524-a643-bd5fb2c5d03a", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1792230061-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "24a7b4447be44babbc8cb7d9d09c1e76", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ced81c-77", "ovs_interfaceid": "d9ced81c-77d5-4b25-a984-054f5dd0a4ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:10:53.653112 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Converting VIF {"id": "d9ced81c-77d5-4b25-a984-054f5dd0a4ac", "address": "fa:16:3e:88:d1:c6", "network": {"id": "4638034a-36e0-4524-a643-bd5fb2c5d03a", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1792230061-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "24a7b4447be44babbc8cb7d9d09c1e76", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ced81c-77", "ovs_interfaceid": "d9ced81c-77d5-4b25-a984-054f5dd0a4ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:10:53.654714 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:d1:c6,bridge_name='br-int',has_traffic_filtering=True,id=d9ced81c-77d5-4b25-a984-054f5dd0a4ac,network=Network(4638034a-36e0-4524-a643-bd5fb2c5d03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9ced81c-77') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:10:53.655628 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:d1:c6,bridge_name='br-int',has_traffic_filtering=True,id=d9ced81c-77d5-4b25-a984-054f5dd0a4ac,network=Network(4638034a-36e0-4524-a643-bd5fb2c5d03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9ced81c-77') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:10:53.657073 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:10:53.657449 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:10:53.659150 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:53.659422 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '11a5a689-5307-50cc-8812-08c15e7f4fff', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:10:53.660126 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:53.660986 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:10:53.675913 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:53.680666 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:53.686905 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:53.694432 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:53.694734 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9ced81c-77, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:10:53.695231 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd9ced81c-77, col_values=(('qos', UUID('161600b3-4646-4b3e-897c-d9fff8d924b7')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:10:53.695494 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd9ced81c-77, col_values=(('external_ids', {'iface-id': 'd9ced81c-77d5-4b25-a984-054f5dd0a4ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:d1:c6', 'vm-uuid': 'b51e6cdd-7556-41bf-ab93-24495d4e3d03'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:10:53.697524 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:53.701452 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:10:53.708597 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:53.711424 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:10:53.713338 np0000001613 nova-compute[98321]: INFO os_vif [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:d1:c6,bridge_name='br-int',has_traffic_filtering=True,id=d9ced81c-77d5-4b25-a984-054f5dd0a4ac,network=Network(4638034a-36e0-4524-a643-bd5fb2c5d03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9ced81c-77')
May 28 10:10:53.731786 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6619fff7ebcede354d1d90be188e5d75e8699444 --force-share --output=json" returned: 0 in 0.111s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:10:53.732210 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Acquiring lock "6619fff7ebcede354d1d90be188e5d75e8699444" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:53.732691 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "6619fff7ebcede354d1d90be188e5d75e8699444" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:53.733225 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:10:53.743422 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:10:53.744218 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6619fff7ebcede354d1d90be188e5d75e8699444 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:10:53.809011 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:53.835189 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:09:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1080199311',display_name='tempest-TestEncryptedCinderVolumes-server-1080199311',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(13),hidden=False,host='np0000001613',hostname='tempest-testencryptedcindervolumes-server-1080199311',id=55,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=13,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPEA8+uxSyCsgS6j+focPk4QpOVZVeAFK2kV4ErBJfCH5RkIc3vXvdGbsr44pZ3e0kq61KVrhwaHdQPmC2IB37UUcRSn+zMS1bh2okKRJrj9i8mJQASjzRzDfrAxUyWcQ==',key_name='tempest-keypair-831862139',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:10:48Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=Flavor(13),node='np0000001613',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7563a83d33d4bc1a6610ccf53c18dc1',ramdisk_id='',reservation_id='r-34tgbqip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-297752033',owner_user_name='tempest-TestEncryptedCinderVolumes-297752033-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:10:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='961948be669c4a18a29398d53015f03b',uuid=edd8dcff-3440-445a-b4a2-8c56863e7ca3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "address": "fa:16:3e:5c:9e:66", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb80648-bd", "ovs_interfaceid": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:10:53.835189 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Converting VIF {"id": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "address": "fa:16:3e:5c:9e:66", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb80648-bd", "ovs_interfaceid": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:10:53.835189 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:9e:66,bridge_name='br-int',has_traffic_filtering=True,id=6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb80648-bd') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:10:53.835189 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:9e:66,bridge_name='br-int',has_traffic_filtering=True,id=6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb80648-bd') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:10:53.837987 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:53.838232 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6eb80648-bd, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:10:53.839416 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:53.840586 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:10:53.845575 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:53.851341 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:53.852361 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:53.852542 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=da39a126-999b-467c-94f5-c87132632ad8) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:10:53.853710 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:53.854051 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:10:53.855548 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6619fff7ebcede354d1d90be188e5d75e8699444 --force-share --output=json" returned: 0 in 0.111s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:10:53.855901 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6619fff7ebcede354d1d90be188e5d75e8699444,backing_fmt=raw /opt/stack/data/nova/instances/b4c26c83-b122-4b4a-a517-1701b23caf03/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:10:53.870004 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:53.879446 np0000001613 nova-compute[98321]: INFO os_vif [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:9e:66,bridge_name='br-int',has_traffic_filtering=True,id=6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb80648-bd')
May 28 10:10:53.904080 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:10:53.904972 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ddb1344-a4d2-4480-9818-32c65d8ad963', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:10:53.905565 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:10:53.906436 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:10:53.906871 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ddb1344-a4d2-4480-9818-32c65d8ad963', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:10:53.907033 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:10:53.925685 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6619fff7ebcede354d1d90be188e5d75e8699444,backing_fmt=raw /opt/stack/data/nova/instances/b4c26c83-b122-4b4a-a517-1701b23caf03/disk 1073741824" returned: 0 in 0.070s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:10:53.926191 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "6619fff7ebcede354d1d90be188e5d75e8699444" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:53.926563 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6619fff7ebcede354d1d90be188e5d75e8699444 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:10:53.945531 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:53.945531 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:53.945531 np0000001613 nova-compute[98321]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:53.945531 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:53.945531 np0000001613 nova-compute[98321]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:53.945531 np0000001613 nova-compute[98321]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:53.945531 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:10:53.945531 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:10:53.945531 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:10:53.946316 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsi session list stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:53.946316 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:10:53.946316 np0000001613 nova-compute[98321]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:53.946316 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:10:53.946316 np0000001613 nova-compute[98321]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:53.946316 np0000001613 nova-compute[98321]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:10:53.946316 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:10:53.946316 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:10:53.946316 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:10:53.946994 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', '148'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', '149'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623', '150'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623', '151'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', '153'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', '154'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d', '155'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d', '156')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:10:53.947368 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', '153')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:10:53.949255 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', '154')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:10:53.950021 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c205ba4a40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963'): ({'sde'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:10:53.950823 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Removing multipathed devices sdf, sde {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:10:53.951510 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Flush multipath device 330000000e79767bf {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:10:53.990082 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:53.995758 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:10:54.035465 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:10:54.063957 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6619fff7ebcede354d1d90be188e5d75e8699444 --force-share --output=json" returned: 0 in 0.137s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:10:54.064661 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:10:54.064902 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Ensure instance console log exists: /opt/stack/data/nova/instances/b4c26c83-b122-4b4a-a517-1701b23caf03/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:10:54.065298 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:54.065711 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:54.065907 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:54.082776 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Checking to see if SCSI volumes sdf, sde have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:10:54.083027 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] SCSI volumes sdf, sde have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:10:54.087191 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Checking to see if device paths {'sdf', 'sde'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:10:54.098874 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Device paths {'sdf', 'sde'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:10:54.099091 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:10:54.111031 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:54.145615 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 153, target: iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963, portal: 192.168.40.100,3260]
May 28 10:10:54.145615 np0000001613 nova-compute[98321]: Logout of [sid: 153, target: iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963, portal: 192.168.40.100,3260] successful.
May 28 10:10:54.145615 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:54.153355 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Updating instance_info_cache with network_info: [{"id": "a00c63db-98a2-46e6-ac78-c54d73edf1e8", "address": "fa:16:3e:a2:6f:fc", "network": {"id": "233ff488-7baf-4369-9054-b24499b82bab", "bridge": "br-int", "label": "tempest-TestStampPattern-854727558-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba63ea134a6e4fe1992f53a0da46d034", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00c63db-98", "ovs_interfaceid": "a00c63db-98a2-46e6-ac78-c54d73edf1e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:10:54.166107 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:54.178757 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:54.212285 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 154, target: iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963, portal: 192.168.50.100,3260]
May 28 10:10:54.212285 np0000001613 nova-compute[98321]: Logout of [sid: 154, target: iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963, portal: 192.168.50.100,3260] successful.
May 28 10:10:54.212285 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:54.228609 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:10:54.229731 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:10:54.229858 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] <== disconnect_volume: return (325ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:10:54.229993 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:10:54.655848 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Releasing lock "refresh_cache-b4c26c83-b122-4b4a-a517-1701b23caf03" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:10:54.656278 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Instance network_info: |[{"id": "a00c63db-98a2-46e6-ac78-c54d73edf1e8", "address": "fa:16:3e:a2:6f:fc", "network": {"id": "233ff488-7baf-4369-9054-b24499b82bab", "bridge": "br-int", "label": "tempest-TestStampPattern-854727558-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba63ea134a6e4fe1992f53a0da46d034", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00c63db-98", "ovs_interfaceid": "a00c63db-98a2-46e6-ac78-c54d73edf1e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:10:54.658057 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Start _get_guest_xml network_info=[{"id": "a00c63db-98a2-46e6-ac78-c54d73edf1e8", "address": "fa:16:3e:a2:6f:fc", "network": {"id": "233ff488-7baf-4369-9054-b24499b82bab", "bridge": "br-int", "label": "tempest-TestStampPattern-854727558-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba63ea134a6e4fe1992f53a0da46d034", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00c63db-98", "ovs_interfaceid": "a00c63db-98a2-46e6-ac78-c54d73edf1e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='6b71c9d54728f25131f8cdae9b6996f6',container_format='bare',created_at=2026-05-28T10:10:36Z,direct_url=<?>,disk_format='qcow2',id=a4df893b-9c4b-42ac-aeec-7933f9c3f012,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1318782964',owner='ba63ea134a6e4fe1992f53a0da46d034',properties=ImageMetaProps,protected=<?>,size=53739520,status='active',tags=<?>,updated_at=2026-05-28T10:10:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a4df893b-9c4b-42ac-aeec-7933f9c3f012'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:10:54.661264 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:10:54.662644 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-TestStampPattern-server-748913283', uuid='b4c26c83-b122-4b4a-a517-1701b23caf03'), owner=OwnerMeta(userid='cda3cde4813d436b9f875ba96f496882', username='tempest-TestStampPattern-414594070-project-member', projectid='ba63ea134a6e4fe1992f53a0da46d034', projectname='tempest-TestStampPattern-414594070'), image=ImageMeta(id='a4df893b-9c4b-42ac-aeec-7933f9c3f012', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio', 'img_owner_id': 'ba63ea134a6e4fe1992f53a0da46d034'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a00c63db-98a2-46e6-ac78-c54d73edf1e8", "address": "fa:16:3e:a2:6f:fc", "network": {"id": "233ff488-7baf-4369-9054-b24499b82bab", "bridge": "br-int", "label": "tempest-TestStampPattern-854727558-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba63ea134a6e4fe1992f53a0da46d034", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00c63db-98", "ovs_interfaceid": "a00c63db-98a2-46e6-ac78-c54d73edf1e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779963054.6622236) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:10:54.664373 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:10:54.664818 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:10:54.666278 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:10:54.666472 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:10:54.667366 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:10:54.667720 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='6b71c9d54728f25131f8cdae9b6996f6',container_format='bare',created_at=2026-05-28T10:10:36Z,direct_url=<?>,disk_format='qcow2',id=a4df893b-9c4b-42ac-aeec-7933f9c3f012,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1318782964',owner='ba63ea134a6e4fe1992f53a0da46d034',properties=ImageMetaProps,protected=<?>,size=53739520,status='active',tags=<?>,updated_at=2026-05-28T10:10:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:10:54.667864 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:10:54.668050 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:10:54.668173 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:10:54.668274 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:10:54.668397 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:10:54.668537 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:10:54.668637 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:10:54.668759 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:10:54.668855 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:10:54.668973 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:10:54.681187 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:10:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-748913283',display_name='tempest-TestStampPattern-server-748913283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-teststamppattern-server-748913283',id=62,image_ref='a4df893b-9c4b-42ac-aeec-7933f9c3f012',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYM/OccL4UHt9TwzRUM2NoxErdXFvJSjsBY3qW0TdqZb62VjSt3Qhb8ydQXj0m7ruuXson/l4HMWZVUlPSmKQS9NgOeLgHIKDS6cwgmeUrB5A+zdtBT5AYw72WB234Frg==',key_name='tempest-TestStampPattern-550069760',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba63ea134a6e4fe1992f53a0da46d034',ramdisk_id='',reservation_id='r-q03fur7u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f42f06fc-5b0c-4973-98db-cd594815f317',image_min_disk='1',image_min_ram='0',image_owner_id='ba63ea134a6e4fe1992f53a0da46d034',image_owner_project_name='tempest-TestStampPattern-414594070',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-414594070-project-member',image_user_id='cda3cde4813d436b9f875ba96f496882',network_allocated='True',owner_project_name='tempest-TestStampPattern-414594070',owner_user_name='tempest-TestStampPattern-414594070-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:10:51Z,user_data=None,user_id='cda3cde4813d436b9f875ba96f496882',uuid=b4c26c83-b122-4b4a-a517-1701b23caf03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a00c63db-98a2-46e6-ac78-c54d73edf1e8", "address": "fa:16:3e:a2:6f:fc", "network": {"id": "233ff488-7baf-4369-9054-b24499b82bab", "bridge": "br-int", "label": "tempest-TestStampPattern-854727558-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba63ea134a6e4fe1992f53a0da46d034", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00c63db-98", "ovs_interfaceid": "a00c63db-98a2-46e6-ac78-c54d73edf1e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:10:54.681616 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Converting VIF {"id": "a00c63db-98a2-46e6-ac78-c54d73edf1e8", "address": "fa:16:3e:a2:6f:fc", "network": {"id": "233ff488-7baf-4369-9054-b24499b82bab", "bridge": "br-int", "label": "tempest-TestStampPattern-854727558-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba63ea134a6e4fe1992f53a0da46d034", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00c63db-98", "ovs_interfaceid": "a00c63db-98a2-46e6-ac78-c54d73edf1e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:10:54.682207 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:6f:fc,bridge_name='br-int',has_traffic_filtering=True,id=a00c63db-98a2-46e6-ac78-c54d73edf1e8,network=Network(233ff488-7baf-4369-9054-b24499b82bab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa00c63db-98') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:10:54.682758 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lazy-loading 'pci_devices' on Instance uuid b4c26c83-b122-4b4a-a517-1701b23caf03 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:10:54.865862 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:55.185633 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] End _get_guest_xml xml=<domain type="qemu">
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:   <uuid>b4c26c83-b122-4b4a-a517-1701b23caf03</uuid>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:   <name>instance-0000003e</name>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:       <nova:name>tempest-TestStampPattern-server-748913283</nova:name>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:10:54</nova:creationTime>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:           <nova:property name="img_owner_id">ba63ea134a6e4fe1992f53a0da46d034</nova:property>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:         <nova:user uuid="cda3cde4813d436b9f875ba96f496882">tempest-TestStampPattern-414594070-project-member</nova:user>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:         <nova:project uuid="ba63ea134a6e4fe1992f53a0da46d034">tempest-TestStampPattern-414594070</nova:project>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:         <nova:port uuid="a00c63db-98a2-46e6-ac78-c54d73edf1e8">
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:     <system>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:       <entry name="serial">b4c26c83-b122-4b4a-a517-1701b23caf03</entry>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:       <entry name="uuid">b4c26c83-b122-4b4a-a517-1701b23caf03</entry>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:     </system>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:   <os>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:   </os>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:   <features>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:   </features>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:   <devices>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/b4c26c83-b122-4b4a-a517-1701b23caf03/disk"/>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:     </disk>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/b4c26c83-b122-4b4a-a517-1701b23caf03/disk.config"/>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:     </disk>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:a2:6f:fc"/>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:       <target dev="tapa00c63db-98"/>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:     </interface>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/b4c26c83-b122-4b4a-a517-1701b23caf03/console.log" append="off"/>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:     </serial>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:     <video>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:     </video>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:     </rng>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:   </devices>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]: </domain>
May 28 10:10:55.185633 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:10:55.188340 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Preparing to wait for external event network-vif-plugged-a00c63db-98a2-46e6-ac78-c54d73edf1e8 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:10:55.188340 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Acquiring lock "b4c26c83-b122-4b4a-a517-1701b23caf03-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:55.188340 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "b4c26c83-b122-4b4a-a517-1701b23caf03-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:55.188340 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "b4c26c83-b122-4b4a-a517-1701b23caf03-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:55.188340 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:10:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-748913283',display_name='tempest-TestStampPattern-server-748913283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-teststamppattern-server-748913283',id=62,image_ref='a4df893b-9c4b-42ac-aeec-7933f9c3f012',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYM/OccL4UHt9TwzRUM2NoxErdXFvJSjsBY3qW0TdqZb62VjSt3Qhb8ydQXj0m7ruuXson/l4HMWZVUlPSmKQS9NgOeLgHIKDS6cwgmeUrB5A+zdtBT5AYw72WB234Frg==',key_name='tempest-TestStampPattern-550069760',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba63ea134a6e4fe1992f53a0da46d034',ramdisk_id='',reservation_id='r-q03fur7u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f42f06fc-5b0c-4973-98db-cd594815f317',image_min_disk='1',image_min_ram='0',image_owner_id='ba63ea134a6e4fe1992f53a0da46d034',image_owner_project_name='tempest-TestStampPattern-414594070',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-414594070-project-member',image_user_id='cda3cde4813d436b9f875ba96f496882',network_allocated='True',owner_project_name='tempest-TestStampPattern-414594070',owner_user_name='tempest-TestStampPattern-414594070-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:10:51Z,user_data=None,user_id='cda3cde4813d436b9f875ba96f496882',uuid=b4c26c83-b122-4b4a-a517-1701b23caf03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a00c63db-98a2-46e6-ac78-c54d73edf1e8", "address": "fa:16:3e:a2:6f:fc", "network": {"id": "233ff488-7baf-4369-9054-b24499b82bab", "bridge": "br-int", "label": "tempest-TestStampPattern-854727558-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba63ea134a6e4fe1992f53a0da46d034", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00c63db-98", "ovs_interfaceid": "a00c63db-98a2-46e6-ac78-c54d73edf1e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:10:55.188340 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Converting VIF {"id": "a00c63db-98a2-46e6-ac78-c54d73edf1e8", "address": "fa:16:3e:a2:6f:fc", "network": {"id": "233ff488-7baf-4369-9054-b24499b82bab", "bridge": "br-int", "label": "tempest-TestStampPattern-854727558-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba63ea134a6e4fe1992f53a0da46d034", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00c63db-98", "ovs_interfaceid": "a00c63db-98a2-46e6-ac78-c54d73edf1e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:10:55.188340 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:6f:fc,bridge_name='br-int',has_traffic_filtering=True,id=a00c63db-98a2-46e6-ac78-c54d73edf1e8,network=Network(233ff488-7baf-4369-9054-b24499b82bab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa00c63db-98') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:10:55.188753 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:6f:fc,bridge_name='br-int',has_traffic_filtering=True,id=a00c63db-98a2-46e6-ac78-c54d73edf1e8,network=Network(233ff488-7baf-4369-9054-b24499b82bab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa00c63db-98') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:10:55.188862 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:55.189193 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:10:55.189477 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:10:55.192762 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:55.193105 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ebe8bd6b-ffc0-559a-8cd2-2a9a7121c8a1', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:10:55.193862 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:55.194643 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:10:55.205610 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:55.208043 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:55.208260 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa00c63db-98, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:10:55.208761 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa00c63db-98, col_values=(('qos', UUID('4ce112aa-3748-42ed-bdbe-02f1b36f4b93')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:10:55.208761 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa00c63db-98, col_values=(('external_ids', {'iface-id': 'a00c63db-98a2-46e6-ac78-c54d73edf1e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:6f:fc', 'vm-uuid': 'b4c26c83-b122-4b4a-a517-1701b23caf03'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:10:55.211369 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:10:55.220904 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:55.222635 np0000001613 nova-compute[98321]: INFO os_vif [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:6f:fc,bridge_name='br-int',has_traffic_filtering=True,id=a00c63db-98a2-46e6-ac78-c54d73edf1e8,network=Network(233ff488-7baf-4369-9054-b24499b82bab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa00c63db-98')
May 28 10:10:55.244881 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:10:55.245047 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:10:55.245307 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] No VIF found with MAC fa:16:3e:88:d1:c6, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:10:55.245918 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Using config drive
May 28 10:10:55.255892 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4b17ac65-7dc6-4b74-87aa-e97efab00b16 req-7affbaa6-0012-4f6d-883b-fa3c618b130c service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Received event network-vif-unplugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:10:55.256074 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4b17ac65-7dc6-4b74-87aa-e97efab00b16 req-7affbaa6-0012-4f6d-883b-fa3c618b130c service nova] Acquiring lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:55.256253 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4b17ac65-7dc6-4b74-87aa-e97efab00b16 req-7affbaa6-0012-4f6d-883b-fa3c618b130c service nova] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:55.256407 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4b17ac65-7dc6-4b74-87aa-e97efab00b16 req-7affbaa6-0012-4f6d-883b-fa3c618b130c service nova] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:55.256530 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4b17ac65-7dc6-4b74-87aa-e97efab00b16 req-7affbaa6-0012-4f6d-883b-fa3c618b130c service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] No waiting events found dispatching network-vif-unplugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:10:55.256657 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-4b17ac65-7dc6-4b74-87aa-e97efab00b16 req-7affbaa6-0012-4f6d-883b-fa3c618b130c service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Received unexpected event network-vif-unplugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc for instance with vm_state resized and task_state resize_reverting.
May 28 10:10:55.256756 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4b17ac65-7dc6-4b74-87aa-e97efab00b16 req-7affbaa6-0012-4f6d-883b-fa3c618b130c service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Received event network-vif-plugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:10:55.256904 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4b17ac65-7dc6-4b74-87aa-e97efab00b16 req-7affbaa6-0012-4f6d-883b-fa3c618b130c service nova] Acquiring lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:55.257028 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4b17ac65-7dc6-4b74-87aa-e97efab00b16 req-7affbaa6-0012-4f6d-883b-fa3c618b130c service nova] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:55.257125 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4b17ac65-7dc6-4b74-87aa-e97efab00b16 req-7affbaa6-0012-4f6d-883b-fa3c618b130c service nova] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:55.257267 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4b17ac65-7dc6-4b74-87aa-e97efab00b16 req-7affbaa6-0012-4f6d-883b-fa3c618b130c service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] No waiting events found dispatching network-vif-plugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:10:55.257381 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-4b17ac65-7dc6-4b74-87aa-e97efab00b16 req-7affbaa6-0012-4f6d-883b-fa3c618b130c service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Received unexpected event network-vif-plugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc for instance with vm_state resized and task_state resize_reverting.
May 28 10:10:55.257481 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4b17ac65-7dc6-4b74-87aa-e97efab00b16 req-7affbaa6-0012-4f6d-883b-fa3c618b130c service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Received event network-vif-plugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:10:55.257597 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4b17ac65-7dc6-4b74-87aa-e97efab00b16 req-7affbaa6-0012-4f6d-883b-fa3c618b130c service nova] Acquiring lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:55.257717 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4b17ac65-7dc6-4b74-87aa-e97efab00b16 req-7affbaa6-0012-4f6d-883b-fa3c618b130c service nova] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:55.258409 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4b17ac65-7dc6-4b74-87aa-e97efab00b16 req-7affbaa6-0012-4f6d-883b-fa3c618b130c service nova] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:55.258523 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4b17ac65-7dc6-4b74-87aa-e97efab00b16 req-7affbaa6-0012-4f6d-883b-fa3c618b130c service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] No waiting events found dispatching network-vif-plugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:10:55.258626 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-4b17ac65-7dc6-4b74-87aa-e97efab00b16 req-7affbaa6-0012-4f6d-883b-fa3c618b130c service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Received unexpected event network-vif-plugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc for instance with vm_state resized and task_state resize_reverting.
May 28 10:10:55.258731 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4b17ac65-7dc6-4b74-87aa-e97efab00b16 req-7affbaa6-0012-4f6d-883b-fa3c618b130c service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Received event network-vif-unplugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:10:55.258854 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4b17ac65-7dc6-4b74-87aa-e97efab00b16 req-7affbaa6-0012-4f6d-883b-fa3c618b130c service nova] Acquiring lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:55.258963 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4b17ac65-7dc6-4b74-87aa-e97efab00b16 req-7affbaa6-0012-4f6d-883b-fa3c618b130c service nova] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:55.259057 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4b17ac65-7dc6-4b74-87aa-e97efab00b16 req-7affbaa6-0012-4f6d-883b-fa3c618b130c service nova] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:55.259272 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4b17ac65-7dc6-4b74-87aa-e97efab00b16 req-7affbaa6-0012-4f6d-883b-fa3c618b130c service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] No waiting events found dispatching network-vif-unplugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:10:55.259379 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-4b17ac65-7dc6-4b74-87aa-e97efab00b16 req-7affbaa6-0012-4f6d-883b-fa3c618b130c service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Received unexpected event network-vif-unplugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc for instance with vm_state resized and task_state resize_reverting.
May 28 10:10:55.259469 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4b17ac65-7dc6-4b74-87aa-e97efab00b16 req-7affbaa6-0012-4f6d-883b-fa3c618b130c service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Received event network-vif-unplugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:10:55.259592 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4b17ac65-7dc6-4b74-87aa-e97efab00b16 req-7affbaa6-0012-4f6d-883b-fa3c618b130c service nova] Acquiring lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:55.259704 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4b17ac65-7dc6-4b74-87aa-e97efab00b16 req-7affbaa6-0012-4f6d-883b-fa3c618b130c service nova] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:55.259794 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4b17ac65-7dc6-4b74-87aa-e97efab00b16 req-7affbaa6-0012-4f6d-883b-fa3c618b130c service nova] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:55.259889 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4b17ac65-7dc6-4b74-87aa-e97efab00b16 req-7affbaa6-0012-4f6d-883b-fa3c618b130c service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] No waiting events found dispatching network-vif-unplugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:10:55.259989 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-4b17ac65-7dc6-4b74-87aa-e97efab00b16 req-7affbaa6-0012-4f6d-883b-fa3c618b130c service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Received unexpected event network-vif-unplugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc for instance with vm_state resized and task_state resize_reverting.
May 28 10:10:55.364859 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:55.365063 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:55.757002 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:55.792690 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:10:55.795150 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:10:55.868643 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lazy-loading 'migration_context' on Instance uuid edd8dcff-3440-445a-b4a2-8c56863e7ca3 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:10:55.886160 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Creating config drive at /opt/stack/data/nova/instances/b51e6cdd-7556-41bf-ab93-24495d4e3d03/disk.config
May 28 10:10:55.889537 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b51e6cdd-7556-41bf-ab93-24495d4e3d03/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpb4n7s82h {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:10:55.952459 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b51e6cdd-7556-41bf-ab93-24495d4e3d03/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpb4n7s82h" returned: 0 in 0.062s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:10:56.374096 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Object Instance<edd8dcff-3440-445a-b4a2-8c56863e7ca3> lazy-loaded attributes: resources,migration_context {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:10:56.454309 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:56.499212 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:56.574005 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:56.737548 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c8f08592-4f34-41ec-a8c3-b7be572343fd req-af74cabc-0057-4844-b8f9-7d4d6dec8c7e service nova] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Received event network-vif-plugged-d9ced81c-77d5-4b25-a984-054f5dd0a4ac {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:10:56.737548 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c8f08592-4f34-41ec-a8c3-b7be572343fd req-af74cabc-0057-4844-b8f9-7d4d6dec8c7e service nova] Acquiring lock "b51e6cdd-7556-41bf-ab93-24495d4e3d03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:56.737548 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c8f08592-4f34-41ec-a8c3-b7be572343fd req-af74cabc-0057-4844-b8f9-7d4d6dec8c7e service nova] Lock "b51e6cdd-7556-41bf-ab93-24495d4e3d03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:56.737548 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c8f08592-4f34-41ec-a8c3-b7be572343fd req-af74cabc-0057-4844-b8f9-7d4d6dec8c7e service nova] Lock "b51e6cdd-7556-41bf-ab93-24495d4e3d03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:56.737548 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c8f08592-4f34-41ec-a8c3-b7be572343fd req-af74cabc-0057-4844-b8f9-7d4d6dec8c7e service nova] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Processing event network-vif-plugged-d9ced81c-77d5-4b25-a984-054f5dd0a4ac {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:10:56.763177 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:10:56.763177 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:10:56.763702 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] No VIF found with MAC fa:16:3e:a2:6f:fc, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:10:56.769404 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Using config drive
May 28 10:10:56.793186 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:10:56.793516 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:10:56.884829 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:56.891331 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:56.895608 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:56.912048 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:10:56.912427 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:10:56.923196 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:57.277807 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:10:57.283198 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:10:57.284178 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963057.280378, b51e6cdd-7556-41bf-ab93-24495d4e3d03 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:10:57.284541 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] VM Started (Lifecycle Event)
May 28 10:10:57.286897 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:10:57.290429 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Instance spawned successfully.
May 28 10:10:57.291682 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:10:57.410258 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Creating config drive at /opt/stack/data/nova/instances/b4c26c83-b122-4b4a-a517-1701b23caf03/disk.config
May 28 10:10:57.413771 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b4c26c83-b122-4b4a-a517-1701b23caf03/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpv8c13knx {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:10:57.428401 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:10:57.471799 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b4c26c83-b122-4b4a-a517-1701b23caf03/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpv8c13knx" returned: 0 in 0.058s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:10:57.787503 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:10:57.788193 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:10:57.788587 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:10:57.791429 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:10:57.791779 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:10:57.793340 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:10:57.803738 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:10:57.804081 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:10:57.804276 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:10:57.804581 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:10:57.804811 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:10:57.805063 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:10:57.962584 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:58.000688 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:58.108724 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:58.173796 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:58.174342 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:10:58.294241 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:10:58.294600 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963058.2943451, b51e6cdd-7556-41bf-ab93-24495d4e3d03 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:10:58.294852 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] VM Paused (Lifecycle Event)
May 28 10:10:58.317684 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Took 9.16 seconds to spawn the instance on the hypervisor.
May 28 10:10:58.318240 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:10:58.453783 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 3.088s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:58.453783 np0000001613 nova-compute[98321]: DEBUG nova.compute.rpcapi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98321) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 10:10:58.791560 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:10:58.791852 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 10:10:58.791979 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:10:58.798100 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:10:58.805964 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963058.8056366, b51e6cdd-7556-41bf-ab93-24495d4e3d03 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:10:58.806155 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] VM Resumed (Lifecycle Event)
May 28 10:10:58.829865 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-db97be0f-1e6f-4e07-87bd-4d982f3c6970 req-823df00b-5755-4f3c-9238-e25fc26d3c74 service nova] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Received event network-vif-plugged-d9ced81c-77d5-4b25-a984-054f5dd0a4ac {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:10:58.829865 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-db97be0f-1e6f-4e07-87bd-4d982f3c6970 req-823df00b-5755-4f3c-9238-e25fc26d3c74 service nova] Acquiring lock "b51e6cdd-7556-41bf-ab93-24495d4e3d03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:58.831273 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-db97be0f-1e6f-4e07-87bd-4d982f3c6970 req-823df00b-5755-4f3c-9238-e25fc26d3c74 service nova] Lock "b51e6cdd-7556-41bf-ab93-24495d4e3d03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:58.831531 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-db97be0f-1e6f-4e07-87bd-4d982f3c6970 req-823df00b-5755-4f3c-9238-e25fc26d3c74 service nova] Lock "b51e6cdd-7556-41bf-ab93-24495d4e3d03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:58.831722 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-db97be0f-1e6f-4e07-87bd-4d982f3c6970 req-823df00b-5755-4f3c-9238-e25fc26d3c74 service nova] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] No waiting events found dispatching network-vif-plugged-d9ced81c-77d5-4b25-a984-054f5dd0a4ac {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:10:58.831943 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-db97be0f-1e6f-4e07-87bd-4d982f3c6970 req-823df00b-5755-4f3c-9238-e25fc26d3c74 service nova] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Received unexpected event network-vif-plugged-d9ced81c-77d5-4b25-a984-054f5dd0a4ac for instance with vm_state active and task_state None.
May 28 10:10:58.832323 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-db97be0f-1e6f-4e07-87bd-4d982f3c6970 req-823df00b-5755-4f3c-9238-e25fc26d3c74 service nova] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Received event network-vif-plugged-a00c63db-98a2-46e6-ac78-c54d73edf1e8 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:10:58.832876 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-db97be0f-1e6f-4e07-87bd-4d982f3c6970 req-823df00b-5755-4f3c-9238-e25fc26d3c74 service nova] Acquiring lock "b4c26c83-b122-4b4a-a517-1701b23caf03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:58.832975 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-db97be0f-1e6f-4e07-87bd-4d982f3c6970 req-823df00b-5755-4f3c-9238-e25fc26d3c74 service nova] Lock "b4c26c83-b122-4b4a-a517-1701b23caf03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:58.833129 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-db97be0f-1e6f-4e07-87bd-4d982f3c6970 req-823df00b-5755-4f3c-9238-e25fc26d3c74 service nova] Lock "b4c26c83-b122-4b4a-a517-1701b23caf03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:58.833317 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-db97be0f-1e6f-4e07-87bd-4d982f3c6970 req-823df00b-5755-4f3c-9238-e25fc26d3c74 service nova] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Processing event network-vif-plugged-a00c63db-98a2-46e6-ac78-c54d73edf1e8 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:10:58.833577 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-db97be0f-1e6f-4e07-87bd-4d982f3c6970 req-823df00b-5755-4f3c-9238-e25fc26d3c74 service nova] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Received event network-vif-plugged-a00c63db-98a2-46e6-ac78-c54d73edf1e8 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:10:58.833749 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-db97be0f-1e6f-4e07-87bd-4d982f3c6970 req-823df00b-5755-4f3c-9238-e25fc26d3c74 service nova] Acquiring lock "b4c26c83-b122-4b4a-a517-1701b23caf03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:58.833954 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-db97be0f-1e6f-4e07-87bd-4d982f3c6970 req-823df00b-5755-4f3c-9238-e25fc26d3c74 service nova] Lock "b4c26c83-b122-4b4a-a517-1701b23caf03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:58.834323 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:10:58.836195 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-db97be0f-1e6f-4e07-87bd-4d982f3c6970 req-823df00b-5755-4f3c-9238-e25fc26d3c74 service nova] Lock "b4c26c83-b122-4b4a-a517-1701b23caf03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:58.836195 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-db97be0f-1e6f-4e07-87bd-4d982f3c6970 req-823df00b-5755-4f3c-9238-e25fc26d3c74 service nova] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] No waiting events found dispatching network-vif-plugged-a00c63db-98a2-46e6-ac78-c54d73edf1e8 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:10:58.836195 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-db97be0f-1e6f-4e07-87bd-4d982f3c6970 req-823df00b-5755-4f3c-9238-e25fc26d3c74 service nova] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Received unexpected event network-vif-plugged-a00c63db-98a2-46e6-ac78-c54d73edf1e8 for instance with vm_state building and task_state spawning.
May 28 10:10:58.836195 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Took 16.48 seconds to build instance.
May 28 10:10:58.839063 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:10:58.841083 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Instance spawned successfully.
May 28 10:10:58.841342 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:10:58.843629 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:10:58.843885 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:10:59.298788 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:10:59.298960 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:10:59.299102 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:59.299346 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Auditing locally available compute resources for np0000001613 (node: np0000001613) {{(pid=98321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 10:10:59.308984 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:10:59.313834 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:10:59.336975 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a5c2dab3-e0b9-4e41-9c02-a29586de93c9 tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Lock "b51e6cdd-7556-41bf-ab93-24495d4e3d03" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.994s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:10:59.352942 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Took 7.01 seconds to spawn the instance on the hypervisor.
May 28 10:10:59.352942 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:10:59.817592 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963059.8171475, b4c26c83-b122-4b4a-a517-1701b23caf03 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:10:59.818467 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] VM Started (Lifecycle Event)
May 28 10:10:59.864529 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Took 12.63 seconds to build instance.
May 28 10:10:59.869076 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:00.047830 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Swapping old allocation on dict_keys(['ad4de091-3626-4008-ac9a-3e83de44a510']) held by migration e7fa3c5c-a528-4946-b370-2dc2ccd8a06f for instance
May 28 10:11:00.146144 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "c0786416-dec3-4610-9ec2-389aa7508148" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:00.146331 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "c0786416-dec3-4610-9ec2-389aa7508148" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:00.146462 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Rebooting instance
May 28 10:11:00.168335 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Overwriting current allocation {'allocations': {'ad4de091-3626-4008-ac9a-3e83de44a510': {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}, 'generation': 81}}, 'project_id': 'c7563a83d33d4bc1a6610ccf53c18dc1', 'user_id': '961948be669c4a18a29398d53015f03b', 'consumer_generation': 1} on consumer edd8dcff-3440-445a-b4a2-8c56863e7ca3 {{(pid=98321) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2036}}
May 28 10:11:00.221233 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:00.278854 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:00.320073 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:11:00.323771 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:11:00.344524 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "refresh_cache-edd8dcff-3440-445a-b4a2-8c56863e7ca3" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:11:00.344639 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquired lock "refresh_cache-edd8dcff-3440-445a-b4a2-8c56863e7ca3" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:11:00.344775 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:11:00.349293 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-5 (vda) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:11:00.351196 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:11:00.374290 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ea67192e-c0f6-4e17-bc52-76f92cf2c9dc tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "b4c26c83-b122-4b4a-a517-1701b23caf03" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.156s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:00.468357 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:11:00.470760 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:11:00.584184 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:11:00.584184 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-2 (vdb) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:11:00.590236 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:11:00.592485 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c26c83-b122-4b4a-a517-1701b23caf03/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:11:00.701517 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c26c83-b122-4b4a-a517-1701b23caf03/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:11:00.701824 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c26c83-b122-4b4a-a517-1701b23caf03/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:11:00.733434 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "refresh_cache-c0786416-dec3-4610-9ec2-389aa7508148" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:11:00.733434 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquired lock "refresh_cache-c0786416-dec3-4610-9ec2-389aa7508148" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:11:00.733434 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:11:00.802445 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c26c83-b122-4b4a-a517-1701b23caf03/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:11:00.809219 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f42f06fc-5b0c-4973-98db-cd594815f317/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:11:00.830624 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963060.829682, b4c26c83-b122-4b4a-a517-1701b23caf03 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:11:00.830963 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] VM Paused (Lifecycle Event)
May 28 10:11:00.848561 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:00.900476 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f42f06fc-5b0c-4973-98db-cd594815f317/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:11:00.901027 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f42f06fc-5b0c-4973-98db-cd594815f317/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:11:00.922619 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-be48fea7-5abd-4ddf-8a08-f87375cdb6e3 req-e21ffb46-1943-40f7-821c-b731a874acaa service nova] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Received event network-changed-d9ced81c-77d5-4b25-a984-054f5dd0a4ac {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:11:00.922619 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-be48fea7-5abd-4ddf-8a08-f87375cdb6e3 req-e21ffb46-1943-40f7-821c-b731a874acaa service nova] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Refreshing instance network info cache due to event network-changed-d9ced81c-77d5-4b25-a984-054f5dd0a4ac. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:11:00.922771 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-be48fea7-5abd-4ddf-8a08-f87375cdb6e3 req-e21ffb46-1943-40f7-821c-b731a874acaa service nova] Acquiring lock "refresh_cache-b51e6cdd-7556-41bf-ab93-24495d4e3d03" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:11:00.922920 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-be48fea7-5abd-4ddf-8a08-f87375cdb6e3 req-e21ffb46-1943-40f7-821c-b731a874acaa service nova] Acquired lock "refresh_cache-b51e6cdd-7556-41bf-ab93-24495d4e3d03" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:11:00.923094 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-be48fea7-5abd-4ddf-8a08-f87375cdb6e3 req-e21ffb46-1943-40f7-821c-b731a874acaa service nova] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Refreshing network info cache for port d9ced81c-77d5-4b25-a984-054f5dd0a4ac {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:11:00.989411 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f42f06fc-5b0c-4973-98db-cd594815f317/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:11:00.994525 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:11:00.996723 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:11:01.048735 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "env LANG=C uptime" returned: 0 in 0.052s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:11:01.049234 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Hypervisor/Node resource view: name=np0000001613 free_ram=12502MB free_disk=72.63570785522461GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 10:11:01.049452 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:01.049612 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:01.104581 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Acquiring lock "60cce3b4-1065-4568-9777-9b78ee43a55b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:01.104773 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "60cce3b4-1065-4568-9777-9b78ee43a55b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:01.243024 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:01.273713 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:01.340834 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:11:01.350097 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963061.3496413, b4c26c83-b122-4b4a-a517-1701b23caf03 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:11:01.350267 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] VM Resumed (Lifecycle Event)
May 28 10:11:01.433221 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-be48fea7-5abd-4ddf-8a08-f87375cdb6e3 req-e21ffb46-1943-40f7-821c-b731a874acaa service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:01.437460 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Updating instance_info_cache with network_info: [{"id": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "address": "fa:16:3e:5c:9e:66", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb80648-bd", "ovs_interfaceid": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:11:01.605750 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:01.608026 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:11:01.803785 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Updating instance_info_cache with network_info: [{"id": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "address": "fa:16:3e:83:3c:7d", "network": {"id": "db344666-4990-47d9-a3a2-9bebce64e660", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1492927350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44f9e47b0cb84ec9a96e9ee54854c98d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e2cc51-3e", "ovs_interfaceid": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:11:01.824721 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-be48fea7-5abd-4ddf-8a08-f87375cdb6e3 req-e21ffb46-1943-40f7-821c-b731a874acaa service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:01.853003 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:11:01.855637 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:11:01.927809 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d0b202f8-83ce-4ba3-b98d-938c898a1fa1 req-b84e49cd-07ae-4aed-aae1-e1067657e4be service nova] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Received event network-changed-a00c63db-98a2-46e6-ac78-c54d73edf1e8 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:11:01.927809 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d0b202f8-83ce-4ba3-b98d-938c898a1fa1 req-b84e49cd-07ae-4aed-aae1-e1067657e4be service nova] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Refreshing instance network info cache due to event network-changed-a00c63db-98a2-46e6-ac78-c54d73edf1e8. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:11:01.927809 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d0b202f8-83ce-4ba3-b98d-938c898a1fa1 req-b84e49cd-07ae-4aed-aae1-e1067657e4be service nova] Acquiring lock "refresh_cache-b4c26c83-b122-4b4a-a517-1701b23caf03" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:11:01.927966 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d0b202f8-83ce-4ba3-b98d-938c898a1fa1 req-b84e49cd-07ae-4aed-aae1-e1067657e4be service nova] Acquired lock "refresh_cache-b4c26c83-b122-4b4a-a517-1701b23caf03" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:11:01.928113 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-d0b202f8-83ce-4ba3-b98d-938c898a1fa1 req-b84e49cd-07ae-4aed-aae1-e1067657e4be service nova] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Refreshing network info cache for port a00c63db-98a2-46e6-ac78-c54d73edf1e8 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:11:01.939981 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Releasing lock "refresh_cache-edd8dcff-3440-445a-b4a2-8c56863e7ca3" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:11:01.940407 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:11:01.953515 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:11:01.970912 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-be48fea7-5abd-4ddf-8a08-f87375cdb6e3 req-e21ffb46-1943-40f7-821c-b731a874acaa service nova] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Updated VIF entry in instance network info cache for port d9ced81c-77d5-4b25-a984-054f5dd0a4ac. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:11:01.971245 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-be48fea7-5abd-4ddf-8a08-f87375cdb6e3 req-e21ffb46-1943-40f7-821c-b731a874acaa service nova] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Updating instance_info_cache with network_info: [{"id": "d9ced81c-77d5-4b25-a984-054f5dd0a4ac", "address": "fa:16:3e:88:d1:c6", "network": {"id": "4638034a-36e0-4524-a643-bd5fb2c5d03a", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1792230061-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "24a7b4447be44babbc8cb7d9d09c1e76", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ced81c-77", "ovs_interfaceid": "d9ced81c-77d5-4b25-a984-054f5dd0a4ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:11:01.978328 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:11:02.023926 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:11:02.024248 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:11:02.032446 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:11:02.033519 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe83:3c7d', 'fe80::e03f:79ff:fe2f:2d97', 'fe80::fc16:3eff:fee7:8ceb', 'fe80::e4eb:4cff:fe5c:5eb7', 'fe80::fc16:3eff:fe88:d1c6', 'fe80::dcfd:9ff:fe70:e322', 'fe80::fc16:3eff:fea2:6ffc', 'fe80::fc16:3eff:fe33:fbde', 'fe80::6807:fff:fe4c:bed3'] 
May 28 10:11:02.033675 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:11:02.033778 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:11:02.033990 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] <== get_connector_properties: return (93ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:11:02.126974 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance f42f06fc-5b0c-4973-98db-cd594815f317 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:11:02.127120 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance c0786416-dec3-4610-9ec2-389aa7508148 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:11:02.127292 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance edd8dcff-3440-445a-b4a2-8c56863e7ca3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:11:02.127409 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:11:02.127526 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance b51e6cdd-7556-41bf-ab93-24495d4e3d03 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:11:02.127642 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance b4c26c83-b122-4b4a-a517-1701b23caf03 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:11:02.183638 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:02.306415 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Releasing lock "refresh_cache-c0786416-dec3-4610-9ec2-389aa7508148" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:11:02.430855 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-d0b202f8-83ce-4ba3-b98d-938c898a1fa1 req-b84e49cd-07ae-4aed-aae1-e1067657e4be service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:02.473702 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-be48fea7-5abd-4ddf-8a08-f87375cdb6e3 req-e21ffb46-1943-40f7-821c-b731a874acaa service nova] Releasing lock "refresh_cache-b51e6cdd-7556-41bf-ab93-24495d4e3d03" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:11:02.630290 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 60cce3b4-1065-4568-9777-9b78ee43a55b has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 28 10:11:02.630598 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 10:11:02.630834 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Final resource view: name=np0000001613 phys_ram=24030MB used_ram=1664MB phys_disk=95GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 10:11:01 up 43 min,  2 users,  load average: 7.21, 7.32, 5.23\n', 'num_instances': '6', 'num_vm_resized': '1', 'num_task_resize_reverting': '1', 'num_os_type_None': '6', 'num_proj_c7563a83d33d4bc1a6610ccf53c18dc1': '1', 'io_workload': '0', 'num_vm_active': '5', 'num_task_None': '4', 'num_proj_ba63ea134a6e4fe1992f53a0da46d034': '2', 'num_task_rebooting_hard': '1', 'num_proj_44f9e47b0cb84ec9a96e9ee54854c98d': '1', 'num_proj_23e9651268114327a9cc6c6c59bef01e': '1', 'num_proj_24a7b4447be44babbc8cb7d9d09c1e76': '1'} {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 10:11:02.752496 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-d0b202f8-83ce-4ba3-b98d-938c898a1fa1 req-b84e49cd-07ae-4aed-aae1-e1067657e4be service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:02.812311 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:11:02.894763 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-d0b202f8-83ce-4ba3-b98d-938c898a1fa1 req-b84e49cd-07ae-4aed-aae1-e1067657e4be service nova] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Updated VIF entry in instance network info cache for port a00c63db-98a2-46e6-ac78-c54d73edf1e8. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:11:02.895102 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-d0b202f8-83ce-4ba3-b98d-938c898a1fa1 req-b84e49cd-07ae-4aed-aae1-e1067657e4be service nova] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Updating instance_info_cache with network_info: [{"id": "a00c63db-98a2-46e6-ac78-c54d73edf1e8", "address": "fa:16:3e:a2:6f:fc", "network": {"id": "233ff488-7baf-4369-9054-b24499b82bab", "bridge": "br-int", "label": "tempest-TestStampPattern-854727558-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba63ea134a6e4fe1992f53a0da46d034", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00c63db-98", "ovs_interfaceid": "a00c63db-98a2-46e6-ac78-c54d73edf1e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:11:02.981354 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3a65edf6-0e8e-4841-95aa-b4531775d8bb req-9be2d8d5-4205-4624-8e73-1765f31d1eb6 service nova] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Received event network-changed-d9ced81c-77d5-4b25-a984-054f5dd0a4ac {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:11:02.981499 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3a65edf6-0e8e-4841-95aa-b4531775d8bb req-9be2d8d5-4205-4624-8e73-1765f31d1eb6 service nova] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Refreshing instance network info cache due to event network-changed-d9ced81c-77d5-4b25-a984-054f5dd0a4ac. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:11:02.981647 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3a65edf6-0e8e-4841-95aa-b4531775d8bb req-9be2d8d5-4205-4624-8e73-1765f31d1eb6 service nova] Acquiring lock "refresh_cache-b51e6cdd-7556-41bf-ab93-24495d4e3d03" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:11:02.981723 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3a65edf6-0e8e-4841-95aa-b4531775d8bb req-9be2d8d5-4205-4624-8e73-1765f31d1eb6 service nova] Acquired lock "refresh_cache-b51e6cdd-7556-41bf-ab93-24495d4e3d03" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:11:02.981833 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-3a65edf6-0e8e-4841-95aa-b4531775d8bb req-9be2d8d5-4205-4624-8e73-1765f31d1eb6 service nova] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Refreshing network info cache for port d9ced81c-77d5-4b25-a984-054f5dd0a4ac {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:11:03.003917 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:11:03.004106 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:11:03.111531 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Starting finish_revert_migration {{(pid=98321) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12932}}
May 28 10:11:03.124657 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Start _get_guest_xml network_info=[{"id": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "address": "fa:16:3e:5c:9e:66", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb80648-bd", "ovs_interfaceid": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ddb1344-a4d2-4480-9818-32c65d8ad963', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'edd8dcff-3440-445a-b4a2-8c56863e7ca3', 'attached_at': '2026-05-28T10:11:02.000000', 'detached_at': '', 'volume_id': '1ddb1344-a4d2-4480-9818-32c65d8ad963', 'serial': '1ddb1344-a4d2-4480-9818-32c65d8ad963'}, 'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': '94369622-ca9c-415f-87f1-b1219ba6068d', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:11:03.126532 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:11:03.127528 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1080199311', uuid='edd8dcff-3440-445a-b4a2-8c56863e7ca3'), owner=OwnerMeta(userid='961948be669c4a18a29398d53015f03b', username='tempest-TestEncryptedCinderVolumes-297752033-project-member', projectid='c7563a83d33d4bc1a6610ccf53c18dc1', projectname='tempest-TestEncryptedCinderVolumes-297752033'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "address": "fa:16:3e:5c:9e:66", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb80648-bd", "ovs_interfaceid": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779963063.1272025) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:11:03.128596 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:11:03.128952 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:11:03.129968 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:11:03.130152 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:11:03.131152 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:11:03.131501 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:11:03.131680 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:11:03.131797 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:11:03.131947 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:11:03.132072 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:11:03.132194 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:11:03.132390 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:11:03.132518 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:11:03.132660 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:11:03.132790 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:11:03.132943 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:11:03.133112 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lazy-loading 'vcpu_model' on Instance uuid edd8dcff-3440-445a-b4a2-8c56863e7ca3 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:11:03.396838 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d0b202f8-83ce-4ba3-b98d-938c898a1fa1 req-b84e49cd-07ae-4aed-aae1-e1067657e4be service nova] Releasing lock "refresh_cache-b4c26c83-b122-4b4a-a517-1701b23caf03" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:11:03.484739 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-3a65edf6-0e8e-4841-95aa-b4531775d8bb req-9be2d8d5-4205-4624-8e73-1765f31d1eb6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:03.506780 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:11:03.646581 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk.config --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:11:03.745995 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk.config --force-share --output=json" returned: 0 in 0.099s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:11:03.746614 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "/opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:03.746947 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "/opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:03.747719 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "/opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:03.748237 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:11:03.748736 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ddb1344-a4d2-4480-9818-32c65d8ad963', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:11:03.748937 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:11:03.749373 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:11:03.749685 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ddb1344-a4d2-4480-9818-32c65d8ad963', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:11:03.762159 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:11:03.762811 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:11:03.763443 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:11:03.763725 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:11:03.767005 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:11:03.767215 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:11:03.778510 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:11:03.778510 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:03.780803 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:11:03.780803 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:03.794516 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963] added
May 28 10:11:03.794516 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:11:03.794516 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:11:03.794516 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:11:03.794516 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:11:03.794516 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:11:03.794516 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:03.794879 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:11:03.795087 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0313(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:11:03.795353 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:11:03.796719 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963] added
May 28 10:11:03.796719 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:11:03.796719 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:11:03.796719 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:11:03.796719 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:11:03.796719 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:11:03.796719 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:03.796914 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:11:03.797013 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0298(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:11:03.797141 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:11:03.880529 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:03.885246 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-3a65edf6-0e8e-4841-95aa-b4531775d8bb req-9be2d8d5-4205-4624-8e73-1765f31d1eb6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:03.887424 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:03.907270 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:03.925614 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:03.946118 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:03.952897 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:04.013487 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Compute_service record updated for np0000001613:np0000001613 {{(pid=98321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 10:11:04.013710 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.964s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:04.014005 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.831s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:04.015506 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:11:04.025559 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:11:04.025702 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Claim successful on node np0000001613
May 28 10:11:04.065975 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-3a65edf6-0e8e-4841-95aa-b4531775d8bb req-9be2d8d5-4205-4624-8e73-1765f31d1eb6 service nova] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Updated VIF entry in instance network info cache for port d9ced81c-77d5-4b25-a984-054f5dd0a4ac. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:11:04.066855 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-3a65edf6-0e8e-4841-95aa-b4531775d8bb req-9be2d8d5-4205-4624-8e73-1765f31d1eb6 service nova] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Updating instance_info_cache with network_info: [{"id": "d9ced81c-77d5-4b25-a984-054f5dd0a4ac", "address": "fa:16:3e:88:d1:c6", "network": {"id": "4638034a-36e0-4524-a643-bd5fb2c5d03a", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1792230061-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "24a7b4447be44babbc8cb7d9d09c1e76", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ced81c-77", "ovs_interfaceid": "d9ced81c-77d5-4b25-a984-054f5dd0a4ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:11:04.074310 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-73499cdc-0146-4464-bb80-4a8b4418fcda req-bd9524c6-3362-4d38-8f44-c71e09af2ee2 service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Received event network-vif-unplugged-19e2cc51-3e82-46f4-8d06-7406f2f72300 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:11:04.074310 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-73499cdc-0146-4464-bb80-4a8b4418fcda req-bd9524c6-3362-4d38-8f44-c71e09af2ee2 service nova] Acquiring lock "c0786416-dec3-4610-9ec2-389aa7508148-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:04.074310 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-73499cdc-0146-4464-bb80-4a8b4418fcda req-bd9524c6-3362-4d38-8f44-c71e09af2ee2 service nova] Lock "c0786416-dec3-4610-9ec2-389aa7508148-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:04.074310 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-73499cdc-0146-4464-bb80-4a8b4418fcda req-bd9524c6-3362-4d38-8f44-c71e09af2ee2 service nova] Lock "c0786416-dec3-4610-9ec2-389aa7508148-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:04.074310 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-73499cdc-0146-4464-bb80-4a8b4418fcda req-bd9524c6-3362-4d38-8f44-c71e09af2ee2 service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] No waiting events found dispatching network-vif-unplugged-19e2cc51-3e82-46f4-8d06-7406f2f72300 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:11:04.074310 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-73499cdc-0146-4464-bb80-4a8b4418fcda req-bd9524c6-3362-4d38-8f44-c71e09af2ee2 service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Received unexpected event network-vif-unplugged-19e2cc51-3e82-46f4-8d06-7406f2f72300 for instance with vm_state active and task_state reboot_started_hard.
May 28 10:11:04.177546 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999641383999915 future=<Future at 0x73c1fc15d5b0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:11:04.179545 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Instance destroyed successfully.
May 28 10:11:04.179690 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lazy-loading 'resources' on Instance uuid c0786416-dec3-4610-9ec2-389aa7508148 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:11:04.571884 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3a65edf6-0e8e-4841-95aa-b4531775d8bb req-9be2d8d5-4205-4624-8e73-1765f31d1eb6 service nova] Releasing lock "refresh_cache-b51e6cdd-7556-41bf-ab93-24495d4e3d03" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:11:04.572060 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3a65edf6-0e8e-4841-95aa-b4531775d8bb req-9be2d8d5-4205-4624-8e73-1765f31d1eb6 service nova] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Received event network-changed-d9ced81c-77d5-4b25-a984-054f5dd0a4ac {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:11:04.572477 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3a65edf6-0e8e-4841-95aa-b4531775d8bb req-9be2d8d5-4205-4624-8e73-1765f31d1eb6 service nova] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Refreshing instance network info cache due to event network-changed-d9ced81c-77d5-4b25-a984-054f5dd0a4ac. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:11:04.572477 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3a65edf6-0e8e-4841-95aa-b4531775d8bb req-9be2d8d5-4205-4624-8e73-1765f31d1eb6 service nova] Acquiring lock "refresh_cache-b51e6cdd-7556-41bf-ab93-24495d4e3d03" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:11:04.572477 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3a65edf6-0e8e-4841-95aa-b4531775d8bb req-9be2d8d5-4205-4624-8e73-1765f31d1eb6 service nova] Acquired lock "refresh_cache-b51e6cdd-7556-41bf-ab93-24495d4e3d03" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:11:04.572621 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-3a65edf6-0e8e-4841-95aa-b4531775d8bb req-9be2d8d5-4205-4624-8e73-1765f31d1eb6 service nova] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Refreshing network info cache for port d9ced81c-77d5-4b25-a984-054f5dd0a4ac {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:11:04.682234 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:10:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1785992036',display_name='tempest-TestMinimumBasicScenario-server-1785992036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testminimumbasicscenario-server-1785992036',id=59,image_ref='63b9de52-b76c-44d7-9e19-2bbc39bd37e6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLiX2kC72bgYbEtDTMsYzL9SD3voo9GX+cDAL0WmMYth6F/EEwHtRxRiF7vbmxiGKhT5mQtsmFOUJpBjXEXu5cbRVXGqFCdGspdUukikdpy3iovlWAZ00U6u/U2VnwRLtQ==',key_name='tempest-TestMinimumBasicScenario-1728575637',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:10:21Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44f9e47b0cb84ec9a96e9ee54854c98d',ramdisk_id='',reservation_id='r-8k0nmdmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='63b9de52-b76c-44d7-9e19-2bbc39bd37e6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-63484617',owner_user_name='tempest-TestMinimumBasicScenario-63484617-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:11:03Z,user_data=None,user_id='4631f2d316394d08825f7c3295412feb',uuid=c0786416-dec3-4610-9ec2-389aa7508148,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "address": "fa:16:3e:83:3c:7d", "network": {"id": "db344666-4990-47d9-a3a2-9bebce64e660", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1492927350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44f9e47b0cb84ec9a96e9ee54854c98d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e2cc51-3e", "ovs_interfaceid": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:11:04.682451 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Converting VIF {"id": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "address": "fa:16:3e:83:3c:7d", "network": {"id": "db344666-4990-47d9-a3a2-9bebce64e660", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1492927350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44f9e47b0cb84ec9a96e9ee54854c98d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e2cc51-3e", "ovs_interfaceid": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:11:04.683206 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:3c:7d,bridge_name='br-int',has_traffic_filtering=True,id=19e2cc51-3e82-46f4-8d06-7406f2f72300,network=Network(db344666-4990-47d9-a3a2-9bebce64e660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19e2cc51-3e') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:11:04.684070 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:3c:7d,bridge_name='br-int',has_traffic_filtering=True,id=19e2cc51-3e82-46f4-8d06-7406f2f72300,network=Network(db344666-4990-47d9-a3a2-9bebce64e660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19e2cc51-3e') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:11:04.685809 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:04.686769 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19e2cc51-3e, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:11:04.688343 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:04.689233 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:11:04.690332 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:04.690664 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c3b803af-e53f-4ed5-9328-975eb510fc24) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:11:04.692031 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:04.692744 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:11:04.695544 np0000001613 nova-compute[98321]: INFO os_vif [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:3c:7d,bridge_name='br-int',has_traffic_filtering=True,id=19e2cc51-3e82-46f4-8d06-7406f2f72300,network=Network(db344666-4990-47d9-a3a2-9bebce64e660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19e2cc51-3e')
May 28 10:11:04.697225 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:11:04.697609 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27d30a68-d569-4696-bcc3-6b1ed57ab61d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:11:04.697745 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:11:04.795739 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:11:04.797414 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:11:04.812427 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:11:04.812427 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:11:04.815174 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:11:04.815174 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:04.826509 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:04.831003 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:04.843995 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:04.843995 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:04.843995 np0000001613 nova-compute[98321]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:04.843995 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:04.843995 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:04.843995 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:04.843995 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:11:04.844268 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsi session list stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:04.844268 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:04.844268 np0000001613 nova-compute[98321]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:04.844268 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:04.844268 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:04.844268 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:04.844268 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:11:04.850191 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:04.850191 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:04.850191 np0000001613 nova-compute[98321]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:04.850191 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:04.850191 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:04.850191 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:04.850191 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:11:04.850437 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsi session list stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:04.850437 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:04.850437 np0000001613 nova-compute[98321]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:04.850437 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:04.850437 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:04.850437 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:04.850437 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:11:04.872122 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:04.894584 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963, portal: 192.168.50.100,3260]
May 28 10:11:04.894584 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963, portal: 192.168.50.100,3260] successful.
May 28 10:11:04.894584 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:04.899503 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963, portal: 192.168.40.100,3260]
May 28 10:11:04.899503 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963, portal: 192.168.40.100,3260] successful.
May 28 10:11:04.899503 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:04.906076 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:04.913427 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:04.923968 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:04.923968 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:04.923968 np0000001613 nova-compute[98321]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:04.923968 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:04.923968 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:04.923968 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:04.923968 np0000001613 nova-compute[98321]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:11:04.923968 np0000001613 nova-compute[98321]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:11:04.923968 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:11:04.924217 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsi session list stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:04.924217 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:04.924217 np0000001613 nova-compute[98321]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:04.924217 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:04.924217 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:04.924217 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:04.924217 np0000001613 nova-compute[98321]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:11:04.924217 np0000001613 nova-compute[98321]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:11:04.924217 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:11:04.924382 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:11:04.924457 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:11:04.925359 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] HCTL ('9', '-', '-', 0) found on session 157 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:11:04.928283 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:11:04.933626 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:04.933626 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:04.933626 np0000001613 nova-compute[98321]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:04.933626 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:04.933626 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:04.933626 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:04.933626 np0000001613 nova-compute[98321]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:11:04.933626 np0000001613 nova-compute[98321]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:11:04.933626 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:11:04.933940 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsi session list stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:04.933940 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:04.933940 np0000001613 nova-compute[98321]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:04.933940 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:04.933940 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:04.933940 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:04.933940 np0000001613 nova-compute[98321]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:11:04.933940 np0000001613 nova-compute[98321]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:11:04.933940 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:11:04.934091 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.171s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:11:04.938295 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:11:04.939424 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] HCTL ('10', '-', '-', 0) found on session 158 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:11:04.939562 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:11:04.954662 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Searching for a device in session 157 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:11:04.954662 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '1ddb1344-a4d2-4480-9818-32c65d8ad963', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:11:04.960920 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Searching for a device in session 158 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:11:04.961132 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ddb1344-a4d2-4480-9818-32c65d8ad963', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:11:05.015487 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:11:05.015801 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:11:05.016066 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.77 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:11:05.075769 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-3a65edf6-0e8e-4841-95aa-b4531775d8bb req-9be2d8d5-4205-4624-8e73-1765f31d1eb6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:05.473965 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:11:05.474232 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:11:05.478980 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-3a65edf6-0e8e-4841-95aa-b4531775d8bb req-9be2d8d5-4205-4624-8e73-1765f31d1eb6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:05.622373 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-3a65edf6-0e8e-4841-95aa-b4531775d8bb req-9be2d8d5-4205-4624-8e73-1765f31d1eb6 service nova] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Updated VIF entry in instance network info cache for port d9ced81c-77d5-4b25-a984-054f5dd0a4ac. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:11:05.622754 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-3a65edf6-0e8e-4841-95aa-b4531775d8bb req-9be2d8d5-4205-4624-8e73-1765f31d1eb6 service nova] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Updating instance_info_cache with network_info: [{"id": "d9ced81c-77d5-4b25-a984-054f5dd0a4ac", "address": "fa:16:3e:88:d1:c6", "network": {"id": "4638034a-36e0-4524-a643-bd5fb2c5d03a", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1792230061-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "24a7b4447be44babbc8cb7d9d09c1e76", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ced81c-77", "ovs_interfaceid": "d9ced81c-77d5-4b25-a984-054f5dd0a4ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:11:05.764180 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:11:05.981795 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:11:06.124955 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3a65edf6-0e8e-4841-95aa-b4531775d8bb req-9be2d8d5-4205-4624-8e73-1765f31d1eb6 service nova] Releasing lock "refresh_cache-b51e6cdd-7556-41bf-ab93-24495d4e3d03" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:11:06.147237 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-62589692-cc2f-4220-b6b7-2d2339aa3e16 req-79f309ee-cdea-45ba-acb9-1c5269393898 service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Received event network-vif-unplugged-19e2cc51-3e82-46f4-8d06-7406f2f72300 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:11:06.147391 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-62589692-cc2f-4220-b6b7-2d2339aa3e16 req-79f309ee-cdea-45ba-acb9-1c5269393898 service nova] Acquiring lock "c0786416-dec3-4610-9ec2-389aa7508148-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:06.147801 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-62589692-cc2f-4220-b6b7-2d2339aa3e16 req-79f309ee-cdea-45ba-acb9-1c5269393898 service nova] Lock "c0786416-dec3-4610-9ec2-389aa7508148-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:06.147928 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-62589692-cc2f-4220-b6b7-2d2339aa3e16 req-79f309ee-cdea-45ba-acb9-1c5269393898 service nova] Lock "c0786416-dec3-4610-9ec2-389aa7508148-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:06.148041 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-62589692-cc2f-4220-b6b7-2d2339aa3e16 req-79f309ee-cdea-45ba-acb9-1c5269393898 service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] No waiting events found dispatching network-vif-unplugged-19e2cc51-3e82-46f4-8d06-7406f2f72300 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:11:06.148147 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-62589692-cc2f-4220-b6b7-2d2339aa3e16 req-79f309ee-cdea-45ba-acb9-1c5269393898 service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Received unexpected event network-vif-unplugged-19e2cc51-3e82-46f4-8d06-7406f2f72300 for instance with vm_state active and task_state reboot_started_hard.
May 28 10:11:06.488733 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.475s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:06.489107 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:11:06.786959 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Found WWN 330000000e79767bf for multipath device dm-4 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:11:06.786959 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:11:06.787785 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.090s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:11:06.788564 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:11:06.788734 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27d30a68-d569-4696-bcc3-6b1ed57ab61d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:11:06.788942 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:11:06.789460 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '330000000e79767bf', 'path': '/dev/disk/by-id/os-brick+dev+dm-4', 'multipath_id': '330000000e79767bf'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:11:06.789645 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e79767bf', 'path': '/dev/disk/by-id/os-brick+dev+dm-4', 'multipath_id': '330000000e79767bf'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:11:06.790847 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:11:06.822592 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:06.822592 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:06.822592 np0000001613 nova-compute[98321]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:06.822592 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:06.822592 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:06.822592 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:06.822592 np0000001613 nova-compute[98321]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:11:06.822592 np0000001613 nova-compute[98321]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:11:06.822592 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:11:06.822592 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsi session list stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:06.822592 np0000001613 nova-compute[98321]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:06.822592 np0000001613 nova-compute[98321]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:06.822592 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:06.822592 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:06.822592 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:06.822592 np0000001613 nova-compute[98321]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:11:06.822592 np0000001613 nova-compute[98321]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:11:06.822592 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:11:06.822592 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', '148'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', '149'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623', '150'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623', '151'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d', '155'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d', '156'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', '157'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', '158')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:11:06.823184 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', '148')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:11:06.824042 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', '149')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:11:06.826001 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1f4750180>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d'): ({'sdh'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:11:06.826001 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Removing multipathed devices sdh, sdi {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:11:06.826001 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Flush multipath device 330000000e1557434 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:11:06.827768 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ddb1344-a4d2-4480-9818-32c65d8ad963', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, 'status': 'attaching', 'instance': 'edd8dcff-3440-445a-b4a2-8c56863e7ca3', 'attached_at': '2026-05-28T10:11:02.000000', 'detached_at': '', 'volume_id': '1ddb1344-a4d2-4480-9818-32c65d8ad963', 'serial': '1ddb1344-a4d2-4480-9818-32c65d8ad963'} {{(pid=98321) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 10:11:06.828453 np0000001613 nova-compute[98321]: WARNING stevedore.named [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 10:11:06.828782 np0000001613 nova-compute[98321]: WARNING castellan.key_manager [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 10:11:06.829031 np0000001613 nova-compute[98321]: WARNING nova.keymgr.conf_key_mgr [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 10:11:06.849744 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 10:11:06.849744 np0000001613 nova-compute[98321]:   <usage type="volume">
May 28 10:11:06.849744 np0000001613 nova-compute[98321]:     <volume>1ddb1344-a4d2-4480-9818-32c65d8ad963</volume>
May 28 10:11:06.849744 np0000001613 nova-compute[98321]:   </usage>
May 28 10:11:06.849744 np0000001613 nova-compute[98321]: </secret>
May 28 10:11:06.849744 np0000001613 nova-compute[98321]:  {{(pid=98321) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 10:11:06.861968 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:11:06.899156 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:11:06.955611 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:11:06.955784 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:11:06.957002 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:11:06.967624 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:11:06.967847 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:11:06.980973 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:06.994339 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:11:06.994764 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:11:06.995051 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:06.995296 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:07.020536 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 148, target: iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d, portal: 192.168.40.100,3260]
May 28 10:11:07.020536 np0000001613 nova-compute[98321]: Logout of [sid: 148, target: iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d, portal: 192.168.40.100,3260] successful.
May 28 10:11:07.020536 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:07.041187 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:07.052728 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:07.074420 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f734f16600ef4cb88fdf7e170dd7f3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bbdf692768465db607aa60a630e5e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:11:07.095680 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 149, target: iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d, portal: 192.168.50.100,3260]
May 28 10:11:07.095680 np0000001613 nova-compute[98321]: Logout of [sid: 149, target: iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d, portal: 192.168.50.100,3260] successful.
May 28 10:11:07.095680 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:07.116105 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:07.116408 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:11:07.116577 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] <== disconnect_volume: return (2418ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:11:07.116755 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:11:07.122602 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Start _get_guest_xml network_info=[{"id": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "address": "fa:16:3e:83:3c:7d", "network": {"id": "db344666-4990-47d9-a3a2-9bebce64e660", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1492927350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44f9e47b0cb84ec9a96e9ee54854c98d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e2cc51-3e", "ovs_interfaceid": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=63b9de52-b76c-44d7-9e19-2bbc39bd37e6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': '63b9de52-b76c-44d7-9e19-2bbc39bd37e6'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27d30a68-d569-4696-bcc3-6b1ed57ab61d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, 'status': 'reserved', 'instance': 'c0786416-dec3-4610-9ec2-389aa7508148', 'attached_at': '', 'detached_at': '', 'volume_id': '27d30a68-d569-4696-bcc3-6b1ed57ab61d', 'serial': '27d30a68-d569-4696-bcc3-6b1ed57ab61d'}, 'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': '3c531e05-69cc-4ee7-8ce0-d956ae0859de', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:11:07.126047 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:11:07.127447 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='63b9de52-b76c-44d7-9e19-2bbc39bd37e6', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-1785992036', uuid='c0786416-dec3-4610-9ec2-389aa7508148'), owner=OwnerMeta(userid='4631f2d316394d08825f7c3295412feb', username='tempest-TestMinimumBasicScenario-63484617-project-member', projectid='44f9e47b0cb84ec9a96e9ee54854c98d', projectname='tempest-TestMinimumBasicScenario-63484617'), image=ImageMeta(id='63b9de52-b76c-44d7-9e19-2bbc39bd37e6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "address": "fa:16:3e:83:3c:7d", "network": {"id": "db344666-4990-47d9-a3a2-9bebce64e660", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1492927350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44f9e47b0cb84ec9a96e9ee54854c98d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e2cc51-3e", "ovs_interfaceid": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779963067.1270456) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:11:07.128705 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:11:07.129046 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:11:07.131246 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:11:07.131456 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:11:07.132496 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:11:07.132795 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=63b9de52-b76c-44d7-9e19-2bbc39bd37e6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:11:07.132980 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:11:07.133113 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:11:07.133333 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:11:07.133458 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:11:07.133603 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:11:07.133805 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:11:07.133949 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:11:07.134132 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:11:07.139205 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:11:07.139478 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:11:07.139691 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lazy-loading 'vcpu_model' on Instance uuid c0786416-dec3-4610-9ec2-389aa7508148 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:11:07.362732 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:09:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1080199311',display_name='tempest-TestEncryptedCinderVolumes-server-1080199311',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testencryptedcindervolumes-server-1080199311',id=55,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPEA8+uxSyCsgS6j+focPk4QpOVZVeAFK2kV4ErBJfCH5RkIc3vXvdGbsr44pZ3e0kq61KVrhwaHdQPmC2IB37UUcRSn+zMS1bh2okKRJrj9i8mJQASjzRzDfrAxUyWcQ==',key_name='tempest-keypair-831862139',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:10:48Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(13),node='np0000001613',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c7563a83d33d4bc1a6610ccf53c18dc1',ramdisk_id='',reservation_id='r-34tgbqip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-297752033',owner_user_name='tempest-TestEncryptedCinderVolumes-297752033-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:10:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='961948be669c4a18a29398d53015f03b',uuid=edd8dcff-3440-445a-b4a2-8c56863e7ca3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "address": "fa:16:3e:5c:9e:66", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb80648-bd", "ovs_interfaceid": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:11:07.362732 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Converting VIF {"id": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "address": "fa:16:3e:5c:9e:66", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb80648-bd", "ovs_interfaceid": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:11:07.362732 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:9e:66,bridge_name='br-int',has_traffic_filtering=True,id=6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb80648-bd') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:11:07.365668 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] End _get_guest_xml xml=<domain type="qemu">
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:   <uuid>edd8dcff-3440-445a-b4a2-8c56863e7ca3</uuid>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:   <name>instance-00000037</name>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1080199311</nova:name>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:11:03</nova:creationTime>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:         <nova:user uuid="961948be669c4a18a29398d53015f03b">tempest-TestEncryptedCinderVolumes-297752033-project-member</nova:user>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:         <nova:project uuid="c7563a83d33d4bc1a6610ccf53c18dc1">tempest-TestEncryptedCinderVolumes-297752033</nova:project>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:         <nova:port uuid="6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc">
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:     <system>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:       <entry name="serial">edd8dcff-3440-445a-b4a2-8c56863e7ca3</entry>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:       <entry name="uuid">edd8dcff-3440-445a-b4a2-8c56863e7ca3</entry>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:     </system>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:   <os>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:   </os>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:   <features>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:   </features>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:   <devices>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk"/>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:     </disk>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/disk.config"/>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:     </disk>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:       <alias name="ua-1ddb1344-a4d2-4480-9818-32c65d8ad963"/>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-4"/>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:       <target dev="vdb" bus="virtio"/>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:       <serial>1ddb1344-a4d2-4480-9818-32c65d8ad963</serial>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:       <encryption format="luks">
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:         <secret type="passphrase" uuid="16044a1b-1201-4710-b120-ca830a2aef23"/>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:       </encryption>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:     </disk>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:5c:9e:66"/>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:       <target dev="tap6eb80648-bd"/>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:     </interface>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3/console.log" append="off"/>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:     </serial>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:     <video>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:     </video>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:     </rng>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:   </devices>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]: </domain>
May 28 10:11:07.365668 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:11:07.365668 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Preparing to wait for external event network-vif-plugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:11:07.365668 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:07.365668 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:07.365668 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:07.372762 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:09:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1080199311',display_name='tempest-TestEncryptedCinderVolumes-server-1080199311',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testencryptedcindervolumes-server-1080199311',id=55,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPEA8+uxSyCsgS6j+focPk4QpOVZVeAFK2kV4ErBJfCH5RkIc3vXvdGbsr44pZ3e0kq61KVrhwaHdQPmC2IB37UUcRSn+zMS1bh2okKRJrj9i8mJQASjzRzDfrAxUyWcQ==',key_name='tempest-keypair-831862139',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:10:48Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(13),node='np0000001613',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c7563a83d33d4bc1a6610ccf53c18dc1',ramdisk_id='',reservation_id='r-34tgbqip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-297752033',owner_user_name='tempest-TestEncryptedCinderVolumes-297752033-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:10:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='961948be669c4a18a29398d53015f03b',uuid=edd8dcff-3440-445a-b4a2-8c56863e7ca3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "address": "fa:16:3e:5c:9e:66", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb80648-bd", "ovs_interfaceid": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:11:07.372762 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Converting VIF {"id": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "address": "fa:16:3e:5c:9e:66", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb80648-bd", "ovs_interfaceid": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:11:07.372762 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:9e:66,bridge_name='br-int',has_traffic_filtering=True,id=6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb80648-bd') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:11:07.372762 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:9e:66,bridge_name='br-int',has_traffic_filtering=True,id=6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb80648-bd') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:11:07.372762 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:07.373515 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:11:07.373515 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:11:07.376592 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:07.376956 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4e5d4490-3b21-57fb-832b-c708b9cf403f', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:11:07.378183 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:07.379229 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:11:07.439765 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:07.441067 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:07.444619 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:07.444879 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6eb80648-bd, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:11:07.445386 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6eb80648-bd, col_values=(('qos', UUID('97f84b79-09a1-45b8-ab84-6faed75d5bb7')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:11:07.446007 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6eb80648-bd, col_values=(('external_ids', {'iface-id': '6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:9e:66', 'vm-uuid': 'edd8dcff-3440-445a-b4a2-8c56863e7ca3'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:11:07.449874 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:07.451307 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:11:07.459383 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:07.460401 np0000001613 nova-compute[98321]: INFO os_vif [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:9e:66,bridge_name='br-int',has_traffic_filtering=True,id=6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb80648-bd')
May 28 10:11:07.498250 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:11:07.648059 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Object Instance<c0786416-dec3-4610-9ec2-389aa7508148> lazy-loaded attributes: resources,vcpu_model {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:11:07.672067 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148/disk.config --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:11:07.748201 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Successfully created port: cd93d344-29fd-4e3e-aa5a-035b8ddb2118 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:11:07.796308 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148/disk.config --force-share --output=json" returned: 0 in 0.125s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:11:07.798449 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "/opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:07.798720 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "/opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:07.802995 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "/opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:07.803514 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:11:07.804026 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27d30a68-d569-4696-bcc3-6b1ed57ab61d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:11:07.804548 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:11:07.804970 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:11:07.805150 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27d30a68-d569-4696-bcc3-6b1ed57ab61d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:11:07.825257 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:11:07.826240 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:11:07.827038 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:11:07.827558 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:11:07.827646 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:11:07.828319 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:11:07.849997 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:11:07.849997 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:07.855822 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:11:07.855822 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:07.866411 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d] added
May 28 10:11:07.866411 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:11:07.866411 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:11:07.866411 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:11:07.866411 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:11:07.866411 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:11:07.866411 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:07.866701 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:11:07.866926 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0397(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:11:07.867103 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:11:07.871140 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d] added
May 28 10:11:07.871140 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:11:07.871140 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:11:07.871140 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:11:07.871140 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:11:07.871140 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:11:07.871140 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:07.871531 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:11:07.872056 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0441(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:11:07.872445 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:11:08.003005 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:11:08.028056 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:08.058552 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:08.154244 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:08.303105 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-fd4a3322-71f7-4257-835f-b66c49fa79ab req-b8168388-e4ac-44a7-bace-47b6da7cec48 service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Received event network-vif-plugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:11:08.303761 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-fd4a3322-71f7-4257-835f-b66c49fa79ab req-b8168388-e4ac-44a7-bace-47b6da7cec48 service nova] Acquiring lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:08.303921 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0019033609996768064 future=<Future at 0x73c1f4074410 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:11:08.305719 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-fd4a3322-71f7-4257-835f-b66c49fa79ab req-b8168388-e4ac-44a7-bace-47b6da7cec48 service nova] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:08.305956 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] Emitting event <LifecycleEvent: 1779963053.3019044, edd8dcff-3440-445a-b4a2-8c56863e7ca3 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:11:08.306386 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] VM Stopped (Lifecycle Event)
May 28 10:11:08.307708 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-fd4a3322-71f7-4257-835f-b66c49fa79ab req-b8168388-e4ac-44a7-bace-47b6da7cec48 service nova] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:08.308031 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:11:08.308210 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=10.868966746999831 future=<Future at 0x73c1fc15d5b0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:11:08.308608 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-fd4a3322-71f7-4257-835f-b66c49fa79ab req-b8168388-e4ac-44a7-bace-47b6da7cec48 service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Processing event network-vif-plugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:11:08.308796 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=10.868343796999852 future=<Future at 0x73c1fc15d5b0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:11:08.497916 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:08.531910 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:08.809652 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3e920b6c-e63e-4497-9de1-849d6d1efe8c tempest-VolumesNegativeTest-34785860 tempest-VolumesNegativeTest-34785860-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:11:08.867600 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:11:08.873575 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:11:08.885550 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:11:08.885550 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:11:08.897235 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:11:08.897235 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:08.904928 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:08.912922 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:08.925633 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:08.925633 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:08.925633 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:08.925633 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:08.925633 np0000001613 nova-compute[98321]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:11:08.925633 np0000001613 nova-compute[98321]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:11:08.925633 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:11:08.925633 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsi session list stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:08.925633 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:08.925633 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:08.925633 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:08.925633 np0000001613 nova-compute[98321]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:11:08.925633 np0000001613 nova-compute[98321]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:11:08.925633 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:11:08.939897 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:08.939897 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:08.939897 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:08.939897 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:08.939897 np0000001613 nova-compute[98321]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:11:08.939897 np0000001613 nova-compute[98321]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:11:08.939897 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:11:08.940189 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsi session list stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:08.940189 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:08.940189 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:08.940189 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:08.940189 np0000001613 nova-compute[98321]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:11:08.940189 np0000001613 nova-compute[98321]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:11:08.940189 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:11:08.973753 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d, portal: 192.168.50.100,3260]
May 28 10:11:08.973753 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d, portal: 192.168.50.100,3260] successful.
May 28 10:11:08.973753 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:08.988642 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:08.996669 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d, portal: 192.168.40.100,3260]
May 28 10:11:08.996669 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d, portal: 192.168.40.100,3260] successful.
May 28 10:11:08.996669 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:09.009709 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:09.009709 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:09.009709 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:09.009709 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:09.009709 np0000001613 nova-compute[98321]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:11:09.009709 np0000001613 nova-compute[98321]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:11:09.009709 np0000001613 nova-compute[98321]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:09.009709 np0000001613 nova-compute[98321]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:09.009709 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:11:09.009709 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsi session list stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:09.009709 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:09.009709 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:09.009709 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:09.009709 np0000001613 nova-compute[98321]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:11:09.009709 np0000001613 nova-compute[98321]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:11:09.009709 np0000001613 nova-compute[98321]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:09.009709 np0000001613 nova-compute[98321]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:09.009709 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:11:09.009709 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:11:09.009709 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:11:09.011115 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:09.012478 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] HCTL ('11', '-', '-', 0) found on session 159 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:11:09.012478 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:11:09.023257 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:11:09.023257 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:11:09.023712 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Creating image(s)
May 28 10:11:09.024532 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Acquiring lock "/opt/stack/data/nova/instances/60cce3b4-1065-4568-9777-9b78ee43a55b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:09.025428 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "/opt/stack/data/nova/instances/60cce3b4-1065-4568-9777-9b78ee43a55b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:09.026115 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "/opt/stack/data/nova/instances/60cce3b4-1065-4568-9777-9b78ee43a55b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:09.046132 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:11:09.046132 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:11:09.046132 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:11:09.065550 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:09.065550 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:09.065550 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:09.065550 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:09.065550 np0000001613 nova-compute[98321]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:11:09.065550 np0000001613 nova-compute[98321]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:11:09.065550 np0000001613 nova-compute[98321]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:09.065550 np0000001613 nova-compute[98321]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:09.065550 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:11:09.068283 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsi session list stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:09.068283 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:09.068283 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:09.068283 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:09.068283 np0000001613 nova-compute[98321]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:11:09.068283 np0000001613 nova-compute[98321]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:11:09.068283 np0000001613 nova-compute[98321]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:09.068283 np0000001613 nova-compute[98321]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:09.068283 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:11:09.072194 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.243s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:11:09.072194 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:11:09.072194 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Searching for a device in session 159 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:11:09.072194 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '27d30a68-d569-4696-bcc3-6b1ed57ab61d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:11:09.082936 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] HCTL ('13', '-', '-', 0) found on session 160 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:11:09.083084 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:11:09.085056 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Successfully updated port: cd93d344-29fd-4e3e-aa5a-035b8ddb2118 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:11:09.116456 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Searching for a device in session 160 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:11:09.116456 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27d30a68-d569-4696-bcc3-6b1ed57ab61d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:11:09.159868 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.123s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:11:09.160485 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:09.160778 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:09.161536 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:11:09.165402 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:11:09.165754 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:11:09.190104 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-1eddfb77-4549-4e73-a8d5-a631cfa55458 req-23a76ba2-ce68-4e15-9b00-ea37003803ce service nova] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Received event network-changed-cd93d344-29fd-4e3e-aa5a-035b8ddb2118 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:11:09.192505 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-1eddfb77-4549-4e73-a8d5-a631cfa55458 req-23a76ba2-ce68-4e15-9b00-ea37003803ce service nova] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Refreshing instance network info cache due to event network-changed-cd93d344-29fd-4e3e-aa5a-035b8ddb2118. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:11:09.192505 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1eddfb77-4549-4e73-a8d5-a631cfa55458 req-23a76ba2-ce68-4e15-9b00-ea37003803ce service nova] Acquiring lock "refresh_cache-60cce3b4-1065-4568-9777-9b78ee43a55b" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:11:09.196067 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1eddfb77-4549-4e73-a8d5-a631cfa55458 req-23a76ba2-ce68-4e15-9b00-ea37003803ce service nova] Acquired lock "refresh_cache-60cce3b4-1065-4568-9777-9b78ee43a55b" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:11:09.196067 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-1eddfb77-4549-4e73-a8d5-a631cfa55458 req-23a76ba2-ce68-4e15-9b00-ea37003803ce service nova] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Refreshing network info cache for port cd93d344-29fd-4e3e-aa5a-035b8ddb2118 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:11:09.240655 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:11:09.275213 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.109s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:11:09.275598 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/60cce3b4-1065-4568-9777-9b78ee43a55b/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:11:09.341815 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/60cce3b4-1065-4568-9777-9b78ee43a55b/disk 1073741824" returned: 0 in 0.066s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:11:09.343512 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.181s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:09.343512 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:11:09.467759 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.125s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:11:09.468443 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Checking if we can resize image /opt/stack/data/nova/instances/60cce3b4-1065-4568-9777-9b78ee43a55b/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:11:09.468731 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60cce3b4-1065-4568-9777-9b78ee43a55b/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:11:09.594113 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60cce3b4-1065-4568-9777-9b78ee43a55b/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:11:09.594113 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Cannot resize image /opt/stack/data/nova/instances/60cce3b4-1065-4568-9777-9b78ee43a55b/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:11:09.594113 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:11:09.594113 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Ensure instance console log exists: /opt/stack/data/nova/instances/60cce3b4-1065-4568-9777-9b78ee43a55b/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:11:09.594113 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:09.594113 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:09.594113 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:09.594113 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Acquiring lock "refresh_cache-60cce3b4-1065-4568-9777-9b78ee43a55b" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:11:09.665039 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:09.701407 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-1eddfb77-4549-4e73-a8d5-a631cfa55458 req-23a76ba2-ce68-4e15-9b00-ea37003803ce service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:09.772300 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-1eddfb77-4549-4e73-a8d5-a631cfa55458 req-23a76ba2-ce68-4e15-9b00-ea37003803ce service nova] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:11:09.827192 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:11:09.872919 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:09.975256 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-1eddfb77-4549-4e73-a8d5-a631cfa55458 req-23a76ba2-ce68-4e15-9b00-ea37003803ce service nova] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:11:09.990902 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963069.99056, edd8dcff-3440-445a-b4a2-8c56863e7ca3 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:11:09.991089 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] VM Started (Lifecycle Event)
May 28 10:11:09.995991 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:11:10.007017 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Instance running successfully.
May 28 10:11:10.007920 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] finish_revert_migration finished successfully. {{(pid=98321) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12978}}
May 28 10:11:10.357897 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-94bcf483-b626-4fd2-9b8c-26d7344a20d1 req-708f2d56-e9c6-4e4e-987a-dfb7baf91d7d service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Received event network-vif-plugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:11:10.358308 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-94bcf483-b626-4fd2-9b8c-26d7344a20d1 req-708f2d56-e9c6-4e4e-987a-dfb7baf91d7d service nova] Acquiring lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:10.358769 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-94bcf483-b626-4fd2-9b8c-26d7344a20d1 req-708f2d56-e9c6-4e4e-987a-dfb7baf91d7d service nova] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:10.358945 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-94bcf483-b626-4fd2-9b8c-26d7344a20d1 req-708f2d56-e9c6-4e4e-987a-dfb7baf91d7d service nova] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:10.361954 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-94bcf483-b626-4fd2-9b8c-26d7344a20d1 req-708f2d56-e9c6-4e4e-987a-dfb7baf91d7d service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] No waiting events found dispatching network-vif-plugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:11:10.362121 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-94bcf483-b626-4fd2-9b8c-26d7344a20d1 req-708f2d56-e9c6-4e4e-987a-dfb7baf91d7d service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Received unexpected event network-vif-plugged-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc for instance with vm_state resized and task_state resize_reverting.
May 28 10:11:10.477743 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1eddfb77-4549-4e73-a8d5-a631cfa55458 req-23a76ba2-ce68-4e15-9b00-ea37003803ce service nova] Releasing lock "refresh_cache-60cce3b4-1065-4568-9777-9b78ee43a55b" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:11:10.478410 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Acquired lock "refresh_cache-60cce3b4-1065-4568-9777-9b78ee43a55b" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:11:10.478608 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:11:10.497505 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:11:10.501103 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:11:10.849577 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Found WWN 330000000e1557434 for multipath device dm-2 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:11:10.849577 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.044s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:11:10.849577 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] <== connect_volume: return (3044ms) {'type': 'block', 'scsi_wwn': '330000000e1557434', 'path': '/dev/dm-2', 'multipath_id': '330000000e1557434'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:11:10.849577 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e1557434', 'path': '/dev/dm-2', 'multipath_id': '330000000e1557434'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:11:11.003740 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] During sync_power_state the instance has a pending task (resize_reverting). Skip.
May 28 10:11:11.004202 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963071.0040255, edd8dcff-3440-445a-b4a2-8c56863e7ca3 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:11:11.004316 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] VM Paused (Lifecycle Event)
May 28 10:11:11.064245 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:11:11.070880 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-aed3f544-c3bd-4e4b-a8a8-a1a9d9e8098d tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Updating instance to original state: 'active'
May 28 10:11:11.280003 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:11.359244 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:10:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1785992036',display_name='tempest-TestMinimumBasicScenario-server-1785992036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testminimumbasicscenario-server-1785992036',id=59,image_ref='63b9de52-b76c-44d7-9e19-2bbc39bd37e6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLiX2kC72bgYbEtDTMsYzL9SD3voo9GX+cDAL0WmMYth6F/EEwHtRxRiF7vbmxiGKhT5mQtsmFOUJpBjXEXu5cbRVXGqFCdGspdUukikdpy3iovlWAZ00U6u/U2VnwRLtQ==',key_name='tempest-TestMinimumBasicScenario-1728575637',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:10:21Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44f9e47b0cb84ec9a96e9ee54854c98d',ramdisk_id='',reservation_id='r-8k0nmdmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='63b9de52-b76c-44d7-9e19-2bbc39bd37e6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-63484617',owner_user_name='tempest-TestMinimumBasicScenario-63484617-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:11:03Z,user_data=None,user_id='4631f2d316394d08825f7c3295412feb',uuid=c0786416-dec3-4610-9ec2-389aa7508148,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "address": "fa:16:3e:83:3c:7d", "network": {"id": "db344666-4990-47d9-a3a2-9bebce64e660", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1492927350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44f9e47b0cb84ec9a96e9ee54854c98d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e2cc51-3e", "ovs_interfaceid": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:11:11.359244 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Converting VIF {"id": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "address": "fa:16:3e:83:3c:7d", "network": {"id": "db344666-4990-47d9-a3a2-9bebce64e660", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1492927350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44f9e47b0cb84ec9a96e9ee54854c98d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e2cc51-3e", "ovs_interfaceid": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:11:11.359805 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:3c:7d,bridge_name='br-int',has_traffic_filtering=True,id=19e2cc51-3e82-46f4-8d06-7406f2f72300,network=Network(db344666-4990-47d9-a3a2-9bebce64e660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19e2cc51-3e') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:11:11.363180 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lazy-loading 'pci_devices' on Instance uuid c0786416-dec3-4610-9ec2-389aa7508148 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:11:11.413182 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Updating instance_info_cache with network_info: [{"id": "cd93d344-29fd-4e3e-aa5a-035b8ddb2118", "address": "fa:16:3e:e5:ea:20", "network": {"id": "8d701503-e690-42e6-8d82-0987ffcf4209", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1480012678-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a4bbdf692768465db607aa60a630e5e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd93d344-29", "ovs_interfaceid": "cd93d344-29fd-4e3e-aa5a-035b8ddb2118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:11:11.507742 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:11:11.510403 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963071.5100732, edd8dcff-3440-445a-b4a2-8c56863e7ca3 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:11:11.510617 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] VM Resumed (Lifecycle Event)
May 28 10:11:11.862137 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Object Instance<c0786416-dec3-4610-9ec2-389aa7508148> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:11:11.863220 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] End _get_guest_xml xml=<domain type="qemu">
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:   <uuid>c0786416-dec3-4610-9ec2-389aa7508148</uuid>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:   <name>instance-0000003b</name>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:       <nova:name>tempest-TestMinimumBasicScenario-server-1785992036</nova:name>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:11:07</nova:creationTime>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:       <nova:image uuid="63b9de52-b76c-44d7-9e19-2bbc39bd37e6">
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:         <nova:user uuid="4631f2d316394d08825f7c3295412feb">tempest-TestMinimumBasicScenario-63484617-project-member</nova:user>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:         <nova:project uuid="44f9e47b0cb84ec9a96e9ee54854c98d">tempest-TestMinimumBasicScenario-63484617</nova:project>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="63b9de52-b76c-44d7-9e19-2bbc39bd37e6"/>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:         <nova:port uuid="19e2cc51-3e82-46f4-8d06-7406f2f72300">
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:     <system>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:       <entry name="serial">c0786416-dec3-4610-9ec2-389aa7508148</entry>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:       <entry name="uuid">c0786416-dec3-4610-9ec2-389aa7508148</entry>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:     </system>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:   <os>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:   </os>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:   <features>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:   </features>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:   <devices>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148/disk"/>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:     </disk>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148/disk.config"/>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:     </disk>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:       <alias name="ua-27d30a68-d569-4696-bcc3-6b1ed57ab61d"/>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-2"/>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:       <target dev="vdb" bus="virtio"/>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:       <serial>27d30a68-d569-4696-bcc3-6b1ed57ab61d</serial>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:     </disk>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:83:3c:7d"/>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:       <target dev="tap19e2cc51-3e"/>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:     </interface>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148/console.log" append="off"/>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:     </serial>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:     <video>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:     </video>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:     </rng>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:   </devices>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]: </domain>
May 28 10:11:11.863220 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:11:11.867105 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:11:11.916190 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Releasing lock "refresh_cache-60cce3b4-1065-4568-9777-9b78ee43a55b" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:11:11.916190 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Instance network_info: |[{"id": "cd93d344-29fd-4e3e-aa5a-035b8ddb2118", "address": "fa:16:3e:e5:ea:20", "network": {"id": "8d701503-e690-42e6-8d82-0987ffcf4209", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1480012678-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a4bbdf692768465db607aa60a630e5e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd93d344-29", "ovs_interfaceid": "cd93d344-29fd-4e3e-aa5a-035b8ddb2118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:11:11.918347 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Start _get_guest_xml network_info=[{"id": "cd93d344-29fd-4e3e-aa5a-035b8ddb2118", "address": "fa:16:3e:e5:ea:20", "network": {"id": "8d701503-e690-42e6-8d82-0987ffcf4209", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1480012678-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a4bbdf692768465db607aa60a630e5e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd93d344-29", "ovs_interfaceid": "cd93d344-29fd-4e3e-aa5a-035b8ddb2118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:11:11.923719 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:11:11.925718 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-VolumesSnapshotTestJSON-instance-284577381', uuid='60cce3b4-1065-4568-9777-9b78ee43a55b'), owner=OwnerMeta(userid='f734f16600ef4cb88fdf7e170dd7f3a0', username='tempest-VolumesSnapshotTestJSON-4375881-project-member', projectid='a4bbdf692768465db607aa60a630e5e2', projectname='tempest-VolumesSnapshotTestJSON-4375881'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cd93d344-29fd-4e3e-aa5a-035b8ddb2118", "address": "fa:16:3e:e5:ea:20", "network": {"id": "8d701503-e690-42e6-8d82-0987ffcf4209", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1480012678-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a4bbdf692768465db607aa60a630e5e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd93d344-29", "ovs_interfaceid": "cd93d344-29fd-4e3e-aa5a-035b8ddb2118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779963071.9253318) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:11:11.927759 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:11:11.928467 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:11:11.929839 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:11:11.929998 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:11:11.931055 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:11:11.931385 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:11:11.931529 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:11:11.931613 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:11:11.931725 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:11:11.931817 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:11:11.931898 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:11:11.932041 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:11:11.932130 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:11:11.932259 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:11:11.932362 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:11:11.932479 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:11:11.946151 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:11:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-284577381',display_name='tempest-VolumesSnapshotTestJSON-instance-284577381',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumessnapshottestjson-instance-284577381',id=63,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACyMwfsfUkNFkbzWbBTIgFUC6rufATbG55GOKsScCcxOV9C0im0iNHk6baTEKJjfvTW7U+r84+PeVPcoYHDvcmVvuKWERmkOmVJVaZfbpGeK/1MN6VJ2WDtcF8Z5c77QA==',key_name='tempest-keypair-1165366685',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4bbdf692768465db607aa60a630e5e2',ramdisk_id='',reservation_id='r-6i3ru6d4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-4375881',owner_user_name='tempest-VolumesSnapshotTestJSON-4375881-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:11:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f734f16600ef4cb88fdf7e170dd7f3a0',uuid=60cce3b4-1065-4568-9777-9b78ee43a55b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd93d344-29fd-4e3e-aa5a-035b8ddb2118", "address": "fa:16:3e:e5:ea:20", "network": {"id": "8d701503-e690-42e6-8d82-0987ffcf4209", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1480012678-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a4bbdf692768465db607aa60a630e5e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd93d344-29", "ovs_interfaceid": "cd93d344-29fd-4e3e-aa5a-035b8ddb2118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:11:11.946484 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Converting VIF {"id": "cd93d344-29fd-4e3e-aa5a-035b8ddb2118", "address": "fa:16:3e:e5:ea:20", "network": {"id": "8d701503-e690-42e6-8d82-0987ffcf4209", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1480012678-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a4bbdf692768465db607aa60a630e5e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd93d344-29", "ovs_interfaceid": "cd93d344-29fd-4e3e-aa5a-035b8ddb2118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:11:11.947354 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:ea:20,bridge_name='br-int',has_traffic_filtering=True,id=cd93d344-29fd-4e3e-aa5a-035b8ddb2118,network=Network(8d701503-e690-42e6-8d82-0987ffcf4209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd93d344-29') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:11:11.948245 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lazy-loading 'pci_devices' on Instance uuid 60cce3b4-1065-4568-9777-9b78ee43a55b {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:11:11.962586 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:11:11.963071 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:11:12.013731 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:11:12.019259 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:11:12.048761 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:11:12.049307 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] skipping disk /dev/dm-2 (vdb) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:11:12.049859 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lazy-loading 'trusted_certs' on Instance uuid c0786416-dec3-4610-9ec2-389aa7508148 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:11:12.428789 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:12.447480 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:12.454196 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] End _get_guest_xml xml=<domain type="qemu">
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:   <uuid>60cce3b4-1065-4568-9777-9b78ee43a55b</uuid>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:   <name>instance-0000003f</name>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-284577381</nova:name>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:11:11</nova:creationTime>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:         <nova:user uuid="f734f16600ef4cb88fdf7e170dd7f3a0">tempest-VolumesSnapshotTestJSON-4375881-project-member</nova:user>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:         <nova:project uuid="a4bbdf692768465db607aa60a630e5e2">tempest-VolumesSnapshotTestJSON-4375881</nova:project>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:         <nova:port uuid="cd93d344-29fd-4e3e-aa5a-035b8ddb2118">
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:     <system>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:       <entry name="serial">60cce3b4-1065-4568-9777-9b78ee43a55b</entry>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:       <entry name="uuid">60cce3b4-1065-4568-9777-9b78ee43a55b</entry>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:     </system>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:   <os>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:   </os>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:   <features>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:   </features>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:   <devices>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/60cce3b4-1065-4568-9777-9b78ee43a55b/disk"/>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:     </disk>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/60cce3b4-1065-4568-9777-9b78ee43a55b/disk.config"/>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:     </disk>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:e5:ea:20"/>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:       <target dev="tapcd93d344-29"/>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:     </interface>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/60cce3b4-1065-4568-9777-9b78ee43a55b/console.log" append="off"/>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:     </serial>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:     <video>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:     </video>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:     </rng>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:   </devices>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]: </domain>
May 28 10:11:12.454196 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:11:12.454196 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Preparing to wait for external event network-vif-plugged-cd93d344-29fd-4e3e-aa5a-035b8ddb2118 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:11:12.455939 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Acquiring lock "60cce3b4-1065-4568-9777-9b78ee43a55b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:12.455939 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "60cce3b4-1065-4568-9777-9b78ee43a55b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:12.455939 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "60cce3b4-1065-4568-9777-9b78ee43a55b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:12.456104 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:11:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-284577381',display_name='tempest-VolumesSnapshotTestJSON-instance-284577381',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumessnapshottestjson-instance-284577381',id=63,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACyMwfsfUkNFkbzWbBTIgFUC6rufATbG55GOKsScCcxOV9C0im0iNHk6baTEKJjfvTW7U+r84+PeVPcoYHDvcmVvuKWERmkOmVJVaZfbpGeK/1MN6VJ2WDtcF8Z5c77QA==',key_name='tempest-keypair-1165366685',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4bbdf692768465db607aa60a630e5e2',ramdisk_id='',reservation_id='r-6i3ru6d4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-4375881',owner_user_name='tempest-VolumesSnapshotTestJSON-4375881-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:11:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f734f16600ef4cb88fdf7e170dd7f3a0',uuid=60cce3b4-1065-4568-9777-9b78ee43a55b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd93d344-29fd-4e3e-aa5a-035b8ddb2118", "address": "fa:16:3e:e5:ea:20", "network": {"id": "8d701503-e690-42e6-8d82-0987ffcf4209", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1480012678-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a4bbdf692768465db607aa60a630e5e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd93d344-29", "ovs_interfaceid": "cd93d344-29fd-4e3e-aa5a-035b8ddb2118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:11:12.456844 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Converting VIF {"id": "cd93d344-29fd-4e3e-aa5a-035b8ddb2118", "address": "fa:16:3e:e5:ea:20", "network": {"id": "8d701503-e690-42e6-8d82-0987ffcf4209", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1480012678-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a4bbdf692768465db607aa60a630e5e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd93d344-29", "ovs_interfaceid": "cd93d344-29fd-4e3e-aa5a-035b8ddb2118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:11:12.457097 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:ea:20,bridge_name='br-int',has_traffic_filtering=True,id=cd93d344-29fd-4e3e-aa5a-035b8ddb2118,network=Network(8d701503-e690-42e6-8d82-0987ffcf4209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd93d344-29') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:11:12.457752 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:ea:20,bridge_name='br-int',has_traffic_filtering=True,id=cd93d344-29fd-4e3e-aa5a-035b8ddb2118,network=Network(8d701503-e690-42e6-8d82-0987ffcf4209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd93d344-29') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:11:12.459491 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:12.459639 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:11:12.459890 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:11:12.462760 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:12.462947 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ecc2890-5ff1-552c-b0a9-99ff1ac89c28', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:11:12.464048 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:12.465632 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:11:12.468342 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:12.468502 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd93d344-29, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:11:12.468831 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcd93d344-29, col_values=(('qos', UUID('6296d966-3e2e-47c9-bd29-2eae0b55a26f')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:11:12.468992 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcd93d344-29, col_values=(('external_ids', {'iface-id': 'cd93d344-29fd-4e3e-aa5a-035b8ddb2118', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:ea:20', 'vm-uuid': '60cce3b4-1065-4568-9777-9b78ee43a55b'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:11:12.469714 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:12.472073 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:11:12.478572 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:12.479702 np0000001613 nova-compute[98321]: INFO os_vif [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:ea:20,bridge_name='br-int',has_traffic_filtering=True,id=cd93d344-29fd-4e3e-aa5a-035b8ddb2118,network=Network(8d701503-e690-42e6-8d82-0987ffcf4209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd93d344-29')
May 28 10:11:12.554653 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Object Instance<c0786416-dec3-4610-9ec2-389aa7508148> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:11:12.555087 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86dbb0ae7799bbec701ab74be40d660df13e8048 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:11:12.670337 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86dbb0ae7799bbec701ab74be40d660df13e8048 --force-share --output=json" returned: 0 in 0.115s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:11:12.670737 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:11:12.670963 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:11:12.765220 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:11:12.765789 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Cannot resize image /opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:11:12.766240 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lazy-loading 'migration_context' on Instance uuid c0786416-dec3-4610-9ec2-389aa7508148 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:11:13.083880 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:13.084879 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:13.271236 np0000001613 nova-compute[98321]: DEBUG nova.objects.base [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Object Instance<c0786416-dec3-4610-9ec2-389aa7508148> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=98321) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 10:11:13.272156 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:10:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1785992036',display_name='tempest-TestMinimumBasicScenario-server-1785992036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testminimumbasicscenario-server-1785992036',id=59,image_ref='63b9de52-b76c-44d7-9e19-2bbc39bd37e6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLiX2kC72bgYbEtDTMsYzL9SD3voo9GX+cDAL0WmMYth6F/EEwHtRxRiF7vbmxiGKhT5mQtsmFOUJpBjXEXu5cbRVXGqFCdGspdUukikdpy3iovlWAZ00U6u/U2VnwRLtQ==',key_name='tempest-TestMinimumBasicScenario-1728575637',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:10:21Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='44f9e47b0cb84ec9a96e9ee54854c98d',ramdisk_id='',reservation_id='r-8k0nmdmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='63b9de52-b76c-44d7-9e19-2bbc39bd37e6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-63484617',owner_user_name='tempest-TestMinimumBasicScenario-63484617-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:11:03Z,user_data=None,user_id='4631f2d316394d08825f7c3295412feb',uuid=c0786416-dec3-4610-9ec2-389aa7508148,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "address": "fa:16:3e:83:3c:7d", "network": {"id": "db344666-4990-47d9-a3a2-9bebce64e660", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1492927350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44f9e47b0cb84ec9a96e9ee54854c98d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e2cc51-3e", "ovs_interfaceid": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:11:13.272392 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Converting VIF {"id": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "address": "fa:16:3e:83:3c:7d", "network": {"id": "db344666-4990-47d9-a3a2-9bebce64e660", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1492927350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44f9e47b0cb84ec9a96e9ee54854c98d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e2cc51-3e", "ovs_interfaceid": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:11:13.273001 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:3c:7d,bridge_name='br-int',has_traffic_filtering=True,id=19e2cc51-3e82-46f4-8d06-7406f2f72300,network=Network(db344666-4990-47d9-a3a2-9bebce64e660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19e2cc51-3e') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:11:13.273331 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:3c:7d,bridge_name='br-int',has_traffic_filtering=True,id=19e2cc51-3e82-46f4-8d06-7406f2f72300,network=Network(db344666-4990-47d9-a3a2-9bebce64e660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19e2cc51-3e') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:11:13.273792 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:13.274133 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:11:13.274504 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:11:13.275327 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:13.275503 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e7b23654-68cc-5e1d-ba8d-2ab2234b240c', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:11:13.276300 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:13.276956 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:11:13.290952 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:13.295103 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:13.295103 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19e2cc51-3e, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:11:13.295103 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap19e2cc51-3e, col_values=(('qos', UUID('6d12e16e-5374-48b8-938d-976952b6df37')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:11:13.295103 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap19e2cc51-3e, col_values=(('external_ids', {'iface-id': '19e2cc51-3e82-46f4-8d06-7406f2f72300', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:3c:7d', 'vm-uuid': 'c0786416-dec3-4610-9ec2-389aa7508148'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:11:13.295103 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:13.297127 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:11:13.304076 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:13.305297 np0000001613 nova-compute[98321]: INFO os_vif [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:3c:7d,bridge_name='br-int',has_traffic_filtering=True,id=19e2cc51-3e82-46f4-8d06-7406f2f72300,network=Network(db344666-4990-47d9-a3a2-9bebce64e660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19e2cc51-3e')
May 28 10:11:13.591598 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Detaching volume 1ddb1344-a4d2-4480-9818-32c65d8ad963
May 28 10:11:13.666664 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Attempting to driver detach volume 1ddb1344-a4d2-4480-9818-32c65d8ad963 from mountpoint /dev/vdb
May 28 10:11:13.716287 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ddb1344-a4d2-4480-9818-32c65d8ad963', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, 'status': 'attaching', 'instance': 'edd8dcff-3440-445a-b4a2-8c56863e7ca3', 'attached_at': '2026-05-28T10:11:02.000000', 'detached_at': '', 'volume_id': '1ddb1344-a4d2-4480-9818-32c65d8ad963', 'serial': '1ddb1344-a4d2-4480-9818-32c65d8ad963'} {{(pid=98321) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 10:11:13.724813 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Found disk vdb by alias ua-1ddb1344-a4d2-4480-9818-32c65d8ad963 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:11:13.726664 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Found disk vdb by alias ua-1ddb1344-a4d2-4480-9818-32c65d8ad963 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:11:13.727041 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Attempting to detach device vdb from instance edd8dcff-3440-445a-b4a2-8c56863e7ca3 from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 10:11:13.727405 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:11:13.727405 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:11:13.727405 np0000001613 nova-compute[98321]:   <alias name="ua-1ddb1344-a4d2-4480-9818-32c65d8ad963"/>
May 28 10:11:13.727405 np0000001613 nova-compute[98321]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-4"/>
May 28 10:11:13.727405 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:11:13.727405 np0000001613 nova-compute[98321]:   <serial>1ddb1344-a4d2-4480-9818-32c65d8ad963</serial>
May 28 10:11:13.727405 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 10:11:13.727405 np0000001613 nova-compute[98321]:   <encryption format="luks">
May 28 10:11:13.727405 np0000001613 nova-compute[98321]:     <secret type="passphrase" uuid="16044a1b-1201-4710-b120-ca830a2aef23"/>
May 28 10:11:13.727405 np0000001613 nova-compute[98321]:   </encryption>
May 28 10:11:13.727405 np0000001613 nova-compute[98321]: </disk>
May 28 10:11:13.727405 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:11:13.738831 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Successfully detached device vdb from instance edd8dcff-3440-445a-b4a2-8c56863e7ca3 from the persistent domain config.
May 28 10:11:13.738831 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] (1/8): Attempting to detach device vdb with device alias ua-1ddb1344-a4d2-4480-9818-32c65d8ad963 from instance edd8dcff-3440-445a-b4a2-8c56863e7ca3 from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 10:11:13.738831 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:11:13.738831 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:11:13.738831 np0000001613 nova-compute[98321]:   <alias name="ua-1ddb1344-a4d2-4480-9818-32c65d8ad963"/>
May 28 10:11:13.738831 np0000001613 nova-compute[98321]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-4"/>
May 28 10:11:13.738831 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:11:13.738831 np0000001613 nova-compute[98321]:   <serial>1ddb1344-a4d2-4480-9818-32c65d8ad963</serial>
May 28 10:11:13.738831 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 10:11:13.738831 np0000001613 nova-compute[98321]:   <encryption format="luks">
May 28 10:11:13.738831 np0000001613 nova-compute[98321]:     <secret type="passphrase" uuid="16044a1b-1201-4710-b120-ca830a2aef23"/>
May 28 10:11:13.738831 np0000001613 nova-compute[98321]:   </encryption>
May 28 10:11:13.738831 np0000001613 nova-compute[98321]: </disk>
May 28 10:11:13.738831 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:11:13.796192 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:13.837184 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:13.846347 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:13.936426 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:14.010722 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:11:14.010868 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:11:14.010930 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] No VIF found with MAC fa:16:3e:e5:ea:20, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:11:14.011392 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Using config drive
May 28 10:11:14.099904 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779963074.0981483, edd8dcff-3440-445a-b4a2-8c56863e7ca3 => ua-1ddb1344-a4d2-4480-9818-32c65d8ad963> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 10:11:14.099904 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-1ddb1344-a4d2-4480-9818-32c65d8ad963 for instance edd8dcff-3440-445a-b4a2-8c56863e7ca3 {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 10:11:14.104122 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Successfully detached device vdb from instance edd8dcff-3440-445a-b4a2-8c56863e7ca3 from the live domain config.
May 28 10:11:14.114457 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:11:14.114897 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ddb1344-a4d2-4480-9818-32c65d8ad963', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:11:14.115059 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:11:14.115904 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:11:14.115904 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ddb1344-a4d2-4480-9818-32c65d8ad963', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:11:14.115904 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:11:14.146746 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:14.146746 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:14.146746 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:14.146746 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:14.146746 np0000001613 nova-compute[98321]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:11:14.146746 np0000001613 nova-compute[98321]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:11:14.146746 np0000001613 nova-compute[98321]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:14.146746 np0000001613 nova-compute[98321]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:14.146746 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:11:14.147134 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsi session list stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:14.147134 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:14.147134 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:14.147134 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:14.147134 np0000001613 nova-compute[98321]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:11:14.147134 np0000001613 nova-compute[98321]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963 (non-flash)
May 28 10:11:14.147134 np0000001613 nova-compute[98321]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:14.147134 np0000001613 nova-compute[98321]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:14.147134 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:11:14.147134 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623', '150'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623', '151'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d', '155'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d', '156'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', '157'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', '158'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', '159'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', '160')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:11:14.147500 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', '158')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:11:14.148508 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963', '157')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:11:14.149883 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc220e00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963'): ({'sdd'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:11:14.151413 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Removing multipathed devices sdd, sde {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:11:14.151413 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Flush multipath device 330000000e79767bf {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:11:14.186609 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:11:14.212992 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:14.218153 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:14.224836 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:11:14.226457 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:14.277464 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:11:14.277757 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:11:14.278649 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:14.280405 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:11:14.293121 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:11:14.293121 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:11:14.300851 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:14.309416 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:14.348356 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 158, target: iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963, portal: 192.168.40.100,3260]
May 28 10:11:14.348356 np0000001613 nova-compute[98321]: Logout of [sid: 158, target: iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963, portal: 192.168.40.100,3260] successful.
May 28 10:11:14.348356 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:14.368478 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:14.382597 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:14.413020 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 157, target: iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963, portal: 192.168.50.100,3260]
May 28 10:11:14.413020 np0000001613 nova-compute[98321]: Logout of [sid: 157, target: iqn.2023-03.storpool.com:os--volume-1ddb1344-a4d2-4480-9818-32c65d8ad963, portal: 192.168.50.100,3260] successful.
May 28 10:11:14.413020 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:14.447293 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:14.451695 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:11:14.452225 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] <== disconnect_volume: return (337ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:11:14.452378 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:11:14.524695 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:14.698752 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Creating config drive at /opt/stack/data/nova/instances/60cce3b4-1065-4568-9777-9b78ee43a55b/disk.config
May 28 10:11:14.706753 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/60cce3b4-1065-4568-9777-9b78ee43a55b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzmxer8t5 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:11:14.771762 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/60cce3b4-1065-4568-9777-9b78ee43a55b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzmxer8t5" returned: 0 in 0.064s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:11:14.873780 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:14.975438 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Instance event wait completed in 0 seconds for  {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:11:14.976406 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Removed pending STOPPED event for c0786416-dec3-4610-9ec2-389aa7508148 due to new event <LifecycleEvent: 1779963074.9760544, c0786416-dec3-4610-9ec2-389aa7508148 => Resumed> {{(pid=98321) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 10:11:14.977285 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963074.9760544, c0786416-dec3-4610-9ec2-389aa7508148 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:11:14.978083 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c0786416-dec3-4610-9ec2-389aa7508148] VM Resumed (Lifecycle Event)
May 28 10:11:14.986766 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Instance rebooted successfully.
May 28 10:11:15.044150 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lazy-loading 'flavor' on Instance uuid edd8dcff-3440-445a-b4a2-8c56863e7ca3 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:11:15.294952 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:15.330499 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:15.336609 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:15.431003 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:15.483695 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:11:15.488490 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:11:15.559329 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-897c1265-02d7-4f6a-80fd-edce24428c4a req-06e583d6-4e32-4206-9b6e-64d07d29b565 service nova] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Received event network-vif-plugged-cd93d344-29fd-4e3e-aa5a-035b8ddb2118 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:11:15.560854 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-897c1265-02d7-4f6a-80fd-edce24428c4a req-06e583d6-4e32-4206-9b6e-64d07d29b565 service nova] Acquiring lock "60cce3b4-1065-4568-9777-9b78ee43a55b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:15.561111 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-897c1265-02d7-4f6a-80fd-edce24428c4a req-06e583d6-4e32-4206-9b6e-64d07d29b565 service nova] Lock "60cce3b4-1065-4568-9777-9b78ee43a55b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:15.561302 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-897c1265-02d7-4f6a-80fd-edce24428c4a req-06e583d6-4e32-4206-9b6e-64d07d29b565 service nova] Lock "60cce3b4-1065-4568-9777-9b78ee43a55b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:15.561450 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-897c1265-02d7-4f6a-80fd-edce24428c4a req-06e583d6-4e32-4206-9b6e-64d07d29b565 service nova] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Processing event network-vif-plugged-cd93d344-29fd-4e3e-aa5a-035b8ddb2118 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:11:15.740364 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:15.751849 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:15.785879 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:15.992598 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c0786416-dec3-4610-9ec2-389aa7508148] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
May 28 10:11:15.992876 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963075.992689, c0786416-dec3-4610-9ec2-389aa7508148 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:11:15.992983 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c0786416-dec3-4610-9ec2-389aa7508148] VM Started (Lifecycle Event)
May 28 10:11:16.057139 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cdbaf56c-0996-404f-b46c-787d9cb0e1c3 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.972s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:16.381732 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:11:16.386544 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:11:16.392779 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Instance spawned successfully.
May 28 10:11:16.393321 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:11:16.442187 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fd426410-43d4-4022-8f2f-d1f7e1cd51d1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:16.442187 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fd426410-43d4-4022-8f2f-d1f7e1cd51d1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:16.442187 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fd426410-43d4-4022-8f2f-d1f7e1cd51d1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:16.442187 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fd426410-43d4-4022-8f2f-d1f7e1cd51d1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:16.442187 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fd426410-43d4-4022-8f2f-d1f7e1cd51d1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:16.443627 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-fd426410-43d4-4022-8f2f-d1f7e1cd51d1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Terminating instance
May 28 10:11:16.498897 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:11:16.500379 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:11:16.500489 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:11:16.500560 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:11:16.500657 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] No VIF found with MAC fa:16:3e:83:3c:7d, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:11:16.501118 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:11:16.503277 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:11:16.900692 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:11:16.901237 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:11:16.901237 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:11:16.901340 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:11:16.901554 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:11:16.901896 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:11:16.947884 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-fd426410-43d4-4022-8f2f-d1f7e1cd51d1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:11:16.969698 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:16.978058 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:16.996331 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:16.998447 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:17.010866 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c0786416-dec3-4610-9ec2-389aa7508148] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
May 28 10:11:17.013986 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b8d364a6-038a-45df-9df9-4fd8cbca6f95 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "c0786416-dec3-4610-9ec2-389aa7508148" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 16.868s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:17.015336 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963077.014503, 60cce3b4-1065-4568-9777-9b78ee43a55b => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:11:17.015336 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] VM Started (Lifecycle Event)
May 28 10:11:17.029114 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:17.264033 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Instance destroyed successfully.
May 28 10:11:17.264384 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-fd426410-43d4-4022-8f2f-d1f7e1cd51d1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lazy-loading 'resources' on Instance uuid edd8dcff-3440-445a-b4a2-8c56863e7ca3 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:11:17.406092 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Took 8.38 seconds to spawn the instance on the hypervisor.
May 28 10:11:17.406416 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:11:17.518584 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:11:17.520847 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:11:17.640760 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3dab876f-286b-4c11-8556-009744ef1791 req-e4326114-5e92-4b24-8a8a-68229ee2fdfc service nova] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Received event network-vif-plugged-cd93d344-29fd-4e3e-aa5a-035b8ddb2118 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:11:17.641571 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3dab876f-286b-4c11-8556-009744ef1791 req-e4326114-5e92-4b24-8a8a-68229ee2fdfc service nova] Acquiring lock "60cce3b4-1065-4568-9777-9b78ee43a55b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:17.641762 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3dab876f-286b-4c11-8556-009744ef1791 req-e4326114-5e92-4b24-8a8a-68229ee2fdfc service nova] Lock "60cce3b4-1065-4568-9777-9b78ee43a55b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:17.641913 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3dab876f-286b-4c11-8556-009744ef1791 req-e4326114-5e92-4b24-8a8a-68229ee2fdfc service nova] Lock "60cce3b4-1065-4568-9777-9b78ee43a55b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:17.642071 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3dab876f-286b-4c11-8556-009744ef1791 req-e4326114-5e92-4b24-8a8a-68229ee2fdfc service nova] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] No waiting events found dispatching network-vif-plugged-cd93d344-29fd-4e3e-aa5a-035b8ddb2118 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:11:17.642269 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-3dab876f-286b-4c11-8556-009744ef1791 req-e4326114-5e92-4b24-8a8a-68229ee2fdfc service nova] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Received unexpected event network-vif-plugged-cd93d344-29fd-4e3e-aa5a-035b8ddb2118 for instance with vm_state active and task_state None.
May 28 10:11:17.766735 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-fd426410-43d4-4022-8f2f-d1f7e1cd51d1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:09:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1080199311',display_name='tempest-TestEncryptedCinderVolumes-server-1080199311',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testencryptedcindervolumes-server-1080199311',id=55,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPEA8+uxSyCsgS6j+focPk4QpOVZVeAFK2kV4ErBJfCH5RkIc3vXvdGbsr44pZ3e0kq61KVrhwaHdQPmC2IB37UUcRSn+zMS1bh2okKRJrj9i8mJQASjzRzDfrAxUyWcQ==',key_name='tempest-keypair-831862139',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:11:10Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7563a83d33d4bc1a6610ccf53c18dc1',ramdisk_id='',reservation_id='r-34tgbqip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-297752033',owner_user_name='tempest-TestEncryptedCinderVolumes-297752033-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:11:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='961948be669c4a18a29398d53015f03b',uuid=edd8dcff-3440-445a-b4a2-8c56863e7ca3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "address": "fa:16:3e:5c:9e:66", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb80648-bd", "ovs_interfaceid": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:11:17.767000 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-fd426410-43d4-4022-8f2f-d1f7e1cd51d1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Converting VIF {"id": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "address": "fa:16:3e:5c:9e:66", "network": {"id": "5d6831d8-0534-4a95-ab49-3ab01d833330", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-510717759-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7563a83d33d4bc1a6610ccf53c18dc1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb80648-bd", "ovs_interfaceid": "6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:11:17.767690 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-fd426410-43d4-4022-8f2f-d1f7e1cd51d1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:9e:66,bridge_name='br-int',has_traffic_filtering=True,id=6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb80648-bd') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:11:17.769108 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-fd426410-43d4-4022-8f2f-d1f7e1cd51d1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:9e:66,bridge_name='br-int',has_traffic_filtering=True,id=6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb80648-bd') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:11:17.769943 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:17.770311 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6eb80648-bd, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:11:17.773336 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:17.778092 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:11:17.780595 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:17.780808 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=97f84b79-09a1-45b8-ab84-6faed75d5bb7) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:11:17.781285 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:17.781843 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:11:17.782144 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:17.784306 np0000001613 nova-compute[98321]: INFO os_vif [None req-fd426410-43d4-4022-8f2f-d1f7e1cd51d1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:9e:66,bridge_name='br-int',has_traffic_filtering=True,id=6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc,network=Network(5d6831d8-0534-4a95-ab49-3ab01d833330),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb80648-bd')
May 28 10:11:17.786179 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-fd426410-43d4-4022-8f2f-d1f7e1cd51d1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Deleting instance files /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3_del
May 28 10:11:17.791315 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-fd426410-43d4-4022-8f2f-d1f7e1cd51d1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Deletion of /opt/stack/data/nova/instances/edd8dcff-3440-445a-b4a2-8c56863e7ca3_del complete
May 28 10:11:17.917466 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Took 15.80 seconds to build instance.
May 28 10:11:18.023871 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963078.0235589, 60cce3b4-1065-4568-9777-9b78ee43a55b => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:11:18.024022 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] VM Paused (Lifecycle Event)
May 28 10:11:18.297776 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-fd426410-43d4-4022-8f2f-d1f7e1cd51d1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Took 1.35 seconds to destroy the instance on the hypervisor.
May 28 10:11:18.298368 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-fd426410-43d4-4022-8f2f-d1f7e1cd51d1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:11:18.298818 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:11:18.298940 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:11:18.299190 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:18.403924 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Acquiring lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:18.404261 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:18.419070 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "60cce3b4-1065-4568-9777-9b78ee43a55b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.314s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:18.427010 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:18.455177 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-79727f8a-894b-4bd7-9a60-e9c55bb9886d req-18b21917-9d89-4a50-bda1-848ba13f5dd9 service nova] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Received event network-changed-cd93d344-29fd-4e3e-aa5a-035b8ddb2118 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:11:18.455669 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-79727f8a-894b-4bd7-9a60-e9c55bb9886d req-18b21917-9d89-4a50-bda1-848ba13f5dd9 service nova] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Refreshing instance network info cache due to event network-changed-cd93d344-29fd-4e3e-aa5a-035b8ddb2118. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:11:18.459558 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-79727f8a-894b-4bd7-9a60-e9c55bb9886d req-18b21917-9d89-4a50-bda1-848ba13f5dd9 service nova] Acquiring lock "refresh_cache-60cce3b4-1065-4568-9777-9b78ee43a55b" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:11:18.459558 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-79727f8a-894b-4bd7-9a60-e9c55bb9886d req-18b21917-9d89-4a50-bda1-848ba13f5dd9 service nova] Acquired lock "refresh_cache-60cce3b4-1065-4568-9777-9b78ee43a55b" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:11:18.459558 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-79727f8a-894b-4bd7-9a60-e9c55bb9886d req-18b21917-9d89-4a50-bda1-848ba13f5dd9 service nova] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Refreshing network info cache for port cd93d344-29fd-4e3e-aa5a-035b8ddb2118 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:11:18.529371 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:11:18.531873 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963078.531588, 60cce3b4-1065-4568-9777-9b78ee43a55b => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:11:18.532106 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] VM Resumed (Lifecycle Event)
May 28 10:11:18.894119 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-9c74c1db-8d78-42aa-a459-a6699c0ec9ec req-6d1855c0-80f2-43d1-8bc9-8120959c5c69 service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Received event network-vif-deleted-6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:11:18.894494 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-9c74c1db-8d78-42aa-a459-a6699c0ec9ec req-6d1855c0-80f2-43d1-8bc9-8120959c5c69 service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Neutron deleted interface 6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc; detaching it from the instance and deleting it from the info cache
May 28 10:11:18.896126 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-9c74c1db-8d78-42aa-a459-a6699c0ec9ec req-6d1855c0-80f2-43d1-8bc9-8120959c5c69 service nova] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Detach interface failed, port_id=6eb80648-bdd1-4c1a-9dd3-a90d2973cfbc, reason: Instance edd8dcff-3440-445a-b4a2-8c56863e7ca3 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:11:18.906039 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:11:18.963308 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-79727f8a-894b-4bd7-9a60-e9c55bb9886d req-18b21917-9d89-4a50-bda1-848ba13f5dd9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:19.036068 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:11:19.038063 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:11:19.177591 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0003995460001533502 future=<Future at 0x73c1fc15d5b0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:11:19.177799 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:11:19.278199 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-79727f8a-894b-4bd7-9a60-e9c55bb9886d req-18b21917-9d89-4a50-bda1-848ba13f5dd9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:19.342883 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:11:19.406188 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-79727f8a-894b-4bd7-9a60-e9c55bb9886d req-18b21917-9d89-4a50-bda1-848ba13f5dd9 service nova] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Updated VIF entry in instance network info cache for port cd93d344-29fd-4e3e-aa5a-035b8ddb2118. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:11:19.406188 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-79727f8a-894b-4bd7-9a60-e9c55bb9886d req-18b21917-9d89-4a50-bda1-848ba13f5dd9 service nova] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Updating instance_info_cache with network_info: [{"id": "cd93d344-29fd-4e3e-aa5a-035b8ddb2118", "address": "fa:16:3e:e5:ea:20", "network": {"id": "8d701503-e690-42e6-8d82-0987ffcf4209", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1480012678-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a4bbdf692768465db607aa60a630e5e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd93d344-29", "ovs_interfaceid": "cd93d344-29fd-4e3e-aa5a-035b8ddb2118", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:11:19.464465 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:19.464642 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:19.467778 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:11:19.467897 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Claim successful on node np0000001613
May 28 10:11:19.540476 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999693310000112 future=<Future at 0x73c1fc183410 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:11:19.540676 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999445649000336 future=<Future at 0x73c1fc183410 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:11:19.540773 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999349550000261 future=<Future at 0x73c1fc183410 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:11:19.848366 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Took 1.55 seconds to deallocate network for instance.
May 28 10:11:19.877549 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:19.908300 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-79727f8a-894b-4bd7-9a60-e9c55bb9886d req-18b21917-9d89-4a50-bda1-848ba13f5dd9 service nova] Releasing lock "refresh_cache-60cce3b4-1065-4568-9777-9b78ee43a55b" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:11:20.354582 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fd426410-43d4-4022-8f2f-d1f7e1cd51d1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:20.517989 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ede778e5-553a-4109-b55b-11c8267bbd17 req-3467157e-496e-4c8c-8340-b961ab8b37dd service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Received event network-vif-plugged-19e2cc51-3e82-46f4-8d06-7406f2f72300 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:11:20.517989 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ede778e5-553a-4109-b55b-11c8267bbd17 req-3467157e-496e-4c8c-8340-b961ab8b37dd service nova] Acquiring lock "c0786416-dec3-4610-9ec2-389aa7508148-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:20.517989 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ede778e5-553a-4109-b55b-11c8267bbd17 req-3467157e-496e-4c8c-8340-b961ab8b37dd service nova] Lock "c0786416-dec3-4610-9ec2-389aa7508148-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:20.517989 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ede778e5-553a-4109-b55b-11c8267bbd17 req-3467157e-496e-4c8c-8340-b961ab8b37dd service nova] Lock "c0786416-dec3-4610-9ec2-389aa7508148-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:20.517989 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ede778e5-553a-4109-b55b-11c8267bbd17 req-3467157e-496e-4c8c-8340-b961ab8b37dd service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] No waiting events found dispatching network-vif-plugged-19e2cc51-3e82-46f4-8d06-7406f2f72300 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:11:20.517989 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-ede778e5-553a-4109-b55b-11c8267bbd17 req-3467157e-496e-4c8c-8340-b961ab8b37dd service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Received unexpected event network-vif-plugged-19e2cc51-3e82-46f4-8d06-7406f2f72300 for instance with vm_state active and task_state None.
May 28 10:11:20.517989 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ede778e5-553a-4109-b55b-11c8267bbd17 req-3467157e-496e-4c8c-8340-b961ab8b37dd service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Received event network-vif-plugged-19e2cc51-3e82-46f4-8d06-7406f2f72300 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:11:20.517989 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ede778e5-553a-4109-b55b-11c8267bbd17 req-3467157e-496e-4c8c-8340-b961ab8b37dd service nova] Acquiring lock "c0786416-dec3-4610-9ec2-389aa7508148-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:20.518191 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ede778e5-553a-4109-b55b-11c8267bbd17 req-3467157e-496e-4c8c-8340-b961ab8b37dd service nova] Lock "c0786416-dec3-4610-9ec2-389aa7508148-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:20.518217 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ede778e5-553a-4109-b55b-11c8267bbd17 req-3467157e-496e-4c8c-8340-b961ab8b37dd service nova] Lock "c0786416-dec3-4610-9ec2-389aa7508148-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:20.519029 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ede778e5-553a-4109-b55b-11c8267bbd17 req-3467157e-496e-4c8c-8340-b961ab8b37dd service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] No waiting events found dispatching network-vif-plugged-19e2cc51-3e82-46f4-8d06-7406f2f72300 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:11:20.519029 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-ede778e5-553a-4109-b55b-11c8267bbd17 req-3467157e-496e-4c8c-8340-b961ab8b37dd service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Received unexpected event network-vif-plugged-19e2cc51-3e82-46f4-8d06-7406f2f72300 for instance with vm_state active and task_state None.
May 28 10:11:20.856383 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:11:20.856624 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:11:21.359588 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:11:21.867861 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.403s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:21.869266 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fd426410-43d4-4022-8f2f-d1f7e1cd51d1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.514s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:21.869491 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:11:22.289038 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fd426410-43d4-4022-8f2f-d1f7e1cd51d1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:11:22.289259 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-fd426410-43d4-4022-8f2f-d1f7e1cd51d1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:11:22.378263 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:11:22.378263 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:11:22.378263 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:22.378263 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:22.452692 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3638304e4c654459b76653c84fd9721e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3e75c7b1bb425fbec695f663a73daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:11:22.782070 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:22.791728 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-fd426410-43d4-4022-8f2f-d1f7e1cd51d1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:11:22.882311 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:11:22.957059 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Successfully created port: c7f466f7-9d37-4d28-8e47-ed59abae0631 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:11:23.301184 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fd426410-43d4-4022-8f2f-d1f7e1cd51d1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.431s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:23.356739 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-fd426410-43d4-4022-8f2f-d1f7e1cd51d1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Deleted allocations for instance edd8dcff-3440-445a-b4a2-8c56863e7ca3
May 28 10:11:23.384222 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:11:23.514695 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Successfully updated port: c7f466f7-9d37-4d28-8e47-ed59abae0631 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:11:23.567453 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-35c3ab3c-db7e-40fe-bc01-d4748a84e2fe req-0b7801e0-6bcc-41a8-b371-37c023ad9f11 service nova] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Received event network-changed-c7f466f7-9d37-4d28-8e47-ed59abae0631 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:11:23.568696 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-35c3ab3c-db7e-40fe-bc01-d4748a84e2fe req-0b7801e0-6bcc-41a8-b371-37c023ad9f11 service nova] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Refreshing instance network info cache due to event network-changed-c7f466f7-9d37-4d28-8e47-ed59abae0631. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:11:23.570088 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-35c3ab3c-db7e-40fe-bc01-d4748a84e2fe req-0b7801e0-6bcc-41a8-b371-37c023ad9f11 service nova] Acquiring lock "refresh_cache-8849d62e-d9a4-4285-95fc-0869cbf20b4c" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:11:23.572796 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-35c3ab3c-db7e-40fe-bc01-d4748a84e2fe req-0b7801e0-6bcc-41a8-b371-37c023ad9f11 service nova] Acquired lock "refresh_cache-8849d62e-d9a4-4285-95fc-0869cbf20b4c" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:11:23.572796 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-35c3ab3c-db7e-40fe-bc01-d4748a84e2fe req-0b7801e0-6bcc-41a8-b371-37c023ad9f11 service nova] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Refreshing network info cache for port c7f466f7-9d37-4d28-8e47-ed59abae0631 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:11:24.017563 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Acquiring lock "refresh_cache-8849d62e-d9a4-4285-95fc-0869cbf20b4c" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:11:24.075973 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-35c3ab3c-db7e-40fe-bc01-d4748a84e2fe req-0b7801e0-6bcc-41a8-b371-37c023ad9f11 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:24.143257 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-35c3ab3c-db7e-40fe-bc01-d4748a84e2fe req-0b7801e0-6bcc-41a8-b371-37c023ad9f11 service nova] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:11:24.302334 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-35c3ab3c-db7e-40fe-bc01-d4748a84e2fe req-0b7801e0-6bcc-41a8-b371-37c023ad9f11 service nova] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:11:24.365382 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fd426410-43d4-4022-8f2f-d1f7e1cd51d1 tempest-TestEncryptedCinderVolumes-297752033 tempest-TestEncryptedCinderVolumes-297752033-project-member] Lock "edd8dcff-3440-445a-b4a2-8c56863e7ca3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.926s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:24.392212 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:11:24.394715 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:11:24.394972 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Creating image(s)
May 28 10:11:24.395463 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Acquiring lock "/opt/stack/data/nova/instances/8849d62e-d9a4-4285-95fc-0869cbf20b4c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:24.395608 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "/opt/stack/data/nova/instances/8849d62e-d9a4-4285-95fc-0869cbf20b4c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:24.396022 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "/opt/stack/data/nova/instances/8849d62e-d9a4-4285-95fc-0869cbf20b4c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:24.396540 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:11:24.399729 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:11:24.400824 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:11:24.511420 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.110s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:11:24.515182 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:24.515182 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:24.515182 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:11:24.517300 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:11:24.517920 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:11:24.632713 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.114s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:11:24.635175 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/8849d62e-d9a4-4285-95fc-0869cbf20b4c/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:11:24.692791 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/8849d62e-d9a4-4285-95fc-0869cbf20b4c/disk 1073741824" returned: 0 in 0.059s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:11:24.693485 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.181s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:24.695222 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:11:24.805582 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-35c3ab3c-db7e-40fe-bc01-d4748a84e2fe req-0b7801e0-6bcc-41a8-b371-37c023ad9f11 service nova] Releasing lock "refresh_cache-8849d62e-d9a4-4285-95fc-0869cbf20b4c" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:11:24.807943 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Acquired lock "refresh_cache-8849d62e-d9a4-4285-95fc-0869cbf20b4c" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:11:24.807943 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:11:24.808633 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.114s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:11:24.809578 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8849d62e-d9a4-4285-95fc-0869cbf20b4c/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:11:24.809578 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8849d62e-d9a4-4285-95fc-0869cbf20b4c/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:11:24.878559 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:24.899477 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8849d62e-d9a4-4285-95fc-0869cbf20b4c/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:11:24.901607 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Cannot resize image /opt/stack/data/nova/instances/8849d62e-d9a4-4285-95fc-0869cbf20b4c/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:11:24.901607 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:11:24.901607 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Ensure instance console log exists: /opt/stack/data/nova/instances/8849d62e-d9a4-4285-95fc-0869cbf20b4c/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:11:24.901607 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:24.901607 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:24.901607 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:25.394723 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:11:25.559620 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:25.683184 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "c57fd7fa-e4b8-4620-89ce-34be56feb58e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:25.683481 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "c57fd7fa-e4b8-4620-89ce-34be56feb58e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:25.736823 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Updating instance_info_cache with network_info: [{"id": "c7f466f7-9d37-4d28-8e47-ed59abae0631", "address": "fa:16:3e:86:53:88", "network": {"id": "f3b5252e-08d9-46f6-90aa-0484e78196b7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1235374496-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6e3e75c7b1bb425fbec695f663a73daf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f466f7-9d", "ovs_interfaceid": "c7f466f7-9d37-4d28-8e47-ed59abae0631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:11:26.188665 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:11:26.239326 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Releasing lock "refresh_cache-8849d62e-d9a4-4285-95fc-0869cbf20b4c" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:11:26.239885 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Instance network_info: |[{"id": "c7f466f7-9d37-4d28-8e47-ed59abae0631", "address": "fa:16:3e:86:53:88", "network": {"id": "f3b5252e-08d9-46f6-90aa-0484e78196b7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1235374496-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6e3e75c7b1bb425fbec695f663a73daf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f466f7-9d", "ovs_interfaceid": "c7f466f7-9d37-4d28-8e47-ed59abae0631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:11:26.241677 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Start _get_guest_xml network_info=[{"id": "c7f466f7-9d37-4d28-8e47-ed59abae0631", "address": "fa:16:3e:86:53:88", "network": {"id": "f3b5252e-08d9-46f6-90aa-0484e78196b7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1235374496-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6e3e75c7b1bb425fbec695f663a73daf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f466f7-9d", "ovs_interfaceid": "c7f466f7-9d37-4d28-8e47-ed59abae0631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:11:26.246234 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:11:26.247660 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-SnapshotDataIntegrityTests-server-1281724929', uuid='8849d62e-d9a4-4285-95fc-0869cbf20b4c'), owner=OwnerMeta(userid='3638304e4c654459b76653c84fd9721e', username='tempest-SnapshotDataIntegrityTests-331511523-project-member', projectid='6e3e75c7b1bb425fbec695f663a73daf', projectname='tempest-SnapshotDataIntegrityTests-331511523'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c7f466f7-9d37-4d28-8e47-ed59abae0631", "address": "fa:16:3e:86:53:88", "network": {"id": "f3b5252e-08d9-46f6-90aa-0484e78196b7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1235374496-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6e3e75c7b1bb425fbec695f663a73daf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f466f7-9d", "ovs_interfaceid": "c7f466f7-9d37-4d28-8e47-ed59abae0631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779963086.247205) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:11:26.249300 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:11:26.249676 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:11:26.253478 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:11:26.254228 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:11:26.255737 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:11:26.256196 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:11:26.257770 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:11:26.257770 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:11:26.258327 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:11:26.258866 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:11:26.258866 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:11:26.258866 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:11:26.259073 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:11:26.259073 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:11:26.259348 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:11:26.259417 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:11:26.276258 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1281724929',display_name='tempest-SnapshotDataIntegrityTests-server-1281724929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-snapshotdataintegritytests-server-1281724929',id=64,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP//p93JjTMDcF+im8PeGmK/wl58gP6a7BxpnoQVWv5ovDePLGUTApQw9P+Xmtc35B+7W3kzKS00SjbPUUCMyBC+4xsPsRVsAqtHHGuTdj5MGlQZWnzmbUlOQgkhNSov2A==',key_name='tempest-keypair-1817864279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e3e75c7b1bb425fbec695f663a73daf',ramdisk_id='',reservation_id='r-dhhvu33l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-331511523',owner_user_name='tempest-SnapshotDataIntegrityTests-331511523-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:11:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3638304e4c654459b76653c84fd9721e',uuid=8849d62e-d9a4-4285-95fc-0869cbf20b4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7f466f7-9d37-4d28-8e47-ed59abae0631", "address": "fa:16:3e:86:53:88", "network": {"id": "f3b5252e-08d9-46f6-90aa-0484e78196b7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1235374496-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6e3e75c7b1bb425fbec695f663a73daf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f466f7-9d", "ovs_interfaceid": "c7f466f7-9d37-4d28-8e47-ed59abae0631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:11:26.276508 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Converting VIF {"id": "c7f466f7-9d37-4d28-8e47-ed59abae0631", "address": "fa:16:3e:86:53:88", "network": {"id": "f3b5252e-08d9-46f6-90aa-0484e78196b7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1235374496-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6e3e75c7b1bb425fbec695f663a73daf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f466f7-9d", "ovs_interfaceid": "c7f466f7-9d37-4d28-8e47-ed59abae0631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:11:26.277225 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:53:88,bridge_name='br-int',has_traffic_filtering=True,id=c7f466f7-9d37-4d28-8e47-ed59abae0631,network=Network(f3b5252e-08d9-46f6-90aa-0484e78196b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f466f7-9d') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:11:26.277858 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lazy-loading 'pci_devices' on Instance uuid 8849d62e-d9a4-4285-95fc-0869cbf20b4c {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:11:26.781754 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] End _get_guest_xml xml=<domain type="qemu">
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:   <uuid>8849d62e-d9a4-4285-95fc-0869cbf20b4c</uuid>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:   <name>instance-00000040</name>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1281724929</nova:name>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:11:26</nova:creationTime>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:         <nova:user uuid="3638304e4c654459b76653c84fd9721e">tempest-SnapshotDataIntegrityTests-331511523-project-member</nova:user>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:         <nova:project uuid="6e3e75c7b1bb425fbec695f663a73daf">tempest-SnapshotDataIntegrityTests-331511523</nova:project>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:         <nova:port uuid="c7f466f7-9d37-4d28-8e47-ed59abae0631">
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:     <system>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:       <entry name="serial">8849d62e-d9a4-4285-95fc-0869cbf20b4c</entry>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:       <entry name="uuid">8849d62e-d9a4-4285-95fc-0869cbf20b4c</entry>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:     </system>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:   <os>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:   </os>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:   <features>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:   </features>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:   <devices>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/8849d62e-d9a4-4285-95fc-0869cbf20b4c/disk"/>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:     </disk>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/8849d62e-d9a4-4285-95fc-0869cbf20b4c/disk.config"/>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:     </disk>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:86:53:88"/>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:       <target dev="tapc7f466f7-9d"/>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:     </interface>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/8849d62e-d9a4-4285-95fc-0869cbf20b4c/console.log" append="off"/>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:     </serial>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:     <video>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:     </video>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:     </rng>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:   </devices>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]: </domain>
May 28 10:11:26.781754 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:11:26.784299 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Preparing to wait for external event network-vif-plugged-c7f466f7-9d37-4d28-8e47-ed59abae0631 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:11:26.784299 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Acquiring lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:26.784299 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:26.784299 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:26.784299 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1281724929',display_name='tempest-SnapshotDataIntegrityTests-server-1281724929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-snapshotdataintegritytests-server-1281724929',id=64,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP//p93JjTMDcF+im8PeGmK/wl58gP6a7BxpnoQVWv5ovDePLGUTApQw9P+Xmtc35B+7W3kzKS00SjbPUUCMyBC+4xsPsRVsAqtHHGuTdj5MGlQZWnzmbUlOQgkhNSov2A==',key_name='tempest-keypair-1817864279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e3e75c7b1bb425fbec695f663a73daf',ramdisk_id='',reservation_id='r-dhhvu33l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-331511523',owner_user_name='tempest-SnapshotDataIntegrityTests-331511523-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:11:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3638304e4c654459b76653c84fd9721e',uuid=8849d62e-d9a4-4285-95fc-0869cbf20b4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7f466f7-9d37-4d28-8e47-ed59abae0631", "address": "fa:16:3e:86:53:88", "network": {"id": "f3b5252e-08d9-46f6-90aa-0484e78196b7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1235374496-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6e3e75c7b1bb425fbec695f663a73daf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f466f7-9d", "ovs_interfaceid": "c7f466f7-9d37-4d28-8e47-ed59abae0631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:11:26.784299 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Converting VIF {"id": "c7f466f7-9d37-4d28-8e47-ed59abae0631", "address": "fa:16:3e:86:53:88", "network": {"id": "f3b5252e-08d9-46f6-90aa-0484e78196b7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1235374496-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6e3e75c7b1bb425fbec695f663a73daf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f466f7-9d", "ovs_interfaceid": "c7f466f7-9d37-4d28-8e47-ed59abae0631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:11:26.784299 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:53:88,bridge_name='br-int',has_traffic_filtering=True,id=c7f466f7-9d37-4d28-8e47-ed59abae0631,network=Network(f3b5252e-08d9-46f6-90aa-0484e78196b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f466f7-9d') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:11:26.784749 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:53:88,bridge_name='br-int',has_traffic_filtering=True,id=c7f466f7-9d37-4d28-8e47-ed59abae0631,network=Network(f3b5252e-08d9-46f6-90aa-0484e78196b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f466f7-9d') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:11:26.784749 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:26.784993 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:11:26.785793 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:11:26.788487 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:26.789065 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:26.789065 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:26.789831 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2779ee76-3f87-50db-ae6d-376983e5fefd', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:11:26.790373 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:26.791376 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:11:26.793849 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:11:26.794116 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:26.794929 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Claim successful on node np0000001613
May 28 10:11:26.804567 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:26.804769 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7f466f7-9d, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:11:26.805145 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc7f466f7-9d, col_values=(('qos', UUID('2ab2cb47-fad6-4de7-bbdf-5003ed7460f8')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:11:26.805482 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc7f466f7-9d, col_values=(('external_ids', {'iface-id': 'c7f466f7-9d37-4d28-8e47-ed59abae0631', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:53:88', 'vm-uuid': '8849d62e-d9a4-4285-95fc-0869cbf20b4c'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:11:26.808016 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:26.809431 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:11:26.814560 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:26.815624 np0000001613 nova-compute[98321]: INFO os_vif [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:53:88,bridge_name='br-int',has_traffic_filtering=True,id=c7f466f7-9d37-4d28-8e47-ed59abae0631,network=Network(f3b5252e-08d9-46f6-90aa-0484e78196b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f466f7-9d')
May 28 10:11:27.590868 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:28.261619 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:11:28.262198 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:11:28.346024 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:11:28.346155 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:11:28.346313 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] No VIF found with MAC fa:16:3e:86:53:88, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:11:28.346775 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Using config drive
May 28 10:11:28.767004 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:11:28.859571 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:29.033134 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Creating config drive at /opt/stack/data/nova/instances/8849d62e-d9a4-4285-95fc-0869cbf20b4c/disk.config
May 28 10:11:29.037694 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8849d62e-d9a4-4285-95fc-0869cbf20b4c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4fg7fbsy {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:11:29.098835 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8849d62e-d9a4-4285-95fc-0869cbf20b4c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4fg7fbsy" returned: 0 in 0.061s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:11:29.275347 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.486s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:29.276064 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:11:29.614319 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:29.628610 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:29.655800 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:29.705294 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:29.785659 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:11:29.788580 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:11:29.789892 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:11:29.789892 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:29.789892 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:29.882936 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:29.917211 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec58233d3b2848bbb2e0b00650398cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e9651268114327a9cc6c6c59bef01e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:11:29.924836 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d6c27d29-b0f0-4b7a-8e2c-b34b1ce75349 req-97c83ac7-de13-4793-a567-abb53cd1b9db service nova] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Received event network-vif-plugged-c7f466f7-9d37-4d28-8e47-ed59abae0631 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:11:29.925100 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d6c27d29-b0f0-4b7a-8e2c-b34b1ce75349 req-97c83ac7-de13-4793-a567-abb53cd1b9db service nova] Acquiring lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:29.925386 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d6c27d29-b0f0-4b7a-8e2c-b34b1ce75349 req-97c83ac7-de13-4793-a567-abb53cd1b9db service nova] Lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:29.925655 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d6c27d29-b0f0-4b7a-8e2c-b34b1ce75349 req-97c83ac7-de13-4793-a567-abb53cd1b9db service nova] Lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:29.925754 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d6c27d29-b0f0-4b7a-8e2c-b34b1ce75349 req-97c83ac7-de13-4793-a567-abb53cd1b9db service nova] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Processing event network-vif-plugged-c7f466f7-9d37-4d28-8e47-ed59abae0631 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:11:30.087429 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:30.091241 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:30.093830 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:30.123387 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:30.294581 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:11:30.579541 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963090.5790715, 8849d62e-d9a4-4285-95fc-0869cbf20b4c => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:11:30.579681 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] VM Started (Lifecycle Event)
May 28 10:11:30.582726 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:11:30.587371 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:11:30.590829 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Instance spawned successfully.
May 28 10:11:30.591116 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:11:30.645267 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Successfully created port: 4d6e364b-e498-4e8f-a49b-ec03c1278449 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:11:30.801244 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Booting with volume snapshot fa35a162-af4b-4388-bb2e-7ce2612012cc at /dev/vda
May 28 10:11:31.085015 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:11:31.088269 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:11:31.099814 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:11:31.100206 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:11:31.100716 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:11:31.101185 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:11:31.101634 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:11:31.102012 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:11:31.328623 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Successfully updated port: 4d6e364b-e498-4e8f-a49b-ec03c1278449 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:11:31.407015 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-65d0655f-8fa1-42c7-9edb-f910b7411672 req-cbdcb2ff-d423-4ee6-8ad7-0f4ee55d1d7b service nova] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Received event network-changed-4d6e364b-e498-4e8f-a49b-ec03c1278449 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:11:31.407410 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-65d0655f-8fa1-42c7-9edb-f910b7411672 req-cbdcb2ff-d423-4ee6-8ad7-0f4ee55d1d7b service nova] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Refreshing instance network info cache due to event network-changed-4d6e364b-e498-4e8f-a49b-ec03c1278449. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:11:31.407654 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-65d0655f-8fa1-42c7-9edb-f910b7411672 req-cbdcb2ff-d423-4ee6-8ad7-0f4ee55d1d7b service nova] Acquiring lock "refresh_cache-c57fd7fa-e4b8-4620-89ce-34be56feb58e" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:11:31.407654 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-65d0655f-8fa1-42c7-9edb-f910b7411672 req-cbdcb2ff-d423-4ee6-8ad7-0f4ee55d1d7b service nova] Acquired lock "refresh_cache-c57fd7fa-e4b8-4620-89ce-34be56feb58e" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:11:31.407825 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-65d0655f-8fa1-42c7-9edb-f910b7411672 req-cbdcb2ff-d423-4ee6-8ad7-0f4ee55d1d7b service nova] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Refreshing network info cache for port 4d6e364b-e498-4e8f-a49b-ec03c1278449 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:11:31.594210 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:11:31.594210 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963091.5922773, 8849d62e-d9a4-4285-95fc-0869cbf20b4c => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:11:31.594210 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] VM Paused (Lifecycle Event)
May 28 10:11:31.610631 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Took 7.22 seconds to spawn the instance on the hypervisor.
May 28 10:11:31.610631 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:11:31.808756 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:31.830772 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "refresh_cache-c57fd7fa-e4b8-4620-89ce-34be56feb58e" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:11:31.910779 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-65d0655f-8fa1-42c7-9edb-f910b7411672 req-cbdcb2ff-d423-4ee6-8ad7-0f4ee55d1d7b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:31.985899 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-65d0655f-8fa1-42c7-9edb-f910b7411672 req-cbdcb2ff-d423-4ee6-8ad7-0f4ee55d1d7b service nova] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:11:31.996756 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4464c544-8d19-48c7-b8ad-4f08db26ac10 req-c836c931-8b57-4b7b-ae57-bab82ce6c229 service nova] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Received event network-vif-plugged-c7f466f7-9d37-4d28-8e47-ed59abae0631 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:11:32.000563 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4464c544-8d19-48c7-b8ad-4f08db26ac10 req-c836c931-8b57-4b7b-ae57-bab82ce6c229 service nova] Acquiring lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:32.000563 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4464c544-8d19-48c7-b8ad-4f08db26ac10 req-c836c931-8b57-4b7b-ae57-bab82ce6c229 service nova] Lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:32.000563 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4464c544-8d19-48c7-b8ad-4f08db26ac10 req-c836c931-8b57-4b7b-ae57-bab82ce6c229 service nova] Lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:32.001513 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4464c544-8d19-48c7-b8ad-4f08db26ac10 req-c836c931-8b57-4b7b-ae57-bab82ce6c229 service nova] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] No waiting events found dispatching network-vif-plugged-c7f466f7-9d37-4d28-8e47-ed59abae0631 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:11:32.001841 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-4464c544-8d19-48c7-b8ad-4f08db26ac10 req-c836c931-8b57-4b7b-ae57-bab82ce6c229 service nova] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Received unexpected event network-vif-plugged-c7f466f7-9d37-4d28-8e47-ed59abae0631 for instance with vm_state active and task_state None.
May 28 10:11:32.098773 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:11:32.101819 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963092.1015232, 8849d62e-d9a4-4285-95fc-0869cbf20b4c => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:11:32.101966 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] VM Resumed (Lifecycle Event)
May 28 10:11:32.128117 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Took 12.72 seconds to build instance.
May 28 10:11:32.230769 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-65d0655f-8fa1-42c7-9edb-f910b7411672 req-cbdcb2ff-d423-4ee6-8ad7-0f4ee55d1d7b service nova] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:11:32.604585 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:11:32.606508 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:11:32.631218 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.227s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:32.733075 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-65d0655f-8fa1-42c7-9edb-f910b7411672 req-cbdcb2ff-d423-4ee6-8ad7-0f4ee55d1d7b service nova] Releasing lock "refresh_cache-c57fd7fa-e4b8-4620-89ce-34be56feb58e" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:11:32.734417 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquired lock "refresh_cache-c57fd7fa-e4b8-4620-89ce-34be56feb58e" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:11:32.734576 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:11:33.331621 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:11:33.511191 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:33.668570 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Updating instance_info_cache with network_info: [{"id": "4d6e364b-e498-4e8f-a49b-ec03c1278449", "address": "fa:16:3e:f2:0d:bb", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d6e364b-e4", "ovs_interfaceid": "4d6e364b-e498-4e8f-a49b-ec03c1278449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:11:34.076791 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b5522224-de01-4559-be4a-290a95b5443c req-727a1506-1b79-49c7-af85-1329c4b677bb service nova] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Received event network-changed-c7f466f7-9d37-4d28-8e47-ed59abae0631 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:11:34.077348 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b5522224-de01-4559-be4a-290a95b5443c req-727a1506-1b79-49c7-af85-1329c4b677bb service nova] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Refreshing instance network info cache due to event network-changed-c7f466f7-9d37-4d28-8e47-ed59abae0631. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:11:34.077766 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b5522224-de01-4559-be4a-290a95b5443c req-727a1506-1b79-49c7-af85-1329c4b677bb service nova] Acquiring lock "refresh_cache-8849d62e-d9a4-4285-95fc-0869cbf20b4c" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:11:34.078460 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b5522224-de01-4559-be4a-290a95b5443c req-727a1506-1b79-49c7-af85-1329c4b677bb service nova] Acquired lock "refresh_cache-8849d62e-d9a4-4285-95fc-0869cbf20b4c" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:11:34.078717 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-b5522224-de01-4559-be4a-290a95b5443c req-727a1506-1b79-49c7-af85-1329c4b677bb service nova] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Refreshing network info cache for port c7f466f7-9d37-4d28-8e47-ed59abae0631 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:11:34.170620 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Releasing lock "refresh_cache-c57fd7fa-e4b8-4620-89ce-34be56feb58e" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:11:34.170891 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Instance network_info: |[{"id": "4d6e364b-e498-4e8f-a49b-ec03c1278449", "address": "fa:16:3e:f2:0d:bb", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d6e364b-e4", "ovs_interfaceid": "4d6e364b-e498-4e8f-a49b-ec03c1278449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:11:34.422744 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:34.438223 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:11:34.453568 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:11:34.483089 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:11:34.542313 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.001929082000060589 future=<Future at 0x73c1fc183410 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:11:34.543179 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:11:34.545679 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] Emitting event <LifecycleEvent: 1779963079.5400643, edd8dcff-3440-445a-b4a2-8c56863e7ca3 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:11:34.545978 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] VM Stopped (Lifecycle Event)
May 28 10:11:34.551934 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:11:34.553303 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:11:34.568758 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:11:34.572540 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fee7:8ceb', 'fe80::e4eb:4cff:fe5c:5eb7', 'fe80::fc16:3eff:fe88:d1c6', 'fe80::dcfd:9ff:fe70:e322', 'fe80::fc16:3eff:fea2:6ffc', 'fe80::fc16:3eff:fe83:3c7d', 'fe80::e03f:79ff:fe2f:2d97', 'fe80::fc16:3eff:fee5:ea20', 'fe80::8cd1:81ff:fea1:944', 'fe80::fc16:3eff:fe86:5388', 'fe80::5c44:a2ff:fe78:6c5f', 'fe80::fc16:3eff:fe33:fbde', 'fe80::6807:fff:fe4c:bed3'] 
May 28 10:11:34.573073 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:11:34.573073 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:11:34.573611 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:11:34.574957 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Updating existing volume attachment record: da6cd223-65f8-4c90-9622-8282b20aa4d7 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:11:34.584184 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-b5522224-de01-4559-be4a-290a95b5443c req-727a1506-1b79-49c7-af85-1329c4b677bb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:34.890238 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:34.956438 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-b5522224-de01-4559-be4a-290a95b5443c req-727a1506-1b79-49c7-af85-1329c4b677bb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:35.056624 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-d5034657-f56e-4e54-bfc7-2dfee8124f64 tempest-TaggedBootDevicesTest-1732945749 tempest-TaggedBootDevicesTest-1732945749-project-member] [instance: edd8dcff-3440-445a-b4a2-8c56863e7ca3] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:11:35.186260 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-b5522224-de01-4559-be4a-290a95b5443c req-727a1506-1b79-49c7-af85-1329c4b677bb service nova] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Updated VIF entry in instance network info cache for port c7f466f7-9d37-4d28-8e47-ed59abae0631. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:11:35.186650 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-b5522224-de01-4559-be4a-290a95b5443c req-727a1506-1b79-49c7-af85-1329c4b677bb service nova] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Updating instance_info_cache with network_info: [{"id": "c7f466f7-9d37-4d28-8e47-ed59abae0631", "address": "fa:16:3e:86:53:88", "network": {"id": "f3b5252e-08d9-46f6-90aa-0484e78196b7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1235374496-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6e3e75c7b1bb425fbec695f663a73daf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f466f7-9d", "ovs_interfaceid": "c7f466f7-9d37-4d28-8e47-ed59abae0631", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:11:35.691622 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b5522224-de01-4559-be4a-290a95b5443c req-727a1506-1b79-49c7-af85-1329c4b677bb service nova] Releasing lock "refresh_cache-8849d62e-d9a4-4285-95fc-0869cbf20b4c" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:11:36.514550 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:36.713092 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:11:36.714598 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:11:36.714880 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Creating image(s)
May 28 10:11:36.715282 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Did not create local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 10:11:36.715440 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Ensure instance console log exists: /opt/stack/data/nova/instances/c57fd7fa-e4b8-4620-89ce-34be56feb58e/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:11:36.715702 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:36.715965 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:36.716098 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:36.716934 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Start _get_guest_xml network_info=[{"id": "4d6e364b-e498-4e8f-a49b-ec03c1278449", "address": "fa:16:3e:f2:0d:bb", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d6e364b-e4", "ovs_interfaceid": "4d6e364b-e498-4e8f-a49b-ec03c1278449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2026-05-28T10:11:22Z,direct_url=<?>,disk_format='raw',id=1998972d-532b-4b3a-bd5f-19aeba2d126b,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1169327071',owner='23e9651268114327a9cc6c6c59bef01e',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2026-05-28T10:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f', 'iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a9c8421e-c803-420d-b094-9e840eb1724f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'c57fd7fa-e4b8-4620-89ce-34be56feb58e', 'attached_at': '', 'detached_at': '', 'volume_id': 'a9c8421e-c803-420d-b094-9e840eb1724f', 'serial': 'a9c8421e-c803-420d-b094-9e840eb1724f'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'da6cd223-65f8-4c90-9622-8282b20aa4d7', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:11:36.720287 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:11:36.721776 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-image-snapshot-server-2043278427', uuid='c57fd7fa-e4b8-4620-89ce-34be56feb58e'), owner=OwnerMeta(userid='ec58233d3b2848bbb2e0b00650398cd1', username='tempest-TestVolumeBootPattern-327944304-project-member', projectid='23e9651268114327a9cc6c6c59bef01e', projectname='tempest-TestVolumeBootPattern-327944304'), image=ImageMeta(id='1998972d-532b-4b3a-bd5f-19aeba2d126b', name=None, container_format='bare', disk_format='raw', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio', 'img_bdm_v2': True, 'img_root_device_name': '/dev/vda'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4d6e364b-e498-4e8f-a49b-ec03c1278449", "address": "fa:16:3e:f2:0d:bb", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d6e364b-e4", "ovs_interfaceid": "4d6e364b-e498-4e8f-a49b-ec03c1278449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779963096.7213326) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:11:36.723515 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:11:36.723918 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:11:36.725037 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:11:36.725262 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:11:36.726444 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:11:36.726818 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2026-05-28T10:11:22Z,direct_url=<?>,disk_format='raw',id=1998972d-532b-4b3a-bd5f-19aeba2d126b,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1169327071',owner='23e9651268114327a9cc6c6c59bef01e',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2026-05-28T10:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:11:36.726993 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:11:36.727129 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:11:36.727323 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:11:36.727431 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:11:36.727565 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:11:36.727752 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:11:36.727874 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:11:36.728035 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:11:36.728176 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:11:36.728504 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:11:36.742686 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:11:36.743152 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f', 'iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a9c8421e-c803-420d-b094-9e840eb1724f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:11:36.743330 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:11:36.743732 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:11:36.744029 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f', 'iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a9c8421e-c803-420d-b094-9e840eb1724f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:11:36.759205 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:11:36.759945 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:11:36.760626 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:11:36.760881 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:11:36.761710 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:11:36.761962 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:11:36.778395 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:11:36.778395 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:36.785015 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:11:36.785015 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:36.792826 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f] added
May 28 10:11:36.792826 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:11:36.792826 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:11:36.792826 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:11:36.792826 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:11:36.792826 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:11:36.792826 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:36.793175 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:11:36.793175 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0323(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:11:36.793323 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:11:36.800964 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f] added
May 28 10:11:36.800964 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:11:36.800964 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:11:36.800964 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:11:36.800964 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:11:36.800964 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:11:36.800964 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:36.801316 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:11:36.801316 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0393(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:11:36.801439 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:11:36.810771 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:37.793853 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:11:37.801965 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:11:37.808131 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:11:37.808131 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:11:37.817529 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:11:37.817529 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:37.825092 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:37.836335 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:37.844353 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:37.844353 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:37.844353 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:37.844353 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:37.844353 np0000001613 nova-compute[98321]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:37.844353 np0000001613 nova-compute[98321]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:37.844353 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:11:37.844730 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:37.844730 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:37.844730 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:37.844730 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:37.844730 np0000001613 nova-compute[98321]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:37.844730 np0000001613 nova-compute[98321]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:37.844730 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:11:37.852099 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:37.852099 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:37.852099 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:37.852099 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:37.852099 np0000001613 nova-compute[98321]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:37.852099 np0000001613 nova-compute[98321]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:37.852099 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:11:37.852396 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:37.852396 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:37.852396 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:37.852396 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:37.852396 np0000001613 nova-compute[98321]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:37.852396 np0000001613 nova-compute[98321]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:37.852396 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:11:37.884297 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f, portal: 192.168.40.100,3260]
May 28 10:11:37.884297 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f, portal: 192.168.40.100,3260] successful.
May 28 10:11:37.884297 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:37.889926 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f, portal: 192.168.50.100,3260]
May 28 10:11:37.889926 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f, portal: 192.168.50.100,3260] successful.
May 28 10:11:37.889926 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:37.896487 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:37.902898 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:37.914388 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:37.914388 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:37.914388 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:37.914388 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:37.914388 np0000001613 nova-compute[98321]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:37.914388 np0000001613 nova-compute[98321]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:37.914388 np0000001613 nova-compute[98321]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:37.914388 np0000001613 nova-compute[98321]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:37.914388 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:11:37.914682 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:37.914682 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:37.914682 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:37.914682 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:37.914682 np0000001613 nova-compute[98321]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:37.914682 np0000001613 nova-compute[98321]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:37.914682 np0000001613 nova-compute[98321]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:37.914682 np0000001613 nova-compute[98321]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:37.914682 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:11:37.914905 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.154s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:11:37.915056 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:11:37.916498 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] HCTL ('9', '-', '-', 0) found on session 161 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:11:37.916691 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:11:37.922509 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:37.922509 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:37.922509 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:37.922509 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:37.922509 np0000001613 nova-compute[98321]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:37.922509 np0000001613 nova-compute[98321]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:37.922509 np0000001613 nova-compute[98321]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:37.922509 np0000001613 nova-compute[98321]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:37.922509 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:11:37.922892 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:37.922892 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:37.922892 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:37.922892 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:37.922892 np0000001613 nova-compute[98321]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:37.922892 np0000001613 nova-compute[98321]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:37.922892 np0000001613 nova-compute[98321]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:37.922892 np0000001613 nova-compute[98321]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:37.922892 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:11:37.923294 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.161s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:11:37.923294 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:11:37.924041 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] HCTL ('10', '-', '-', 0) found on session 162 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:11:37.924141 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:11:37.933702 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching for a device in session 161 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:11:37.933940 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a9c8421e-c803-420d-b094-9e840eb1724f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:11:37.945525 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching for a device in session 162 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:11:37.945525 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a9c8421e-c803-420d-b094-9e840eb1724f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:11:38.415379 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Acquiring lock "b4c26c83-b122-4b4a-a517-1701b23caf03" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:38.415379 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "b4c26c83-b122-4b4a-a517-1701b23caf03" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:38.761925 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:11:38.918751 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lazy-loading 'flavor' on Instance uuid b4c26c83-b122-4b4a-a517-1701b23caf03 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:11:39.392299 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:39.781107 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Found WWN 3300000000cefd8d8 for multipath device dm-4 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:11:39.781411 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:11:39.781588 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '3300000000cefd8d8', 'path': '/dev/dm-4', 'multipath_id': '3300000000cefd8d8'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:11:39.781735 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000cefd8d8', 'path': '/dev/dm-4', 'multipath_id': '3300000000cefd8d8'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:11:39.891064 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:39.923921 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "b4c26c83-b122-4b4a-a517-1701b23caf03" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:40.288345 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2043278427',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2043278427',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpattern-image-snapshot-server-2043278427',id=65,image_ref='1998972d-532b-4b3a-bd5f-19aeba2d126b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIcXuzJAQfVEICOjPYWqezGadsBXi/TFIkkC3EgXhGC4zMSPb6/FdcgnDU2y1HUmqdhib8vsj9wxGouFPTuNlI9TjoReWZ3WWjFBEfw3mOm3xuObjODjEFW9sPEGLZIiA==',key_name='tempest-keypair-1687066286',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23e9651268114327a9cc6c6c59bef01e',ramdisk_id='',reservation_id='r-m2ud72t0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-327944304',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-327944304-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-327944304',owner_user_name='tempest-TestVolumeBootPattern-327944304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:11:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec58233d3b2848bbb2e0b00650398cd1',uuid=c57fd7fa-e4b8-4620-89ce-34be56feb58e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d6e364b-e498-4e8f-a49b-ec03c1278449", "address": "fa:16:3e:f2:0d:bb", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d6e364b-e4", "ovs_interfaceid": "4d6e364b-e498-4e8f-a49b-ec03c1278449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:11:40.288345 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converting VIF {"id": "4d6e364b-e498-4e8f-a49b-ec03c1278449", "address": "fa:16:3e:f2:0d:bb", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d6e364b-e4", "ovs_interfaceid": "4d6e364b-e498-4e8f-a49b-ec03c1278449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:11:40.289346 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:0d:bb,bridge_name='br-int',has_traffic_filtering=True,id=4d6e364b-e498-4e8f-a49b-ec03c1278449,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d6e364b-e4') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:11:40.290057 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lazy-loading 'pci_devices' on Instance uuid c57fd7fa-e4b8-4620-89ce-34be56feb58e {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:11:40.793090 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] End _get_guest_xml xml=<domain type="qemu">
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:   <uuid>c57fd7fa-e4b8-4620-89ce-34be56feb58e</uuid>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:   <name>instance-00000041</name>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-2043278427</nova:name>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:11:36</nova:creationTime>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:       <nova:image uuid="">
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:         <nova:diskFormat>raw</nova:diskFormat>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:           <nova:property name="img_bdm_v2">True</nova:property>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:           <nova:property name="img_root_device_name">/dev/vda</nova:property>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:         <nova:user uuid="ec58233d3b2848bbb2e0b00650398cd1">tempest-TestVolumeBootPattern-327944304-project-member</nova:user>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:         <nova:project uuid="23e9651268114327a9cc6c6c59bef01e">tempest-TestVolumeBootPattern-327944304</nova:project>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid=""/>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:         <nova:port uuid="4d6e364b-e498-4e8f-a49b-ec03c1278449">
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:     <system>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:       <entry name="serial">c57fd7fa-e4b8-4620-89ce-34be56feb58e</entry>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:       <entry name="uuid">c57fd7fa-e4b8-4620-89ce-34be56feb58e</entry>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:     </system>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:   <os>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:   </os>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:   <features>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:   </features>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:   <devices>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/c57fd7fa-e4b8-4620-89ce-34be56feb58e/disk.config"/>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:     </disk>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:       <alias name="ua-a9c8421e-c803-420d-b094-9e840eb1724f"/>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-4"/>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:       <serial>a9c8421e-c803-420d-b094-9e840eb1724f</serial>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:     </disk>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:f2:0d:bb"/>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:       <target dev="tap4d6e364b-e4"/>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:     </interface>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/c57fd7fa-e4b8-4620-89ce-34be56feb58e/console.log" append="off"/>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:     </serial>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:     <video>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:     </video>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:     </rng>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:   </devices>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]: </domain>
May 28 10:11:40.793090 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:11:40.796055 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Preparing to wait for external event network-vif-plugged-4d6e364b-e498-4e8f-a49b-ec03c1278449 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:11:40.796055 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "c57fd7fa-e4b8-4620-89ce-34be56feb58e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:40.796055 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "c57fd7fa-e4b8-4620-89ce-34be56feb58e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:40.796055 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "c57fd7fa-e4b8-4620-89ce-34be56feb58e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:40.796055 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2043278427',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2043278427',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpattern-image-snapshot-server-2043278427',id=65,image_ref='1998972d-532b-4b3a-bd5f-19aeba2d126b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIcXuzJAQfVEICOjPYWqezGadsBXi/TFIkkC3EgXhGC4zMSPb6/FdcgnDU2y1HUmqdhib8vsj9wxGouFPTuNlI9TjoReWZ3WWjFBEfw3mOm3xuObjODjEFW9sPEGLZIiA==',key_name='tempest-keypair-1687066286',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23e9651268114327a9cc6c6c59bef01e',ramdisk_id='',reservation_id='r-m2ud72t0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-327944304',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-327944304-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-327944304',owner_user_name='tempest-TestVolumeBootPattern-327944304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:11:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec58233d3b2848bbb2e0b00650398cd1',uuid=c57fd7fa-e4b8-4620-89ce-34be56feb58e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d6e364b-e498-4e8f-a49b-ec03c1278449", "address": "fa:16:3e:f2:0d:bb", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d6e364b-e4", "ovs_interfaceid": "4d6e364b-e498-4e8f-a49b-ec03c1278449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:11:40.796055 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converting VIF {"id": "4d6e364b-e498-4e8f-a49b-ec03c1278449", "address": "fa:16:3e:f2:0d:bb", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d6e364b-e4", "ovs_interfaceid": "4d6e364b-e498-4e8f-a49b-ec03c1278449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:11:40.796055 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:0d:bb,bridge_name='br-int',has_traffic_filtering=True,id=4d6e364b-e498-4e8f-a49b-ec03c1278449,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d6e364b-e4') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:11:40.796055 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:0d:bb,bridge_name='br-int',has_traffic_filtering=True,id=4d6e364b-e498-4e8f-a49b-ec03c1278449,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d6e364b-e4') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:11:40.797241 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:40.797241 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:11:40.797241 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:11:40.798007 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:40.798261 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bbc4d6cc-5230-502c-b145-eb14dc281250', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:11:40.799068 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:40.799762 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:11:40.802060 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:40.808004 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:40.808228 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d6e364b-e4, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:11:40.808560 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d6e364b-e4, col_values=(('qos', UUID('250b7739-6a39-4eb4-a258-b1f3c0b0edbc')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:11:40.808707 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d6e364b-e4, col_values=(('external_ids', {'iface-id': '4d6e364b-e498-4e8f-a49b-ec03c1278449', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:0d:bb', 'vm-uuid': 'c57fd7fa-e4b8-4620-89ce-34be56feb58e'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:11:40.810318 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:40.811810 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:11:40.822987 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:40.824119 np0000001613 nova-compute[98321]: INFO os_vif [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:0d:bb,bridge_name='br-int',has_traffic_filtering=True,id=4d6e364b-e498-4e8f-a49b-ec03c1278449,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d6e364b-e4')
May 28 10:11:41.066288 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:41.189578 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Acquiring lock "b4c26c83-b122-4b4a-a517-1701b23caf03" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:41.189852 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "b4c26c83-b122-4b4a-a517-1701b23caf03" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:41.190156 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Attaching volume 0c86893a-973e-4330-91fd-44541d8b1c4a to /dev/vdb
May 28 10:11:41.244647 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:11:41.261480 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:11:41.283985 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:11:41.333343 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:11:41.338051 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:11:41.348785 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:11:41.350242 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fee7:8ceb', 'fe80::e4eb:4cff:fe5c:5eb7', 'fe80::fc16:3eff:fe88:d1c6', 'fe80::dcfd:9ff:fe70:e322', 'fe80::fc16:3eff:fea2:6ffc', 'fe80::fc16:3eff:fe83:3c7d', 'fe80::e03f:79ff:fe2f:2d97', 'fe80::fc16:3eff:fee5:ea20', 'fe80::8cd1:81ff:fea1:944', 'fe80::fc16:3eff:fe86:5388', 'fe80::5c44:a2ff:fe78:6c5f', 'fe80::fc16:3eff:fe33:fbde', 'fe80::6807:fff:fe4c:bed3'] 
May 28 10:11:41.350388 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:11:41.352534 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:11:41.352534 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:11:41.352534 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Updating existing volume attachment record: 48c48b60-ee2e-404c-8162-468c1159d9f0 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:11:41.680233 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:41.915289 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:11:41.915289 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a', 'iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0c86893a-973e-4330-91fd-44541d8b1c4a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:11:41.915289 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:11:41.915289 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:11:41.916669 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a', 'iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0c86893a-973e-4330-91fd-44541d8b1c4a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:11:41.928959 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:11:41.929794 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:11:41.930263 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:11:41.930534 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:11:41.931372 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:11:41.931511 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:11:41.950734 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:11:41.950734 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:41.956105 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:11:41.956105 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:41.967905 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a] added
May 28 10:11:41.967905 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:11:41.967905 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:11:41.967905 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:11:41.967905 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:11:41.967905 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:11:41.967905 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:41.967905 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:11:41.967905 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0372(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:11:41.967905 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:11:41.974567 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a] added
May 28 10:11:41.974567 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:11:41.974567 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:11:41.974567 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:11:41.974567 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:11:41.974567 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:11:41.974567 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:41.974567 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:11:41.974567 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0424(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:11:41.974567 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:11:42.352812 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:11:42.353351 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:11:42.353351 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] No VIF found with MAC fa:16:3e:f2:0d:bb, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:11:42.353900 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Using config drive
May 28 10:11:42.860173 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:42.968677 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:11:42.974950 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:11:42.993454 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Creating config drive at /opt/stack/data/nova/instances/c57fd7fa-e4b8-4620-89ce-34be56feb58e/disk.config
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:11:42.995588 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:11:42.995588 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:11:42.999600 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:11:42.999600 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:43.006536 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c57fd7fa-e4b8-4620-89ce-34be56feb58e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdy00kqxy {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:11:43.017428 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:43.027547 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:43.035665 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:43.035665 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:43.035665 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:43.035665 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:43.035665 np0000001613 nova-compute[98321]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:43.035665 np0000001613 nova-compute[98321]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:43.035665 np0000001613 nova-compute[98321]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:43.035665 np0000001613 nova-compute[98321]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:43.035665 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:11:43.035889 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsi session list stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:43.035889 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:43.035889 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:43.035889 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:43.035889 np0000001613 nova-compute[98321]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:43.035889 np0000001613 nova-compute[98321]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:43.035889 np0000001613 nova-compute[98321]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:43.035889 np0000001613 nova-compute[98321]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:43.035889 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:11:43.045280 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:43.045280 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:43.045280 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:43.045280 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:43.045280 np0000001613 nova-compute[98321]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:43.045280 np0000001613 nova-compute[98321]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:43.045280 np0000001613 nova-compute[98321]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:43.045280 np0000001613 nova-compute[98321]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:43.045280 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:11:43.045585 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsi session list stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:43.045585 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:43.045585 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:43.045585 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:43.045585 np0000001613 nova-compute[98321]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:43.045585 np0000001613 nova-compute[98321]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:43.045585 np0000001613 nova-compute[98321]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:43.045585 np0000001613 nova-compute[98321]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:43.045585 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:11:43.068884 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c57fd7fa-e4b8-4620-89ce-34be56feb58e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdy00kqxy" returned: 0 in 0.067s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:11:43.077593 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a, portal: 192.168.50.100,3260]
May 28 10:11:43.077593 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a, portal: 192.168.50.100,3260] successful.
May 28 10:11:43.077593 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:43.092741 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:43.102418 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a, portal: 192.168.40.100,3260]
May 28 10:11:43.102418 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a, portal: 192.168.40.100,3260] successful.
May 28 10:11:43.102418 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:43.113613 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:43.118042 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:43.118042 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:43.118042 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:43.118042 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:43.118042 np0000001613 nova-compute[98321]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:43.118042 np0000001613 nova-compute[98321]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:43.118042 np0000001613 nova-compute[98321]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:43.118042 np0000001613 nova-compute[98321]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:43.118042 np0000001613 nova-compute[98321]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a (non-flash)
May 28 10:11:43.118042 np0000001613 nova-compute[98321]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a (non-flash)
May 28 10:11:43.118042 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:11:43.118562 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsi session list stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:43.118562 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:43.118562 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:43.118562 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:43.118562 np0000001613 nova-compute[98321]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:43.118562 np0000001613 nova-compute[98321]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:43.118562 np0000001613 nova-compute[98321]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:43.118562 np0000001613 nova-compute[98321]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:43.118562 np0000001613 nova-compute[98321]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a (non-flash)
May 28 10:11:43.118562 np0000001613 nova-compute[98321]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a (non-flash)
May 28 10:11:43.118562 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:11:43.118862 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.189s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:11:43.118937 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:11:43.120067 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] HCTL ('14', '-', '-', 0) found on session 163 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:11:43.120224 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:11:43.136294 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:43.136294 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:43.136294 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:43.136294 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:43.136294 np0000001613 nova-compute[98321]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:43.136294 np0000001613 nova-compute[98321]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:43.136294 np0000001613 nova-compute[98321]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:43.136294 np0000001613 nova-compute[98321]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:43.136294 np0000001613 nova-compute[98321]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a (non-flash)
May 28 10:11:43.136294 np0000001613 nova-compute[98321]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a (non-flash)
May 28 10:11:43.136294 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:11:43.136294 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsi session list stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:43.136294 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:43.136294 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:43.136294 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:43.136294 np0000001613 nova-compute[98321]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:43.136294 np0000001613 nova-compute[98321]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:43.136294 np0000001613 nova-compute[98321]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:43.136294 np0000001613 nova-compute[98321]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:43.136294 np0000001613 nova-compute[98321]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a (non-flash)
May 28 10:11:43.136294 np0000001613 nova-compute[98321]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a (non-flash)
May 28 10:11:43.136294 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:11:43.136294 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.201s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:11:43.136294 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:11:43.136294 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Searching for a device in session 163 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:11:43.140249 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0c86893a-973e-4330-91fd-44541d8b1c4a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:11:43.140249 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] HCTL ('16', '-', '-', 0) found on session 164 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:11:43.140249 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:11:43.159619 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Searching for a device in session 164 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:11:43.159766 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0c86893a-973e-4330-91fd-44541d8b1c4a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:11:43.548347 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:43.582946 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:43.586310 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:43.684981 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:43.775897 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-bcc0d1b2-3cad-4e17-8e55-7d83dd4c92e2 req-bce36d04-2e52-4d05-bf46-780294756fd3 service nova] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Received event network-vif-plugged-4d6e364b-e498-4e8f-a49b-ec03c1278449 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:11:43.775897 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-bcc0d1b2-3cad-4e17-8e55-7d83dd4c92e2 req-bce36d04-2e52-4d05-bf46-780294756fd3 service nova] Acquiring lock "c57fd7fa-e4b8-4620-89ce-34be56feb58e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:43.775897 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-bcc0d1b2-3cad-4e17-8e55-7d83dd4c92e2 req-bce36d04-2e52-4d05-bf46-780294756fd3 service nova] Lock "c57fd7fa-e4b8-4620-89ce-34be56feb58e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:43.775897 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-bcc0d1b2-3cad-4e17-8e55-7d83dd4c92e2 req-bce36d04-2e52-4d05-bf46-780294756fd3 service nova] Lock "c57fd7fa-e4b8-4620-89ce-34be56feb58e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:43.776332 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-bcc0d1b2-3cad-4e17-8e55-7d83dd4c92e2 req-bce36d04-2e52-4d05-bf46-780294756fd3 service nova] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Processing event network-vif-plugged-4d6e364b-e498-4e8f-a49b-ec03c1278449 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:11:43.910793 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:43.912595 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:43.930816 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:11:43.953965 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Acquiring lock "38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:43.954249 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Lock "38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:44.365328 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963104.3648493, c57fd7fa-e4b8-4620-89ce-34be56feb58e => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:11:44.365855 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:11:44.366047 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] VM Started (Lifecycle Event)
May 28 10:11:44.369402 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:11:44.372591 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Instance spawned successfully.
May 28 10:11:44.373859 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:11:44.376186 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:11:44.376505 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:11:44.456700 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:11:44.868651 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:11:44.871260 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:11:44.881690 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Took 8.17 seconds to spawn the instance on the hypervisor.
May 28 10:11:44.881894 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:11:44.906601 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:44.949246 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Found WWN 3300000007c4277c1 for multipath device dm-10 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:11:44.949987 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:11:44.950047 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '3300000007c4277c1', 'path': '/dev/dm-10', 'multipath_id': '3300000007c4277c1'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:11:44.950284 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007c4277c1', 'path': '/dev/dm-10', 'multipath_id': '3300000007c4277c1'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:11:44.953333 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lazy-loading 'flavor' on Instance uuid b4c26c83-b122-4b4a-a517-1701b23caf03 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:11:45.026693 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:45.026937 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:45.030514 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:11:45.030685 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Claim successful on node np0000001613
May 28 10:11:45.373727 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:11:45.373942 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963105.3737411, c57fd7fa-e4b8-4620-89ce-34be56feb58e => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:11:45.374059 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] VM Paused (Lifecycle Event)
May 28 10:11:45.393600 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Took 18.70 seconds to build instance.
May 28 10:11:45.456013 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Attempting to attach volume 0c86893a-973e-4330-91fd-44541d8b1c4a with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 10:11:45.457442 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] attach device xml: <disk type="block" device="disk">
May 28 10:11:45.457442 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:11:45.457442 np0000001613 nova-compute[98321]:   <alias name="ua-0c86893a-973e-4330-91fd-44541d8b1c4a"/>
May 28 10:11:45.457442 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-10"/>
May 28 10:11:45.457442 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:11:45.457442 np0000001613 nova-compute[98321]:   <serial>0c86893a-973e-4330-91fd-44541d8b1c4a</serial>
May 28 10:11:45.457442 np0000001613 nova-compute[98321]: </disk>
May 28 10:11:45.457442 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 10:11:45.811520 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:45.837075 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-653a40ee-132e-4f9c-8bd5-f663b20cc764 req-6de4ebe9-afa8-478a-8e49-00faef1e70e5 service nova] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Received event network-vif-plugged-4d6e364b-e498-4e8f-a49b-ec03c1278449 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:11:45.837621 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-653a40ee-132e-4f9c-8bd5-f663b20cc764 req-6de4ebe9-afa8-478a-8e49-00faef1e70e5 service nova] Acquiring lock "c57fd7fa-e4b8-4620-89ce-34be56feb58e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:45.837807 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-653a40ee-132e-4f9c-8bd5-f663b20cc764 req-6de4ebe9-afa8-478a-8e49-00faef1e70e5 service nova] Lock "c57fd7fa-e4b8-4620-89ce-34be56feb58e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:45.837959 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-653a40ee-132e-4f9c-8bd5-f663b20cc764 req-6de4ebe9-afa8-478a-8e49-00faef1e70e5 service nova] Lock "c57fd7fa-e4b8-4620-89ce-34be56feb58e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:45.838109 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-653a40ee-132e-4f9c-8bd5-f663b20cc764 req-6de4ebe9-afa8-478a-8e49-00faef1e70e5 service nova] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] No waiting events found dispatching network-vif-plugged-4d6e364b-e498-4e8f-a49b-ec03c1278449 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:11:45.838454 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-653a40ee-132e-4f9c-8bd5-f663b20cc764 req-6de4ebe9-afa8-478a-8e49-00faef1e70e5 service nova] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Received unexpected event network-vif-plugged-4d6e364b-e498-4e8f-a49b-ec03c1278449 for instance with vm_state active and task_state None.
May 28 10:11:45.876594 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:11:45.878850 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963105.8786688, c57fd7fa-e4b8-4620-89ce-34be56feb58e => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:11:45.878973 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] VM Resumed (Lifecycle Event)
May 28 10:11:45.895387 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "c57fd7fa-e4b8-4620-89ce-34be56feb58e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.212s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:46.382850 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:11:46.386013 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:11:46.506177 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:11:46.506520 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:11:47.009706 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:11:47.133975 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:11:47.134124 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:11:47.134224 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:11:47.134344 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] No VIF found with MAC fa:16:3e:a2:6f:fc, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:11:47.520750 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.494s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:47.521297 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:11:47.903803 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-58c73567-acaf-4542-acc4-d4f939c04a38 req-22542bdc-624c-4434-b108-43ec2094cc4e service nova] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Received event network-changed-4d6e364b-e498-4e8f-a49b-ec03c1278449 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:11:47.903973 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-58c73567-acaf-4542-acc4-d4f939c04a38 req-22542bdc-624c-4434-b108-43ec2094cc4e service nova] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Refreshing instance network info cache due to event network-changed-4d6e364b-e498-4e8f-a49b-ec03c1278449. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:11:47.904203 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-58c73567-acaf-4542-acc4-d4f939c04a38 req-22542bdc-624c-4434-b108-43ec2094cc4e service nova] Acquiring lock "refresh_cache-c57fd7fa-e4b8-4620-89ce-34be56feb58e" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:11:47.904434 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-58c73567-acaf-4542-acc4-d4f939c04a38 req-22542bdc-624c-4434-b108-43ec2094cc4e service nova] Acquired lock "refresh_cache-c57fd7fa-e4b8-4620-89ce-34be56feb58e" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:11:47.904550 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-58c73567-acaf-4542-acc4-d4f939c04a38 req-22542bdc-624c-4434-b108-43ec2094cc4e service nova] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Refreshing network info cache for port 4d6e364b-e498-4e8f-a49b-ec03c1278449 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:11:48.028085 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:11:48.028739 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:11:48.029101 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:48.029101 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:48.131313 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '19b3fdd1190f40d49a21e78b400abbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b2299852eb46bc9d4049993bba63c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:11:48.406687 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-58c73567-acaf-4542-acc4-d4f939c04a38 req-22542bdc-624c-4434-b108-43ec2094cc4e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:48.532421 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:11:48.714853 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fb16f64d-94af-4ebc-b77b-c88c22beab09 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "b4c26c83-b122-4b4a-a517-1701b23caf03" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.525s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:48.769175 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Successfully created port: 5891d2d0-85db-4fea-a75d-eda91bfd237d {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:11:48.885758 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-58c73567-acaf-4542-acc4-d4f939c04a38 req-22542bdc-624c-4434-b108-43ec2094cc4e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:49.036232 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:11:49.067747 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-58c73567-acaf-4542-acc4-d4f939c04a38 req-22542bdc-624c-4434-b108-43ec2094cc4e service nova] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Updated VIF entry in instance network info cache for port 4d6e364b-e498-4e8f-a49b-ec03c1278449. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:11:49.068186 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-58c73567-acaf-4542-acc4-d4f939c04a38 req-22542bdc-624c-4434-b108-43ec2094cc4e service nova] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Updating instance_info_cache with network_info: [{"id": "4d6e364b-e498-4e8f-a49b-ec03c1278449", "address": "fa:16:3e:f2:0d:bb", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d6e364b-e4", "ovs_interfaceid": "4d6e364b-e498-4e8f-a49b-ec03c1278449", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:11:49.430044 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Successfully updated port: 5891d2d0-85db-4fea-a75d-eda91bfd237d {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:11:49.571539 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-58c73567-acaf-4542-acc4-d4f939c04a38 req-22542bdc-624c-4434-b108-43ec2094cc4e service nova] Releasing lock "refresh_cache-c57fd7fa-e4b8-4620-89ce-34be56feb58e" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:11:49.913643 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:49.933962 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Acquiring lock "refresh_cache-38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:11:49.934096 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Acquired lock "refresh_cache-38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:11:49.934390 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:11:49.964059 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7bae21ba-4422-4f21-9288-ded7dd4d3fd0 req-ae5f140f-2573-4596-9813-ec60e263766c service nova] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Received event network-changed-5891d2d0-85db-4fea-a75d-eda91bfd237d {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:11:49.964307 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7bae21ba-4422-4f21-9288-ded7dd4d3fd0 req-ae5f140f-2573-4596-9813-ec60e263766c service nova] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Refreshing instance network info cache due to event network-changed-5891d2d0-85db-4fea-a75d-eda91bfd237d. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:11:49.964876 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7bae21ba-4422-4f21-9288-ded7dd4d3fd0 req-ae5f140f-2573-4596-9813-ec60e263766c service nova] Acquiring lock "refresh_cache-38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:11:50.045141 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:11:50.046134 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:11:50.046728 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Creating image(s)
May 28 10:11:50.047407 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Acquiring lock "/opt/stack/data/nova/instances/38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:50.047608 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Lock "/opt/stack/data/nova/instances/38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:50.048151 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Lock "/opt/stack/data/nova/instances/38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:50.048744 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:11:50.051598 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:11:50.052422 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:11:50.144977 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.092s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:11:50.145610 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:50.146408 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:50.147103 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:11:50.152460 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:11:50.152954 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:11:50.255692 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.102s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:11:50.256147 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:11:50.310913 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f/disk 1073741824" returned: 0 in 0.054s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:11:50.312113 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.166s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:50.312606 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:11:50.408439 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.095s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:11:50.408903 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Checking if we can resize image /opt/stack/data/nova/instances/38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:11:50.409177 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:11:50.494947 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:11:50.496609 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Cannot resize image /opt/stack/data/nova/instances/38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:11:50.497036 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:11:50.497288 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Ensure instance console log exists: /opt/stack/data/nova/instances/38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:11:50.497589 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:50.497790 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:50.497920 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:50.508334 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:11:50.650486 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:50.773871 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Updating instance_info_cache with network_info: [{"id": "5891d2d0-85db-4fea-a75d-eda91bfd237d", "address": "fa:16:3e:8c:40:68", "network": {"id": "446df521-2c31-4c3a-b11f-066d4fa34be7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-691863219-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12b2299852eb46bc9d4049993bba63c8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5891d2d0-85", "ovs_interfaceid": "5891d2d0-85db-4fea-a75d-eda91bfd237d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:11:50.813364 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:51.276441 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Releasing lock "refresh_cache-38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:11:51.277308 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Instance network_info: |[{"id": "5891d2d0-85db-4fea-a75d-eda91bfd237d", "address": "fa:16:3e:8c:40:68", "network": {"id": "446df521-2c31-4c3a-b11f-066d4fa34be7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-691863219-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12b2299852eb46bc9d4049993bba63c8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5891d2d0-85", "ovs_interfaceid": "5891d2d0-85db-4fea-a75d-eda91bfd237d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:11:51.277308 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7bae21ba-4422-4f21-9288-ded7dd4d3fd0 req-ae5f140f-2573-4596-9813-ec60e263766c service nova] Acquired lock "refresh_cache-38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:11:51.278676 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Start _get_guest_xml network_info=[{"id": "5891d2d0-85db-4fea-a75d-eda91bfd237d", "address": "fa:16:3e:8c:40:68", "network": {"id": "446df521-2c31-4c3a-b11f-066d4fa34be7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-691863219-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12b2299852eb46bc9d4049993bba63c8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5891d2d0-85", "ovs_interfaceid": "5891d2d0-85db-4fea-a75d-eda91bfd237d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:11:51.280002 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-7bae21ba-4422-4f21-9288-ded7dd4d3fd0 req-ae5f140f-2573-4596-9813-ec60e263766c service nova] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Refreshing network info cache for port 5891d2d0-85db-4fea-a75d-eda91bfd237d {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:11:51.283063 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:11:51.284245 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1119403308', uuid='38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f'), owner=OwnerMeta(userid='19b3fdd1190f40d49a21e78b400abbd3', username='tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member', projectid='12b2299852eb46bc9d4049993bba63c8', projectname='tempest-TestServerVolumeAttachScenarioOldVersion-1790847208'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5891d2d0-85db-4fea-a75d-eda91bfd237d", "address": "fa:16:3e:8c:40:68", "network": {"id": "446df521-2c31-4c3a-b11f-066d4fa34be7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-691863219-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12b2299852eb46bc9d4049993bba63c8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5891d2d0-85", "ovs_interfaceid": "5891d2d0-85db-4fea-a75d-eda91bfd237d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779963111.2839215) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:11:51.285520 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:11:51.285942 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:11:51.287001 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:11:51.287158 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:11:51.288049 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:11:51.288358 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:11:51.288508 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:11:51.288599 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:11:51.288710 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:11:51.288792 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:11:51.288880 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:11:51.289062 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:11:51.289159 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:11:51.289799 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:11:51.289934 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:11:51.290055 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:11:51.302262 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:11:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1119403308',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1119403308',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testservervolumeattachscenariooldversion-server-1119403',id=66,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIL4OheUQNySvxy14CnXy50E6tElxyFnj0sozvCAFWgSa+8mQykaSBrRIp3MXKUB1obKtxpmgAQlvTOkGntgoUVmphjtoGL3+kawnT52fTjL8Zy6cWVRb90FEl9kJu3T1Q==',key_name='tempest-keypair-986171858',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12b2299852eb46bc9d4049993bba63c8',ramdisk_id='',reservation_id='r-0wpegttj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1790847208',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:11:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19b3fdd1190f40d49a21e78b400abbd3',uuid=38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5891d2d0-85db-4fea-a75d-eda91bfd237d", "address": "fa:16:3e:8c:40:68", "network": {"id": "446df521-2c31-4c3a-b11f-066d4fa34be7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-691863219-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12b2299852eb46bc9d4049993bba63c8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5891d2d0-85", "ovs_interfaceid": "5891d2d0-85db-4fea-a75d-eda91bfd237d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:11:51.302262 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Converting VIF {"id": "5891d2d0-85db-4fea-a75d-eda91bfd237d", "address": "fa:16:3e:8c:40:68", "network": {"id": "446df521-2c31-4c3a-b11f-066d4fa34be7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-691863219-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12b2299852eb46bc9d4049993bba63c8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5891d2d0-85", "ovs_interfaceid": "5891d2d0-85db-4fea-a75d-eda91bfd237d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:11:51.303109 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:40:68,bridge_name='br-int',has_traffic_filtering=True,id=5891d2d0-85db-4fea-a75d-eda91bfd237d,network=Network(446df521-2c31-4c3a-b11f-066d4fa34be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5891d2d0-85') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:11:51.303639 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Lazy-loading 'pci_devices' on Instance uuid 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:11:51.488560 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Acquiring lock "b4c26c83-b122-4b4a-a517-1701b23caf03" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:51.488716 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "b4c26c83-b122-4b4a-a517-1701b23caf03" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:51.784265 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-7bae21ba-4422-4f21-9288-ded7dd4d3fd0 req-ae5f140f-2573-4596-9813-ec60e263766c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:51.806606 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] End _get_guest_xml xml=<domain type="qemu">
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:   <uuid>38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f</uuid>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:   <name>instance-00000042</name>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1119403308</nova:name>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:11:51</nova:creationTime>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:         <nova:user uuid="19b3fdd1190f40d49a21e78b400abbd3">tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member</nova:user>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:         <nova:project uuid="12b2299852eb46bc9d4049993bba63c8">tempest-TestServerVolumeAttachScenarioOldVersion-1790847208</nova:project>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:         <nova:port uuid="5891d2d0-85db-4fea-a75d-eda91bfd237d">
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:     <system>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:       <entry name="serial">38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f</entry>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:       <entry name="uuid">38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f</entry>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:     </system>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:   <os>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:   </os>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:   <features>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:   </features>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:   <devices>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f/disk"/>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:     </disk>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f/disk.config"/>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:     </disk>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:8c:40:68"/>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:       <target dev="tap5891d2d0-85"/>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:     </interface>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f/console.log" append="off"/>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:     </serial>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:     <video>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:     </video>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:     </rng>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:   </devices>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]: </domain>
May 28 10:11:51.806606 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:11:51.809903 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Preparing to wait for external event network-vif-plugged-5891d2d0-85db-4fea-a75d-eda91bfd237d {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:11:51.809903 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Acquiring lock "38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:51.809903 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Lock "38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:51.809903 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Lock "38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:51.809903 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:11:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1119403308',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1119403308',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testservervolumeattachscenariooldversion-server-1119403',id=66,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIL4OheUQNySvxy14CnXy50E6tElxyFnj0sozvCAFWgSa+8mQykaSBrRIp3MXKUB1obKtxpmgAQlvTOkGntgoUVmphjtoGL3+kawnT52fTjL8Zy6cWVRb90FEl9kJu3T1Q==',key_name='tempest-keypair-986171858',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12b2299852eb46bc9d4049993bba63c8',ramdisk_id='',reservation_id='r-0wpegttj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1790847208',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:11:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19b3fdd1190f40d49a21e78b400abbd3',uuid=38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5891d2d0-85db-4fea-a75d-eda91bfd237d", "address": "fa:16:3e:8c:40:68", "network": {"id": "446df521-2c31-4c3a-b11f-066d4fa34be7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-691863219-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12b2299852eb46bc9d4049993bba63c8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5891d2d0-85", "ovs_interfaceid": "5891d2d0-85db-4fea-a75d-eda91bfd237d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:11:51.809903 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Converting VIF {"id": "5891d2d0-85db-4fea-a75d-eda91bfd237d", "address": "fa:16:3e:8c:40:68", "network": {"id": "446df521-2c31-4c3a-b11f-066d4fa34be7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-691863219-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12b2299852eb46bc9d4049993bba63c8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5891d2d0-85", "ovs_interfaceid": "5891d2d0-85db-4fea-a75d-eda91bfd237d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:11:51.809903 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:40:68,bridge_name='br-int',has_traffic_filtering=True,id=5891d2d0-85db-4fea-a75d-eda91bfd237d,network=Network(446df521-2c31-4c3a-b11f-066d4fa34be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5891d2d0-85') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:11:51.809903 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:40:68,bridge_name='br-int',has_traffic_filtering=True,id=5891d2d0-85db-4fea-a75d-eda91bfd237d,network=Network(446df521-2c31-4c3a-b11f-066d4fa34be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5891d2d0-85') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:11:51.809903 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:51.809903 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:11:51.809903 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:11:51.812183 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:51.812183 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'af9073b6-b81f-51de-a755-002119e6e793', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:11:51.813006 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:51.813880 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:11:51.816751 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:51.816982 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5891d2d0-85, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:11:51.817472 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5891d2d0-85, col_values=(('qos', UUID('1ae7a5d2-eeeb-4d6d-ada9-36fc93c5d9fd')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:11:51.817694 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5891d2d0-85, col_values=(('external_ids', {'iface-id': '5891d2d0-85db-4fea-a75d-eda91bfd237d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:40:68', 'vm-uuid': '38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:11:51.822957 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:51.824898 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:11:51.827573 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:51.830651 np0000001613 nova-compute[98321]: INFO os_vif [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:40:68,bridge_name='br-int',has_traffic_filtering=True,id=5891d2d0-85db-4fea-a75d-eda91bfd237d,network=Network(446df521-2c31-4c3a-b11f-066d4fa34be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5891d2d0-85')
May 28 10:11:51.992196 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Detaching volume 0c86893a-973e-4330-91fd-44541d8b1c4a
May 28 10:11:52.040199 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Attempting to driver detach volume 0c86893a-973e-4330-91fd-44541d8b1c4a from mountpoint /dev/vdb
May 28 10:11:52.045546 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Found disk vdb by alias ua-0c86893a-973e-4330-91fd-44541d8b1c4a {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:11:52.047241 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Found disk vdb by alias ua-0c86893a-973e-4330-91fd-44541d8b1c4a {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:11:52.047508 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Attempting to detach device vdb from instance b4c26c83-b122-4b4a-a517-1701b23caf03 from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 10:11:52.048429 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:11:52.048429 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:11:52.048429 np0000001613 nova-compute[98321]:   <alias name="ua-0c86893a-973e-4330-91fd-44541d8b1c4a"/>
May 28 10:11:52.048429 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-10"/>
May 28 10:11:52.048429 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:11:52.048429 np0000001613 nova-compute[98321]:   <serial>0c86893a-973e-4330-91fd-44541d8b1c4a</serial>
May 28 10:11:52.048429 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:11:52.048429 np0000001613 nova-compute[98321]: </disk>
May 28 10:11:52.048429 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:11:52.055890 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Successfully detached device vdb from instance b4c26c83-b122-4b4a-a517-1701b23caf03 from the persistent domain config.
May 28 10:11:52.056097 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] (1/8): Attempting to detach device vdb with device alias ua-0c86893a-973e-4330-91fd-44541d8b1c4a from instance b4c26c83-b122-4b4a-a517-1701b23caf03 from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 10:11:52.056467 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:11:52.056467 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:11:52.056467 np0000001613 nova-compute[98321]:   <alias name="ua-0c86893a-973e-4330-91fd-44541d8b1c4a"/>
May 28 10:11:52.056467 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-10"/>
May 28 10:11:52.056467 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:11:52.056467 np0000001613 nova-compute[98321]:   <serial>0c86893a-973e-4330-91fd-44541d8b1c4a</serial>
May 28 10:11:52.056467 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:11:52.056467 np0000001613 nova-compute[98321]: </disk>
May 28 10:11:52.056467 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:11:52.100090 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-7bae21ba-4422-4f21-9288-ded7dd4d3fd0 req-ae5f140f-2573-4596-9813-ec60e263766c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:52.219551 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-7bae21ba-4422-4f21-9288-ded7dd4d3fd0 req-ae5f140f-2573-4596-9813-ec60e263766c service nova] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Updated VIF entry in instance network info cache for port 5891d2d0-85db-4fea-a75d-eda91bfd237d. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:11:52.221051 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-7bae21ba-4422-4f21-9288-ded7dd4d3fd0 req-ae5f140f-2573-4596-9813-ec60e263766c service nova] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Updating instance_info_cache with network_info: [{"id": "5891d2d0-85db-4fea-a75d-eda91bfd237d", "address": "fa:16:3e:8c:40:68", "network": {"id": "446df521-2c31-4c3a-b11f-066d4fa34be7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-691863219-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12b2299852eb46bc9d4049993bba63c8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5891d2d0-85", "ovs_interfaceid": "5891d2d0-85db-4fea-a75d-eda91bfd237d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:11:52.553442 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779963112.5530367, b4c26c83-b122-4b4a-a517-1701b23caf03 => ua-0c86893a-973e-4330-91fd-44541d8b1c4a> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 10:11:52.554634 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-0c86893a-973e-4330-91fd-44541d8b1c4a for instance b4c26c83-b122-4b4a-a517-1701b23caf03 {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 10:11:52.557277 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Successfully detached device vdb from instance b4c26c83-b122-4b4a-a517-1701b23caf03 from the live domain config.
May 28 10:11:52.558732 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:11:52.559091 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a', 'iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0c86893a-973e-4330-91fd-44541d8b1c4a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:11:52.559373 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:11:52.559740 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:11:52.560085 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a', 'iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0c86893a-973e-4330-91fd-44541d8b1c4a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:11:52.560413 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:11:52.599536 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:52.599536 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:52.599536 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:52.599536 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:52.599536 np0000001613 nova-compute[98321]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:52.599536 np0000001613 nova-compute[98321]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:52.599536 np0000001613 nova-compute[98321]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:52.599536 np0000001613 nova-compute[98321]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:52.599536 np0000001613 nova-compute[98321]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a (non-flash)
May 28 10:11:52.599536 np0000001613 nova-compute[98321]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a (non-flash)
May 28 10:11:52.599536 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:11:52.599889 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsi session list stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:52.599889 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:52.599889 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:52.599889 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:52.599889 np0000001613 nova-compute[98321]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:52.599889 np0000001613 nova-compute[98321]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:52.599889 np0000001613 nova-compute[98321]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:52.599889 np0000001613 nova-compute[98321]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:52.599889 np0000001613 nova-compute[98321]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a (non-flash)
May 28 10:11:52.599889 np0000001613 nova-compute[98321]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a (non-flash)
May 28 10:11:52.599889 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:11:52.599889 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623', '150'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623', '151'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d', '155'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d', '156'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', '159'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', '160'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f', '161'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f', '162'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a', '163'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a', '164')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:11:52.599889 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a', '164')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:11:52.600821 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a', '163')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:11:52.601581 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc2ab6a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a'): ({'sdi'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:11:52.601807 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Removing multipathed devices sdi, sdk {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:11:52.602053 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Flush multipath device 3300000007c4277c1 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:11:52.642420 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:11:52.687855 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:11:52.722217 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7bae21ba-4422-4f21-9288-ded7dd4d3fd0 req-ae5f140f-2573-4596-9813-ec60e263766c service nova] Releasing lock "refresh_cache-38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:11:52.743734 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Checking to see if SCSI volumes sdi, sdk have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:11:52.743908 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] SCSI volumes sdi, sdk have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:11:52.745240 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Checking to see if device paths {'sdi', 'sdk'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:11:52.756589 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Device paths {'sdi', 'sdk'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:11:52.756887 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:11:52.768776 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:52.806313 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 164, target: iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a, portal: 192.168.40.100,3260]
May 28 10:11:52.806313 np0000001613 nova-compute[98321]: Logout of [sid: 164, target: iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a, portal: 192.168.40.100,3260] successful.
May 28 10:11:52.806313 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:52.831568 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:52.844978 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:52.881027 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 163, target: iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a, portal: 192.168.50.100,3260]
May 28 10:11:52.881027 np0000001613 nova-compute[98321]: Logout of [sid: 163, target: iqn.2023-03.storpool.com:os--volume-0c86893a-973e-4330-91fd-44541d8b1c4a, portal: 192.168.50.100,3260] successful.
May 28 10:11:52.881027 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:52.902574 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:52.902812 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:11:52.902934 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] <== disconnect_volume: return (343ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:11:52.903046 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:11:53.352666 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:11:53.352785 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:11:53.352882 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] No VIF found with MAC fa:16:3e:8c:40:68, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:11:53.353372 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Using config drive
May 28 10:11:53.447500 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lazy-loading 'flavor' on Instance uuid b4c26c83-b122-4b4a-a517-1701b23caf03 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:11:53.868431 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:54.005741 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Creating config drive at /opt/stack/data/nova/instances/38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f/disk.config
May 28 10:11:54.010117 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp56r5il64 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:11:54.065976 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp56r5il64" returned: 0 in 0.055s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:11:54.457137 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-dfa08a9f-59cb-45ab-9833-8166399b2fbf tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "b4c26c83-b122-4b4a-a517-1701b23caf03" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.968s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:54.476019 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:54.504662 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:54.591616 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:54.658948 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2879b9b6-5838-4ce1-951e-992476ad1fa5 req-6dc3563b-c0dc-41cd-ac9f-409e78089ffa service nova] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Received event network-changed-a00c63db-98a2-46e6-ac78-c54d73edf1e8 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:11:54.659071 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2879b9b6-5838-4ce1-951e-992476ad1fa5 req-6dc3563b-c0dc-41cd-ac9f-409e78089ffa service nova] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Refreshing instance network info cache due to event network-changed-a00c63db-98a2-46e6-ac78-c54d73edf1e8. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:11:54.659288 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2879b9b6-5838-4ce1-951e-992476ad1fa5 req-6dc3563b-c0dc-41cd-ac9f-409e78089ffa service nova] Acquiring lock "refresh_cache-b4c26c83-b122-4b4a-a517-1701b23caf03" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:11:54.659757 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2879b9b6-5838-4ce1-951e-992476ad1fa5 req-6dc3563b-c0dc-41cd-ac9f-409e78089ffa service nova] Acquired lock "refresh_cache-b4c26c83-b122-4b4a-a517-1701b23caf03" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:11:54.659913 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-2879b9b6-5838-4ce1-951e-992476ad1fa5 req-6dc3563b-c0dc-41cd-ac9f-409e78089ffa service nova] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Refreshing network info cache for port a00c63db-98a2-46e6-ac78-c54d73edf1e8 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:11:54.794779 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Acquiring lock "60cce3b4-1065-4568-9777-9b78ee43a55b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:54.795413 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "60cce3b4-1065-4568-9777-9b78ee43a55b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:54.976336 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:55.163087 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-2879b9b6-5838-4ce1-951e-992476ad1fa5 req-6dc3563b-c0dc-41cd-ac9f-409e78089ffa service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:55.195235 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b4b64156-e972-4c21-b23f-9d2d7cafb63a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Acquiring lock "b4c26c83-b122-4b4a-a517-1701b23caf03" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:55.195235 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b4b64156-e972-4c21-b23f-9d2d7cafb63a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "b4c26c83-b122-4b4a-a517-1701b23caf03" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:55.195235 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b4b64156-e972-4c21-b23f-9d2d7cafb63a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Acquiring lock "b4c26c83-b122-4b4a-a517-1701b23caf03-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:55.195235 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b4b64156-e972-4c21-b23f-9d2d7cafb63a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "b4c26c83-b122-4b4a-a517-1701b23caf03-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:55.195235 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b4b64156-e972-4c21-b23f-9d2d7cafb63a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "b4c26c83-b122-4b4a-a517-1701b23caf03-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:55.196723 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-b4b64156-e972-4c21-b23f-9d2d7cafb63a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Terminating instance
May 28 10:11:55.346022 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963115.3456328, 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:11:55.346467 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] VM Started (Lifecycle Event)
May 28 10:11:55.475805 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-2879b9b6-5838-4ce1-951e-992476ad1fa5 req-6dc3563b-c0dc-41cd-ac9f-409e78089ffa service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:55.505124 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lazy-loading 'flavor' on Instance uuid 60cce3b4-1065-4568-9777-9b78ee43a55b {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:11:55.602195 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-2879b9b6-5838-4ce1-951e-992476ad1fa5 req-6dc3563b-c0dc-41cd-ac9f-409e78089ffa service nova] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Updated VIF entry in instance network info cache for port a00c63db-98a2-46e6-ac78-c54d73edf1e8. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:11:55.602457 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-2879b9b6-5838-4ce1-951e-992476ad1fa5 req-6dc3563b-c0dc-41cd-ac9f-409e78089ffa service nova] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Updating instance_info_cache with network_info: [{"id": "a00c63db-98a2-46e6-ac78-c54d73edf1e8", "address": "fa:16:3e:a2:6f:fc", "network": {"id": "233ff488-7baf-4369-9054-b24499b82bab", "bridge": "br-int", "label": "tempest-TestStampPattern-854727558-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba63ea134a6e4fe1992f53a0da46d034", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00c63db-98", "ovs_interfaceid": "a00c63db-98a2-46e6-ac78-c54d73edf1e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:11:55.700293 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-b4b64156-e972-4c21-b23f-9d2d7cafb63a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:11:55.720703 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:55.726863 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:55.755123 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:55.774872 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-059ac922-01cf-45df-8ab4-e80f09ce9011 req-cf3fe709-39a9-4820-8acd-9efeca17d811 service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Received event network-changed-19e2cc51-3e82-46f4-8d06-7406f2f72300 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:11:55.777340 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-059ac922-01cf-45df-8ab4-e80f09ce9011 req-cf3fe709-39a9-4820-8acd-9efeca17d811 service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Refreshing instance network info cache due to event network-changed-19e2cc51-3e82-46f4-8d06-7406f2f72300. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:11:55.777340 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-059ac922-01cf-45df-8ab4-e80f09ce9011 req-cf3fe709-39a9-4820-8acd-9efeca17d811 service nova] Acquiring lock "refresh_cache-c0786416-dec3-4610-9ec2-389aa7508148" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:11:55.777340 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-059ac922-01cf-45df-8ab4-e80f09ce9011 req-cf3fe709-39a9-4820-8acd-9efeca17d811 service nova] Acquired lock "refresh_cache-c0786416-dec3-4610-9ec2-389aa7508148" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:11:55.777340 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-059ac922-01cf-45df-8ab4-e80f09ce9011 req-cf3fe709-39a9-4820-8acd-9efeca17d811 service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Refreshing network info cache for port 19e2cc51-3e82-46f4-8d06-7406f2f72300 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:11:55.849794 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:11:55.857076 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963115.856769, 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:11:55.857253 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] VM Paused (Lifecycle Event)
May 28 10:11:55.884474 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f8b404f1-f0a2-4555-89a3-7f5f3475c301 req-31753c7b-8c26-4030-9116-a8b67a9d1c3e service nova] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Received event network-vif-unplugged-a00c63db-98a2-46e6-ac78-c54d73edf1e8 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:11:55.884790 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f8b404f1-f0a2-4555-89a3-7f5f3475c301 req-31753c7b-8c26-4030-9116-a8b67a9d1c3e service nova] Acquiring lock "b4c26c83-b122-4b4a-a517-1701b23caf03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:55.885033 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f8b404f1-f0a2-4555-89a3-7f5f3475c301 req-31753c7b-8c26-4030-9116-a8b67a9d1c3e service nova] Lock "b4c26c83-b122-4b4a-a517-1701b23caf03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:55.885185 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f8b404f1-f0a2-4555-89a3-7f5f3475c301 req-31753c7b-8c26-4030-9116-a8b67a9d1c3e service nova] Lock "b4c26c83-b122-4b4a-a517-1701b23caf03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:55.885414 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f8b404f1-f0a2-4555-89a3-7f5f3475c301 req-31753c7b-8c26-4030-9116-a8b67a9d1c3e service nova] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] No waiting events found dispatching network-vif-unplugged-a00c63db-98a2-46e6-ac78-c54d73edf1e8 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:11:55.885577 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f8b404f1-f0a2-4555-89a3-7f5f3475c301 req-31753c7b-8c26-4030-9116-a8b67a9d1c3e service nova] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Received event network-vif-unplugged-a00c63db-98a2-46e6-ac78-c54d73edf1e8 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:11:55.928373 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:55.932029 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:56.008336 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Ignoring supplied device name: /dev/vdb
May 28 10:11:56.062925 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Instance destroyed successfully.
May 28 10:11:56.063479 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-b4b64156-e972-4c21-b23f-9d2d7cafb63a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lazy-loading 'resources' on Instance uuid b4c26c83-b122-4b4a-a517-1701b23caf03 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:11:56.104399 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2879b9b6-5838-4ce1-951e-992476ad1fa5 req-6dc3563b-c0dc-41cd-ac9f-409e78089ffa service nova] Releasing lock "refresh_cache-b4c26c83-b122-4b4a-a517-1701b23caf03" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:11:56.278308 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-059ac922-01cf-45df-8ab4-e80f09ce9011 req-cf3fe709-39a9-4820-8acd-9efeca17d811 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:56.360038 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:11:56.365773 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:11:56.396744 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "c0786416-dec3-4610-9ec2-389aa7508148" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:56.397086 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "c0786416-dec3-4610-9ec2-389aa7508148" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:56.510704 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "60cce3b4-1065-4568-9777-9b78ee43a55b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.716s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:56.565723 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-b4b64156-e972-4c21-b23f-9d2d7cafb63a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:10:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-748913283',display_name='tempest-TestStampPattern-server-748913283',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-teststamppattern-server-748913283',id=62,image_ref='a4df893b-9c4b-42ac-aeec-7933f9c3f012',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYM/OccL4UHt9TwzRUM2NoxErdXFvJSjsBY3qW0TdqZb62VjSt3Qhb8ydQXj0m7ruuXson/l4HMWZVUlPSmKQS9NgOeLgHIKDS6cwgmeUrB5A+zdtBT5AYw72WB234Frg==',key_name='tempest-TestStampPattern-550069760',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:10:59Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba63ea134a6e4fe1992f53a0da46d034',ramdisk_id='',reservation_id='r-q03fur7u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f42f06fc-5b0c-4973-98db-cd594815f317',image_min_disk='1',image_min_ram='0',image_owner_id='ba63ea134a6e4fe1992f53a0da46d034',image_owner_project_name='tempest-TestStampPattern-414594070',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-414594070-project-member',image_user_id='cda3cde4813d436b9f875ba96f496882',owner_project_name='tempest-TestStampPattern-414594070',owner_user_name='tempest-TestStampPattern-414594070-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:10:59Z,user_data=None,user_id='cda3cde4813d436b9f875ba96f496882',uuid=b4c26c83-b122-4b4a-a517-1701b23caf03,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a00c63db-98a2-46e6-ac78-c54d73edf1e8", "address": "fa:16:3e:a2:6f:fc", "network": {"id": "233ff488-7baf-4369-9054-b24499b82bab", "bridge": "br-int", "label": "tempest-TestStampPattern-854727558-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba63ea134a6e4fe1992f53a0da46d034", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00c63db-98", "ovs_interfaceid": "a00c63db-98a2-46e6-ac78-c54d73edf1e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:11:56.565953 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-b4b64156-e972-4c21-b23f-9d2d7cafb63a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Converting VIF {"id": "a00c63db-98a2-46e6-ac78-c54d73edf1e8", "address": "fa:16:3e:a2:6f:fc", "network": {"id": "233ff488-7baf-4369-9054-b24499b82bab", "bridge": "br-int", "label": "tempest-TestStampPattern-854727558-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba63ea134a6e4fe1992f53a0da46d034", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00c63db-98", "ovs_interfaceid": "a00c63db-98a2-46e6-ac78-c54d73edf1e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:11:56.566461 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-b4b64156-e972-4c21-b23f-9d2d7cafb63a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:6f:fc,bridge_name='br-int',has_traffic_filtering=True,id=a00c63db-98a2-46e6-ac78-c54d73edf1e8,network=Network(233ff488-7baf-4369-9054-b24499b82bab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa00c63db-98') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:11:56.566670 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-b4b64156-e972-4c21-b23f-9d2d7cafb63a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:6f:fc,bridge_name='br-int',has_traffic_filtering=True,id=a00c63db-98a2-46e6-ac78-c54d73edf1e8,network=Network(233ff488-7baf-4369-9054-b24499b82bab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa00c63db-98') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:11:56.568358 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:56.568358 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa00c63db-98, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:11:56.568961 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:56.570070 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:11:56.571478 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:56.572972 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:56.573638 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4ce112aa-3748-42ed-bdbe-02f1b36f4b93) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:11:56.574663 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:56.574663 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:11:56.576283 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:11:56.578340 np0000001613 nova-compute[98321]: INFO os_vif [None req-b4b64156-e972-4c21-b23f-9d2d7cafb63a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:6f:fc,bridge_name='br-int',has_traffic_filtering=True,id=a00c63db-98a2-46e6-ac78-c54d73edf1e8,network=Network(233ff488-7baf-4369-9054-b24499b82bab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa00c63db-98')
May 28 10:11:56.578712 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-b4b64156-e972-4c21-b23f-9d2d7cafb63a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Deleting instance files /opt/stack/data/nova/instances/b4c26c83-b122-4b4a-a517-1701b23caf03_del
May 28 10:11:56.579553 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-b4b64156-e972-4c21-b23f-9d2d7cafb63a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Deletion of /opt/stack/data/nova/instances/b4c26c83-b122-4b4a-a517-1701b23caf03_del complete
May 28 10:11:56.593467 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-059ac922-01cf-45df-8ab4-e80f09ce9011 req-cf3fe709-39a9-4820-8acd-9efeca17d811 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:56.726762 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5bda61aa-fc89-485f-a212-5eba7231a5c1 req-20857bd3-d43f-4079-96f6-16e096203f24 service nova] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Received event network-vif-plugged-5891d2d0-85db-4fea-a75d-eda91bfd237d {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:11:56.726762 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5bda61aa-fc89-485f-a212-5eba7231a5c1 req-20857bd3-d43f-4079-96f6-16e096203f24 service nova] Acquiring lock "38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:56.726762 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5bda61aa-fc89-485f-a212-5eba7231a5c1 req-20857bd3-d43f-4079-96f6-16e096203f24 service nova] Lock "38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:56.726762 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5bda61aa-fc89-485f-a212-5eba7231a5c1 req-20857bd3-d43f-4079-96f6-16e096203f24 service nova] Lock "38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:56.726951 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5bda61aa-fc89-485f-a212-5eba7231a5c1 req-20857bd3-d43f-4079-96f6-16e096203f24 service nova] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Processing event network-vif-plugged-5891d2d0-85db-4fea-a75d-eda91bfd237d {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:11:56.727083 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5bda61aa-fc89-485f-a212-5eba7231a5c1 req-20857bd3-d43f-4079-96f6-16e096203f24 service nova] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Received event network-vif-plugged-5891d2d0-85db-4fea-a75d-eda91bfd237d {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:11:56.727480 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5bda61aa-fc89-485f-a212-5eba7231a5c1 req-20857bd3-d43f-4079-96f6-16e096203f24 service nova] Acquiring lock "38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:56.728420 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:11:56.728630 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5bda61aa-fc89-485f-a212-5eba7231a5c1 req-20857bd3-d43f-4079-96f6-16e096203f24 service nova] Lock "38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:56.728816 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5bda61aa-fc89-485f-a212-5eba7231a5c1 req-20857bd3-d43f-4079-96f6-16e096203f24 service nova] Lock "38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:56.728979 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5bda61aa-fc89-485f-a212-5eba7231a5c1 req-20857bd3-d43f-4079-96f6-16e096203f24 service nova] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] No waiting events found dispatching network-vif-plugged-5891d2d0-85db-4fea-a75d-eda91bfd237d {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:11:56.729151 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-5bda61aa-fc89-485f-a212-5eba7231a5c1 req-20857bd3-d43f-4079-96f6-16e096203f24 service nova] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Received unexpected event network-vif-plugged-5891d2d0-85db-4fea-a75d-eda91bfd237d for instance with vm_state building and task_state spawning.
May 28 10:11:56.729357 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5bda61aa-fc89-485f-a212-5eba7231a5c1 req-20857bd3-d43f-4079-96f6-16e096203f24 service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Received event network-changed-19e2cc51-3e82-46f4-8d06-7406f2f72300 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:11:56.729499 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5bda61aa-fc89-485f-a212-5eba7231a5c1 req-20857bd3-d43f-4079-96f6-16e096203f24 service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Refreshing instance network info cache due to event network-changed-19e2cc51-3e82-46f4-8d06-7406f2f72300. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:11:56.729652 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5bda61aa-fc89-485f-a212-5eba7231a5c1 req-20857bd3-d43f-4079-96f6-16e096203f24 service nova] Acquiring lock "refresh_cache-c0786416-dec3-4610-9ec2-389aa7508148" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:11:56.734476 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:11:56.740350 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Instance spawned successfully.
May 28 10:11:56.740638 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:11:56.745794 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-059ac922-01cf-45df-8ab4-e80f09ce9011 req-cf3fe709-39a9-4820-8acd-9efeca17d811 service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Updated VIF entry in instance network info cache for port 19e2cc51-3e82-46f4-8d06-7406f2f72300. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:11:56.746070 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-059ac922-01cf-45df-8ab4-e80f09ce9011 req-cf3fe709-39a9-4820-8acd-9efeca17d811 service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Updating instance_info_cache with network_info: [{"id": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "address": "fa:16:3e:83:3c:7d", "network": {"id": "db344666-4990-47d9-a3a2-9bebce64e660", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1492927350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44f9e47b0cb84ec9a96e9ee54854c98d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e2cc51-3e", "ovs_interfaceid": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:11:56.791515 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:11:56.792232 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:11:56.871041 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:11:56.874311 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999725660999957 future=<Future at 0x73c1f4069970 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:11:56.874648 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.99944565900023 future=<Future at 0x73c1f4069970 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:11:56.874882 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963116.874572, 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:11:56.875213 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.99881601800007 future=<Future at 0x73c1f4069970 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:11:56.875331 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] VM Resumed (Lifecycle Event)
May 28 10:11:56.899630 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Detaching volume 27d30a68-d569-4696-bcc3-6b1ed57ab61d
May 28 10:11:56.942816 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Attempting to driver detach volume 27d30a68-d569-4696-bcc3-6b1ed57ab61d from mountpoint /dev/vdb
May 28 10:11:56.947633 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Found disk vdb by alias ua-27d30a68-d569-4696-bcc3-6b1ed57ab61d {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:11:56.949057 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Found disk vdb by alias ua-27d30a68-d569-4696-bcc3-6b1ed57ab61d {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:11:56.949274 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Attempting to detach device vdb from instance c0786416-dec3-4610-9ec2-389aa7508148 from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 10:11:56.949553 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:11:56.949553 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:11:56.949553 np0000001613 nova-compute[98321]:   <alias name="ua-27d30a68-d569-4696-bcc3-6b1ed57ab61d"/>
May 28 10:11:56.949553 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-2"/>
May 28 10:11:56.949553 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:11:56.949553 np0000001613 nova-compute[98321]:   <serial>27d30a68-d569-4696-bcc3-6b1ed57ab61d</serial>
May 28 10:11:56.949553 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 10:11:56.949553 np0000001613 nova-compute[98321]: </disk>
May 28 10:11:56.949553 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:11:56.955405 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Successfully detached device vdb from instance c0786416-dec3-4610-9ec2-389aa7508148 from the persistent domain config.
May 28 10:11:56.955551 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] (1/8): Attempting to detach device vdb with device alias ua-27d30a68-d569-4696-bcc3-6b1ed57ab61d from instance c0786416-dec3-4610-9ec2-389aa7508148 from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 10:11:56.955883 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:11:56.955883 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:11:56.955883 np0000001613 nova-compute[98321]:   <alias name="ua-27d30a68-d569-4696-bcc3-6b1ed57ab61d"/>
May 28 10:11:56.955883 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-2"/>
May 28 10:11:56.955883 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:11:56.955883 np0000001613 nova-compute[98321]:   <serial>27d30a68-d569-4696-bcc3-6b1ed57ab61d</serial>
May 28 10:11:56.955883 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 10:11:56.955883 np0000001613 nova-compute[98321]: </disk>
May 28 10:11:56.955883 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:11:57.087575 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-b4b64156-e972-4c21-b23f-9d2d7cafb63a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Took 1.39 seconds to destroy the instance on the hypervisor.
May 28 10:11:57.088222 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-b4b64156-e972-4c21-b23f-9d2d7cafb63a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:11:57.088514 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:11:57.088617 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:11:57.089364 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:57.208823 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:57.249319 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-059ac922-01cf-45df-8ab4-e80f09ce9011 req-cf3fe709-39a9-4820-8acd-9efeca17d811 service nova] Releasing lock "refresh_cache-c0786416-dec3-4610-9ec2-389aa7508148" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:11:57.250291 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5bda61aa-fc89-485f-a212-5eba7231a5c1 req-20857bd3-d43f-4079-96f6-16e096203f24 service nova] Acquired lock "refresh_cache-c0786416-dec3-4610-9ec2-389aa7508148" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:11:57.250691 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-5bda61aa-fc89-485f-a212-5eba7231a5c1 req-20857bd3-d43f-4079-96f6-16e096203f24 service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Refreshing network info cache for port 19e2cc51-3e82-46f4-8d06-7406f2f72300 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:11:57.254621 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:11:57.254798 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:11:57.255327 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:11:57.255629 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:11:57.255971 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:11:57.256333 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:11:57.375910 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Acquiring lock "60cce3b4-1065-4568-9777-9b78ee43a55b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:57.376134 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "60cce3b4-1065-4568-9777-9b78ee43a55b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:57.376276 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Attaching volume 836f0c06-aec5-4c9a-b1e7-3306787831ea to /dev/vdb
May 28 10:11:57.378130 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:11:57.382719 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:11:57.441245 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:11:57.454702 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:11:57.481468 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:11:57.523669 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-27d30a68-d569-4696-bcc3-6b1ed57ab61d for instance c0786416-dec3-4610-9ec2-389aa7508148 {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 10:11:57.532781 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:11:57.533076 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:11:57.542416 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:11:57.544129 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fee7:8ceb', 'fe80::e4eb:4cff:fe5c:5eb7', 'fe80::fc16:3eff:fe88:d1c6', 'fe80::dcfd:9ff:fe70:e322', 'fe80::fc16:3eff:fe83:3c7d', 'fe80::e03f:79ff:fe2f:2d97', 'fe80::fc16:3eff:fee5:ea20', 'fe80::8cd1:81ff:fea1:944', 'fe80::fc16:3eff:fe86:5388', 'fe80::5c44:a2ff:fe78:6c5f', 'fe80::fc16:3eff:fef2:dbb', 'fe80::fc16:3eff:fe8c:4068', 'fe80::9098:76ff:fe86:646f', 'fe80::fc16:3eff:fe33:fbde', 'fe80::6807:fff:fe4c:bed3'] 
May 28 10:11:57.544379 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:11:57.544598 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:11:57.544880 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:11:57.545154 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Updating existing volume attachment record: b0b8f244-68c9-4bee-a906-e7e70d0f9fa1 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:11:57.754280 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-5bda61aa-fc89-485f-a212-5eba7231a5c1 req-20857bd3-d43f-4079-96f6-16e096203f24 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:57.762728 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Took 7.72 seconds to spawn the instance on the hypervisor.
May 28 10:11:57.762995 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:11:57.792363 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:11:57.794004 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:11:57.885746 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:11:57.886243 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779963117.8859317, c0786416-dec3-4610-9ec2-389aa7508148 => ua-27d30a68-d569-4696-bcc3-6b1ed57ab61d> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 10:11:57.890109 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Successfully detached device vdb from instance c0786416-dec3-4610-9ec2-389aa7508148 from the live domain config.
May 28 10:11:57.891617 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:11:57.892144 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27d30a68-d569-4696-bcc3-6b1ed57ab61d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:11:57.892450 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:11:57.893012 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:11:57.893594 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27d30a68-d569-4696-bcc3-6b1ed57ab61d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:11:57.893868 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:11:57.928535 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:57.928535 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:57.928535 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:57.928535 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:57.928535 np0000001613 nova-compute[98321]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:57.928535 np0000001613 nova-compute[98321]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:57.928535 np0000001613 nova-compute[98321]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:57.928535 np0000001613 nova-compute[98321]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:57.928535 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:11:57.928845 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsi session list stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:57.928845 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:57.928845 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:57.928845 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:57.928845 np0000001613 nova-compute[98321]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:57.928845 np0000001613 nova-compute[98321]: tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d (non-flash)
May 28 10:11:57.928845 np0000001613 nova-compute[98321]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:57.928845 np0000001613 nova-compute[98321]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:57.928845 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:11:57.928845 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623', '150'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623', '151'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d', '155'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d', '156'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', '159'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', '160'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f', '161'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f', '162')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:11:57.929183 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', '160')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:11:57.930080 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d', '159')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:11:57.930862 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc413e20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d'): ({'sdf'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:11:57.931084 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Removing multipathed devices sdf, sdh {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:11:57.935652 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Flush multipath device 330000000e1557434 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:11:57.951070 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6babaefa-b0ed-4e75-b2ed-d12da7f4bfe0 req-5f24ca3a-98e7-4e3f-8aa9-33348aa5dacd service nova] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Received event network-vif-unplugged-a00c63db-98a2-46e6-ac78-c54d73edf1e8 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:11:57.951070 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6babaefa-b0ed-4e75-b2ed-d12da7f4bfe0 req-5f24ca3a-98e7-4e3f-8aa9-33348aa5dacd service nova] Acquiring lock "b4c26c83-b122-4b4a-a517-1701b23caf03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:57.951070 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6babaefa-b0ed-4e75-b2ed-d12da7f4bfe0 req-5f24ca3a-98e7-4e3f-8aa9-33348aa5dacd service nova] Lock "b4c26c83-b122-4b4a-a517-1701b23caf03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:57.951070 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6babaefa-b0ed-4e75-b2ed-d12da7f4bfe0 req-5f24ca3a-98e7-4e3f-8aa9-33348aa5dacd service nova] Lock "b4c26c83-b122-4b4a-a517-1701b23caf03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:57.951070 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6babaefa-b0ed-4e75-b2ed-d12da7f4bfe0 req-5f24ca3a-98e7-4e3f-8aa9-33348aa5dacd service nova] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] No waiting events found dispatching network-vif-unplugged-a00c63db-98a2-46e6-ac78-c54d73edf1e8 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:11:57.951070 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6babaefa-b0ed-4e75-b2ed-d12da7f4bfe0 req-5f24ca3a-98e7-4e3f-8aa9-33348aa5dacd service nova] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Received event network-vif-unplugged-a00c63db-98a2-46e6-ac78-c54d73edf1e8 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:11:57.951070 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6babaefa-b0ed-4e75-b2ed-d12da7f4bfe0 req-5f24ca3a-98e7-4e3f-8aa9-33348aa5dacd service nova] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Received event network-vif-deleted-a00c63db-98a2-46e6-ac78-c54d73edf1e8 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:11:57.951070 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-6babaefa-b0ed-4e75-b2ed-d12da7f4bfe0 req-5f24ca3a-98e7-4e3f-8aa9-33348aa5dacd service nova] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Neutron deleted interface a00c63db-98a2-46e6-ac78-c54d73edf1e8; detaching it from the instance and deleting it from the info cache
May 28 10:11:57.953019 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6babaefa-b0ed-4e75-b2ed-d12da7f4bfe0 req-5f24ca3a-98e7-4e3f-8aa9-33348aa5dacd service nova] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Detach interface failed, port_id=a00c63db-98a2-46e6-ac78-c54d73edf1e8, reason: Instance b4c26c83-b122-4b4a-a517-1701b23caf03 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:11:57.966500 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:11:57.969108 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:11:58.015624 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:11:58.061747 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Checking to see if SCSI volumes sdf, sdh have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:11:58.061972 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] SCSI volumes sdf, sdh have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:11:58.063052 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Checking to see if device paths {'sdf', 'sdh'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:11:58.076593 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Device paths {'sdf', 'sdh'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:11:58.076843 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:11:58.090113 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:58.100050 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:11:58.100408 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea', 'iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '836f0c06-aec5-4c9a-b1e7-3306787831ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:11:58.100584 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:11:58.108516 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-5bda61aa-fc89-485f-a212-5eba7231a5c1 req-20857bd3-d43f-4079-96f6-16e096203f24 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:11:58.124494 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 160, target: iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d, portal: 192.168.40.100,3260]
May 28 10:11:58.124494 np0000001613 nova-compute[98321]: Logout of [sid: 160, target: iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d, portal: 192.168.40.100,3260] successful.
May 28 10:11:58.124494 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:58.141351 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:58.154717 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:58.196542 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 159, target: iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d, portal: 192.168.50.100,3260]
May 28 10:11:58.196542 np0000001613 nova-compute[98321]: Logout of [sid: 159, target: iqn.2023-03.storpool.com:os--volume-27d30a68-d569-4696-bcc3-6b1ed57ab61d, portal: 192.168.50.100,3260] successful.
May 28 10:11:58.196542 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:58.215427 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:58.215632 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:11:58.215790 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] <== disconnect_volume: return (323ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:11:58.215932 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:11:58.217736 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.117s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:11:58.218022 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea', 'iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '836f0c06-aec5-4c9a-b1e7-3306787831ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:11:58.231139 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:11:58.231854 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:11:58.232367 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:11:58.232652 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:11:58.233065 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:11:58.233318 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:11:58.247311 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:11:58.247311 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:58.255931 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:11:58.255931 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:58.263587 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea] added
May 28 10:11:58.263587 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:11:58.263587 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:11:58.263587 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:11:58.263587 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:11:58.263587 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:11:58.263587 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:58.263937 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:11:58.263937 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0306(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:11:58.264017 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:11:58.268833 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-5bda61aa-fc89-485f-a212-5eba7231a5c1 req-20857bd3-d43f-4079-96f6-16e096203f24 service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Updated VIF entry in instance network info cache for port 19e2cc51-3e82-46f4-8d06-7406f2f72300. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:11:58.272178 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-5bda61aa-fc89-485f-a212-5eba7231a5c1 req-20857bd3-d43f-4079-96f6-16e096203f24 service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Updating instance_info_cache with network_info: [{"id": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "address": "fa:16:3e:83:3c:7d", "network": {"id": "db344666-4990-47d9-a3a2-9bebce64e660", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1492927350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44f9e47b0cb84ec9a96e9ee54854c98d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e2cc51-3e", "ovs_interfaceid": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:11:58.273552 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea] added
May 28 10:11:58.273552 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:11:58.273552 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:11:58.273552 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:11:58.273552 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:11:58.273552 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:11:58.273552 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:58.273763 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:11:58.273877 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0413(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:11:58.274040 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:11:58.275356 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Took 13.31 seconds to build instance.
May 28 10:11:58.476103 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Took 1.39 seconds to deallocate network for instance.
May 28 10:11:58.772571 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lazy-loading 'flavor' on Instance uuid c0786416-dec3-4610-9ec2-389aa7508148 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:11:58.775907 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5bda61aa-fc89-485f-a212-5eba7231a5c1 req-20857bd3-d43f-4079-96f6-16e096203f24 service nova] Releasing lock "refresh_cache-c0786416-dec3-4610-9ec2-389aa7508148" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:11:58.776625 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Lock "38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.822s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:58.982886 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b4b64156-e972-4c21-b23f-9d2d7cafb63a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:11:58.982886 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b4b64156-e972-4c21-b23f-9d2d7cafb63a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:11:59.264484 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:11:59.276260 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:11:59.287214 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:11:59.287214 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:11:59.298042 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:11:59.298042 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:59.310461 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:59.319934 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:59.334524 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:59.334524 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:59.334524 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:59.334524 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:59.334524 np0000001613 nova-compute[98321]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:59.334524 np0000001613 nova-compute[98321]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:59.334524 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:11:59.334524 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsi session list stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:59.334524 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:59.334524 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:59.334524 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:59.334524 np0000001613 nova-compute[98321]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:59.334524 np0000001613 nova-compute[98321]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:59.334524 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:11:59.339622 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:59.339622 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:59.339622 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:59.339622 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:59.339622 np0000001613 nova-compute[98321]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:59.339622 np0000001613 nova-compute[98321]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:59.339622 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:11:59.339943 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsi session list stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:59.339943 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:59.339943 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:59.339943 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:59.339943 np0000001613 nova-compute[98321]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:59.339943 np0000001613 nova-compute[98321]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:59.339943 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:11:59.373525 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea, portal: 192.168.40.100,3260]
May 28 10:11:59.373525 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea, portal: 192.168.40.100,3260] successful.
May 28 10:11:59.373525 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:59.386058 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea, portal: 192.168.50.100,3260]
May 28 10:11:59.386058 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea, portal: 192.168.50.100,3260] successful.
May 28 10:11:59.386058 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:59.391896 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:59.399425 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:11:59.414067 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:59.414067 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:59.414067 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:59.414067 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:59.414067 np0000001613 nova-compute[98321]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:59.414067 np0000001613 nova-compute[98321]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:59.414067 np0000001613 nova-compute[98321]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea (non-flash)
May 28 10:11:59.414067 np0000001613 nova-compute[98321]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea (non-flash)
May 28 10:11:59.414067 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:11:59.414350 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsi session list stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:59.414350 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:59.414350 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:59.414350 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:59.414350 np0000001613 nova-compute[98321]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:59.414350 np0000001613 nova-compute[98321]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:59.414350 np0000001613 nova-compute[98321]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea (non-flash)
May 28 10:11:59.414350 np0000001613 nova-compute[98321]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea (non-flash)
May 28 10:11:59.414350 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:11:59.414507 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.181s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:11:59.414579 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:11:59.415330 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] HCTL ('11', '-', '-', 0) found on session 165 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:11:59.415430 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:11:59.420325 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:59.420325 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:59.420325 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:59.420325 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:59.420325 np0000001613 nova-compute[98321]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:59.420325 np0000001613 nova-compute[98321]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:59.420325 np0000001613 nova-compute[98321]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea (non-flash)
May 28 10:11:59.420325 np0000001613 nova-compute[98321]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea (non-flash)
May 28 10:11:59.420325 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:11:59.420714 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsi session list stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:59.420714 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:11:59.420714 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:59.420714 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:11:59.420714 np0000001613 nova-compute[98321]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:59.420714 np0000001613 nova-compute[98321]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:11:59.420714 np0000001613 nova-compute[98321]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea (non-flash)
May 28 10:11:59.420714 np0000001613 nova-compute[98321]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea (non-flash)
May 28 10:11:59.420714 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:11:59.420714 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.188s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:11:59.421094 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:11:59.421710 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] HCTL ('13', '-', '-', 0) found on session 166 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:11:59.421864 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:11:59.438095 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Searching for a device in session 165 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:11:59.438095 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '836f0c06-aec5-4c9a-b1e7-3306787831ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:11:59.447503 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Searching for a device in session 166 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:11:59.447503 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '836f0c06-aec5-4c9a-b1e7-3306787831ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:11:59.585117 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b4b64156-e972-4c21-b23f-9d2d7cafb63a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:11:59.585396 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-b4b64156-e972-4c21-b23f-9d2d7cafb63a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:11:59.783520 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-68e6ff67-4e98-4726-a492-f15a2b6621a2 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "c0786416-dec3-4610-9ec2-389aa7508148" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.386s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:11:59.789977 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:11:59.790613 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:11:59.791599 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:11:59.791928 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:11:59.792352 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 10:11:59.792904 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:11:59.918394 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:00.007589 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d7012c1c-4d95-4ae2-8d48-a0b8237e283b req-c2f89ae6-6dcd-4f1d-aa40-9214356612cc service nova] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Received event network-changed-5891d2d0-85db-4fea-a75d-eda91bfd237d {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:12:00.007589 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d7012c1c-4d95-4ae2-8d48-a0b8237e283b req-c2f89ae6-6dcd-4f1d-aa40-9214356612cc service nova] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Refreshing instance network info cache due to event network-changed-5891d2d0-85db-4fea-a75d-eda91bfd237d. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:12:00.007589 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d7012c1c-4d95-4ae2-8d48-a0b8237e283b req-c2f89ae6-6dcd-4f1d-aa40-9214356612cc service nova] Acquiring lock "refresh_cache-38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:12:00.007804 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d7012c1c-4d95-4ae2-8d48-a0b8237e283b req-c2f89ae6-6dcd-4f1d-aa40-9214356612cc service nova] Acquired lock "refresh_cache-38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:12:00.007865 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-d7012c1c-4d95-4ae2-8d48-a0b8237e283b req-c2f89ae6-6dcd-4f1d-aa40-9214356612cc service nova] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Refreshing network info cache for port 5891d2d0-85db-4fea-a75d-eda91bfd237d {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:12:00.088459 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-b4b64156-e972-4c21-b23f-9d2d7cafb63a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:12:00.235733 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:12:00.297684 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:00.512450 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-d7012c1c-4d95-4ae2-8d48-a0b8237e283b req-c2f89ae6-6dcd-4f1d-aa40-9214356612cc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:00.596338 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b4b64156-e972-4c21-b23f-9d2d7cafb63a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.614s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:00.597724 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.299s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:00.597960 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:00.598128 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Auditing locally available compute resources for np0000001613 (node: np0000001613) {{(pid=98321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 10:12:00.654678 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-b4b64156-e972-4c21-b23f-9d2d7cafb63a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Deleted allocations for instance b4c26c83-b122-4b4a-a517-1701b23caf03
May 28 10:12:00.798896 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-d7012c1c-4d95-4ae2-8d48-a0b8237e283b req-c2f89ae6-6dcd-4f1d-aa40-9214356612cc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:00.925637 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-d7012c1c-4d95-4ae2-8d48-a0b8237e283b req-c2f89ae6-6dcd-4f1d-aa40-9214356612cc service nova] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Updated VIF entry in instance network info cache for port 5891d2d0-85db-4fea-a75d-eda91bfd237d. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:12:00.925899 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-d7012c1c-4d95-4ae2-8d48-a0b8237e283b req-c2f89ae6-6dcd-4f1d-aa40-9214356612cc service nova] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Updating instance_info_cache with network_info: [{"id": "5891d2d0-85db-4fea-a75d-eda91bfd237d", "address": "fa:16:3e:8c:40:68", "network": {"id": "446df521-2c31-4c3a-b11f-066d4fa34be7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-691863219-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12b2299852eb46bc9d4049993bba63c8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5891d2d0-85", "ovs_interfaceid": "5891d2d0-85db-4fea-a75d-eda91bfd237d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:12:01.250052 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Found WWN 3300000003f7ee433 for multipath device dm-2 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:12:01.250355 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:12:01.250628 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] <== connect_volume: return (3149ms) {'type': 'block', 'scsi_wwn': '3300000003f7ee433', 'path': '/dev/dm-2', 'multipath_id': '3300000003f7ee433'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:12:01.250770 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003f7ee433', 'path': '/dev/dm-2', 'multipath_id': '3300000003f7ee433'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:12:01.253569 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lazy-loading 'flavor' on Instance uuid 60cce3b4-1065-4568-9777-9b78ee43a55b {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:12:01.427879 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d7012c1c-4d95-4ae2-8d48-a0b8237e283b req-c2f89ae6-6dcd-4f1d-aa40-9214356612cc service nova] Releasing lock "refresh_cache-38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:12:01.574843 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:01.650351 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:12:01.677582 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b4b64156-e972-4c21-b23f-9d2d7cafb63a tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "b4c26c83-b122-4b4a-a517-1701b23caf03" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.483s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:01.757052 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Attempting to attach volume 836f0c06-aec5-4c9a-b1e7-3306787831ea with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 10:12:01.761499 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] attach device xml: <disk type="block" device="disk">
May 28 10:12:01.761499 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:12:01.761499 np0000001613 nova-compute[98321]:   <alias name="ua-836f0c06-aec5-4c9a-b1e7-3306787831ea"/>
May 28 10:12:01.761499 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-2"/>
May 28 10:12:01.761499 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:12:01.761499 np0000001613 nova-compute[98321]:   <serial>836f0c06-aec5-4c9a-b1e7-3306787831ea</serial>
May 28 10:12:01.761499 np0000001613 nova-compute[98321]: </disk>
May 28 10:12:01.761499 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 10:12:01.762413 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:12:01.762903 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:12:01.850271 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ab3c680d-e82b-4592-bd19-96fef7501300 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "c0786416-dec3-4610-9ec2-389aa7508148" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:01.850271 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ab3c680d-e82b-4592-bd19-96fef7501300 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "c0786416-dec3-4610-9ec2-389aa7508148" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:01.850727 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ab3c680d-e82b-4592-bd19-96fef7501300 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "c0786416-dec3-4610-9ec2-389aa7508148-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:01.851059 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ab3c680d-e82b-4592-bd19-96fef7501300 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "c0786416-dec3-4610-9ec2-389aa7508148-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:01.851387 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ab3c680d-e82b-4592-bd19-96fef7501300 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "c0786416-dec3-4610-9ec2-389aa7508148-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:01.854584 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-ab3c680d-e82b-4592-bd19-96fef7501300 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Terminating instance
May 28 10:12:01.861160 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:12:01.866940 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:12:02.000666 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:12:02.001219 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:12:02.107028 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:12:02.113477 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:12:02.114889 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:12:02.118904 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60cce3b4-1065-4568-9777-9b78ee43a55b/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:12:02.207723 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60cce3b4-1065-4568-9777-9b78ee43a55b/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:12:02.210935 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60cce3b4-1065-4568-9777-9b78ee43a55b/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:12:02.303435 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60cce3b4-1065-4568-9777-9b78ee43a55b/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:12:02.304441 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-2 (vdb) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:12:02.309778 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f42f06fc-5b0c-4973-98db-cd594815f317/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:12:02.359267 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ab3c680d-e82b-4592-bd19-96fef7501300 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:12:02.390674 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:02.395641 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:02.404912 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f42f06fc-5b0c-4973-98db-cd594815f317/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:12:02.406887 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f42f06fc-5b0c-4973-98db-cd594815f317/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:12:02.426295 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:02.453522 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:02.527374 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f42f06fc-5b0c-4973-98db-cd594815f317/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:12:02.533730 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-5 (vda) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:12:02.535897 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8849d62e-d9a4-4285-95fc-0869cbf20b4c/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:12:02.583824 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-39a09882-4135-467d-95fd-81a2a9cd53fb req-ca0d4e31-200c-49cc-9825-a889f09173de service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Received event network-vif-unplugged-19e2cc51-3e82-46f4-8d06-7406f2f72300 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:12:02.589236 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-39a09882-4135-467d-95fd-81a2a9cd53fb req-ca0d4e31-200c-49cc-9825-a889f09173de service nova] Acquiring lock "c0786416-dec3-4610-9ec2-389aa7508148-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:02.589236 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-39a09882-4135-467d-95fd-81a2a9cd53fb req-ca0d4e31-200c-49cc-9825-a889f09173de service nova] Lock "c0786416-dec3-4610-9ec2-389aa7508148-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:02.589236 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-39a09882-4135-467d-95fd-81a2a9cd53fb req-ca0d4e31-200c-49cc-9825-a889f09173de service nova] Lock "c0786416-dec3-4610-9ec2-389aa7508148-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:02.589236 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-39a09882-4135-467d-95fd-81a2a9cd53fb req-ca0d4e31-200c-49cc-9825-a889f09173de service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] No waiting events found dispatching network-vif-unplugged-19e2cc51-3e82-46f4-8d06-7406f2f72300 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:12:02.589236 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-39a09882-4135-467d-95fd-81a2a9cd53fb req-ca0d4e31-200c-49cc-9825-a889f09173de service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Received event network-vif-unplugged-19e2cc51-3e82-46f4-8d06-7406f2f72300 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:12:02.632003 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8849d62e-d9a4-4285-95fc-0869cbf20b4c/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:12:02.632499 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8849d62e-d9a4-4285-95fc-0869cbf20b4c/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:12:02.713470 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.99924623700008 future=<Future at 0x73c1fc157bf0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:12:02.715720 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Instance destroyed successfully.
May 28 10:12:02.716684 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-ab3c680d-e82b-4592-bd19-96fef7501300 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lazy-loading 'resources' on Instance uuid c0786416-dec3-4610-9ec2-389aa7508148 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:12:02.744422 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8849d62e-d9a4-4285-95fc-0869cbf20b4c/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:12:02.747676 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:12:02.748945 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:12:02.800210 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "env LANG=C uptime" returned: 0 in 0.051s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:12:02.801068 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Hypervisor/Node resource view: name=np0000001613 free_ram=11202MB free_disk=72.60194396972656GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 10:12:02.801272 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:02.801550 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:03.220438 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-ab3c680d-e82b-4592-bd19-96fef7501300 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:10:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1785992036',display_name='tempest-TestMinimumBasicScenario-server-1785992036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testminimumbasicscenario-server-1785992036',id=59,image_ref='63b9de52-b76c-44d7-9e19-2bbc39bd37e6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLiX2kC72bgYbEtDTMsYzL9SD3voo9GX+cDAL0WmMYth6F/EEwHtRxRiF7vbmxiGKhT5mQtsmFOUJpBjXEXu5cbRVXGqFCdGspdUukikdpy3iovlWAZ00U6u/U2VnwRLtQ==',key_name='tempest-TestMinimumBasicScenario-1728575637',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:10:21Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44f9e47b0cb84ec9a96e9ee54854c98d',ramdisk_id='',reservation_id='r-8k0nmdmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='63b9de52-b76c-44d7-9e19-2bbc39bd37e6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-63484617',owner_user_name='tempest-TestMinimumBasicScenario-63484617-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:11:17Z,user_data=None,user_id='4631f2d316394d08825f7c3295412feb',uuid=c0786416-dec3-4610-9ec2-389aa7508148,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "address": "fa:16:3e:83:3c:7d", "network": {"id": "db344666-4990-47d9-a3a2-9bebce64e660", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1492927350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44f9e47b0cb84ec9a96e9ee54854c98d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e2cc51-3e", "ovs_interfaceid": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:12:03.220732 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ab3c680d-e82b-4592-bd19-96fef7501300 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Converting VIF {"id": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "address": "fa:16:3e:83:3c:7d", "network": {"id": "db344666-4990-47d9-a3a2-9bebce64e660", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1492927350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44f9e47b0cb84ec9a96e9ee54854c98d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e2cc51-3e", "ovs_interfaceid": "19e2cc51-3e82-46f4-8d06-7406f2f72300", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:12:03.221372 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ab3c680d-e82b-4592-bd19-96fef7501300 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:3c:7d,bridge_name='br-int',has_traffic_filtering=True,id=19e2cc51-3e82-46f4-8d06-7406f2f72300,network=Network(db344666-4990-47d9-a3a2-9bebce64e660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19e2cc51-3e') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:12:03.221618 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-ab3c680d-e82b-4592-bd19-96fef7501300 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:3c:7d,bridge_name='br-int',has_traffic_filtering=True,id=19e2cc51-3e82-46f4-8d06-7406f2f72300,network=Network(db344666-4990-47d9-a3a2-9bebce64e660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19e2cc51-3e') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:12:03.223948 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:03.224446 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19e2cc51-3e, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:12:03.239141 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:12:03.242393 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:03.242577 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d12e16e-5374-48b8-938d-976952b6df37) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:12:03.243437 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:03.244032 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:12:03.244497 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:03.248354 np0000001613 nova-compute[98321]: INFO os_vif [None req-ab3c680d-e82b-4592-bd19-96fef7501300 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:3c:7d,bridge_name='br-int',has_traffic_filtering=True,id=19e2cc51-3e82-46f4-8d06-7406f2f72300,network=Network(db344666-4990-47d9-a3a2-9bebce64e660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19e2cc51-3e')
May 28 10:12:03.248354 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-ab3c680d-e82b-4592-bd19-96fef7501300 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Deleting instance files /opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148_del
May 28 10:12:03.249116 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-ab3c680d-e82b-4592-bd19-96fef7501300 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Deletion of /opt/stack/data/nova/instances/c0786416-dec3-4610-9ec2-389aa7508148_del complete
May 28 10:12:03.461739 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:12:03.462242 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:12:03.462242 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:12:03.462242 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] No VIF found with MAC fa:16:3e:e5:ea:20, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:12:03.755619 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-ab3c680d-e82b-4592-bd19-96fef7501300 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Took 1.40 seconds to destroy the instance on the hypervisor.
May 28 10:12:03.756505 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-ab3c680d-e82b-4592-bd19-96fef7501300 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:12:03.756933 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:12:03.757148 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: c0786416-dec3-4610-9ec2-389aa7508148] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:12:03.757738 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:03.861652 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:03.865596 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance f42f06fc-5b0c-4973-98db-cd594815f317 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:12:03.865722 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance c0786416-dec3-4610-9ec2-389aa7508148 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:12:03.865816 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:12:03.865905 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance b51e6cdd-7556-41bf-ab93-24495d4e3d03 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:12:03.865983 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 60cce3b4-1065-4568-9777-9b78ee43a55b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:12:03.866079 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 8849d62e-d9a4-4285-95fc-0869cbf20b4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:12:03.866181 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance c57fd7fa-e4b8-4620-89ce-34be56feb58e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:12:03.866258 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:12:03.866436 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 10:12:03.866553 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Final resource view: name=np0000001613 phys_ram=24030MB used_ram=2048MB phys_disk=95GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 10:12:02 up 44 min,  2 users,  load average: 7.48, 7.40, 5.39\n', 'num_instances': '8', 'num_vm_active': '8', 'num_task_None': '7', 'num_os_type_None': '8', 'num_proj_ba63ea134a6e4fe1992f53a0da46d034': '1', 'io_workload': '0', 'num_task_deleting': '1', 'num_proj_44f9e47b0cb84ec9a96e9ee54854c98d': '1', 'num_proj_23e9651268114327a9cc6c6c59bef01e': '2', 'num_proj_24a7b4447be44babbc8cb7d9d09c1e76': '1', 'num_proj_a4bbdf692768465db607aa60a630e5e2': '1', 'num_proj_6e3e75c7b1bb425fbec695f663a73daf': '1', 'num_proj_12b2299852eb46bc9d4049993bba63c8': '1'} {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 10:12:04.287817 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:12:04.288305 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:12:04.652638 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:12:04.658366 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8f86983f-0c3a-4814-ae07-9163a2d87e2f req-e94c8394-6266-4f09-8e9a-b90c594bfb23 service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Received event network-vif-unplugged-19e2cc51-3e82-46f4-8d06-7406f2f72300 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:12:04.660104 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8f86983f-0c3a-4814-ae07-9163a2d87e2f req-e94c8394-6266-4f09-8e9a-b90c594bfb23 service nova] Acquiring lock "c0786416-dec3-4610-9ec2-389aa7508148-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:04.660243 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8f86983f-0c3a-4814-ae07-9163a2d87e2f req-e94c8394-6266-4f09-8e9a-b90c594bfb23 service nova] Lock "c0786416-dec3-4610-9ec2-389aa7508148-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:04.660346 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8f86983f-0c3a-4814-ae07-9163a2d87e2f req-e94c8394-6266-4f09-8e9a-b90c594bfb23 service nova] Lock "c0786416-dec3-4610-9ec2-389aa7508148-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:04.660514 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8f86983f-0c3a-4814-ae07-9163a2d87e2f req-e94c8394-6266-4f09-8e9a-b90c594bfb23 service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] No waiting events found dispatching network-vif-unplugged-19e2cc51-3e82-46f4-8d06-7406f2f72300 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:12:04.660629 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8f86983f-0c3a-4814-ae07-9163a2d87e2f req-e94c8394-6266-4f09-8e9a-b90c594bfb23 service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Received event network-vif-unplugged-19e2cc51-3e82-46f4-8d06-7406f2f72300 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:12:04.660692 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8f86983f-0c3a-4814-ae07-9163a2d87e2f req-e94c8394-6266-4f09-8e9a-b90c594bfb23 service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Received event network-vif-deleted-19e2cc51-3e82-46f4-8d06-7406f2f72300 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:12:04.660848 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-8f86983f-0c3a-4814-ae07-9163a2d87e2f req-e94c8394-6266-4f09-8e9a-b90c594bfb23 service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Neutron deleted interface 19e2cc51-3e82-46f4-8d06-7406f2f72300; detaching it from the instance and deleting it from the info cache
May 28 10:12:04.666215 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8f86983f-0c3a-4814-ae07-9163a2d87e2f req-e94c8394-6266-4f09-8e9a-b90c594bfb23 service nova] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Detach interface failed, port_id=19e2cc51-3e82-46f4-8d06-7406f2f72300, reason: Instance c0786416-dec3-4610-9ec2-389aa7508148 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:12:04.715063 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-12a39813-1c4f-4e20-befb-83c816a87204 req-abe9a434-57ff-4195-aa2f-18106e6d1b48 service nova] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Received event network-changed-d9ced81c-77d5-4b25-a984-054f5dd0a4ac {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:12:04.715229 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-12a39813-1c4f-4e20-befb-83c816a87204 req-abe9a434-57ff-4195-aa2f-18106e6d1b48 service nova] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Refreshing instance network info cache due to event network-changed-d9ced81c-77d5-4b25-a984-054f5dd0a4ac. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:12:04.715383 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-12a39813-1c4f-4e20-befb-83c816a87204 req-abe9a434-57ff-4195-aa2f-18106e6d1b48 service nova] Acquiring lock "refresh_cache-b51e6cdd-7556-41bf-ab93-24495d4e3d03" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:12:04.715468 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-12a39813-1c4f-4e20-befb-83c816a87204 req-abe9a434-57ff-4195-aa2f-18106e6d1b48 service nova] Acquired lock "refresh_cache-b51e6cdd-7556-41bf-ab93-24495d4e3d03" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:12:04.715572 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-12a39813-1c4f-4e20-befb-83c816a87204 req-abe9a434-57ff-4195-aa2f-18106e6d1b48 service nova] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Refreshing network info cache for port d9ced81c-77d5-4b25-a984-054f5dd0a4ac {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:12:04.790642 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:12:04.920541 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:05.030557 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-980ebd30-f3c4-4a05-999b-1d1398dadef9 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "60cce3b4-1065-4568-9777-9b78ee43a55b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.654s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:05.054216 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2517fcd5-6412-4514-bc1c-fdeb103d9643 req-0b3c1057-50e9-4f7d-96b8-47c0d5389bc4 service nova] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Received event network-changed-58c8c13b-5e85-402b-9c1b-900748ac5b1a {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:12:05.054599 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2517fcd5-6412-4514-bc1c-fdeb103d9643 req-0b3c1057-50e9-4f7d-96b8-47c0d5389bc4 service nova] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Refreshing instance network info cache due to event network-changed-58c8c13b-5e85-402b-9c1b-900748ac5b1a. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:12:05.054816 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2517fcd5-6412-4514-bc1c-fdeb103d9643 req-0b3c1057-50e9-4f7d-96b8-47c0d5389bc4 service nova] Acquiring lock "refresh_cache-f42f06fc-5b0c-4973-98db-cd594815f317" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:12:05.054956 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2517fcd5-6412-4514-bc1c-fdeb103d9643 req-0b3c1057-50e9-4f7d-96b8-47c0d5389bc4 service nova] Acquired lock "refresh_cache-f42f06fc-5b0c-4973-98db-cd594815f317" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:12:05.055102 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-2517fcd5-6412-4514-bc1c-fdeb103d9643 req-0b3c1057-50e9-4f7d-96b8-47c0d5389bc4 service nova] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Refreshing network info cache for port 58c8c13b-5e85-402b-9c1b-900748ac5b1a {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:12:05.156526 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Took 1.40 seconds to deallocate network for instance.
May 28 10:12:05.217507 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-12a39813-1c4f-4e20-befb-83c816a87204 req-abe9a434-57ff-4195-aa2f-18106e6d1b48 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:05.240459 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Acquiring lock "b51e6cdd-7556-41bf-ab93-24495d4e3d03" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:05.240694 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Lock "b51e6cdd-7556-41bf-ab93-24495d4e3d03" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:05.240935 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Acquiring lock "b51e6cdd-7556-41bf-ab93-24495d4e3d03-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:05.241108 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Lock "b51e6cdd-7556-41bf-ab93-24495d4e3d03-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:05.241301 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Lock "b51e6cdd-7556-41bf-ab93-24495d4e3d03-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:05.246228 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Terminating instance
May 28 10:12:05.299380 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Compute_service record updated for np0000001613:np0000001613 {{(pid=98321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 10:12:05.299482 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.498s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:05.300238 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:12:05.499117 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-12a39813-1c4f-4e20-befb-83c816a87204 req-abe9a434-57ff-4195-aa2f-18106e6d1b48 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:05.560287 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-2517fcd5-6412-4514-bc1c-fdeb103d9643 req-0b3c1057-50e9-4f7d-96b8-47c0d5389bc4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:05.564453 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-238bf53c-d028-45d3-a96c-f49b05bff332 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Acquiring lock "f42f06fc-5b0c-4973-98db-cd594815f317" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:05.564650 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-238bf53c-d028-45d3-a96c-f49b05bff332 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "f42f06fc-5b0c-4973-98db-cd594815f317" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:05.564898 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-238bf53c-d028-45d3-a96c-f49b05bff332 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Acquiring lock "f42f06fc-5b0c-4973-98db-cd594815f317-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:05.565047 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-238bf53c-d028-45d3-a96c-f49b05bff332 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "f42f06fc-5b0c-4973-98db-cd594815f317-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:05.565180 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-238bf53c-d028-45d3-a96c-f49b05bff332 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "f42f06fc-5b0c-4973-98db-cd594815f317-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:05.567363 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-238bf53c-d028-45d3-a96c-f49b05bff332 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Terminating instance
May 28 10:12:05.662224 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-12a39813-1c4f-4e20-befb-83c816a87204 req-abe9a434-57ff-4195-aa2f-18106e6d1b48 service nova] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Updated VIF entry in instance network info cache for port d9ced81c-77d5-4b25-a984-054f5dd0a4ac. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:12:05.662579 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-12a39813-1c4f-4e20-befb-83c816a87204 req-abe9a434-57ff-4195-aa2f-18106e6d1b48 service nova] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Updating instance_info_cache with network_info: [{"id": "d9ced81c-77d5-4b25-a984-054f5dd0a4ac", "address": "fa:16:3e:88:d1:c6", "network": {"id": "4638034a-36e0-4524-a643-bd5fb2c5d03a", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1792230061-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "24a7b4447be44babbc8cb7d9d09c1e76", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ced81c-77", "ovs_interfaceid": "d9ced81c-77d5-4b25-a984-054f5dd0a4ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:12:05.668267 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ab3c680d-e82b-4592-bd19-96fef7501300 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:05.668432 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ab3c680d-e82b-4592-bd19-96fef7501300 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:05.751828 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:12:05.777767 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:05.788910 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:05.809721 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:05.819540 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:05.842288 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:05.974853 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-2517fcd5-6412-4514-bc1c-fdeb103d9643 req-0b3c1057-50e9-4f7d-96b8-47c0d5389bc4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:06.075990 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-238bf53c-d028-45d3-a96c-f49b05bff332 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:12:06.104202 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.99971705300004 future=<Future at 0x73c1fc2f7fe0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:12:06.105116 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Instance destroyed successfully.
May 28 10:12:06.105116 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Lazy-loading 'resources' on Instance uuid b51e6cdd-7556-41bf-ab93-24495d4e3d03 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:12:06.119832 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:06.139716 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:06.142679 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:06.164925 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-12a39813-1c4f-4e20-befb-83c816a87204 req-abe9a434-57ff-4195-aa2f-18106e6d1b48 service nova] Releasing lock "refresh_cache-b51e6cdd-7556-41bf-ab93-24495d4e3d03" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:12:06.176505 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:06.186394 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ab3c680d-e82b-4592-bd19-96fef7501300 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:12:06.186921 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-ab3c680d-e82b-4592-bd19-96fef7501300 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:12:06.212359 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-2517fcd5-6412-4514-bc1c-fdeb103d9643 req-0b3c1057-50e9-4f7d-96b8-47c0d5389bc4 service nova] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Updated VIF entry in instance network info cache for port 58c8c13b-5e85-402b-9c1b-900748ac5b1a. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:12:06.212812 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-2517fcd5-6412-4514-bc1c-fdeb103d9643 req-0b3c1057-50e9-4f7d-96b8-47c0d5389bc4 service nova] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Updating instance_info_cache with network_info: [{"id": "58c8c13b-5e85-402b-9c1b-900748ac5b1a", "address": "fa:16:3e:33:fb:de", "network": {"id": "233ff488-7baf-4369-9054-b24499b82bab", "bridge": "br-int", "label": "tempest-TestStampPattern-854727558-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba63ea134a6e4fe1992f53a0da46d034", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c8c13b-5e", "ovs_interfaceid": "58c8c13b-5e85-402b-9c1b-900748ac5b1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:12:06.418935 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999764501999834 future=<Future at 0x73c1fc155880 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:12:06.419839 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Instance destroyed successfully.
May 28 10:12:06.420364 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-238bf53c-d028-45d3-a96c-f49b05bff332 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lazy-loading 'resources' on Instance uuid f42f06fc-5b0c-4973-98db-cd594815f317 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:12:06.607443 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:10:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-1239841217',display_name='tempest-TestVolumeBackupRestore-server-1239841217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebackuprestore-server-1239841217',id=61,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1IKD7EdkNHiiDyibS2/QThQNCvbbv5Lj6MAY6q4XRGAXzGZF7E8Ie6LU1Z0lEzgwmtr+C6tzix+eQniG7QVaeYOag0OQIb8MLZcYjS/Z/j674exChHmL//AUvemK4sRw==',key_name='tempest-TestVolumeBackupRestore-39710801',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:10:58Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='24a7b4447be44babbc8cb7d9d09c1e76',ramdisk_id='',reservation_id='r-p9d0fbrk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBackupRestore-1977101720',owner_user_name='tempest-TestVolumeBackupRestore-1977101720-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:10:58Z,user_data=None,user_id='aa5dd2b739b04d2c97c592939c03a2c8',uuid=b51e6cdd-7556-41bf-ab93-24495d4e3d03,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9ced81c-77d5-4b25-a984-054f5dd0a4ac", "address": "fa:16:3e:88:d1:c6", "network": {"id": "4638034a-36e0-4524-a643-bd5fb2c5d03a", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1792230061-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "24a7b4447be44babbc8cb7d9d09c1e76", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ced81c-77", "ovs_interfaceid": "d9ced81c-77d5-4b25-a984-054f5dd0a4ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:12:06.607625 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Converting VIF {"id": "d9ced81c-77d5-4b25-a984-054f5dd0a4ac", "address": "fa:16:3e:88:d1:c6", "network": {"id": "4638034a-36e0-4524-a643-bd5fb2c5d03a", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1792230061-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "24a7b4447be44babbc8cb7d9d09c1e76", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ced81c-77", "ovs_interfaceid": "d9ced81c-77d5-4b25-a984-054f5dd0a4ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:12:06.608086 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:d1:c6,bridge_name='br-int',has_traffic_filtering=True,id=d9ced81c-77d5-4b25-a984-054f5dd0a4ac,network=Network(4638034a-36e0-4524-a643-bd5fb2c5d03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9ced81c-77') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:12:06.608321 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:d1:c6,bridge_name='br-int',has_traffic_filtering=True,id=d9ced81c-77d5-4b25-a984-054f5dd0a4ac,network=Network(4638034a-36e0-4524-a643-bd5fb2c5d03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9ced81c-77') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:12:06.610040 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:06.610422 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9ced81c-77, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:12:06.612781 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:06.613849 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:12:06.617026 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:06.617873 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:06.618022 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=161600b3-4646-4b3e-897c-d9fff8d924b7) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:12:06.619518 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:12:06.623502 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:06.625152 np0000001613 nova-compute[98321]: INFO os_vif [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:d1:c6,bridge_name='br-int',has_traffic_filtering=True,id=d9ced81c-77d5-4b25-a984-054f5dd0a4ac,network=Network(4638034a-36e0-4524-a643-bd5fb2c5d03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9ced81c-77')
May 28 10:12:06.626854 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:12:06.627136 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d', 'iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '31209469-afde-4316-8798-ce950e49a11d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:12:06.627314 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:12:06.627649 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:12:06.627962 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d', 'iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '31209469-afde-4316-8798-ce950e49a11d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:12:06.628104 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:12:06.656459 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:06.656459 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:06.656459 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:12:06.656459 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:12:06.656459 np0000001613 nova-compute[98321]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:12:06.656459 np0000001613 nova-compute[98321]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:12:06.656459 np0000001613 nova-compute[98321]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea (non-flash)
May 28 10:12:06.656459 np0000001613 nova-compute[98321]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea (non-flash)
May 28 10:12:06.656459 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:12:06.656805 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] iscsi session list stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:06.656805 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:06.656805 np0000001613 nova-compute[98321]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:12:06.656805 np0000001613 nova-compute[98321]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d (non-flash)
May 28 10:12:06.656805 np0000001613 nova-compute[98321]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:12:06.656805 np0000001613 nova-compute[98321]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:12:06.656805 np0000001613 nova-compute[98321]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea (non-flash)
May 28 10:12:06.656805 np0000001613 nova-compute[98321]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea (non-flash)
May 28 10:12:06.656805 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:12:06.656805 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623', '150'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623', '151'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d', '155'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d', '156'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f', '161'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f', '162'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea', '165'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea', '166')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:12:06.657020 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d', '155')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:12:06.657896 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d', '156')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:12:06.658679 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc772e80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d'): ({'sdj'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:12:06.658891 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Removing multipathed devices sdg, sdj {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:12:06.659104 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Flush multipath device 330000000dfc66705 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:12:06.689943 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-ab3c680d-e82b-4592-bd19-96fef7501300 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:12:06.711197 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:12:06.716871 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2517fcd5-6412-4514-bc1c-fdeb103d9643 req-0b3c1057-50e9-4f7d-96b8-47c0d5389bc4 service nova] Releasing lock "refresh_cache-f42f06fc-5b0c-4973-98db-cd594815f317" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:12:06.764556 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:12:06.774388 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d6ab76ae-336f-4353-b160-68e93a2aa569 req-9019662d-8d64-4ecf-a362-53a6da4a83d5 service nova] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Received event network-vif-unplugged-d9ced81c-77d5-4b25-a984-054f5dd0a4ac {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:12:06.774584 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d6ab76ae-336f-4353-b160-68e93a2aa569 req-9019662d-8d64-4ecf-a362-53a6da4a83d5 service nova] Acquiring lock "b51e6cdd-7556-41bf-ab93-24495d4e3d03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:06.774777 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d6ab76ae-336f-4353-b160-68e93a2aa569 req-9019662d-8d64-4ecf-a362-53a6da4a83d5 service nova] Lock "b51e6cdd-7556-41bf-ab93-24495d4e3d03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:06.774916 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d6ab76ae-336f-4353-b160-68e93a2aa569 req-9019662d-8d64-4ecf-a362-53a6da4a83d5 service nova] Lock "b51e6cdd-7556-41bf-ab93-24495d4e3d03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:06.775048 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d6ab76ae-336f-4353-b160-68e93a2aa569 req-9019662d-8d64-4ecf-a362-53a6da4a83d5 service nova] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] No waiting events found dispatching network-vif-unplugged-d9ced81c-77d5-4b25-a984-054f5dd0a4ac {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:12:06.775196 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d6ab76ae-336f-4353-b160-68e93a2aa569 req-9019662d-8d64-4ecf-a362-53a6da4a83d5 service nova] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Received event network-vif-unplugged-d9ced81c-77d5-4b25-a984-054f5dd0a4ac for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:12:06.775842 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d6ab76ae-336f-4353-b160-68e93a2aa569 req-9019662d-8d64-4ecf-a362-53a6da4a83d5 service nova] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Received event network-vif-unplugged-d9ced81c-77d5-4b25-a984-054f5dd0a4ac {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:12:06.775842 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d6ab76ae-336f-4353-b160-68e93a2aa569 req-9019662d-8d64-4ecf-a362-53a6da4a83d5 service nova] Acquiring lock "b51e6cdd-7556-41bf-ab93-24495d4e3d03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:06.776044 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d6ab76ae-336f-4353-b160-68e93a2aa569 req-9019662d-8d64-4ecf-a362-53a6da4a83d5 service nova] Lock "b51e6cdd-7556-41bf-ab93-24495d4e3d03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:06.776044 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d6ab76ae-336f-4353-b160-68e93a2aa569 req-9019662d-8d64-4ecf-a362-53a6da4a83d5 service nova] Lock "b51e6cdd-7556-41bf-ab93-24495d4e3d03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:06.776217 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d6ab76ae-336f-4353-b160-68e93a2aa569 req-9019662d-8d64-4ecf-a362-53a6da4a83d5 service nova] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] No waiting events found dispatching network-vif-unplugged-d9ced81c-77d5-4b25-a984-054f5dd0a4ac {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:12:06.776831 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d6ab76ae-336f-4353-b160-68e93a2aa569 req-9019662d-8d64-4ecf-a362-53a6da4a83d5 service nova] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Received event network-vif-unplugged-d9ced81c-77d5-4b25-a984-054f5dd0a4ac for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:12:06.776831 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d6ab76ae-336f-4353-b160-68e93a2aa569 req-9019662d-8d64-4ecf-a362-53a6da4a83d5 service nova] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Received event network-vif-unplugged-58c8c13b-5e85-402b-9c1b-900748ac5b1a {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:12:06.776831 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d6ab76ae-336f-4353-b160-68e93a2aa569 req-9019662d-8d64-4ecf-a362-53a6da4a83d5 service nova] Acquiring lock "f42f06fc-5b0c-4973-98db-cd594815f317-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:06.776831 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d6ab76ae-336f-4353-b160-68e93a2aa569 req-9019662d-8d64-4ecf-a362-53a6da4a83d5 service nova] Lock "f42f06fc-5b0c-4973-98db-cd594815f317-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:06.776966 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d6ab76ae-336f-4353-b160-68e93a2aa569 req-9019662d-8d64-4ecf-a362-53a6da4a83d5 service nova] Lock "f42f06fc-5b0c-4973-98db-cd594815f317-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:06.776966 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d6ab76ae-336f-4353-b160-68e93a2aa569 req-9019662d-8d64-4ecf-a362-53a6da4a83d5 service nova] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] No waiting events found dispatching network-vif-unplugged-58c8c13b-5e85-402b-9c1b-900748ac5b1a {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:12:06.777221 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d6ab76ae-336f-4353-b160-68e93a2aa569 req-9019662d-8d64-4ecf-a362-53a6da4a83d5 service nova] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Received event network-vif-unplugged-58c8c13b-5e85-402b-9c1b-900748ac5b1a for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:12:06.777221 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d6ab76ae-336f-4353-b160-68e93a2aa569 req-9019662d-8d64-4ecf-a362-53a6da4a83d5 service nova] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Received event network-vif-unplugged-58c8c13b-5e85-402b-9c1b-900748ac5b1a {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:12:06.777299 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d6ab76ae-336f-4353-b160-68e93a2aa569 req-9019662d-8d64-4ecf-a362-53a6da4a83d5 service nova] Acquiring lock "f42f06fc-5b0c-4973-98db-cd594815f317-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:06.777428 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d6ab76ae-336f-4353-b160-68e93a2aa569 req-9019662d-8d64-4ecf-a362-53a6da4a83d5 service nova] Lock "f42f06fc-5b0c-4973-98db-cd594815f317-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:06.777480 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d6ab76ae-336f-4353-b160-68e93a2aa569 req-9019662d-8d64-4ecf-a362-53a6da4a83d5 service nova] Lock "f42f06fc-5b0c-4973-98db-cd594815f317-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:06.777578 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d6ab76ae-336f-4353-b160-68e93a2aa569 req-9019662d-8d64-4ecf-a362-53a6da4a83d5 service nova] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] No waiting events found dispatching network-vif-unplugged-58c8c13b-5e85-402b-9c1b-900748ac5b1a {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:12:06.777674 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d6ab76ae-336f-4353-b160-68e93a2aa569 req-9019662d-8d64-4ecf-a362-53a6da4a83d5 service nova] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Received event network-vif-unplugged-58c8c13b-5e85-402b-9c1b-900748ac5b1a for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:12:06.809448 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Checking to see if SCSI volumes sdg, sdj have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:12:06.809597 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] SCSI volumes sdg, sdj have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:12:06.810685 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Checking to see if device paths {'sdg', 'sdj'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:12:06.821728 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Device paths {'sdg', 'sdj'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:12:06.821895 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:12:06.832726 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:06.860996 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 155, target: iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d, portal: 192.168.40.100,3260]
May 28 10:12:06.860996 np0000001613 nova-compute[98321]: Logout of [sid: 155, target: iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d, portal: 192.168.40.100,3260] successful.
May 28 10:12:06.860996 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:06.878218 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:06.889787 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:06.919583 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 156, target: iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d, portal: 192.168.50.100,3260]
May 28 10:12:06.919583 np0000001613 nova-compute[98321]: Logout of [sid: 156, target: iqn.2023-03.storpool.com:os--volume-31209469-afde-4316-8798-ce950e49a11d, portal: 192.168.50.100,3260] successful.
May 28 10:12:06.919583 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:06.922682 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-238bf53c-d028-45d3-a96c-f49b05bff332 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:09:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1380522586',display_name='tempest-TestStampPattern-server-1380522586',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-teststamppattern-server-1380522586',id=56,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYM/OccL4UHt9TwzRUM2NoxErdXFvJSjsBY3qW0TdqZb62VjSt3Qhb8ydQXj0m7ruuXson/l4HMWZVUlPSmKQS9NgOeLgHIKDS6cwgmeUrB5A+zdtBT5AYw72WB234Frg==',key_name='tempest-TestStampPattern-550069760',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:09:38Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba63ea134a6e4fe1992f53a0da46d034',ramdisk_id='',reservation_id='r-kno8wxh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-414594070',owner_user_name='tempest-TestStampPattern-414594070-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:10:44Z,user_data=None,user_id='cda3cde4813d436b9f875ba96f496882',uuid=f42f06fc-5b0c-4973-98db-cd594815f317,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58c8c13b-5e85-402b-9c1b-900748ac5b1a", "address": "fa:16:3e:33:fb:de", "network": {"id": "233ff488-7baf-4369-9054-b24499b82bab", "bridge": "br-int", "label": "tempest-TestStampPattern-854727558-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba63ea134a6e4fe1992f53a0da46d034", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c8c13b-5e", "ovs_interfaceid": "58c8c13b-5e85-402b-9c1b-900748ac5b1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:12:06.922838 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-238bf53c-d028-45d3-a96c-f49b05bff332 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Converting VIF {"id": "58c8c13b-5e85-402b-9c1b-900748ac5b1a", "address": "fa:16:3e:33:fb:de", "network": {"id": "233ff488-7baf-4369-9054-b24499b82bab", "bridge": "br-int", "label": "tempest-TestStampPattern-854727558-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba63ea134a6e4fe1992f53a0da46d034", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58c8c13b-5e", "ovs_interfaceid": "58c8c13b-5e85-402b-9c1b-900748ac5b1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:12:06.923352 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-238bf53c-d028-45d3-a96c-f49b05bff332 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:fb:de,bridge_name='br-int',has_traffic_filtering=True,id=58c8c13b-5e85-402b-9c1b-900748ac5b1a,network=Network(233ff488-7baf-4369-9054-b24499b82bab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58c8c13b-5e') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:12:06.923542 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-238bf53c-d028-45d3-a96c-f49b05bff332 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:fb:de,bridge_name='br-int',has_traffic_filtering=True,id=58c8c13b-5e85-402b-9c1b-900748ac5b1a,network=Network(233ff488-7baf-4369-9054-b24499b82bab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58c8c13b-5e') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:12:06.924735 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:06.924893 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58c8c13b-5e, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:12:06.926608 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:12:06.927843 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:06.928418 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:06.928537 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7f03b2f-dace-4e6d-aab7-9c1678f8340c) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:12:06.930203 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:12:06.931480 np0000001613 nova-compute[98321]: INFO os_vif [None req-238bf53c-d028-45d3-a96c-f49b05bff332 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:fb:de,bridge_name='br-int',has_traffic_filtering=True,id=58c8c13b-5e85-402b-9c1b-900748ac5b1a,network=Network(233ff488-7baf-4369-9054-b24499b82bab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58c8c13b-5e')
May 28 10:12:06.931695 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-238bf53c-d028-45d3-a96c-f49b05bff332 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Deleting instance files /opt/stack/data/nova/instances/f42f06fc-5b0c-4973-98db-cd594815f317_del
May 28 10:12:06.932353 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-238bf53c-d028-45d3-a96c-f49b05bff332 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Deletion of /opt/stack/data/nova/instances/f42f06fc-5b0c-4973-98db-cd594815f317_del complete
May 28 10:12:06.936530 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:06.936794 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:12:06.936950 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] <== disconnect_volume: return (309ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:12:06.937104 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:12:06.937414 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Deleting instance files /opt/stack/data/nova/instances/b51e6cdd-7556-41bf-ab93-24495d4e3d03_del
May 28 10:12:06.937969 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Deletion of /opt/stack/data/nova/instances/b51e6cdd-7556-41bf-ab93-24495d4e3d03_del complete
May 28 10:12:07.199762 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ab3c680d-e82b-4592-bd19-96fef7501300 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.531s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:07.244782 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-ab3c680d-e82b-4592-bd19-96fef7501300 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Deleted allocations for instance c0786416-dec3-4610-9ec2-389aa7508148
May 28 10:12:07.299700 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:12:07.300021 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:12:07.300300 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 51.49 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:12:07.438056 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-238bf53c-d028-45d3-a96c-f49b05bff332 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Took 1.36 seconds to destroy the instance on the hypervisor.
May 28 10:12:07.438633 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-238bf53c-d028-45d3-a96c-f49b05bff332 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:12:07.438901 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:12:07.439010 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:12:07.439281 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:07.444101 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Took 1.69 seconds to destroy the instance on the hypervisor.
May 28 10:12:07.446329 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:12:07.446743 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:12:07.446931 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:12:07.447194 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:07.526504 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:07.572280 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:07.835417 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-476d3e9a-df14-412f-a3f9-2a0e9ee05fc8 req-c5bb48d1-61f7-4a2a-891c-5c8fa3eb0811 service nova] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Received event network-vif-deleted-d9ced81c-77d5-4b25-a984-054f5dd0a4ac {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:12:07.837695 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-476d3e9a-df14-412f-a3f9-2a0e9ee05fc8 req-c5bb48d1-61f7-4a2a-891c-5c8fa3eb0811 service nova] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Neutron deleted interface d9ced81c-77d5-4b25-a984-054f5dd0a4ac; detaching it from the instance and deleting it from the info cache
May 28 10:12:07.839768 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-476d3e9a-df14-412f-a3f9-2a0e9ee05fc8 req-c5bb48d1-61f7-4a2a-891c-5c8fa3eb0811 service nova] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Detach interface failed, port_id=d9ced81c-77d5-4b25-a984-054f5dd0a4ac, reason: Instance b51e6cdd-7556-41bf-ab93-24495d4e3d03 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:12:08.254906 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ab3c680d-e82b-4592-bd19-96fef7501300 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "c0786416-dec3-4610-9ec2-389aa7508148" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.405s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:08.287672 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:12:08.391095 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-0eb4f25b-5eff-4fa3-8220-18e716882d65 req-03ff2d51-475b-4caf-a349-4d836ce47007 service nova] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Received event network-vif-deleted-58c8c13b-5e85-402b-9c1b-900748ac5b1a {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:12:08.391316 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-0eb4f25b-5eff-4fa3-8220-18e716882d65 req-03ff2d51-475b-4caf-a349-4d836ce47007 service nova] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Neutron deleted interface 58c8c13b-5e85-402b-9c1b-900748ac5b1a; detaching it from the instance and deleting it from the info cache
May 28 10:12:08.393643 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-0eb4f25b-5eff-4fa3-8220-18e716882d65 req-03ff2d51-475b-4caf-a349-4d836ce47007 service nova] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Detach interface failed, port_id=58c8c13b-5e85-402b-9c1b-900748ac5b1a, reason: Instance f42f06fc-5b0c-4973-98db-cd594815f317 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:12:08.791069 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Took 1.34 seconds to deallocate network for instance.
May 28 10:12:08.841553 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:12:09.343575 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Took 1.90 seconds to deallocate network for instance.
May 28 10:12:09.352009 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Took 0.56 seconds to detach 1 volumes for instance.
May 28 10:12:09.850149 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-238bf53c-d028-45d3-a96c-f49b05bff332 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:09.850489 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-238bf53c-d028-45d3-a96c-f49b05bff332 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:09.858097 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:09.922336 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:10.251066 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-238bf53c-d028-45d3-a96c-f49b05bff332 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:12:10.251470 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-238bf53c-d028-45d3-a96c-f49b05bff332 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:12:10.754073 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-238bf53c-d028-45d3-a96c-f49b05bff332 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:12:11.263229 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-238bf53c-d028-45d3-a96c-f49b05bff332 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.413s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:11.267195 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.405s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:11.337837 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-238bf53c-d028-45d3-a96c-f49b05bff332 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Deleted allocations for instance f42f06fc-5b0c-4973-98db-cd594815f317
May 28 10:12:11.463325 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Acquiring lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:11.463561 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:11.670864 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:12:11.671138 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:12:11.831552 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:11.831761 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:11.874644 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.00045632499995917897 future=<Future at 0x73c1f4069970 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:12:11.874644 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:12:11.875309 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Emitting event <LifecycleEvent: 1779963116.8739376, b4c26c83-b122-4b4a-a517-1701b23caf03 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:12:11.875463 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] VM Stopped (Lifecycle Event)
May 28 10:12:11.876679 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=5.836104618000263 future=<Future at 0x73c1fc157bf0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:12:11.876679 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=5.835990956999922 future=<Future at 0x73c1fc157bf0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:12:11.929432 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:11.969070 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lazy-loading 'flavor' on Instance uuid 8849d62e-d9a4-4285-95fc-0869cbf20b4c {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:12:12.043954 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Acquiring lock "60cce3b4-1065-4568-9777-9b78ee43a55b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:12.044211 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "60cce3b4-1065-4568-9777-9b78ee43a55b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:12.115586 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Acquiring lock "60cce3b4-1065-4568-9777-9b78ee43a55b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:12.173542 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:12:12.334820 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:12:12.350431 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-238bf53c-d028-45d3-a96c-f49b05bff332 tempest-TestStampPattern-414594070 tempest-TestStampPattern-414594070-project-member] Lock "f42f06fc-5b0c-4973-98db-cd594815f317" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.785s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:12.379353 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: b4c26c83-b122-4b4a-a517-1701b23caf03] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:12:12.546746 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Detaching volume 836f0c06-aec5-4c9a-b1e7-3306787831ea
May 28 10:12:12.581857 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Attempting to driver detach volume 836f0c06-aec5-4c9a-b1e7-3306787831ea from mountpoint /dev/vdb
May 28 10:12:12.585972 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Found disk vdb by alias ua-836f0c06-aec5-4c9a-b1e7-3306787831ea {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:12:12.587441 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Found disk vdb by alias ua-836f0c06-aec5-4c9a-b1e7-3306787831ea {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:12:12.587542 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Attempting to detach device vdb from instance 60cce3b4-1065-4568-9777-9b78ee43a55b from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 10:12:12.587837 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:12:12.587837 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:12:12.587837 np0000001613 nova-compute[98321]:   <alias name="ua-836f0c06-aec5-4c9a-b1e7-3306787831ea"/>
May 28 10:12:12.587837 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-2"/>
May 28 10:12:12.587837 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:12:12.587837 np0000001613 nova-compute[98321]:   <serial>836f0c06-aec5-4c9a-b1e7-3306787831ea</serial>
May 28 10:12:12.587837 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:12:12.587837 np0000001613 nova-compute[98321]: </disk>
May 28 10:12:12.587837 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:12:12.592607 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Successfully detached device vdb from instance 60cce3b4-1065-4568-9777-9b78ee43a55b from the persistent domain config.
May 28 10:12:12.592754 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] (1/8): Attempting to detach device vdb with device alias ua-836f0c06-aec5-4c9a-b1e7-3306787831ea from instance 60cce3b4-1065-4568-9777-9b78ee43a55b from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 10:12:12.592993 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:12:12.592993 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:12:12.592993 np0000001613 nova-compute[98321]:   <alias name="ua-836f0c06-aec5-4c9a-b1e7-3306787831ea"/>
May 28 10:12:12.592993 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-2"/>
May 28 10:12:12.592993 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:12:12.592993 np0000001613 nova-compute[98321]:   <serial>836f0c06-aec5-4c9a-b1e7-3306787831ea</serial>
May 28 10:12:12.592993 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:12:12.592993 np0000001613 nova-compute[98321]: </disk>
May 28 10:12:12.592993 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:12:12.681849 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.418s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:12.743758 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Deleted allocations for instance b51e6cdd-7556-41bf-ab93-24495d4e3d03
May 28 10:12:12.889959 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:12.890138 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:12.894519 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:12:12.894687 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Claim successful on node np0000001613
May 28 10:12:12.974364 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:13.118352 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779963133.1176744, 60cce3b4-1065-4568-9777-9b78ee43a55b => ua-836f0c06-aec5-4c9a-b1e7-3306787831ea> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 10:12:13.119184 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-836f0c06-aec5-4c9a-b1e7-3306787831ea for instance 60cce3b4-1065-4568-9777-9b78ee43a55b {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 10:12:13.121467 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Successfully detached device vdb from instance 60cce3b4-1065-4568-9777-9b78ee43a55b from the live domain config.
May 28 10:12:13.122542 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:12:13.122844 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea', 'iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '836f0c06-aec5-4c9a-b1e7-3306787831ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:12:13.122962 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:12:13.123308 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:12:13.123596 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea', 'iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '836f0c06-aec5-4c9a-b1e7-3306787831ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:12:13.123746 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:12:13.147531 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:13.147531 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:13.147531 np0000001613 nova-compute[98321]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:12:13.147531 np0000001613 nova-compute[98321]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:12:13.147531 np0000001613 nova-compute[98321]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea (non-flash)
May 28 10:12:13.147531 np0000001613 nova-compute[98321]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea (non-flash)
May 28 10:12:13.147531 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:12:13.147772 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsi session list stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:13.147772 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:13.147772 np0000001613 nova-compute[98321]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:12:13.147772 np0000001613 nova-compute[98321]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:12:13.147772 np0000001613 nova-compute[98321]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea (non-flash)
May 28 10:12:13.147772 np0000001613 nova-compute[98321]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea (non-flash)
May 28 10:12:13.147772 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:12:13.147895 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623', '150'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623', '151'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f', '161'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f', '162'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea', '165'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea', '166')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:12:13.147950 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea', '165')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:12:13.148830 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea', '166')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:12:13.149554 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc2bc720>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea'): ({'sdh'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:12:13.149756 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Removing multipathed devices sdf, sdh {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:12:13.149951 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Flush multipath device 3300000003f7ee433 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:12:13.209578 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:12:13.254720 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:12:13.308026 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Checking to see if SCSI volumes sdf, sdh have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:12:13.308026 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] SCSI volumes sdf, sdh have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:12:13.309403 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Checking to see if device paths {'sdf', 'sdh'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:12:13.321747 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Device paths {'sdf', 'sdh'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:12:13.322035 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:12:13.334341 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:13.367828 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 165, target: iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea, portal: 192.168.40.100,3260]
May 28 10:12:13.367828 np0000001613 nova-compute[98321]: Logout of [sid: 165, target: iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea, portal: 192.168.40.100,3260] successful.
May 28 10:12:13.367828 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:13.383901 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:13.402677 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:13.440100 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 166, target: iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea, portal: 192.168.50.100,3260]
May 28 10:12:13.440100 np0000001613 nova-compute[98321]: Logout of [sid: 166, target: iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea, portal: 192.168.50.100,3260] successful.
May 28 10:12:13.440100 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:13.454834 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:13.455056 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:12:13.455217 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] <== disconnect_volume: return (332ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:12:13.455322 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:12:13.752500 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-25c6a4bf-02d0-49dd-ae7e-f2b3d4ec49cf tempest-TestVolumeBackupRestore-1977101720 tempest-TestVolumeBackupRestore-1977101720-project-member] Lock "b51e6cdd-7556-41bf-ab93-24495d4e3d03" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.512s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:14.007387 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lazy-loading 'flavor' on Instance uuid 60cce3b4-1065-4568-9777-9b78ee43a55b {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:12:14.061623 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Acquiring lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:14.062337 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:14.062564 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Attaching volume f7ffc7cd-3f54-455e-a48d-c0cf435cc401 to /dev/vdb
May 28 10:12:14.111618 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:12:14.127807 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:12:14.157768 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:12:14.229905 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:12:14.230403 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:12:14.241838 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:12:14.244842 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fee7:8ceb', 'fe80::e4eb:4cff:fe5c:5eb7', 'fe80::fc16:3eff:fee5:ea20', 'fe80::8cd1:81ff:fea1:944', 'fe80::fc16:3eff:fe86:5388', 'fe80::5c44:a2ff:fe78:6c5f', 'fe80::fc16:3eff:fef2:dbb', 'fe80::fc16:3eff:fe8c:4068', 'fe80::9098:76ff:fe86:646f'] 
May 28 10:12:14.245091 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:12:14.245361 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:12:14.245819 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:12:14.246204 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Updating existing volume attachment record: 0d68f7d2-cd18-4bfa-989e-73dacfbf6e09 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:12:14.341803 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:12:14.342031 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:12:14.811216 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:12:14.811634 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401', 'iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7ffc7cd-3f54-455e-a48d-c0cf435cc401', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:12:14.811634 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:12:14.812182 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:12:14.812397 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401', 'iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7ffc7cd-3f54-455e-a48d-c0cf435cc401', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:12:14.823722 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:12:14.824312 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:12:14.824705 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:12:14.824988 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:12:14.825190 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:12:14.825387 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:12:14.836686 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:12:14.836686 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:14.843124 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:12:14.843124 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:14.844992 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:12:14.851651 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401] added
May 28 10:12:14.851651 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:12:14.851651 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:12:14.851651 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:12:14.851651 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:12:14.851651 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:12:14.851651 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:14.851792 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:12:14.851936 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.027(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:12:14.852053 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:12:14.856857 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401] added
May 28 10:12:14.856857 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:12:14.856857 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:12:14.856857 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:12:14.856857 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:12:14.856857 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:12:14.856857 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:14.857092 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:12:14.857092 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.032(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:12:14.857241 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:12:14.929063 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:15.014326 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-39cd1d2d-5a19-4279-b503-138e4de6ad28 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "60cce3b4-1065-4568-9777-9b78ee43a55b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.970s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:15.016360 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "60cce3b4-1065-4568-9777-9b78ee43a55b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.901s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:15.016617 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Acquiring lock "60cce3b4-1065-4568-9777-9b78ee43a55b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:15.016978 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "60cce3b4-1065-4568-9777-9b78ee43a55b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:15.018476 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "60cce3b4-1065-4568-9777-9b78ee43a55b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:15.021044 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Terminating instance
May 28 10:12:15.028388 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:15.351663 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.461s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:15.352010 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:12:15.537541 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:12:15.559838 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:15.563946 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:15.588254 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:15.600489 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:15.625710 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:15.823941 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-26a0b939-358f-4fb2-8c8d-89f84d7d03fd req-a17d6c7c-5c2b-4da6-a5b9-24e0ec0369cb service nova] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Received event network-vif-unplugged-cd93d344-29fd-4e3e-aa5a-035b8ddb2118 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:12:15.824706 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-26a0b939-358f-4fb2-8c8d-89f84d7d03fd req-a17d6c7c-5c2b-4da6-a5b9-24e0ec0369cb service nova] Acquiring lock "60cce3b4-1065-4568-9777-9b78ee43a55b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:15.824920 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-26a0b939-358f-4fb2-8c8d-89f84d7d03fd req-a17d6c7c-5c2b-4da6-a5b9-24e0ec0369cb service nova] Lock "60cce3b4-1065-4568-9777-9b78ee43a55b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:15.825127 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-26a0b939-358f-4fb2-8c8d-89f84d7d03fd req-a17d6c7c-5c2b-4da6-a5b9-24e0ec0369cb service nova] Lock "60cce3b4-1065-4568-9777-9b78ee43a55b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:15.825401 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-26a0b939-358f-4fb2-8c8d-89f84d7d03fd req-a17d6c7c-5c2b-4da6-a5b9-24e0ec0369cb service nova] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] No waiting events found dispatching network-vif-unplugged-cd93d344-29fd-4e3e-aa5a-035b8ddb2118 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:12:15.825617 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-26a0b939-358f-4fb2-8c8d-89f84d7d03fd req-a17d6c7c-5c2b-4da6-a5b9-24e0ec0369cb service nova] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Received event network-vif-unplugged-cd93d344-29fd-4e3e-aa5a-035b8ddb2118 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:12:15.852562 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:12:15.859222 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:12:15.861486 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:12:15.861486 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:15.863279 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:15.871102 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:12:15.875809 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:12:15.875809 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:15.885716 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999628960000337 future=<Future at 0x73c1f43ce6f0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:12:15.885716 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Instance destroyed successfully.
May 28 10:12:15.886569 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lazy-loading 'resources' on Instance uuid 60cce3b4-1065-4568-9777-9b78ee43a55b {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:12:15.893094 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:12:15.893094 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:15.897344 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:15.909330 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:15.921029 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:15.921029 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:15.921029 np0000001613 nova-compute[98321]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:12:15.921029 np0000001613 nova-compute[98321]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:12:15.921029 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:12:15.921275 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsi session list stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:15.921275 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:15.921275 np0000001613 nova-compute[98321]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:12:15.921275 np0000001613 nova-compute[98321]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:12:15.921275 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:12:15.929454 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:15.929454 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:15.929454 np0000001613 nova-compute[98321]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:12:15.929454 np0000001613 nova-compute[98321]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:12:15.929454 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:12:15.929454 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsi session list stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:15.929454 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:15.929454 np0000001613 nova-compute[98321]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:12:15.929454 np0000001613 nova-compute[98321]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:12:15.929454 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:12:15.954798 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401, portal: 192.168.50.100,3260]
May 28 10:12:15.954798 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401, portal: 192.168.50.100,3260] successful.
May 28 10:12:15.954798 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:15.967006 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4631f2d316394d08825f7c3295412feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f9e47b0cb84ec9a96e9ee54854c98d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:12:15.968048 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:15.978892 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401, portal: 192.168.40.100,3260]
May 28 10:12:15.978892 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401, portal: 192.168.40.100,3260] successful.
May 28 10:12:15.978892 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:15.988732 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:15.988732 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:15.988732 np0000001613 nova-compute[98321]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:12:15.988732 np0000001613 nova-compute[98321]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:12:15.988732 np0000001613 nova-compute[98321]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401 (non-flash)
May 28 10:12:15.988732 np0000001613 nova-compute[98321]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401 (non-flash)
May 28 10:12:15.988732 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:12:15.989033 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsi session list stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:15.989033 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:15.989033 np0000001613 nova-compute[98321]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:12:15.989033 np0000001613 nova-compute[98321]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:12:15.989033 np0000001613 nova-compute[98321]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401 (non-flash)
May 28 10:12:15.989033 np0000001613 nova-compute[98321]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401 (non-flash)
May 28 10:12:15.989033 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:12:15.989514 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.165s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:12:15.989785 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:12:15.990149 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:15.991346 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] HCTL ('11', '-', '-', 0) found on session 167 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:12:15.994509 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:12:16.010727 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:16.010727 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:16.010727 np0000001613 nova-compute[98321]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:12:16.010727 np0000001613 nova-compute[98321]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:12:16.010727 np0000001613 nova-compute[98321]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401 (non-flash)
May 28 10:12:16.010727 np0000001613 nova-compute[98321]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401 (non-flash)
May 28 10:12:16.010727 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:12:16.011150 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsi session list stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:16.011150 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:16.011150 np0000001613 nova-compute[98321]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:12:16.011150 np0000001613 nova-compute[98321]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:12:16.011150 np0000001613 nova-compute[98321]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401 (non-flash)
May 28 10:12:16.011150 np0000001613 nova-compute[98321]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401 (non-flash)
May 28 10:12:16.011150 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:12:16.011150 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.186s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:12:16.011514 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:12:16.012245 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] HCTL ('12', '-', '-', 0) found on session 168 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:12:16.012350 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:12:16.020867 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Searching for a device in session 167 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:12:16.020867 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f7ffc7cd-3f54-455e-a48d-c0cf435cc401', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:12:16.037688 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Searching for a device in session 168 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:12:16.037688 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7ffc7cd-3f54-455e-a48d-c0cf435cc401', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:12:16.379302 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:12:16.390149 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:11:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-284577381',display_name='tempest-VolumesSnapshotTestJSON-instance-284577381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumessnapshottestjson-instance-284577381',id=63,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACyMwfsfUkNFkbzWbBTIgFUC6rufATbG55GOKsScCcxOV9C0im0iNHk6baTEKJjfvTW7U+r84+PeVPcoYHDvcmVvuKWERmkOmVJVaZfbpGeK/1MN6VJ2WDtcF8Z5c77QA==',key_name='tempest-keypair-1165366685',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:11:17Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4bbdf692768465db607aa60a630e5e2',ramdisk_id='',reservation_id='r-6i3ru6d4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-4375881',owner_user_name='tempest-VolumesSnapshotTestJSON-4375881-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:11:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f734f16600ef4cb88fdf7e170dd7f3a0',uuid=60cce3b4-1065-4568-9777-9b78ee43a55b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd93d344-29fd-4e3e-aa5a-035b8ddb2118", "address": "fa:16:3e:e5:ea:20", "network": {"id": "8d701503-e690-42e6-8d82-0987ffcf4209", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1480012678-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a4bbdf692768465db607aa60a630e5e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd93d344-29", "ovs_interfaceid": "cd93d344-29fd-4e3e-aa5a-035b8ddb2118", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:12:16.390393 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Converting VIF {"id": "cd93d344-29fd-4e3e-aa5a-035b8ddb2118", "address": "fa:16:3e:e5:ea:20", "network": {"id": "8d701503-e690-42e6-8d82-0987ffcf4209", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1480012678-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a4bbdf692768465db607aa60a630e5e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd93d344-29", "ovs_interfaceid": "cd93d344-29fd-4e3e-aa5a-035b8ddb2118", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:12:16.391005 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:ea:20,bridge_name='br-int',has_traffic_filtering=True,id=cd93d344-29fd-4e3e-aa5a-035b8ddb2118,network=Network(8d701503-e690-42e6-8d82-0987ffcf4209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd93d344-29') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:12:16.391284 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:ea:20,bridge_name='br-int',has_traffic_filtering=True,id=cd93d344-29fd-4e3e-aa5a-035b8ddb2118,network=Network(8d701503-e690-42e6-8d82-0987ffcf4209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd93d344-29') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:12:16.394242 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:16.394522 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd93d344-29, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:12:16.396441 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:16.398529 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:12:16.399480 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:16.399666 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6296d966-3e2e-47c9-bd29-2eae0b55a26f) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:12:16.401240 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:16.401754 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:12:16.403261 np0000001613 nova-compute[98321]: INFO os_vif [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:ea:20,bridge_name='br-int',has_traffic_filtering=True,id=cd93d344-29fd-4e3e-aa5a-035b8ddb2118,network=Network(8d701503-e690-42e6-8d82-0987ffcf4209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd93d344-29')
May 28 10:12:16.405313 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:12:16.405643 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea', 'iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '836f0c06-aec5-4c9a-b1e7-3306787831ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:12:16.405807 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:12:16.431524 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Successfully created port: 04633d7b-a11f-4e7a-bd98-683a082e8a73 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:12:16.825535 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:12:16.884314 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:12:16.958374 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Successfully updated port: 04633d7b-a11f-4e7a-bd98-683a082e8a73 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:12:16.960436 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:17.030000 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b3d86a41-c2cc-4c80-a236-53e9ea715385 req-dd439aed-0238-494f-b02c-811ecb53fe57 service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Received event network-changed-04633d7b-a11f-4e7a-bd98-683a082e8a73 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:12:17.033614 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b3d86a41-c2cc-4c80-a236-53e9ea715385 req-dd439aed-0238-494f-b02c-811ecb53fe57 service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Refreshing instance network info cache due to event network-changed-04633d7b-a11f-4e7a-bd98-683a082e8a73. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:12:17.033786 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b3d86a41-c2cc-4c80-a236-53e9ea715385 req-dd439aed-0238-494f-b02c-811ecb53fe57 service nova] Acquiring lock "refresh_cache-3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:12:17.033879 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b3d86a41-c2cc-4c80-a236-53e9ea715385 req-dd439aed-0238-494f-b02c-811ecb53fe57 service nova] Acquired lock "refresh_cache-3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:12:17.033984 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-b3d86a41-c2cc-4c80-a236-53e9ea715385 req-dd439aed-0238-494f-b02c-811ecb53fe57 service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Refreshing network info cache for port 04633d7b-a11f-4e7a-bd98-683a082e8a73 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:12:17.462600 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "refresh_cache-3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:12:17.488376 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:17.536445 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-b3d86a41-c2cc-4c80-a236-53e9ea715385 req-dd439aed-0238-494f-b02c-811ecb53fe57 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:17.614963 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-b3d86a41-c2cc-4c80-a236-53e9ea715385 req-dd439aed-0238-494f-b02c-811ecb53fe57 service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:12:17.713307 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0006272989999160927 future=<Future at 0x73c1fc157bf0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:12:17.713468 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:12:17.714230 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=3.3894267239998044 future=<Future at 0x73c1fc2f7fe0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:12:17.714640 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] Emitting event <LifecycleEvent: 1779963122.71256, c0786416-dec3-4610-9ec2-389aa7508148 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:12:17.714785 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] VM Stopped (Lifecycle Event)
May 28 10:12:17.715745 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=3.3879132880001634 future=<Future at 0x73c1fc2f7fe0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:12:17.774128 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-b3d86a41-c2cc-4c80-a236-53e9ea715385 req-dd439aed-0238-494f-b02c-811ecb53fe57 service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:12:17.845584 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Found WWN 3300000005e83c097 for multipath device dm-2 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:12:17.845584 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:12:17.845584 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '3300000005e83c097', 'path': '/dev/dm-2', 'multipath_id': '3300000005e83c097'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:12:17.845584 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005e83c097', 'path': '/dev/dm-2', 'multipath_id': '3300000005e83c097'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:12:17.845584 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.439s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:12:17.846130 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea', 'iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '836f0c06-aec5-4c9a-b1e7-3306787831ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:12:17.846130 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:12:17.851093 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lazy-loading 'flavor' on Instance uuid 8849d62e-d9a4-4285-95fc-0869cbf20b4c {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:12:17.880383 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:17.880383 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:17.880383 np0000001613 nova-compute[98321]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:12:17.880383 np0000001613 nova-compute[98321]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:12:17.880383 np0000001613 nova-compute[98321]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401 (non-flash)
May 28 10:12:17.880383 np0000001613 nova-compute[98321]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401 (non-flash)
May 28 10:12:17.880383 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:12:17.880610 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsi session list stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:17.880610 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:17.880610 np0000001613 nova-compute[98321]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:12:17.880610 np0000001613 nova-compute[98321]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:12:17.880610 np0000001613 nova-compute[98321]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401 (non-flash)
May 28 10:12:17.880610 np0000001613 nova-compute[98321]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401 (non-flash)
May 28 10:12:17.880610 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:12:17.880774 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623', '150'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623', '151'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f', '161'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f', '162'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401', '167'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401', '168')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:12:17.880827 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea, 0): [] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:12:17.880889 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea') {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 10:12:17.881254 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea, 0): [] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:12:17.881254 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-836f0c06-aec5-4c9a-b1e7-3306787831ea') {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 10:12:17.881254 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc222980>, {}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:12:17.881392 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Disconnecting from: [] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:12:17.881446 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.036s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:12:17.881549 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] <== disconnect_volume: return (1475ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:12:17.881646 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:12:17.881899 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Deleting instance files /opt/stack/data/nova/instances/60cce3b4-1065-4568-9777-9b78ee43a55b_del
May 28 10:12:17.882654 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Deletion of /opt/stack/data/nova/instances/60cce3b4-1065-4568-9777-9b78ee43a55b_del complete
May 28 10:12:17.893828 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:12:17.894922 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:12:17.895138 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Creating image(s)
May 28 10:12:17.895585 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:17.896250 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "/opt/stack/data/nova/instances/3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:17.899317 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-192d0e0d-968c-4d43-9b63-5b1fd46bec11 req-60fca928-c312-4914-8a64-0b2ea2e0acbf service nova] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Received event network-vif-unplugged-cd93d344-29fd-4e3e-aa5a-035b8ddb2118 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:12:17.899489 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-192d0e0d-968c-4d43-9b63-5b1fd46bec11 req-60fca928-c312-4914-8a64-0b2ea2e0acbf service nova] Acquiring lock "60cce3b4-1065-4568-9777-9b78ee43a55b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:17.899645 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-192d0e0d-968c-4d43-9b63-5b1fd46bec11 req-60fca928-c312-4914-8a64-0b2ea2e0acbf service nova] Lock "60cce3b4-1065-4568-9777-9b78ee43a55b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:17.899758 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-192d0e0d-968c-4d43-9b63-5b1fd46bec11 req-60fca928-c312-4914-8a64-0b2ea2e0acbf service nova] Lock "60cce3b4-1065-4568-9777-9b78ee43a55b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:17.899871 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-192d0e0d-968c-4d43-9b63-5b1fd46bec11 req-60fca928-c312-4914-8a64-0b2ea2e0acbf service nova] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] No waiting events found dispatching network-vif-unplugged-cd93d344-29fd-4e3e-aa5a-035b8ddb2118 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:12:17.899971 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-192d0e0d-968c-4d43-9b63-5b1fd46bec11 req-60fca928-c312-4914-8a64-0b2ea2e0acbf service nova] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Received event network-vif-unplugged-cd93d344-29fd-4e3e-aa5a-035b8ddb2118 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:12:17.900749 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "/opt/stack/data/nova/instances/3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:17.901145 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "8f5365613d6da1c6b2e601d3ef63d8e6b8abc147" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:17.901642 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "8f5365613d6da1c6b2e601d3ef63d8e6b8abc147" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:18.218744 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-0ff42e78-e88c-4876-b4e2-7c08c1b4d725 tempest-TestShelveInstance-793753334 tempest-TestShelveInstance-793753334-project-member] [instance: c0786416-dec3-4610-9ec2-389aa7508148] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:12:18.276571 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b3d86a41-c2cc-4c80-a236-53e9ea715385 req-dd439aed-0238-494f-b02c-811ecb53fe57 service nova] Releasing lock "refresh_cache-3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:12:18.277947 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquired lock "refresh_cache-3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:12:18.277947 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:12:18.355134 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Attempting to attach volume f7ffc7cd-3f54-455e-a48d-c0cf435cc401 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 10:12:18.358538 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] attach device xml: <disk type="block" device="disk">
May 28 10:12:18.358538 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:12:18.358538 np0000001613 nova-compute[98321]:   <alias name="ua-f7ffc7cd-3f54-455e-a48d-c0cf435cc401"/>
May 28 10:12:18.358538 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-2"/>
May 28 10:12:18.358538 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:12:18.358538 np0000001613 nova-compute[98321]:   <serial>f7ffc7cd-3f54-455e-a48d-c0cf435cc401</serial>
May 28 10:12:18.358538 np0000001613 nova-compute[98321]: </disk>
May 28 10:12:18.358538 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 10:12:18.390049 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Took 2.85 seconds to destroy the instance on the hypervisor.
May 28 10:12:18.391374 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:12:18.391787 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:12:18.392263 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:12:18.392532 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:18.467122 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:18.542491 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:12:18.545573 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:12:18.546295 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5365613d6da1c6b2e601d3ef63d8e6b8abc147.part --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:12:18.646483 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5365613d6da1c6b2e601d3ef63d8e6b8abc147.part --force-share --output=json" returned: 0 in 0.100s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:12:18.647131 np0000001613 nova-compute[98321]: DEBUG nova.virt.images [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] 878a1682-ebcd-4fd7-9461-1644d7fc7535 was qcow2, converting to raw {{(pid=98321) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 10:12:18.647760 np0000001613 nova-compute[98321]: DEBUG nova.privsep.utils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98321) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 10:12:18.648084 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8f5365613d6da1c6b2e601d3ef63d8e6b8abc147.part /opt/stack/data/nova/instances/_base/8f5365613d6da1c6b2e601d3ef63d8e6b8abc147.converted {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:12:18.826999 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8f5365613d6da1c6b2e601d3ef63d8e6b8abc147.part /opt/stack/data/nova/instances/_base/8f5365613d6da1c6b2e601d3ef63d8e6b8abc147.converted" returned: 0 in 0.179s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:12:18.832635 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5365613d6da1c6b2e601d3ef63d8e6b8abc147.converted --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:12:18.871060 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:12:18.951671 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5365613d6da1c6b2e601d3ef63d8e6b8abc147.converted --force-share --output=json" returned: 0 in 0.119s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:12:18.952281 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "8f5365613d6da1c6b2e601d3ef63d8e6b8abc147" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.051s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:18.952889 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:12:18.955581 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:12:18.956616 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5365613d6da1c6b2e601d3ef63d8e6b8abc147 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:12:19.055897 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5365613d6da1c6b2e601d3ef63d8e6b8abc147 --force-share --output=json" returned: 0 in 0.099s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:12:19.056436 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "8f5365613d6da1c6b2e601d3ef63d8e6b8abc147" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:19.056858 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "8f5365613d6da1c6b2e601d3ef63d8e6b8abc147" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:19.058244 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:12:19.060910 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:12:19.061273 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5365613d6da1c6b2e601d3ef63d8e6b8abc147 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:12:19.100233 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ef6ea468-484c-4533-a1b0-b3a8cf9aab76 req-6e3d1e5e-91cd-4d06-a4c9-f70b63ab84c0 service nova] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Received event network-vif-deleted-cd93d344-29fd-4e3e-aa5a-035b8ddb2118 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:12:19.100233 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-ef6ea468-484c-4533-a1b0-b3a8cf9aab76 req-6e3d1e5e-91cd-4d06-a4c9-f70b63ab84c0 service nova] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Neutron deleted interface cd93d344-29fd-4e3e-aa5a-035b8ddb2118; detaching it from the instance and deleting it from the info cache
May 28 10:12:19.107579 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ef6ea468-484c-4533-a1b0-b3a8cf9aab76 req-6e3d1e5e-91cd-4d06-a4c9-f70b63ab84c0 service nova] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Detach interface failed, port_id=cd93d344-29fd-4e3e-aa5a-035b8ddb2118, reason: Instance 60cce3b4-1065-4568-9777-9b78ee43a55b could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:12:19.126028 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:19.164347 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5365613d6da1c6b2e601d3ef63d8e6b8abc147 --force-share --output=json" returned: 0 in 0.103s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:12:19.164972 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5365613d6da1c6b2e601d3ef63d8e6b8abc147,backing_fmt=raw /opt/stack/data/nova/instances/3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:12:19.228268 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5365613d6da1c6b2e601d3ef63d8e6b8abc147,backing_fmt=raw /opt/stack/data/nova/instances/3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd/disk 1073741824" returned: 0 in 0.063s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:12:19.228718 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "8f5365613d6da1c6b2e601d3ef63d8e6b8abc147" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.172s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:19.229022 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5365613d6da1c6b2e601d3ef63d8e6b8abc147 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:12:19.309706 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Updating instance_info_cache with network_info: [{"id": "04633d7b-a11f-4e7a-bd98-683a082e8a73", "address": "fa:16:3e:f0:49:ef", "network": {"id": "db344666-4990-47d9-a3a2-9bebce64e660", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1492927350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44f9e47b0cb84ec9a96e9ee54854c98d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04633d7b-a1", "ovs_interfaceid": "04633d7b-a11f-4e7a-bd98-683a082e8a73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:12:19.325831 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5365613d6da1c6b2e601d3ef63d8e6b8abc147 --force-share --output=json" returned: 0 in 0.097s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:12:19.326416 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:12:19.327152 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:12:19.401968 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:12:19.427217 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:12:19.427660 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Cannot resize image /opt/stack/data/nova/instances/3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:12:19.427806 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:12:19.428386 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Ensure instance console log exists: /opt/stack/data/nova/instances/3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:12:19.428386 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:19.428626 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:19.428757 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:19.623025 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:19.814001 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Releasing lock "refresh_cache-3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:12:19.814472 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Instance network_info: |[{"id": "04633d7b-a11f-4e7a-bd98-683a082e8a73", "address": "fa:16:3e:f0:49:ef", "network": {"id": "db344666-4990-47d9-a3a2-9bebce64e660", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1492927350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44f9e47b0cb84ec9a96e9ee54854c98d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04633d7b-a1", "ovs_interfaceid": "04633d7b-a11f-4e7a-bd98-683a082e8a73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:12:19.817207 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Start _get_guest_xml network_info=[{"id": "04633d7b-a11f-4e7a-bd98-683a082e8a73", "address": "fa:16:3e:f0:49:ef", "network": {"id": "db344666-4990-47d9-a3a2-9bebce64e660", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1492927350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44f9e47b0cb84ec9a96e9ee54854c98d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04633d7b-a1", "ovs_interfaceid": "04633d7b-a11f-4e7a-bd98-683a082e8a73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T10:12:09Z,direct_url=<?>,disk_format='qcow2',id=878a1682-ebcd-4fd7-9461-1644d7fc7535,min_disk=0,min_ram=0,name='tempest-scenario-img--1550066597',owner='44f9e47b0cb84ec9a96e9ee54854c98d',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T10:12:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': '878a1682-ebcd-4fd7-9461-1644d7fc7535'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:12:19.823065 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:12:19.824832 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='878a1682-ebcd-4fd7-9461-1644d7fc7535', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-1279174109', uuid='3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd'), owner=OwnerMeta(userid='4631f2d316394d08825f7c3295412feb', username='tempest-TestMinimumBasicScenario-63484617-project-member', projectid='44f9e47b0cb84ec9a96e9ee54854c98d', projectname='tempest-TestMinimumBasicScenario-63484617'), image=ImageMeta(id='878a1682-ebcd-4fd7-9461-1644d7fc7535', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "04633d7b-a11f-4e7a-bd98-683a082e8a73", "address": "fa:16:3e:f0:49:ef", "network": {"id": "db344666-4990-47d9-a3a2-9bebce64e660", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1492927350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44f9e47b0cb84ec9a96e9ee54854c98d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04633d7b-a1", "ovs_interfaceid": "04633d7b-a11f-4e7a-bd98-683a082e8a73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779963139.8243172) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:12:19.826541 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:12:19.826981 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:12:19.828154 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:12:19.828409 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:12:19.829755 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:12:19.830237 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T10:12:09Z,direct_url=<?>,disk_format='qcow2',id=878a1682-ebcd-4fd7-9461-1644d7fc7535,min_disk=0,min_ram=0,name='tempest-scenario-img--1550066597',owner='44f9e47b0cb84ec9a96e9ee54854c98d',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T10:12:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:12:19.830467 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:12:19.830603 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:12:19.830788 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:12:19.830914 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:12:19.831058 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:12:19.831308 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:12:19.831463 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:12:19.831629 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:12:19.831826 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:12:19.831988 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:12:19.845709 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:12:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1279174109',display_name='tempest-TestMinimumBasicScenario-server-1279174109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testminimumbasicscenario-server-1279174109',id=67,image_ref='878a1682-ebcd-4fd7-9461-1644d7fc7535',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7kslxWNTrBewiPEbe147CLpXkM+/J6loy5QWlKpBcVKens6+9CBUWERBXi7HXqJ48X208nhfn5DKMI+Q8liIVY6ZwgaAQpHfxF1Qk9jVXVgPX2aw4Gfw90ZyD4nG2HqA==',key_name='tempest-TestMinimumBasicScenario-860378945',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44f9e47b0cb84ec9a96e9ee54854c98d',ramdisk_id='',reservation_id='r-4zc6pq93',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='878a1682-ebcd-4fd7-9461-1644d7fc7535',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-63484617',owner_user_name='tempest-TestMinimumBasicScenario-63484617-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:12:17Z,user_data=None,user_id='4631f2d316394d08825f7c3295412feb',uuid=3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04633d7b-a11f-4e7a-bd98-683a082e8a73", "address": "fa:16:3e:f0:49:ef", "network": {"id": "db344666-4990-47d9-a3a2-9bebce64e660", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1492927350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44f9e47b0cb84ec9a96e9ee54854c98d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04633d7b-a1", "ovs_interfaceid": "04633d7b-a11f-4e7a-bd98-683a082e8a73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:12:19.845884 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Converting VIF {"id": "04633d7b-a11f-4e7a-bd98-683a082e8a73", "address": "fa:16:3e:f0:49:ef", "network": {"id": "db344666-4990-47d9-a3a2-9bebce64e660", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1492927350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44f9e47b0cb84ec9a96e9ee54854c98d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04633d7b-a1", "ovs_interfaceid": "04633d7b-a11f-4e7a-bd98-683a082e8a73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:12:19.846664 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:49:ef,bridge_name='br-int',has_traffic_filtering=True,id=04633d7b-a11f-4e7a-bd98-683a082e8a73,network=Network(db344666-4990-47d9-a3a2-9bebce64e660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04633d7b-a1') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:12:19.847415 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:12:19.904990 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Took 1.51 seconds to deallocate network for instance.
May 28 10:12:19.926678 np0000001613 nova-compute[98321]: WARNING nova.volume.cinder [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Attachment b0b8f244-68c9-4bee-a906-e7e70d0f9fa1 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = b0b8f244-68c9-4bee-a906-e7e70d0f9fa1. (HTTP 404) (Request-ID: req-a8f182b1-4669-4b4d-921f-a5245e17d891)
May 28 10:12:19.927036 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Took 0.02 seconds to detach 1 volumes for instance.
May 28 10:12:19.929036 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:20.032574 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:12:20.032721 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:12:20.033028 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:12:20.033028 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] No VIF found with MAC fa:16:3e:86:53:88, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:12:20.350549 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] End _get_guest_xml xml=<domain type="qemu">
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:   <uuid>3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd</uuid>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:   <name>instance-00000043</name>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:       <nova:name>tempest-TestMinimumBasicScenario-server-1279174109</nova:name>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:12:19</nova:creationTime>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:       <nova:image uuid="878a1682-ebcd-4fd7-9461-1644d7fc7535">
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:         <nova:properties/>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:         <nova:user uuid="4631f2d316394d08825f7c3295412feb">tempest-TestMinimumBasicScenario-63484617-project-member</nova:user>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:         <nova:project uuid="44f9e47b0cb84ec9a96e9ee54854c98d">tempest-TestMinimumBasicScenario-63484617</nova:project>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="878a1682-ebcd-4fd7-9461-1644d7fc7535"/>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:         <nova:port uuid="04633d7b-a11f-4e7a-bd98-683a082e8a73">
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:     <system>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:       <entry name="serial">3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd</entry>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:       <entry name="uuid">3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd</entry>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:     </system>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:   <os>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:   </os>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:   <features>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:   </features>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:   <devices>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd/disk"/>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:     </disk>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd/disk.config"/>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:     </disk>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:f0:49:ef"/>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:       <target dev="tap04633d7b-a1"/>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:     </interface>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd/console.log" append="off"/>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:     </serial>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:     <video>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:     </video>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:     </rng>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:   </devices>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]: </domain>
May 28 10:12:20.350549 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:12:20.353634 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Preparing to wait for external event network-vif-plugged-04633d7b-a11f-4e7a-bd98-683a082e8a73 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:12:20.353634 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:20.353634 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:20.353634 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:20.353634 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:12:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1279174109',display_name='tempest-TestMinimumBasicScenario-server-1279174109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testminimumbasicscenario-server-1279174109',id=67,image_ref='878a1682-ebcd-4fd7-9461-1644d7fc7535',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7kslxWNTrBewiPEbe147CLpXkM+/J6loy5QWlKpBcVKens6+9CBUWERBXi7HXqJ48X208nhfn5DKMI+Q8liIVY6ZwgaAQpHfxF1Qk9jVXVgPX2aw4Gfw90ZyD4nG2HqA==',key_name='tempest-TestMinimumBasicScenario-860378945',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44f9e47b0cb84ec9a96e9ee54854c98d',ramdisk_id='',reservation_id='r-4zc6pq93',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='878a1682-ebcd-4fd7-9461-1644d7fc7535',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-63484617',owner_user_name='tempest-TestMinimumBasicScenario-63484617-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:12:17Z,user_data=None,user_id='4631f2d316394d08825f7c3295412feb',uuid=3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04633d7b-a11f-4e7a-bd98-683a082e8a73", "address": "fa:16:3e:f0:49:ef", "network": {"id": "db344666-4990-47d9-a3a2-9bebce64e660", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1492927350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44f9e47b0cb84ec9a96e9ee54854c98d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04633d7b-a1", "ovs_interfaceid": "04633d7b-a11f-4e7a-bd98-683a082e8a73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:12:20.353634 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Converting VIF {"id": "04633d7b-a11f-4e7a-bd98-683a082e8a73", "address": "fa:16:3e:f0:49:ef", "network": {"id": "db344666-4990-47d9-a3a2-9bebce64e660", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1492927350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44f9e47b0cb84ec9a96e9ee54854c98d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04633d7b-a1", "ovs_interfaceid": "04633d7b-a11f-4e7a-bd98-683a082e8a73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:12:20.353634 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:49:ef,bridge_name='br-int',has_traffic_filtering=True,id=04633d7b-a11f-4e7a-bd98-683a082e8a73,network=Network(db344666-4990-47d9-a3a2-9bebce64e660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04633d7b-a1') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:12:20.353634 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:49:ef,bridge_name='br-int',has_traffic_filtering=True,id=04633d7b-a11f-4e7a-bd98-683a082e8a73,network=Network(db344666-4990-47d9-a3a2-9bebce64e660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04633d7b-a1') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:12:20.354098 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:20.354187 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:12:20.354420 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:12:20.355380 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:20.355527 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2b7bbd65-4ae1-571a-b231-a45c4e1fd207', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:12:20.356257 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:20.356945 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:12:20.357344 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:20.359538 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:20.359773 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04633d7b-a1, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:12:20.360230 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap04633d7b-a1, col_values=(('qos', UUID('71c332b5-cc61-434a-a9da-22a31bc787ec')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:12:20.360442 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap04633d7b-a1, col_values=(('external_ids', {'iface-id': '04633d7b-a11f-4e7a-bd98-683a082e8a73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:49:ef', 'vm-uuid': '3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:12:20.361568 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:20.363231 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:12:20.368557 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:20.369653 np0000001613 nova-compute[98321]: INFO os_vif [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:49:ef,bridge_name='br-int',has_traffic_filtering=True,id=04633d7b-a11f-4e7a-bd98-683a082e8a73,network=Network(db344666-4990-47d9-a3a2-9bebce64e660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04633d7b-a1')
May 28 10:12:20.435635 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:20.435843 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:20.791601 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:12:20.791601 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:12:21.104126 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.000400997999804531 future=<Future at 0x73c1fc2f7fe0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:12:21.104719 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Emitting event <LifecycleEvent: 1779963126.1035461, b51e6cdd-7556-41bf-ab93-24495d4e3d03 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:12:21.104902 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:12:21.105141 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] VM Stopped (Lifecycle Event)
May 28 10:12:21.105716 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=0.3129765019998558 future=<Future at 0x73c1fc155880 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:12:21.105861 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=0.3128199110001333 future=<Future at 0x73c1fc155880 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:12:21.294020 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:12:21.419223 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0004768710000462306 future=<Future at 0x73c1fc155880 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:12:21.419873 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Emitting event <LifecycleEvent: 1779963126.4186156, f42f06fc-5b0c-4973-98db-cd594815f317 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:12:21.420074 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:12:21.420339 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] VM Stopped (Lifecycle Event)
May 28 10:12:21.420456 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=9.461617406000187 future=<Future at 0x73c1f43ce6f0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:12:21.422517 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=9.45955584100011 future=<Future at 0x73c1f43ce6f0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:12:21.586817 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d56fa1de-4acd-4440-a065-9c9f44ccc6c0 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.524s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:21.608060 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: b51e6cdd-7556-41bf-ab93-24495d4e3d03] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:12:21.802591 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.366s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:21.880877 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Deleted allocations for instance 60cce3b4-1065-4568-9777-9b78ee43a55b
May 28 10:12:21.888408 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:12:21.888606 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:12:21.888785 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] No VIF found with MAC fa:16:3e:f0:49:ef, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:12:21.889402 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Using config drive
May 28 10:12:21.923854 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: f42f06fc-5b0c-4973-98db-cd594815f317] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:12:22.395534 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:22.556986 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Creating config drive at /opt/stack/data/nova/instances/3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd/disk.config
May 28 10:12:22.559752 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1q9gavo4 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:12:22.622818 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1q9gavo4" returned: 0 in 0.063s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:12:22.906794 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cc0566b3-6e4e-4efb-9fb6-dde740c19cc1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "60cce3b4-1065-4568-9777-9b78ee43a55b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.890s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:23.165511 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:23.199809 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:23.204035 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:23.294127 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:23.525884 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c8125f20-2efa-471c-9c0b-a2f798cdc4db req-e0b136ed-9011-4168-bf9d-de558b7000dc service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Received event network-vif-plugged-04633d7b-a11f-4e7a-bd98-683a082e8a73 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:12:23.526614 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c8125f20-2efa-471c-9c0b-a2f798cdc4db req-e0b136ed-9011-4168-bf9d-de558b7000dc service nova] Acquiring lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:23.526614 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c8125f20-2efa-471c-9c0b-a2f798cdc4db req-e0b136ed-9011-4168-bf9d-de558b7000dc service nova] Lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:23.526614 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c8125f20-2efa-471c-9c0b-a2f798cdc4db req-e0b136ed-9011-4168-bf9d-de558b7000dc service nova] Lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:23.527433 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c8125f20-2efa-471c-9c0b-a2f798cdc4db req-e0b136ed-9011-4168-bf9d-de558b7000dc service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Processing event network-vif-plugged-04633d7b-a11f-4e7a-bd98-683a082e8a73 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:12:23.605660 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:23.611479 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:23.633925 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:23.907660 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "c57fd7fa-e4b8-4620-89ce-34be56feb58e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:23.907660 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "c57fd7fa-e4b8-4620-89ce-34be56feb58e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:23.907660 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "c57fd7fa-e4b8-4620-89ce-34be56feb58e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:23.907660 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "c57fd7fa-e4b8-4620-89ce-34be56feb58e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:23.907660 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "c57fd7fa-e4b8-4620-89ce-34be56feb58e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:23.915306 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Terminating instance
May 28 10:12:24.015968 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:24.082207 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:12:24.082750 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963144.0823638, 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:12:24.083292 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] VM Started (Lifecycle Event)
May 28 10:12:24.086003 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:12:24.088683 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Instance spawned successfully.
May 28 10:12:24.089053 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:12:24.423094 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:12:24.451452 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:24.480880 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:24.589007 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:12:24.595730 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:12:24.600845 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:12:24.601148 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:12:24.601600 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:12:24.602910 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:12:24.603301 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:12:24.603646 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:12:24.684867 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:24.694052 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:24.739862 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2027d364-ae2a-4f71-a5fc-643cb76a958b req-0daad2e7-e7ef-4b67-875d-ff6bf3d07e5c service nova] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Received event network-vif-unplugged-4d6e364b-e498-4e8f-a49b-ec03c1278449 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:12:24.739862 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2027d364-ae2a-4f71-a5fc-643cb76a958b req-0daad2e7-e7ef-4b67-875d-ff6bf3d07e5c service nova] Acquiring lock "c57fd7fa-e4b8-4620-89ce-34be56feb58e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:24.739862 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2027d364-ae2a-4f71-a5fc-643cb76a958b req-0daad2e7-e7ef-4b67-875d-ff6bf3d07e5c service nova] Lock "c57fd7fa-e4b8-4620-89ce-34be56feb58e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:24.739862 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2027d364-ae2a-4f71-a5fc-643cb76a958b req-0daad2e7-e7ef-4b67-875d-ff6bf3d07e5c service nova] Lock "c57fd7fa-e4b8-4620-89ce-34be56feb58e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:24.739862 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2027d364-ae2a-4f71-a5fc-643cb76a958b req-0daad2e7-e7ef-4b67-875d-ff6bf3d07e5c service nova] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] No waiting events found dispatching network-vif-unplugged-4d6e364b-e498-4e8f-a49b-ec03c1278449 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:12:24.740429 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2027d364-ae2a-4f71-a5fc-643cb76a958b req-0daad2e7-e7ef-4b67-875d-ff6bf3d07e5c service nova] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Received event network-vif-unplugged-4d6e364b-e498-4e8f-a49b-ec03c1278449 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:12:24.755044 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:24.765672 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:24.797672 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Instance destroyed successfully.
May 28 10:12:24.798361 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lazy-loading 'resources' on Instance uuid c57fd7fa-e4b8-4620-89ce-34be56feb58e {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:12:24.934440 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:25.100620 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:12:25.100620 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963145.098676, 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:12:25.100620 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] VM Paused (Lifecycle Event)
May 28 10:12:25.113412 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Took 7.22 seconds to spawn the instance on the hypervisor.
May 28 10:12:25.113965 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:12:25.301082 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2043278427',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2043278427',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpattern-image-snapshot-server-2043278427',id=65,image_ref='1998972d-532b-4b3a-bd5f-19aeba2d126b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIcXuzJAQfVEICOjPYWqezGadsBXi/TFIkkC3EgXhGC4zMSPb6/FdcgnDU2y1HUmqdhib8vsj9wxGouFPTuNlI9TjoReWZ3WWjFBEfw3mOm3xuObjODjEFW9sPEGLZIiA==',key_name='tempest-keypair-1687066286',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:11:44Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='23e9651268114327a9cc6c6c59bef01e',ramdisk_id='',reservation_id='r-m2ud72t0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-327944304',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-327944304-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-327944304',owner_user_name='tempest-TestVolumeBootPattern-327944304-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:11:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec58233d3b2848bbb2e0b00650398cd1',uuid=c57fd7fa-e4b8-4620-89ce-34be56feb58e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d6e364b-e498-4e8f-a49b-ec03c1278449", "address": "fa:16:3e:f2:0d:bb", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d6e364b-e4", "ovs_interfaceid": "4d6e364b-e498-4e8f-a49b-ec03c1278449", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:12:25.301357 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converting VIF {"id": "4d6e364b-e498-4e8f-a49b-ec03c1278449", "address": "fa:16:3e:f2:0d:bb", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d6e364b-e4", "ovs_interfaceid": "4d6e364b-e498-4e8f-a49b-ec03c1278449", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:12:25.301778 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:0d:bb,bridge_name='br-int',has_traffic_filtering=True,id=4d6e364b-e498-4e8f-a49b-ec03c1278449,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d6e364b-e4') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:12:25.302014 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:0d:bb,bridge_name='br-int',has_traffic_filtering=True,id=4d6e364b-e498-4e8f-a49b-ec03c1278449,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d6e364b-e4') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:12:25.303526 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:25.303767 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d6e364b-e4, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:12:25.304809 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:25.306210 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:12:25.306423 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:25.307894 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:25.308052 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=250b7739-6a39-4eb4-a258-b1f3c0b0edbc) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:12:25.308509 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:25.309105 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:12:25.309283 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:25.312833 np0000001613 nova-compute[98321]: INFO os_vif [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:0d:bb,bridge_name='br-int',has_traffic_filtering=True,id=4d6e364b-e498-4e8f-a49b-ec03c1278449,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d6e364b-e4')
May 28 10:12:25.314580 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:12:25.315010 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f', 'iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a9c8421e-c803-420d-b094-9e840eb1724f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:12:25.315148 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:12:25.315830 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:12:25.316048 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f', 'iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a9c8421e-c803-420d-b094-9e840eb1724f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:12:25.316301 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:12:25.345358 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:25.345358 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:25.345358 np0000001613 nova-compute[98321]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:12:25.345358 np0000001613 nova-compute[98321]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:12:25.345358 np0000001613 nova-compute[98321]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401 (non-flash)
May 28 10:12:25.345358 np0000001613 nova-compute[98321]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401 (non-flash)
May 28 10:12:25.345358 np0000001613 nova-compute[98321]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39d87a61-a644-439c-9b9e-faf53ad32407 (non-flash)
May 28 10:12:25.345358 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:12:25.345707 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:25.345707 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:25.345707 np0000001613 nova-compute[98321]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:12:25.345707 np0000001613 nova-compute[98321]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f (non-flash)
May 28 10:12:25.345707 np0000001613 nova-compute[98321]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401 (non-flash)
May 28 10:12:25.345707 np0000001613 nova-compute[98321]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401 (non-flash)
May 28 10:12:25.345707 np0000001613 nova-compute[98321]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39d87a61-a644-439c-9b9e-faf53ad32407 (non-flash)
May 28 10:12:25.345707 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:12:25.345707 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623', '150'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623', '151'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f', '161'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f', '162'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401', '167'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401', '168'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-39d87a61-a644-439c-9b9e-faf53ad32407', '169')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:12:25.345994 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f', '161')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:12:25.346636 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f', '162')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:12:25.347420 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1f4347380>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f'): ({'sde'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:12:25.347699 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Removing multipathed devices sdd, sde {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:12:25.347836 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Flush multipath device 3300000000cefd8d8 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:12:25.402620 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:12:25.445648 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:12:25.491040 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:12:25.491731 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:12:25.493375 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:12:25.506591 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:12:25.506884 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:12:25.524731 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:25.569728 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 161, target: iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f, portal: 192.168.40.100,3260]
May 28 10:12:25.569728 np0000001613 nova-compute[98321]: Logout of [sid: 161, target: iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f, portal: 192.168.40.100,3260] successful.
May 28 10:12:25.569728 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:25.600676 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:25.603244 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:12:25.604341 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2e98b49f-f34a-4253-85d9-fd7915be6b4c req-eaa48481-c6df-46d6-968d-3570ba13c77b service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Received event network-vif-plugged-04633d7b-a11f-4e7a-bd98-683a082e8a73 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:12:25.606189 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2e98b49f-f34a-4253-85d9-fd7915be6b4c req-eaa48481-c6df-46d6-968d-3570ba13c77b service nova] Acquiring lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:25.606189 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2e98b49f-f34a-4253-85d9-fd7915be6b4c req-eaa48481-c6df-46d6-968d-3570ba13c77b service nova] Lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:25.606189 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2e98b49f-f34a-4253-85d9-fd7915be6b4c req-eaa48481-c6df-46d6-968d-3570ba13c77b service nova] Lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:25.612239 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2e98b49f-f34a-4253-85d9-fd7915be6b4c req-eaa48481-c6df-46d6-968d-3570ba13c77b service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] No waiting events found dispatching network-vif-plugged-04633d7b-a11f-4e7a-bd98-683a082e8a73 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:12:25.612694 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-2e98b49f-f34a-4253-85d9-fd7915be6b4c req-eaa48481-c6df-46d6-968d-3570ba13c77b service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Received unexpected event network-vif-plugged-04633d7b-a11f-4e7a-bd98-683a082e8a73 for instance with vm_state active and task_state None.
May 28 10:12:25.612990 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963145.6102712, 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:12:25.614252 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] VM Resumed (Lifecycle Event)
May 28 10:12:25.620949 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:25.630631 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Took 12.79 seconds to build instance.
May 28 10:12:25.663908 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 162, target: iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f, portal: 192.168.50.100,3260]
May 28 10:12:25.663908 np0000001613 nova-compute[98321]: Logout of [sid: 162, target: iqn.2023-03.storpool.com:os--volume-a9c8421e-c803-420d-b094-9e840eb1724f, portal: 192.168.50.100,3260] successful.
May 28 10:12:25.663908 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:25.682151 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:25.682510 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:12:25.682960 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] <== disconnect_volume: return (368ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:12:25.683123 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:12:25.683494 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Deleting instance files /opt/stack/data/nova/instances/c57fd7fa-e4b8-4620-89ce-34be56feb58e_del
May 28 10:12:25.684083 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Deletion of /opt/stack/data/nova/instances/c57fd7fa-e4b8-4620-89ce-34be56feb58e_del complete
May 28 10:12:26.026371 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:26.117658 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:12:26.120222 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:12:26.133186 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.301s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:26.202835 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Took 1.78 seconds to destroy the instance on the hypervisor.
May 28 10:12:26.203895 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:12:26.203895 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:12:26.204067 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:12:26.204465 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:26.290414 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:26.623654 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999733825000021 future=<Future at 0x73c1fc157410 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:12:26.822818 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4c453e91-310e-4455-973b-6552eb077ff1 req-b86291de-69e7-4faa-a90a-b5061a759089 service nova] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Received event network-vif-unplugged-4d6e364b-e498-4e8f-a49b-ec03c1278449 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:12:26.822818 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4c453e91-310e-4455-973b-6552eb077ff1 req-b86291de-69e7-4faa-a90a-b5061a759089 service nova] Acquiring lock "c57fd7fa-e4b8-4620-89ce-34be56feb58e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:26.822818 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4c453e91-310e-4455-973b-6552eb077ff1 req-b86291de-69e7-4faa-a90a-b5061a759089 service nova] Lock "c57fd7fa-e4b8-4620-89ce-34be56feb58e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:26.822818 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4c453e91-310e-4455-973b-6552eb077ff1 req-b86291de-69e7-4faa-a90a-b5061a759089 service nova] Lock "c57fd7fa-e4b8-4620-89ce-34be56feb58e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:26.822818 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4c453e91-310e-4455-973b-6552eb077ff1 req-b86291de-69e7-4faa-a90a-b5061a759089 service nova] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] No waiting events found dispatching network-vif-unplugged-4d6e364b-e498-4e8f-a49b-ec03c1278449 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:12:26.822954 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4c453e91-310e-4455-973b-6552eb077ff1 req-b86291de-69e7-4faa-a90a-b5061a759089 service nova] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Received event network-vif-unplugged-4d6e364b-e498-4e8f-a49b-ec03c1278449 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:12:27.262656 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:12:27.765422 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Took 1.56 seconds to deallocate network for instance.
May 28 10:12:28.326398 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Took 0.56 seconds to detach 1 volumes for instance.
May 28 10:12:28.328888 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Deleting volume: a9c8421e-c803-420d-b094-9e840eb1724f {{(pid=98321) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 10:12:28.393469 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:28.393611 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:28.876622 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:28.876938 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:28.896652 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-feb42acf-8ee8-4eb3-826a-7e4d6a419b63 req-727c41a2-d056-4492-b30f-1248ed2dc7d7 service nova] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Received event network-vif-deleted-4d6e364b-e498-4e8f-a49b-ec03c1278449 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:12:28.900439 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lazy-loading 'flavor' on Instance uuid 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:12:29.241696 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:12:29.241946 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:12:29.309314 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:29.751435 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:12:29.907185 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:29.933856 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:30.262267 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.385s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:30.310368 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:30.333992 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Deleted allocations for instance c57fd7fa-e4b8-4620-89ce-34be56feb58e
May 28 10:12:30.694090 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Acquiring lock "405de22b-28c5-4415-ad12-e7e8eae4d591" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:30.694090 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "405de22b-28c5-4415-ad12-e7e8eae4d591" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:30.885481 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0033936609997908818 future=<Future at 0x73c1f43ce6f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:12:30.886519 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Emitting event <LifecycleEvent: 1779963135.8819823, 60cce3b4-1065-4568-9777-9b78ee43a55b => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:12:30.887023 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:12:30.887302 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] VM Stopped (Lifecycle Event)
May 28 10:12:30.888533 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=10.734884431999944 future=<Future at 0x73c1fc157410 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:12:30.889023 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=10.734607787000186 future=<Future at 0x73c1fc157410 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:12:31.004198 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:31.004198 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:31.004198 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Attaching volume adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a to /dev/vdb
May 28 10:12:31.059196 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:12:31.072210 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:12:31.103189 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:12:31.156562 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:12:31.157127 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:12:31.167862 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:12:31.170263 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fee7:8ceb', 'fe80::e4eb:4cff:fe5c:5eb7', 'fe80::fc16:3eff:fe86:5388', 'fe80::5c44:a2ff:fe78:6c5f', 'fe80::fc16:3eff:fe8c:4068', 'fe80::9098:76ff:fe86:646f', 'fe80::fc16:3eff:fef0:49ef', 'fe80::e03f:79ff:fe2f:2d97'] 
May 28 10:12:31.170263 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:12:31.170263 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:12:31.170263 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:12:31.170754 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Updating existing volume attachment record: c1daa966-b779-464a-9fca-dd235a3930ce {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:12:31.197441 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:12:31.344255 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-73700f9f-a7ce-439e-81bc-401e656826e7 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "c57fd7fa-e4b8-4620-89ce-34be56feb58e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.438s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:31.388603 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:31.390496 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: 60cce3b4-1065-4568-9777-9b78ee43a55b] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:12:31.753066 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:12:31.753563 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a', 'iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:12:31.753789 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:12:31.754425 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:12:31.754665 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a', 'iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:12:31.771333 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:12:31.772024 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:12:31.772336 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:12:31.773056 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:12:31.773773 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:12:31.774007 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:12:31.785942 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:31.785942 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:31.787843 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:12:31.787843 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:31.790466 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:12:31.790605 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Claim successful on node np0000001613
May 28 10:12:31.797411 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:12:31.797411 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:31.806802 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a] added
May 28 10:12:31.806802 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:12:31.806802 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:12:31.806802 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:12:31.806802 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:12:31.806802 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:12:31.806802 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:31.806802 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:12:31.807070 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0347(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:12:31.807227 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:12:31.812802 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a] added
May 28 10:12:31.812802 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:12:31.812802 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:12:31.812802 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:12:31.812802 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:12:31.812802 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:12:31.812802 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:31.813185 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:12:31.813235 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0392(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:12:31.814021 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:12:32.478498 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Acquiring lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:32.478872 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:32.807731 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:12:32.814556 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:12:32.823703 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:12:32.823703 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:12:32.832059 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:12:32.832059 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:32.839854 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:32.846553 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:32.858582 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:32.858582 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:32.858582 np0000001613 nova-compute[98321]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401 (non-flash)
May 28 10:12:32.858582 np0000001613 nova-compute[98321]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401 (non-flash)
May 28 10:12:32.858582 np0000001613 nova-compute[98321]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39d87a61-a644-439c-9b9e-faf53ad32407 (non-flash)
May 28 10:12:32.858582 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:12:32.858892 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsi session list stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:32.858892 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:32.858892 np0000001613 nova-compute[98321]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401 (non-flash)
May 28 10:12:32.858892 np0000001613 nova-compute[98321]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401 (non-flash)
May 28 10:12:32.858892 np0000001613 nova-compute[98321]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39d87a61-a644-439c-9b9e-faf53ad32407 (non-flash)
May 28 10:12:32.858892 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:12:32.864543 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:32.864543 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:32.864543 np0000001613 nova-compute[98321]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401 (non-flash)
May 28 10:12:32.864543 np0000001613 nova-compute[98321]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401 (non-flash)
May 28 10:12:32.864543 np0000001613 nova-compute[98321]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39d87a61-a644-439c-9b9e-faf53ad32407 (non-flash)
May 28 10:12:32.864543 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:12:32.864825 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsi session list stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:32.864825 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:32.864825 np0000001613 nova-compute[98321]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401 (non-flash)
May 28 10:12:32.864825 np0000001613 nova-compute[98321]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401 (non-flash)
May 28 10:12:32.864825 np0000001613 nova-compute[98321]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39d87a61-a644-439c-9b9e-faf53ad32407 (non-flash)
May 28 10:12:32.864825 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:12:32.895081 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a, portal: 192.168.40.100,3260]
May 28 10:12:32.895081 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a, portal: 192.168.40.100,3260] successful.
May 28 10:12:32.895081 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:32.906556 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a, portal: 192.168.50.100,3260]
May 28 10:12:32.906556 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a, portal: 192.168.50.100,3260] successful.
May 28 10:12:32.906556 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:32.911264 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:32.919283 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:32.930185 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:32.930185 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:32.930185 np0000001613 nova-compute[98321]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401 (non-flash)
May 28 10:12:32.930185 np0000001613 nova-compute[98321]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401 (non-flash)
May 28 10:12:32.930185 np0000001613 nova-compute[98321]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39d87a61-a644-439c-9b9e-faf53ad32407 (non-flash)
May 28 10:12:32.930185 np0000001613 nova-compute[98321]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:32.930185 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:32.930185 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:12:32.930185 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsi session list stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:32.930185 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:32.930185 np0000001613 nova-compute[98321]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401 (non-flash)
May 28 10:12:32.930185 np0000001613 nova-compute[98321]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401 (non-flash)
May 28 10:12:32.930185 np0000001613 nova-compute[98321]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39d87a61-a644-439c-9b9e-faf53ad32407 (non-flash)
May 28 10:12:32.930185 np0000001613 nova-compute[98321]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:32.930185 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:32.930185 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:12:32.930185 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.156s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:12:32.930185 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:12:32.930185 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] HCTL ('9', '-', '-', 0) found on session 170 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:12:32.930185 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:12:32.937968 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:32.937968 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:32.937968 np0000001613 nova-compute[98321]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401 (non-flash)
May 28 10:12:32.937968 np0000001613 nova-compute[98321]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401 (non-flash)
May 28 10:12:32.937968 np0000001613 nova-compute[98321]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39d87a61-a644-439c-9b9e-faf53ad32407 (non-flash)
May 28 10:12:32.937968 np0000001613 nova-compute[98321]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:32.937968 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:32.937968 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:12:32.938218 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsi session list stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:32.938218 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:32.938218 np0000001613 nova-compute[98321]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401 (non-flash)
May 28 10:12:32.938218 np0000001613 nova-compute[98321]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401 (non-flash)
May 28 10:12:32.938218 np0000001613 nova-compute[98321]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39d87a61-a644-439c-9b9e-faf53ad32407 (non-flash)
May 28 10:12:32.938218 np0000001613 nova-compute[98321]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:32.938218 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:32.938218 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:12:32.938444 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.165s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:12:32.938582 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:12:32.939507 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] HCTL ('10', '-', '-', 0) found on session 171 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:12:32.939636 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:12:32.947657 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Searching for a device in session 170 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:12:32.947789 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:12:32.953090 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Searching for a device in session 171 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:12:32.953090 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:12:32.982606 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Detaching volume f7ffc7cd-3f54-455e-a48d-c0cf435cc401
May 28 10:12:33.093549 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Attempting to driver detach volume f7ffc7cd-3f54-455e-a48d-c0cf435cc401 from mountpoint /dev/vdb
May 28 10:12:33.098336 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Found disk vdb by alias ua-f7ffc7cd-3f54-455e-a48d-c0cf435cc401 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:12:33.099520 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Found disk vdb by alias ua-f7ffc7cd-3f54-455e-a48d-c0cf435cc401 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:12:33.099645 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Attempting to detach device vdb from instance 8849d62e-d9a4-4285-95fc-0869cbf20b4c from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 10:12:33.099919 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:12:33.099919 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:12:33.099919 np0000001613 nova-compute[98321]:   <alias name="ua-f7ffc7cd-3f54-455e-a48d-c0cf435cc401"/>
May 28 10:12:33.099919 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-2"/>
May 28 10:12:33.099919 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:12:33.099919 np0000001613 nova-compute[98321]:   <serial>f7ffc7cd-3f54-455e-a48d-c0cf435cc401</serial>
May 28 10:12:33.099919 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:12:33.099919 np0000001613 nova-compute[98321]: </disk>
May 28 10:12:33.099919 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:12:33.110571 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Successfully detached device vdb from instance 8849d62e-d9a4-4285-95fc-0869cbf20b4c from the persistent domain config.
May 28 10:12:33.110571 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] (1/8): Attempting to detach device vdb with device alias ua-f7ffc7cd-3f54-455e-a48d-c0cf435cc401 from instance 8849d62e-d9a4-4285-95fc-0869cbf20b4c from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 10:12:33.110855 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:12:33.110855 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:12:33.110855 np0000001613 nova-compute[98321]:   <alias name="ua-f7ffc7cd-3f54-455e-a48d-c0cf435cc401"/>
May 28 10:12:33.110855 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-2"/>
May 28 10:12:33.110855 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:12:33.110855 np0000001613 nova-compute[98321]:   <serial>f7ffc7cd-3f54-455e-a48d-c0cf435cc401</serial>
May 28 10:12:33.110855 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:12:33.110855 np0000001613 nova-compute[98321]: </disk>
May 28 10:12:33.110855 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:12:33.182254 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:12:33.182591 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:12:33.664368 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-f7ffc7cd-3f54-455e-a48d-c0cf435cc401 for instance 8849d62e-d9a4-4285-95fc-0869cbf20b4c {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 10:12:33.665025 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779963153.6645825, 8849d62e-d9a4-4285-95fc-0869cbf20b4c => ua-f7ffc7cd-3f54-455e-a48d-c0cf435cc401> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 10:12:33.667499 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Successfully detached device vdb from instance 8849d62e-d9a4-4285-95fc-0869cbf20b4c from the live domain config.
May 28 10:12:33.668546 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:12:33.668846 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401', 'iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7ffc7cd-3f54-455e-a48d-c0cf435cc401', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:12:33.669027 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:12:33.688136 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:12:33.718787 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:33.719061 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:33.719412 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:33.719574 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:33.719710 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:33.722514 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Terminating instance
May 28 10:12:33.774110 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:12:34.195057 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.409s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:34.195499 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:12:34.226231 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:12:34.247374 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:34.270876 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:34.272404 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:34.297371 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:34.410970 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cd3c2411-38b3-46b6-94c7-1364cfab309d req-4ecf2451-27cf-476c-bc3a-f3d9ac51ed6e service nova] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Received event network-vif-unplugged-f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:12:34.411658 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cd3c2411-38b3-46b6-94c7-1364cfab309d req-4ecf2451-27cf-476c-bc3a-f3d9ac51ed6e service nova] Acquiring lock "5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:34.411658 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cd3c2411-38b3-46b6-94c7-1364cfab309d req-4ecf2451-27cf-476c-bc3a-f3d9ac51ed6e service nova] Lock "5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:34.411769 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cd3c2411-38b3-46b6-94c7-1364cfab309d req-4ecf2451-27cf-476c-bc3a-f3d9ac51ed6e service nova] Lock "5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:34.411871 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cd3c2411-38b3-46b6-94c7-1364cfab309d req-4ecf2451-27cf-476c-bc3a-f3d9ac51ed6e service nova] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] No waiting events found dispatching network-vif-unplugged-f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:12:34.412053 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cd3c2411-38b3-46b6-94c7-1364cfab309d req-4ecf2451-27cf-476c-bc3a-f3d9ac51ed6e service nova] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Received event network-vif-unplugged-f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:12:34.537723 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:34.548852 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:34.578954 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999725959999978 future=<Future at 0x73c1fc1680b0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:12:34.582255 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Instance destroyed successfully.
May 28 10:12:34.582864 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lazy-loading 'resources' on Instance uuid 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:12:34.704188 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:12:34.704188 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:12:34.704188 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:34.704188 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:34.776068 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f734f16600ef4cb88fdf7e170dd7f3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bbdf692768465db607aa60a630e5e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:12:34.808980 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Found WWN 330000000025109af for multipath device dm-4 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:12:34.808980 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.053s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:12:34.808980 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] <== connect_volume: return (3053ms) {'type': 'block', 'scsi_wwn': '330000000025109af', 'path': '/dev/dm-4', 'multipath_id': '330000000025109af'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:12:34.808980 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000025109af', 'path': '/dev/dm-4', 'multipath_id': '330000000025109af'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:12:34.808980 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.139s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:12:34.808980 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401', 'iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7ffc7cd-3f54-455e-a48d-c0cf435cc401', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:12:34.808980 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:12:34.810979 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lazy-loading 'flavor' on Instance uuid 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:12:34.844044 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:34.844044 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:34.844044 np0000001613 nova-compute[98321]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401 (non-flash)
May 28 10:12:34.844044 np0000001613 nova-compute[98321]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401 (non-flash)
May 28 10:12:34.844044 np0000001613 nova-compute[98321]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39d87a61-a644-439c-9b9e-faf53ad32407 (non-flash)
May 28 10:12:34.844044 np0000001613 nova-compute[98321]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:34.844044 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:34.844044 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:12:34.844532 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsi session list stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:34.844532 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:34.844532 np0000001613 nova-compute[98321]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401 (non-flash)
May 28 10:12:34.844532 np0000001613 nova-compute[98321]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401 (non-flash)
May 28 10:12:34.844532 np0000001613 nova-compute[98321]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39d87a61-a644-439c-9b9e-faf53ad32407 (non-flash)
May 28 10:12:34.844532 np0000001613 nova-compute[98321]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:34.844532 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:34.844532 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:12:34.844532 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623', '150'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623', '151'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401', '167'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401', '168'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-39d87a61-a644-439c-9b9e-faf53ad32407', '169'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a', '170'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a', '171')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:12:34.844746 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401', '168')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:12:34.845549 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401', '167')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:12:34.846354 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc2aaca0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401'): ({'sdf'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:12:34.846542 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Removing multipathed devices sdg, sdf {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:12:34.846770 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Flush multipath device 3300000005e83c097 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:12:34.888835 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:12:34.935676 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:34.938084 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:12:34.992791 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:12:34.992958 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:12:34.994103 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:12:35.005400 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:12:35.005651 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:12:35.019478 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:35.068835 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 168, target: iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401, portal: 192.168.40.100,3260]
May 28 10:12:35.068835 np0000001613 nova-compute[98321]: Logout of [sid: 168, target: iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401, portal: 192.168.40.100,3260] successful.
May 28 10:12:35.068835 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:35.085844 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:10:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1154159386',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1154159386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpattern-volume-backed-server-1154159386',id=60,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSGdGDTpkrfeA5bxTBraSUAdxFaEI225UG+XhKLS/HXxUQ2rB9uEiU5bBBTd7sBRG6A4cYQs3Jv4Yyb7HHlgmDWttsOJBcveq/4gyM/RNwXAYVDIGRikZqLT6mOn3+p9Q==',key_name='tempest-keypair-138210009',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:10:42Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='23e9651268114327a9cc6c6c59bef01e',ramdisk_id='',reservation_id='r-exvv2blf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-327944304',owner_user_name='tempest-TestVolumeBootPattern-327944304-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:10:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec58233d3b2848bbb2e0b00650398cd1',uuid=5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b", "address": "fa:16:3e:e7:8c:eb", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e7bd1f-7b", "ovs_interfaceid": "f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:12:35.086204 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converting VIF {"id": "f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b", "address": "fa:16:3e:e7:8c:eb", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e7bd1f-7b", "ovs_interfaceid": "f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:12:35.087070 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:8c:eb,bridge_name='br-int',has_traffic_filtering=True,id=f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e7bd1f-7b') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:12:35.087837 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:8c:eb,bridge_name='br-int',has_traffic_filtering=True,id=f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e7bd1f-7b') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:12:35.091242 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:35.094191 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:35.094561 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9e7bd1f-7b, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:12:35.103124 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:35.104701 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:12:35.105362 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:35.105955 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ce208a3e-4ea0-4058-ab0f-cb364ecfe115) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:12:35.106838 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:35.107316 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:35.108356 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:12:35.111557 np0000001613 nova-compute[98321]: INFO os_vif [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:8c:eb,bridge_name='br-int',has_traffic_filtering=True,id=f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e7bd1f-7b')
May 28 10:12:35.116556 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:12:35.118143 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623', 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '73471d14-2d44-4513-afbe-2a601903e623', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:12:35.118302 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:12:35.144740 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 167, target: iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401, portal: 192.168.50.100,3260]
May 28 10:12:35.144740 np0000001613 nova-compute[98321]: Logout of [sid: 167, target: iqn.2023-03.storpool.com:os--volume-f7ffc7cd-3f54-455e-a48d-c0cf435cc401, portal: 192.168.50.100,3260] successful.
May 28 10:12:35.144740 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:35.165051 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:35.165371 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:12:35.165603 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] <== disconnect_volume: return (1496ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:12:35.165836 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:12:35.169248 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.051s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:12:35.169748 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623', 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '73471d14-2d44-4513-afbe-2a601903e623', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:12:35.170112 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:12:35.206533 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:12:35.209864 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:35.209864 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:35.209864 np0000001613 nova-compute[98321]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39d87a61-a644-439c-9b9e-faf53ad32407 (non-flash)
May 28 10:12:35.209864 np0000001613 nova-compute[98321]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:35.209864 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:35.209864 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:12:35.210420 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:35.210420 np0000001613 nova-compute[98321]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623 (non-flash)
May 28 10:12:35.210420 np0000001613 nova-compute[98321]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39d87a61-a644-439c-9b9e-faf53ad32407 (non-flash)
May 28 10:12:35.210420 np0000001613 nova-compute[98321]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:35.210420 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:35.210420 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:12:35.210672 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623', '150'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623', '151'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-39d87a61-a644-439c-9b9e-faf53ad32407', '169'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a', '170'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a', '171')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:12:35.210883 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623', '151')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:12:35.212042 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623', '150')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:12:35.214128 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc20b7e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623'): ({'sdb'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:12:35.214442 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Removing multipathed devices sdb, sdc {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:12:35.214737 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Flush multipath device 33000000033a15670 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:12:35.263407 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:12:35.319216 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Attempting to attach volume adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 10:12:35.320422 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] attach device xml: <disk type="block" device="disk">
May 28 10:12:35.320422 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:12:35.320422 np0000001613 nova-compute[98321]:   <alias name="ua-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a"/>
May 28 10:12:35.320422 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-4"/>
May 28 10:12:35.320422 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:12:35.320422 np0000001613 nova-compute[98321]:   <serial>adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a</serial>
May 28 10:12:35.320422 np0000001613 nova-compute[98321]: </disk>
May 28 10:12:35.320422 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 10:12:35.321751 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:12:35.335446 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Successfully created port: dde08f5f-faec-48b5-87a9-f4d4069875f0 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:12:35.374850 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:12:35.375010 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:12:35.375940 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:12:35.389531 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:12:35.389787 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:12:35.401678 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:35.434727 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 151, target: iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623, portal: 192.168.40.100,3260]
May 28 10:12:35.434727 np0000001613 nova-compute[98321]: Logout of [sid: 151, target: iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623, portal: 192.168.40.100,3260] successful.
May 28 10:12:35.434727 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:35.449286 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:35.461781 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:35.491480 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 150, target: iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623, portal: 192.168.50.100,3260]
May 28 10:12:35.491480 np0000001613 nova-compute[98321]: Logout of [sid: 150, target: iqn.2023-03.storpool.com:os--volume-73471d14-2d44-4513-afbe-2a601903e623, portal: 192.168.50.100,3260] successful.
May 28 10:12:35.491480 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:35.508632 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:35.508892 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:12:35.509063 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] <== disconnect_volume: return (390ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:12:35.509181 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:12:35.509694 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Deleting instance files /opt/stack/data/nova/instances/5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9_del
May 28 10:12:35.510179 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Deletion of /opt/stack/data/nova/instances/5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9_del complete
May 28 10:12:35.710479 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:12:35.760802 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lazy-loading 'flavor' on Instance uuid 8849d62e-d9a4-4285-95fc-0869cbf20b4c {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:12:35.770410 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Acquiring lock "93a38b6d-e199-4653-a617-290247c8e430" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:35.770410 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "93a38b6d-e199-4653-a617-290247c8e430" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:35.866123 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Successfully updated port: dde08f5f-faec-48b5-87a9-f4d4069875f0 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:12:35.919447 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-816ecda3-b136-432a-a072-f6d6e1f7a99e req-0820d8bb-96a5-4870-bc22-8a4b0a5d1caa service nova] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Received event network-changed-dde08f5f-faec-48b5-87a9-f4d4069875f0 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:12:35.921155 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-816ecda3-b136-432a-a072-f6d6e1f7a99e req-0820d8bb-96a5-4870-bc22-8a4b0a5d1caa service nova] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Refreshing instance network info cache due to event network-changed-dde08f5f-faec-48b5-87a9-f4d4069875f0. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:12:35.921155 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-816ecda3-b136-432a-a072-f6d6e1f7a99e req-0820d8bb-96a5-4870-bc22-8a4b0a5d1caa service nova] Acquiring lock "refresh_cache-405de22b-28c5-4415-ad12-e7e8eae4d591" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:12:35.921155 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-816ecda3-b136-432a-a072-f6d6e1f7a99e req-0820d8bb-96a5-4870-bc22-8a4b0a5d1caa service nova] Acquired lock "refresh_cache-405de22b-28c5-4415-ad12-e7e8eae4d591" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:12:35.921155 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-816ecda3-b136-432a-a072-f6d6e1f7a99e req-0820d8bb-96a5-4870-bc22-8a4b0a5d1caa service nova] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Refreshing network info cache for port dde08f5f-faec-48b5-87a9-f4d4069875f0 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:12:36.020616 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Took 1.79 seconds to destroy the instance on the hypervisor.
May 28 10:12:36.024507 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:12:36.024762 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:12:36.025191 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:12:36.025533 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:36.149428 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:36.273633 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:12:36.368746 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Acquiring lock "refresh_cache-405de22b-28c5-4415-ad12-e7e8eae4d591" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:12:36.422713 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-816ecda3-b136-432a-a072-f6d6e1f7a99e req-0820d8bb-96a5-4870-bc22-8a4b0a5d1caa service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:36.520131 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a4421f31-8c55-4218-ada8-6a1a20e14692 req-ddc848e9-c98d-4a88-a3b3-10a9ec3176a9 service nova] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Received event network-vif-unplugged-f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:12:36.520325 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a4421f31-8c55-4218-ada8-6a1a20e14692 req-ddc848e9-c98d-4a88-a3b3-10a9ec3176a9 service nova] Acquiring lock "5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:36.520526 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a4421f31-8c55-4218-ada8-6a1a20e14692 req-ddc848e9-c98d-4a88-a3b3-10a9ec3176a9 service nova] Lock "5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:36.520661 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a4421f31-8c55-4218-ada8-6a1a20e14692 req-ddc848e9-c98d-4a88-a3b3-10a9ec3176a9 service nova] Lock "5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:36.520821 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a4421f31-8c55-4218-ada8-6a1a20e14692 req-ddc848e9-c98d-4a88-a3b3-10a9ec3176a9 service nova] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] No waiting events found dispatching network-vif-unplugged-f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:12:36.520939 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a4421f31-8c55-4218-ada8-6a1a20e14692 req-ddc848e9-c98d-4a88-a3b3-10a9ec3176a9 service nova] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Received event network-vif-unplugged-f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:12:36.534344 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-816ecda3-b136-432a-a072-f6d6e1f7a99e req-0820d8bb-96a5-4870-bc22-8a4b0a5d1caa service nova] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:12:36.720315 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:12:36.721983 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:12:36.722210 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Creating image(s)
May 28 10:12:36.723063 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Acquiring lock "/opt/stack/data/nova/instances/405de22b-28c5-4415-ad12-e7e8eae4d591/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:36.723322 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "/opt/stack/data/nova/instances/405de22b-28c5-4415-ad12-e7e8eae4d591/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:36.724365 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "/opt/stack/data/nova/instances/405de22b-28c5-4415-ad12-e7e8eae4d591/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:36.724988 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:12:36.730719 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:12:36.732745 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:12:36.761119 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-816ecda3-b136-432a-a072-f6d6e1f7a99e req-0820d8bb-96a5-4870-bc22-8a4b0a5d1caa service nova] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:12:36.771446 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a043b4cc-accc-4cdc-8cfc-ecc6a371e5c2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.292s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:36.833439 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.101s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:12:36.834085 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:36.834435 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:36.834897 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:12:36.839837 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:12:36.840329 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:12:36.884272 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:36.884272 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:36.897289 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:12:36.897289 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Claim successful on node np0000001613
May 28 10:12:36.953155 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.113s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:12:36.954286 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/405de22b-28c5-4415-ad12-e7e8eae4d591/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:12:37.003830 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:12:37.004476 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:12:37.004476 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:12:37.004476 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] No VIF found with MAC fa:16:3e:f0:49:ef, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:12:37.018571 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/405de22b-28c5-4415-ad12-e7e8eae4d591/disk 1073741824" returned: 0 in 0.064s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:12:37.019249 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:37.019675 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:12:37.096420 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:12:37.141648 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.122s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:12:37.145572 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Checking if we can resize image /opt/stack/data/nova/instances/405de22b-28c5-4415-ad12-e7e8eae4d591/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:12:37.145798 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/405de22b-28c5-4415-ad12-e7e8eae4d591/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:12:37.259281 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/405de22b-28c5-4415-ad12-e7e8eae4d591/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:12:37.259786 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Cannot resize image /opt/stack/data/nova/instances/405de22b-28c5-4415-ad12-e7e8eae4d591/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:12:37.260294 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:12:37.260564 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Ensure instance console log exists: /opt/stack/data/nova/instances/405de22b-28c5-4415-ad12-e7e8eae4d591/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:12:37.260937 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:37.261269 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:37.261513 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:37.266427 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-816ecda3-b136-432a-a072-f6d6e1f7a99e req-0820d8bb-96a5-4870-bc22-8a4b0a5d1caa service nova] Releasing lock "refresh_cache-405de22b-28c5-4415-ad12-e7e8eae4d591" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:12:37.267081 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Acquired lock "refresh_cache-405de22b-28c5-4415-ad12-e7e8eae4d591" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:12:37.267337 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:12:37.599690 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Took 1.57 seconds to deallocate network for instance.
May 28 10:12:37.854364 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:12:37.964996 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Acquiring lock "38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:37.965269 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Lock "38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:38.054281 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:38.156438 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Took 0.56 seconds to detach 1 volumes for instance.
May 28 10:12:38.159974 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Deleting volume: 73471d14-2d44-4513-afbe-2a601903e623 {{(pid=98321) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 10:12:38.209292 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Updating instance_info_cache with network_info: [{"id": "dde08f5f-faec-48b5-87a9-f4d4069875f0", "address": "fa:16:3e:28:03:66", "network": {"id": "8d701503-e690-42e6-8d82-0987ffcf4209", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1480012678-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a4bbdf692768465db607aa60a630e5e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde08f5f-fa", "ovs_interfaceid": "dde08f5f-faec-48b5-87a9-f4d4069875f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:12:38.354572 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:12:38.354848 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:12:38.469965 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Lazy-loading 'flavor' on Instance uuid 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:12:38.563889 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7ab0a270-1482-40a2-afd1-deca508859d6 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.560s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:38.604334 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5207fb1f-6e62-41fd-a085-3523389af77a req-9a1d2269-42c4-42bd-b173-7e600d4e8b7d service nova] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Received event network-vif-deleted-f9e7bd1f-7b4a-466c-887e-1b2bcc366b2b {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:12:38.711682 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Releasing lock "refresh_cache-405de22b-28c5-4415-ad12-e7e8eae4d591" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:12:38.711961 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Instance network_info: |[{"id": "dde08f5f-faec-48b5-87a9-f4d4069875f0", "address": "fa:16:3e:28:03:66", "network": {"id": "8d701503-e690-42e6-8d82-0987ffcf4209", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1480012678-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a4bbdf692768465db607aa60a630e5e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde08f5f-fa", "ovs_interfaceid": "dde08f5f-faec-48b5-87a9-f4d4069875f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:12:38.713543 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Start _get_guest_xml network_info=[{"id": "dde08f5f-faec-48b5-87a9-f4d4069875f0", "address": "fa:16:3e:28:03:66", "network": {"id": "8d701503-e690-42e6-8d82-0987ffcf4209", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1480012678-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a4bbdf692768465db607aa60a630e5e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde08f5f-fa", "ovs_interfaceid": "dde08f5f-faec-48b5-87a9-f4d4069875f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:12:38.715766 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:38.717590 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:12:38.718665 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-VolumesSnapshotTestJSON-instance-1765933896', uuid='405de22b-28c5-4415-ad12-e7e8eae4d591'), owner=OwnerMeta(userid='f734f16600ef4cb88fdf7e170dd7f3a0', username='tempest-VolumesSnapshotTestJSON-4375881-project-member', projectid='a4bbdf692768465db607aa60a630e5e2', projectname='tempest-VolumesSnapshotTestJSON-4375881'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "dde08f5f-faec-48b5-87a9-f4d4069875f0", "address": "fa:16:3e:28:03:66", "network": {"id": "8d701503-e690-42e6-8d82-0987ffcf4209", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1480012678-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a4bbdf692768465db607aa60a630e5e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde08f5f-fa", "ovs_interfaceid": "dde08f5f-faec-48b5-87a9-f4d4069875f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779963158.7183456) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:12:38.719961 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:12:38.720288 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:12:38.721701 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:12:38.721851 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:12:38.722747 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:12:38.723010 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:12:38.723137 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:12:38.723268 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:12:38.723382 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:12:38.723463 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:12:38.723569 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:12:38.723711 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:12:38.723800 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:12:38.723898 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:12:38.723987 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:12:38.724093 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:12:38.734593 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:12:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1765933896',display_name='tempest-VolumesSnapshotTestJSON-instance-1765933896',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumessnapshottestjson-instance-1765933896',id=68,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVtEtJ3IIoWtzxHrrCF9S9ZjZ/UqtbeSFn2f8p1n/3Nd1jt5BwroFKyawGPEa7s/AUA6TypH6ehdGP7XropZc0PQDp/4YerW0IzSanzYlkGXwN7t+ck5C8uhUYKic/h0g==',key_name='tempest-keypair-2069242342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4bbdf692768465db607aa60a630e5e2',ramdisk_id='',reservation_id='r-gwooed2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-4375881',owner_user_name='tempest-VolumesSnapshotTestJSON-4375881-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:12:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f734f16600ef4cb88fdf7e170dd7f3a0',uuid=405de22b-28c5-4415-ad12-e7e8eae4d591,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dde08f5f-faec-48b5-87a9-f4d4069875f0", "address": "fa:16:3e:28:03:66", "network": {"id": "8d701503-e690-42e6-8d82-0987ffcf4209", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1480012678-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a4bbdf692768465db607aa60a630e5e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde08f5f-fa", "ovs_interfaceid": "dde08f5f-faec-48b5-87a9-f4d4069875f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:12:38.735153 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Converting VIF {"id": "dde08f5f-faec-48b5-87a9-f4d4069875f0", "address": "fa:16:3e:28:03:66", "network": {"id": "8d701503-e690-42e6-8d82-0987ffcf4209", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1480012678-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a4bbdf692768465db607aa60a630e5e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde08f5f-fa", "ovs_interfaceid": "dde08f5f-faec-48b5-87a9-f4d4069875f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:12:38.735765 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:03:66,bridge_name='br-int',has_traffic_filtering=True,id=dde08f5f-faec-48b5-87a9-f4d4069875f0,network=Network(8d701503-e690-42e6-8d82-0987ffcf4209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdde08f5f-fa') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:12:38.736263 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lazy-loading 'pci_devices' on Instance uuid 405de22b-28c5-4415-ad12-e7e8eae4d591 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:12:38.857883 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:12:39.069392 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Acquiring lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:39.069628 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:39.239361 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] End _get_guest_xml xml=<domain type="qemu">
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:   <uuid>405de22b-28c5-4415-ad12-e7e8eae4d591</uuid>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:   <name>instance-00000044</name>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1765933896</nova:name>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:12:38</nova:creationTime>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:         <nova:user uuid="f734f16600ef4cb88fdf7e170dd7f3a0">tempest-VolumesSnapshotTestJSON-4375881-project-member</nova:user>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:         <nova:project uuid="a4bbdf692768465db607aa60a630e5e2">tempest-VolumesSnapshotTestJSON-4375881</nova:project>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:         <nova:port uuid="dde08f5f-faec-48b5-87a9-f4d4069875f0">
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:     <system>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:       <entry name="serial">405de22b-28c5-4415-ad12-e7e8eae4d591</entry>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:       <entry name="uuid">405de22b-28c5-4415-ad12-e7e8eae4d591</entry>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:     </system>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:   <os>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:   </os>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:   <features>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:   </features>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:   <devices>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/405de22b-28c5-4415-ad12-e7e8eae4d591/disk"/>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:     </disk>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/405de22b-28c5-4415-ad12-e7e8eae4d591/disk.config"/>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:     </disk>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:28:03:66"/>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:       <target dev="tapdde08f5f-fa"/>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:     </interface>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/405de22b-28c5-4415-ad12-e7e8eae4d591/console.log" append="off"/>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:     </serial>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:     <video>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:     </video>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:     </rng>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:   </devices>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]: </domain>
May 28 10:12:39.239361 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:12:39.241689 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Preparing to wait for external event network-vif-plugged-dde08f5f-faec-48b5-87a9-f4d4069875f0 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:12:39.241689 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Acquiring lock "405de22b-28c5-4415-ad12-e7e8eae4d591-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:39.241689 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "405de22b-28c5-4415-ad12-e7e8eae4d591-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:39.241689 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "405de22b-28c5-4415-ad12-e7e8eae4d591-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:39.241689 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:12:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1765933896',display_name='tempest-VolumesSnapshotTestJSON-instance-1765933896',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumessnapshottestjson-instance-1765933896',id=68,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVtEtJ3IIoWtzxHrrCF9S9ZjZ/UqtbeSFn2f8p1n/3Nd1jt5BwroFKyawGPEa7s/AUA6TypH6ehdGP7XropZc0PQDp/4YerW0IzSanzYlkGXwN7t+ck5C8uhUYKic/h0g==',key_name='tempest-keypair-2069242342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4bbdf692768465db607aa60a630e5e2',ramdisk_id='',reservation_id='r-gwooed2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-4375881',owner_user_name='tempest-VolumesSnapshotTestJSON-4375881-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:12:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f734f16600ef4cb88fdf7e170dd7f3a0',uuid=405de22b-28c5-4415-ad12-e7e8eae4d591,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dde08f5f-faec-48b5-87a9-f4d4069875f0", "address": "fa:16:3e:28:03:66", "network": {"id": "8d701503-e690-42e6-8d82-0987ffcf4209", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1480012678-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a4bbdf692768465db607aa60a630e5e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde08f5f-fa", "ovs_interfaceid": "dde08f5f-faec-48b5-87a9-f4d4069875f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:12:39.241689 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Converting VIF {"id": "dde08f5f-faec-48b5-87a9-f4d4069875f0", "address": "fa:16:3e:28:03:66", "network": {"id": "8d701503-e690-42e6-8d82-0987ffcf4209", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1480012678-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a4bbdf692768465db607aa60a630e5e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde08f5f-fa", "ovs_interfaceid": "dde08f5f-faec-48b5-87a9-f4d4069875f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:12:39.241689 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:03:66,bridge_name='br-int',has_traffic_filtering=True,id=dde08f5f-faec-48b5-87a9-f4d4069875f0,network=Network(8d701503-e690-42e6-8d82-0987ffcf4209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdde08f5f-fa') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:12:39.242253 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:03:66,bridge_name='br-int',has_traffic_filtering=True,id=dde08f5f-faec-48b5-87a9-f4d4069875f0,network=Network(8d701503-e690-42e6-8d82-0987ffcf4209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdde08f5f-fa') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:12:39.242578 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:39.243101 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:12:39.243740 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:12:39.244607 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:39.245277 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8a09dc03-a519-57ee-9e2a-70ece3af7686', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:12:39.246402 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:39.246402 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:12:39.247207 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:39.249415 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:39.249713 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdde08f5f-fa, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:12:39.250120 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdde08f5f-fa, col_values=(('qos', UUID('aa0312a6-b36d-408d-96d4-f4c23d4e8df0')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:12:39.250380 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdde08f5f-fa, col_values=(('external_ids', {'iface-id': 'dde08f5f-faec-48b5-87a9-f4d4069875f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:03:66', 'vm-uuid': '405de22b-28c5-4415-ad12-e7e8eae4d591'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:12:39.251280 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:39.253253 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:12:39.261396 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:39.261894 np0000001613 nova-compute[98321]: INFO os_vif [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:03:66,bridge_name='br-int',has_traffic_filtering=True,id=dde08f5f-faec-48b5-87a9-f4d4069875f0,network=Network(8d701503-e690-42e6-8d82-0987ffcf4209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdde08f5f-fa')
May 28 10:12:39.366202 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.482s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:39.366780 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.651s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:39.366991 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:12:39.475963 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Lock "38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:39.572758 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lazy-loading 'flavor' on Instance uuid 8849d62e-d9a4-4285-95fc-0869cbf20b4c {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:12:39.740720 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:12:39.740898 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:12:39.838475 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e8e275d7-63af-4696-94bb-dbab7c5fd832 req-3be65c85-5e81-46e1-b7ab-a3f3ef72de3d service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Received event network-changed-04633d7b-a11f-4e7a-bd98-683a082e8a73 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:12:39.838998 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e8e275d7-63af-4696-94bb-dbab7c5fd832 req-3be65c85-5e81-46e1-b7ab-a3f3ef72de3d service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Refreshing instance network info cache due to event network-changed-04633d7b-a11f-4e7a-bd98-683a082e8a73. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:12:39.839339 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e8e275d7-63af-4696-94bb-dbab7c5fd832 req-3be65c85-5e81-46e1-b7ab-a3f3ef72de3d service nova] Acquiring lock "refresh_cache-3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:12:39.839510 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e8e275d7-63af-4696-94bb-dbab7c5fd832 req-3be65c85-5e81-46e1-b7ab-a3f3ef72de3d service nova] Acquired lock "refresh_cache-3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:12:39.839673 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-e8e275d7-63af-4696-94bb-dbab7c5fd832 req-3be65c85-5e81-46e1-b7ab-a3f3ef72de3d service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Refreshing network info cache for port 04633d7b-a11f-4e7a-bd98-683a082e8a73 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:12:39.875416 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:12:39.876711 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:12:39.876711 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:39.876860 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:39.935483 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:39.967520 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7ffa50296592417a99dd0566355e09f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80b528594ac4ee5b3b56bf7c94c7ffa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:12:40.245777 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:12:40.342552 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-e8e275d7-63af-4696-94bb-dbab7c5fd832 req-3be65c85-5e81-46e1-b7ab-a3f3ef72de3d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:40.380933 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:12:40.483183 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Successfully created port: e9818d03-4fce-4fba-a66e-524f18ac36fd {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:12:40.572576 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Acquiring lock "38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:40.573749 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Lock "38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:40.575218 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Attaching volume 17f979c3-9cf4-4d6f-81dd-c382d3df3497 to /dev/vdb
May 28 10:12:40.585733 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.516s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:40.647180 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:12:40.663256 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:12:40.694742 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:12:40.748968 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:12:40.749563 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:12:40.754310 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.387s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:40.759432 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:12:40.760562 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe86:5388', 'fe80::5c44:a2ff:fe78:6c5f', 'fe80::fc16:3eff:fe8c:4068', 'fe80::9098:76ff:fe86:646f', 'fe80::fc16:3eff:fef0:49ef', 'fe80::e03f:79ff:fe2f:2d97'] 
May 28 10:12:40.760715 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:12:40.762116 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:12:40.762229 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:12:40.762446 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Updating existing volume attachment record: 5c94f845-2255-4e69-aa03-296df1254bef {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:12:40.791572 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:12:40.791802 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:12:40.795616 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] No VIF found with MAC fa:16:3e:28:03:66, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:12:40.797105 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Using config drive
May 28 10:12:40.821711 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Deleted allocations for instance 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9
May 28 10:12:40.867604 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-e8e275d7-63af-4696-94bb-dbab7c5fd832 req-3be65c85-5e81-46e1-b7ab-a3f3ef72de3d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:40.882699 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:12:41.032485 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-e8e275d7-63af-4696-94bb-dbab7c5fd832 req-3be65c85-5e81-46e1-b7ab-a3f3ef72de3d service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Updated VIF entry in instance network info cache for port 04633d7b-a11f-4e7a-bd98-683a082e8a73. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:12:41.032850 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-e8e275d7-63af-4696-94bb-dbab7c5fd832 req-3be65c85-5e81-46e1-b7ab-a3f3ef72de3d service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Updating instance_info_cache with network_info: [{"id": "04633d7b-a11f-4e7a-bd98-683a082e8a73", "address": "fa:16:3e:f0:49:ef", "network": {"id": "db344666-4990-47d9-a3a2-9bebce64e660", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1492927350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44f9e47b0cb84ec9a96e9ee54854c98d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04633d7b-a1", "ovs_interfaceid": "04633d7b-a11f-4e7a-bd98-683a082e8a73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:12:41.141040 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Successfully updated port: e9818d03-4fce-4fba-a66e-524f18ac36fd {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:12:41.254034 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ccd7f372-088d-40b9-a56c-3d60f8af6391 req-d4b23d09-eed7-43f8-bd3b-35b5eeba8ac8 service nova] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Received event network-changed-e9818d03-4fce-4fba-a66e-524f18ac36fd {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:12:41.254522 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ccd7f372-088d-40b9-a56c-3d60f8af6391 req-d4b23d09-eed7-43f8-bd3b-35b5eeba8ac8 service nova] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Refreshing instance network info cache due to event network-changed-e9818d03-4fce-4fba-a66e-524f18ac36fd. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:12:41.254745 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ccd7f372-088d-40b9-a56c-3d60f8af6391 req-d4b23d09-eed7-43f8-bd3b-35b5eeba8ac8 service nova] Acquiring lock "refresh_cache-93a38b6d-e199-4653-a617-290247c8e430" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:12:41.254871 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ccd7f372-088d-40b9-a56c-3d60f8af6391 req-d4b23d09-eed7-43f8-bd3b-35b5eeba8ac8 service nova] Acquired lock "refresh_cache-93a38b6d-e199-4653-a617-290247c8e430" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:12:41.255013 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-ccd7f372-088d-40b9-a56c-3d60f8af6391 req-d4b23d09-eed7-43f8-bd3b-35b5eeba8ac8 service nova] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Refreshing network info cache for port e9818d03-4fce-4fba-a66e-524f18ac36fd {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:12:41.306342 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:41.334936 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:12:41.335328 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497', 'iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '17f979c3-9cf4-4d6f-81dd-c382d3df3497', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:12:41.335513 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:12:41.338965 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:12:41.338965 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497', 'iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '17f979c3-9cf4-4d6f-81dd-c382d3df3497', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:12:41.352115 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:12:41.352115 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:12:41.352377 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:12:41.352878 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:12:41.353832 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:12:41.353832 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:12:41.365712 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:12:41.365712 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:41.377340 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:12:41.377340 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:41.387795 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497] added
May 28 10:12:41.387795 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:12:41.387795 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:12:41.387795 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:12:41.387795 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:12:41.387795 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:12:41.387795 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:41.387795 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:12:41.387795 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.035(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:12:41.387795 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:12:41.390014 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497] added
May 28 10:12:41.390014 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:12:41.390014 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:12:41.390014 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:12:41.390014 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:12:41.390014 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:12:41.390014 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:41.390267 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:12:41.391567 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.038(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:12:41.391995 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Booting with volume a22ccd2b-8f27-4899-85c7-6ea7af4453a2 at /dev/vda
May 28 10:12:41.396633 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:12:41.433647 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:12:41.446765 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:12:41.465193 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-20a7f722-7f29-473f-a5cd-c7d3fad9a1df req-5bd4bb35-8796-4a48-bf7c-f9124b4b4ee6 service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Received event network-changed-04633d7b-a11f-4e7a-bd98-683a082e8a73 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:12:41.469014 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Creating config drive at /opt/stack/data/nova/instances/405de22b-28c5-4415-ad12-e7e8eae4d591/disk.config
May 28 10:12:41.469575 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-20a7f722-7f29-473f-a5cd-c7d3fad9a1df req-5bd4bb35-8796-4a48-bf7c-f9124b4b4ee6 service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Refreshing instance network info cache due to event network-changed-04633d7b-a11f-4e7a-bd98-683a082e8a73. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:12:41.469837 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-20a7f722-7f29-473f-a5cd-c7d3fad9a1df req-5bd4bb35-8796-4a48-bf7c-f9124b4b4ee6 service nova] Acquiring lock "refresh_cache-3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:12:41.470900 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:12:41.489573 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/405de22b-28c5-4415-ad12-e7e8eae4d591/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppztaxs2z {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:12:41.522028 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:12:41.522496 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:12:41.534428 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:12:41.535592 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe86:5388', 'fe80::5c44:a2ff:fe78:6c5f', 'fe80::fc16:3eff:fe8c:4068', 'fe80::9098:76ff:fe86:646f', 'fe80::fc16:3eff:fef0:49ef', 'fe80::e03f:79ff:fe2f:2d97'] 
May 28 10:12:41.535733 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:12:41.535853 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:12:41.536117 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] <== get_connector_properties: return (102ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:12:41.536445 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Updating existing volume attachment record: 753772e6-5780-4654-bf0c-52ffaca522e3 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:12:41.540932 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e8e275d7-63af-4696-94bb-dbab7c5fd832 req-3be65c85-5e81-46e1-b7ab-a3f3ef72de3d service nova] Releasing lock "refresh_cache-3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:12:41.541605 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-20a7f722-7f29-473f-a5cd-c7d3fad9a1df req-5bd4bb35-8796-4a48-bf7c-f9124b4b4ee6 service nova] Acquired lock "refresh_cache-3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:12:41.541810 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-20a7f722-7f29-473f-a5cd-c7d3fad9a1df req-5bd4bb35-8796-4a48-bf7c-f9124b4b4ee6 service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Refreshing network info cache for port 04633d7b-a11f-4e7a-bd98-683a082e8a73 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:12:41.560633 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/405de22b-28c5-4415-ad12-e7e8eae4d591/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppztaxs2z" returned: 0 in 0.072s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:12:41.624838 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0014453059998231765 future=<Future at 0x73c1fc157410 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:12:41.625362 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Emitting event <LifecycleEvent: 1779963146.6232998, c57fd7fa-e4b8-4620-89ce-34be56feb58e => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:12:41.625581 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:12:41.625796 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] VM Stopped (Lifecycle Event)
May 28 10:12:41.626973 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=7.951706793000085 future=<Future at 0x73c1fc1680b0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:12:41.627156 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=7.951521679000052 future=<Future at 0x73c1fc1680b0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:12:41.650697 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Acquiring lock "refresh_cache-93a38b6d-e199-4653-a617-290247c8e430" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:12:41.664623 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Acquiring lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:41.664755 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:41.664931 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Attaching volume f350dea6-be89-4379-b391-df96bd9c3fc2 to /dev/vdb
May 28 10:12:41.715607 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:12:41.727809 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:12:41.748799 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:12:41.768689 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-ccd7f372-088d-40b9-a56c-3d60f8af6391 req-d4b23d09-eed7-43f8-bd3b-35b5eeba8ac8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:41.804121 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:12:41.804378 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:12:41.819068 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:12:41.820441 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe86:5388', 'fe80::5c44:a2ff:fe78:6c5f', 'fe80::fc16:3eff:fe8c:4068', 'fe80::9098:76ff:fe86:646f', 'fe80::fc16:3eff:fef0:49ef', 'fe80::e03f:79ff:fe2f:2d97'] 
May 28 10:12:41.820782 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:12:41.820782 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:12:41.821128 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:12:41.821477 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Updating existing volume attachment record: 4113070a-b6db-413b-a9c0-37ced914b035 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:12:41.835613 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-9cacaa35-1084-4fd8-92c8-69899db46fa2 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.117s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:41.861011 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-ccd7f372-088d-40b9-a56c-3d60f8af6391 req-d4b23d09-eed7-43f8-bd3b-35b5eeba8ac8 service nova] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:12:42.044865 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-20a7f722-7f29-473f-a5cd-c7d3fad9a1df req-5bd4bb35-8796-4a48-bf7c-f9124b4b4ee6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:42.061053 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:42.066648 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-ccd7f372-088d-40b9-a56c-3d60f8af6391 req-d4b23d09-eed7-43f8-bd3b-35b5eeba8ac8 service nova] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:12:42.100122 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:42.131017 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: c57fd7fa-e4b8-4620-89ce-34be56feb58e] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:12:42.178023 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:42.343230 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:42.388943 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d85cae03-5653-44fe-ae69-c312bc884dcb req-db3cb87c-f494-48ec-adba-0327f48dc9c3 service nova] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Received event network-vif-plugged-dde08f5f-faec-48b5-87a9-f4d4069875f0 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:12:42.391246 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:12:42.393126 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d85cae03-5653-44fe-ae69-c312bc884dcb req-db3cb87c-f494-48ec-adba-0327f48dc9c3 service nova] Acquiring lock "405de22b-28c5-4415-ad12-e7e8eae4d591-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:42.393522 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d85cae03-5653-44fe-ae69-c312bc884dcb req-db3cb87c-f494-48ec-adba-0327f48dc9c3 service nova] Lock "405de22b-28c5-4415-ad12-e7e8eae4d591-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:42.394115 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d85cae03-5653-44fe-ae69-c312bc884dcb req-db3cb87c-f494-48ec-adba-0327f48dc9c3 service nova] Lock "405de22b-28c5-4415-ad12-e7e8eae4d591-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:42.394299 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d85cae03-5653-44fe-ae69-c312bc884dcb req-db3cb87c-f494-48ec-adba-0327f48dc9c3 service nova] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Processing event network-vif-plugged-dde08f5f-faec-48b5-87a9-f4d4069875f0 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:12:42.397334 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:12:42.408108 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:12:42.408108 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:12:42.419029 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:12:42.419029 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:42.422092 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:12:42.423310 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2', 'iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f350dea6-be89-4379-b391-df96bd9c3fc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:12:42.423310 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:12:42.428602 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:42.436684 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:42.445289 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:42.445289 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:42.445289 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:12:42.445289 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:42.445289 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:42.445289 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:12:42.453125 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:42.453125 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:42.453125 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:12:42.453359 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:42.453359 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:42.453359 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:12:42.479932 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497, portal: 192.168.40.100,3260]
May 28 10:12:42.479932 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497, portal: 192.168.40.100,3260] successful.
May 28 10:12:42.479932 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:42.491464 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:42.496613 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:42.501870 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497, portal: 192.168.50.100,3260]
May 28 10:12:42.501870 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497, portal: 192.168.50.100,3260] successful.
May 28 10:12:42.501870 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:42.511175 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:42.511175 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:42.511175 np0000001613 nova-compute[98321]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:42.511175 np0000001613 nova-compute[98321]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:42.511175 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:12:42.511330 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:42.511330 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:42.511330 np0000001613 nova-compute[98321]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:42.511330 np0000001613 nova-compute[98321]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:42.511330 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:12:42.511649 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.160s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:12:42.511761 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:12:42.512413 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] HCTL ('7', '-', '-', 0) found on session 172 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:12:42.512518 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:12:42.521316 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:42.537573 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:42.537573 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Searching for a device in session 172 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:12:42.537573 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '17f979c3-9cf4-4d6f-81dd-c382d3df3497', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:12:42.547400 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:42.547400 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:42.547400 np0000001613 nova-compute[98321]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:42.547400 np0000001613 nova-compute[98321]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:42.547400 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:12:42.547400 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:42.547400 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:42.547400 np0000001613 nova-compute[98321]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:42.547400 np0000001613 nova-compute[98321]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:42.547400 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:12:42.547878 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.194s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:12:42.548050 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:12:42.550607 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] HCTL ('8', '-', '-', 0) found on session 173 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:12:42.550607 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:12:42.574272 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ccd7f372-088d-40b9-a56c-3d60f8af6391 req-d4b23d09-eed7-43f8-bd3b-35b5eeba8ac8 service nova] Releasing lock "refresh_cache-93a38b6d-e199-4653-a617-290247c8e430" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:12:42.574272 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Acquired lock "refresh_cache-93a38b6d-e199-4653-a617-290247c8e430" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:12:42.574272 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:12:42.574272 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Searching for a device in session 173 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:12:42.574469 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '17f979c3-9cf4-4d6f-81dd-c382d3df3497', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:12:42.629332 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-20a7f722-7f29-473f-a5cd-c7d3fad9a1df req-5bd4bb35-8796-4a48-bf7c-f9124b4b4ee6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:42.791172 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-20a7f722-7f29-473f-a5cd-c7d3fad9a1df req-5bd4bb35-8796-4a48-bf7c-f9124b4b4ee6 service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Updated VIF entry in instance network info cache for port 04633d7b-a11f-4e7a-bd98-683a082e8a73. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:12:42.791495 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-20a7f722-7f29-473f-a5cd-c7d3fad9a1df req-5bd4bb35-8796-4a48-bf7c-f9124b4b4ee6 service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Updating instance_info_cache with network_info: [{"id": "04633d7b-a11f-4e7a-bd98-683a082e8a73", "address": "fa:16:3e:f0:49:ef", "network": {"id": "db344666-4990-47d9-a3a2-9bebce64e660", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1492927350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44f9e47b0cb84ec9a96e9ee54854c98d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04633d7b-a1", "ovs_interfaceid": "04633d7b-a11f-4e7a-bd98-683a082e8a73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:12:42.983199 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963162.9825032, 405de22b-28c5-4415-ad12-e7e8eae4d591 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:12:42.983437 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] VM Started (Lifecycle Event)
May 28 10:12:42.986280 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:12:42.988891 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:12:42.992463 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Instance spawned successfully.
May 28 10:12:42.993300 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:12:43.134447 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:12:43.284310 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:43.293628 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-20a7f722-7f29-473f-a5cd-c7d3fad9a1df req-5bd4bb35-8796-4a48-bf7c-f9124b4b4ee6 service nova] Releasing lock "refresh_cache-3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:12:43.354199 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:12:43.428878 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Updating instance_info_cache with network_info: [{"id": "e9818d03-4fce-4fba-a66e-524f18ac36fd", "address": "fa:16:3e:49:8b:e9", "network": {"id": "83f5548a-aebf-46e0-a4d2-07f06d3967d4", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1141449765-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d80b528594ac4ee5b3b56bf7c94c7ffa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9818d03-4f", "ovs_interfaceid": "e9818d03-4fce-4fba-a66e-524f18ac36fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:12:43.492313 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:12:43.496370 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:12:43.504489 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:12:43.504665 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:12:43.504988 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:12:43.505384 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:12:43.505743 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:12:43.506005 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:12:43.675080 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:12:43.676050 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:12:43.676206 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Creating image(s)
May 28 10:12:43.676478 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Did not create local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 10:12:43.676601 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Ensure instance console log exists: /opt/stack/data/nova/instances/93a38b6d-e199-4653-a617-290247c8e430/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:12:43.676785 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:43.676952 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:43.677158 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:43.932130 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Releasing lock "refresh_cache-93a38b6d-e199-4653-a617-290247c8e430" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:12:43.932130 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Instance network_info: |[{"id": "e9818d03-4fce-4fba-a66e-524f18ac36fd", "address": "fa:16:3e:49:8b:e9", "network": {"id": "83f5548a-aebf-46e0-a4d2-07f06d3967d4", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1141449765-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d80b528594ac4ee5b3b56bf7c94c7ffa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9818d03-4f", "ovs_interfaceid": "e9818d03-4fce-4fba-a66e-524f18ac36fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:12:43.932834 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Start _get_guest_xml network_info=[{"id": "e9818d03-4fce-4fba-a66e-524f18ac36fd", "address": "fa:16:3e:49:8b:e9", "network": {"id": "83f5548a-aebf-46e0-a4d2-07f06d3967d4", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1141449765-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d80b528594ac4ee5b3b56bf7c94c7ffa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9818d03-4f", "ovs_interfaceid": "e9818d03-4fce-4fba-a66e-524f18ac36fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a22ccd2b-8f27-4899-85c7-6ea7af4453a2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '93a38b6d-e199-4653-a617-290247c8e430', 'attached_at': '', 'detached_at': '', 'volume_id': 'a22ccd2b-8f27-4899-85c7-6ea7af4453a2', 'serial': 'a22ccd2b-8f27-4899-85c7-6ea7af4453a2'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '753772e6-5780-4654-bf0c-52ffaca522e3', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:12:43.935451 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:12:43.936465 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-288419323', uuid='93a38b6d-e199-4653-a617-290247c8e430'), owner=OwnerMeta(userid='7ffa50296592417a99dd0566355e09f9', username='tempest-TestVolumeBootPatternV346-204163382-project-member', projectid='d80b528594ac4ee5b3b56bf7c94c7ffa', projectname='tempest-TestVolumeBootPatternV346-204163382'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e9818d03-4fce-4fba-a66e-524f18ac36fd", "address": "fa:16:3e:49:8b:e9", "network": {"id": "83f5548a-aebf-46e0-a4d2-07f06d3967d4", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1141449765-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d80b528594ac4ee5b3b56bf7c94c7ffa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9818d03-4f", "ovs_interfaceid": "e9818d03-4fce-4fba-a66e-524f18ac36fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779963163.9361298) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:12:43.937614 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:12:43.937998 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:12:43.938906 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:12:43.939053 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:12:43.940182 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:12:43.940450 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:12:43.940566 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:12:43.940658 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:12:43.940806 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:12:43.940891 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:12:43.940969 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:12:43.941109 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:12:43.941214 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:12:43.941328 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:12:43.941418 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:12:43.941538 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:12:43.953255 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:12:43.953486 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a22ccd2b-8f27-4899-85c7-6ea7af4453a2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:12:43.953604 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:12:44.008426 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:12:44.008642 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963164.0084996, 405de22b-28c5-4415-ad12-e7e8eae4d591 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:12:44.008734 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] VM Paused (Lifecycle Event)
May 28 10:12:44.010359 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Took 7.29 seconds to spawn the instance on the hypervisor.
May 28 10:12:44.010510 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:12:44.251119 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:44.371700 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Found WWN 3300000001d879997 for multipath device dm-0 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:12:44.371700 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:12:44.371798 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '3300000001d879997', 'path': '/dev/dm-0', 'multipath_id': '3300000001d879997'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:12:44.371932 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001d879997', 'path': '/dev/dm-0', 'multipath_id': '3300000001d879997'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:12:44.372373 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.950s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:12:44.372644 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2', 'iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f350dea6-be89-4379-b391-df96bd9c3fc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:12:44.374741 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Lazy-loading 'flavor' on Instance uuid 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:12:44.385446 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:12:44.386085 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:12:44.386435 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:12:44.386630 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:12:44.387004 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:12:44.387242 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:12:44.399014 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:12:44.399014 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:44.404568 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:12:44.404568 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:44.410327 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2] added
May 28 10:12:44.410327 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:12:44.410327 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:12:44.410327 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:12:44.410327 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:12:44.410327 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:12:44.410327 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:44.410571 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:12:44.410660 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.024(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:12:44.410829 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:12:44.415591 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2] added
May 28 10:12:44.415591 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:12:44.415591 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:12:44.415591 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:12:44.415591 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:12:44.415591 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:12:44.415591 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:44.415804 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:12:44.415959 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0287(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:12:44.416178 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:12:44.452918 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a9761a3d-bbec-475a-a8e1-218d1a04c402 req-289ab985-9ee5-4582-86ac-419029f4349a service nova] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Received event network-vif-plugged-dde08f5f-faec-48b5-87a9-f4d4069875f0 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:12:44.453621 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a9761a3d-bbec-475a-a8e1-218d1a04c402 req-289ab985-9ee5-4582-86ac-419029f4349a service nova] Acquiring lock "405de22b-28c5-4415-ad12-e7e8eae4d591-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:44.453674 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a9761a3d-bbec-475a-a8e1-218d1a04c402 req-289ab985-9ee5-4582-86ac-419029f4349a service nova] Lock "405de22b-28c5-4415-ad12-e7e8eae4d591-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:44.453818 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a9761a3d-bbec-475a-a8e1-218d1a04c402 req-289ab985-9ee5-4582-86ac-419029f4349a service nova] Lock "405de22b-28c5-4415-ad12-e7e8eae4d591-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:44.453955 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a9761a3d-bbec-475a-a8e1-218d1a04c402 req-289ab985-9ee5-4582-86ac-419029f4349a service nova] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] No waiting events found dispatching network-vif-plugged-dde08f5f-faec-48b5-87a9-f4d4069875f0 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:12:44.454084 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-a9761a3d-bbec-475a-a8e1-218d1a04c402 req-289ab985-9ee5-4582-86ac-419029f4349a service nova] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Received unexpected event network-vif-plugged-dde08f5f-faec-48b5-87a9-f4d4069875f0 for instance with vm_state active and task_state None.
May 28 10:12:44.512217 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:12:44.514536 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963164.514291, 405de22b-28c5-4415-ad12-e7e8eae4d591 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:12:44.514721 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] VM Resumed (Lifecycle Event)
May 28 10:12:44.522830 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Took 12.82 seconds to build instance.
May 28 10:12:44.878204 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Attempting to attach volume 17f979c3-9cf4-4d6f-81dd-c382d3df3497 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 10:12:44.882824 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] attach device xml: <disk type="block" device="disk">
May 28 10:12:44.882824 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:12:44.882824 np0000001613 nova-compute[98321]:   <alias name="ua-17f979c3-9cf4-4d6f-81dd-c382d3df3497"/>
May 28 10:12:44.882824 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-0"/>
May 28 10:12:44.882824 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:12:44.882824 np0000001613 nova-compute[98321]:   <serial>17f979c3-9cf4-4d6f-81dd-c382d3df3497</serial>
May 28 10:12:44.882824 np0000001613 nova-compute[98321]: </disk>
May 28 10:12:44.882824 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 10:12:44.937552 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:45.016702 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:12:45.021509 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:12:45.026370 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "405de22b-28c5-4415-ad12-e7e8eae4d591" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.331s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:45.411298 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:12:45.416616 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:12:45.423446 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:12:45.423446 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:12:45.427054 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:12:45.427054 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:45.438008 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:45.443322 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:45.455458 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5983383b-2ae5-434a-8664-cdb25d3a7efd req-5ed6cb8b-a4ae-4192-8131-e7d62e203fcc service nova] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Received event network-changed-dde08f5f-faec-48b5-87a9-f4d4069875f0 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:12:45.456180 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5983383b-2ae5-434a-8664-cdb25d3a7efd req-5ed6cb8b-a4ae-4192-8131-e7d62e203fcc service nova] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Refreshing instance network info cache due to event network-changed-dde08f5f-faec-48b5-87a9-f4d4069875f0. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:12:45.456484 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5983383b-2ae5-434a-8664-cdb25d3a7efd req-5ed6cb8b-a4ae-4192-8131-e7d62e203fcc service nova] Acquiring lock "refresh_cache-405de22b-28c5-4415-ad12-e7e8eae4d591" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:12:45.457023 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:45.457023 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:45.457023 np0000001613 nova-compute[98321]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:45.457023 np0000001613 nova-compute[98321]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:45.457023 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:12:45.457302 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5983383b-2ae5-434a-8664-cdb25d3a7efd req-5ed6cb8b-a4ae-4192-8131-e7d62e203fcc service nova] Acquired lock "refresh_cache-405de22b-28c5-4415-ad12-e7e8eae4d591" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:12:45.457639 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:45.457639 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:45.457639 np0000001613 nova-compute[98321]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:45.457639 np0000001613 nova-compute[98321]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:45.457639 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:12:45.457830 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:45.457830 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:45.457830 np0000001613 nova-compute[98321]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:45.457830 np0000001613 nova-compute[98321]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:45.457830 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:12:45.459260 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-5983383b-2ae5-434a-8664-cdb25d3a7efd req-5ed6cb8b-a4ae-4192-8131-e7d62e203fcc service nova] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Refreshing network info cache for port dde08f5f-faec-48b5-87a9-f4d4069875f0 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:12:45.460478 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:45.460478 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:45.460478 np0000001613 nova-compute[98321]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:45.460478 np0000001613 nova-compute[98321]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:45.460478 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:12:45.498061 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2, portal: 192.168.40.100,3260]
May 28 10:12:45.498061 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2, portal: 192.168.40.100,3260] successful.
May 28 10:12:45.498061 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:45.505752 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2, portal: 192.168.50.100,3260]
May 28 10:12:45.505752 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2, portal: 192.168.50.100,3260] successful.
May 28 10:12:45.505752 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:45.511028 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:45.517934 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:45.527469 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:45.527469 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:45.527469 np0000001613 nova-compute[98321]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:45.527469 np0000001613 nova-compute[98321]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:45.527469 np0000001613 nova-compute[98321]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:45.527469 np0000001613 nova-compute[98321]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:45.527469 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:12:45.527898 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:45.527898 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:45.527898 np0000001613 nova-compute[98321]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:45.527898 np0000001613 nova-compute[98321]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:45.527898 np0000001613 nova-compute[98321]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:45.527898 np0000001613 nova-compute[98321]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:45.527898 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:12:45.527898 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.141s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:12:45.528323 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:12:45.528705 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] HCTL ('11', '-', '-', 0) found on session 174 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:12:45.528810 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:12:45.533425 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:45.533425 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:45.533425 np0000001613 nova-compute[98321]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:45.533425 np0000001613 nova-compute[98321]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:45.533425 np0000001613 nova-compute[98321]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:45.533425 np0000001613 nova-compute[98321]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:45.533425 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:12:45.533726 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:45.533726 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:45.533726 np0000001613 nova-compute[98321]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:45.533726 np0000001613 nova-compute[98321]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:45.533726 np0000001613 nova-compute[98321]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:45.533726 np0000001613 nova-compute[98321]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:45.533726 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:12:45.533979 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.147s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:12:45.534064 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:12:45.534785 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] HCTL ('12', '-', '-', 0) found on session 175 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:12:45.534933 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:12:45.547789 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Searching for a device in session 174 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:12:45.547789 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f350dea6-be89-4379-b391-df96bd9c3fc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:12:45.562022 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Searching for a device in session 175 and hctl ['12', '*', '*', 0] yield: None {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:12:45.962995 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-5983383b-2ae5-434a-8664-cdb25d3a7efd req-5ed6cb8b-a4ae-4192-8131-e7d62e203fcc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:46.307257 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-5983383b-2ae5-434a-8664-cdb25d3a7efd req-5ed6cb8b-a4ae-4192-8131-e7d62e203fcc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:46.453676 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-5983383b-2ae5-434a-8664-cdb25d3a7efd req-5ed6cb8b-a4ae-4192-8131-e7d62e203fcc service nova] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Updated VIF entry in instance network info cache for port dde08f5f-faec-48b5-87a9-f4d4069875f0. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:12:46.454242 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-5983383b-2ae5-434a-8664-cdb25d3a7efd req-5ed6cb8b-a4ae-4192-8131-e7d62e203fcc service nova] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Updating instance_info_cache with network_info: [{"id": "dde08f5f-faec-48b5-87a9-f4d4069875f0", "address": "fa:16:3e:28:03:66", "network": {"id": "8d701503-e690-42e6-8d82-0987ffcf4209", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1480012678-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a4bbdf692768465db607aa60a630e5e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde08f5f-fa", "ovs_interfaceid": "dde08f5f-faec-48b5-87a9-f4d4069875f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:12:46.549692 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:12:46.549817 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:12:46.549920 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:12:46.550032 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] No VIF found with MAC fa:16:3e:8c:40:68, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:12:46.564188 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Searching for a device in session 175 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:12:46.564188 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f350dea6-be89-4379-b391-df96bd9c3fc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:12:46.956460 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5983383b-2ae5-434a-8664-cdb25d3a7efd req-5ed6cb8b-a4ae-4192-8131-e7d62e203fcc service nova] Releasing lock "refresh_cache-405de22b-28c5-4415-ad12-e7e8eae4d591" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:12:47.169638 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:47.169809 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:47.402519 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Found WWN 330000000573d6d41 for multipath device dm-1 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:12:47.402813 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:12:47.403005 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] <== connect_volume: return (4980ms) {'type': 'block', 'scsi_wwn': '330000000573d6d41', 'path': '/dev/dm-1', 'multipath_id': '330000000573d6d41'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:12:47.403099 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000573d6d41', 'path': '/dev/dm-1', 'multipath_id': '330000000573d6d41'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:12:47.403918 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.450s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:12:47.403918 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a22ccd2b-8f27-4899-85c7-6ea7af4453a2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:12:47.406642 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lazy-loading 'flavor' on Instance uuid 8849d62e-d9a4-4285-95fc-0869cbf20b4c {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:12:47.414749 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:12:47.415198 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:12:47.415388 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:12:47.415872 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:12:47.416222 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:12:47.416381 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:12:47.427558 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:12:47.427558 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:47.434651 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:12:47.434651 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:47.441521 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2] added
May 28 10:12:47.441521 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:12:47.441521 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:12:47.441521 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:12:47.441521 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:12:47.441521 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:12:47.441521 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:47.441911 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:12:47.441911 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0264(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:12:47.442062 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:12:47.445935 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2] added
May 28 10:12:47.445935 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:12:47.445935 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:12:47.445935 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:12:47.445935 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:12:47.445935 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:12:47.445935 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:47.446153 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:12:47.446287 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0298(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:12:47.446442 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:12:47.671857 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:12:47.909046 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Attempting to attach volume f350dea6-be89-4379-b391-df96bd9c3fc2 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 10:12:47.910453 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] attach device xml: <disk type="block" device="disk">
May 28 10:12:47.910453 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:12:47.910453 np0000001613 nova-compute[98321]:   <alias name="ua-f350dea6-be89-4379-b391-df96bd9c3fc2"/>
May 28 10:12:47.910453 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-1"/>
May 28 10:12:47.910453 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:12:47.910453 np0000001613 nova-compute[98321]:   <serial>f350dea6-be89-4379-b391-df96bd9c3fc2</serial>
May 28 10:12:47.910453 np0000001613 nova-compute[98321]: </disk>
May 28 10:12:47.910453 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 10:12:48.098033 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-da7bec31-7a2c-4665-9aab-c0aac9b3a428 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Lock "38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.524s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:48.242413 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:48.243014 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:48.247454 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:12:48.247454 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Claim successful on node np0000001613
May 28 10:12:48.442588 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:12:48.446820 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:12:48.459189 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:12:48.459189 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:12:48.465579 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:12:48.465579 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:48.475945 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:48.485539 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:48.495558 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:48.495558 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:48.495558 np0000001613 nova-compute[98321]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:48.495558 np0000001613 nova-compute[98321]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:48.495558 np0000001613 nova-compute[98321]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:48.495558 np0000001613 nova-compute[98321]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:48.495558 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:12:48.495948 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:48.495948 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:48.495948 np0000001613 nova-compute[98321]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:48.495948 np0000001613 nova-compute[98321]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:48.495948 np0000001613 nova-compute[98321]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:48.495948 np0000001613 nova-compute[98321]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:48.495948 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:12:48.503803 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:48.503803 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:48.503803 np0000001613 nova-compute[98321]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:48.503803 np0000001613 nova-compute[98321]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:48.503803 np0000001613 nova-compute[98321]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:48.503803 np0000001613 nova-compute[98321]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:48.503803 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:12:48.504063 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:48.504063 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:48.504063 np0000001613 nova-compute[98321]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:48.504063 np0000001613 nova-compute[98321]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:48.504063 np0000001613 nova-compute[98321]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:48.504063 np0000001613 nova-compute[98321]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:48.504063 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:12:48.546591 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2, portal: 192.168.40.100,3260]
May 28 10:12:48.546591 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2, portal: 192.168.40.100,3260] successful.
May 28 10:12:48.546591 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:48.554250 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2, portal: 192.168.50.100,3260]
May 28 10:12:48.554250 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2, portal: 192.168.50.100,3260] successful.
May 28 10:12:48.554250 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:48.561793 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:48.567043 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:48.577770 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:48.577770 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:48.577770 np0000001613 nova-compute[98321]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:48.577770 np0000001613 nova-compute[98321]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:48.577770 np0000001613 nova-compute[98321]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:48.577770 np0000001613 nova-compute[98321]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:48.577770 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:12:48.577770 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:12:48.577770 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:12:48.578157 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:48.578157 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:48.578157 np0000001613 nova-compute[98321]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:48.578157 np0000001613 nova-compute[98321]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:48.578157 np0000001613 nova-compute[98321]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:48.578157 np0000001613 nova-compute[98321]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:48.578157 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:12:48.578157 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:12:48.578157 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:12:48.578157 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:12:48.578527 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:12:48.579317 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] HCTL ('13', '-', '-', 0) found on session 176 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:12:48.579431 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:12:48.584033 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:48.584033 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:48.584033 np0000001613 nova-compute[98321]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:48.584033 np0000001613 nova-compute[98321]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:48.584033 np0000001613 nova-compute[98321]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:48.584033 np0000001613 nova-compute[98321]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:48.584033 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:12:48.584033 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:12:48.584033 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:12:48.584369 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:48.584369 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:48.584369 np0000001613 nova-compute[98321]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:48.584369 np0000001613 nova-compute[98321]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:48.584369 np0000001613 nova-compute[98321]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:48.584369 np0000001613 nova-compute[98321]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:48.584369 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:12:48.584369 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:12:48.584369 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:12:48.584823 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.169s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:12:48.584977 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:12:48.585754 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] HCTL ('14', '-', '-', 0) found on session 177 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:12:48.585857 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:12:48.598385 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Searching for a device in session 176 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:12:48.598619 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a22ccd2b-8f27-4899-85c7-6ea7af4453a2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:12:48.608774 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Searching for a device in session 177 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:12:48.608774 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a22ccd2b-8f27-4899-85c7-6ea7af4453a2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:12:48.864602 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Acquiring lock "38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:48.864913 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Lock "38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:49.252820 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:49.368391 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Detaching volume 17f979c3-9cf4-4d6f-81dd-c382d3df3497
May 28 10:12:49.408575 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Attempting to driver detach volume 17f979c3-9cf4-4d6f-81dd-c382d3df3497 from mountpoint /dev/vdb
May 28 10:12:49.412693 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Found disk vdb by alias ua-17f979c3-9cf4-4d6f-81dd-c382d3df3497 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:12:49.413838 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Found disk vdb by alias ua-17f979c3-9cf4-4d6f-81dd-c382d3df3497 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:12:49.413990 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Attempting to detach device vdb from instance 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 10:12:49.414266 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:12:49.414266 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:12:49.414266 np0000001613 nova-compute[98321]:   <alias name="ua-17f979c3-9cf4-4d6f-81dd-c382d3df3497"/>
May 28 10:12:49.414266 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-0"/>
May 28 10:12:49.414266 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:12:49.414266 np0000001613 nova-compute[98321]:   <serial>17f979c3-9cf4-4d6f-81dd-c382d3df3497</serial>
May 28 10:12:49.414266 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:12:49.414266 np0000001613 nova-compute[98321]: </disk>
May 28 10:12:49.414266 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:12:49.417325 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:12:49.421770 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Successfully detached device vdb from instance 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f from the persistent domain config.
May 28 10:12:49.421910 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] (1/8): Attempting to detach device vdb with device alias ua-17f979c3-9cf4-4d6f-81dd-c382d3df3497 from instance 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 10:12:49.422145 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:12:49.422145 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:12:49.422145 np0000001613 nova-compute[98321]:   <alias name="ua-17f979c3-9cf4-4d6f-81dd-c382d3df3497"/>
May 28 10:12:49.422145 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-0"/>
May 28 10:12:49.422145 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:12:49.422145 np0000001613 nova-compute[98321]:   <serial>17f979c3-9cf4-4d6f-81dd-c382d3df3497</serial>
May 28 10:12:49.422145 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:12:49.422145 np0000001613 nova-compute[98321]: </disk>
May 28 10:12:49.422145 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:12:49.551731 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:12:49.551864 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:12:49.552018 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:12:49.552151 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] No VIF found with MAC fa:16:3e:86:53:88, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:12:49.579206 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.00044276400012677186 future=<Future at 0x73c1fc1680b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:12:49.579700 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:12:49.580198 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Emitting event <LifecycleEvent: 1779963154.5786002, 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:12:49.584575 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] VM Stopped (Lifecycle Event)
May 28 10:12:49.658955 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:12:49.659300 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:12:49.938868 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:49.959870 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779963169.959573, 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f => ua-17f979c3-9cf4-4d6f-81dd-c382d3df3497> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 10:12:49.960277 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-17f979c3-9cf4-4d6f-81dd-c382d3df3497 for instance 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 10:12:49.962592 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Successfully detached device vdb from instance 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f from the live domain config.
May 28 10:12:49.963790 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:12:49.964055 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497', 'iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '17f979c3-9cf4-4d6f-81dd-c382d3df3497', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:12:49.965332 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:12:50.088386 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-9e3a358a-f280-44f7-8ec3-7e7536df1034 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 5c37fd19-ce16-43a1-9b2a-75e2a4b0cab9] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:12:50.162384 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:12:50.432886 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Found WWN 330000000be9ab1c7 for multipath device dm-2 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:12:50.433208 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:12:50.433395 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] <== connect_volume: return (6479ms) {'type': 'block', 'scsi_wwn': '330000000be9ab1c7', 'path': '/dev/dm-2', 'multipath_id': '330000000be9ab1c7'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:12:50.433534 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000be9ab1c7', 'path': '/dev/dm-2', 'multipath_id': '330000000be9ab1c7'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:12:50.433968 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.470s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:12:50.434405 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497', 'iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '17f979c3-9cf4-4d6f-81dd-c382d3df3497', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:12:50.434592 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:12:50.470357 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:50.470357 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:50.470357 np0000001613 nova-compute[98321]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:50.470357 np0000001613 nova-compute[98321]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:50.470357 np0000001613 nova-compute[98321]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:50.470357 np0000001613 nova-compute[98321]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:50.470357 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:12:50.470357 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:12:50.470357 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:12:50.470613 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:50.470613 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:50.470613 np0000001613 nova-compute[98321]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:50.470613 np0000001613 nova-compute[98321]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497 (non-flash)
May 28 10:12:50.470613 np0000001613 nova-compute[98321]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:50.470613 np0000001613 nova-compute[98321]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:50.470613 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:12:50.470613 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:12:50.470613 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:12:50.470852 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a', '170'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a', '171'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497', '172'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497', '173'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2', '174'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2', '175'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', '176'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', '177')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:12:50.470852 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497', '172')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:12:50.472106 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497', '173')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:12:50.473012 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc1487c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497'): ({'sdc'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:12:50.473264 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Removing multipathed devices sdb, sdc {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:12:50.473482 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Flush multipath device 3300000001d879997 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:12:50.502855 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:12:50.548785 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:12:50.590968 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:12:50.591127 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:12:50.592127 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:12:50.605278 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:12:50.606776 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:12:50.620538 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:50.656451 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 172, target: iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497, portal: 192.168.40.100,3260]
May 28 10:12:50.656451 np0000001613 nova-compute[98321]: Logout of [sid: 172, target: iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497, portal: 192.168.40.100,3260] successful.
May 28 10:12:50.656451 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:50.669042 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.426s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:50.669398 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:12:50.674125 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:50.686088 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:50.717000 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 173, target: iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497, portal: 192.168.50.100,3260]
May 28 10:12:50.717000 np0000001613 nova-compute[98321]: Logout of [sid: 173, target: iqn.2023-03.storpool.com:os--volume-17f979c3-9cf4-4d6f-81dd-c382d3df3497, portal: 192.168.50.100,3260] successful.
May 28 10:12:50.717000 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:50.735987 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:50.736222 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:12:50.736344 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] <== disconnect_volume: return (771ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:12:50.736474 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:12:50.938818 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:12:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-288419323',display_name='tempest-TestVolumeBootPatternV346-server-288419323',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpatternv346-server-288419323',id=69,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3cEaRHItP11PmI2SEJKC/OwfP7HVOzMTvMY4PVBNkeeAtDxTqgCv/kW8CrWC9tHTkoNin6B2ta1TiZI7ymjl1xZ3t9rfiDefeyUBvFiaVO02aMlQPC2u8XZcNAikqsbQ==',key_name='tempest-keypair-474001042',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d80b528594ac4ee5b3b56bf7c94c7ffa',ramdisk_id='',reservation_id='r-vpifr2gp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-204163382',owner_user_name='tempest-TestVolumeBootPatternV346-204163382-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:12:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ffa50296592417a99dd0566355e09f9',uuid=93a38b6d-e199-4653-a617-290247c8e430,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9818d03-4fce-4fba-a66e-524f18ac36fd", "address": "fa:16:3e:49:8b:e9", "network": {"id": "83f5548a-aebf-46e0-a4d2-07f06d3967d4", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1141449765-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d80b528594ac4ee5b3b56bf7c94c7ffa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9818d03-4f", "ovs_interfaceid": "e9818d03-4fce-4fba-a66e-524f18ac36fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:12:50.939038 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Converting VIF {"id": "e9818d03-4fce-4fba-a66e-524f18ac36fd", "address": "fa:16:3e:49:8b:e9", "network": {"id": "83f5548a-aebf-46e0-a4d2-07f06d3967d4", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1141449765-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d80b528594ac4ee5b3b56bf7c94c7ffa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9818d03-4f", "ovs_interfaceid": "e9818d03-4fce-4fba-a66e-524f18ac36fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:12:50.939690 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:8b:e9,bridge_name='br-int',has_traffic_filtering=True,id=e9818d03-4fce-4fba-a66e-524f18ac36fd,network=Network(83f5548a-aebf-46e0-a4d2-07f06d3967d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9818d03-4f') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:12:50.940088 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lazy-loading 'pci_devices' on Instance uuid 93a38b6d-e199-4653-a617-290247c8e430 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:12:51.110478 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b084318c-6816-4ce5-8c7b-4f5d78d47f24 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.445s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:51.173692 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:12:51.174835 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:12:51.175125 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:51.175479 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:51.250407 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec58233d3b2848bbb2e0b00650398cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e9651268114327a9cc6c6c59bef01e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:12:51.292074 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Lazy-loading 'flavor' on Instance uuid 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:12:51.442846 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] End _get_guest_xml xml=<domain type="qemu">
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:   <uuid>93a38b6d-e199-4653-a617-290247c8e430</uuid>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:   <name>instance-00000045</name>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:       <nova:name>tempest-TestVolumeBootPatternV346-server-288419323</nova:name>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:12:43</nova:creationTime>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:       <nova:image uuid="">
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:         <nova:user uuid="7ffa50296592417a99dd0566355e09f9">tempest-TestVolumeBootPatternV346-204163382-project-member</nova:user>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:         <nova:project uuid="d80b528594ac4ee5b3b56bf7c94c7ffa">tempest-TestVolumeBootPatternV346-204163382</nova:project>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:       <nova:root type="volume" uuid=""/>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:         <nova:port uuid="e9818d03-4fce-4fba-a66e-524f18ac36fd">
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:     <system>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:       <entry name="serial">93a38b6d-e199-4653-a617-290247c8e430</entry>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:       <entry name="uuid">93a38b6d-e199-4653-a617-290247c8e430</entry>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:     </system>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:   <os>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:   </os>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:   <features>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:   </features>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:   <devices>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/93a38b6d-e199-4653-a617-290247c8e430/disk.config"/>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:     </disk>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:       <alias name="ua-a22ccd2b-8f27-4899-85c7-6ea7af4453a2"/>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-2"/>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:       <serial>a22ccd2b-8f27-4899-85c7-6ea7af4453a2</serial>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:     </disk>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:49:8b:e9"/>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:       <target dev="tape9818d03-4f"/>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:     </interface>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/93a38b6d-e199-4653-a617-290247c8e430/console.log" append="off"/>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:     </serial>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:     <video>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:     </video>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:     </rng>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:   </devices>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]: </domain>
May 28 10:12:51.442846 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:12:51.446066 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Preparing to wait for external event network-vif-plugged-e9818d03-4fce-4fba-a66e-524f18ac36fd {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:12:51.446066 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Acquiring lock "93a38b6d-e199-4653-a617-290247c8e430-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:51.446066 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "93a38b6d-e199-4653-a617-290247c8e430-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:51.446066 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "93a38b6d-e199-4653-a617-290247c8e430-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:51.446066 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:12:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-288419323',display_name='tempest-TestVolumeBootPatternV346-server-288419323',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpatternv346-server-288419323',id=69,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3cEaRHItP11PmI2SEJKC/OwfP7HVOzMTvMY4PVBNkeeAtDxTqgCv/kW8CrWC9tHTkoNin6B2ta1TiZI7ymjl1xZ3t9rfiDefeyUBvFiaVO02aMlQPC2u8XZcNAikqsbQ==',key_name='tempest-keypair-474001042',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d80b528594ac4ee5b3b56bf7c94c7ffa',ramdisk_id='',reservation_id='r-vpifr2gp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-204163382',owner_user_name='tempest-TestVolumeBootPatternV346-204163382-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:12:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ffa50296592417a99dd0566355e09f9',uuid=93a38b6d-e199-4653-a617-290247c8e430,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9818d03-4fce-4fba-a66e-524f18ac36fd", "address": "fa:16:3e:49:8b:e9", "network": {"id": "83f5548a-aebf-46e0-a4d2-07f06d3967d4", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1141449765-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d80b528594ac4ee5b3b56bf7c94c7ffa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9818d03-4f", "ovs_interfaceid": "e9818d03-4fce-4fba-a66e-524f18ac36fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:12:51.446066 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Converting VIF {"id": "e9818d03-4fce-4fba-a66e-524f18ac36fd", "address": "fa:16:3e:49:8b:e9", "network": {"id": "83f5548a-aebf-46e0-a4d2-07f06d3967d4", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1141449765-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d80b528594ac4ee5b3b56bf7c94c7ffa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9818d03-4f", "ovs_interfaceid": "e9818d03-4fce-4fba-a66e-524f18ac36fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:12:51.446066 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:8b:e9,bridge_name='br-int',has_traffic_filtering=True,id=e9818d03-4fce-4fba-a66e-524f18ac36fd,network=Network(83f5548a-aebf-46e0-a4d2-07f06d3967d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9818d03-4f') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:12:51.446066 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:8b:e9,bridge_name='br-int',has_traffic_filtering=True,id=e9818d03-4fce-4fba-a66e-524f18ac36fd,network=Network(83f5548a-aebf-46e0-a4d2-07f06d3967d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9818d03-4f') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:12:51.446066 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:51.446066 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:12:51.446704 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:12:51.447043 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:51.447299 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '507857be-2f5a-597e-9642-9babc0666bf7', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:12:51.449541 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:12:51.450484 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:51.452872 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:51.453088 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9818d03-4f, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:12:51.453560 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape9818d03-4f, col_values=(('qos', UUID('d1799ea0-6194-4892-9dbc-1f4c2738e3de')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:12:51.453788 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape9818d03-4f, col_values=(('external_ids', {'iface-id': 'e9818d03-4fce-4fba-a66e-524f18ac36fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:8b:e9', 'vm-uuid': '93a38b6d-e199-4653-a617-290247c8e430'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:12:51.457972 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:12:51.461773 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:51.462905 np0000001613 nova-compute[98321]: INFO os_vif [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:8b:e9,bridge_name='br-int',has_traffic_filtering=True,id=e9818d03-4fce-4fba-a66e-524f18ac36fd,network=Network(83f5548a-aebf-46e0-a4d2-07f06d3967d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9818d03-4f')
May 28 10:12:51.679227 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:12:51.821782 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Successfully created port: 8907c86c-3bc6-41a2-ace1-517b5a4a92d1 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:12:52.182076 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:12:52.302311 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d3c87787-8d62-4ace-9ddf-a7c24c3c255b tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Lock "38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.437s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:52.470266 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Successfully updated port: 8907c86c-3bc6-41a2-ace1-517b5a4a92d1 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:12:52.564379 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-21798bcf-0f46-4808-82c8-47a7ebd8c48e req-c0d13b49-9be8-4057-b79d-3420245cd7e1 service nova] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Received event network-changed-8907c86c-3bc6-41a2-ace1-517b5a4a92d1 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:12:52.564507 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-21798bcf-0f46-4808-82c8-47a7ebd8c48e req-c0d13b49-9be8-4057-b79d-3420245cd7e1 service nova] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Refreshing instance network info cache due to event network-changed-8907c86c-3bc6-41a2-ace1-517b5a4a92d1. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:12:52.564663 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-21798bcf-0f46-4808-82c8-47a7ebd8c48e req-c0d13b49-9be8-4057-b79d-3420245cd7e1 service nova] Acquiring lock "refresh_cache-9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:12:52.566231 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-21798bcf-0f46-4808-82c8-47a7ebd8c48e req-c0d13b49-9be8-4057-b79d-3420245cd7e1 service nova] Acquired lock "refresh_cache-9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:12:52.566344 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-21798bcf-0f46-4808-82c8-47a7ebd8c48e req-c0d13b49-9be8-4057-b79d-3420245cd7e1 service nova] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Refreshing network info cache for port 8907c86c-3bc6-41a2-ace1-517b5a4a92d1 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:12:52.690487 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Booting with volume b23f5880-1872-41fd-becc-baf8432031f3 at /dev/vda
May 28 10:12:52.743040 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:12:52.758618 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:12:52.785436 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:12:52.846385 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:12:52.846710 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:12:52.855852 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:12:52.858447 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe86:5388', 'fe80::5c44:a2ff:fe78:6c5f', 'fe80::fc16:3eff:fe8c:4068', 'fe80::9098:76ff:fe86:646f', 'fe80::fc16:3eff:fef0:49ef', 'fe80::e03f:79ff:fe2f:2d97', 'fe80::fc16:3eff:fe28:366', 'fe80::8cd1:81ff:fea1:944'] 
May 28 10:12:52.858447 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:12:52.858447 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:12:52.858447 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:12:52.858447 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Updating existing volume attachment record: ecd5e4e4-47e8-4dcf-8f91-cc01ca68b622 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:12:52.972769 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "refresh_cache-9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:12:52.983841 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:12:52.984095 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:12:52.984261 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] No VIF found with MAC fa:16:3e:49:8b:e9, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:12:52.984786 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Using config drive
May 28 10:12:53.069496 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-21798bcf-0f46-4808-82c8-47a7ebd8c48e req-c0d13b49-9be8-4057-b79d-3420245cd7e1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:53.127986 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-21798bcf-0f46-4808-82c8-47a7ebd8c48e req-c0d13b49-9be8-4057-b79d-3420245cd7e1 service nova] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:12:53.257340 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-21798bcf-0f46-4808-82c8-47a7ebd8c48e req-c0d13b49-9be8-4057-b79d-3420245cd7e1 service nova] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:12:53.495049 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:53.617680 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Creating config drive at /opt/stack/data/nova/instances/93a38b6d-e199-4653-a617-290247c8e430/disk.config
May 28 10:12:53.621679 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/93a38b6d-e199-4653-a617-290247c8e430/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpz3gwwznc {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:12:53.678536 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/93a38b6d-e199-4653-a617-290247c8e430/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpz3gwwznc" returned: 0 in 0.056s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:12:53.760188 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-21798bcf-0f46-4808-82c8-47a7ebd8c48e req-c0d13b49-9be8-4057-b79d-3420245cd7e1 service nova] Releasing lock "refresh_cache-9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:12:53.760188 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquired lock "refresh_cache-9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:12:53.760188 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:12:54.141425 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:54.193002 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:54.277051 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:54.356636 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:12:54.369343 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-5db80634-497b-40d7-82f8-b25acd78a9f9 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Acquiring lock "38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:54.369547 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-5db80634-497b-40d7-82f8-b25acd78a9f9 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Lock "38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:54.369721 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-5db80634-497b-40d7-82f8-b25acd78a9f9 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Acquiring lock "38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:54.369790 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-5db80634-497b-40d7-82f8-b25acd78a9f9 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Lock "38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:54.369918 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-5db80634-497b-40d7-82f8-b25acd78a9f9 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Lock "38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:54.374185 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-5db80634-497b-40d7-82f8-b25acd78a9f9 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Terminating instance
May 28 10:12:54.599472 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:54.601458 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:54.605962 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:54.612063 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:54.612894 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:54.636699 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:54.667294 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-944cb6c6-e0eb-4ef9-a1b5-3a2b98563e4c req-6e43d659-af87-481c-a37e-b41b0bbc0f8c service nova] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Received event network-vif-plugged-e9818d03-4fce-4fba-a66e-524f18ac36fd {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:12:54.670526 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-944cb6c6-e0eb-4ef9-a1b5-3a2b98563e4c req-6e43d659-af87-481c-a37e-b41b0bbc0f8c service nova] Acquiring lock "93a38b6d-e199-4653-a617-290247c8e430-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:54.670722 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-944cb6c6-e0eb-4ef9-a1b5-3a2b98563e4c req-6e43d659-af87-481c-a37e-b41b0bbc0f8c service nova] Lock "93a38b6d-e199-4653-a617-290247c8e430-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:54.670852 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-944cb6c6-e0eb-4ef9-a1b5-3a2b98563e4c req-6e43d659-af87-481c-a37e-b41b0bbc0f8c service nova] Lock "93a38b6d-e199-4653-a617-290247c8e430-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:54.670975 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-944cb6c6-e0eb-4ef9-a1b5-3a2b98563e4c req-6e43d659-af87-481c-a37e-b41b0bbc0f8c service nova] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Processing event network-vif-plugged-e9818d03-4fce-4fba-a66e-524f18ac36fd {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:12:54.671100 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-944cb6c6-e0eb-4ef9-a1b5-3a2b98563e4c req-6e43d659-af87-481c-a37e-b41b0bbc0f8c service nova] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Received event network-vif-plugged-e9818d03-4fce-4fba-a66e-524f18ac36fd {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:12:54.671254 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-944cb6c6-e0eb-4ef9-a1b5-3a2b98563e4c req-6e43d659-af87-481c-a37e-b41b0bbc0f8c service nova] Acquiring lock "93a38b6d-e199-4653-a617-290247c8e430-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:54.671370 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-944cb6c6-e0eb-4ef9-a1b5-3a2b98563e4c req-6e43d659-af87-481c-a37e-b41b0bbc0f8c service nova] Lock "93a38b6d-e199-4653-a617-290247c8e430-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:54.671470 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-944cb6c6-e0eb-4ef9-a1b5-3a2b98563e4c req-6e43d659-af87-481c-a37e-b41b0bbc0f8c service nova] Lock "93a38b6d-e199-4653-a617-290247c8e430-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:54.671603 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-944cb6c6-e0eb-4ef9-a1b5-3a2b98563e4c req-6e43d659-af87-481c-a37e-b41b0bbc0f8c service nova] [instance: 93a38b6d-e199-4653-a617-290247c8e430] No waiting events found dispatching network-vif-plugged-e9818d03-4fce-4fba-a66e-524f18ac36fd {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:12:54.674179 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-944cb6c6-e0eb-4ef9-a1b5-3a2b98563e4c req-6e43d659-af87-481c-a37e-b41b0bbc0f8c service nova] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Received unexpected event network-vif-plugged-e9818d03-4fce-4fba-a66e-524f18ac36fd for instance with vm_state building and task_state spawning.
May 28 10:12:54.766535 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Updating instance_info_cache with network_info: [{"id": "8907c86c-3bc6-41a2-ace1-517b5a4a92d1", "address": "fa:16:3e:c4:aa:35", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8907c86c-3b", "ovs_interfaceid": "8907c86c-3bc6-41a2-ace1-517b5a4a92d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:12:54.876698 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-5db80634-497b-40d7-82f8-b25acd78a9f9 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:12:54.919693 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:54.922809 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:54.939194 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:54.947681 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:54.952551 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:54.970021 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:54.976439 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:54.988798 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:12:54.990207 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:12:54.990463 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Creating image(s)
May 28 10:12:54.990791 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Did not create local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 10:12:54.991106 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Ensure instance console log exists: /opt/stack/data/nova/instances/9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:12:54.991690 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:54.991890 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:54.992037 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:55.129694 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6f444e28-329e-4bac-9944-96558b91ad4b req-6c1520dd-061a-43b8-baf4-f06db6718cd3 service nova] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Received event network-vif-unplugged-5891d2d0-85db-4fea-a75d-eda91bfd237d {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:12:55.129882 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6f444e28-329e-4bac-9944-96558b91ad4b req-6c1520dd-061a-43b8-baf4-f06db6718cd3 service nova] Acquiring lock "38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:55.130011 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6f444e28-329e-4bac-9944-96558b91ad4b req-6c1520dd-061a-43b8-baf4-f06db6718cd3 service nova] Lock "38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:55.130184 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6f444e28-329e-4bac-9944-96558b91ad4b req-6c1520dd-061a-43b8-baf4-f06db6718cd3 service nova] Lock "38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:55.130293 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6f444e28-329e-4bac-9944-96558b91ad4b req-6c1520dd-061a-43b8-baf4-f06db6718cd3 service nova] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] No waiting events found dispatching network-vif-unplugged-5891d2d0-85db-4fea-a75d-eda91bfd237d {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:12:55.130413 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6f444e28-329e-4bac-9944-96558b91ad4b req-6c1520dd-061a-43b8-baf4-f06db6718cd3 service nova] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Received event network-vif-unplugged-5891d2d0-85db-4fea-a75d-eda91bfd237d for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:12:55.204018 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963175.202586, 93a38b6d-e199-4653-a617-290247c8e430 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:12:55.204018 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 93a38b6d-e199-4653-a617-290247c8e430] VM Started (Lifecycle Event)
May 28 10:12:55.204704 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:12:55.208450 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:55.212211 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:12:55.215906 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Instance spawned successfully.
May 28 10:12:55.216426 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:12:55.241269 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Instance destroyed successfully.
May 28 10:12:55.241662 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-5db80634-497b-40d7-82f8-b25acd78a9f9 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Lazy-loading 'resources' on Instance uuid 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:12:55.269021 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Releasing lock "refresh_cache-9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:12:55.269349 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Instance network_info: |[{"id": "8907c86c-3bc6-41a2-ace1-517b5a4a92d1", "address": "fa:16:3e:c4:aa:35", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8907c86c-3b", "ovs_interfaceid": "8907c86c-3bc6-41a2-ace1-517b5a4a92d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:12:55.270124 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Start _get_guest_xml network_info=[{"id": "8907c86c-3bc6-41a2-ace1-517b5a4a92d1", "address": "fa:16:3e:c4:aa:35", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8907c86c-3b", "ovs_interfaceid": "8907c86c-3bc6-41a2-ace1-517b5a4a92d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b23f5880-1872-41fd-becc-baf8432031f3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5', 'attached_at': '', 'detached_at': '', 'volume_id': 'b23f5880-1872-41fd-becc-baf8432031f3', 'serial': 'b23f5880-1872-41fd-becc-baf8432031f3'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'ecd5e4e4-47e8-4dcf-8f91-cc01ca68b622', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:12:55.274785 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:12:55.279259 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-408625165', uuid='9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5'), owner=OwnerMeta(userid='ec58233d3b2848bbb2e0b00650398cd1', username='tempest-TestVolumeBootPattern-327944304-project-member', projectid='23e9651268114327a9cc6c6c59bef01e', projectname='tempest-TestVolumeBootPattern-327944304'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8907c86c-3bc6-41a2-ace1-517b5a4a92d1", "address": "fa:16:3e:c4:aa:35", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8907c86c-3b", "ovs_interfaceid": "8907c86c-3bc6-41a2-ace1-517b5a4a92d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779963175.2788517) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:12:55.282012 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:12:55.282367 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:12:55.285603 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Acquiring lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:55.285849 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:55.287437 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:12:55.287437 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:12:55.291208 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:12:55.291627 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:12:55.291921 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:12:55.291921 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:12:55.292005 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:12:55.292092 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:12:55.292241 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:12:55.292669 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:12:55.296332 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:12:55.296525 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:12:55.296642 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:12:55.296764 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:12:55.309105 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:12:55.309455 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b23f5880-1872-41fd-becc-baf8432031f3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:12:55.309609 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:12:55.309928 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:12:55.310108 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b23f5880-1872-41fd-becc-baf8432031f3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:12:55.322971 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:12:55.323746 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:12:55.324175 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:12:55.324371 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:12:55.324994 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:12:55.325242 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:12:55.337443 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:12:55.337443 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:55.347252 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:12:55.347252 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:55.350400 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3] added
May 28 10:12:55.350400 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:12:55.350400 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:12:55.350400 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:12:55.350400 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:12:55.350400 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:12:55.350400 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:55.350579 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:12:55.351041 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0263(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:12:55.351041 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:12:55.363016 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3] added
May 28 10:12:55.363016 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:12:55.363016 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:12:55.363016 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:12:55.363016 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:12:55.363016 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:12:55.363016 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:55.363789 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:12:55.363867 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0386(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:12:55.364481 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:12:55.707713 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:12:55.710176 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:12:55.724007 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:12:55.724464 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:12:55.724896 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:12:55.725228 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:12:55.725570 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:12:55.725956 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:12:55.744365 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-5db80634-497b-40d7-82f8-b25acd78a9f9 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:11:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1119403308',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1119403308',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testservervolumeattachscenariooldversion-server-1119403',id=66,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIL4OheUQNySvxy14CnXy50E6tElxyFnj0sozvCAFWgSa+8mQykaSBrRIp3MXKUB1obKtxpmgAQlvTOkGntgoUVmphjtoGL3+kawnT52fTjL8Zy6cWVRb90FEl9kJu3T1Q==',key_name='tempest-keypair-986171858',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:11:57Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12b2299852eb46bc9d4049993bba63c8',ramdisk_id='',reservation_id='r-0wpegttj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1790847208',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:11:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19b3fdd1190f40d49a21e78b400abbd3',uuid=38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5891d2d0-85db-4fea-a75d-eda91bfd237d", "address": "fa:16:3e:8c:40:68", "network": {"id": "446df521-2c31-4c3a-b11f-066d4fa34be7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-691863219-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12b2299852eb46bc9d4049993bba63c8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5891d2d0-85", "ovs_interfaceid": "5891d2d0-85db-4fea-a75d-eda91bfd237d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:12:55.744664 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-5db80634-497b-40d7-82f8-b25acd78a9f9 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Converting VIF {"id": "5891d2d0-85db-4fea-a75d-eda91bfd237d", "address": "fa:16:3e:8c:40:68", "network": {"id": "446df521-2c31-4c3a-b11f-066d4fa34be7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-691863219-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12b2299852eb46bc9d4049993bba63c8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5891d2d0-85", "ovs_interfaceid": "5891d2d0-85db-4fea-a75d-eda91bfd237d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:12:55.745375 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-5db80634-497b-40d7-82f8-b25acd78a9f9 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:40:68,bridge_name='br-int',has_traffic_filtering=True,id=5891d2d0-85db-4fea-a75d-eda91bfd237d,network=Network(446df521-2c31-4c3a-b11f-066d4fa34be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5891d2d0-85') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:12:55.745707 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-5db80634-497b-40d7-82f8-b25acd78a9f9 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:40:68,bridge_name='br-int',has_traffic_filtering=True,id=5891d2d0-85db-4fea-a75d-eda91bfd237d,network=Network(446df521-2c31-4c3a-b11f-066d4fa34be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5891d2d0-85') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:12:55.747191 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:55.747552 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5891d2d0-85, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:12:55.748914 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:55.752739 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:12:55.752739 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:55.752739 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:55.752739 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1ae7a5d2-eeeb-4d6d-ada9-36fc93c5d9fd) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:12:55.754035 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:12:55.757685 np0000001613 nova-compute[98321]: INFO os_vif [None req-5db80634-497b-40d7-82f8-b25acd78a9f9 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:40:68,bridge_name='br-int',has_traffic_filtering=True,id=5891d2d0-85db-4fea-a75d-eda91bfd237d,network=Network(446df521-2c31-4c3a-b11f-066d4fa34be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5891d2d0-85')
May 28 10:12:55.758076 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-5db80634-497b-40d7-82f8-b25acd78a9f9 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Deleting instance files /opt/stack/data/nova/instances/38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f_del
May 28 10:12:55.762639 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-5db80634-497b-40d7-82f8-b25acd78a9f9 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Deletion of /opt/stack/data/nova/instances/38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f_del complete
May 28 10:12:55.793753 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Detaching volume f350dea6-be89-4379-b391-df96bd9c3fc2
May 28 10:12:55.856950 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Attempting to driver detach volume f350dea6-be89-4379-b391-df96bd9c3fc2 from mountpoint /dev/vdb
May 28 10:12:55.862551 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Found disk vdb by alias ua-f350dea6-be89-4379-b391-df96bd9c3fc2 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:12:55.863922 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Found disk vdb by alias ua-f350dea6-be89-4379-b391-df96bd9c3fc2 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:12:55.864078 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Attempting to detach device vdb from instance 8849d62e-d9a4-4285-95fc-0869cbf20b4c from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 10:12:55.864328 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:12:55.864328 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:12:55.864328 np0000001613 nova-compute[98321]:   <alias name="ua-f350dea6-be89-4379-b391-df96bd9c3fc2"/>
May 28 10:12:55.864328 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-1"/>
May 28 10:12:55.864328 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:12:55.864328 np0000001613 nova-compute[98321]:   <serial>f350dea6-be89-4379-b391-df96bd9c3fc2</serial>
May 28 10:12:55.864328 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:12:55.864328 np0000001613 nova-compute[98321]: </disk>
May 28 10:12:55.864328 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:12:55.873630 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Successfully detached device vdb from instance 8849d62e-d9a4-4285-95fc-0869cbf20b4c from the persistent domain config.
May 28 10:12:55.873814 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] (1/8): Attempting to detach device vdb with device alias ua-f350dea6-be89-4379-b391-df96bd9c3fc2 from instance 8849d62e-d9a4-4285-95fc-0869cbf20b4c from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 10:12:55.874249 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:12:55.874249 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:12:55.874249 np0000001613 nova-compute[98321]:   <alias name="ua-f350dea6-be89-4379-b391-df96bd9c3fc2"/>
May 28 10:12:55.874249 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-1"/>
May 28 10:12:55.874249 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:12:55.874249 np0000001613 nova-compute[98321]:   <serial>f350dea6-be89-4379-b391-df96bd9c3fc2</serial>
May 28 10:12:55.874249 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:12:55.874249 np0000001613 nova-compute[98321]: </disk>
May 28 10:12:55.874249 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:12:56.212474 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 93a38b6d-e199-4653-a617-290247c8e430] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:12:56.212858 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963176.2125664, 93a38b6d-e199-4653-a617-290247c8e430 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:12:56.213025 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 93a38b6d-e199-4653-a617-290247c8e430] VM Paused (Lifecycle Event)
May 28 10:12:56.231556 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Took 12.56 seconds to spawn the instance on the hypervisor.
May 28 10:12:56.231706 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:12:56.269763 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-5db80634-497b-40d7-82f8-b25acd78a9f9 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Took 1.39 seconds to destroy the instance on the hypervisor.
May 28 10:12:56.270264 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-5db80634-497b-40d7-82f8-b25acd78a9f9 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:12:56.270452 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:12:56.270523 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:12:56.270753 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:56.343401 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:56.351460 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:12:56.364710 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:12:56.364710 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:56.366905 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:12:56.380988 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:12:56.390409 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:12:56.390409 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:56.404045 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:56.404045 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:56.404045 np0000001613 nova-compute[98321]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:56.404045 np0000001613 nova-compute[98321]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:56.404045 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:12:56.404045 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:12:56.404045 np0000001613 nova-compute[98321]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4066489-19a4-44b1-9f26-f1b7c8fbaa6d (non-flash)
May 28 10:12:56.404045 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:12:56.404450 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:56.404450 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:56.404450 np0000001613 nova-compute[98321]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:56.404450 np0000001613 nova-compute[98321]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:56.404450 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:12:56.404450 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:12:56.404450 np0000001613 nova-compute[98321]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4066489-19a4-44b1-9f26-f1b7c8fbaa6d (non-flash)
May 28 10:12:56.404450 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:12:56.405219 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:56.432980 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:56.432980 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:56.432980 np0000001613 nova-compute[98321]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:56.432980 np0000001613 nova-compute[98321]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:56.432980 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:12:56.432980 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:12:56.432980 np0000001613 nova-compute[98321]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4066489-19a4-44b1-9f26-f1b7c8fbaa6d (non-flash)
May 28 10:12:56.432980 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:12:56.432980 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:56.432980 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:56.432980 np0000001613 nova-compute[98321]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:56.432980 np0000001613 nova-compute[98321]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:56.432980 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:12:56.432980 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:12:56.432980 np0000001613 nova-compute[98321]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4066489-19a4-44b1-9f26-f1b7c8fbaa6d (non-flash)
May 28 10:12:56.432980 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:12:56.455206 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3, portal: 192.168.40.100,3260]
May 28 10:12:56.455206 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3, portal: 192.168.40.100,3260] successful.
May 28 10:12:56.455206 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:56.473212 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:56.484818 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3, portal: 192.168.50.100,3260]
May 28 10:12:56.484818 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3, portal: 192.168.50.100,3260] successful.
May 28 10:12:56.484818 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:56.496712 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:56.496712 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:56.496712 np0000001613 nova-compute[98321]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:56.496712 np0000001613 nova-compute[98321]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:56.496712 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:12:56.496712 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:12:56.496712 np0000001613 nova-compute[98321]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4066489-19a4-44b1-9f26-f1b7c8fbaa6d (non-flash)
May 28 10:12:56.496712 np0000001613 nova-compute[98321]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:12:56.496712 np0000001613 nova-compute[98321]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:12:56.496712 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:12:56.498861 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:56.498861 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:56.498861 np0000001613 nova-compute[98321]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:56.498861 np0000001613 nova-compute[98321]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:56.498861 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:12:56.498861 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:12:56.498861 np0000001613 nova-compute[98321]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4066489-19a4-44b1-9f26-f1b7c8fbaa6d (non-flash)
May 28 10:12:56.498861 np0000001613 nova-compute[98321]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:12:56.498861 np0000001613 nova-compute[98321]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:12:56.498861 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:12:56.498861 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.173s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:12:56.498861 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:12:56.498861 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] HCTL ('8', '-', '-', 0) found on session 179 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:12:56.498861 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:12:56.499408 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:56.518040 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:56.518040 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:56.518040 np0000001613 nova-compute[98321]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:56.518040 np0000001613 nova-compute[98321]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:56.518040 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:12:56.518040 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:12:56.518040 np0000001613 nova-compute[98321]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4066489-19a4-44b1-9f26-f1b7c8fbaa6d (non-flash)
May 28 10:12:56.518040 np0000001613 nova-compute[98321]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:12:56.518040 np0000001613 nova-compute[98321]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:12:56.518040 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:12:56.518826 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:56.518826 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:56.518826 np0000001613 nova-compute[98321]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:56.518826 np0000001613 nova-compute[98321]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:56.518826 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:12:56.518826 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:12:56.518826 np0000001613 nova-compute[98321]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4066489-19a4-44b1-9f26-f1b7c8fbaa6d (non-flash)
May 28 10:12:56.518826 np0000001613 nova-compute[98321]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:12:56.518826 np0000001613 nova-compute[98321]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:12:56.518826 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:12:56.518826 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.194s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:12:56.518826 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:12:56.519708 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] HCTL ('15', '-', '-', 0) found on session 180 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:12:56.519850 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:12:56.531737 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching for a device in session 179 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:12:56.531737 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b23f5880-1872-41fd-becc-baf8432031f3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:12:56.536807 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching for a device in session 180 and hctl ['15', '*', '*', 0] yield: None {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:12:56.569209 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-f350dea6-be89-4379-b391-df96bd9c3fc2 for instance 8849d62e-d9a4-4285-95fc-0869cbf20b4c {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 10:12:56.717361 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:12:56.720749 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963176.7204566, 93a38b6d-e199-4653-a617-290247c8e430 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:12:56.720990 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 93a38b6d-e199-4653-a617-290247c8e430] VM Resumed (Lifecycle Event)
May 28 10:12:56.748517 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Took 19.95 seconds to build instance.
May 28 10:12:57.063840 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b966646d-47f1-40fe-b548-a40b1265838d req-d6eaa68f-fc04-4ad3-b6ca-5f42f3097888 service nova] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Received event network-vif-deleted-5891d2d0-85db-4fea-a75d-eda91bfd237d {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:12:57.063840 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-b966646d-47f1-40fe-b548-a40b1265838d req-d6eaa68f-fc04-4ad3-b6ca-5f42f3097888 service nova] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Neutron deleted interface 5891d2d0-85db-4fea-a75d-eda91bfd237d; detaching it from the instance and deleting it from the info cache
May 28 10:12:57.068816 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b966646d-47f1-40fe-b548-a40b1265838d req-d6eaa68f-fc04-4ad3-b6ca-5f42f3097888 service nova] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Detach interface failed, port_id=5891d2d0-85db-4fea-a75d-eda91bfd237d, reason: Instance 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:12:57.203473 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-69fe6382-edc0-4de5-8884-f6cd72b2de0e req-94ff07dc-3dff-4081-91f0-47b9a739a9e1 service nova] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Received event network-vif-unplugged-5891d2d0-85db-4fea-a75d-eda91bfd237d {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:12:57.203646 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-69fe6382-edc0-4de5-8884-f6cd72b2de0e req-94ff07dc-3dff-4081-91f0-47b9a739a9e1 service nova] Acquiring lock "38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:57.203782 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-69fe6382-edc0-4de5-8884-f6cd72b2de0e req-94ff07dc-3dff-4081-91f0-47b9a739a9e1 service nova] Lock "38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:57.203860 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-69fe6382-edc0-4de5-8884-f6cd72b2de0e req-94ff07dc-3dff-4081-91f0-47b9a739a9e1 service nova] Lock "38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:57.203965 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-69fe6382-edc0-4de5-8884-f6cd72b2de0e req-94ff07dc-3dff-4081-91f0-47b9a739a9e1 service nova] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] No waiting events found dispatching network-vif-unplugged-5891d2d0-85db-4fea-a75d-eda91bfd237d {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:12:57.204049 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-69fe6382-edc0-4de5-8884-f6cd72b2de0e req-94ff07dc-3dff-4081-91f0-47b9a739a9e1 service nova] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Received event network-vif-unplugged-5891d2d0-85db-4fea-a75d-eda91bfd237d for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:12:57.223963 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:12:57.226417 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:12:57.255360 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a04e5904-a463-46cc-9797-cbe7e5c030b9 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "93a38b6d-e199-4653-a617-290247c8e430" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.485s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:57.501060 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:12:57.537899 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching for a device in session 180 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:12:57.538146 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b23f5880-1872-41fd-becc-baf8432031f3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:12:57.728773 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999743884000054 future=<Future at 0x73c1f4209af0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:12:57.729154 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.99933933200009 future=<Future at 0x73c1f4209af0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:12:57.729303 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999171989999923 future=<Future at 0x73c1f4209af0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:12:57.729483 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779963177.7293143, 8849d62e-d9a4-4285-95fc-0869cbf20b4c => ua-f350dea6-be89-4379-b391-df96bd9c3fc2> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 10:12:57.733141 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Successfully detached device vdb from instance 8849d62e-d9a4-4285-95fc-0869cbf20b4c from the live domain config.
May 28 10:12:57.734732 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:12:57.734996 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2', 'iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f350dea6-be89-4379-b391-df96bd9c3fc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:12:57.735109 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:12:58.003463 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Took 1.73 seconds to deallocate network for instance.
May 28 10:12:58.006342 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-94172f33-2555-492b-a4c8-006d40bd270d req-7f7b8b49-5b2c-42d4-a5ce-ed41f5fe1334 service nova] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Received event network-changed-e9818d03-4fce-4fba-a66e-524f18ac36fd {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:12:58.006524 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-94172f33-2555-492b-a4c8-006d40bd270d req-7f7b8b49-5b2c-42d4-a5ce-ed41f5fe1334 service nova] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Refreshing instance network info cache due to event network-changed-e9818d03-4fce-4fba-a66e-524f18ac36fd. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:12:58.006835 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-94172f33-2555-492b-a4c8-006d40bd270d req-7f7b8b49-5b2c-42d4-a5ce-ed41f5fe1334 service nova] Acquiring lock "refresh_cache-93a38b6d-e199-4653-a617-290247c8e430" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:12:58.006895 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-94172f33-2555-492b-a4c8-006d40bd270d req-7f7b8b49-5b2c-42d4-a5ce-ed41f5fe1334 service nova] Acquired lock "refresh_cache-93a38b6d-e199-4653-a617-290247c8e430" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:12:58.007140 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-94172f33-2555-492b-a4c8-006d40bd270d req-7f7b8b49-5b2c-42d4-a5ce-ed41f5fe1334 service nova] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Refreshing network info cache for port e9818d03-4fce-4fba-a66e-524f18ac36fd {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:12:58.341895 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Found WWN 330000000eafe978e for multipath device dm-0 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:12:58.342101 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:12:58.342353 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '330000000eafe978e', 'path': '/dev/dm-0', 'multipath_id': '330000000eafe978e'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:12:58.342511 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000eafe978e', 'path': '/dev/dm-0', 'multipath_id': '330000000eafe978e'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:12:58.342958 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.608s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:12:58.343466 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2', 'iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f350dea6-be89-4379-b391-df96bd9c3fc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:12:58.343636 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:12:58.376417 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:58.376417 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:58.376417 np0000001613 nova-compute[98321]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:58.376417 np0000001613 nova-compute[98321]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:58.376417 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:12:58.376417 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:12:58.376417 np0000001613 nova-compute[98321]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4066489-19a4-44b1-9f26-f1b7c8fbaa6d (non-flash)
May 28 10:12:58.376417 np0000001613 nova-compute[98321]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:12:58.376417 np0000001613 nova-compute[98321]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:12:58.376417 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:12:58.376778 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:58.376778 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:12:58.376778 np0000001613 nova-compute[98321]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:58.376778 np0000001613 nova-compute[98321]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2 (non-flash)
May 28 10:12:58.376778 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:12:58.376778 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:12:58.376778 np0000001613 nova-compute[98321]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4066489-19a4-44b1-9f26-f1b7c8fbaa6d (non-flash)
May 28 10:12:58.376778 np0000001613 nova-compute[98321]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:12:58.376778 np0000001613 nova-compute[98321]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:12:58.376778 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:12:58.376778 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a', '170'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a', '171'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2', '174'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2', '175'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', '176'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', '177'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4066489-19a4-44b1-9f26-f1b7c8fbaa6d', '178'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', '179'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', '180')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:12:58.377056 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2', '174')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:12:58.378770 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2', '175')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:12:58.379363 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc2bde40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2'): ({'sdg'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:12:58.379363 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Removing multipathed devices sdf, sdg {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:12:58.379465 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Flush multipath device 330000000573d6d41 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:12:58.411978 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:12:58.466811 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:12:58.513421 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-94172f33-2555-492b-a4c8-006d40bd270d req-7f7b8b49-5b2c-42d4-a5ce-ed41f5fe1334 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:58.520803 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-5db80634-497b-40d7-82f8-b25acd78a9f9 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:58.520992 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-5db80634-497b-40d7-82f8-b25acd78a9f9 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:58.530213 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:12:58.530632 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:12:58.534337 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:12:58.556336 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:12:58.556336 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:12:58.571366 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:58.622046 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 174, target: iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2, portal: 192.168.40.100,3260]
May 28 10:12:58.622046 np0000001613 nova-compute[98321]: Logout of [sid: 174, target: iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2, portal: 192.168.40.100,3260] successful.
May 28 10:12:58.622046 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:58.643681 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:58.657055 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:58.694810 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 175, target: iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2, portal: 192.168.50.100,3260]
May 28 10:12:58.694810 np0000001613 nova-compute[98321]: Logout of [sid: 175, target: iqn.2023-03.storpool.com:os--volume-f350dea6-be89-4379-b391-df96bd9c3fc2, portal: 192.168.50.100,3260] successful.
May 28 10:12:58.694810 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:58.712942 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:12:58.713209 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:12:58.713341 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] <== disconnect_volume: return (978ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:12:58.713513 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:12:58.792294 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:12:58.792591 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:12:58.792969 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:12:58.852105 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:12:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-408625165',display_name='tempest-TestVolumeBootPattern-server-408625165',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpattern-server-408625165',id=70,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIssEW3wFq5Z5UVaYZuW5cmCRsiPiqbdvADCw1wCLU3ZToJr2mBO+GTeBlReOodZ6qxe1OJNXGES/jiq9J2PvBGzYYtKCDR4nIPiT2JecYH/bovKreakXe+d0IlAq6PNVA==',key_name='tempest-TestVolumeBootPattern-1325122028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23e9651268114327a9cc6c6c59bef01e',ramdisk_id='',reservation_id='r-irsw1n6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-327944304',owner_user_name='tempest-TestVolumeBootPattern-327944304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:12:52Z,user_data=None,user_id='ec58233d3b2848bbb2e0b00650398cd1',uuid=9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8907c86c-3bc6-41a2-ace1-517b5a4a92d1", "address": "fa:16:3e:c4:aa:35", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8907c86c-3b", "ovs_interfaceid": "8907c86c-3bc6-41a2-ace1-517b5a4a92d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:12:58.852346 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converting VIF {"id": "8907c86c-3bc6-41a2-ace1-517b5a4a92d1", "address": "fa:16:3e:c4:aa:35", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8907c86c-3b", "ovs_interfaceid": "8907c86c-3bc6-41a2-ace1-517b5a4a92d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:12:58.852786 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:aa:35,bridge_name='br-int',has_traffic_filtering=True,id=8907c86c-3bc6-41a2-ace1-517b5a4a92d1,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8907c86c-3b') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:12:58.853313 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:12:58.959326 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-94172f33-2555-492b-a4c8-006d40bd270d req-7f7b8b49-5b2c-42d4-a5ce-ed41f5fe1334 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:12:59.045502 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-5db80634-497b-40d7-82f8-b25acd78a9f9 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:12:59.045767 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-5db80634-497b-40d7-82f8-b25acd78a9f9 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:12:59.143659 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-94172f33-2555-492b-a4c8-006d40bd270d req-7f7b8b49-5b2c-42d4-a5ce-ed41f5fe1334 service nova] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Updated VIF entry in instance network info cache for port e9818d03-4fce-4fba-a66e-524f18ac36fd. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:12:59.143977 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-94172f33-2555-492b-a4c8-006d40bd270d req-7f7b8b49-5b2c-42d4-a5ce-ed41f5fe1334 service nova] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Updating instance_info_cache with network_info: [{"id": "e9818d03-4fce-4fba-a66e-524f18ac36fd", "address": "fa:16:3e:49:8b:e9", "network": {"id": "83f5548a-aebf-46e0-a4d2-07f06d3967d4", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1141449765-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d80b528594ac4ee5b3b56bf7c94c7ffa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9818d03-4f", "ovs_interfaceid": "e9818d03-4fce-4fba-a66e-524f18ac36fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:12:59.261357 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lazy-loading 'flavor' on Instance uuid 8849d62e-d9a4-4285-95fc-0869cbf20b4c {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:12:59.359023 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] End _get_guest_xml xml=<domain type="qemu">
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:   <uuid>9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5</uuid>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:   <name>instance-00000046</name>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:       <nova:name>tempest-TestVolumeBootPattern-server-408625165</nova:name>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:12:55</nova:creationTime>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:       <nova:image uuid="">
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:         <nova:user uuid="ec58233d3b2848bbb2e0b00650398cd1">tempest-TestVolumeBootPattern-327944304-project-member</nova:user>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:         <nova:project uuid="23e9651268114327a9cc6c6c59bef01e">tempest-TestVolumeBootPattern-327944304</nova:project>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:       <nova:root type="volume" uuid=""/>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:         <nova:port uuid="8907c86c-3bc6-41a2-ace1-517b5a4a92d1">
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:     <system>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:       <entry name="serial">9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5</entry>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:       <entry name="uuid">9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5</entry>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:     </system>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:   <os>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:   </os>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:   <features>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:   </features>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:   <devices>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5/disk.config"/>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:     </disk>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:       <alias name="ua-b23f5880-1872-41fd-becc-baf8432031f3"/>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-0"/>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:       <serial>b23f5880-1872-41fd-becc-baf8432031f3</serial>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:     </disk>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:c4:aa:35"/>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:       <target dev="tap8907c86c-3b"/>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:     </interface>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5/console.log" append="off"/>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:     </serial>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:     <video>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:     </video>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:     </rng>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:   </devices>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]: </domain>
May 28 10:12:59.359023 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:12:59.360863 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Preparing to wait for external event network-vif-plugged-8907c86c-3bc6-41a2-ace1-517b5a4a92d1 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:12:59.360863 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:59.360863 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:59.360863 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:12:59.360863 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:12:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-408625165',display_name='tempest-TestVolumeBootPattern-server-408625165',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpattern-server-408625165',id=70,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIssEW3wFq5Z5UVaYZuW5cmCRsiPiqbdvADCw1wCLU3ZToJr2mBO+GTeBlReOodZ6qxe1OJNXGES/jiq9J2PvBGzYYtKCDR4nIPiT2JecYH/bovKreakXe+d0IlAq6PNVA==',key_name='tempest-TestVolumeBootPattern-1325122028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23e9651268114327a9cc6c6c59bef01e',ramdisk_id='',reservation_id='r-irsw1n6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-327944304',owner_user_name='tempest-TestVolumeBootPattern-327944304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:12:52Z,user_data=None,user_id='ec58233d3b2848bbb2e0b00650398cd1',uuid=9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8907c86c-3bc6-41a2-ace1-517b5a4a92d1", "address": "fa:16:3e:c4:aa:35", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8907c86c-3b", "ovs_interfaceid": "8907c86c-3bc6-41a2-ace1-517b5a4a92d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:12:59.360863 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converting VIF {"id": "8907c86c-3bc6-41a2-ace1-517b5a4a92d1", "address": "fa:16:3e:c4:aa:35", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8907c86c-3b", "ovs_interfaceid": "8907c86c-3bc6-41a2-ace1-517b5a4a92d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:12:59.360863 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:aa:35,bridge_name='br-int',has_traffic_filtering=True,id=8907c86c-3bc6-41a2-ace1-517b5a4a92d1,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8907c86c-3b') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:12:59.361223 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:aa:35,bridge_name='br-int',has_traffic_filtering=True,id=8907c86c-3bc6-41a2-ace1-517b5a4a92d1,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8907c86c-3b') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:12:59.361957 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:59.362185 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:12:59.362351 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:12:59.366185 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:59.366185 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0eb54626-1030-561c-8ab0-bcc842118041', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:12:59.366185 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:59.366185 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:12:59.367628 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:59.367875 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8907c86c-3b, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:12:59.368321 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8907c86c-3b, col_values=(('qos', UUID('08237de9-1a35-4f9d-b376-f81792ebc705')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:12:59.368574 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8907c86c-3b, col_values=(('external_ids', {'iface-id': '8907c86c-3bc6-41a2-ace1-517b5a4a92d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:aa:35', 'vm-uuid': '9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:12:59.374236 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:12:59.376538 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:12:59.377750 np0000001613 nova-compute[98321]: INFO os_vif [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:aa:35,bridge_name='br-int',has_traffic_filtering=True,id=8907c86c-3bc6-41a2-ace1-517b5a4a92d1,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8907c86c-3b')
May 28 10:12:59.551793 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-5db80634-497b-40d7-82f8-b25acd78a9f9 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:12:59.646595 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-94172f33-2555-492b-a4c8-006d40bd270d req-7f7b8b49-5b2c-42d4-a5ce-ed41f5fe1334 service nova] Releasing lock "refresh_cache-93a38b6d-e199-4653-a617-290247c8e430" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:12:59.689102 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-988c82c3-1ef6-4341-9b41-e327620f46e4 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:12:59.690246 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-988c82c3-1ef6-4341-9b41-e327620f46e4 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:12:59.690975 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-988c82c3-1ef6-4341-9b41-e327620f46e4 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Rebooting instance
May 28 10:12:59.792710 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:12:59.792926 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:12:59.793088 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 10:12:59.793355 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:12:59.985288 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:00.059720 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-5db80634-497b-40d7-82f8-b25acd78a9f9 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.539s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:00.123825 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-5db80634-497b-40d7-82f8-b25acd78a9f9 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Deleted allocations for instance 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f
May 28 10:13:00.268851 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-25515416-6010-48a6-9b9a-7707e39c725d tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.983s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:00.288980 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-988c82c3-1ef6-4341-9b41-e327620f46e4 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "refresh_cache-3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:13:00.289671 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-988c82c3-1ef6-4341-9b41-e327620f46e4 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquired lock "refresh_cache-3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:13:00.290102 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-988c82c3-1ef6-4341-9b41-e327620f46e4 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:13:00.298761 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:00.298960 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:00.299140 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:00.299347 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Auditing locally available compute resources for np0000001613 (node: np0000001613) {{(pid=98321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 10:13:00.798953 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-988c82c3-1ef6-4341-9b41-e327620f46e4 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:13:00.896189 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:13:00.896432 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:13:00.896574 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] No VIF found with MAC fa:16:3e:c4:aa:35, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:13:00.897023 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Using config drive
May 28 10:13:01.136223 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-5db80634-497b-40d7-82f8-b25acd78a9f9 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Lock "38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.767s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:01.203222 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-988c82c3-1ef6-4341-9b41-e327620f46e4 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:13:01.344432 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:13:01.383967 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-988c82c3-1ef6-4341-9b41-e327620f46e4 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Updating instance_info_cache with network_info: [{"id": "04633d7b-a11f-4e7a-bd98-683a082e8a73", "address": "fa:16:3e:f0:49:ef", "network": {"id": "db344666-4990-47d9-a3a2-9bebce64e660", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1492927350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44f9e47b0cb84ec9a96e9ee54854c98d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04633d7b-a1", "ovs_interfaceid": "04633d7b-a11f-4e7a-bd98-683a082e8a73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:13:01.404769 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:13:01.455351 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:13:01.456108 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:13:01.554013 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:13:01.555275 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-4 (vdb) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:13:01.562840 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:13:01.565336 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/405de22b-28c5-4415-ad12-e7e8eae4d591/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:13:01.587961 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Creating config drive at /opt/stack/data/nova/instances/9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5/disk.config
May 28 10:13:01.592607 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_lp6u50o {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:13:01.649035 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_lp6u50o" returned: 0 in 0.056s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:13:01.676766 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/405de22b-28c5-4415-ad12-e7e8eae4d591/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:13:01.677445 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/405de22b-28c5-4415-ad12-e7e8eae4d591/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:13:01.794786 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/405de22b-28c5-4415-ad12-e7e8eae4d591/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:13:01.811824 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8849d62e-d9a4-4285-95fc-0869cbf20b4c/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:13:01.892016 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-988c82c3-1ef6-4341-9b41-e327620f46e4 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Releasing lock "refresh_cache-3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:13:01.930414 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8849d62e-d9a4-4285-95fc-0869cbf20b4c/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:13:01.932915 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8849d62e-d9a4-4285-95fc-0869cbf20b4c/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:13:02.050180 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8849d62e-d9a4-4285-95fc-0869cbf20b4c/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:13:02.095811 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Acquiring lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:02.096004 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:02.125443 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:02.156477 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:02.263900 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:02.336944 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d48973d8-b9af-42b3-a825-a87b02d3c7a9 req-63d39664-26b4-43b9-b0fb-4431557ee4cd service nova] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Received event network-vif-plugged-8907c86c-3bc6-41a2-ace1-517b5a4a92d1 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:13:02.337770 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d48973d8-b9af-42b3-a825-a87b02d3c7a9 req-63d39664-26b4-43b9-b0fb-4431557ee4cd service nova] Acquiring lock "9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:02.338044 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d48973d8-b9af-42b3-a825-a87b02d3c7a9 req-63d39664-26b4-43b9-b0fb-4431557ee4cd service nova] Lock "9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:02.338212 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d48973d8-b9af-42b3-a825-a87b02d3c7a9 req-63d39664-26b4-43b9-b0fb-4431557ee4cd service nova] Lock "9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:02.338470 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d48973d8-b9af-42b3-a825-a87b02d3c7a9 req-63d39664-26b4-43b9-b0fb-4431557ee4cd service nova] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Processing event network-vif-plugged-8907c86c-3bc6-41a2-ace1-517b5a4a92d1 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:13:02.349015 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:13:02.356043 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:13:02.357288 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:13:02.403730 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-988c82c3-1ef6-4341-9b41-e327620f46e4 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:13:02.421921 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "env LANG=C uptime" returned: 0 in 0.065s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:13:02.422321 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Hypervisor/Node resource view: name=np0000001613 free_ram=12193MB free_disk=72.62726593017578GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 10:13:02.422509 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:02.422742 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:02.543633 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:02.546975 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:02.548601 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:02.573012 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:02.601385 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lazy-loading 'flavor' on Instance uuid 8849d62e-d9a4-4285-95fc-0869cbf20b4c {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:13:03.044946 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963183.043642, 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:13:03.044946 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] VM Started (Lifecycle Event)
May 28 10:13:03.046111 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:13:03.050196 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:13:03.057784 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Instance spawned successfully.
May 28 10:13:03.058231 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:13:03.391231 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:03.496714 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 8849d62e-d9a4-4285-95fc-0869cbf20b4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:13:03.496862 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:13:03.496992 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 405de22b-28c5-4415-ad12-e7e8eae4d591 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:13:03.497135 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 93a38b6d-e199-4653-a617-290247c8e430 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:13:03.497295 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:13:03.497531 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 10:13:03.497756 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Final resource view: name=np0000001613 phys_ram=24030MB used_ram=1472MB phys_disk=95GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 10:13:02 up 45 min,  2 users,  load average: 6.70, 7.19, 5.45\n', 'num_instances': '5', 'num_vm_active': '4', 'num_task_None': '3', 'num_os_type_None': '5', 'num_proj_6e3e75c7b1bb425fbec695f663a73daf': '1', 'io_workload': '1', 'num_task_rebooting': '1', 'num_proj_44f9e47b0cb84ec9a96e9ee54854c98d': '1', 'num_proj_a4bbdf692768465db607aa60a630e5e2': '1', 'num_proj_d80b528594ac4ee5b3b56bf7c94c7ffa': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_23e9651268114327a9cc6c6c59bef01e': '1'} {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 10:13:03.547604 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:13:03.550665 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:13:03.569707 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:13:03.569894 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:13:03.570048 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:13:03.570309 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:13:03.570567 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:13:03.570766 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:13:03.610195 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.514s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:03.831793 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:13:03.832014 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:13:04.053134 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:13:04.053512 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963184.053287, 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:13:04.053678 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] VM Paused (Lifecycle Event)
May 28 10:13:04.075325 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Took 9.09 seconds to spawn the instance on the hypervisor.
May 28 10:13:04.075522 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:13:04.335437 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:13:04.370239 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:04.423689 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2e543416-ad21-44a4-82de-10945f4899f3 req-77909c3c-6046-4aeb-bfa8-4d66d7139a3e service nova] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Received event network-vif-plugged-8907c86c-3bc6-41a2-ace1-517b5a4a92d1 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:13:04.425179 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2e543416-ad21-44a4-82de-10945f4899f3 req-77909c3c-6046-4aeb-bfa8-4d66d7139a3e service nova] Acquiring lock "9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:04.425179 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2e543416-ad21-44a4-82de-10945f4899f3 req-77909c3c-6046-4aeb-bfa8-4d66d7139a3e service nova] Lock "9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:04.425179 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2e543416-ad21-44a4-82de-10945f4899f3 req-77909c3c-6046-4aeb-bfa8-4d66d7139a3e service nova] Lock "9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:04.425179 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2e543416-ad21-44a4-82de-10945f4899f3 req-77909c3c-6046-4aeb-bfa8-4d66d7139a3e service nova] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] No waiting events found dispatching network-vif-plugged-8907c86c-3bc6-41a2-ace1-517b5a4a92d1 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:13:04.425416 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-2e543416-ad21-44a4-82de-10945f4899f3 req-77909c3c-6046-4aeb-bfa8-4d66d7139a3e service nova] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Received unexpected event network-vif-plugged-8907c86c-3bc6-41a2-ace1-517b5a4a92d1 for instance with vm_state active and task_state None.
May 28 10:13:04.558041 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:13:04.560602 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963184.5602937, 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:13:04.560793 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] VM Resumed (Lifecycle Event)
May 28 10:13:04.584808 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Took 16.41 seconds to build instance.
May 28 10:13:04.697853 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Acquiring lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:04.698492 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:04.699576 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Attaching volume e113d7a6-8f4b-466b-b6b9-4f417f99e99b to /dev/vdb
May 28 10:13:04.741213 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:13:04.753832 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:13:04.777485 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:13:04.822291 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:13:04.822578 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:13:04.832224 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:13:04.833824 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe86:5388', 'fe80::5c44:a2ff:fe78:6c5f', 'fe80::fc16:3eff:fef0:49ef', 'fe80::e03f:79ff:fe2f:2d97', 'fe80::fc16:3eff:fe28:366', 'fe80::8cd1:81ff:fea1:944', 'fe80::fc16:3eff:fe49:8be9', 'fe80::2c59:8cff:fea1:3a8', 'fe80::fc16:3eff:fec4:aa35', 'fe80::e4eb:4cff:fe5c:5eb7'] 
May 28 10:13:04.834001 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:13:04.834183 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:13:04.834714 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:13:04.835074 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Updating existing volume attachment record: d29cfda5-e42c-40d8-9320-133b62a73bae {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:13:04.845299 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Compute_service record updated for np0000001613:np0000001613 {{(pid=98321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 10:13:04.845791 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.423s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:04.846577 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:13:04.988280 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:05.069037 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:13:05.074839 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:13:05.085906 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6f55b059-899b-4792-ab85-902665c0487a tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.916s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:05.388554 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:13:05.388978 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b', 'iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e113d7a6-8f4b-466b-b6b9-4f417f99e99b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:13:05.389187 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:13:05.389615 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:13:05.389843 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b', 'iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e113d7a6-8f4b-466b-b6b9-4f417f99e99b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:13:05.408102 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:05.410853 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:13:05.411215 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:13:05.411752 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:13:05.412289 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:13:05.412618 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:13:05.412846 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:13:05.429291 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:13:05.429291 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:05.429766 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:13:05.429766 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:05.442940 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b] added
May 28 10:13:05.442940 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:13:05.442940 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:13:05.442940 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:13:05.442940 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:13:05.442940 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:13:05.442940 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:05.443103 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:13:05.443299 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0313(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:13:05.443451 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:13:05.448109 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b] added
May 28 10:13:05.448109 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:13:05.448109 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:13:05.448109 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:13:05.448109 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:13:05.448109 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:13:05.448109 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:05.448406 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:13:05.448623 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0358(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:13:05.448818 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:13:05.959068 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:05.989442 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:06.010053 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:06.015582 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:06.204785 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-de9f35c2-8ca0-4110-a949-6c8a4563ca26 req-c320cbf6-85bf-4300-8700-16a5bb6c2136 service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Received event network-vif-unplugged-04633d7b-a11f-4e7a-bd98-683a082e8a73 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:13:06.204785 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-de9f35c2-8ca0-4110-a949-6c8a4563ca26 req-c320cbf6-85bf-4300-8700-16a5bb6c2136 service nova] Acquiring lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:06.206077 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-de9f35c2-8ca0-4110-a949-6c8a4563ca26 req-c320cbf6-85bf-4300-8700-16a5bb6c2136 service nova] Lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:06.206077 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-de9f35c2-8ca0-4110-a949-6c8a4563ca26 req-c320cbf6-85bf-4300-8700-16a5bb6c2136 service nova] Lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:06.206077 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-de9f35c2-8ca0-4110-a949-6c8a4563ca26 req-c320cbf6-85bf-4300-8700-16a5bb6c2136 service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] No waiting events found dispatching network-vif-unplugged-04633d7b-a11f-4e7a-bd98-683a082e8a73 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:13:06.206315 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-de9f35c2-8ca0-4110-a949-6c8a4563ca26 req-c320cbf6-85bf-4300-8700-16a5bb6c2136 service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Received unexpected event network-vif-unplugged-04633d7b-a11f-4e7a-bd98-683a082e8a73 for instance with vm_state active and task_state reboot_started.
May 28 10:13:06.301560 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999614892999944 future=<Future at 0x73c1fc5ed2b0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:13:06.444297 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:13:06.450410 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-988c82c3-1ef6-4341-9b41-e327620f46e4 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Instance shutdown successfully.
May 28 10:13:06.450835 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:13:06.459690 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:13:06.459690 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:13:06.467348 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:13:06.467348 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:06.479208 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:06.486808 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:06.497632 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:06.497632 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:06.497632 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:06.497632 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:06.497632 np0000001613 nova-compute[98321]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4066489-19a4-44b1-9f26-f1b7c8fbaa6d (non-flash)
May 28 10:13:06.497632 np0000001613 nova-compute[98321]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:06.497632 np0000001613 nova-compute[98321]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:06.497632 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:13:06.497888 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:06.497888 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:06.497888 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:06.497888 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:06.497888 np0000001613 nova-compute[98321]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4066489-19a4-44b1-9f26-f1b7c8fbaa6d (non-flash)
May 28 10:13:06.497888 np0000001613 nova-compute[98321]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:06.497888 np0000001613 nova-compute[98321]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:06.497888 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:13:06.507095 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:06.507095 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:06.507095 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:06.507095 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:06.507095 np0000001613 nova-compute[98321]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4066489-19a4-44b1-9f26-f1b7c8fbaa6d (non-flash)
May 28 10:13:06.507095 np0000001613 nova-compute[98321]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:06.507095 np0000001613 nova-compute[98321]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:06.507095 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:13:06.507425 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:06.507425 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:06.507425 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:06.507425 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:06.507425 np0000001613 nova-compute[98321]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4066489-19a4-44b1-9f26-f1b7c8fbaa6d (non-flash)
May 28 10:13:06.507425 np0000001613 nova-compute[98321]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:06.507425 np0000001613 nova-compute[98321]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:06.507425 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:13:06.543930 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b, portal: 192.168.40.100,3260]
May 28 10:13:06.543930 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b, portal: 192.168.40.100,3260] successful.
May 28 10:13:06.543930 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:06.559881 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:06.568070 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b, portal: 192.168.50.100,3260]
May 28 10:13:06.568070 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b, portal: 192.168.50.100,3260] successful.
May 28 10:13:06.568070 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:06.577310 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:06.577310 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:06.577310 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:06.577310 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:06.577310 np0000001613 nova-compute[98321]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4066489-19a4-44b1-9f26-f1b7c8fbaa6d (non-flash)
May 28 10:13:06.577310 np0000001613 nova-compute[98321]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:06.577310 np0000001613 nova-compute[98321]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:06.577310 np0000001613 nova-compute[98321]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b (non-flash)
May 28 10:13:06.577310 np0000001613 nova-compute[98321]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b (non-flash)
May 28 10:13:06.577310 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:13:06.577839 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:06.577839 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:06.577839 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:06.577839 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:06.577839 np0000001613 nova-compute[98321]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4066489-19a4-44b1-9f26-f1b7c8fbaa6d (non-flash)
May 28 10:13:06.577839 np0000001613 nova-compute[98321]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:06.577839 np0000001613 nova-compute[98321]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:06.577839 np0000001613 nova-compute[98321]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b (non-flash)
May 28 10:13:06.577839 np0000001613 nova-compute[98321]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b (non-flash)
May 28 10:13:06.577839 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:13:06.577839 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.166s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:13:06.578295 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:13:06.579232 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] HCTL ('11', '-', '-', 0) found on session 181 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:13:06.579373 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:13:06.585305 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:06.600561 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Searching for a device in session 181 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:13:06.600561 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e113d7a6-8f4b-466b-b6b9-4f417f99e99b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:13:06.609964 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:06.609964 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:06.609964 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:06.609964 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:06.609964 np0000001613 nova-compute[98321]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4066489-19a4-44b1-9f26-f1b7c8fbaa6d (non-flash)
May 28 10:13:06.609964 np0000001613 nova-compute[98321]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:06.609964 np0000001613 nova-compute[98321]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:06.609964 np0000001613 nova-compute[98321]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b (non-flash)
May 28 10:13:06.609964 np0000001613 nova-compute[98321]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b (non-flash)
May 28 10:13:06.609964 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:13:06.610789 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:06.610789 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:06.610789 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:06.610789 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:06.610789 np0000001613 nova-compute[98321]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4066489-19a4-44b1-9f26-f1b7c8fbaa6d (non-flash)
May 28 10:13:06.610789 np0000001613 nova-compute[98321]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:06.610789 np0000001613 nova-compute[98321]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:06.610789 np0000001613 nova-compute[98321]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b (non-flash)
May 28 10:13:06.610789 np0000001613 nova-compute[98321]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b (non-flash)
May 28 10:13:06.610789 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:13:06.610789 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.198s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:13:06.610789 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:13:06.612377 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] HCTL ('12', '-', '-', 0) found on session 182 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:13:06.612377 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:13:06.629593 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Searching for a device in session 182 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:13:06.629593 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e113d7a6-8f4b-466b-b6b9-4f417f99e99b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:13:06.841628 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:13:06.843258 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:13:06.843891 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.95 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:13:06.957233 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:06.989513 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:07.084462 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:07.315814 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:07.326890 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:07.413425 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:13:07.498968 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-295bb1bd-e943-458d-b16a-6129caaff136 req-cdcfa477-1183-483c-893a-ef19a4e89992 service nova] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Received event network-changed-8907c86c-3bc6-41a2-ace1-517b5a4a92d1 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:13:07.500004 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-295bb1bd-e943-458d-b16a-6129caaff136 req-cdcfa477-1183-483c-893a-ef19a4e89992 service nova] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Refreshing instance network info cache due to event network-changed-8907c86c-3bc6-41a2-ace1-517b5a4a92d1. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:13:07.500332 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-295bb1bd-e943-458d-b16a-6129caaff136 req-cdcfa477-1183-483c-893a-ef19a4e89992 service nova] Acquiring lock "refresh_cache-9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:13:07.500452 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-295bb1bd-e943-458d-b16a-6129caaff136 req-cdcfa477-1183-483c-893a-ef19a4e89992 service nova] Acquired lock "refresh_cache-9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:13:07.503358 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:07.503540 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-295bb1bd-e943-458d-b16a-6129caaff136 req-cdcfa477-1183-483c-893a-ef19a4e89992 service nova] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Refreshing network info cache for port 8907c86c-3bc6-41a2-ace1-517b5a4a92d1 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:13:07.526527 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:07.792260 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:13:07.792685 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.99 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:13:07.922684 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Removed pending STOPPED event for 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd due to new event <LifecycleEvent: 1779963187.922311, 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd => Resumed> {{(pid=98321) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 10:13:07.925157 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963187.922311, 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:13:07.925157 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] VM Resumed (Lifecycle Event)
May 28 10:13:07.930498 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Instance running successfully.
May 28 10:13:07.930990 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-988c82c3-1ef6-4341-9b41-e327620f46e4 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Instance soft rebooted successfully.
May 28 10:13:07.931214 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-988c82c3-1ef6-4341-9b41-e327620f46e4 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:13:08.009031 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-295bb1bd-e943-458d-b16a-6129caaff136 req-cdcfa477-1183-483c-893a-ef19a4e89992 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:13:08.281938 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f99bc790-3ecb-4864-9dcf-45cef37dcf2d req-42b9bde0-78a4-48be-841f-2bc7e1b6f279 service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Received event network-vif-unplugged-04633d7b-a11f-4e7a-bd98-683a082e8a73 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:13:08.282083 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f99bc790-3ecb-4864-9dcf-45cef37dcf2d req-42b9bde0-78a4-48be-841f-2bc7e1b6f279 service nova] Acquiring lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:08.282883 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f99bc790-3ecb-4864-9dcf-45cef37dcf2d req-42b9bde0-78a4-48be-841f-2bc7e1b6f279 service nova] Lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:08.282883 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f99bc790-3ecb-4864-9dcf-45cef37dcf2d req-42b9bde0-78a4-48be-841f-2bc7e1b6f279 service nova] Lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:08.282883 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f99bc790-3ecb-4864-9dcf-45cef37dcf2d req-42b9bde0-78a4-48be-841f-2bc7e1b6f279 service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] No waiting events found dispatching network-vif-unplugged-04633d7b-a11f-4e7a-bd98-683a082e8a73 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:13:08.282883 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-f99bc790-3ecb-4864-9dcf-45cef37dcf2d req-42b9bde0-78a4-48be-841f-2bc7e1b6f279 service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Received unexpected event network-vif-unplugged-04633d7b-a11f-4e7a-bd98-683a082e8a73 for instance with vm_state active and task_state None.
May 28 10:13:08.283419 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f99bc790-3ecb-4864-9dcf-45cef37dcf2d req-42b9bde0-78a4-48be-841f-2bc7e1b6f279 service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Received event network-vif-plugged-04633d7b-a11f-4e7a-bd98-683a082e8a73 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:13:08.283419 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f99bc790-3ecb-4864-9dcf-45cef37dcf2d req-42b9bde0-78a4-48be-841f-2bc7e1b6f279 service nova] Acquiring lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:08.283419 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f99bc790-3ecb-4864-9dcf-45cef37dcf2d req-42b9bde0-78a4-48be-841f-2bc7e1b6f279 service nova] Lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:08.283419 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f99bc790-3ecb-4864-9dcf-45cef37dcf2d req-42b9bde0-78a4-48be-841f-2bc7e1b6f279 service nova] Lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:08.283586 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f99bc790-3ecb-4864-9dcf-45cef37dcf2d req-42b9bde0-78a4-48be-841f-2bc7e1b6f279 service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] No waiting events found dispatching network-vif-plugged-04633d7b-a11f-4e7a-bd98-683a082e8a73 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:13:08.283635 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-f99bc790-3ecb-4864-9dcf-45cef37dcf2d req-42b9bde0-78a4-48be-841f-2bc7e1b6f279 service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Received unexpected event network-vif-plugged-04633d7b-a11f-4e7a-bd98-683a082e8a73 for instance with vm_state active and task_state None.
May 28 10:13:08.284475 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f99bc790-3ecb-4864-9dcf-45cef37dcf2d req-42b9bde0-78a4-48be-841f-2bc7e1b6f279 service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Received event network-vif-plugged-04633d7b-a11f-4e7a-bd98-683a082e8a73 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:13:08.284475 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f99bc790-3ecb-4864-9dcf-45cef37dcf2d req-42b9bde0-78a4-48be-841f-2bc7e1b6f279 service nova] Acquiring lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:08.284475 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f99bc790-3ecb-4864-9dcf-45cef37dcf2d req-42b9bde0-78a4-48be-841f-2bc7e1b6f279 service nova] Lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:08.284475 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f99bc790-3ecb-4864-9dcf-45cef37dcf2d req-42b9bde0-78a4-48be-841f-2bc7e1b6f279 service nova] Lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:08.284777 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f99bc790-3ecb-4864-9dcf-45cef37dcf2d req-42b9bde0-78a4-48be-841f-2bc7e1b6f279 service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] No waiting events found dispatching network-vif-plugged-04633d7b-a11f-4e7a-bd98-683a082e8a73 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:13:08.284877 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-f99bc790-3ecb-4864-9dcf-45cef37dcf2d req-42b9bde0-78a4-48be-841f-2bc7e1b6f279 service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Received unexpected event network-vif-plugged-04633d7b-a11f-4e7a-bd98-683a082e8a73 for instance with vm_state active and task_state None.
May 28 10:13:08.407090 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-295bb1bd-e943-458d-b16a-6129caaff136 req-cdcfa477-1183-483c-893a-ef19a4e89992 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:13:08.426759 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:13:08.430994 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:13:08.435067 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Found WWN 330000000e1336b07 for multipath device dm-1 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:13:08.436382 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.046s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:13:08.436382 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] <== connect_volume: return (3046ms) {'type': 'block', 'scsi_wwn': '330000000e1336b07', 'path': '/dev/dm-1', 'multipath_id': '330000000e1336b07'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:13:08.436382 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e1336b07', 'path': '/dev/dm-1', 'multipath_id': '330000000e1336b07'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:13:08.443090 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-988c82c3-1ef6-4341-9b41-e327620f46e4 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.754s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:08.446543 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lazy-loading 'flavor' on Instance uuid 8849d62e-d9a4-4285-95fc-0869cbf20b4c {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:13:08.570836 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-295bb1bd-e943-458d-b16a-6129caaff136 req-cdcfa477-1183-483c-893a-ef19a4e89992 service nova] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Updated VIF entry in instance network info cache for port 8907c86c-3bc6-41a2-ace1-517b5a4a92d1. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:13:08.571152 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-295bb1bd-e943-458d-b16a-6129caaff136 req-cdcfa477-1183-483c-893a-ef19a4e89992 service nova] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Updating instance_info_cache with network_info: [{"id": "8907c86c-3bc6-41a2-ace1-517b5a4a92d1", "address": "fa:16:3e:c4:aa:35", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8907c86c-3b", "ovs_interfaceid": "8907c86c-3bc6-41a2-ace1-517b5a4a92d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:13:08.935013 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963188.934486, 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:13:08.935251 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] VM Started (Lifecycle Event)
May 28 10:13:08.952326 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Attempting to attach volume e113d7a6-8f4b-466b-b6b9-4f417f99e99b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 10:13:08.956856 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] attach device xml: <disk type="block" device="disk">
May 28 10:13:08.956856 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:13:08.956856 np0000001613 nova-compute[98321]:   <alias name="ua-e113d7a6-8f4b-466b-b6b9-4f417f99e99b"/>
May 28 10:13:08.956856 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-1"/>
May 28 10:13:08.956856 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:13:08.956856 np0000001613 nova-compute[98321]:   <serial>e113d7a6-8f4b-466b-b6b9-4f417f99e99b</serial>
May 28 10:13:08.956856 np0000001613 nova-compute[98321]: </disk>
May 28 10:13:08.956856 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 10:13:09.074581 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-295bb1bd-e943-458d-b16a-6129caaff136 req-cdcfa477-1183-483c-893a-ef19a4e89992 service nova] Releasing lock "refresh_cache-9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:13:09.244455 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:13:09.371347 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:09.437967 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:13:09.441342 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:13:09.988382 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:10.136924 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:10.608468 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:13:10.611627 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:13:10.611627 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:13:10.611627 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] No VIF found with MAC fa:16:3e:86:53:88, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:13:10.787980 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:13:10.788348 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:13:12.189331 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-da6f5501-9cab-427d-bddb-c722a49bc904 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.491s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:12.728853 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0003718359998856613 future=<Future at 0x73c1f4209af0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:13:12.729381 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Emitting event <LifecycleEvent: 1779963177.7283735, 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:13:12.729536 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:13:12.729773 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] VM Stopped (Lifecycle Event)
May 28 10:13:12.730795 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=8.570352424999783 future=<Future at 0x73c1fc5ed2b0 state=cancelled>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:13:12.730880 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=8.57020301700004 future=<Future at 0x73c1fc5ed2b0 state=cancelled>) was cancelled while queued, skipping {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:13:12.730956 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:13:13.233063 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-b91732d3-6b7c-46de-9f44-2d14b29c1229 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 38f3b3c0-01a0-442c-8c51-ad8f8e32aa7f] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:13:13.706609 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:14.373182 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:14.990089 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:15.896498 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Acquiring lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:15.896813 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:16.399349 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Detaching volume e113d7a6-8f4b-466b-b6b9-4f417f99e99b
May 28 10:13:16.445536 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Attempting to driver detach volume e113d7a6-8f4b-466b-b6b9-4f417f99e99b from mountpoint /dev/vdb
May 28 10:13:16.453447 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Found disk vdb by alias ua-e113d7a6-8f4b-466b-b6b9-4f417f99e99b {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:13:16.454692 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Found disk vdb by alias ua-e113d7a6-8f4b-466b-b6b9-4f417f99e99b {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:13:16.454816 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Attempting to detach device vdb from instance 8849d62e-d9a4-4285-95fc-0869cbf20b4c from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 10:13:16.455024 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:13:16.455024 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:13:16.455024 np0000001613 nova-compute[98321]:   <alias name="ua-e113d7a6-8f4b-466b-b6b9-4f417f99e99b"/>
May 28 10:13:16.455024 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-1"/>
May 28 10:13:16.455024 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:13:16.455024 np0000001613 nova-compute[98321]:   <serial>e113d7a6-8f4b-466b-b6b9-4f417f99e99b</serial>
May 28 10:13:16.455024 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:13:16.455024 np0000001613 nova-compute[98321]: </disk>
May 28 10:13:16.455024 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:13:16.462576 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Successfully detached device vdb from instance 8849d62e-d9a4-4285-95fc-0869cbf20b4c from the persistent domain config.
May 28 10:13:16.462736 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] (1/8): Attempting to detach device vdb with device alias ua-e113d7a6-8f4b-466b-b6b9-4f417f99e99b from instance 8849d62e-d9a4-4285-95fc-0869cbf20b4c from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 10:13:16.462973 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:13:16.462973 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:13:16.462973 np0000001613 nova-compute[98321]:   <alias name="ua-e113d7a6-8f4b-466b-b6b9-4f417f99e99b"/>
May 28 10:13:16.462973 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-1"/>
May 28 10:13:16.462973 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:13:16.462973 np0000001613 nova-compute[98321]:   <serial>e113d7a6-8f4b-466b-b6b9-4f417f99e99b</serial>
May 28 10:13:16.462973 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:13:16.462973 np0000001613 nova-compute[98321]: </disk>
May 28 10:13:16.462973 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:13:16.622838 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:16.989559 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779963196.9890091, 8849d62e-d9a4-4285-95fc-0869cbf20b4c => ua-e113d7a6-8f4b-466b-b6b9-4f417f99e99b> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 10:13:16.990926 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-e113d7a6-8f4b-466b-b6b9-4f417f99e99b for instance 8849d62e-d9a4-4285-95fc-0869cbf20b4c {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 10:13:16.994635 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Successfully detached device vdb from instance 8849d62e-d9a4-4285-95fc-0869cbf20b4c from the live domain config.
May 28 10:13:16.997074 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:13:16.997074 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b', 'iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e113d7a6-8f4b-466b-b6b9-4f417f99e99b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:13:16.997074 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:13:16.997074 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:13:16.997074 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b', 'iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e113d7a6-8f4b-466b-b6b9-4f417f99e99b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:13:16.997074 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:13:17.027906 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:17.027906 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:17.027906 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:17.027906 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:17.027906 np0000001613 nova-compute[98321]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:17.027906 np0000001613 nova-compute[98321]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:17.027906 np0000001613 nova-compute[98321]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b (non-flash)
May 28 10:13:17.027906 np0000001613 nova-compute[98321]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b (non-flash)
May 28 10:13:17.027906 np0000001613 nova-compute[98321]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-972b12ec-4bdc-4796-8d98-a4ce035caa1a (non-flash)
May 28 10:13:17.027906 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:13:17.031136 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:17.031136 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:17.031136 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:17.031136 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:17.031136 np0000001613 nova-compute[98321]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:17.031136 np0000001613 nova-compute[98321]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:17.031136 np0000001613 nova-compute[98321]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b (non-flash)
May 28 10:13:17.031136 np0000001613 nova-compute[98321]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b (non-flash)
May 28 10:13:17.031136 np0000001613 nova-compute[98321]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-972b12ec-4bdc-4796-8d98-a4ce035caa1a (non-flash)
May 28 10:13:17.031136 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:13:17.031136 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a', '170'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a', '171'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', '176'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', '177'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', '179'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', '180'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b', '181'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b', '182'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-972b12ec-4bdc-4796-8d98-a4ce035caa1a', '183')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:13:17.031136 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b', '181')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:13:17.031136 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b', '182')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:13:17.031136 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc4705e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b'): ({'sdg'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:13:17.031136 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Removing multipathed devices sdf, sdg {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:13:17.031136 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Flush multipath device 330000000e1336b07 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:13:17.070253 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:13:17.129978 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:13:17.183641 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:13:17.183641 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:13:17.183641 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:13:17.194727 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:13:17.194727 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:13:17.211399 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:17.247648 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 181, target: iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b, portal: 192.168.40.100,3260]
May 28 10:13:17.247648 np0000001613 nova-compute[98321]: Logout of [sid: 181, target: iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b, portal: 192.168.40.100,3260] successful.
May 28 10:13:17.247648 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:17.273707 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:17.287157 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:17.326063 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 182, target: iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b, portal: 192.168.50.100,3260]
May 28 10:13:17.326063 np0000001613 nova-compute[98321]: Logout of [sid: 182, target: iqn.2023-03.storpool.com:os--volume-e113d7a6-8f4b-466b-b6b9-4f417f99e99b, portal: 192.168.50.100,3260] successful.
May 28 10:13:17.326063 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:17.347489 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:17.351156 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:13:17.351156 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] <== disconnect_volume: return (351ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:13:17.351156 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:13:17.900315 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lazy-loading 'flavor' on Instance uuid 8849d62e-d9a4-4285-95fc-0869cbf20b4c {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:13:18.906507 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-d7a1bdc5-03f0-4a28-9284-596d2ffa5ad2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.010s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:19.094828 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:19.375481 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:19.996925 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:20.477619 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Acquiring lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:20.477915 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:20.981244 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lazy-loading 'flavor' on Instance uuid 8849d62e-d9a4-4285-95fc-0869cbf20b4c {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:13:21.284261 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Acquiring lock "405de22b-28c5-4415-ad12-e7e8eae4d591" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:21.284756 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "405de22b-28c5-4415-ad12-e7e8eae4d591" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:21.789265 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lazy-loading 'flavor' on Instance uuid 405de22b-28c5-4415-ad12-e7e8eae4d591 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:13:21.986844 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:22.293179 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Ignoring supplied device name: /dev/vdb
May 28 10:13:22.604618 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Acquiring lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:22.605293 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:22.796410 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "405de22b-28c5-4415-ad12-e7e8eae4d591" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:23.078532 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Acquiring lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:23.078532 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:23.078532 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Attaching volume 6c684650-f91b-4888-a081-1cd18e3a9dc9 to /dev/vdb
May 28 10:13:23.109680 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:13:23.132465 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:13:23.151403 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:13:23.177526 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:13:23.220361 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:13:23.220741 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:13:23.230189 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:13:23.231712 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe86:5388', 'fe80::5c44:a2ff:fe78:6c5f', 'fe80::fc16:3eff:fe28:366', 'fe80::8cd1:81ff:fea1:944', 'fe80::fc16:3eff:fe49:8be9', 'fe80::2c59:8cff:fea1:3a8', 'fe80::fc16:3eff:fec4:aa35', 'fe80::e4eb:4cff:fe5c:5eb7', 'fe80::fc16:3eff:fef0:49ef', 'fe80::e03f:79ff:fe2f:2d97'] 
May 28 10:13:23.231919 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:13:23.232081 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:13:23.232388 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] <== get_connector_properties: return (99ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:13:23.232700 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Updating existing volume attachment record: f6b9ef1a-0c8f-4bfa-ac16-dd5d74aa6926 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:13:23.672794 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:23.673242 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:23.679836 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:13:23.679990 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Claim successful on node np0000001613
May 28 10:13:23.780710 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:13:23.781020 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9', 'iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6c684650-f91b-4888-a081-1cd18e3a9dc9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:13:23.781217 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:13:23.781687 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:13:23.781911 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9', 'iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6c684650-f91b-4888-a081-1cd18e3a9dc9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:13:23.794956 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:13:23.795830 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:13:23.797014 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:13:23.797292 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:13:23.797752 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:13:23.798033 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:13:23.813664 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:13:23.813664 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:23.820306 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:13:23.820306 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:23.825608 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9] added
May 28 10:13:23.825608 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:13:23.825608 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:13:23.825608 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:13:23.825608 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:13:23.825608 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:13:23.825608 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:23.826110 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:13:23.826110 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.028(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:13:23.826210 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:13:23.831902 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9] added
May 28 10:13:23.831902 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:13:23.831902 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:13:23.831902 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:13:23.831902 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:13:23.831902 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:13:23.831902 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:23.832355 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:13:23.832457 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0352(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:13:23.832603 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:13:23.858521 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Acquiring lock "405de22b-28c5-4415-ad12-e7e8eae4d591" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:23.858693 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "405de22b-28c5-4415-ad12-e7e8eae4d591" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:23.858885 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Attaching volume 1e8b72e7-e848-45da-9947-b52bba91c8f0 to /dev/vdb
May 28 10:13:23.896963 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:13:23.909250 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:13:23.931752 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:13:23.975324 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:13:23.975392 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:13:23.984786 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:13:23.987088 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe86:5388', 'fe80::5c44:a2ff:fe78:6c5f', 'fe80::fc16:3eff:fe28:366', 'fe80::8cd1:81ff:fea1:944', 'fe80::fc16:3eff:fe49:8be9', 'fe80::2c59:8cff:fea1:3a8', 'fe80::fc16:3eff:fec4:aa35', 'fe80::e4eb:4cff:fe5c:5eb7', 'fe80::fc16:3eff:fef0:49ef', 'fe80::e03f:79ff:fe2f:2d97'] 
May 28 10:13:23.987088 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:13:23.987088 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:13:23.987088 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] <== get_connector_properties: return (89ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:13:23.987088 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Updating existing volume attachment record: 8d088914-6828-4d3a-9b85-1f13cce0df7c {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:13:24.375876 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:24.544095 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:13:24.544740 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0', 'iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1e8b72e7-e848-45da-9947-b52bba91c8f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:13:24.544740 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:13:24.826818 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:13:24.833489 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:13:24.843750 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:13:24.843750 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:13:24.854300 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:13:24.854300 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:24.864503 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:24.876895 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:24.885650 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:24.885650 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:24.885650 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:24.885650 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:24.885650 np0000001613 nova-compute[98321]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:24.885650 np0000001613 nova-compute[98321]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:24.885650 np0000001613 nova-compute[98321]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-972b12ec-4bdc-4796-8d98-a4ce035caa1a (non-flash)
May 28 10:13:24.885650 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:13:24.886249 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:24.886249 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:24.886249 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:24.886249 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:24.886249 np0000001613 nova-compute[98321]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:24.886249 np0000001613 nova-compute[98321]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:24.886249 np0000001613 nova-compute[98321]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-972b12ec-4bdc-4796-8d98-a4ce035caa1a (non-flash)
May 28 10:13:24.886249 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:13:24.899693 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:24.899693 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:24.899693 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:24.899693 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:24.899693 np0000001613 nova-compute[98321]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:24.899693 np0000001613 nova-compute[98321]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:24.899693 np0000001613 nova-compute[98321]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-972b12ec-4bdc-4796-8d98-a4ce035caa1a (non-flash)
May 28 10:13:24.899693 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:13:24.899963 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:24.899963 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:24.899963 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:24.899963 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:24.899963 np0000001613 nova-compute[98321]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:24.899963 np0000001613 nova-compute[98321]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:24.899963 np0000001613 nova-compute[98321]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-972b12ec-4bdc-4796-8d98-a4ce035caa1a (non-flash)
May 28 10:13:24.899963 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:13:24.935738 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9, portal: 192.168.50.100,3260]
May 28 10:13:24.935738 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9, portal: 192.168.50.100,3260] successful.
May 28 10:13:24.935738 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:24.947472 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:24.957559 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9, portal: 192.168.40.100,3260]
May 28 10:13:24.957559 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9, portal: 192.168.40.100,3260] successful.
May 28 10:13:24.957559 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:24.964975 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:24.964975 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:24.964975 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:24.964975 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:24.964975 np0000001613 nova-compute[98321]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:24.964975 np0000001613 nova-compute[98321]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:24.964975 np0000001613 nova-compute[98321]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-972b12ec-4bdc-4796-8d98-a4ce035caa1a (non-flash)
May 28 10:13:24.964975 np0000001613 nova-compute[98321]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9 (non-flash)
May 28 10:13:24.964975 np0000001613 nova-compute[98321]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9 (non-flash)
May 28 10:13:24.964975 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:13:24.965256 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:24.965256 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:24.965256 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:24.965256 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:24.965256 np0000001613 nova-compute[98321]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:24.965256 np0000001613 nova-compute[98321]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:24.965256 np0000001613 nova-compute[98321]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-972b12ec-4bdc-4796-8d98-a4ce035caa1a (non-flash)
May 28 10:13:24.965256 np0000001613 nova-compute[98321]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9 (non-flash)
May 28 10:13:24.965256 np0000001613 nova-compute[98321]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9 (non-flash)
May 28 10:13:24.965256 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:13:24.965496 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:13:24.965612 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:13:24.966556 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] HCTL ('11', '-', '-', 0) found on session 184 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:13:24.966669 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:13:24.971635 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:24.984711 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Searching for a device in session 184 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:13:24.984992 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6c684650-f91b-4888-a081-1cd18e3a9dc9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:13:24.992590 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:24.992590 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:24.992590 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:24.992590 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:24.992590 np0000001613 nova-compute[98321]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:24.992590 np0000001613 nova-compute[98321]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:24.992590 np0000001613 nova-compute[98321]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-972b12ec-4bdc-4796-8d98-a4ce035caa1a (non-flash)
May 28 10:13:24.992590 np0000001613 nova-compute[98321]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9 (non-flash)
May 28 10:13:24.992590 np0000001613 nova-compute[98321]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9 (non-flash)
May 28 10:13:24.992590 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:13:24.992881 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:24.992881 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:24.992881 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:24.992881 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:24.992881 np0000001613 nova-compute[98321]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:24.992881 np0000001613 nova-compute[98321]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:24.992881 np0000001613 nova-compute[98321]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-972b12ec-4bdc-4796-8d98-a4ce035caa1a (non-flash)
May 28 10:13:24.992881 np0000001613 nova-compute[98321]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9 (non-flash)
May 28 10:13:24.992881 np0000001613 nova-compute[98321]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9 (non-flash)
May 28 10:13:24.992881 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:13:24.993237 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.197s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:13:24.993398 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:13:24.995278 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] HCTL ('12', '-', '-', 0) found on session 185 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:13:24.995278 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:13:24.998879 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:25.013710 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Searching for a device in session 185 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:13:25.013935 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6c684650-f91b-4888-a081-1cd18e3a9dc9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:13:25.129848 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:13:25.130365 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:13:25.634351 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:13:25.798120 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:13:26.144507 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.471s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:26.144874 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:13:26.651429 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:13:26.651675 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:13:26.652093 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:13:26.652544 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:13:26.746294 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3af73fcd68ed467c88011baf26231cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4005d70969740a687a13ecb27e151a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:13:26.816333 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Found WWN 3300000003adcbc56 for multipath device dm-1 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:13:26.816595 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:13:26.816745 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '3300000003adcbc56', 'path': '/dev/dm-1', 'multipath_id': '3300000003adcbc56'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:13:26.816861 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003adcbc56', 'path': '/dev/dm-1', 'multipath_id': '3300000003adcbc56'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:13:26.817328 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.273s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:13:26.817613 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0', 'iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1e8b72e7-e848-45da-9947-b52bba91c8f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:13:26.823104 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lazy-loading 'flavor' on Instance uuid 8849d62e-d9a4-4285-95fc-0869cbf20b4c {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:13:26.829950 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:13:26.830764 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:13:26.831625 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:13:26.831625 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:13:26.831941 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:13:26.832224 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:13:26.845217 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:13:26.845217 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:26.851511 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:13:26.851511 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:26.859672 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0] added
May 28 10:13:26.859672 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:13:26.859672 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:13:26.859672 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:13:26.859672 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:13:26.859672 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:13:26.859672 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:26.859939 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:13:26.860146 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0286(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:13:26.860471 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:13:26.864435 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0] added
May 28 10:13:26.864435 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:13:26.864435 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:13:26.864435 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:13:26.864435 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:13:26.864435 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:13:26.864435 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:26.865811 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:13:26.866097 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0338(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:13:26.866342 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:13:27.155439 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:13:27.327460 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Attempting to attach volume 6c684650-f91b-4888-a081-1cd18e3a9dc9 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 10:13:27.329210 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] attach device xml: <disk type="block" device="disk">
May 28 10:13:27.329210 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:13:27.329210 np0000001613 nova-compute[98321]:   <alias name="ua-6c684650-f91b-4888-a081-1cd18e3a9dc9"/>
May 28 10:13:27.329210 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-1"/>
May 28 10:13:27.329210 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:13:27.329210 np0000001613 nova-compute[98321]:   <serial>6c684650-f91b-4888-a081-1cd18e3a9dc9</serial>
May 28 10:13:27.329210 np0000001613 nova-compute[98321]: </disk>
May 28 10:13:27.329210 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 10:13:27.362079 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Successfully created port: 503fc02b-83eb-415b-8439-c6b3c2175ae2 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:13:27.659606 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:13:27.860870 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:13:27.866664 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:13:27.875436 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:13:27.875436 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:13:27.881323 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:13:27.881323 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:27.890985 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:27.899751 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:27.913482 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Successfully updated port: 503fc02b-83eb-415b-8439-c6b3c2175ae2 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:13:27.914786 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:27.914786 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:27.914786 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:27.914786 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:27.914786 np0000001613 nova-compute[98321]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:27.914786 np0000001613 nova-compute[98321]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:27.914786 np0000001613 nova-compute[98321]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-972b12ec-4bdc-4796-8d98-a4ce035caa1a (non-flash)
May 28 10:13:27.914786 np0000001613 nova-compute[98321]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9 (non-flash)
May 28 10:13:27.914786 np0000001613 nova-compute[98321]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9 (non-flash)
May 28 10:13:27.914786 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:13:27.915051 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:27.915051 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:27.915051 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:27.915051 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:27.915051 np0000001613 nova-compute[98321]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:27.915051 np0000001613 nova-compute[98321]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:27.915051 np0000001613 nova-compute[98321]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-972b12ec-4bdc-4796-8d98-a4ce035caa1a (non-flash)
May 28 10:13:27.915051 np0000001613 nova-compute[98321]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9 (non-flash)
May 28 10:13:27.915051 np0000001613 nova-compute[98321]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9 (non-flash)
May 28 10:13:27.915051 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:13:27.919850 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:27.919850 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:27.919850 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:27.919850 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:27.919850 np0000001613 nova-compute[98321]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:27.919850 np0000001613 nova-compute[98321]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:27.919850 np0000001613 nova-compute[98321]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-972b12ec-4bdc-4796-8d98-a4ce035caa1a (non-flash)
May 28 10:13:27.919850 np0000001613 nova-compute[98321]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9 (non-flash)
May 28 10:13:27.919850 np0000001613 nova-compute[98321]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9 (non-flash)
May 28 10:13:27.919850 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:13:27.920245 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:27.920245 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:27.920245 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:27.920245 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:27.920245 np0000001613 nova-compute[98321]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:27.920245 np0000001613 nova-compute[98321]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:27.920245 np0000001613 nova-compute[98321]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-972b12ec-4bdc-4796-8d98-a4ce035caa1a (non-flash)
May 28 10:13:27.920245 np0000001613 nova-compute[98321]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9 (non-flash)
May 28 10:13:27.920245 np0000001613 nova-compute[98321]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9 (non-flash)
May 28 10:13:27.920245 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:13:27.963595 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-279280c7-e07f-40be-95ce-9f36a651e351 req-fc2158f0-c9db-46bb-b8be-b2a9d06db739 service nova] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Received event network-changed-503fc02b-83eb-415b-8439-c6b3c2175ae2 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:13:27.963595 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-279280c7-e07f-40be-95ce-9f36a651e351 req-fc2158f0-c9db-46bb-b8be-b2a9d06db739 service nova] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Refreshing instance network info cache due to event network-changed-503fc02b-83eb-415b-8439-c6b3c2175ae2. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:13:27.963796 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-279280c7-e07f-40be-95ce-9f36a651e351 req-fc2158f0-c9db-46bb-b8be-b2a9d06db739 service nova] Acquiring lock "refresh_cache-0cffddf7-ea43-43a0-83c1-6bddb8e42884" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:13:27.963905 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-279280c7-e07f-40be-95ce-9f36a651e351 req-fc2158f0-c9db-46bb-b8be-b2a9d06db739 service nova] Acquired lock "refresh_cache-0cffddf7-ea43-43a0-83c1-6bddb8e42884" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:13:27.964014 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-279280c7-e07f-40be-95ce-9f36a651e351 req-fc2158f0-c9db-46bb-b8be-b2a9d06db739 service nova] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Refreshing network info cache for port 503fc02b-83eb-415b-8439-c6b3c2175ae2 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:13:27.970030 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0, portal: 192.168.50.100,3260]
May 28 10:13:27.970030 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0, portal: 192.168.50.100,3260] successful.
May 28 10:13:27.970030 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:27.976970 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0, portal: 192.168.40.100,3260]
May 28 10:13:27.976970 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0, portal: 192.168.40.100,3260] successful.
May 28 10:13:27.976970 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:27.982467 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:27.992709 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:28.004960 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:28.004960 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:28.004960 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:28.004960 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:28.004960 np0000001613 nova-compute[98321]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:28.004960 np0000001613 nova-compute[98321]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:28.004960 np0000001613 nova-compute[98321]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-972b12ec-4bdc-4796-8d98-a4ce035caa1a (non-flash)
May 28 10:13:28.004960 np0000001613 nova-compute[98321]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9 (non-flash)
May 28 10:13:28.004960 np0000001613 nova-compute[98321]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9 (non-flash)
May 28 10:13:28.004960 np0000001613 nova-compute[98321]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0 (non-flash)
May 28 10:13:28.004960 np0000001613 nova-compute[98321]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0 (non-flash)
May 28 10:13:28.004960 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:13:28.005587 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:28.005587 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:28.005587 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:28.005587 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:28.005587 np0000001613 nova-compute[98321]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:28.005587 np0000001613 nova-compute[98321]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:28.005587 np0000001613 nova-compute[98321]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-972b12ec-4bdc-4796-8d98-a4ce035caa1a (non-flash)
May 28 10:13:28.005587 np0000001613 nova-compute[98321]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9 (non-flash)
May 28 10:13:28.005587 np0000001613 nova-compute[98321]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9 (non-flash)
May 28 10:13:28.005587 np0000001613 nova-compute[98321]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0 (non-flash)
May 28 10:13:28.005587 np0000001613 nova-compute[98321]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0 (non-flash)
May 28 10:13:28.005587 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:13:28.005587 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.174s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:13:28.006312 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:13:28.006849 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] HCTL ('16', '-', '-', 0) found on session 186 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:13:28.006979 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:13:28.013809 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:28.013809 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:28.013809 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:28.013809 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:28.013809 np0000001613 nova-compute[98321]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:28.013809 np0000001613 nova-compute[98321]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:28.013809 np0000001613 nova-compute[98321]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-972b12ec-4bdc-4796-8d98-a4ce035caa1a (non-flash)
May 28 10:13:28.013809 np0000001613 nova-compute[98321]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9 (non-flash)
May 28 10:13:28.013809 np0000001613 nova-compute[98321]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9 (non-flash)
May 28 10:13:28.013809 np0000001613 nova-compute[98321]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0 (non-flash)
May 28 10:13:28.013809 np0000001613 nova-compute[98321]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0 (non-flash)
May 28 10:13:28.013809 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:13:28.014263 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:28.014263 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:28.014263 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:28.014263 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:28.014263 np0000001613 nova-compute[98321]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:28.014263 np0000001613 nova-compute[98321]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:28.014263 np0000001613 nova-compute[98321]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-972b12ec-4bdc-4796-8d98-a4ce035caa1a (non-flash)
May 28 10:13:28.014263 np0000001613 nova-compute[98321]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9 (non-flash)
May 28 10:13:28.014263 np0000001613 nova-compute[98321]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9 (non-flash)
May 28 10:13:28.014263 np0000001613 nova-compute[98321]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0 (non-flash)
May 28 10:13:28.014263 np0000001613 nova-compute[98321]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0 (non-flash)
May 28 10:13:28.014263 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:13:28.014263 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.183s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:13:28.014650 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:13:28.015283 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] HCTL ('17', '-', '-', 0) found on session 187 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:13:28.015381 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:13:28.022277 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Searching for a device in session 186 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:13:28.022546 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '1e8b72e7-e848-45da-9947-b52bba91c8f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:13:28.032929 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Searching for a device in session 187 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:13:28.032929 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1e8b72e7-e848-45da-9947-b52bba91c8f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:13:28.415984 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Acquiring lock "refresh_cache-0cffddf7-ea43-43a0-83c1-6bddb8e42884" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:13:28.466905 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-279280c7-e07f-40be-95ce-9f36a651e351 req-fc2158f0-c9db-46bb-b8be-b2a9d06db739 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:13:28.551434 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-279280c7-e07f-40be-95ce-9f36a651e351 req-fc2158f0-c9db-46bb-b8be-b2a9d06db739 service nova] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:13:28.669424 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:13:28.670486 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:13:28.670746 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Creating image(s)
May 28 10:13:28.671259 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Acquiring lock "/opt/stack/data/nova/instances/0cffddf7-ea43-43a0-83c1-6bddb8e42884/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:28.672070 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "/opt/stack/data/nova/instances/0cffddf7-ea43-43a0-83c1-6bddb8e42884/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:28.672540 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "/opt/stack/data/nova/instances/0cffddf7-ea43-43a0-83c1-6bddb8e42884/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:28.673134 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:13:28.676679 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:13:28.677712 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:13:28.695092 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-279280c7-e07f-40be-95ce-9f36a651e351 req-fc2158f0-c9db-46bb-b8be-b2a9d06db739 service nova] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:13:28.768448 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.091s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:13:28.768929 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:28.769488 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:28.770213 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:13:28.774325 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:13:28.774760 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:13:28.835402 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:13:28.886550 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.112s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:13:28.887049 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/0cffddf7-ea43-43a0-83c1-6bddb8e42884/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:13:28.953081 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/0cffddf7-ea43-43a0-83c1-6bddb8e42884/disk 1073741824" returned: 0 in 0.066s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:13:28.953760 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.184s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:28.954427 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:13:29.004140 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:13:29.004353 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:13:29.004555 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:13:29.004722 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] No VIF found with MAC fa:16:3e:86:53:88, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:13:29.049438 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.095s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:13:29.049856 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0cffddf7-ea43-43a0-83c1-6bddb8e42884/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:13:29.050334 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cffddf7-ea43-43a0-83c1-6bddb8e42884/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:13:29.135763 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cffddf7-ea43-43a0-83c1-6bddb8e42884/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:13:29.136136 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Cannot resize image /opt/stack/data/nova/instances/0cffddf7-ea43-43a0-83c1-6bddb8e42884/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:13:29.136586 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:13:29.136789 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Ensure instance console log exists: /opt/stack/data/nova/instances/0cffddf7-ea43-43a0-83c1-6bddb8e42884/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:13:29.137194 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:29.137420 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:29.137564 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:29.198796 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-279280c7-e07f-40be-95ce-9f36a651e351 req-fc2158f0-c9db-46bb-b8be-b2a9d06db739 service nova] Releasing lock "refresh_cache-0cffddf7-ea43-43a0-83c1-6bddb8e42884" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:13:29.199380 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Acquired lock "refresh_cache-0cffddf7-ea43-43a0-83c1-6bddb8e42884" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:13:29.199551 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:13:29.377494 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:29.781396 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:13:29.855230 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Found WWN 330000000924ef8ee for multipath device dm-8 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:13:29.855563 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:13:29.855775 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] <== connect_volume: return (5311ms) {'type': 'block', 'scsi_wwn': '330000000924ef8ee', 'path': '/dev/dm-8', 'multipath_id': '330000000924ef8ee'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:13:29.855896 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000924ef8ee', 'path': '/dev/dm-8', 'multipath_id': '330000000924ef8ee'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:13:29.860033 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lazy-loading 'flavor' on Instance uuid 405de22b-28c5-4415-ad12-e7e8eae4d591 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:13:29.956639 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:13:29.998342 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:30.120816 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Updating instance_info_cache with network_info: [{"id": "503fc02b-83eb-415b-8439-c6b3c2175ae2", "address": "fa:16:3e:57:fe:26", "network": {"id": "ddadd9b9-c8a6-4280-b1e1-fdd193bdceca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1440559780-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f4005d70969740a687a13ecb27e151a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap503fc02b-83", "ovs_interfaceid": "503fc02b-83eb-415b-8439-c6b3c2175ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:13:30.362874 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Attempting to attach volume 1e8b72e7-e848-45da-9947-b52bba91c8f0 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 10:13:30.365806 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] attach device xml: <disk type="block" device="disk">
May 28 10:13:30.365806 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:13:30.365806 np0000001613 nova-compute[98321]:   <alias name="ua-1e8b72e7-e848-45da-9947-b52bba91c8f0"/>
May 28 10:13:30.365806 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-8"/>
May 28 10:13:30.365806 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:13:30.365806 np0000001613 nova-compute[98321]:   <serial>1e8b72e7-e848-45da-9947-b52bba91c8f0</serial>
May 28 10:13:30.365806 np0000001613 nova-compute[98321]: </disk>
May 28 10:13:30.365806 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 10:13:30.565021 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-66e577bc-7bc2-48a0-b559-eebff71a6f03 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.487s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:30.625438 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Releasing lock "refresh_cache-0cffddf7-ea43-43a0-83c1-6bddb8e42884" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:13:30.625711 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Instance network_info: |[{"id": "503fc02b-83eb-415b-8439-c6b3c2175ae2", "address": "fa:16:3e:57:fe:26", "network": {"id": "ddadd9b9-c8a6-4280-b1e1-fdd193bdceca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1440559780-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f4005d70969740a687a13ecb27e151a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap503fc02b-83", "ovs_interfaceid": "503fc02b-83eb-415b-8439-c6b3c2175ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:13:30.627985 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Start _get_guest_xml network_info=[{"id": "503fc02b-83eb-415b-8439-c6b3c2175ae2", "address": "fa:16:3e:57:fe:26", "network": {"id": "ddadd9b9-c8a6-4280-b1e1-fdd193bdceca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1440559780-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f4005d70969740a687a13ecb27e151a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap503fc02b-83", "ovs_interfaceid": "503fc02b-83eb-415b-8439-c6b3c2175ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:13:30.631292 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:13:30.632832 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-TestServerVolumeAttachmentScenario-server-1318729689', uuid='0cffddf7-ea43-43a0-83c1-6bddb8e42884'), owner=OwnerMeta(userid='3af73fcd68ed467c88011baf26231cfa', username='tempest-TestServerVolumeAttachmentScenario-1785951-project-member', projectid='f4005d70969740a687a13ecb27e151a9', projectname='tempest-TestServerVolumeAttachmentScenario-1785951'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "503fc02b-83eb-415b-8439-c6b3c2175ae2", "address": "fa:16:3e:57:fe:26", "network": {"id": "ddadd9b9-c8a6-4280-b1e1-fdd193bdceca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1440559780-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f4005d70969740a687a13ecb27e151a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap503fc02b-83", "ovs_interfaceid": "503fc02b-83eb-415b-8439-c6b3c2175ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779963210.6324136) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:13:30.634645 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:13:30.635080 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:13:30.636293 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:13:30.636531 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:13:30.637774 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:13:30.638360 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:13:30.638596 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:13:30.638754 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:13:30.638960 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:13:30.639120 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:13:30.639318 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:13:30.639552 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:13:30.639753 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:13:30.639950 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:13:30.640155 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:13:30.640386 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:13:30.658666 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:13:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1318729689',display_name='tempest-TestServerVolumeAttachmentScenario-server-1318729689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testservervolumeattachmentscenario-server-1318729689',id=71,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaFBf4R9c2LdZoSSkm9VYg2GpV8qLgisD5C7HY4k4slCXz7cFsNsDyHcIu1y7Id99AEKS0y7ELMurrZgbfg9Gk2UbA1T25baKdd6fOkYKAfapq/iIIYLu6Zf4IAmGu9yA==',key_name='tempest-keypair-1065478257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4005d70969740a687a13ecb27e151a9',ramdisk_id='',reservation_id='r-cm3nioac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1785951',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1785951-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:13:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3af73fcd68ed467c88011baf26231cfa',uuid=0cffddf7-ea43-43a0-83c1-6bddb8e42884,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "503fc02b-83eb-415b-8439-c6b3c2175ae2", "address": "fa:16:3e:57:fe:26", "network": {"id": "ddadd9b9-c8a6-4280-b1e1-fdd193bdceca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1440559780-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f4005d70969740a687a13ecb27e151a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap503fc02b-83", "ovs_interfaceid": "503fc02b-83eb-415b-8439-c6b3c2175ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:13:30.659055 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Converting VIF {"id": "503fc02b-83eb-415b-8439-c6b3c2175ae2", "address": "fa:16:3e:57:fe:26", "network": {"id": "ddadd9b9-c8a6-4280-b1e1-fdd193bdceca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1440559780-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f4005d70969740a687a13ecb27e151a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap503fc02b-83", "ovs_interfaceid": "503fc02b-83eb-415b-8439-c6b3c2175ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:13:30.659922 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:fe:26,bridge_name='br-int',has_traffic_filtering=True,id=503fc02b-83eb-415b-8439-c6b3c2175ae2,network=Network(ddadd9b9-c8a6-4280-b1e1-fdd193bdceca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap503fc02b-83') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:13:30.660721 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lazy-loading 'pci_devices' on Instance uuid 0cffddf7-ea43-43a0-83c1-6bddb8e42884 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:13:31.163371 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] End _get_guest_xml xml=<domain type="qemu">
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:   <uuid>0cffddf7-ea43-43a0-83c1-6bddb8e42884</uuid>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:   <name>instance-00000047</name>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1318729689</nova:name>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:13:30</nova:creationTime>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:         <nova:user uuid="3af73fcd68ed467c88011baf26231cfa">tempest-TestServerVolumeAttachmentScenario-1785951-project-member</nova:user>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:         <nova:project uuid="f4005d70969740a687a13ecb27e151a9">tempest-TestServerVolumeAttachmentScenario-1785951</nova:project>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:         <nova:port uuid="503fc02b-83eb-415b-8439-c6b3c2175ae2">
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:     <system>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:       <entry name="serial">0cffddf7-ea43-43a0-83c1-6bddb8e42884</entry>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:       <entry name="uuid">0cffddf7-ea43-43a0-83c1-6bddb8e42884</entry>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:     </system>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:   <os>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:   </os>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:   <features>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:   </features>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:   <devices>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/0cffddf7-ea43-43a0-83c1-6bddb8e42884/disk"/>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:     </disk>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/0cffddf7-ea43-43a0-83c1-6bddb8e42884/disk.config"/>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:     </disk>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:57:fe:26"/>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:       <target dev="tap503fc02b-83"/>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:     </interface>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/0cffddf7-ea43-43a0-83c1-6bddb8e42884/console.log" append="off"/>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:     </serial>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:     <video>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:     </video>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:     </rng>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:   </devices>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]: </domain>
May 28 10:13:31.163371 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:13:31.166987 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Preparing to wait for external event network-vif-plugged-503fc02b-83eb-415b-8439-c6b3c2175ae2 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:13:31.166987 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Acquiring lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:31.166987 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:31.166987 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:31.166987 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:13:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1318729689',display_name='tempest-TestServerVolumeAttachmentScenario-server-1318729689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testservervolumeattachmentscenario-server-1318729689',id=71,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaFBf4R9c2LdZoSSkm9VYg2GpV8qLgisD5C7HY4k4slCXz7cFsNsDyHcIu1y7Id99AEKS0y7ELMurrZgbfg9Gk2UbA1T25baKdd6fOkYKAfapq/iIIYLu6Zf4IAmGu9yA==',key_name='tempest-keypair-1065478257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4005d70969740a687a13ecb27e151a9',ramdisk_id='',reservation_id='r-cm3nioac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1785951',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1785951-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:13:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3af73fcd68ed467c88011baf26231cfa',uuid=0cffddf7-ea43-43a0-83c1-6bddb8e42884,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "503fc02b-83eb-415b-8439-c6b3c2175ae2", "address": "fa:16:3e:57:fe:26", "network": {"id": "ddadd9b9-c8a6-4280-b1e1-fdd193bdceca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1440559780-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f4005d70969740a687a13ecb27e151a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap503fc02b-83", "ovs_interfaceid": "503fc02b-83eb-415b-8439-c6b3c2175ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:13:31.166987 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Converting VIF {"id": "503fc02b-83eb-415b-8439-c6b3c2175ae2", "address": "fa:16:3e:57:fe:26", "network": {"id": "ddadd9b9-c8a6-4280-b1e1-fdd193bdceca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1440559780-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f4005d70969740a687a13ecb27e151a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap503fc02b-83", "ovs_interfaceid": "503fc02b-83eb-415b-8439-c6b3c2175ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:13:31.166987 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:fe:26,bridge_name='br-int',has_traffic_filtering=True,id=503fc02b-83eb-415b-8439-c6b3c2175ae2,network=Network(ddadd9b9-c8a6-4280-b1e1-fdd193bdceca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap503fc02b-83') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:13:31.166987 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:fe:26,bridge_name='br-int',has_traffic_filtering=True,id=503fc02b-83eb-415b-8439-c6b3c2175ae2,network=Network(ddadd9b9-c8a6-4280-b1e1-fdd193bdceca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap503fc02b-83') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:13:31.166987 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:31.166987 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:13:31.167514 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:13:31.167860 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:31.168015 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '651969fe-68aa-51ee-964f-9963e13f5b0a', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:13:31.168820 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:31.169637 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:13:31.170788 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:31.172910 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:31.173078 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap503fc02b-83, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:13:31.173468 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap503fc02b-83, col_values=(('qos', UUID('740ddd64-001d-4bee-aba8-44d7e70ef424')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:13:31.173644 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap503fc02b-83, col_values=(('external_ids', {'iface-id': '503fc02b-83eb-415b-8439-c6b3c2175ae2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:fe:26', 'vm-uuid': '0cffddf7-ea43-43a0-83c1-6bddb8e42884'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:13:31.174821 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:31.175498 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:13:31.181082 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:31.182302 np0000001613 nova-compute[98321]: INFO os_vif [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:fe:26,bridge_name='br-int',has_traffic_filtering=True,id=503fc02b-83eb-415b-8439-c6b3c2175ae2,network=Network(ddadd9b9-c8a6-4280-b1e1-fdd193bdceca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap503fc02b-83')
May 28 10:13:32.013972 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:13:32.014221 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:13:32.014381 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:13:32.014509 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] No VIF found with MAC fa:16:3e:28:03:66, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:13:32.698926 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:13:32.701242 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:13:32.701242 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] No VIF found with MAC fa:16:3e:57:fe:26, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:13:32.701242 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Using config drive
May 28 10:13:33.208839 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:13:33.371194 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Creating config drive at /opt/stack/data/nova/instances/0cffddf7-ea43-43a0-83c1-6bddb8e42884/disk.config
May 28 10:13:33.374462 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0cffddf7-ea43-43a0-83c1-6bddb8e42884/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1kwe35ej {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:13:33.437399 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0cffddf7-ea43-43a0-83c1-6bddb8e42884/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1kwe35ej" returned: 0 in 0.063s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:13:33.565226 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0e6a670f-3215-4da0-9178-499a2633f2ee tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "405de22b-28c5-4415-ad12-e7e8eae4d591" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.706s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:33.857020 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:33.891680 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:33.985071 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:34.086012 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b96b9044-5851-4629-8b5f-5f7ac6a2edae req-ab8490cd-5320-4f85-8358-5c3f72ef3314 service nova] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Received event network-vif-plugged-503fc02b-83eb-415b-8439-c6b3c2175ae2 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:13:34.088082 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b96b9044-5851-4629-8b5f-5f7ac6a2edae req-ab8490cd-5320-4f85-8358-5c3f72ef3314 service nova] Acquiring lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:34.088082 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b96b9044-5851-4629-8b5f-5f7ac6a2edae req-ab8490cd-5320-4f85-8358-5c3f72ef3314 service nova] Lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:34.088352 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b96b9044-5851-4629-8b5f-5f7ac6a2edae req-ab8490cd-5320-4f85-8358-5c3f72ef3314 service nova] Lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:34.088496 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b96b9044-5851-4629-8b5f-5f7ac6a2edae req-ab8490cd-5320-4f85-8358-5c3f72ef3314 service nova] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Processing event network-vif-plugged-503fc02b-83eb-415b-8439-c6b3c2175ae2 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:13:34.286671 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:34.288906 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:34.292284 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:34.318553 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:34.587483 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Acquiring lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:34.587637 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:34.782763 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963214.7823699, 0cffddf7-ea43-43a0-83c1-6bddb8e42884 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:13:34.783929 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:13:34.784191 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] VM Started (Lifecycle Event)
May 28 10:13:34.787050 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:13:34.791309 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Instance spawned successfully.
May 28 10:13:34.791747 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:13:35.010954 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:35.090616 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Detaching volume 6c684650-f91b-4888-a081-1cd18e3a9dc9
May 28 10:13:35.138066 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Attempting to driver detach volume 6c684650-f91b-4888-a081-1cd18e3a9dc9 from mountpoint /dev/vdb
May 28 10:13:35.143902 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Found disk vdb by alias ua-6c684650-f91b-4888-a081-1cd18e3a9dc9 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:13:35.145064 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Found disk vdb by alias ua-6c684650-f91b-4888-a081-1cd18e3a9dc9 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:13:35.145195 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Attempting to detach device vdb from instance 8849d62e-d9a4-4285-95fc-0869cbf20b4c from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 10:13:35.145512 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:13:35.145512 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:13:35.145512 np0000001613 nova-compute[98321]:   <alias name="ua-6c684650-f91b-4888-a081-1cd18e3a9dc9"/>
May 28 10:13:35.145512 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-1"/>
May 28 10:13:35.145512 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:13:35.145512 np0000001613 nova-compute[98321]:   <serial>6c684650-f91b-4888-a081-1cd18e3a9dc9</serial>
May 28 10:13:35.145512 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:13:35.145512 np0000001613 nova-compute[98321]: </disk>
May 28 10:13:35.145512 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:13:35.152786 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Successfully detached device vdb from instance 8849d62e-d9a4-4285-95fc-0869cbf20b4c from the persistent domain config.
May 28 10:13:35.152846 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] (1/8): Attempting to detach device vdb with device alias ua-6c684650-f91b-4888-a081-1cd18e3a9dc9 from instance 8849d62e-d9a4-4285-95fc-0869cbf20b4c from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 10:13:35.153144 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:13:35.153144 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:13:35.153144 np0000001613 nova-compute[98321]:   <alias name="ua-6c684650-f91b-4888-a081-1cd18e3a9dc9"/>
May 28 10:13:35.153144 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-1"/>
May 28 10:13:35.153144 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:13:35.153144 np0000001613 nova-compute[98321]:   <serial>6c684650-f91b-4888-a081-1cd18e3a9dc9</serial>
May 28 10:13:35.153144 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:13:35.153144 np0000001613 nova-compute[98321]: </disk>
May 28 10:13:35.153144 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:13:35.288003 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:13:35.291759 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:13:35.305274 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:13:35.305496 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:13:35.305976 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:13:35.306590 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:13:35.307074 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:13:35.307513 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:13:35.694740 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-6c684650-f91b-4888-a081-1cd18e3a9dc9 for instance 8849d62e-d9a4-4285-95fc-0869cbf20b4c {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 10:13:35.795861 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:13:35.796242 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963215.7959652, 0cffddf7-ea43-43a0-83c1-6bddb8e42884 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:13:35.796575 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] VM Paused (Lifecycle Event)
May 28 10:13:35.812858 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Took 7.14 seconds to spawn the instance on the hypervisor.
May 28 10:13:35.813004 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:13:36.160656 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-aa48c132-24fa-46d0-8676-d3fff071b248 req-297379f0-da9c-4057-bed4-2f2a88736136 service nova] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Received event network-vif-plugged-503fc02b-83eb-415b-8439-c6b3c2175ae2 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:13:36.161302 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-aa48c132-24fa-46d0-8676-d3fff071b248 req-297379f0-da9c-4057-bed4-2f2a88736136 service nova] Acquiring lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:36.161302 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-aa48c132-24fa-46d0-8676-d3fff071b248 req-297379f0-da9c-4057-bed4-2f2a88736136 service nova] Lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:36.161302 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-aa48c132-24fa-46d0-8676-d3fff071b248 req-297379f0-da9c-4057-bed4-2f2a88736136 service nova] Lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:36.161439 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-aa48c132-24fa-46d0-8676-d3fff071b248 req-297379f0-da9c-4057-bed4-2f2a88736136 service nova] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] No waiting events found dispatching network-vif-plugged-503fc02b-83eb-415b-8439-c6b3c2175ae2 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:13:36.161552 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-aa48c132-24fa-46d0-8676-d3fff071b248 req-297379f0-da9c-4057-bed4-2f2a88736136 service nova] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Received unexpected event network-vif-plugged-503fc02b-83eb-415b-8439-c6b3c2175ae2 for instance with vm_state active and task_state None.
May 28 10:13:36.175047 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:36.299575 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:13:36.304562 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963216.3043292, 0cffddf7-ea43-43a0-83c1-6bddb8e42884 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:13:36.304834 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] VM Resumed (Lifecycle Event)
May 28 10:13:36.325960 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Took 12.71 seconds to build instance.
May 28 10:13:36.806886 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:13:36.811843 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:13:36.829656 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-55276e3e-ec6c-4f09-a0cc-8b2ed231585b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.222s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:37.313972 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779963217.3136504, 8849d62e-d9a4-4285-95fc-0869cbf20b4c => ua-6c684650-f91b-4888-a081-1cd18e3a9dc9> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 10:13:37.316993 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Successfully detached device vdb from instance 8849d62e-d9a4-4285-95fc-0869cbf20b4c from the live domain config.
May 28 10:13:37.318487 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:13:37.318927 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9', 'iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6c684650-f91b-4888-a081-1cd18e3a9dc9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:13:37.319135 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:13:37.319619 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:13:37.320137 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9', 'iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6c684650-f91b-4888-a081-1cd18e3a9dc9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:13:37.320465 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:13:37.352758 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:37.352758 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:37.352758 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:37.352758 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:37.352758 np0000001613 nova-compute[98321]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:37.352758 np0000001613 nova-compute[98321]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:37.352758 np0000001613 nova-compute[98321]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9 (non-flash)
May 28 10:13:37.352758 np0000001613 nova-compute[98321]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9 (non-flash)
May 28 10:13:37.352758 np0000001613 nova-compute[98321]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0 (non-flash)
May 28 10:13:37.352758 np0000001613 nova-compute[98321]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0 (non-flash)
May 28 10:13:37.352758 np0000001613 nova-compute[98321]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-972b12ec-4bdc-4796-8d98-a4ce035caa1a (non-flash)
May 28 10:13:37.352758 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:13:37.353214 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:37.353214 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:37.353214 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:37.353214 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:37.353214 np0000001613 nova-compute[98321]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:37.353214 np0000001613 nova-compute[98321]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:37.353214 np0000001613 nova-compute[98321]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9 (non-flash)
May 28 10:13:37.353214 np0000001613 nova-compute[98321]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9 (non-flash)
May 28 10:13:37.353214 np0000001613 nova-compute[98321]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0 (non-flash)
May 28 10:13:37.353214 np0000001613 nova-compute[98321]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0 (non-flash)
May 28 10:13:37.353214 np0000001613 nova-compute[98321]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-972b12ec-4bdc-4796-8d98-a4ce035caa1a (non-flash)
May 28 10:13:37.353214 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:13:37.353214 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a', '170'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a', '171'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', '176'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', '177'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', '179'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', '180'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9', '184'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9', '185'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0', '186'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0', '187'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-972b12ec-4bdc-4796-8d98-a4ce035caa1a', '188')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:13:37.353656 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9', '185')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:13:37.354456 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9', '184')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:13:37.355575 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc477d80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9'): ({'sdf'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:13:37.355828 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Removing multipathed devices sdg, sdf {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:13:37.356080 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Flush multipath device 3300000003adcbc56 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:13:37.388314 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:13:37.446818 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:13:37.501457 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:13:37.501606 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:13:37.503040 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:13:37.514588 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:13:37.514799 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:13:37.527148 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:37.570460 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 185, target: iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9, portal: 192.168.40.100,3260]
May 28 10:13:37.570460 np0000001613 nova-compute[98321]: Logout of [sid: 185, target: iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9, portal: 192.168.40.100,3260] successful.
May 28 10:13:37.570460 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:37.596369 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:37.610157 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:37.653875 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 184, target: iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9, portal: 192.168.50.100,3260]
May 28 10:13:37.653875 np0000001613 nova-compute[98321]: Logout of [sid: 184, target: iqn.2023-03.storpool.com:os--volume-6c684650-f91b-4888-a081-1cd18e3a9dc9, portal: 192.168.50.100,3260] successful.
May 28 10:13:37.653875 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:37.678369 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:37.678977 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:13:37.678977 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] <== disconnect_volume: return (360ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:13:37.678977 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:13:38.226406 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-616abda1-9084-4833-9ad2-7b81c59a805e req-0760da5c-be6d-4284-9f10-e45418044933 service nova] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Received event network-changed-503fc02b-83eb-415b-8439-c6b3c2175ae2 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:13:38.226731 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-616abda1-9084-4833-9ad2-7b81c59a805e req-0760da5c-be6d-4284-9f10-e45418044933 service nova] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Refreshing instance network info cache due to event network-changed-503fc02b-83eb-415b-8439-c6b3c2175ae2. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:13:38.229695 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-616abda1-9084-4833-9ad2-7b81c59a805e req-0760da5c-be6d-4284-9f10-e45418044933 service nova] Acquiring lock "refresh_cache-0cffddf7-ea43-43a0-83c1-6bddb8e42884" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:13:38.229804 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-616abda1-9084-4833-9ad2-7b81c59a805e req-0760da5c-be6d-4284-9f10-e45418044933 service nova] Acquired lock "refresh_cache-0cffddf7-ea43-43a0-83c1-6bddb8e42884" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:13:38.229898 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-616abda1-9084-4833-9ad2-7b81c59a805e req-0760da5c-be6d-4284-9f10-e45418044933 service nova] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Refreshing network info cache for port 503fc02b-83eb-415b-8439-c6b3c2175ae2 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:13:38.234733 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lazy-loading 'flavor' on Instance uuid 8849d62e-d9a4-4285-95fc-0869cbf20b4c {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:13:38.733063 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-616abda1-9084-4833-9ad2-7b81c59a805e req-0760da5c-be6d-4284-9f10-e45418044933 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:13:39.118639 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-616abda1-9084-4833-9ad2-7b81c59a805e req-0760da5c-be6d-4284-9f10-e45418044933 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:13:39.243175 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-84cc2e25-3bbf-4006-90e1-7d6bd2b7ead8 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.655s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:39.265768 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-616abda1-9084-4833-9ad2-7b81c59a805e req-0760da5c-be6d-4284-9f10-e45418044933 service nova] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Updated VIF entry in instance network info cache for port 503fc02b-83eb-415b-8439-c6b3c2175ae2. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:13:39.266019 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-616abda1-9084-4833-9ad2-7b81c59a805e req-0760da5c-be6d-4284-9f10-e45418044933 service nova] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Updating instance_info_cache with network_info: [{"id": "503fc02b-83eb-415b-8439-c6b3c2175ae2", "address": "fa:16:3e:57:fe:26", "network": {"id": "ddadd9b9-c8a6-4280-b1e1-fdd193bdceca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1440559780-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f4005d70969740a687a13ecb27e151a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap503fc02b-83", "ovs_interfaceid": "503fc02b-83eb-415b-8439-c6b3c2175ae2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:13:39.560062 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Acquiring lock "405de22b-28c5-4415-ad12-e7e8eae4d591" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:39.560384 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "405de22b-28c5-4415-ad12-e7e8eae4d591" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:39.648904 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Acquiring lock "405de22b-28c5-4415-ad12-e7e8eae4d591" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:39.768379 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-616abda1-9084-4833-9ad2-7b81c59a805e req-0760da5c-be6d-4284-9f10-e45418044933 service nova] Releasing lock "refresh_cache-0cffddf7-ea43-43a0-83c1-6bddb8e42884" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:13:40.013460 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:40.063846 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Detaching volume 1e8b72e7-e848-45da-9947-b52bba91c8f0
May 28 10:13:40.153715 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Attempting to driver detach volume 1e8b72e7-e848-45da-9947-b52bba91c8f0 from mountpoint /dev/vdb
May 28 10:13:40.160538 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Found disk vdb by alias ua-1e8b72e7-e848-45da-9947-b52bba91c8f0 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:13:40.161795 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Found disk vdb by alias ua-1e8b72e7-e848-45da-9947-b52bba91c8f0 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:13:40.161892 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Attempting to detach device vdb from instance 405de22b-28c5-4415-ad12-e7e8eae4d591 from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 10:13:40.162158 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:13:40.162158 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:13:40.162158 np0000001613 nova-compute[98321]:   <alias name="ua-1e8b72e7-e848-45da-9947-b52bba91c8f0"/>
May 28 10:13:40.162158 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-8"/>
May 28 10:13:40.162158 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:13:40.162158 np0000001613 nova-compute[98321]:   <serial>1e8b72e7-e848-45da-9947-b52bba91c8f0</serial>
May 28 10:13:40.162158 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:13:40.162158 np0000001613 nova-compute[98321]: </disk>
May 28 10:13:40.162158 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:13:40.168296 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Successfully detached device vdb from instance 405de22b-28c5-4415-ad12-e7e8eae4d591 from the persistent domain config.
May 28 10:13:40.168513 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] (1/8): Attempting to detach device vdb with device alias ua-1e8b72e7-e848-45da-9947-b52bba91c8f0 from instance 405de22b-28c5-4415-ad12-e7e8eae4d591 from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 10:13:40.169363 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:13:40.169363 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:13:40.169363 np0000001613 nova-compute[98321]:   <alias name="ua-1e8b72e7-e848-45da-9947-b52bba91c8f0"/>
May 28 10:13:40.169363 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-8"/>
May 28 10:13:40.169363 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:13:40.169363 np0000001613 nova-compute[98321]:   <serial>1e8b72e7-e848-45da-9947-b52bba91c8f0</serial>
May 28 10:13:40.169363 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:13:40.169363 np0000001613 nova-compute[98321]: </disk>
May 28 10:13:40.169363 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:13:40.667151 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779963220.666819, 405de22b-28c5-4415-ad12-e7e8eae4d591 => ua-1e8b72e7-e848-45da-9947-b52bba91c8f0> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 10:13:40.670241 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-1e8b72e7-e848-45da-9947-b52bba91c8f0 for instance 405de22b-28c5-4415-ad12-e7e8eae4d591 {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 10:13:40.674028 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Successfully detached device vdb from instance 405de22b-28c5-4415-ad12-e7e8eae4d591 from the live domain config.
May 28 10:13:40.675673 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:13:40.676019 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0', 'iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1e8b72e7-e848-45da-9947-b52bba91c8f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:13:40.676252 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:13:40.676706 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:13:40.677632 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0', 'iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1e8b72e7-e848-45da-9947-b52bba91c8f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:13:40.677841 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:13:40.717393 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:40.717393 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:40.717393 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:40.717393 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:40.717393 np0000001613 nova-compute[98321]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:40.717393 np0000001613 nova-compute[98321]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:40.717393 np0000001613 nova-compute[98321]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0 (non-flash)
May 28 10:13:40.717393 np0000001613 nova-compute[98321]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0 (non-flash)
May 28 10:13:40.717393 np0000001613 nova-compute[98321]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-972b12ec-4bdc-4796-8d98-a4ce035caa1a (non-flash)
May 28 10:13:40.717393 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:13:40.717798 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:40.717798 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:40.717798 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:40.717798 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:40.717798 np0000001613 nova-compute[98321]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:40.717798 np0000001613 nova-compute[98321]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:40.717798 np0000001613 nova-compute[98321]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0 (non-flash)
May 28 10:13:40.717798 np0000001613 nova-compute[98321]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0 (non-flash)
May 28 10:13:40.717798 np0000001613 nova-compute[98321]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-972b12ec-4bdc-4796-8d98-a4ce035caa1a (non-flash)
May 28 10:13:40.717798 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:13:40.718031 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a', '170'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a', '171'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', '176'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', '177'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', '179'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', '180'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0', '186'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0', '187'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-972b12ec-4bdc-4796-8d98-a4ce035caa1a', '188')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:13:40.718031 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0', '187')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:13:40.719777 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0', '186')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:13:40.721172 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc4767a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0'): ({'sdk'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:13:40.721460 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Removing multipathed devices sdl, sdk {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:13:40.721812 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Flush multipath device 330000000924ef8ee {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:13:40.760005 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:13:40.810928 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:13:40.855503 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Checking to see if SCSI volumes sdl, sdk have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:13:40.855702 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] SCSI volumes sdl, sdk have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:13:40.856778 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Checking to see if device paths {'sdl', 'sdk'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:13:40.869745 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Device paths {'sdl', 'sdk'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:13:40.869975 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:13:40.881986 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:40.921356 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 187, target: iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0, portal: 192.168.40.100,3260]
May 28 10:13:40.921356 np0000001613 nova-compute[98321]: Logout of [sid: 187, target: iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0, portal: 192.168.40.100,3260] successful.
May 28 10:13:40.921356 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:40.941861 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:40.953721 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:40.986127 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 186, target: iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0, portal: 192.168.50.100,3260]
May 28 10:13:40.986127 np0000001613 nova-compute[98321]: Logout of [sid: 186, target: iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0, portal: 192.168.50.100,3260] successful.
May 28 10:13:40.986127 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:41.007738 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:41.007951 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:13:41.008068 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] <== disconnect_volume: return (331ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:13:41.008238 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:13:41.135687 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Acquiring lock "bf181571-acd7-4482-90b1-50b7223411fc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:41.137509 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "bf181571-acd7-4482-90b1-50b7223411fc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:41.177724 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:41.559299 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lazy-loading 'flavor' on Instance uuid 405de22b-28c5-4415-ad12-e7e8eae4d591 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:13:41.639666 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:13:42.199485 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:42.199870 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:42.202854 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:13:42.202968 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Claim successful on node np0000001613
May 28 10:13:42.565568 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b22d0da7-a29f-4038-85ce-811e8e3f2505 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "405de22b-28c5-4415-ad12-e7e8eae4d591" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.005s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:42.566569 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "405de22b-28c5-4415-ad12-e7e8eae4d591" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.917s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:42.566840 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Acquiring lock "405de22b-28c5-4415-ad12-e7e8eae4d591-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:42.567018 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "405de22b-28c5-4415-ad12-e7e8eae4d591-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:42.567212 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "405de22b-28c5-4415-ad12-e7e8eae4d591-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:42.569129 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Terminating instance
May 28 10:13:43.071915 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:13:43.097515 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:43.101687 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:43.124712 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:43.147081 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:43.156154 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:43.288510 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-54a20bf0-68eb-45c1-bbd8-9b6c35e57501 req-ca13118d-556e-4658-9cd0-bf7768ac414c service nova] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Received event network-vif-unplugged-dde08f5f-faec-48b5-87a9-f4d4069875f0 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:13:43.288972 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-54a20bf0-68eb-45c1-bbd8-9b6c35e57501 req-ca13118d-556e-4658-9cd0-bf7768ac414c service nova] Acquiring lock "405de22b-28c5-4415-ad12-e7e8eae4d591-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:43.289221 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-54a20bf0-68eb-45c1-bbd8-9b6c35e57501 req-ca13118d-556e-4658-9cd0-bf7768ac414c service nova] Lock "405de22b-28c5-4415-ad12-e7e8eae4d591-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:43.289353 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-54a20bf0-68eb-45c1-bbd8-9b6c35e57501 req-ca13118d-556e-4658-9cd0-bf7768ac414c service nova] Lock "405de22b-28c5-4415-ad12-e7e8eae4d591-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:43.289524 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-54a20bf0-68eb-45c1-bbd8-9b6c35e57501 req-ca13118d-556e-4658-9cd0-bf7768ac414c service nova] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] No waiting events found dispatching network-vif-unplugged-dde08f5f-faec-48b5-87a9-f4d4069875f0 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:13:43.289647 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-54a20bf0-68eb-45c1-bbd8-9b6c35e57501 req-ca13118d-556e-4658-9cd0-bf7768ac414c service nova] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Received event network-vif-unplugged-dde08f5f-faec-48b5-87a9-f4d4069875f0 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:13:43.421583 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999579268000161 future=<Future at 0x73c1f418e660 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:13:43.422353 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.998942182000064 future=<Future at 0x73c1f418e660 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:13:43.422353 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.99878664300013 future=<Future at 0x73c1f418e660 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:13:43.423677 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Instance destroyed successfully.
May 28 10:13:43.424153 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lazy-loading 'resources' on Instance uuid 405de22b-28c5-4415-ad12-e7e8eae4d591 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:13:43.673720 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:13:43.674047 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:13:43.926458 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:12:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1765933896',display_name='tempest-VolumesSnapshotTestJSON-instance-1765933896',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumessnapshottestjson-instance-1765933896',id=68,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVtEtJ3IIoWtzxHrrCF9S9ZjZ/UqtbeSFn2f8p1n/3Nd1jt5BwroFKyawGPEa7s/AUA6TypH6ehdGP7XropZc0PQDp/4YerW0IzSanzYlkGXwN7t+ck5C8uhUYKic/h0g==',key_name='tempest-keypair-2069242342',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:12:44Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4bbdf692768465db607aa60a630e5e2',ramdisk_id='',reservation_id='r-gwooed2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-4375881',owner_user_name='tempest-VolumesSnapshotTestJSON-4375881-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:12:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f734f16600ef4cb88fdf7e170dd7f3a0',uuid=405de22b-28c5-4415-ad12-e7e8eae4d591,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dde08f5f-faec-48b5-87a9-f4d4069875f0", "address": "fa:16:3e:28:03:66", "network": {"id": "8d701503-e690-42e6-8d82-0987ffcf4209", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1480012678-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a4bbdf692768465db607aa60a630e5e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde08f5f-fa", "ovs_interfaceid": "dde08f5f-faec-48b5-87a9-f4d4069875f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:13:43.926687 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Converting VIF {"id": "dde08f5f-faec-48b5-87a9-f4d4069875f0", "address": "fa:16:3e:28:03:66", "network": {"id": "8d701503-e690-42e6-8d82-0987ffcf4209", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1480012678-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a4bbdf692768465db607aa60a630e5e2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde08f5f-fa", "ovs_interfaceid": "dde08f5f-faec-48b5-87a9-f4d4069875f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:13:43.927177 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:03:66,bridge_name='br-int',has_traffic_filtering=True,id=dde08f5f-faec-48b5-87a9-f4d4069875f0,network=Network(8d701503-e690-42e6-8d82-0987ffcf4209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdde08f5f-fa') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:13:43.927418 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:03:66,bridge_name='br-int',has_traffic_filtering=True,id=dde08f5f-faec-48b5-87a9-f4d4069875f0,network=Network(8d701503-e690-42e6-8d82-0987ffcf4209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdde08f5f-fa') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:13:43.929217 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:43.929217 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdde08f5f-fa, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:13:43.930497 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:43.930497 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:13:43.930956 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:43.931662 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:43.932007 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aa0312a6-b36d-408d-96d4-f4c23d4e8df0) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:13:43.932486 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:43.932875 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:13:43.936611 np0000001613 nova-compute[98321]: INFO os_vif [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:03:66,bridge_name='br-int',has_traffic_filtering=True,id=dde08f5f-faec-48b5-87a9-f4d4069875f0,network=Network(8d701503-e690-42e6-8d82-0987ffcf4209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdde08f5f-fa')
May 28 10:13:43.938316 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:13:43.938555 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0', 'iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1e8b72e7-e848-45da-9947-b52bba91c8f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:13:43.938670 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:13:43.938945 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:13:43.939234 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0', 'iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1e8b72e7-e848-45da-9947-b52bba91c8f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:13:43.939397 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:13:43.962545 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:43.962545 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:43.962545 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:43.962545 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:43.962545 np0000001613 nova-compute[98321]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:43.962545 np0000001613 nova-compute[98321]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:43.962545 np0000001613 nova-compute[98321]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-972b12ec-4bdc-4796-8d98-a4ce035caa1a (non-flash)
May 28 10:13:43.962545 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:13:43.962789 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:43.962789 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:43.962789 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:43.962789 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:43.962789 np0000001613 nova-compute[98321]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:43.962789 np0000001613 nova-compute[98321]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:43.962789 np0000001613 nova-compute[98321]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-972b12ec-4bdc-4796-8d98-a4ce035caa1a (non-flash)
May 28 10:13:43.962789 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:13:43.962789 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a', '170'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a', '171'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', '176'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', '177'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', '179'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', '180'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-972b12ec-4bdc-4796-8d98-a4ce035caa1a', '188')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:13:43.962981 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0, 0): [] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:13:43.962981 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0') {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 10:13:43.963033 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0, 0): [] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:13:43.963135 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1e8b72e7-e848-45da-9947-b52bba91c8f0') {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 10:13:43.963249 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc223880>, {}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:13:43.963353 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Disconnecting from: [] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:13:43.963518 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.025s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:13:43.963611 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] <== disconnect_volume: return (25ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:13:43.963711 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:13:43.963938 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Deleting instance files /opt/stack/data/nova/instances/405de22b-28c5-4415-ad12-e7e8eae4d591_del
May 28 10:13:43.964635 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Deletion of /opt/stack/data/nova/instances/405de22b-28c5-4415-ad12-e7e8eae4d591_del complete
May 28 10:13:44.179055 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:13:44.470412 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Took 1.40 seconds to destroy the instance on the hypervisor.
May 28 10:13:44.471044 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:13:44.471491 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:13:44.471645 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:13:44.471929 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:13:44.608443 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:13:44.686926 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.487s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:44.687318 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:13:44.997535 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:45.003740 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:45.003932 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:45.004270 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:45.004270 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:45.004270 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:45.009854 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Terminating instance
May 28 10:13:45.015463 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:45.097320 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-9d3ab2e3-8c15-47c9-9104-b2f9ce76a508 req-f8962265-eeb5-417f-ac6f-53e31ec8bfb5 service nova] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Received event network-vif-deleted-dde08f5f-faec-48b5-87a9-f4d4069875f0 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:13:45.097521 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-9d3ab2e3-8c15-47c9-9104-b2f9ce76a508 req-f8962265-eeb5-417f-ac6f-53e31ec8bfb5 service nova] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Neutron deleted interface dde08f5f-faec-48b5-87a9-f4d4069875f0; detaching it from the instance and deleting it from the info cache
May 28 10:13:45.100862 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-9d3ab2e3-8c15-47c9-9104-b2f9ce76a508 req-f8962265-eeb5-417f-ac6f-53e31ec8bfb5 service nova] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Detach interface failed, port_id=dde08f5f-faec-48b5-87a9-f4d4069875f0, reason: Instance 405de22b-28c5-4415-ad12-e7e8eae4d591 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:13:45.195186 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:13:45.195422 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:13:45.195703 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:13:45.195819 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:13:45.273765 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7ffa50296592417a99dd0566355e09f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80b528594ac4ee5b3b56bf7c94c7ffa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:13:45.354689 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cf345690-0dec-40f3-9a7b-30efb16e34e2 req-b28daa0e-afc0-4ffb-830e-95ce323a26f2 service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Received event network-changed-04633d7b-a11f-4e7a-bd98-683a082e8a73 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:13:45.354689 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cf345690-0dec-40f3-9a7b-30efb16e34e2 req-b28daa0e-afc0-4ffb-830e-95ce323a26f2 service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Refreshing instance network info cache due to event network-changed-04633d7b-a11f-4e7a-bd98-683a082e8a73. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:13:45.354800 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cf345690-0dec-40f3-9a7b-30efb16e34e2 req-b28daa0e-afc0-4ffb-830e-95ce323a26f2 service nova] Acquiring lock "refresh_cache-3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:13:45.354950 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cf345690-0dec-40f3-9a7b-30efb16e34e2 req-b28daa0e-afc0-4ffb-830e-95ce323a26f2 service nova] Acquired lock "refresh_cache-3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:13:45.355012 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-cf345690-0dec-40f3-9a7b-30efb16e34e2 req-b28daa0e-afc0-4ffb-830e-95ce323a26f2 service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Refreshing network info cache for port 04633d7b-a11f-4e7a-bd98-683a082e8a73 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:13:45.372848 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b1c4d1b0-1db4-4a0a-be3c-a7a0bb90d2fc req-03c20ce0-f015-4cba-8c95-1547bbebc751 service nova] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Received event network-vif-unplugged-dde08f5f-faec-48b5-87a9-f4d4069875f0 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:13:45.373408 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b1c4d1b0-1db4-4a0a-be3c-a7a0bb90d2fc req-03c20ce0-f015-4cba-8c95-1547bbebc751 service nova] Acquiring lock "405de22b-28c5-4415-ad12-e7e8eae4d591-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:45.374119 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b1c4d1b0-1db4-4a0a-be3c-a7a0bb90d2fc req-03c20ce0-f015-4cba-8c95-1547bbebc751 service nova] Lock "405de22b-28c5-4415-ad12-e7e8eae4d591-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:45.374119 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b1c4d1b0-1db4-4a0a-be3c-a7a0bb90d2fc req-03c20ce0-f015-4cba-8c95-1547bbebc751 service nova] Lock "405de22b-28c5-4415-ad12-e7e8eae4d591-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:45.374119 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b1c4d1b0-1db4-4a0a-be3c-a7a0bb90d2fc req-03c20ce0-f015-4cba-8c95-1547bbebc751 service nova] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] No waiting events found dispatching network-vif-unplugged-dde08f5f-faec-48b5-87a9-f4d4069875f0 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:13:45.374119 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b1c4d1b0-1db4-4a0a-be3c-a7a0bb90d2fc req-03c20ce0-f015-4cba-8c95-1547bbebc751 service nova] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Received event network-vif-unplugged-dde08f5f-faec-48b5-87a9-f4d4069875f0 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:13:45.522953 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:13:45.551663 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:45.553189 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:13:45.566208 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:45.574669 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:45.588902 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:45.594275 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:45.698208 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:13:45.829821 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:45.837788 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:45.866440 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-cf345690-0dec-40f3-9a7b-30efb16e34e2 req-b28daa0e-afc0-4ffb-830e-95ce323a26f2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:13:45.868377 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999677719999909 future=<Future at 0x73c1f4311640 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:13:45.876964 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Instance destroyed successfully.
May 28 10:13:45.886547 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lazy-loading 'resources' on Instance uuid 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:13:46.054896 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Took 1.58 seconds to deallocate network for instance.
May 28 10:13:46.064754 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Successfully created port: 4ba3c950-6075-4485-8352-d019b6137361 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:13:46.079960 np0000001613 nova-compute[98321]: WARNING nova.volume.cinder [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Attachment 8d088914-6828-4d3a-9b85-1f13cce0df7c does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 8d088914-6828-4d3a-9b85-1f13cce0df7c. (HTTP 404) (Request-ID: req-fa6988f3-0ad0-402b-8b0d-96a81b0eb5f5)
May 28 10:13:46.080369 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Took 0.03 seconds to detach 1 volumes for instance.
May 28 10:13:46.201252 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:13:46.250763 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-cf345690-0dec-40f3-9a7b-30efb16e34e2 req-b28daa0e-afc0-4ffb-830e-95ce323a26f2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:13:46.396728 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:12:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-408625165',display_name='tempest-TestVolumeBootPattern-server-408625165',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpattern-server-408625165',id=70,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIssEW3wFq5Z5UVaYZuW5cmCRsiPiqbdvADCw1wCLU3ZToJr2mBO+GTeBlReOodZ6qxe1OJNXGES/jiq9J2PvBGzYYtKCDR4nIPiT2JecYH/bovKreakXe+d0IlAq6PNVA==',key_name='tempest-TestVolumeBootPattern-1325122028',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:13:04Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='23e9651268114327a9cc6c6c59bef01e',ramdisk_id='',reservation_id='r-irsw1n6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-327944304',owner_user_name='tempest-TestVolumeBootPattern-327944304-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:13:04Z,user_data=None,user_id='ec58233d3b2848bbb2e0b00650398cd1',uuid=9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8907c86c-3bc6-41a2-ace1-517b5a4a92d1", "address": "fa:16:3e:c4:aa:35", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8907c86c-3b", "ovs_interfaceid": "8907c86c-3bc6-41a2-ace1-517b5a4a92d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:13:46.396728 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converting VIF {"id": "8907c86c-3bc6-41a2-ace1-517b5a4a92d1", "address": "fa:16:3e:c4:aa:35", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8907c86c-3b", "ovs_interfaceid": "8907c86c-3bc6-41a2-ace1-517b5a4a92d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:13:46.396728 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:aa:35,bridge_name='br-int',has_traffic_filtering=True,id=8907c86c-3bc6-41a2-ace1-517b5a4a92d1,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8907c86c-3b') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:13:46.396728 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:aa:35,bridge_name='br-int',has_traffic_filtering=True,id=8907c86c-3bc6-41a2-ace1-517b5a4a92d1,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8907c86c-3b') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:13:46.396728 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:46.396728 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8907c86c-3b, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:13:46.397811 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:46.398381 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:13:46.402751 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:46.406182 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:46.406642 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=08237de9-1a35-4f9d-b376-f81792ebc705) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:13:46.407135 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:46.407892 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:13:46.408437 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:46.412882 np0000001613 nova-compute[98321]: INFO os_vif [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:aa:35,bridge_name='br-int',has_traffic_filtering=True,id=8907c86c-3bc6-41a2-ace1-517b5a4a92d1,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8907c86c-3b')
May 28 10:13:46.416144 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:13:46.416533 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b23f5880-1872-41fd-becc-baf8432031f3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:13:46.417282 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:13:46.417975 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:13:46.418183 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b23f5880-1872-41fd-becc-baf8432031f3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:13:46.418298 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:13:46.432099 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-cf345690-0dec-40f3-9a7b-30efb16e34e2 req-b28daa0e-afc0-4ffb-830e-95ce323a26f2 service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Updated VIF entry in instance network info cache for port 04633d7b-a11f-4e7a-bd98-683a082e8a73. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:13:46.432416 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-cf345690-0dec-40f3-9a7b-30efb16e34e2 req-b28daa0e-afc0-4ffb-830e-95ce323a26f2 service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Updating instance_info_cache with network_info: [{"id": "04633d7b-a11f-4e7a-bd98-683a082e8a73", "address": "fa:16:3e:f0:49:ef", "network": {"id": "db344666-4990-47d9-a3a2-9bebce64e660", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1492927350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44f9e47b0cb84ec9a96e9ee54854c98d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04633d7b-a1", "ovs_interfaceid": "04633d7b-a11f-4e7a-bd98-683a082e8a73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:13:46.459759 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:46.459759 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:46.459759 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:46.459759 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:46.459759 np0000001613 nova-compute[98321]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:46.459759 np0000001613 nova-compute[98321]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:46.459759 np0000001613 nova-compute[98321]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-972b12ec-4bdc-4796-8d98-a4ce035caa1a (non-flash)
May 28 10:13:46.459759 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:13:46.460034 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:46.460034 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:46.460034 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:46.460034 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:46.460034 np0000001613 nova-compute[98321]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:46.460034 np0000001613 nova-compute[98321]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:13:46.460034 np0000001613 nova-compute[98321]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-972b12ec-4bdc-4796-8d98-a4ce035caa1a (non-flash)
May 28 10:13:46.460034 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:13:46.460264 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a', '170'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a', '171'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', '176'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', '177'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', '179'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', '180'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-972b12ec-4bdc-4796-8d98-a4ce035caa1a', '188')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:13:46.460355 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', '179')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:13:46.462407 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', '180')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:13:46.463860 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc7df920>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3'): ({'sdj'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:13:46.464105 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Removing multipathed devices sdc, sdj {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:13:46.464374 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Flush multipath device 330000000eafe978e {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:13:46.510259 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:46.510438 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:46.521752 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:13:46.571889 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:13:46.587943 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:46.587943 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:46.617033 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Checking to see if SCSI volumes sdc, sdj have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:13:46.617033 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] SCSI volumes sdc, sdj have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:13:46.617033 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Checking to see if device paths {'sdc', 'sdj'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:13:46.633334 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Device paths {'sdc', 'sdj'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:13:46.633938 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:13:46.645418 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:46.677963 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Successfully updated port: 4ba3c950-6075-4485-8352-d019b6137361 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:13:46.685704 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 179, target: iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3, portal: 192.168.40.100,3260]
May 28 10:13:46.685704 np0000001613 nova-compute[98321]: Logout of [sid: 179, target: iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3, portal: 192.168.40.100,3260] successful.
May 28 10:13:46.685704 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:46.703810 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:46.707507 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Booting with volume 3e7b8c65-f460-4db9-91ae-2b3e144f0b5c at /dev/vda
May 28 10:13:46.721054 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:46.750045 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:13:46.761554 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:13:46.762201 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 180, target: iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3, portal: 192.168.50.100,3260]
May 28 10:13:46.762201 np0000001613 nova-compute[98321]: Logout of [sid: 180, target: iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3, portal: 192.168.50.100,3260] successful.
May 28 10:13:46.762201 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:46.783187 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:46.783187 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:13:46.783187 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] <== disconnect_volume: return (364ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:13:46.783187 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:13:46.783187 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Deleting instance files /opt/stack/data/nova/instances/9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5_del
May 28 10:13:46.783187 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Deletion of /opt/stack/data/nova/instances/9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5_del complete
May 28 10:13:46.786917 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:13:46.842744 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:13:46.843057 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:13:46.853958 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:13:46.855283 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe86:5388', 'fe80::5c44:a2ff:fe78:6c5f', 'fe80::fc16:3eff:fe49:8be9', 'fe80::2c59:8cff:fea1:3a8', 'fe80::fc16:3eff:fef0:49ef', 'fe80::e03f:79ff:fe2f:2d97', 'fe80::fc16:3eff:fe57:fe26', 'fe80::e4bc:c7ff:fe7f:dc5f'] 
May 28 10:13:46.855424 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:13:46.855519 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:13:46.855776 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:13:46.856013 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Updating existing volume attachment record: 925a23f7-578a-4f91-bc6d-bb1ac5b8c98a {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:13:46.935069 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cf345690-0dec-40f3-9a7b-30efb16e34e2 req-b28daa0e-afc0-4ffb-830e-95ce323a26f2 service nova] Releasing lock "refresh_cache-3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:13:47.011606 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:13:47.011866 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:13:47.014506 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Detaching volume adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a
May 28 10:13:47.062316 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Attempting to driver detach volume adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a from mountpoint /dev/vdb
May 28 10:13:47.070064 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Found disk vdb by alias ua-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:13:47.072297 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Found disk vdb by alias ua-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:13:47.072477 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Attempting to detach device vdb from instance 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 10:13:47.073483 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:13:47.073483 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:13:47.073483 np0000001613 nova-compute[98321]:   <alias name="ua-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a"/>
May 28 10:13:47.073483 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-4"/>
May 28 10:13:47.073483 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:13:47.073483 np0000001613 nova-compute[98321]:   <serial>adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a</serial>
May 28 10:13:47.073483 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:13:47.073483 np0000001613 nova-compute[98321]: </disk>
May 28 10:13:47.073483 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:13:47.082184 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Successfully detached device vdb from instance 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd from the persistent domain config.
May 28 10:13:47.082354 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] (1/8): Attempting to detach device vdb with device alias ua-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a from instance 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 10:13:47.082666 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:13:47.082666 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:13:47.082666 np0000001613 nova-compute[98321]:   <alias name="ua-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a"/>
May 28 10:13:47.082666 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-4"/>
May 28 10:13:47.082666 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:13:47.082666 np0000001613 nova-compute[98321]:   <serial>adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a</serial>
May 28 10:13:47.082666 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:13:47.082666 np0000001613 nova-compute[98321]: </disk>
May 28 10:13:47.082666 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:13:47.157422 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d998a29f-d711-4094-8ea0-3e42a190117e req-d2095c88-4f88-4362-b54c-383811036432 service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Received event network-changed-04633d7b-a11f-4e7a-bd98-683a082e8a73 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:13:47.157818 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d998a29f-d711-4094-8ea0-3e42a190117e req-d2095c88-4f88-4362-b54c-383811036432 service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Refreshing instance network info cache due to event network-changed-04633d7b-a11f-4e7a-bd98-683a082e8a73. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:13:47.157973 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d998a29f-d711-4094-8ea0-3e42a190117e req-d2095c88-4f88-4362-b54c-383811036432 service nova] Acquiring lock "refresh_cache-3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:13:47.158048 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d998a29f-d711-4094-8ea0-3e42a190117e req-d2095c88-4f88-4362-b54c-383811036432 service nova] Acquired lock "refresh_cache-3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:13:47.158243 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-d998a29f-d711-4094-8ea0-3e42a190117e req-d2095c88-4f88-4362-b54c-383811036432 service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Refreshing network info cache for port 04633d7b-a11f-4e7a-bd98-683a082e8a73 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:13:47.180366 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Acquiring lock "refresh_cache-bf181571-acd7-4482-90b1-50b7223411fc" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:13:47.180519 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Acquired lock "refresh_cache-bf181571-acd7-4482-90b1-50b7223411fc" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:13:47.180703 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:13:47.293922 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Took 1.77 seconds to destroy the instance on the hypervisor.
May 28 10:13:47.294920 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:13:47.295321 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:13:47.295428 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:13:47.295750 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:13:47.361829 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:13:47.451007 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-943ad4bf-8845-4bc6-9643-8b20ccd3afec req-347f3be5-31ed-4a4c-9fd9-6ec91f3f3544 service nova] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Received event network-vif-unplugged-8907c86c-3bc6-41a2-ace1-517b5a4a92d1 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:13:47.451513 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-943ad4bf-8845-4bc6-9643-8b20ccd3afec req-347f3be5-31ed-4a4c-9fd9-6ec91f3f3544 service nova] Acquiring lock "9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:47.451656 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-943ad4bf-8845-4bc6-9643-8b20ccd3afec req-347f3be5-31ed-4a4c-9fd9-6ec91f3f3544 service nova] Lock "9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:47.451772 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-943ad4bf-8845-4bc6-9643-8b20ccd3afec req-347f3be5-31ed-4a4c-9fd9-6ec91f3f3544 service nova] Lock "9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:47.451888 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-943ad4bf-8845-4bc6-9643-8b20ccd3afec req-347f3be5-31ed-4a4c-9fd9-6ec91f3f3544 service nova] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] No waiting events found dispatching network-vif-unplugged-8907c86c-3bc6-41a2-ace1-517b5a4a92d1 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:13:47.451993 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-943ad4bf-8845-4bc6-9643-8b20ccd3afec req-347f3be5-31ed-4a4c-9fd9-6ec91f3f3544 service nova] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Received event network-vif-unplugged-8907c86c-3bc6-41a2-ace1-517b5a4a92d1 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:13:47.452102 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-943ad4bf-8845-4bc6-9643-8b20ccd3afec req-347f3be5-31ed-4a4c-9fd9-6ec91f3f3544 service nova] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Received event network-vif-unplugged-8907c86c-3bc6-41a2-ace1-517b5a4a92d1 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:13:47.452285 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-943ad4bf-8845-4bc6-9643-8b20ccd3afec req-347f3be5-31ed-4a4c-9fd9-6ec91f3f3544 service nova] Acquiring lock "9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:47.452403 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-943ad4bf-8845-4bc6-9643-8b20ccd3afec req-347f3be5-31ed-4a4c-9fd9-6ec91f3f3544 service nova] Lock "9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:47.452504 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-943ad4bf-8845-4bc6-9643-8b20ccd3afec req-347f3be5-31ed-4a4c-9fd9-6ec91f3f3544 service nova] Lock "9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:47.452658 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-943ad4bf-8845-4bc6-9643-8b20ccd3afec req-347f3be5-31ed-4a4c-9fd9-6ec91f3f3544 service nova] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] No waiting events found dispatching network-vif-unplugged-8907c86c-3bc6-41a2-ace1-517b5a4a92d1 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:13:47.454260 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-943ad4bf-8845-4bc6-9643-8b20ccd3afec req-347f3be5-31ed-4a4c-9fd9-6ec91f3f3544 service nova] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Received event network-vif-unplugged-8907c86c-3bc6-41a2-ace1-517b5a4a92d1 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:13:47.454260 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-943ad4bf-8845-4bc6-9643-8b20ccd3afec req-347f3be5-31ed-4a4c-9fd9-6ec91f3f3544 service nova] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Received event network-changed-4ba3c950-6075-4485-8352-d019b6137361 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:13:47.454260 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-943ad4bf-8845-4bc6-9643-8b20ccd3afec req-347f3be5-31ed-4a4c-9fd9-6ec91f3f3544 service nova] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Refreshing instance network info cache due to event network-changed-4ba3c950-6075-4485-8352-d019b6137361. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:13:47.454260 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-943ad4bf-8845-4bc6-9643-8b20ccd3afec req-347f3be5-31ed-4a4c-9fd9-6ec91f3f3544 service nova] Acquiring lock "refresh_cache-bf181571-acd7-4482-90b1-50b7223411fc" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:13:47.519196 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:13:47.610033 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779963227.609605, 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd => ua-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 10:13:47.612419 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a for instance 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 10:13:47.617443 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Successfully detached device vdb from instance 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd from the live domain config.
May 28 10:13:47.621823 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:13:47.622139 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a', 'iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:13:47.622344 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:13:47.622762 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:13:47.623102 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a', 'iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:13:47.628609 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:13:47.660083 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-d998a29f-d711-4094-8ea0-3e42a190117e req-d2095c88-4f88-4362-b54c-383811036432 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:13:47.663984 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:47.663984 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:47.663984 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:47.663984 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:47.663984 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:13:47.663984 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsi session list stdout=tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:47.663984 np0000001613 nova-compute[98321]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a (non-flash)
May 28 10:13:47.663984 np0000001613 nova-compute[98321]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:47.663984 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:47.663984 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:13:47.663984 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a', '170'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a', '171'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', '176'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', '177')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:13:47.663984 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a', '170')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:13:47.664461 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a', '171')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:13:47.665379 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1f40dc2c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a'): ({'sde'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:13:47.665636 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Removing multipathed devices sdd, sde {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:13:47.665936 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Flush multipath device 330000000025109af {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:13:47.702541 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:13:47.749762 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:13:47.769812 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:13:47.801584 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:13:47.801726 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:13:47.802855 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:13:47.817297 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:13:47.817584 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:13:47.830236 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:47.861506 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 170, target: iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a, portal: 192.168.40.100,3260]
May 28 10:13:47.861506 np0000001613 nova-compute[98321]: Logout of [sid: 170, target: iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a, portal: 192.168.40.100,3260] successful.
May 28 10:13:47.861506 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:47.874265 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:47.885156 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:47.910182 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 171, target: iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a, portal: 192.168.50.100,3260]
May 28 10:13:47.910182 np0000001613 nova-compute[98321]: Logout of [sid: 171, target: iqn.2023-03.storpool.com:os--volume-adb63ff7-afc0-4dd6-b6c6-39c0f0597c3a, portal: 192.168.50.100,3260] successful.
May 28 10:13:47.910182 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:47.923405 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:47.923628 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:13:47.923744 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] <== disconnect_volume: return (301ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:13:47.923848 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:13:47.951414 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a19289bd-7d7b-4b5f-a2d4-a352f6bf7829 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Acquiring lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:47.951549 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a19289bd-7d7b-4b5f-a2d4-a352f6bf7829 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:47.951712 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a19289bd-7d7b-4b5f-a2d4-a352f6bf7829 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Acquiring lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:47.952309 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a19289bd-7d7b-4b5f-a2d4-a352f6bf7829 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:47.952309 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a19289bd-7d7b-4b5f-a2d4-a352f6bf7829 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:47.953935 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a19289bd-7d7b-4b5f-a2d4-a352f6bf7829 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Terminating instance
May 28 10:13:48.002718 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:13:48.026043 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.439s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:48.086912 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-d998a29f-d711-4094-8ea0-3e42a190117e req-d2095c88-4f88-4362-b54c-383811036432 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:13:48.121799 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Deleted allocations for instance 405de22b-28c5-4415-ad12-e7e8eae4d591
May 28 10:13:48.178256 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Updating instance_info_cache with network_info: [{"id": "4ba3c950-6075-4485-8352-d019b6137361", "address": "fa:16:3e:38:91:9c", "network": {"id": "83f5548a-aebf-46e0-a4d2-07f06d3967d4", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1141449765-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d80b528594ac4ee5b3b56bf7c94c7ffa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ba3c950-60", "ovs_interfaceid": "4ba3c950-6075-4485-8352-d019b6137361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:13:48.244534 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-d998a29f-d711-4094-8ea0-3e42a190117e req-d2095c88-4f88-4362-b54c-383811036432 service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Updated VIF entry in instance network info cache for port 04633d7b-a11f-4e7a-bd98-683a082e8a73. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:13:48.244883 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-d998a29f-d711-4094-8ea0-3e42a190117e req-d2095c88-4f88-4362-b54c-383811036432 service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Updating instance_info_cache with network_info: [{"id": "04633d7b-a11f-4e7a-bd98-683a082e8a73", "address": "fa:16:3e:f0:49:ef", "network": {"id": "db344666-4990-47d9-a3a2-9bebce64e660", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1492927350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44f9e47b0cb84ec9a96e9ee54854c98d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04633d7b-a1", "ovs_interfaceid": "04633d7b-a11f-4e7a-bd98-683a082e8a73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:13:48.339367 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:13:48.458434 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a19289bd-7d7b-4b5f-a2d4-a352f6bf7829 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:13:48.495874 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lazy-loading 'flavor' on Instance uuid 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:13:48.495874 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:48.507256 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:48.537490 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:48.655409 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-82ed9de5-f72c-41a1-8fe2-ef7332dc3d01 req-c7a367b5-7b7d-4eac-a708-fc964b21332c service nova] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Received event network-vif-unplugged-c7f466f7-9d37-4d28-8e47-ed59abae0631 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:13:48.656542 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-82ed9de5-f72c-41a1-8fe2-ef7332dc3d01 req-c7a367b5-7b7d-4eac-a708-fc964b21332c service nova] Acquiring lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:48.656715 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-82ed9de5-f72c-41a1-8fe2-ef7332dc3d01 req-c7a367b5-7b7d-4eac-a708-fc964b21332c service nova] Lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:48.656884 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-82ed9de5-f72c-41a1-8fe2-ef7332dc3d01 req-c7a367b5-7b7d-4eac-a708-fc964b21332c service nova] Lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:48.657382 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-82ed9de5-f72c-41a1-8fe2-ef7332dc3d01 req-c7a367b5-7b7d-4eac-a708-fc964b21332c service nova] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] No waiting events found dispatching network-vif-unplugged-c7f466f7-9d37-4d28-8e47-ed59abae0631 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:13:48.657382 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-82ed9de5-f72c-41a1-8fe2-ef7332dc3d01 req-c7a367b5-7b7d-4eac-a708-fc964b21332c service nova] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Received event network-vif-unplugged-c7f466f7-9d37-4d28-8e47-ed59abae0631 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:13:48.680577 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Releasing lock "refresh_cache-bf181571-acd7-4482-90b1-50b7223411fc" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:13:48.680836 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Instance network_info: |[{"id": "4ba3c950-6075-4485-8352-d019b6137361", "address": "fa:16:3e:38:91:9c", "network": {"id": "83f5548a-aebf-46e0-a4d2-07f06d3967d4", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1141449765-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d80b528594ac4ee5b3b56bf7c94c7ffa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ba3c950-60", "ovs_interfaceid": "4ba3c950-6075-4485-8352-d019b6137361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:13:48.681058 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-943ad4bf-8845-4bc6-9643-8b20ccd3afec req-347f3be5-31ed-4a4c-9fd9-6ec91f3f3544 service nova] Acquired lock "refresh_cache-bf181571-acd7-4482-90b1-50b7223411fc" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:13:48.681233 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-943ad4bf-8845-4bc6-9643-8b20ccd3afec req-347f3be5-31ed-4a4c-9fd9-6ec91f3f3544 service nova] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Refreshing network info cache for port 4ba3c950-6075-4485-8352-d019b6137361 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:13:48.747655 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-d998a29f-d711-4094-8ea0-3e42a190117e req-d2095c88-4f88-4362-b54c-383811036432 service nova] Releasing lock "refresh_cache-3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:13:48.762835 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:48.769565 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:48.789182 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999705753000399 future=<Future at 0x73c1f40b5460 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:13:48.792516 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Instance destroyed successfully.
May 28 10:13:48.792916 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-a19289bd-7d7b-4b5f-a2d4-a352f6bf7829 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lazy-loading 'resources' on Instance uuid 8849d62e-d9a4-4285-95fc-0869cbf20b4c {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:13:48.841882 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Took 1.55 seconds to deallocate network for instance.
May 28 10:13:48.989597 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:13:48.990608 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:13:48.990841 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Creating image(s)
May 28 10:13:48.991116 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Did not create local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 10:13:48.991475 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Ensure instance console log exists: /opt/stack/data/nova/instances/bf181571-acd7-4482-90b1-50b7223411fc/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:13:48.991475 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:48.991597 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:48.991683 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:48.993225 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Start _get_guest_xml network_info=[{"id": "4ba3c950-6075-4485-8352-d019b6137361", "address": "fa:16:3e:38:91:9c", "network": {"id": "83f5548a-aebf-46e0-a4d2-07f06d3967d4", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1141449765-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d80b528594ac4ee5b3b56bf7c94c7ffa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ba3c950-60", "ovs_interfaceid": "4ba3c950-6075-4485-8352-d019b6137361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c', 'iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3e7b8c65-f460-4db9-91ae-2b3e144f0b5c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'bf181571-acd7-4482-90b1-50b7223411fc', 'attached_at': '', 'detached_at': '', 'volume_id': '3e7b8c65-f460-4db9-91ae-2b3e144f0b5c', 'serial': '3e7b8c65-f460-4db9-91ae-2b3e144f0b5c'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '925a23f7-578a-4f91-bc6d-bb1ac5b8c98a', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:13:48.996896 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:13:48.997782 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-1166496640', uuid='bf181571-acd7-4482-90b1-50b7223411fc'), owner=OwnerMeta(userid='7ffa50296592417a99dd0566355e09f9', username='tempest-TestVolumeBootPatternV346-204163382-project-member', projectid='d80b528594ac4ee5b3b56bf7c94c7ffa', projectname='tempest-TestVolumeBootPatternV346-204163382'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4ba3c950-6075-4485-8352-d019b6137361", "address": "fa:16:3e:38:91:9c", "network": {"id": "83f5548a-aebf-46e0-a4d2-07f06d3967d4", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1141449765-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d80b528594ac4ee5b3b56bf7c94c7ffa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ba3c950-60", "ovs_interfaceid": "4ba3c950-6075-4485-8352-d019b6137361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779963228.9973924) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:13:48.999104 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:13:48.999686 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:13:49.000856 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:13:49.001431 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:13:49.001879 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:13:49.002152 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:13:49.002334 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:13:49.002421 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:13:49.002543 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:13:49.002619 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:13:49.002704 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:13:49.002935 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:13:49.003030 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:13:49.003147 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:13:49.003261 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:13:49.003370 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:13:49.014750 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:13:49.015014 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c', 'iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3e7b8c65-f460-4db9-91ae-2b3e144f0b5c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:13:49.015126 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:13:49.015433 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:13:49.015668 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c', 'iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3e7b8c65-f460-4db9-91ae-2b3e144f0b5c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:13:49.027990 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:13:49.028957 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:13:49.030061 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:13:49.030345 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:13:49.030782 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:13:49.031007 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:13:49.050656 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:13:49.050656 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:49.055024 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:13:49.055024 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:49.066181 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c] added
May 28 10:13:49.066181 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:13:49.066181 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:13:49.066181 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:13:49.066181 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:13:49.066181 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:13:49.066181 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:49.066181 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:13:49.066181 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0339(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:13:49.066181 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:13:49.067421 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c] added
May 28 10:13:49.067421 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:13:49.067421 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:13:49.067421 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:13:49.067421 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:13:49.067421 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:13:49.067421 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:49.067609 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:13:49.067743 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0368(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:13:49.067919 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:13:49.132579 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e71fe553-205d-4a29-a6f1-356bbd82ce8a tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Lock "405de22b-28c5-4415-ad12-e7e8eae4d591" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.567s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:49.183344 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-943ad4bf-8845-4bc6-9643-8b20ccd3afec req-347f3be5-31ed-4a4c-9fd9-6ec91f3f3544 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:13:49.222804 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-282e26a6-b61a-4786-9c9b-a9153d19de94 req-1d0229f1-a729-4488-864d-73f5e28befce service nova] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Received event network-vif-deleted-8907c86c-3bc6-41a2-ace1-517b5a4a92d1 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:13:49.295032 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-a19289bd-7d7b-4b5f-a2d4-a352f6bf7829 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1281724929',display_name='tempest-SnapshotDataIntegrityTests-server-1281724929',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-snapshotdataintegritytests-server-1281724929',id=64,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP//p93JjTMDcF+im8PeGmK/wl58gP6a7BxpnoQVWv5ovDePLGUTApQw9P+Xmtc35B+7W3kzKS00SjbPUUCMyBC+4xsPsRVsAqtHHGuTdj5MGlQZWnzmbUlOQgkhNSov2A==',key_name='tempest-keypair-1817864279',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:11:31Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e3e75c7b1bb425fbec695f663a73daf',ramdisk_id='',reservation_id='r-dhhvu33l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-331511523',owner_user_name='tempest-SnapshotDataIntegrityTests-331511523-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:11:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3638304e4c654459b76653c84fd9721e',uuid=8849d62e-d9a4-4285-95fc-0869cbf20b4c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7f466f7-9d37-4d28-8e47-ed59abae0631", "address": "fa:16:3e:86:53:88", "network": {"id": "f3b5252e-08d9-46f6-90aa-0484e78196b7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1235374496-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6e3e75c7b1bb425fbec695f663a73daf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f466f7-9d", "ovs_interfaceid": "c7f466f7-9d37-4d28-8e47-ed59abae0631", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:13:49.295425 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-a19289bd-7d7b-4b5f-a2d4-a352f6bf7829 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Converting VIF {"id": "c7f466f7-9d37-4d28-8e47-ed59abae0631", "address": "fa:16:3e:86:53:88", "network": {"id": "f3b5252e-08d9-46f6-90aa-0484e78196b7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1235374496-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6e3e75c7b1bb425fbec695f663a73daf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f466f7-9d", "ovs_interfaceid": "c7f466f7-9d37-4d28-8e47-ed59abae0631", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:13:49.295874 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-a19289bd-7d7b-4b5f-a2d4-a352f6bf7829 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:53:88,bridge_name='br-int',has_traffic_filtering=True,id=c7f466f7-9d37-4d28-8e47-ed59abae0631,network=Network(f3b5252e-08d9-46f6-90aa-0484e78196b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f466f7-9d') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:13:49.296054 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-a19289bd-7d7b-4b5f-a2d4-a352f6bf7829 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:53:88,bridge_name='br-int',has_traffic_filtering=True,id=c7f466f7-9d37-4d28-8e47-ed59abae0631,network=Network(f3b5252e-08d9-46f6-90aa-0484e78196b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f466f7-9d') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:13:49.297574 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:49.297873 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7f466f7-9d, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:13:49.300909 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:49.300909 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:13:49.302728 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:49.302927 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2ab2cb47-fad6-4de7-bbdf-5003ed7460f8) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:13:49.303530 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:49.304185 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:13:49.304474 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:49.310275 np0000001613 nova-compute[98321]: INFO os_vif [None req-a19289bd-7d7b-4b5f-a2d4-a352f6bf7829 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:53:88,bridge_name='br-int',has_traffic_filtering=True,id=c7f466f7-9d37-4d28-8e47-ed59abae0631,network=Network(f3b5252e-08d9-46f6-90aa-0484e78196b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f466f7-9d')
May 28 10:13:49.310275 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-a19289bd-7d7b-4b5f-a2d4-a352f6bf7829 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Deleting instance files /opt/stack/data/nova/instances/8849d62e-d9a4-4285-95fc-0869cbf20b4c_del
May 28 10:13:49.310275 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-a19289bd-7d7b-4b5f-a2d4-a352f6bf7829 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Deletion of /opt/stack/data/nova/instances/8849d62e-d9a4-4285-95fc-0869cbf20b4c_del complete
May 28 10:13:49.390696 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Took 0.55 seconds to detach 1 volumes for instance.
May 28 10:13:49.490120 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-943ad4bf-8845-4bc6-9643-8b20ccd3afec req-347f3be5-31ed-4a4c-9fd9-6ec91f3f3544 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:13:49.495636 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-84481076-c61b-4031-a914-977f495c3f41 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.985s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:49.643024 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-943ad4bf-8845-4bc6-9643-8b20ccd3afec req-347f3be5-31ed-4a4c-9fd9-6ec91f3f3544 service nova] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Updated VIF entry in instance network info cache for port 4ba3c950-6075-4485-8352-d019b6137361. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:13:49.644049 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-943ad4bf-8845-4bc6-9643-8b20ccd3afec req-347f3be5-31ed-4a4c-9fd9-6ec91f3f3544 service nova] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Updating instance_info_cache with network_info: [{"id": "4ba3c950-6075-4485-8352-d019b6137361", "address": "fa:16:3e:38:91:9c", "network": {"id": "83f5548a-aebf-46e0-a4d2-07f06d3967d4", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1141449765-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d80b528594ac4ee5b3b56bf7c94c7ffa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ba3c950-60", "ovs_interfaceid": "4ba3c950-6075-4485-8352-d019b6137361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:13:49.815148 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a19289bd-7d7b-4b5f-a2d4-a352f6bf7829 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Took 1.36 seconds to destroy the instance on the hypervisor.
May 28 10:13:49.815818 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-a19289bd-7d7b-4b5f-a2d4-a352f6bf7829 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:13:49.815986 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:13:49.816132 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:13:49.816370 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:13:49.895809 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:49.895985 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:49.945806 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:13:50.017483 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:50.064914 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:13:50.071184 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:13:50.077370 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:13:50.077370 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:13:50.083737 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:13:50.083737 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:50.094361 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:50.099795 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:50.109523 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:50.109523 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:50.109523 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:13:50.109643 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsi session list stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:50.109643 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:50.109643 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:13:50.114927 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:50.114927 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:50.114927 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:13:50.115065 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsi session list stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:50.115065 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:50.115065 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:13:50.139758 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c, portal: 192.168.40.100,3260]
May 28 10:13:50.139758 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c, portal: 192.168.40.100,3260] successful.
May 28 10:13:50.139758 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:50.144722 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c, portal: 192.168.50.100,3260]
May 28 10:13:50.144722 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c, portal: 192.168.50.100,3260] successful.
May 28 10:13:50.144722 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:50.147920 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-943ad4bf-8845-4bc6-9643-8b20ccd3afec req-347f3be5-31ed-4a4c-9fd9-6ec91f3f3544 service nova] Releasing lock "refresh_cache-bf181571-acd7-4482-90b1-50b7223411fc" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:13:50.155359 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:50.160610 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:13:50.171349 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:50.171349 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:50.171349 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:13:50.171349 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:13:50.171349 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:13:50.171541 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsi session list stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:50.171541 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:50.171541 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:13:50.171541 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:13:50.171541 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:13:50.171718 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.143s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:13:50.171817 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:13:50.172411 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] HCTL ('7', '-', '-', 0) found on session 189 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:13:50.172507 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:13:50.178879 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:50.178879 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:50.178879 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:13:50.178879 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:13:50.178879 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:13:50.179028 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsi session list stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:50.179028 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:13:50.179028 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:13:50.179028 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:13:50.179028 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:13:50.179276 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.149s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:13:50.179438 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:13:50.179953 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] HCTL ('8', '-', '-', 0) found on session 190 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:13:50.180059 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:13:50.189224 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Searching for a device in session 189 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:13:50.189224 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3e7b8c65-f460-4db9-91ae-2b3e144f0b5c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:13:50.204418 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Searching for a device in session 190 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:13:50.204619 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3e7b8c65-f460-4db9-91ae-2b3e144f0b5c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:13:50.305994 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:13:50.307344 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:13:50.488616 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d9e63668-072d-404e-8f33-21c47dc77416 req-4371d188-ca16-43bc-9557-43d6c787ba6f service nova] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Received event network-vif-deleted-c7f466f7-9d37-4d28-8e47-ed59abae0631 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:13:50.489096 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-d9e63668-072d-404e-8f33-21c47dc77416 req-4371d188-ca16-43bc-9557-43d6c787ba6f service nova] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Neutron deleted interface c7f466f7-9d37-4d28-8e47-ed59abae0631; detaching it from the instance and deleting it from the info cache
May 28 10:13:50.490512 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-d9e63668-072d-404e-8f33-21c47dc77416 req-4371d188-ca16-43bc-9557-43d6c787ba6f service nova] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Detach interface failed, port_id=c7f466f7-9d37-4d28-8e47-ed59abae0631, reason: Instance 8849d62e-d9a4-4285-95fc-0869cbf20b4c could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:13:50.709329 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-eef6994a-068b-4fad-98ed-33eca9bc744e req-582ea6d9-812c-494f-8f47-a9fd1e71ad1c service nova] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Received event network-vif-unplugged-c7f466f7-9d37-4d28-8e47-ed59abae0631 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:13:50.709710 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-eef6994a-068b-4fad-98ed-33eca9bc744e req-582ea6d9-812c-494f-8f47-a9fd1e71ad1c service nova] Acquiring lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:50.709849 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-eef6994a-068b-4fad-98ed-33eca9bc744e req-582ea6d9-812c-494f-8f47-a9fd1e71ad1c service nova] Lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:50.709962 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-eef6994a-068b-4fad-98ed-33eca9bc744e req-582ea6d9-812c-494f-8f47-a9fd1e71ad1c service nova] Lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:50.710305 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-eef6994a-068b-4fad-98ed-33eca9bc744e req-582ea6d9-812c-494f-8f47-a9fd1e71ad1c service nova] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] No waiting events found dispatching network-vif-unplugged-c7f466f7-9d37-4d28-8e47-ed59abae0631 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:13:50.710422 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-eef6994a-068b-4fad-98ed-33eca9bc744e req-582ea6d9-812c-494f-8f47-a9fd1e71ad1c service nova] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Received event network-vif-unplugged-c7f466f7-9d37-4d28-8e47-ed59abae0631 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:13:50.808982 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:13:50.925948 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ac5dc904-ca25-4442-b160-57ae4309c970 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:50.926387 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ac5dc904-ca25-4442-b160-57ae4309c970 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:50.926387 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ac5dc904-ca25-4442-b160-57ae4309c970 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:50.926556 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ac5dc904-ca25-4442-b160-57ae4309c970 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:50.926750 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ac5dc904-ca25-4442-b160-57ae4309c970 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:50.929498 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-ac5dc904-ca25-4442-b160-57ae4309c970 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Terminating instance
May 28 10:13:50.943401 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:13:51.030970 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:13:51.315240 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.419s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:51.360862 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Deleted allocations for instance 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5
May 28 10:13:51.432526 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-ac5dc904-ca25-4442-b160-57ae4309c970 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:13:51.445447 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Took 1.63 seconds to deallocate network for instance.
May 28 10:13:51.449192 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:51.451290 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:51.470501 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:51.476275 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:51.493211 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:51.497726 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:51.761687 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999632656999893 future=<Future at 0x73c1fc2d4da0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:13:51.763693 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Instance destroyed successfully.
May 28 10:13:51.764055 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-ac5dc904-ca25-4442-b160-57ae4309c970 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lazy-loading 'resources' on Instance uuid 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:13:51.951418 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a19289bd-7d7b-4b5f-a2d4-a352f6bf7829 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:51.951857 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a19289bd-7d7b-4b5f-a2d4-a352f6bf7829 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:52.051648 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Found WWN 330000000ccc2d9bd for multipath device dm-0 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:13:52.051911 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:13:52.052067 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '330000000ccc2d9bd', 'path': '/dev/dm-0', 'multipath_id': '330000000ccc2d9bd'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:13:52.052226 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ccc2d9bd', 'path': '/dev/dm-0', 'multipath_id': '330000000ccc2d9bd'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:13:52.210474 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a19289bd-7d7b-4b5f-a2d4-a352f6bf7829 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:13:52.210704 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-a19289bd-7d7b-4b5f-a2d4-a352f6bf7829 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:13:52.266819 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-ac5dc904-ca25-4442-b160-57ae4309c970 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:12:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1279174109',display_name='tempest-TestMinimumBasicScenario-server-1279174109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testminimumbasicscenario-server-1279174109',id=67,image_ref='878a1682-ebcd-4fd7-9461-1644d7fc7535',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7kslxWNTrBewiPEbe147CLpXkM+/J6loy5QWlKpBcVKens6+9CBUWERBXi7HXqJ48X208nhfn5DKMI+Q8liIVY6ZwgaAQpHfxF1Qk9jVXVgPX2aw4Gfw90ZyD4nG2HqA==',key_name='tempest-TestMinimumBasicScenario-860378945',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:12:25Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44f9e47b0cb84ec9a96e9ee54854c98d',ramdisk_id='',reservation_id='r-4zc6pq93',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='878a1682-ebcd-4fd7-9461-1644d7fc7535',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-63484617',owner_user_name='tempest-TestMinimumBasicScenario-63484617-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:13:08Z,user_data=None,user_id='4631f2d316394d08825f7c3295412feb',uuid=3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04633d7b-a11f-4e7a-bd98-683a082e8a73", "address": "fa:16:3e:f0:49:ef", "network": {"id": "db344666-4990-47d9-a3a2-9bebce64e660", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1492927350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44f9e47b0cb84ec9a96e9ee54854c98d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04633d7b-a1", "ovs_interfaceid": "04633d7b-a11f-4e7a-bd98-683a082e8a73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:13:52.267046 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ac5dc904-ca25-4442-b160-57ae4309c970 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Converting VIF {"id": "04633d7b-a11f-4e7a-bd98-683a082e8a73", "address": "fa:16:3e:f0:49:ef", "network": {"id": "db344666-4990-47d9-a3a2-9bebce64e660", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1492927350-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44f9e47b0cb84ec9a96e9ee54854c98d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04633d7b-a1", "ovs_interfaceid": "04633d7b-a11f-4e7a-bd98-683a082e8a73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:13:52.267779 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-ac5dc904-ca25-4442-b160-57ae4309c970 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:49:ef,bridge_name='br-int',has_traffic_filtering=True,id=04633d7b-a11f-4e7a-bd98-683a082e8a73,network=Network(db344666-4990-47d9-a3a2-9bebce64e660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04633d7b-a1') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:13:52.268057 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-ac5dc904-ca25-4442-b160-57ae4309c970 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:49:ef,bridge_name='br-int',has_traffic_filtering=True,id=04633d7b-a11f-4e7a-bd98-683a082e8a73,network=Network(db344666-4990-47d9-a3a2-9bebce64e660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04633d7b-a1') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:13:52.270140 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:52.270140 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04633d7b-a1, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:13:52.271677 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:52.271677 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:13:52.275852 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:52.276888 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:52.276888 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=71c332b5-cc61-434a-a9da-22a31bc787ec) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:13:52.278353 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:52.278353 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:13:52.278353 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:52.280463 np0000001613 nova-compute[98321]: INFO os_vif [None req-ac5dc904-ca25-4442-b160-57ae4309c970 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:49:ef,bridge_name='br-int',has_traffic_filtering=True,id=04633d7b-a11f-4e7a-bd98-683a082e8a73,network=Network(db344666-4990-47d9-a3a2-9bebce64e660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04633d7b-a1')
May 28 10:13:52.280813 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-ac5dc904-ca25-4442-b160-57ae4309c970 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Deleting instance files /opt/stack/data/nova/instances/3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd_del
May 28 10:13:52.281795 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-ac5dc904-ca25-4442-b160-57ae4309c970 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Deletion of /opt/stack/data/nova/instances/3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd_del complete
May 28 10:13:52.369545 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f803a49-a287-4289-b525-f1f01f28963f tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.366s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:52.557455 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:13:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1166496640',display_name='tempest-TestVolumeBootPatternV346-server-1166496640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpatternv346-server-1166496640',id=72,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDovb6GcHgfJLeWhkHeKDk4pr+NYI9gRs5uwNkn54JOZpQHE3U5GYfLmxjgF7LyGlOvcApcsHheS/8INQnLBu7/CCYA9CtGqCv0qIUbHvDdVeVbaSFNRFcHIsB/jI3EHHg==',key_name='tempest-keypair-1639758246',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d80b528594ac4ee5b3b56bf7c94c7ffa',ramdisk_id='',reservation_id='r-59apzmeq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-204163382',owner_user_name='tempest-TestVolumeBootPatternV346-204163382-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:13:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ffa50296592417a99dd0566355e09f9',uuid=bf181571-acd7-4482-90b1-50b7223411fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ba3c950-6075-4485-8352-d019b6137361", "address": "fa:16:3e:38:91:9c", "network": {"id": "83f5548a-aebf-46e0-a4d2-07f06d3967d4", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1141449765-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d80b528594ac4ee5b3b56bf7c94c7ffa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ba3c950-60", "ovs_interfaceid": "4ba3c950-6075-4485-8352-d019b6137361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:13:52.557730 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Converting VIF {"id": "4ba3c950-6075-4485-8352-d019b6137361", "address": "fa:16:3e:38:91:9c", "network": {"id": "83f5548a-aebf-46e0-a4d2-07f06d3967d4", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1141449765-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d80b528594ac4ee5b3b56bf7c94c7ffa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ba3c950-60", "ovs_interfaceid": "4ba3c950-6075-4485-8352-d019b6137361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:13:52.558338 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:91:9c,bridge_name='br-int',has_traffic_filtering=True,id=4ba3c950-6075-4485-8352-d019b6137361,network=Network(83f5548a-aebf-46e0-a4d2-07f06d3967d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ba3c950-60') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:13:52.559733 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lazy-loading 'pci_devices' on Instance uuid bf181571-acd7-4482-90b1-50b7223411fc {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:13:52.713141 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-a19289bd-7d7b-4b5f-a2d4-a352f6bf7829 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:13:52.762929 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-603dd965-3de2-449b-8e4d-8dfdcf4430ce req-1202e5c0-9f73-49dc-afd9-1442aa9e3e7c service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Received event network-vif-unplugged-04633d7b-a11f-4e7a-bd98-683a082e8a73 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:13:52.763157 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-603dd965-3de2-449b-8e4d-8dfdcf4430ce req-1202e5c0-9f73-49dc-afd9-1442aa9e3e7c service nova] Acquiring lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:52.763439 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-603dd965-3de2-449b-8e4d-8dfdcf4430ce req-1202e5c0-9f73-49dc-afd9-1442aa9e3e7c service nova] Lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:52.763622 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-603dd965-3de2-449b-8e4d-8dfdcf4430ce req-1202e5c0-9f73-49dc-afd9-1442aa9e3e7c service nova] Lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:52.763810 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-603dd965-3de2-449b-8e4d-8dfdcf4430ce req-1202e5c0-9f73-49dc-afd9-1442aa9e3e7c service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] No waiting events found dispatching network-vif-unplugged-04633d7b-a11f-4e7a-bd98-683a082e8a73 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:13:52.763978 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-603dd965-3de2-449b-8e4d-8dfdcf4430ce req-1202e5c0-9f73-49dc-afd9-1442aa9e3e7c service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Received event network-vif-unplugged-04633d7b-a11f-4e7a-bd98-683a082e8a73 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:13:52.764614 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-603dd965-3de2-449b-8e4d-8dfdcf4430ce req-1202e5c0-9f73-49dc-afd9-1442aa9e3e7c service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Received event network-vif-unplugged-04633d7b-a11f-4e7a-bd98-683a082e8a73 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:13:52.764870 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-603dd965-3de2-449b-8e4d-8dfdcf4430ce req-1202e5c0-9f73-49dc-afd9-1442aa9e3e7c service nova] Acquiring lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:52.765050 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-603dd965-3de2-449b-8e4d-8dfdcf4430ce req-1202e5c0-9f73-49dc-afd9-1442aa9e3e7c service nova] Lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:52.765267 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-603dd965-3de2-449b-8e4d-8dfdcf4430ce req-1202e5c0-9f73-49dc-afd9-1442aa9e3e7c service nova] Lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:52.765455 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-603dd965-3de2-449b-8e4d-8dfdcf4430ce req-1202e5c0-9f73-49dc-afd9-1442aa9e3e7c service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] No waiting events found dispatching network-vif-unplugged-04633d7b-a11f-4e7a-bd98-683a082e8a73 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:13:52.765626 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-603dd965-3de2-449b-8e4d-8dfdcf4430ce req-1202e5c0-9f73-49dc-afd9-1442aa9e3e7c service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Received event network-vif-unplugged-04633d7b-a11f-4e7a-bd98-683a082e8a73 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:13:52.788247 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-ac5dc904-ca25-4442-b160-57ae4309c970 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Took 1.36 seconds to destroy the instance on the hypervisor.
May 28 10:13:52.788828 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-ac5dc904-ca25-4442-b160-57ae4309c970 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:13:52.789025 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:13:52.789131 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:13:52.789378 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:13:52.850046 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:13:53.062788 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] End _get_guest_xml xml=<domain type="qemu">
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:   <uuid>bf181571-acd7-4482-90b1-50b7223411fc</uuid>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:   <name>instance-00000048</name>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:       <nova:name>tempest-TestVolumeBootPatternV346-server-1166496640</nova:name>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:13:48</nova:creationTime>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:       <nova:image uuid="">
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:         <nova:user uuid="7ffa50296592417a99dd0566355e09f9">tempest-TestVolumeBootPatternV346-204163382-project-member</nova:user>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:         <nova:project uuid="d80b528594ac4ee5b3b56bf7c94c7ffa">tempest-TestVolumeBootPatternV346-204163382</nova:project>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:       <nova:root type="volume" uuid=""/>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:         <nova:port uuid="4ba3c950-6075-4485-8352-d019b6137361">
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:     <system>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:       <entry name="serial">bf181571-acd7-4482-90b1-50b7223411fc</entry>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:       <entry name="uuid">bf181571-acd7-4482-90b1-50b7223411fc</entry>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:     </system>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:   <os>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:   </os>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:   <features>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:   </features>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:   <devices>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/bf181571-acd7-4482-90b1-50b7223411fc/disk.config"/>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:     </disk>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:       <alias name="ua-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c"/>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-0"/>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:       <serial>3e7b8c65-f460-4db9-91ae-2b3e144f0b5c</serial>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:     </disk>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:38:91:9c"/>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:       <target dev="tap4ba3c950-60"/>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:     </interface>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/bf181571-acd7-4482-90b1-50b7223411fc/console.log" append="off"/>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:     </serial>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:     <video>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:     </video>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:     </rng>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:   </devices>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]: </domain>
May 28 10:13:53.062788 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:13:53.069179 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Preparing to wait for external event network-vif-plugged-4ba3c950-6075-4485-8352-d019b6137361 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:13:53.069179 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Acquiring lock "bf181571-acd7-4482-90b1-50b7223411fc-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:53.069179 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "bf181571-acd7-4482-90b1-50b7223411fc-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:53.069179 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "bf181571-acd7-4482-90b1-50b7223411fc-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:53.069179 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:13:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1166496640',display_name='tempest-TestVolumeBootPatternV346-server-1166496640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpatternv346-server-1166496640',id=72,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDovb6GcHgfJLeWhkHeKDk4pr+NYI9gRs5uwNkn54JOZpQHE3U5GYfLmxjgF7LyGlOvcApcsHheS/8INQnLBu7/CCYA9CtGqCv0qIUbHvDdVeVbaSFNRFcHIsB/jI3EHHg==',key_name='tempest-keypair-1639758246',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d80b528594ac4ee5b3b56bf7c94c7ffa',ramdisk_id='',reservation_id='r-59apzmeq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-204163382',owner_user_name='tempest-TestVolumeBootPatternV346-204163382-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:13:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ffa50296592417a99dd0566355e09f9',uuid=bf181571-acd7-4482-90b1-50b7223411fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ba3c950-6075-4485-8352-d019b6137361", "address": "fa:16:3e:38:91:9c", "network": {"id": "83f5548a-aebf-46e0-a4d2-07f06d3967d4", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1141449765-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d80b528594ac4ee5b3b56bf7c94c7ffa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ba3c950-60", "ovs_interfaceid": "4ba3c950-6075-4485-8352-d019b6137361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:13:53.069179 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Converting VIF {"id": "4ba3c950-6075-4485-8352-d019b6137361", "address": "fa:16:3e:38:91:9c", "network": {"id": "83f5548a-aebf-46e0-a4d2-07f06d3967d4", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1141449765-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d80b528594ac4ee5b3b56bf7c94c7ffa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ba3c950-60", "ovs_interfaceid": "4ba3c950-6075-4485-8352-d019b6137361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:13:53.069179 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:91:9c,bridge_name='br-int',has_traffic_filtering=True,id=4ba3c950-6075-4485-8352-d019b6137361,network=Network(83f5548a-aebf-46e0-a4d2-07f06d3967d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ba3c950-60') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:13:53.069179 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:91:9c,bridge_name='br-int',has_traffic_filtering=True,id=4ba3c950-6075-4485-8352-d019b6137361,network=Network(83f5548a-aebf-46e0-a4d2-07f06d3967d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ba3c950-60') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:13:53.069179 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:53.069179 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:13:53.069179 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:13:53.069179 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:53.069179 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b2855ce5-839e-52a9-8c61-82de1f9aa1ee', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:13:53.070117 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:53.070316 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:13:53.072564 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:53.072709 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ba3c950-60, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:13:53.073008 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4ba3c950-60, col_values=(('qos', UUID('57e16dc3-4470-4969-8828-9d5dfda99486')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:13:53.073256 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4ba3c950-60, col_values=(('external_ids', {'iface-id': '4ba3c950-6075-4485-8352-d019b6137361', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:91:9c', 'vm-uuid': 'bf181571-acd7-4482-90b1-50b7223411fc'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:13:53.075335 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:53.076891 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:13:53.080157 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:53.081327 np0000001613 nova-compute[98321]: INFO os_vif [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:91:9c,bridge_name='br-int',has_traffic_filtering=True,id=4ba3c950-6075-4485-8352-d019b6137361,network=Network(83f5548a-aebf-46e0-a4d2-07f06d3967d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ba3c950-60')
May 28 10:13:53.141346 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f4feb1c3-79fb-471a-9597-4fdeebc55ea4 req-3ee14f46-7183-4d9b-9836-66a8e75e6d91 service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Received event network-vif-deleted-04633d7b-a11f-4e7a-bd98-683a082e8a73 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:13:53.141500 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-f4feb1c3-79fb-471a-9597-4fdeebc55ea4 req-3ee14f46-7183-4d9b-9836-66a8e75e6d91 service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Neutron deleted interface 04633d7b-a11f-4e7a-bd98-683a082e8a73; detaching it from the instance and deleting it from the info cache
May 28 10:13:53.143420 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f4feb1c3-79fb-471a-9597-4fdeebc55ea4 req-3ee14f46-7183-4d9b-9836-66a8e75e6d91 service nova] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Detach interface failed, port_id=04633d7b-a11f-4e7a-bd98-683a082e8a73, reason: Instance 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:13:53.220276 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a19289bd-7d7b-4b5f-a2d4-a352f6bf7829 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.269s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:53.267063 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-a19289bd-7d7b-4b5f-a2d4-a352f6bf7829 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Deleted allocations for instance 8849d62e-d9a4-4285-95fc-0869cbf20b4c
May 28 10:13:53.597950 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:13:54.100941 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Took 1.31 seconds to deallocate network for instance.
May 28 10:13:54.275767 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a19289bd-7d7b-4b5f-a2d4-a352f6bf7829 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Lock "8849d62e-d9a4-4285-95fc-0869cbf20b4c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.324s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:54.281189 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "0327fb6e-6b30-4f70-8877-a3859969f5ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:54.281405 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "0327fb6e-6b30-4f70-8877-a3859969f5ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:54.604000 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:13:54.604122 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:13:54.604256 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] No VIF found with MAC fa:16:3e:38:91:9c, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:13:54.604626 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Using config drive
May 28 10:13:54.606941 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ac5dc904-ca25-4442-b160-57ae4309c970 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:54.606941 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ac5dc904-ca25-4442-b160-57ae4309c970 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:54.783718 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:13:54.894218 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-ac5dc904-ca25-4442-b160-57ae4309c970 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:13:54.894490 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-ac5dc904-ca25-4442-b160-57ae4309c970 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:13:55.019652 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:55.110735 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:13:55.247612 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Creating config drive at /opt/stack/data/nova/instances/bf181571-acd7-4482-90b1-50b7223411fc/disk.config
May 28 10:13:55.262819 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bf181571-acd7-4482-90b1-50b7223411fc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsq4abdax {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:13:55.331539 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bf181571-acd7-4482-90b1-50b7223411fc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsq4abdax" returned: 0 in 0.069s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:13:55.351050 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:55.398643 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-ac5dc904-ca25-4442-b160-57ae4309c970 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:13:55.908203 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ac5dc904-ca25-4442-b160-57ae4309c970 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.301s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:55.909888 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.558s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:55.918461 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:13:55.918619 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Claim successful on node np0000001613
May 28 10:13:55.935831 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:55.964315 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:55.987393 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-ac5dc904-ca25-4442-b160-57ae4309c970 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Deleted allocations for instance 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd
May 28 10:13:56.063676 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:56.147353 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:56.148249 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:56.242579 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7428543b-b394-4536-ba00-bfbf8c21de0b req-c8d3182c-048c-43eb-ae26-f692340d6ca3 service nova] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Received event network-vif-plugged-4ba3c950-6075-4485-8352-d019b6137361 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:13:56.244496 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7428543b-b394-4536-ba00-bfbf8c21de0b req-c8d3182c-048c-43eb-ae26-f692340d6ca3 service nova] Acquiring lock "bf181571-acd7-4482-90b1-50b7223411fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:56.244496 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7428543b-b394-4536-ba00-bfbf8c21de0b req-c8d3182c-048c-43eb-ae26-f692340d6ca3 service nova] Lock "bf181571-acd7-4482-90b1-50b7223411fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:56.244496 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7428543b-b394-4536-ba00-bfbf8c21de0b req-c8d3182c-048c-43eb-ae26-f692340d6ca3 service nova] Lock "bf181571-acd7-4482-90b1-50b7223411fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:56.245209 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7428543b-b394-4536-ba00-bfbf8c21de0b req-c8d3182c-048c-43eb-ae26-f692340d6ca3 service nova] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Processing event network-vif-plugged-4ba3c950-6075-4485-8352-d019b6137361 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:13:56.820733 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:13:56.821266 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963236.8208475, bf181571-acd7-4482-90b1-50b7223411fc => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:13:56.821649 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: bf181571-acd7-4482-90b1-50b7223411fc] VM Started (Lifecycle Event)
May 28 10:13:56.824507 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:13:56.828400 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Instance spawned successfully.
May 28 10:13:56.828870 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:13:56.949267 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:57.003634 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-ac5dc904-ca25-4442-b160-57ae4309c970 tempest-TestMinimumBasicScenario-63484617 tempest-TestMinimumBasicScenario-63484617-project-member] Lock "3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.076s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:57.211100 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:13:57.211100 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:13:57.325586 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:13:57.329332 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:13:57.349841 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:13:57.350024 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:13:57.350343 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:13:57.350510 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:13:57.350794 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:13:57.351009 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:13:57.713816 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:13:57.848033 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: bf181571-acd7-4482-90b1-50b7223411fc] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:13:57.848033 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963237.8477223, bf181571-acd7-4482-90b1-50b7223411fc => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:13:57.848285 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: bf181571-acd7-4482-90b1-50b7223411fc] VM Paused (Lifecycle Event)
May 28 10:13:57.858503 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Took 8.87 seconds to spawn the instance on the hypervisor.
May 28 10:13:57.858706 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:13:58.075871 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:58.227454 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.318s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:58.227454 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:13:58.342624 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7855a012-2c67-4d9a-b3f3-0d8259da3b98 req-b57d34dd-605b-4a23-b991-8dacd358f2e9 service nova] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Received event network-vif-plugged-4ba3c950-6075-4485-8352-d019b6137361 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:13:58.343105 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7855a012-2c67-4d9a-b3f3-0d8259da3b98 req-b57d34dd-605b-4a23-b991-8dacd358f2e9 service nova] Acquiring lock "bf181571-acd7-4482-90b1-50b7223411fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:13:58.343591 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7855a012-2c67-4d9a-b3f3-0d8259da3b98 req-b57d34dd-605b-4a23-b991-8dacd358f2e9 service nova] Lock "bf181571-acd7-4482-90b1-50b7223411fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:13:58.343629 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7855a012-2c67-4d9a-b3f3-0d8259da3b98 req-b57d34dd-605b-4a23-b991-8dacd358f2e9 service nova] Lock "bf181571-acd7-4482-90b1-50b7223411fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:58.343758 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7855a012-2c67-4d9a-b3f3-0d8259da3b98 req-b57d34dd-605b-4a23-b991-8dacd358f2e9 service nova] [instance: bf181571-acd7-4482-90b1-50b7223411fc] No waiting events found dispatching network-vif-plugged-4ba3c950-6075-4485-8352-d019b6137361 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:13:58.343869 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-7855a012-2c67-4d9a-b3f3-0d8259da3b98 req-b57d34dd-605b-4a23-b991-8dacd358f2e9 service nova] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Received unexpected event network-vif-plugged-4ba3c950-6075-4485-8352-d019b6137361 for instance with vm_state active and task_state None.
May 28 10:13:58.352246 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:13:58.355148 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963238.354889, bf181571-acd7-4482-90b1-50b7223411fc => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:13:58.355356 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: bf181571-acd7-4482-90b1-50b7223411fc] VM Resumed (Lifecycle Event)
May 28 10:13:58.372536 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Took 16.23 seconds to build instance.
May 28 10:13:58.422001 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0005544769996959076 future=<Future at 0x73c1f418e660 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:13:58.422001 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:13:58.422001 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=2.445936558000085 future=<Future at 0x73c1f4311640 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:13:58.422283 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=2.4458295389999876 future=<Future at 0x73c1f4311640 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:13:58.422607 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Emitting event <LifecycleEvent: 1779963223.4210343, 405de22b-28c5-4415-ad12-e7e8eae4d591 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:13:58.422781 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] VM Stopped (Lifecycle Event)
May 28 10:13:58.739672 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:13:58.739935 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:13:58.743129 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:13:58.743638 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:13:58.847204 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec58233d3b2848bbb2e0b00650398cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e9651268114327a9cc6c6c59bef01e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:13:58.857840 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:13:58.860743 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:13:58.874577 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a16d2470-2ff9-4b98-9560-c599276a7247 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "bf181571-acd7-4482-90b1-50b7223411fc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.738s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:13:58.929991 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: 405de22b-28c5-4415-ad12-e7e8eae4d591] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:13:59.190156 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:59.248091 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:13:59.440568 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Successfully created port: 4e515a16-b64c-41b0-8aac-6c77cd0b75cd {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:13:59.632756 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:13:59.753579 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:13:59.793723 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:13:59.793723 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 10:13:59.793723 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:14:00.024242 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:00.037484 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Successfully updated port: 4e515a16-b64c-41b0-8aac-6c77cd0b75cd {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:14:00.106543 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-91ef86e2-1f17-449c-a961-f35295a6b1f0 req-9fdc4e63-1c4f-4782-a642-02abf9277a80 service nova] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Received event network-changed-4e515a16-b64c-41b0-8aac-6c77cd0b75cd {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:14:00.107683 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-91ef86e2-1f17-449c-a961-f35295a6b1f0 req-9fdc4e63-1c4f-4782-a642-02abf9277a80 service nova] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Refreshing instance network info cache due to event network-changed-4e515a16-b64c-41b0-8aac-6c77cd0b75cd. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:14:00.108103 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-91ef86e2-1f17-449c-a961-f35295a6b1f0 req-9fdc4e63-1c4f-4782-a642-02abf9277a80 service nova] Acquiring lock "refresh_cache-0327fb6e-6b30-4f70-8877-a3859969f5ca" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:14:00.110368 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-91ef86e2-1f17-449c-a961-f35295a6b1f0 req-9fdc4e63-1c4f-4782-a642-02abf9277a80 service nova] Acquired lock "refresh_cache-0327fb6e-6b30-4f70-8877-a3859969f5ca" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:14:00.110368 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-91ef86e2-1f17-449c-a961-f35295a6b1f0 req-9fdc4e63-1c4f-4782-a642-02abf9277a80 service nova] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Refreshing network info cache for port 4e515a16-b64c-41b0-8aac-6c77cd0b75cd {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:14:00.258524 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Booting with volume b23f5880-1872-41fd-becc-baf8432031f3 at /dev/vda
May 28 10:14:00.319289 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:14:00.336836 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:14:00.361745 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:14:00.411150 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:14:00.411562 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:14:00.421777 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:14:00.422766 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe49:8be9', 'fe80::2c59:8cff:fea1:3a8', 'fe80::fc16:3eff:fe57:fe26', 'fe80::e4bc:c7ff:fe7f:dc5f', 'fe80::fc16:3eff:fe38:919c'] 
May 28 10:14:00.422901 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:14:00.423031 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:14:00.423223 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:14:00.423443 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Updating existing volume attachment record: 159b060d-cced-485e-8e0f-d3784bc1bb8f {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:14:00.429241 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a7338ead-8915-4b44-93b0-295b7bb8700e req-91aa2d87-b7e4-4520-8b91-59bd914e4fd7 service nova] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Received event network-changed-4ba3c950-6075-4485-8352-d019b6137361 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:14:00.430049 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a7338ead-8915-4b44-93b0-295b7bb8700e req-91aa2d87-b7e4-4520-8b91-59bd914e4fd7 service nova] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Refreshing instance network info cache due to event network-changed-4ba3c950-6075-4485-8352-d019b6137361. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:14:00.430527 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a7338ead-8915-4b44-93b0-295b7bb8700e req-91aa2d87-b7e4-4520-8b91-59bd914e4fd7 service nova] Acquiring lock "refresh_cache-bf181571-acd7-4482-90b1-50b7223411fc" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:14:00.430610 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a7338ead-8915-4b44-93b0-295b7bb8700e req-91aa2d87-b7e4-4520-8b91-59bd914e4fd7 service nova] Acquired lock "refresh_cache-bf181571-acd7-4482-90b1-50b7223411fc" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:14:00.430989 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-a7338ead-8915-4b44-93b0-295b7bb8700e req-91aa2d87-b7e4-4520-8b91-59bd914e4fd7 service nova] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Refreshing network info cache for port 4ba3c950-6075-4485-8352-d019b6137361 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:14:00.539790 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "refresh_cache-0327fb6e-6b30-4f70-8877-a3859969f5ca" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:14:00.612385 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-91ef86e2-1f17-449c-a961-f35295a6b1f0 req-9fdc4e63-1c4f-4782-a642-02abf9277a80 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:14:00.693707 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-91ef86e2-1f17-449c-a961-f35295a6b1f0 req-9fdc4e63-1c4f-4782-a642-02abf9277a80 service nova] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:14:00.792517 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:14:00.792719 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:14:00.792987 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:14:00.831388 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-91ef86e2-1f17-449c-a961-f35295a6b1f0 req-9fdc4e63-1c4f-4782-a642-02abf9277a80 service nova] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:14:00.868434 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0004682560002038372 future=<Future at 0x73c1f4311640 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:14:00.868561 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:14:00.868635 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=2.9201592240001446 future=<Future at 0x73c1f40b5460 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:14:00.868712 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=2.9200659400003133 future=<Future at 0x73c1f40b5460 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:14:00.869314 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] Emitting event <LifecycleEvent: 1779963225.8678577, 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:14:00.869519 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] VM Stopped (Lifecycle Event)
May 28 10:14:00.933699 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-a7338ead-8915-4b44-93b0-295b7bb8700e req-91aa2d87-b7e4-4520-8b91-59bd914e4fd7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:14:01.271246 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-a7338ead-8915-4b44-93b0-295b7bb8700e req-91aa2d87-b7e4-4520-8b91-59bd914e4fd7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:14:01.333302 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-91ef86e2-1f17-449c-a961-f35295a6b1f0 req-9fdc4e63-1c4f-4782-a642-02abf9277a80 service nova] Releasing lock "refresh_cache-0327fb6e-6b30-4f70-8877-a3859969f5ca" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:14:01.334700 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquired lock "refresh_cache-0327fb6e-6b30-4f70-8877-a3859969f5ca" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:14:01.334831 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:14:01.375603 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bdb86d2d-3a0e-4260-89ae-c30ecc01104f tempest-TestInstancesWithCinderVolumes-1983686635 tempest-TestInstancesWithCinderVolumes-1983686635-project-member] [instance: 9f8f6b6c-da6e-4c0f-9573-7f50994c3fb5] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:14:01.419252 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-a7338ead-8915-4b44-93b0-295b7bb8700e req-91aa2d87-b7e4-4520-8b91-59bd914e4fd7 service nova] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Updated VIF entry in instance network info cache for port 4ba3c950-6075-4485-8352-d019b6137361. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:14:01.419559 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-a7338ead-8915-4b44-93b0-295b7bb8700e req-91aa2d87-b7e4-4520-8b91-59bd914e4fd7 service nova] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Updating instance_info_cache with network_info: [{"id": "4ba3c950-6075-4485-8352-d019b6137361", "address": "fa:16:3e:38:91:9c", "network": {"id": "83f5548a-aebf-46e0-a4d2-07f06d3967d4", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1141449765-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d80b528594ac4ee5b3b56bf7c94c7ffa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ba3c950-60", "ovs_interfaceid": "4ba3c950-6075-4485-8352-d019b6137361", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:14:01.791622 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:14:01.792707 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:14:01.809754 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:01.905997 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:14:01.922002 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a7338ead-8915-4b44-93b0-295b7bb8700e req-91aa2d87-b7e4-4520-8b91-59bd914e4fd7 service nova] Releasing lock "refresh_cache-bf181571-acd7-4482-90b1-50b7223411fc" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:14:02.084580 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:14:02.269973 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Updating instance_info_cache with network_info: [{"id": "4e515a16-b64c-41b0-8aac-6c77cd0b75cd", "address": "fa:16:3e:ed:76:9b", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e515a16-b6", "ovs_interfaceid": "4e515a16-b64c-41b0-8aac-6c77cd0b75cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:14:02.299127 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:14:02.299614 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:14:02.299614 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:14:02.299796 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Auditing locally available compute resources for np0000001613 (node: np0000001613) {{(pid=98321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 10:14:02.550967 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:14:02.550967 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:14:02.550967 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Creating image(s)
May 28 10:14:02.551867 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Did not create local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 10:14:02.552193 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Ensure instance console log exists: /opt/stack/data/nova/instances/0327fb6e-6b30-4f70-8877-a3859969f5ca/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:14:02.552704 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:14:02.553052 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:14:02.553354 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:14:02.773220 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Releasing lock "refresh_cache-0327fb6e-6b30-4f70-8877-a3859969f5ca" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:14:02.773560 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Instance network_info: |[{"id": "4e515a16-b64c-41b0-8aac-6c77cd0b75cd", "address": "fa:16:3e:ed:76:9b", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e515a16-b6", "ovs_interfaceid": "4e515a16-b64c-41b0-8aac-6c77cd0b75cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:14:02.775218 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Start _get_guest_xml network_info=[{"id": "4e515a16-b64c-41b0-8aac-6c77cd0b75cd", "address": "fa:16:3e:ed:76:9b", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e515a16-b6", "ovs_interfaceid": "4e515a16-b64c-41b0-8aac-6c77cd0b75cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b23f5880-1872-41fd-becc-baf8432031f3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '0327fb6e-6b30-4f70-8877-a3859969f5ca', 'attached_at': '', 'detached_at': '', 'volume_id': 'b23f5880-1872-41fd-becc-baf8432031f3', 'serial': 'b23f5880-1872-41fd-becc-baf8432031f3'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '159b060d-cced-485e-8e0f-d3784bc1bb8f', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:14:02.783820 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:14:02.783820 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-3389747', uuid='0327fb6e-6b30-4f70-8877-a3859969f5ca'), owner=OwnerMeta(userid='ec58233d3b2848bbb2e0b00650398cd1', username='tempest-TestVolumeBootPattern-327944304-project-member', projectid='23e9651268114327a9cc6c6c59bef01e', projectname='tempest-TestVolumeBootPattern-327944304'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4e515a16-b64c-41b0-8aac-6c77cd0b75cd", "address": "fa:16:3e:ed:76:9b", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e515a16-b6", "ovs_interfaceid": "4e515a16-b64c-41b0-8aac-6c77cd0b75cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779963242.7828462) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:14:02.784821 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:14:02.785406 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:14:02.786595 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:14:02.786862 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:14:02.788114 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:14:02.788526 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:14:02.788829 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:14:02.789021 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:14:02.789316 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:14:02.789579 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:14:02.789765 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:14:02.790006 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:14:02.791460 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:14:02.791460 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:14:02.791460 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:14:02.791460 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:14:02.802593 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:14:02.803181 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b23f5880-1872-41fd-becc-baf8432031f3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:14:02.803516 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:14:03.076696 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:03.323877 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:14:03.326096 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:14:03.327911 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cffddf7-ea43-43a0-83c1-6bddb8e42884/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:14:03.431566 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cffddf7-ea43-43a0-83c1-6bddb8e42884/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:14:03.432136 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cffddf7-ea43-43a0-83c1-6bddb8e42884/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:14:03.535471 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cffddf7-ea43-43a0-83c1-6bddb8e42884/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:14:03.542317 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:14:03.544257 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:14:03.608872 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "env LANG=C uptime" returned: 0 in 0.064s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:14:03.608872 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Hypervisor/Node resource view: name=np0000001613 free_ram=12597MB free_disk=72.6800422668457GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 10:14:03.608872 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:14:03.609136 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:14:03.790468 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0016379239996240358 future=<Future at 0x73c1f40b5460 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:14:03.790603 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:14:03.790756 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=2.9705164229999355 future=<Future at 0x73c1fc2d4da0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:14:03.790867 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=2.9703979529999742 future=<Future at 0x73c1fc2d4da0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:14:03.792258 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Emitting event <LifecycleEvent: 1779963228.7887232, 8849d62e-d9a4-4285-95fc-0869cbf20b4c => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:14:03.792258 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] VM Stopped (Lifecycle Event)
May 28 10:14:04.294369 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 8849d62e-d9a4-4285-95fc-0869cbf20b4c] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:14:04.367620 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.563s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:14:04.367620 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b23f5880-1872-41fd-becc-baf8432031f3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:14:04.382352 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:14:04.382830 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:14:04.382983 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:14:04.388849 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:14:04.388849 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:14:04.388849 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:14:04.400249 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:14:04.400249 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:04.407207 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:14:04.407207 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:04.416417 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3] added
May 28 10:14:04.416417 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:14:04.416417 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:14:04.416417 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:14:04.416417 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:14:04.416417 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:14:04.416417 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:04.416765 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:14:04.416765 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0338(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:14:04.416942 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:14:04.421883 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3] added
May 28 10:14:04.421883 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:14:04.421883 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:14:04.421883 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:14:04.421883 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:14:04.421883 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:14:04.421883 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:04.422267 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:14:04.422267 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0376(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:14:04.422452 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:14:04.694620 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 93a38b6d-e199-4653-a617-290247c8e430 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:14:04.694775 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 0cffddf7-ea43-43a0-83c1-6bddb8e42884 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:14:04.694912 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance bf181571-acd7-4482-90b1-50b7223411fc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:14:04.695034 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 0327fb6e-6b30-4f70-8877-a3859969f5ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:14:04.695510 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 10:14:04.695696 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Final resource view: name=np0000001613 phys_ram=24030MB used_ram=1280MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 10:14:03 up 46 min,  2 users,  load average: 7.55, 7.36, 5.62\n', 'num_instances': '4', 'num_vm_active': '3', 'num_task_None': '3', 'num_os_type_None': '4', 'num_proj_d80b528594ac4ee5b3b56bf7c94c7ffa': '2', 'io_workload': '1', 'num_proj_f4005d70969740a687a13ecb27e151a9': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_23e9651268114327a9cc6c6c59bef01e': '1'} {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 10:14:04.982938 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:14:04.983181 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:14:05.028076 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:05.417580 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:14:05.426189 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:14:05.431088 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:14:05.431088 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:14:05.443460 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:14:05.443460 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:05.454493 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:05.461073 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:05.484660 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:05.484660 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:05.484660 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:05.484660 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:05.484660 np0000001613 nova-compute[98321]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-972b12ec-4bdc-4796-8d98-a4ce035caa1a (non-flash)
May 28 10:14:05.484660 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:14:05.484933 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:05.484933 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:05.484933 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:05.484933 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:05.484933 np0000001613 nova-compute[98321]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-972b12ec-4bdc-4796-8d98-a4ce035caa1a (non-flash)
May 28 10:14:05.484933 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:14:05.486149 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:14:05.503633 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:05.503633 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:05.503633 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:05.503633 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:05.503633 np0000001613 nova-compute[98321]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-972b12ec-4bdc-4796-8d98-a4ce035caa1a (non-flash)
May 28 10:14:05.503633 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:14:05.503887 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:05.503887 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:05.503887 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:05.503887 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:05.503887 np0000001613 nova-compute[98321]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-972b12ec-4bdc-4796-8d98-a4ce035caa1a (non-flash)
May 28 10:14:05.503887 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:14:05.533623 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3, portal: 192.168.40.100,3260]
May 28 10:14:05.533623 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3, portal: 192.168.40.100,3260] successful.
May 28 10:14:05.533623 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:05.550550 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:05.568315 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3, portal: 192.168.50.100,3260]
May 28 10:14:05.568315 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3, portal: 192.168.50.100,3260] successful.
May 28 10:14:05.568315 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:05.576912 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:05.576912 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:05.576912 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:05.576912 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:05.576912 np0000001613 nova-compute[98321]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-972b12ec-4bdc-4796-8d98-a4ce035caa1a (non-flash)
May 28 10:14:05.576912 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:05.576912 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:05.576912 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:14:05.576912 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:05.576912 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:05.576912 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:05.576912 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:05.576912 np0000001613 nova-compute[98321]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-972b12ec-4bdc-4796-8d98-a4ce035caa1a (non-flash)
May 28 10:14:05.576912 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:05.576912 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:05.576912 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:14:05.577360 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.194s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:14:05.577360 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:14:05.579980 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] HCTL ('10', '-', '-', 0) found on session 193 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:14:05.580106 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:14:05.589276 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:05.601903 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching for a device in session 193 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:14:05.602054 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b23f5880-1872-41fd-becc-baf8432031f3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:14:05.607996 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:05.607996 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:05.607996 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:05.607996 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:05.607996 np0000001613 nova-compute[98321]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-972b12ec-4bdc-4796-8d98-a4ce035caa1a (non-flash)
May 28 10:14:05.607996 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:05.607996 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:05.607996 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:14:05.608426 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:05.608426 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:05.608426 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:05.608426 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:05.608426 np0000001613 nova-compute[98321]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-972b12ec-4bdc-4796-8d98-a4ce035caa1a (non-flash)
May 28 10:14:05.608426 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:05.608426 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:05.608426 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:14:05.609860 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.225s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:14:05.611009 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:14:05.611009 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] HCTL ('11', '-', '-', 0) found on session 194 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:14:05.611009 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:14:05.627980 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching for a device in session 194 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:14:05.628208 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b23f5880-1872-41fd-becc-baf8432031f3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:14:05.842008 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:06.000353 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Compute_service record updated for np0000001613:np0000001613 {{(pid=98321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 10:14:06.000522 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.391s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:14:06.001135 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:14:06.387688 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:14:06.761639 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.00034324700027354993 future=<Future at 0x73c1fc2d4da0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:14:06.762225 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Emitting event <LifecycleEvent: 1779963231.761199, 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:14:06.763376 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:14:06.763658 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] VM Stopped (Lifecycle Event)
May 28 10:14:06.996837 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:14:06.997123 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:14:06.997391 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.79 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:14:07.274081 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 3a56bd5d-6c2c-4bc9-b9bc-f19391ba13cd] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:14:07.376977 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:07.410210 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Found WWN 330000000eafe978e for multipath device dm-6 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:14:07.410210 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:14:07.410210 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] <== connect_volume: return (4605ms) {'type': 'block', 'scsi_wwn': '330000000eafe978e', 'path': '/dev/dm-6', 'multipath_id': '330000000eafe978e'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:14:07.410210 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000eafe978e', 'path': '/dev/dm-6', 'multipath_id': '330000000eafe978e'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:14:07.573363 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:07.925198 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:13:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-3389747',display_name='tempest-TestVolumeBootPattern-server-3389747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpattern-server-3389747',id=73,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIssEW3wFq5Z5UVaYZuW5cmCRsiPiqbdvADCw1wCLU3ZToJr2mBO+GTeBlReOodZ6qxe1OJNXGES/jiq9J2PvBGzYYtKCDR4nIPiT2JecYH/bovKreakXe+d0IlAq6PNVA==',key_name='tempest-TestVolumeBootPattern-1325122028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23e9651268114327a9cc6c6c59bef01e',ramdisk_id='',reservation_id='r-t4xe30cs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-327944304',owner_user_name='tempest-TestVolumeBootPattern-327944304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:14:00Z,user_data=None,user_id='ec58233d3b2848bbb2e0b00650398cd1',uuid=0327fb6e-6b30-4f70-8877-a3859969f5ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e515a16-b64c-41b0-8aac-6c77cd0b75cd", "address": "fa:16:3e:ed:76:9b", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e515a16-b6", "ovs_interfaceid": "4e515a16-b64c-41b0-8aac-6c77cd0b75cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:14:07.925198 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converting VIF {"id": "4e515a16-b64c-41b0-8aac-6c77cd0b75cd", "address": "fa:16:3e:ed:76:9b", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e515a16-b6", "ovs_interfaceid": "4e515a16-b64c-41b0-8aac-6c77cd0b75cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:14:07.925198 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:76:9b,bridge_name='br-int',has_traffic_filtering=True,id=4e515a16-b64c-41b0-8aac-6c77cd0b75cd,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e515a16-b6') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:14:07.927185 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lazy-loading 'pci_devices' on Instance uuid 0327fb6e-6b30-4f70-8877-a3859969f5ca {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:14:08.079348 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:08.431142 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] End _get_guest_xml xml=<domain type="qemu">
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:   <uuid>0327fb6e-6b30-4f70-8877-a3859969f5ca</uuid>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:   <name>instance-00000049</name>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:       <nova:name>tempest-TestVolumeBootPattern-server-3389747</nova:name>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:14:02</nova:creationTime>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:       <nova:image uuid="">
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:         <nova:user uuid="ec58233d3b2848bbb2e0b00650398cd1">tempest-TestVolumeBootPattern-327944304-project-member</nova:user>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:         <nova:project uuid="23e9651268114327a9cc6c6c59bef01e">tempest-TestVolumeBootPattern-327944304</nova:project>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:       <nova:root type="volume" uuid=""/>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:         <nova:port uuid="4e515a16-b64c-41b0-8aac-6c77cd0b75cd">
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:     <system>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:       <entry name="serial">0327fb6e-6b30-4f70-8877-a3859969f5ca</entry>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:       <entry name="uuid">0327fb6e-6b30-4f70-8877-a3859969f5ca</entry>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:     </system>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:   <os>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:   </os>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:   <features>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:   </features>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:   <devices>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/0327fb6e-6b30-4f70-8877-a3859969f5ca/disk.config"/>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:     </disk>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:       <alias name="ua-b23f5880-1872-41fd-becc-baf8432031f3"/>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-6"/>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:       <serial>b23f5880-1872-41fd-becc-baf8432031f3</serial>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:     </disk>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:ed:76:9b"/>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:       <target dev="tap4e515a16-b6"/>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:     </interface>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/0327fb6e-6b30-4f70-8877-a3859969f5ca/console.log" append="off"/>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:     </serial>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:     <video>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:     </video>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:     </rng>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:   </devices>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]: </domain>
May 28 10:14:08.431142 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:14:08.435052 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Preparing to wait for external event network-vif-plugged-4e515a16-b64c-41b0-8aac-6c77cd0b75cd {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:14:08.435052 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "0327fb6e-6b30-4f70-8877-a3859969f5ca-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:14:08.435052 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "0327fb6e-6b30-4f70-8877-a3859969f5ca-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:14:08.435052 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "0327fb6e-6b30-4f70-8877-a3859969f5ca-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:14:08.435052 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:13:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-3389747',display_name='tempest-TestVolumeBootPattern-server-3389747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpattern-server-3389747',id=73,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIssEW3wFq5Z5UVaYZuW5cmCRsiPiqbdvADCw1wCLU3ZToJr2mBO+GTeBlReOodZ6qxe1OJNXGES/jiq9J2PvBGzYYtKCDR4nIPiT2JecYH/bovKreakXe+d0IlAq6PNVA==',key_name='tempest-TestVolumeBootPattern-1325122028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23e9651268114327a9cc6c6c59bef01e',ramdisk_id='',reservation_id='r-t4xe30cs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-327944304',owner_user_name='tempest-TestVolumeBootPattern-327944304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:14:00Z,user_data=None,user_id='ec58233d3b2848bbb2e0b00650398cd1',uuid=0327fb6e-6b30-4f70-8877-a3859969f5ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e515a16-b64c-41b0-8aac-6c77cd0b75cd", "address": "fa:16:3e:ed:76:9b", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e515a16-b6", "ovs_interfaceid": "4e515a16-b64c-41b0-8aac-6c77cd0b75cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:14:08.435052 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converting VIF {"id": "4e515a16-b64c-41b0-8aac-6c77cd0b75cd", "address": "fa:16:3e:ed:76:9b", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e515a16-b6", "ovs_interfaceid": "4e515a16-b64c-41b0-8aac-6c77cd0b75cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:14:08.435052 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:76:9b,bridge_name='br-int',has_traffic_filtering=True,id=4e515a16-b64c-41b0-8aac-6c77cd0b75cd,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e515a16-b6') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:14:08.437489 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:76:9b,bridge_name='br-int',has_traffic_filtering=True,id=4e515a16-b64c-41b0-8aac-6c77cd0b75cd,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e515a16-b6') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:14:08.437489 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:08.437489 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:14:08.438321 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:14:08.438403 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:08.438601 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b4db45a1-6dc8-56fe-aa9f-7953619fcbbc', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:14:08.439756 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:08.440853 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:14:08.445244 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:08.447432 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:08.447604 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e515a16-b6, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:14:08.447881 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4e515a16-b6, col_values=(('qos', UUID('d3359475-d7c2-4667-a97d-20bc34021455')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:14:08.448029 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4e515a16-b6, col_values=(('external_ids', {'iface-id': '4e515a16-b64c-41b0-8aac-6c77cd0b75cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:76:9b', 'vm-uuid': '0327fb6e-6b30-4f70-8877-a3859969f5ca'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:14:08.451343 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:08.455833 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:14:08.459524 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:08.460619 np0000001613 nova-compute[98321]: INFO os_vif [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:76:9b,bridge_name='br-int',has_traffic_filtering=True,id=4e515a16-b64c-41b0-8aac-6c77cd0b75cd,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e515a16-b6')
May 28 10:14:08.791818 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:14:08.792781 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 43.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:14:09.982187 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:14:09.982722 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:14:09.982722 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] No VIF found with MAC fa:16:3e:ed:76:9b, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:14:09.983218 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Using config drive
May 28 10:14:10.028308 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:10.491191 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:14:10.640032 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Creating config drive at /opt/stack/data/nova/instances/0327fb6e-6b30-4f70-8877-a3859969f5ca/disk.config
May 28 10:14:10.644692 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0327fb6e-6b30-4f70-8877-a3859969f5ca/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnf36nykx {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:14:10.719128 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0327fb6e-6b30-4f70-8877-a3859969f5ca/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnf36nykx" returned: 0 in 0.074s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:14:10.794613 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:11.167483 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:11.193755 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:11.314401 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:11.580341 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:11.582519 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:11.591377 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:11.613087 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:12.049417 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963252.0488002, 0327fb6e-6b30-4f70-8877-a3859969f5ca => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:14:12.049704 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] VM Started (Lifecycle Event)
May 28 10:14:12.553969 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:14:12.556424 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963252.5561802, 0327fb6e-6b30-4f70-8877-a3859969f5ca => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:14:12.556541 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] VM Paused (Lifecycle Event)
May 28 10:14:13.948317 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:14:13.948317 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:14:13.948317 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e2d287b9-e72e-4c66-a5ac-112e247fa25f req-e2d73130-120a-465d-a91d-20b98976b329 service nova] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Received event network-vif-plugged-4e515a16-b64c-41b0-8aac-6c77cd0b75cd {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:14:13.948317 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e2d287b9-e72e-4c66-a5ac-112e247fa25f req-e2d73130-120a-465d-a91d-20b98976b329 service nova] Acquiring lock "0327fb6e-6b30-4f70-8877-a3859969f5ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:14:13.948317 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e2d287b9-e72e-4c66-a5ac-112e247fa25f req-e2d73130-120a-465d-a91d-20b98976b329 service nova] Lock "0327fb6e-6b30-4f70-8877-a3859969f5ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:14:13.948317 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e2d287b9-e72e-4c66-a5ac-112e247fa25f req-e2d73130-120a-465d-a91d-20b98976b329 service nova] Lock "0327fb6e-6b30-4f70-8877-a3859969f5ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:14:13.948317 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e2d287b9-e72e-4c66-a5ac-112e247fa25f req-e2d73130-120a-465d-a91d-20b98976b329 service nova] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Processing event network-vif-plugged-4e515a16-b64c-41b0-8aac-6c77cd0b75cd {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:14:13.948317 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:14:13.948317 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:14:13.948317 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Instance spawned successfully.
May 28 10:14:13.948317 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:14:13.948317 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:13.948317 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:14:13.948317 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Acquiring lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:14:13.948317 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:14:13.948317 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963253.5694501, 0327fb6e-6b30-4f70-8877-a3859969f5ca => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:14:13.948317 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] VM Resumed (Lifecycle Event)
May 28 10:14:13.948317 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:14:13.948317 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:14:13.948317 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:14:13.948317 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:14:13.948317 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:14:13.948317 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:14:14.029295 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:14.073290 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lazy-loading 'flavor' on Instance uuid 0cffddf7-ea43-43a0-83c1-6bddb8e42884 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:14:14.075986 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:14:14.083339 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:14:14.165499 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Took 11.62 seconds to spawn the instance on the hypervisor.
May 28 10:14:14.165661 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:14:14.586934 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:14:14.674887 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Took 19.38 seconds to build instance.
May 28 10:14:15.040817 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:15.077868 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:14:15.176529 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e13a9cd3-4976-47d6-b316-1ae15f420f35 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "0327fb6e-6b30-4f70-8877-a3859969f5ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.895s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:14:15.209941 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8f762d79-7a90-4044-9c1c-0e40777675de req-26a806e0-bd0b-458a-9c60-7f8dc3da4ac7 service nova] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Received event network-vif-plugged-4e515a16-b64c-41b0-8aac-6c77cd0b75cd {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:14:15.210234 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8f762d79-7a90-4044-9c1c-0e40777675de req-26a806e0-bd0b-458a-9c60-7f8dc3da4ac7 service nova] Acquiring lock "0327fb6e-6b30-4f70-8877-a3859969f5ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:14:15.210454 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8f762d79-7a90-4044-9c1c-0e40777675de req-26a806e0-bd0b-458a-9c60-7f8dc3da4ac7 service nova] Lock "0327fb6e-6b30-4f70-8877-a3859969f5ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:14:15.210642 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8f762d79-7a90-4044-9c1c-0e40777675de req-26a806e0-bd0b-458a-9c60-7f8dc3da4ac7 service nova] Lock "0327fb6e-6b30-4f70-8877-a3859969f5ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:14:15.210822 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8f762d79-7a90-4044-9c1c-0e40777675de req-26a806e0-bd0b-458a-9c60-7f8dc3da4ac7 service nova] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] No waiting events found dispatching network-vif-plugged-4e515a16-b64c-41b0-8aac-6c77cd0b75cd {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:14:15.211022 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-8f762d79-7a90-4044-9c1c-0e40777675de req-26a806e0-bd0b-458a-9c60-7f8dc3da4ac7 service nova] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Received unexpected event network-vif-plugged-4e515a16-b64c-41b0-8aac-6c77cd0b75cd for instance with vm_state active and task_state None.
May 28 10:14:16.219677 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Acquiring lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:14:16.219677 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:14:16.219932 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Attaching volume 4a3e62d1-8f39-4140-a697-75ad996b93b2 to /dev/vdb
May 28 10:14:16.275278 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:14:16.287806 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:14:16.308646 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:14:16.356948 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:14:16.357318 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:14:16.364952 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:14:16.366018 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe49:8be9', 'fe80::2c59:8cff:fea1:3a8', 'fe80::fc16:3eff:fe57:fe26', 'fe80::e4bc:c7ff:fe7f:dc5f', 'fe80::fc16:3eff:fe38:919c', 'fe80::fc16:3eff:feed:769b', 'fe80::e4eb:4cff:fe5c:5eb7'] 
May 28 10:14:16.366218 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:14:16.366359 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:14:16.366634 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] <== get_connector_properties: return (90ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:14:16.366919 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Updating existing volume attachment record: aeb3ffbd-95e5-438c-b669-d56f5620820b {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:14:16.459700 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cbd392cd-2f77-4c2d-93f0-63cae864a7b4 req-935978f7-5115-4f32-a37f-c5369bb7135c service nova] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Received event network-changed-4e515a16-b64c-41b0-8aac-6c77cd0b75cd {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:14:16.459866 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cbd392cd-2f77-4c2d-93f0-63cae864a7b4 req-935978f7-5115-4f32-a37f-c5369bb7135c service nova] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Refreshing instance network info cache due to event network-changed-4e515a16-b64c-41b0-8aac-6c77cd0b75cd. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:14:16.460151 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cbd392cd-2f77-4c2d-93f0-63cae864a7b4 req-935978f7-5115-4f32-a37f-c5369bb7135c service nova] Acquiring lock "refresh_cache-0327fb6e-6b30-4f70-8877-a3859969f5ca" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:14:16.460301 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cbd392cd-2f77-4c2d-93f0-63cae864a7b4 req-935978f7-5115-4f32-a37f-c5369bb7135c service nova] Acquired lock "refresh_cache-0327fb6e-6b30-4f70-8877-a3859969f5ca" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:14:16.460487 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-cbd392cd-2f77-4c2d-93f0-63cae864a7b4 req-935978f7-5115-4f32-a37f-c5369bb7135c service nova] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Refreshing network info cache for port 4e515a16-b64c-41b0-8aac-6c77cd0b75cd {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:14:16.917443 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:14:16.917443 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2', 'iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a3e62d1-8f39-4140-a697-75ad996b93b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:14:16.917443 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:14:16.965218 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-cbd392cd-2f77-4c2d-93f0-63cae864a7b4 req-935978f7-5115-4f32-a37f-c5369bb7135c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:14:17.272869 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-cbd392cd-2f77-4c2d-93f0-63cae864a7b4 req-935978f7-5115-4f32-a37f-c5369bb7135c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:14:17.435422 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-cbd392cd-2f77-4c2d-93f0-63cae864a7b4 req-935978f7-5115-4f32-a37f-c5369bb7135c service nova] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Updated VIF entry in instance network info cache for port 4e515a16-b64c-41b0-8aac-6c77cd0b75cd. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:14:17.435422 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-cbd392cd-2f77-4c2d-93f0-63cae864a7b4 req-935978f7-5115-4f32-a37f-c5369bb7135c service nova] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Updating instance_info_cache with network_info: [{"id": "4e515a16-b64c-41b0-8aac-6c77cd0b75cd", "address": "fa:16:3e:ed:76:9b", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e515a16-b6", "ovs_interfaceid": "4e515a16-b64c-41b0-8aac-6c77cd0b75cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:14:17.938267 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cbd392cd-2f77-4c2d-93f0-63cae864a7b4 req-935978f7-5115-4f32-a37f-c5369bb7135c service nova] Releasing lock "refresh_cache-0327fb6e-6b30-4f70-8877-a3859969f5ca" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:14:18.451943 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:19.173653 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.256s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:14:19.173812 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2', 'iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a3e62d1-8f39-4140-a697-75ad996b93b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:14:19.185306 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:14:19.186268 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:14:19.186688 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:14:19.186847 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:14:19.187179 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:14:19.187567 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:14:19.198630 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:14:19.198630 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:19.204478 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:14:19.204478 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:19.211793 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2] added
May 28 10:14:19.211793 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:14:19.211793 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:14:19.211793 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:14:19.211793 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:14:19.211793 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:14:19.211793 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:19.212003 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:14:19.212235 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0253(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:14:19.212363 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:14:19.217581 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2] added
May 28 10:14:19.217581 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:14:19.217581 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:14:19.217581 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:14:19.217581 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:14:19.217581 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:14:19.217581 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:19.217795 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:14:19.217893 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0305(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:14:19.218078 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:14:20.042898 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:20.212927 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:14:20.218544 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:14:20.225567 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:14:20.225567 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:14:20.234141 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:14:20.234141 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:20.240314 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:20.246881 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:20.258882 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:20.258882 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:20.258882 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:20.258882 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:20.258882 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:20.258882 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:20.258882 np0000001613 nova-compute[98321]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1 (non-flash)
May 28 10:14:20.258882 np0000001613 nova-compute[98321]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1 (non-flash)
May 28 10:14:20.258882 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:14:20.259218 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsi session list stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:20.259218 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:20.259218 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:20.259218 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:20.259218 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:20.259218 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:20.259218 np0000001613 nova-compute[98321]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1 (non-flash)
May 28 10:14:20.259218 np0000001613 nova-compute[98321]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1 (non-flash)
May 28 10:14:20.259218 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:14:20.268339 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:20.268339 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:20.268339 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:20.268339 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:20.268339 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:20.268339 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:20.268339 np0000001613 nova-compute[98321]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1 (non-flash)
May 28 10:14:20.268339 np0000001613 nova-compute[98321]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1 (non-flash)
May 28 10:14:20.268339 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:14:20.268776 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsi session list stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:20.268776 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:20.268776 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:20.268776 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:20.268776 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:20.268776 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:20.268776 np0000001613 nova-compute[98321]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1 (non-flash)
May 28 10:14:20.268776 np0000001613 nova-compute[98321]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1 (non-flash)
May 28 10:14:20.268776 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:14:20.311965 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2, portal: 192.168.40.100,3260]
May 28 10:14:20.311965 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2, portal: 192.168.40.100,3260] successful.
May 28 10:14:20.311965 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:20.315124 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2, portal: 192.168.50.100,3260]
May 28 10:14:20.315124 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2, portal: 192.168.50.100,3260] successful.
May 28 10:14:20.315124 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:20.325287 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:20.329226 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:20.341428 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:20.341428 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:20.341428 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:20.341428 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:20.341428 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:20.341428 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:20.341428 np0000001613 nova-compute[98321]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1 (non-flash)
May 28 10:14:20.341428 np0000001613 nova-compute[98321]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1 (non-flash)
May 28 10:14:20.341428 np0000001613 nova-compute[98321]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2 (non-flash)
May 28 10:14:20.341428 np0000001613 nova-compute[98321]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2 (non-flash)
May 28 10:14:20.341428 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:14:20.341919 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsi session list stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:20.341919 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:20.341919 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:20.341919 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:20.341919 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:20.341919 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:20.341919 np0000001613 nova-compute[98321]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1 (non-flash)
May 28 10:14:20.341919 np0000001613 nova-compute[98321]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1 (non-flash)
May 28 10:14:20.341919 np0000001613 nova-compute[98321]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2 (non-flash)
May 28 10:14:20.341919 np0000001613 nova-compute[98321]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2 (non-flash)
May 28 10:14:20.341919 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:14:20.341919 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.155s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:14:20.342149 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:14:20.342971 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] HCTL ('15', '-', '-', 0) found on session 197 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:14:20.343018 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:14:20.351119 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:20.351119 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:20.351119 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:20.351119 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:20.351119 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:20.351119 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:20.351119 np0000001613 nova-compute[98321]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1 (non-flash)
May 28 10:14:20.351119 np0000001613 nova-compute[98321]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1 (non-flash)
May 28 10:14:20.351119 np0000001613 nova-compute[98321]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2 (non-flash)
May 28 10:14:20.351119 np0000001613 nova-compute[98321]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2 (non-flash)
May 28 10:14:20.351119 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:14:20.351388 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsi session list stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:20.351388 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:20.351388 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:20.351388 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:20.351388 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:20.351388 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:20.351388 np0000001613 nova-compute[98321]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1 (non-flash)
May 28 10:14:20.351388 np0000001613 nova-compute[98321]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1 (non-flash)
May 28 10:14:20.351388 np0000001613 nova-compute[98321]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2 (non-flash)
May 28 10:14:20.351388 np0000001613 nova-compute[98321]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2 (non-flash)
May 28 10:14:20.351388 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:14:20.351550 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.164s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:14:20.351600 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:14:20.352812 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] HCTL ('16', '-', '-', 0) found on session 198 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:14:20.352928 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:14:20.359194 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Searching for a device in session 197 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:14:20.359391 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a3e62d1-8f39-4140-a697-75ad996b93b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:14:20.368093 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Searching for a device in session 198 and hctl ['16', '*', '*', 0] yield: None {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:14:21.368413 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Searching for a device in session 198 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:14:21.368413 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4a3e62d1-8f39-4140-a697-75ad996b93b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:14:22.202238 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Found WWN 330000000bd7bd38f for multipath device dm-10 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:14:22.202475 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:14:22.202620 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] <== connect_volume: return (5284ms) {'type': 'block', 'scsi_wwn': '330000000bd7bd38f', 'path': '/dev/dm-10', 'multipath_id': '330000000bd7bd38f'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:14:22.202805 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000bd7bd38f', 'path': '/dev/dm-10', 'multipath_id': '330000000bd7bd38f'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:14:22.206114 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lazy-loading 'flavor' on Instance uuid 0cffddf7-ea43-43a0-83c1-6bddb8e42884 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:14:22.709644 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Attempting to attach volume 4a3e62d1-8f39-4140-a697-75ad996b93b2 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 10:14:22.711457 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] attach device xml: <disk type="block" device="disk">
May 28 10:14:22.711457 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:14:22.711457 np0000001613 nova-compute[98321]:   <alias name="ua-4a3e62d1-8f39-4140-a697-75ad996b93b2"/>
May 28 10:14:22.711457 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-10"/>
May 28 10:14:22.711457 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:14:22.711457 np0000001613 nova-compute[98321]:   <serial>4a3e62d1-8f39-4140-a697-75ad996b93b2</serial>
May 28 10:14:22.711457 np0000001613 nova-compute[98321]: </disk>
May 28 10:14:22.711457 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 10:14:23.454615 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:24.362184 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:14:24.362593 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:14:24.362593 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:14:24.362593 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] No VIF found with MAC fa:16:3e:57:fe:26, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:14:25.045224 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:25.923445 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-953cca49-0af5-445f-962a-5bc133846fa1 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.704s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:14:26.903845 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Acquiring lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:14:26.904288 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:14:27.409473 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lazy-loading 'flavor' on Instance uuid 0cffddf7-ea43-43a0-83c1-6bddb8e42884 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:14:27.489405 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquiring lock "2543ae6b-cda1-4986-bc88-2982f1610eec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:14:27.489550 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "2543ae6b-cda1-4986-bc88-2982f1610eec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:14:27.991638 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:14:28.414018 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:14:28.456954 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:28.549215 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:14:28.549423 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:14:28.552952 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:14:28.553151 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Claim successful on node np0000001613
May 28 10:14:29.467339 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Acquiring lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:14:29.467839 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:14:29.467839 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Attaching volume 4a9df5c3-2180-4247-a371-d9e43e1b3692 to /dev/vdc
May 28 10:14:29.501896 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:14:29.511752 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:14:29.531376 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:14:29.576589 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:14:29.576888 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:14:29.584504 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:14:29.585798 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe49:8be9', 'fe80::2c59:8cff:fea1:3a8', 'fe80::fc16:3eff:fe57:fe26', 'fe80::e4bc:c7ff:fe7f:dc5f', 'fe80::fc16:3eff:fe38:919c', 'fe80::fc16:3eff:feed:769b', 'fe80::e4eb:4cff:fe5c:5eb7'] 
May 28 10:14:29.585958 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:14:29.586142 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:14:29.586504 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:14:29.586732 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Updating existing volume attachment record: c0e45547-81fd-4ce9-9b62-ac16537fd64a {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:14:29.825484 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:14:29.825728 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:14:30.046367 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:30.143212 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:14:30.143530 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692', 'iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a9df5c3-2180-4247-a371-d9e43e1b3692', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:14:30.143656 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:14:30.144076 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:14:30.144285 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692', 'iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a9df5c3-2180-4247-a371-d9e43e1b3692', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:14:30.156570 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:14:30.157286 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:14:30.157595 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:14:30.157789 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:14:30.158069 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:14:30.158417 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:14:30.170802 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:14:30.170802 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:30.176510 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:14:30.176510 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:30.182788 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692] added
May 28 10:14:30.182788 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:14:30.182788 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:14:30.182788 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:14:30.182788 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:14:30.182788 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:14:30.182788 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:30.182930 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:14:30.183099 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0253(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:14:30.183260 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:14:30.190672 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692] added
May 28 10:14:30.190672 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:14:30.190672 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:14:30.190672 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:14:30.190672 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:14:30.190672 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:14:30.190672 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:30.190827 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:14:30.190939 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0325(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:14:30.191105 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:14:30.329829 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:14:30.835424 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.286s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:14:30.835898 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:14:31.183714 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:14:31.191527 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:14:31.197787 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:14:31.197787 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:14:31.207175 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:14:31.207175 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:31.210255 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:31.220722 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:31.231938 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:31.231938 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:31.231938 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:31.231938 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:31.231938 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:31.231938 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:31.231938 np0000001613 nova-compute[98321]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2 (non-flash)
May 28 10:14:31.231938 np0000001613 nova-compute[98321]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2 (non-flash)
May 28 10:14:31.231938 np0000001613 nova-compute[98321]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-597d68c3-c5bf-471f-97d6-ef9d1c2bc1e4 (non-flash)
May 28 10:14:31.231938 np0000001613 nova-compute[98321]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-597d68c3-c5bf-471f-97d6-ef9d1c2bc1e4 (non-flash)
May 28 10:14:31.231938 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:14:31.232220 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsi session list stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:31.232220 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:31.232220 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:31.232220 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:31.232220 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:31.232220 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:31.232220 np0000001613 nova-compute[98321]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2 (non-flash)
May 28 10:14:31.232220 np0000001613 nova-compute[98321]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2 (non-flash)
May 28 10:14:31.232220 np0000001613 nova-compute[98321]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-597d68c3-c5bf-471f-97d6-ef9d1c2bc1e4 (non-flash)
May 28 10:14:31.232220 np0000001613 nova-compute[98321]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-597d68c3-c5bf-471f-97d6-ef9d1c2bc1e4 (non-flash)
May 28 10:14:31.232220 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:14:31.237614 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:31.237614 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:31.237614 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:31.237614 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:31.237614 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:31.237614 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:31.237614 np0000001613 nova-compute[98321]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2 (non-flash)
May 28 10:14:31.237614 np0000001613 nova-compute[98321]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2 (non-flash)
May 28 10:14:31.237614 np0000001613 nova-compute[98321]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-597d68c3-c5bf-471f-97d6-ef9d1c2bc1e4 (non-flash)
May 28 10:14:31.237614 np0000001613 nova-compute[98321]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-597d68c3-c5bf-471f-97d6-ef9d1c2bc1e4 (non-flash)
May 28 10:14:31.237614 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:14:31.237863 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsi session list stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:31.237863 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:31.237863 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:31.237863 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:31.237863 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:31.237863 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:31.237863 np0000001613 nova-compute[98321]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2 (non-flash)
May 28 10:14:31.237863 np0000001613 nova-compute[98321]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2 (non-flash)
May 28 10:14:31.237863 np0000001613 nova-compute[98321]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-597d68c3-c5bf-471f-97d6-ef9d1c2bc1e4 (non-flash)
May 28 10:14:31.237863 np0000001613 nova-compute[98321]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-597d68c3-c5bf-471f-97d6-ef9d1c2bc1e4 (non-flash)
May 28 10:14:31.237863 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:14:31.281512 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692, portal: 192.168.40.100,3260]
May 28 10:14:31.281512 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692, portal: 192.168.40.100,3260] successful.
May 28 10:14:31.281512 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:31.291501 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692, portal: 192.168.50.100,3260]
May 28 10:14:31.291501 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692, portal: 192.168.50.100,3260] successful.
May 28 10:14:31.291501 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:31.297443 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:31.305223 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:31.318908 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:31.318908 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:31.318908 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:31.318908 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:31.318908 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:31.318908 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:31.318908 np0000001613 nova-compute[98321]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2 (non-flash)
May 28 10:14:31.318908 np0000001613 nova-compute[98321]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2 (non-flash)
May 28 10:14:31.318908 np0000001613 nova-compute[98321]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-597d68c3-c5bf-471f-97d6-ef9d1c2bc1e4 (non-flash)
May 28 10:14:31.318908 np0000001613 nova-compute[98321]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-597d68c3-c5bf-471f-97d6-ef9d1c2bc1e4 (non-flash)
May 28 10:14:31.318908 np0000001613 nova-compute[98321]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692 (non-flash)
May 28 10:14:31.318908 np0000001613 nova-compute[98321]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692 (non-flash)
May 28 10:14:31.318908 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:14:31.319622 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsi session list stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:31.319622 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:31.319622 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:31.319622 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:31.319622 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:31.319622 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:31.319622 np0000001613 nova-compute[98321]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2 (non-flash)
May 28 10:14:31.319622 np0000001613 nova-compute[98321]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2 (non-flash)
May 28 10:14:31.319622 np0000001613 nova-compute[98321]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-597d68c3-c5bf-471f-97d6-ef9d1c2bc1e4 (non-flash)
May 28 10:14:31.319622 np0000001613 nova-compute[98321]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-597d68c3-c5bf-471f-97d6-ef9d1c2bc1e4 (non-flash)
May 28 10:14:31.319622 np0000001613 nova-compute[98321]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692 (non-flash)
May 28 10:14:31.319622 np0000001613 nova-compute[98321]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692 (non-flash)
May 28 10:14:31.319622 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:14:31.319622 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.162s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:14:31.319622 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:14:31.320533 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] HCTL ('17', '-', '-', 0) found on session 201 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:14:31.320643 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:14:31.325357 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:31.325357 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:31.325357 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:31.325357 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:31.325357 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:31.325357 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:31.325357 np0000001613 nova-compute[98321]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2 (non-flash)
May 28 10:14:31.325357 np0000001613 nova-compute[98321]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2 (non-flash)
May 28 10:14:31.325357 np0000001613 nova-compute[98321]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-597d68c3-c5bf-471f-97d6-ef9d1c2bc1e4 (non-flash)
May 28 10:14:31.325357 np0000001613 nova-compute[98321]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-597d68c3-c5bf-471f-97d6-ef9d1c2bc1e4 (non-flash)
May 28 10:14:31.325357 np0000001613 nova-compute[98321]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692 (non-flash)
May 28 10:14:31.325357 np0000001613 nova-compute[98321]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692 (non-flash)
May 28 10:14:31.325357 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:14:31.325631 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsi session list stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:31.325631 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:31.325631 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:31.325631 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:31.325631 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:31.325631 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:31.325631 np0000001613 nova-compute[98321]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2 (non-flash)
May 28 10:14:31.325631 np0000001613 nova-compute[98321]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2 (non-flash)
May 28 10:14:31.325631 np0000001613 nova-compute[98321]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-597d68c3-c5bf-471f-97d6-ef9d1c2bc1e4 (non-flash)
May 28 10:14:31.325631 np0000001613 nova-compute[98321]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-597d68c3-c5bf-471f-97d6-ef9d1c2bc1e4 (non-flash)
May 28 10:14:31.325631 np0000001613 nova-compute[98321]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692 (non-flash)
May 28 10:14:31.325631 np0000001613 nova-compute[98321]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692 (non-flash)
May 28 10:14:31.325631 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:14:31.325852 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:14:31.325852 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:14:31.326797 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] HCTL ('18', '-', '-', 0) found on session 202 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:14:31.326889 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:14:31.339366 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Searching for a device in session 201 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:14:31.340212 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a9df5c3-2180-4247-a371-d9e43e1b3692', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:14:31.360894 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:14:31.360894 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:14:31.360894 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:14:31.360894 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:14:31.360894 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Searching for a device in session 202 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:14:31.360894 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4a9df5c3-2180-4247-a371-d9e43e1b3692', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:14:31.425732 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cabed30cb95f4f7b9f96187fc336f7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a515533ba1c4e23a52f472549e5211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:14:31.847529 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:14:31.899920 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Successfully created port: 4c7bfebd-7e6f-4b71-a583-88587f20f87c {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:14:32.158020 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:14:32.309754 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Successfully updated port: 4c7bfebd-7e6f-4b71-a583-88587f20f87c {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:14:32.350984 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:14:32.361846 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-526479a9-ddfc-4fb1-9ff3-fbf68da78cef req-9ca75222-c454-40c7-80bc-1d24d6a448f3 service nova] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Received event network-changed-4c7bfebd-7e6f-4b71-a583-88587f20f87c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:14:32.363483 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-526479a9-ddfc-4fb1-9ff3-fbf68da78cef req-9ca75222-c454-40c7-80bc-1d24d6a448f3 service nova] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Refreshing instance network info cache due to event network-changed-4c7bfebd-7e6f-4b71-a583-88587f20f87c. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:14:32.363674 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-526479a9-ddfc-4fb1-9ff3-fbf68da78cef req-9ca75222-c454-40c7-80bc-1d24d6a448f3 service nova] Acquiring lock "refresh_cache-2543ae6b-cda1-4986-bc88-2982f1610eec" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:14:32.363781 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-526479a9-ddfc-4fb1-9ff3-fbf68da78cef req-9ca75222-c454-40c7-80bc-1d24d6a448f3 service nova] Acquired lock "refresh_cache-2543ae6b-cda1-4986-bc88-2982f1610eec" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:14:32.363909 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-526479a9-ddfc-4fb1-9ff3-fbf68da78cef req-9ca75222-c454-40c7-80bc-1d24d6a448f3 service nova] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Refreshing network info cache for port 4c7bfebd-7e6f-4b71-a583-88587f20f87c {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:14:32.811609 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquiring lock "refresh_cache-2543ae6b-cda1-4986-bc88-2982f1610eec" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:14:32.867408 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-526479a9-ddfc-4fb1-9ff3-fbf68da78cef req-9ca75222-c454-40c7-80bc-1d24d6a448f3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:14:32.936888 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-526479a9-ddfc-4fb1-9ff3-fbf68da78cef req-9ca75222-c454-40c7-80bc-1d24d6a448f3 service nova] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:14:33.070208 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-526479a9-ddfc-4fb1-9ff3-fbf68da78cef req-9ca75222-c454-40c7-80bc-1d24d6a448f3 service nova] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:14:33.174445 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Found WWN 330000000b32bc311 for multipath device dm-11 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:14:33.174801 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:14:33.175039 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '330000000b32bc311', 'path': '/dev/dm-11', 'multipath_id': '330000000b32bc311'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:14:33.175273 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b32bc311', 'path': '/dev/dm-11', 'multipath_id': '330000000b32bc311'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:14:33.178243 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lazy-loading 'flavor' on Instance uuid 0cffddf7-ea43-43a0-83c1-6bddb8e42884 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:14:33.360918 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:14:33.361686 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:14:33.361878 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Creating image(s)
May 28 10:14:33.362298 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquiring lock "/opt/stack/data/nova/instances/2543ae6b-cda1-4986-bc88-2982f1610eec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:14:33.362428 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "/opt/stack/data/nova/instances/2543ae6b-cda1-4986-bc88-2982f1610eec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:14:33.362794 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "/opt/stack/data/nova/instances/2543ae6b-cda1-4986-bc88-2982f1610eec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:14:33.363634 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:14:33.365882 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:14:33.366649 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:14:33.455621 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.089s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:14:33.456249 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:14:33.456703 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:14:33.457236 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:14:33.459972 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:14:33.460249 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:33.460670 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:14:33.548213 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.087s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:14:33.548635 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/2543ae6b-cda1-4986-bc88-2982f1610eec/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:14:33.573534 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-526479a9-ddfc-4fb1-9ff3-fbf68da78cef req-9ca75222-c454-40c7-80bc-1d24d6a448f3 service nova] Releasing lock "refresh_cache-2543ae6b-cda1-4986-bc88-2982f1610eec" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:14:33.574687 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquired lock "refresh_cache-2543ae6b-cda1-4986-bc88-2982f1610eec" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:14:33.575018 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:14:33.614734 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/2543ae6b-cda1-4986-bc88-2982f1610eec/disk 1073741824" returned: 0 in 0.066s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:14:33.616462 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.160s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:14:33.616792 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:14:33.682467 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Attempting to attach volume 4a9df5c3-2180-4247-a371-d9e43e1b3692 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 10:14:33.690463 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] attach device xml: <disk type="block" device="disk">
May 28 10:14:33.690463 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:14:33.690463 np0000001613 nova-compute[98321]:   <alias name="ua-4a9df5c3-2180-4247-a371-d9e43e1b3692"/>
May 28 10:14:33.690463 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-11"/>
May 28 10:14:33.690463 np0000001613 nova-compute[98321]:   <target dev="vdc" bus="virtio"/>
May 28 10:14:33.690463 np0000001613 nova-compute[98321]:   <serial>4a9df5c3-2180-4247-a371-d9e43e1b3692</serial>
May 28 10:14:33.690463 np0000001613 nova-compute[98321]: </disk>
May 28 10:14:33.690463 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 10:14:33.709860 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.093s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:14:33.710359 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2543ae6b-cda1-4986-bc88-2982f1610eec/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:14:33.710631 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543ae6b-cda1-4986-bc88-2982f1610eec/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:14:33.802101 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543ae6b-cda1-4986-bc88-2982f1610eec/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:14:33.802975 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Cannot resize image /opt/stack/data/nova/instances/2543ae6b-cda1-4986-bc88-2982f1610eec/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:14:33.803107 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:14:33.803328 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Ensure instance console log exists: /opt/stack/data/nova/instances/2543ae6b-cda1-4986-bc88-2982f1610eec/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:14:33.803638 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:14:33.803841 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:14:33.803983 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:14:34.150031 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:14:34.324091 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:14:34.476126 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Updating instance_info_cache with network_info: [{"id": "4c7bfebd-7e6f-4b71-a583-88587f20f87c", "address": "fa:16:3e:72:cb:b7", "network": {"id": "07ee30b7-dd9c-433d-81cc-42ab11aded18", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1881482359-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a515533ba1c4e23a52f472549e5211f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c7bfebd-7e", "ovs_interfaceid": "4c7bfebd-7e6f-4b71-a583-88587f20f87c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:14:34.978439 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Releasing lock "refresh_cache-2543ae6b-cda1-4986-bc88-2982f1610eec" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:14:34.978726 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Instance network_info: |[{"id": "4c7bfebd-7e6f-4b71-a583-88587f20f87c", "address": "fa:16:3e:72:cb:b7", "network": {"id": "07ee30b7-dd9c-433d-81cc-42ab11aded18", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1881482359-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a515533ba1c4e23a52f472549e5211f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c7bfebd-7e", "ovs_interfaceid": "4c7bfebd-7e6f-4b71-a583-88587f20f87c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:14:34.981329 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Start _get_guest_xml network_info=[{"id": "4c7bfebd-7e6f-4b71-a583-88587f20f87c", "address": "fa:16:3e:72:cb:b7", "network": {"id": "07ee30b7-dd9c-433d-81cc-42ab11aded18", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1881482359-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a515533ba1c4e23a52f472549e5211f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c7bfebd-7e", "ovs_interfaceid": "4c7bfebd-7e6f-4b71-a583-88587f20f87c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:14:34.984508 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:14:34.985633 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-973170547', uuid='2543ae6b-cda1-4986-bc88-2982f1610eec'), owner=OwnerMeta(userid='cabed30cb95f4f7b9f96187fc336f7c4', username='tempest-TestEncryptedCinderVolumes-678033643-project-member', projectid='2a515533ba1c4e23a52f472549e5211f', projectname='tempest-TestEncryptedCinderVolumes-678033643'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4c7bfebd-7e6f-4b71-a583-88587f20f87c", "address": "fa:16:3e:72:cb:b7", "network": {"id": "07ee30b7-dd9c-433d-81cc-42ab11aded18", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1881482359-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a515533ba1c4e23a52f472549e5211f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c7bfebd-7e", "ovs_interfaceid": "4c7bfebd-7e6f-4b71-a583-88587f20f87c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779963274.9852955) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:14:34.986841 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:14:34.987207 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:14:34.988391 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:14:34.988547 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:14:34.989423 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:14:34.989681 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:14:34.989808 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:14:34.990004 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:14:34.990125 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:14:34.990498 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:14:34.990619 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:14:34.990766 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:14:34.990869 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:14:34.991301 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:14:34.991499 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:14:34.991628 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:14:35.002941 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:14:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-973170547',display_name='tempest-TestEncryptedCinderVolumes-server-973170547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testencryptedcindervolumes-server-973170547',id=74,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAspM3MUEQp/CLwGSyf9HiiiHVasYSSjr1W1iTCGBS6Sc+blFuh06DungdVsKorsYe9FudoaMzjR9hwr6pUShsTdju0H/Fz5dl5hvmLsZGKv1F+IN1eCVR1ZMV69xzZJtg==',key_name='tempest-keypair-1780126761',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a515533ba1c4e23a52f472549e5211f',ramdisk_id='',reservation_id='r-ktcitt0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-678033643',owner_user_name='tempest-TestEncryptedCinderVolumes-678033643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:14:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cabed30cb95f4f7b9f96187fc336f7c4',uuid=2543ae6b-cda1-4986-bc88-2982f1610eec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c7bfebd-7e6f-4b71-a583-88587f20f87c", "address": "fa:16:3e:72:cb:b7", "network": {"id": "07ee30b7-dd9c-433d-81cc-42ab11aded18", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1881482359-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a515533ba1c4e23a52f472549e5211f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c7bfebd-7e", "ovs_interfaceid": "4c7bfebd-7e6f-4b71-a583-88587f20f87c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:14:35.003100 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Converting VIF {"id": "4c7bfebd-7e6f-4b71-a583-88587f20f87c", "address": "fa:16:3e:72:cb:b7", "network": {"id": "07ee30b7-dd9c-433d-81cc-42ab11aded18", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1881482359-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a515533ba1c4e23a52f472549e5211f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c7bfebd-7e", "ovs_interfaceid": "4c7bfebd-7e6f-4b71-a583-88587f20f87c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:14:35.003637 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:cb:b7,bridge_name='br-int',has_traffic_filtering=True,id=4c7bfebd-7e6f-4b71-a583-88587f20f87c,network=Network(07ee30b7-dd9c-433d-81cc-42ab11aded18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c7bfebd-7e') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:14:35.004112 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lazy-loading 'pci_devices' on Instance uuid 2543ae6b-cda1-4986-bc88-2982f1610eec {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:14:35.048650 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:35.369006 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:14:35.369533 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:14:35.369533 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:14:35.369533 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:14:35.369533 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] No VIF found with MAC fa:16:3e:57:fe:26, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:14:35.506872 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] End _get_guest_xml xml=<domain type="qemu">
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:   <uuid>2543ae6b-cda1-4986-bc88-2982f1610eec</uuid>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:   <name>instance-0000004a</name>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-973170547</nova:name>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:14:34</nova:creationTime>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:         <nova:user uuid="cabed30cb95f4f7b9f96187fc336f7c4">tempest-TestEncryptedCinderVolumes-678033643-project-member</nova:user>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:         <nova:project uuid="2a515533ba1c4e23a52f472549e5211f">tempest-TestEncryptedCinderVolumes-678033643</nova:project>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:         <nova:port uuid="4c7bfebd-7e6f-4b71-a583-88587f20f87c">
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:     <system>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:       <entry name="serial">2543ae6b-cda1-4986-bc88-2982f1610eec</entry>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:       <entry name="uuid">2543ae6b-cda1-4986-bc88-2982f1610eec</entry>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:     </system>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:   <os>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:   </os>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:   <features>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:   </features>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:   <devices>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/2543ae6b-cda1-4986-bc88-2982f1610eec/disk"/>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:     </disk>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/2543ae6b-cda1-4986-bc88-2982f1610eec/disk.config"/>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:     </disk>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:72:cb:b7"/>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:       <target dev="tap4c7bfebd-7e"/>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:     </interface>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/2543ae6b-cda1-4986-bc88-2982f1610eec/console.log" append="off"/>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:     </serial>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:     <video>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:     </video>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:     </rng>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:   </devices>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]: </domain>
May 28 10:14:35.506872 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:14:35.509139 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Preparing to wait for external event network-vif-plugged-4c7bfebd-7e6f-4b71-a583-88587f20f87c {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:14:35.509139 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquiring lock "2543ae6b-cda1-4986-bc88-2982f1610eec-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:14:35.509139 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "2543ae6b-cda1-4986-bc88-2982f1610eec-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:14:35.509139 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "2543ae6b-cda1-4986-bc88-2982f1610eec-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:14:35.509139 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:14:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-973170547',display_name='tempest-TestEncryptedCinderVolumes-server-973170547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testencryptedcindervolumes-server-973170547',id=74,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAspM3MUEQp/CLwGSyf9HiiiHVasYSSjr1W1iTCGBS6Sc+blFuh06DungdVsKorsYe9FudoaMzjR9hwr6pUShsTdju0H/Fz5dl5hvmLsZGKv1F+IN1eCVR1ZMV69xzZJtg==',key_name='tempest-keypair-1780126761',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a515533ba1c4e23a52f472549e5211f',ramdisk_id='',reservation_id='r-ktcitt0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-678033643',owner_user_name='tempest-TestEncryptedCinderVolumes-678033643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:14:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cabed30cb95f4f7b9f96187fc336f7c4',uuid=2543ae6b-cda1-4986-bc88-2982f1610eec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c7bfebd-7e6f-4b71-a583-88587f20f87c", "address": "fa:16:3e:72:cb:b7", "network": {"id": "07ee30b7-dd9c-433d-81cc-42ab11aded18", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1881482359-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a515533ba1c4e23a52f472549e5211f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c7bfebd-7e", "ovs_interfaceid": "4c7bfebd-7e6f-4b71-a583-88587f20f87c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:14:35.509139 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Converting VIF {"id": "4c7bfebd-7e6f-4b71-a583-88587f20f87c", "address": "fa:16:3e:72:cb:b7", "network": {"id": "07ee30b7-dd9c-433d-81cc-42ab11aded18", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1881482359-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a515533ba1c4e23a52f472549e5211f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c7bfebd-7e", "ovs_interfaceid": "4c7bfebd-7e6f-4b71-a583-88587f20f87c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:14:35.509503 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:cb:b7,bridge_name='br-int',has_traffic_filtering=True,id=4c7bfebd-7e6f-4b71-a583-88587f20f87c,network=Network(07ee30b7-dd9c-433d-81cc-42ab11aded18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c7bfebd-7e') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:14:35.509815 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:cb:b7,bridge_name='br-int',has_traffic_filtering=True,id=4c7bfebd-7e6f-4b71-a583-88587f20f87c,network=Network(07ee30b7-dd9c-433d-81cc-42ab11aded18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c7bfebd-7e') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:14:35.510722 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:35.510722 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:14:35.510722 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:14:35.511487 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:35.511715 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '987e81a5-e89b-5b67-8ac7-bbd81cbdc08a', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:14:35.527734 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:35.528528 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:14:35.529351 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:35.531114 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:35.531265 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c7bfebd-7e, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:14:35.531557 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4c7bfebd-7e, col_values=(('qos', UUID('aff1ada1-9a9f-4f2e-ba4b-0137aea2a8de')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:14:35.531703 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4c7bfebd-7e, col_values=(('external_ids', {'iface-id': '4c7bfebd-7e6f-4b71-a583-88587f20f87c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:cb:b7', 'vm-uuid': '2543ae6b-cda1-4986-bc88-2982f1610eec'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:14:35.532419 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:35.533403 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:14:35.537846 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:35.538707 np0000001613 nova-compute[98321]: INFO os_vif [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:cb:b7,bridge_name='br-int',has_traffic_filtering=True,id=4c7bfebd-7e6f-4b71-a583-88587f20f87c,network=Network(07ee30b7-dd9c-433d-81cc-42ab11aded18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c7bfebd-7e')
May 28 10:14:36.918955 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-23d136ea-0488-4bcd-bed9-dea5b34038d9 tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.451s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:14:37.053383 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:14:37.053550 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:14:37.053681 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] No VIF found with MAC fa:16:3e:72:cb:b7, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:14:37.054133 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Using config drive
May 28 10:14:37.371733 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Acquiring lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:14:37.371990 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:14:37.559529 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:14:37.670612 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Creating config drive at /opt/stack/data/nova/instances/2543ae6b-cda1-4986-bc88-2982f1610eec/disk.config
May 28 10:14:37.676558 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2543ae6b-cda1-4986-bc88-2982f1610eec/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmph0_a698k {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:14:37.747433 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2543ae6b-cda1-4986-bc88-2982f1610eec/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmph0_a698k" returned: 0 in 0.071s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:14:37.875098 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Detaching volume 4a9df5c3-2180-4247-a371-d9e43e1b3692
May 28 10:14:37.937742 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Attempting to driver detach volume 4a9df5c3-2180-4247-a371-d9e43e1b3692 from mountpoint /dev/vdc
May 28 10:14:37.945072 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Found disk vdc by alias ua-4a9df5c3-2180-4247-a371-d9e43e1b3692 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:14:37.946802 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Found disk vdc by alias ua-4a9df5c3-2180-4247-a371-d9e43e1b3692 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:14:37.946977 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Attempting to detach device vdc from instance 0cffddf7-ea43-43a0-83c1-6bddb8e42884 from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 10:14:37.947359 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:14:37.947359 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:14:37.947359 np0000001613 nova-compute[98321]:   <alias name="ua-4a9df5c3-2180-4247-a371-d9e43e1b3692"/>
May 28 10:14:37.947359 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-11"/>
May 28 10:14:37.947359 np0000001613 nova-compute[98321]:   <target dev="vdc" bus="virtio"/>
May 28 10:14:37.947359 np0000001613 nova-compute[98321]:   <serial>4a9df5c3-2180-4247-a371-d9e43e1b3692</serial>
May 28 10:14:37.947359 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 10:14:37.947359 np0000001613 nova-compute[98321]: </disk>
May 28 10:14:37.947359 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:14:37.963430 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Successfully detached device vdc from instance 0cffddf7-ea43-43a0-83c1-6bddb8e42884 from the persistent domain config.
May 28 10:14:37.963618 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] (1/8): Attempting to detach device vdc with device alias ua-4a9df5c3-2180-4247-a371-d9e43e1b3692 from instance 0cffddf7-ea43-43a0-83c1-6bddb8e42884 from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 10:14:37.964005 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:14:37.964005 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:14:37.964005 np0000001613 nova-compute[98321]:   <alias name="ua-4a9df5c3-2180-4247-a371-d9e43e1b3692"/>
May 28 10:14:37.964005 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-11"/>
May 28 10:14:37.964005 np0000001613 nova-compute[98321]:   <target dev="vdc" bus="virtio"/>
May 28 10:14:37.964005 np0000001613 nova-compute[98321]:   <serial>4a9df5c3-2180-4247-a371-d9e43e1b3692</serial>
May 28 10:14:37.964005 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 10:14:37.964005 np0000001613 nova-compute[98321]: </disk>
May 28 10:14:37.964005 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:14:38.181395 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:38.210682 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:38.304536 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:38.478521 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4af68e83-b7d6-4f75-b174-b5ff4f67e8dc req-311231d1-6305-41f6-809e-9478cafd537e service nova] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Received event network-vif-plugged-4c7bfebd-7e6f-4b71-a583-88587f20f87c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:14:38.478706 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4af68e83-b7d6-4f75-b174-b5ff4f67e8dc req-311231d1-6305-41f6-809e-9478cafd537e service nova] Acquiring lock "2543ae6b-cda1-4986-bc88-2982f1610eec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:14:38.478775 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4af68e83-b7d6-4f75-b174-b5ff4f67e8dc req-311231d1-6305-41f6-809e-9478cafd537e service nova] Lock "2543ae6b-cda1-4986-bc88-2982f1610eec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:14:38.479583 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4af68e83-b7d6-4f75-b174-b5ff4f67e8dc req-311231d1-6305-41f6-809e-9478cafd537e service nova] Lock "2543ae6b-cda1-4986-bc88-2982f1610eec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:14:38.479583 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4af68e83-b7d6-4f75-b174-b5ff4f67e8dc req-311231d1-6305-41f6-809e-9478cafd537e service nova] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Processing event network-vif-plugged-4c7bfebd-7e6f-4b71-a583-88587f20f87c {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:14:38.502599 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779963278.5001152, 0cffddf7-ea43-43a0-83c1-6bddb8e42884 => ua-4a9df5c3-2180-4247-a371-d9e43e1b3692> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 10:14:38.502599 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-4a9df5c3-2180-4247-a371-d9e43e1b3692 for instance 0cffddf7-ea43-43a0-83c1-6bddb8e42884 {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 10:14:38.509074 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Successfully detached device vdc from instance 0cffddf7-ea43-43a0-83c1-6bddb8e42884 from the live domain config.
May 28 10:14:38.511299 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:14:38.511720 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692', 'iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a9df5c3-2180-4247-a371-d9e43e1b3692', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:14:38.511831 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:14:38.512342 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:14:38.512660 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692', 'iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a9df5c3-2180-4247-a371-d9e43e1b3692', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:14:38.512893 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:14:38.534341 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:38.537513 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:38.557215 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:38.557215 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:38.557215 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:38.557215 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:38.557215 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:38.557215 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:38.557215 np0000001613 nova-compute[98321]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2 (non-flash)
May 28 10:14:38.557215 np0000001613 nova-compute[98321]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2 (non-flash)
May 28 10:14:38.557215 np0000001613 nova-compute[98321]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692 (non-flash)
May 28 10:14:38.557215 np0000001613 nova-compute[98321]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692 (non-flash)
May 28 10:14:38.557215 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:14:38.557215 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsi session list stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:38.557215 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:38.557215 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:38.557215 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:38.557215 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:38.557215 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:38.557215 np0000001613 nova-compute[98321]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2 (non-flash)
May 28 10:14:38.557215 np0000001613 nova-compute[98321]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2 (non-flash)
May 28 10:14:38.557215 np0000001613 nova-compute[98321]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692 (non-flash)
May 28 10:14:38.557215 np0000001613 nova-compute[98321]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692 (non-flash)
May 28 10:14:38.557215 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:14:38.557839 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', '176'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', '177'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c', '189'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c', '190'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', '193'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', '194'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2', '197'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2', '198'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692', '201'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692', '202')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:14:38.557839 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692', '201')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:14:38.559771 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692', '202')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:14:38.559771 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc2e2b60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692'): ({'sdm'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:14:38.559771 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Removing multipathed devices sdl, sdm {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:14:38.559771 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Flush multipath device 330000000b32bc311 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:14:38.563556 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:38.595918 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:14:38.642836 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:14:38.685918 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Checking to see if SCSI volumes sdl, sdm have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:14:38.686090 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] SCSI volumes sdl, sdm have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:14:38.687584 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Checking to see if device paths {'sdl', 'sdm'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:14:38.700466 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Device paths {'sdl', 'sdm'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:14:38.700668 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:14:38.712345 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:38.751503 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 201, target: iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692, portal: 192.168.40.100,3260]
May 28 10:14:38.751503 np0000001613 nova-compute[98321]: Logout of [sid: 201, target: iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692, portal: 192.168.40.100,3260] successful.
May 28 10:14:38.751503 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:38.770325 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:38.781840 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:38.820932 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 202, target: iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692, portal: 192.168.50.100,3260]
May 28 10:14:38.820932 np0000001613 nova-compute[98321]: Logout of [sid: 202, target: iqn.2023-03.storpool.com:os--volume-4a9df5c3-2180-4247-a371-d9e43e1b3692, portal: 192.168.50.100,3260] successful.
May 28 10:14:38.820932 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:38.840686 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:38.840897 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:14:38.841025 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] <== disconnect_volume: return (329ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:14:38.841189 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:14:39.025443 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963279.0249565, 2543ae6b-cda1-4986-bc88-2982f1610eec => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:14:39.026174 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:14:39.027072 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] VM Started (Lifecycle Event)
May 28 10:14:39.030122 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:14:39.032834 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Instance spawned successfully.
May 28 10:14:39.034318 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:14:39.392964 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lazy-loading 'flavor' on Instance uuid 0cffddf7-ea43-43a0-83c1-6bddb8e42884 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:14:39.531613 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:14:39.534198 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:14:39.539780 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:14:39.539780 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:14:39.540296 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:14:39.540397 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:14:39.540870 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:14:39.540959 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:14:40.037599 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:14:40.038055 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963280.037837, 2543ae6b-cda1-4986-bc88-2982f1610eec => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:14:40.038187 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] VM Paused (Lifecycle Event)
May 28 10:14:40.046129 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Took 6.68 seconds to spawn the instance on the hypervisor.
May 28 10:14:40.046267 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:14:40.058605 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:40.398459 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a1391ab4-894c-428e-806f-805c4579248b tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.026s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:14:40.532831 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:40.534795 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a021839d-d5c5-4e78-99e3-21675666ee8b req-5089eac1-066e-44b9-ba38-c5933ce0d0a3 service nova] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Received event network-vif-plugged-4c7bfebd-7e6f-4b71-a583-88587f20f87c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:14:40.534973 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a021839d-d5c5-4e78-99e3-21675666ee8b req-5089eac1-066e-44b9-ba38-c5933ce0d0a3 service nova] Acquiring lock "2543ae6b-cda1-4986-bc88-2982f1610eec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:14:40.535137 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a021839d-d5c5-4e78-99e3-21675666ee8b req-5089eac1-066e-44b9-ba38-c5933ce0d0a3 service nova] Lock "2543ae6b-cda1-4986-bc88-2982f1610eec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:14:40.535263 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a021839d-d5c5-4e78-99e3-21675666ee8b req-5089eac1-066e-44b9-ba38-c5933ce0d0a3 service nova] Lock "2543ae6b-cda1-4986-bc88-2982f1610eec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:14:40.535379 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a021839d-d5c5-4e78-99e3-21675666ee8b req-5089eac1-066e-44b9-ba38-c5933ce0d0a3 service nova] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] No waiting events found dispatching network-vif-plugged-4c7bfebd-7e6f-4b71-a583-88587f20f87c {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:14:40.535493 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-a021839d-d5c5-4e78-99e3-21675666ee8b req-5089eac1-066e-44b9-ba38-c5933ce0d0a3 service nova] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Received unexpected event network-vif-plugged-4c7bfebd-7e6f-4b71-a583-88587f20f87c for instance with vm_state active and task_state None.
May 28 10:14:40.542417 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:14:40.545074 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963280.5448055, 2543ae6b-cda1-4986-bc88-2982f1610eec => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:14:40.545235 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] VM Resumed (Lifecycle Event)
May 28 10:14:40.574883 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Took 12.08 seconds to build instance.
May 28 10:14:40.760747 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Acquiring lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:14:40.760974 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:14:41.047616 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:14:41.050901 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:14:41.077007 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "2543ae6b-cda1-4986-bc88-2982f1610eec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.587s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:14:41.263833 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Detaching volume 4a3e62d1-8f39-4140-a697-75ad996b93b2
May 28 10:14:41.315752 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Attempting to driver detach volume 4a3e62d1-8f39-4140-a697-75ad996b93b2 from mountpoint /dev/vdb
May 28 10:14:41.325616 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:41.327396 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Found disk vdb by alias ua-4a3e62d1-8f39-4140-a697-75ad996b93b2 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:14:41.329450 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Found disk vdb by alias ua-4a3e62d1-8f39-4140-a697-75ad996b93b2 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:14:41.329639 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Attempting to detach device vdb from instance 0cffddf7-ea43-43a0-83c1-6bddb8e42884 from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 10:14:41.329814 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:14:41.329814 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:14:41.329814 np0000001613 nova-compute[98321]:   <alias name="ua-4a3e62d1-8f39-4140-a697-75ad996b93b2"/>
May 28 10:14:41.329814 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-10"/>
May 28 10:14:41.329814 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:14:41.329814 np0000001613 nova-compute[98321]:   <serial>4a3e62d1-8f39-4140-a697-75ad996b93b2</serial>
May 28 10:14:41.329814 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:14:41.329814 np0000001613 nova-compute[98321]: </disk>
May 28 10:14:41.329814 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:14:41.341333 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Successfully detached device vdb from instance 0cffddf7-ea43-43a0-83c1-6bddb8e42884 from the persistent domain config.
May 28 10:14:41.341460 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] (1/8): Attempting to detach device vdb with device alias ua-4a3e62d1-8f39-4140-a697-75ad996b93b2 from instance 0cffddf7-ea43-43a0-83c1-6bddb8e42884 from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 10:14:41.341773 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:14:41.341773 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:14:41.341773 np0000001613 nova-compute[98321]:   <alias name="ua-4a3e62d1-8f39-4140-a697-75ad996b93b2"/>
May 28 10:14:41.341773 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-10"/>
May 28 10:14:41.341773 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:14:41.341773 np0000001613 nova-compute[98321]:   <serial>4a3e62d1-8f39-4140-a697-75ad996b93b2</serial>
May 28 10:14:41.341773 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:14:41.341773 np0000001613 nova-compute[98321]: </disk>
May 28 10:14:41.341773 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:14:41.856651 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779963281.856295, 0cffddf7-ea43-43a0-83c1-6bddb8e42884 => ua-4a3e62d1-8f39-4140-a697-75ad996b93b2> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 10:14:41.857085 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-4a3e62d1-8f39-4140-a697-75ad996b93b2 for instance 0cffddf7-ea43-43a0-83c1-6bddb8e42884 {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 10:14:41.860428 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Successfully detached device vdb from instance 0cffddf7-ea43-43a0-83c1-6bddb8e42884 from the live domain config.
May 28 10:14:41.862405 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:14:41.862706 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2', 'iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a3e62d1-8f39-4140-a697-75ad996b93b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:14:41.862970 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:14:41.866669 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:14:41.866940 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2', 'iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a3e62d1-8f39-4140-a697-75ad996b93b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:14:41.867103 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:14:41.894713 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:41.894713 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:41.894713 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:41.894713 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:41.894713 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:41.894713 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:41.894713 np0000001613 nova-compute[98321]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2 (non-flash)
May 28 10:14:41.894713 np0000001613 nova-compute[98321]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2 (non-flash)
May 28 10:14:41.894713 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:14:41.896431 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsi session list stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:41.896431 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:41.896431 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:41.896431 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:41.896431 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:41.896431 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:41.896431 np0000001613 nova-compute[98321]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2 (non-flash)
May 28 10:14:41.896431 np0000001613 nova-compute[98321]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2 (non-flash)
May 28 10:14:41.896431 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:14:41.896431 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', '176'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', '177'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c', '189'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c', '190'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', '193'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', '194'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2', '197'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2', '198')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:14:41.896431 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2', '197')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:14:41.896824 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2', '198')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:14:41.897542 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc7c9620>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2'): ({'sdk'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:14:41.901559 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Removing multipathed devices sdj, sdk {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:14:41.901559 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Flush multipath device 330000000bd7bd38f {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:14:41.939095 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:14:41.991082 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:14:42.047574 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:14:42.048499 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:14:42.051219 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:14:42.062241 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:14:42.062241 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:14:42.077817 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:42.119394 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 197, target: iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2, portal: 192.168.40.100,3260]
May 28 10:14:42.119394 np0000001613 nova-compute[98321]: Logout of [sid: 197, target: iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2, portal: 192.168.40.100,3260] successful.
May 28 10:14:42.119394 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:42.142110 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:42.156774 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:42.188592 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 198, target: iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2, portal: 192.168.50.100,3260]
May 28 10:14:42.188592 np0000001613 nova-compute[98321]: Logout of [sid: 198, target: iqn.2023-03.storpool.com:os--volume-4a3e62d1-8f39-4140-a697-75ad996b93b2, portal: 192.168.50.100,3260] successful.
May 28 10:14:42.188592 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:42.208696 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:42.212192 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:14:42.212192 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] <== disconnect_volume: return (346ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:14:42.212192 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:14:42.594458 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c95d5a5a-87f8-4f4b-a992-98fd9141a72f req-03d2a863-0558-4492-af59-dba802ea0663 service nova] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Received event network-changed-4c7bfebd-7e6f-4b71-a583-88587f20f87c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:14:42.594685 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c95d5a5a-87f8-4f4b-a992-98fd9141a72f req-03d2a863-0558-4492-af59-dba802ea0663 service nova] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Refreshing instance network info cache due to event network-changed-4c7bfebd-7e6f-4b71-a583-88587f20f87c. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:14:42.594878 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c95d5a5a-87f8-4f4b-a992-98fd9141a72f req-03d2a863-0558-4492-af59-dba802ea0663 service nova] Acquiring lock "refresh_cache-2543ae6b-cda1-4986-bc88-2982f1610eec" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:14:42.595056 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c95d5a5a-87f8-4f4b-a992-98fd9141a72f req-03d2a863-0558-4492-af59-dba802ea0663 service nova] Acquired lock "refresh_cache-2543ae6b-cda1-4986-bc88-2982f1610eec" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:14:42.595258 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-c95d5a5a-87f8-4f4b-a992-98fd9141a72f req-03d2a863-0558-4492-af59-dba802ea0663 service nova] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Refreshing network info cache for port 4c7bfebd-7e6f-4b71-a583-88587f20f87c {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:14:42.762437 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lazy-loading 'flavor' on Instance uuid 0cffddf7-ea43-43a0-83c1-6bddb8e42884 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:14:43.097415 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-c95d5a5a-87f8-4f4b-a992-98fd9141a72f req-03d2a863-0558-4492-af59-dba802ea0663 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:14:43.485304 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-c95d5a5a-87f8-4f4b-a992-98fd9141a72f req-03d2a863-0558-4492-af59-dba802ea0663 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:14:43.580985 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:43.673652 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-c95d5a5a-87f8-4f4b-a992-98fd9141a72f req-03d2a863-0558-4492-af59-dba802ea0663 service nova] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Updated VIF entry in instance network info cache for port 4c7bfebd-7e6f-4b71-a583-88587f20f87c. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:14:43.674153 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-c95d5a5a-87f8-4f4b-a992-98fd9141a72f req-03d2a863-0558-4492-af59-dba802ea0663 service nova] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Updating instance_info_cache with network_info: [{"id": "4c7bfebd-7e6f-4b71-a583-88587f20f87c", "address": "fa:16:3e:72:cb:b7", "network": {"id": "07ee30b7-dd9c-433d-81cc-42ab11aded18", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1881482359-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a515533ba1c4e23a52f472549e5211f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c7bfebd-7e", "ovs_interfaceid": "4c7bfebd-7e6f-4b71-a583-88587f20f87c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:14:43.770989 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b1259978-bd3b-455a-95b6-6a582c2899ff tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.010s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:14:44.144721 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-61f5fe20-647e-4b3f-8231-98576509ce1f tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Acquiring lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:14:44.145365 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-61f5fe20-647e-4b3f-8231-98576509ce1f tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:14:44.145365 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-61f5fe20-647e-4b3f-8231-98576509ce1f tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Acquiring lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:14:44.145540 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-61f5fe20-647e-4b3f-8231-98576509ce1f tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:14:44.145625 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-61f5fe20-647e-4b3f-8231-98576509ce1f tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:14:44.148072 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-61f5fe20-647e-4b3f-8231-98576509ce1f tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Terminating instance
May 28 10:14:44.177684 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c95d5a5a-87f8-4f4b-a992-98fd9141a72f req-03d2a863-0558-4492-af59-dba802ea0663 service nova] Releasing lock "refresh_cache-2543ae6b-cda1-4986-bc88-2982f1610eec" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:14:44.651893 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-61f5fe20-647e-4b3f-8231-98576509ce1f tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:14:44.678988 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:44.686522 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:44.701615 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:44.729250 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:44.731506 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:44.845864 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-698c57df-1dc1-4cc2-9d88-f17b9abff4ff req-faceaa00-9956-4df1-ba0b-4d3ec96e085c service nova] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Received event network-vif-unplugged-503fc02b-83eb-415b-8439-c6b3c2175ae2 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:14:44.845961 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-698c57df-1dc1-4cc2-9d88-f17b9abff4ff req-faceaa00-9956-4df1-ba0b-4d3ec96e085c service nova] Acquiring lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:14:44.846238 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-698c57df-1dc1-4cc2-9d88-f17b9abff4ff req-faceaa00-9956-4df1-ba0b-4d3ec96e085c service nova] Lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:14:44.846382 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-698c57df-1dc1-4cc2-9d88-f17b9abff4ff req-faceaa00-9956-4df1-ba0b-4d3ec96e085c service nova] Lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:14:44.846535 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-698c57df-1dc1-4cc2-9d88-f17b9abff4ff req-faceaa00-9956-4df1-ba0b-4d3ec96e085c service nova] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] No waiting events found dispatching network-vif-unplugged-503fc02b-83eb-415b-8439-c6b3c2175ae2 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:14:44.846685 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-698c57df-1dc1-4cc2-9d88-f17b9abff4ff req-faceaa00-9956-4df1-ba0b-4d3ec96e085c service nova] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Received event network-vif-unplugged-503fc02b-83eb-415b-8439-c6b3c2175ae2 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:14:44.949323 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:44.954660 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:44.979427 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.99965939699996 future=<Future at 0x73c1f41bbd40 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:14:44.981412 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.99765145099991 future=<Future at 0x73c1f41bbd40 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:14:44.981564 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.997523502999684 future=<Future at 0x73c1f41bbd40 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:14:44.982276 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Instance destroyed successfully.
May 28 10:14:44.982626 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-61f5fe20-647e-4b3f-8231-98576509ce1f tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lazy-loading 'resources' on Instance uuid 0cffddf7-ea43-43a0-83c1-6bddb8e42884 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:14:45.059315 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:45.485418 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-61f5fe20-647e-4b3f-8231-98576509ce1f tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:13:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1318729689',display_name='tempest-TestServerVolumeAttachmentScenario-server-1318729689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testservervolumeattachmentscenario-server-1318729689',id=71,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaFBf4R9c2LdZoSSkm9VYg2GpV8qLgisD5C7HY4k4slCXz7cFsNsDyHcIu1y7Id99AEKS0y7ELMurrZgbfg9Gk2UbA1T25baKdd6fOkYKAfapq/iIIYLu6Zf4IAmGu9yA==',key_name='tempest-keypair-1065478257',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:13:35Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4005d70969740a687a13ecb27e151a9',ramdisk_id='',reservation_id='r-cm3nioac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1785951',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1785951-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:13:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3af73fcd68ed467c88011baf26231cfa',uuid=0cffddf7-ea43-43a0-83c1-6bddb8e42884,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "503fc02b-83eb-415b-8439-c6b3c2175ae2", "address": "fa:16:3e:57:fe:26", "network": {"id": "ddadd9b9-c8a6-4280-b1e1-fdd193bdceca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1440559780-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f4005d70969740a687a13ecb27e151a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap503fc02b-83", "ovs_interfaceid": "503fc02b-83eb-415b-8439-c6b3c2175ae2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:14:45.485418 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-61f5fe20-647e-4b3f-8231-98576509ce1f tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Converting VIF {"id": "503fc02b-83eb-415b-8439-c6b3c2175ae2", "address": "fa:16:3e:57:fe:26", "network": {"id": "ddadd9b9-c8a6-4280-b1e1-fdd193bdceca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1440559780-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f4005d70969740a687a13ecb27e151a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap503fc02b-83", "ovs_interfaceid": "503fc02b-83eb-415b-8439-c6b3c2175ae2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:14:45.486041 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-61f5fe20-647e-4b3f-8231-98576509ce1f tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:fe:26,bridge_name='br-int',has_traffic_filtering=True,id=503fc02b-83eb-415b-8439-c6b3c2175ae2,network=Network(ddadd9b9-c8a6-4280-b1e1-fdd193bdceca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap503fc02b-83') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:14:45.486041 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-61f5fe20-647e-4b3f-8231-98576509ce1f tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:fe:26,bridge_name='br-int',has_traffic_filtering=True,id=503fc02b-83eb-415b-8439-c6b3c2175ae2,network=Network(ddadd9b9-c8a6-4280-b1e1-fdd193bdceca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap503fc02b-83') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:14:45.488634 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:45.488634 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap503fc02b-83, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:14:45.488867 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:45.490634 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:14:45.492842 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:45.492842 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=740ddd64-001d-4bee-aba8-44d7e70ef424) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:14:45.494003 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:45.494990 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:14:45.497098 np0000001613 nova-compute[98321]: INFO os_vif [None req-61f5fe20-647e-4b3f-8231-98576509ce1f tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:fe:26,bridge_name='br-int',has_traffic_filtering=True,id=503fc02b-83eb-415b-8439-c6b3c2175ae2,network=Network(ddadd9b9-c8a6-4280-b1e1-fdd193bdceca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap503fc02b-83')
May 28 10:14:45.497370 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-61f5fe20-647e-4b3f-8231-98576509ce1f tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Deleting instance files /opt/stack/data/nova/instances/0cffddf7-ea43-43a0-83c1-6bddb8e42884_del
May 28 10:14:45.498043 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-61f5fe20-647e-4b3f-8231-98576509ce1f tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Deletion of /opt/stack/data/nova/instances/0cffddf7-ea43-43a0-83c1-6bddb8e42884_del complete
May 28 10:14:45.814095 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Acquiring lock "7de5b639-f7aa-46af-8f5e-a34503673ba0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:14:45.814294 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "7de5b639-f7aa-46af-8f5e-a34503673ba0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:14:46.003855 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-61f5fe20-647e-4b3f-8231-98576509ce1f tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Took 1.35 seconds to destroy the instance on the hypervisor.
May 28 10:14:46.004319 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-61f5fe20-647e-4b3f-8231-98576509ce1f tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:14:46.004676 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:14:46.004852 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:14:46.005158 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:14:46.073389 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:14:46.319705 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:14:46.454574 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:46.540758 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b0284527-307b-4da3-bf84-ba9d3efbb427 req-6ab2d402-d602-4fe6-883c-c25a952875fa service nova] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Received event network-vif-deleted-503fc02b-83eb-415b-8439-c6b3c2175ae2 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:14:46.541134 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-b0284527-307b-4da3-bf84-ba9d3efbb427 req-6ab2d402-d602-4fe6-883c-c25a952875fa service nova] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Neutron deleted interface 503fc02b-83eb-415b-8439-c6b3c2175ae2; detaching it from the instance and deleting it from the info cache
May 28 10:14:46.545892 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b0284527-307b-4da3-bf84-ba9d3efbb427 req-6ab2d402-d602-4fe6-883c-c25a952875fa service nova] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Detach interface failed, port_id=503fc02b-83eb-415b-8439-c6b3c2175ae2, reason: Instance 0cffddf7-ea43-43a0-83c1-6bddb8e42884 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:14:46.871939 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:14:46.872120 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:14:46.875249 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:14:46.875421 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Claim successful on node np0000001613
May 28 10:14:46.912617 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c78c7141-ba42-4256-a401-4bd1747a0066 req-695713e3-0033-4f9f-8977-03eb14799099 service nova] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Received event network-vif-unplugged-503fc02b-83eb-415b-8439-c6b3c2175ae2 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:14:46.915488 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c78c7141-ba42-4256-a401-4bd1747a0066 req-695713e3-0033-4f9f-8977-03eb14799099 service nova] Acquiring lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:14:46.915684 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c78c7141-ba42-4256-a401-4bd1747a0066 req-695713e3-0033-4f9f-8977-03eb14799099 service nova] Lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:14:46.915821 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c78c7141-ba42-4256-a401-4bd1747a0066 req-695713e3-0033-4f9f-8977-03eb14799099 service nova] Lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:14:46.915955 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c78c7141-ba42-4256-a401-4bd1747a0066 req-695713e3-0033-4f9f-8977-03eb14799099 service nova] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] No waiting events found dispatching network-vif-unplugged-503fc02b-83eb-415b-8439-c6b3c2175ae2 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:14:46.916099 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c78c7141-ba42-4256-a401-4bd1747a0066 req-695713e3-0033-4f9f-8977-03eb14799099 service nova] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Received event network-vif-unplugged-503fc02b-83eb-415b-8439-c6b3c2175ae2 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:14:46.995625 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:14:47.498493 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Took 1.49 seconds to deallocate network for instance.
May 28 10:14:48.003989 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-61f5fe20-647e-4b3f-8231-98576509ce1f tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:14:48.170444 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:14:48.170696 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:14:48.673585 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:14:49.184501 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.312s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:14:49.185480 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-61f5fe20-647e-4b3f-8231-98576509ce1f tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.181s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:14:49.185480 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:14:49.515770 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-61f5fe20-647e-4b3f-8231-98576509ce1f tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:14:49.516034 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-61f5fe20-647e-4b3f-8231-98576509ce1f tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:14:49.691988 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:14:49.692153 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:14:49.692364 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:14:49.692540 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:14:49.782182 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7ffa50296592417a99dd0566355e09f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80b528594ac4ee5b3b56bf7c94c7ffa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:14:50.019070 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-61f5fe20-647e-4b3f-8231-98576509ce1f tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:14:50.060410 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:50.196896 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:14:50.234952 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Successfully created port: 9ca42655-a086-4ab1-9be6-d413a2c17cb2 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:14:50.493504 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:50.528210 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-61f5fe20-647e-4b3f-8231-98576509ce1f tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.343s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:14:50.572630 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-61f5fe20-647e-4b3f-8231-98576509ce1f tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Deleted allocations for instance 0cffddf7-ea43-43a0-83c1-6bddb8e42884
May 28 10:14:50.699963 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:14:50.714440 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Successfully updated port: 9ca42655-a086-4ab1-9be6-d413a2c17cb2 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:14:50.775695 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7cc6a304-decb-476f-9275-372bf04c62d3 req-263fcd3d-4825-4326-b652-70902ace8b40 service nova] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Received event network-changed-9ca42655-a086-4ab1-9be6-d413a2c17cb2 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:14:50.776448 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7cc6a304-decb-476f-9275-372bf04c62d3 req-263fcd3d-4825-4326-b652-70902ace8b40 service nova] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Refreshing instance network info cache due to event network-changed-9ca42655-a086-4ab1-9be6-d413a2c17cb2. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:14:50.777136 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7cc6a304-decb-476f-9275-372bf04c62d3 req-263fcd3d-4825-4326-b652-70902ace8b40 service nova] Acquiring lock "refresh_cache-7de5b639-f7aa-46af-8f5e-a34503673ba0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:14:50.778358 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7cc6a304-decb-476f-9275-372bf04c62d3 req-263fcd3d-4825-4326-b652-70902ace8b40 service nova] Acquired lock "refresh_cache-7de5b639-f7aa-46af-8f5e-a34503673ba0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:14:50.779065 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-7cc6a304-decb-476f-9275-372bf04c62d3 req-263fcd3d-4825-4326-b652-70902ace8b40 service nova] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Refreshing network info cache for port 9ca42655-a086-4ab1-9be6-d413a2c17cb2 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:14:51.205138 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Booting with volume 052c293f-59e1-402b-9305-6ebf50a25311 at /dev/vda
May 28 10:14:51.217240 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Acquiring lock "refresh_cache-7de5b639-f7aa-46af-8f5e-a34503673ba0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:14:51.244386 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:14:51.255257 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:14:51.278500 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:14:51.292351 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-7cc6a304-decb-476f-9275-372bf04c62d3 req-263fcd3d-4825-4326-b652-70902ace8b40 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:14:51.324374 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:14:51.324688 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:14:51.333450 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:14:51.334552 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe49:8be9', 'fe80::2c59:8cff:fea1:3a8', 'fe80::fc16:3eff:fe38:919c', 'fe80::fc16:3eff:feed:769b', 'fe80::e4eb:4cff:fe5c:5eb7', 'fe80::fc16:3eff:fe72:cbb7', 'fe80::428:aaff:fee4:e565'] 
May 28 10:14:51.334680 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:14:51.334778 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:14:51.334977 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] <== get_connector_properties: return (90ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:14:51.335192 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Updating existing volume attachment record: f43c42c6-4c63-4de7-9b55-72be15f1dadb {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:14:51.431978 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-7cc6a304-decb-476f-9275-372bf04c62d3 req-263fcd3d-4825-4326-b652-70902ace8b40 service nova] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:14:51.582603 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-61f5fe20-647e-4b3f-8231-98576509ce1f tempest-TestServerVolumeAttachmentScenario-1785951 tempest-TestServerVolumeAttachmentScenario-1785951-project-member] Lock "0cffddf7-ea43-43a0-83c1-6bddb8e42884" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.437s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:14:51.600152 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-7cc6a304-decb-476f-9275-372bf04c62d3 req-263fcd3d-4825-4326-b652-70902ace8b40 service nova] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:14:51.791948 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:14:51.792290 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98321) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
May 28 10:14:52.102213 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7cc6a304-decb-476f-9275-372bf04c62d3 req-263fcd3d-4825-4326-b652-70902ace8b40 service nova] Releasing lock "refresh_cache-7de5b639-f7aa-46af-8f5e-a34503673ba0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:14:52.102380 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Acquired lock "refresh_cache-7de5b639-f7aa-46af-8f5e-a34503673ba0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:14:52.102832 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:14:52.294429 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.50 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:14:52.669763 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:14:52.837499 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:14:52.996157 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Updating instance_info_cache with network_info: [{"id": "9ca42655-a086-4ab1-9be6-d413a2c17cb2", "address": "fa:16:3e:af:0f:dd", "network": {"id": "83f5548a-aebf-46e0-a4d2-07f06d3967d4", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1141449765-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d80b528594ac4ee5b3b56bf7c94c7ffa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca42655-a0", "ovs_interfaceid": "9ca42655-a086-4ab1-9be6-d413a2c17cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:14:53.438780 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:14:53.439920 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:14:53.440157 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Creating image(s)
May 28 10:14:53.440453 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Did not create local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 10:14:53.440567 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Ensure instance console log exists: /opt/stack/data/nova/instances/7de5b639-f7aa-46af-8f5e-a34503673ba0/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:14:53.440774 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:14:53.440962 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:14:53.441097 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:14:53.498532 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Releasing lock "refresh_cache-7de5b639-f7aa-46af-8f5e-a34503673ba0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:14:53.498532 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Instance network_info: |[{"id": "9ca42655-a086-4ab1-9be6-d413a2c17cb2", "address": "fa:16:3e:af:0f:dd", "network": {"id": "83f5548a-aebf-46e0-a4d2-07f06d3967d4", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1141449765-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d80b528594ac4ee5b3b56bf7c94c7ffa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca42655-a0", "ovs_interfaceid": "9ca42655-a086-4ab1-9be6-d413a2c17cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:14:53.499032 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Start _get_guest_xml network_info=[{"id": "9ca42655-a086-4ab1-9be6-d413a2c17cb2", "address": "fa:16:3e:af:0f:dd", "network": {"id": "83f5548a-aebf-46e0-a4d2-07f06d3967d4", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1141449765-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d80b528594ac4ee5b3b56bf7c94c7ffa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca42655-a0", "ovs_interfaceid": "9ca42655-a086-4ab1-9be6-d413a2c17cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311', 'iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '052c293f-59e1-402b-9305-6ebf50a25311', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '7de5b639-f7aa-46af-8f5e-a34503673ba0', 'attached_at': '', 'detached_at': '', 'volume_id': '052c293f-59e1-402b-9305-6ebf50a25311', 'serial': '052c293f-59e1-402b-9305-6ebf50a25311'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'f43c42c6-4c63-4de7-9b55-72be15f1dadb', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:14:53.503176 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:14:53.504214 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-1722593881', uuid='7de5b639-f7aa-46af-8f5e-a34503673ba0'), owner=OwnerMeta(userid='7ffa50296592417a99dd0566355e09f9', username='tempest-TestVolumeBootPatternV346-204163382-project-member', projectid='d80b528594ac4ee5b3b56bf7c94c7ffa', projectname='tempest-TestVolumeBootPatternV346-204163382'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9ca42655-a086-4ab1-9be6-d413a2c17cb2", "address": "fa:16:3e:af:0f:dd", "network": {"id": "83f5548a-aebf-46e0-a4d2-07f06d3967d4", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1141449765-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d80b528594ac4ee5b3b56bf7c94c7ffa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca42655-a0", "ovs_interfaceid": "9ca42655-a086-4ab1-9be6-d413a2c17cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779963293.5038888) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:14:53.505392 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:14:53.505688 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:14:53.506726 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:14:53.506872 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:14:53.507697 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:14:53.507952 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:14:53.508082 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:14:53.508208 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:14:53.508325 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:14:53.508406 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:14:53.508491 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:14:53.508634 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:14:53.508721 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:14:53.508820 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:14:53.508914 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:14:53.509031 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:14:53.518228 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:14:53.518594 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311', 'iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '052c293f-59e1-402b-9305-6ebf50a25311', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:14:53.518765 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:14:53.519124 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:14:53.519381 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311', 'iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '052c293f-59e1-402b-9305-6ebf50a25311', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:14:53.530542 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:14:53.531190 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:14:53.531788 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:14:53.532126 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:14:53.532698 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:14:53.533149 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:14:53.543221 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:14:53.543221 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:53.549882 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:14:53.549882 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:53.555986 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311] added
May 28 10:14:53.555986 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:14:53.555986 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:14:53.555986 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:14:53.555986 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:14:53.555986 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:14:53.555986 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:53.557453 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:14:53.557453 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0247(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:14:53.557453 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:14:53.563872 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311] added
May 28 10:14:53.563872 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:14:53.563872 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:14:53.563872 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:14:53.563872 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:14:53.563872 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:14:53.563872 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:53.563872 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:14:53.563872 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0306(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:14:53.563872 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:14:54.556965 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:14:54.564223 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:14:54.572096 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:14:54.572096 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:14:54.578384 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:14:54.578384 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:54.588702 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:54.593600 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:54.604242 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:54.604242 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:54.604242 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:54.604242 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:54.604242 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:54.604242 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:54.604242 np0000001613 nova-compute[98321]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d340710-424e-45ff-b451-7a2d32944fd8 (non-flash)
May 28 10:14:54.604242 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:14:54.604414 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsi session list stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:54.604414 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:54.604414 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:54.604414 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:54.604414 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:54.604414 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:54.604414 np0000001613 nova-compute[98321]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d340710-424e-45ff-b451-7a2d32944fd8 (non-flash)
May 28 10:14:54.604414 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:14:54.609440 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:54.609440 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:54.609440 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:54.609440 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:54.609440 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:54.609440 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:54.609440 np0000001613 nova-compute[98321]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d340710-424e-45ff-b451-7a2d32944fd8 (non-flash)
May 28 10:14:54.609440 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:14:54.609599 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsi session list stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:54.609599 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:54.609599 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:54.609599 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:54.609599 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:54.609599 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:54.609599 np0000001613 nova-compute[98321]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d340710-424e-45ff-b451-7a2d32944fd8 (non-flash)
May 28 10:14:54.609599 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:14:54.646038 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311, portal: 192.168.40.100,3260]
May 28 10:14:54.646038 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311, portal: 192.168.40.100,3260] successful.
May 28 10:14:54.646038 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:54.657042 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311, portal: 192.168.50.100,3260]
May 28 10:14:54.657042 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311, portal: 192.168.50.100,3260] successful.
May 28 10:14:54.657042 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:54.658472 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:54.673160 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:14:54.678757 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:54.678757 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:54.678757 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:54.678757 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:54.678757 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:54.678757 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:54.678757 np0000001613 nova-compute[98321]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d340710-424e-45ff-b451-7a2d32944fd8 (non-flash)
May 28 10:14:54.678757 np0000001613 nova-compute[98321]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:14:54.678757 np0000001613 nova-compute[98321]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:14:54.678757 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:14:54.678991 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsi session list stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:54.678991 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:54.678991 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:54.678991 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:54.678991 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:54.678991 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:54.678991 np0000001613 nova-compute[98321]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d340710-424e-45ff-b451-7a2d32944fd8 (non-flash)
May 28 10:14:54.678991 np0000001613 nova-compute[98321]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:14:54.678991 np0000001613 nova-compute[98321]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:14:54.678991 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:14:54.679244 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.148s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:14:54.679244 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:14:54.680317 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] HCTL ('12', '-', '-', 0) found on session 204 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:14:54.680438 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:14:54.694026 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:54.694026 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:54.694026 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:54.694026 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:54.694026 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:54.694026 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:54.694026 np0000001613 nova-compute[98321]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d340710-424e-45ff-b451-7a2d32944fd8 (non-flash)
May 28 10:14:54.694026 np0000001613 nova-compute[98321]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:14:54.694026 np0000001613 nova-compute[98321]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:14:54.694026 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:14:54.694303 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsi session list stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:54.694303 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:14:54.694303 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:54.694303 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:14:54.694303 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:54.694303 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:14:54.694303 np0000001613 nova-compute[98321]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d340710-424e-45ff-b451-7a2d32944fd8 (non-flash)
May 28 10:14:54.694303 np0000001613 nova-compute[98321]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:14:54.694303 np0000001613 nova-compute[98321]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:14:54.694303 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:14:54.694529 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.162s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:14:54.694684 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:14:54.695618 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] HCTL ('15', '-', '-', 0) found on session 205 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:14:54.695750 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:14:54.702579 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Searching for a device in session 204 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:14:54.702844 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '052c293f-59e1-402b-9305-6ebf50a25311', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:14:54.735524 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Searching for a device in session 205 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:14:54.735674 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '052c293f-59e1-402b-9305-6ebf50a25311', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:14:55.061679 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:55.494276 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:55.533075 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:14:56.208853 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:56.557079 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Found WWN 330000000c2ce75e0 for multipath device dm-9 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:14:56.557326 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:14:56.557461 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '330000000c2ce75e0', 'path': '/dev/dm-9', 'multipath_id': '330000000c2ce75e0'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:14:56.557569 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c2ce75e0', 'path': '/dev/dm-9', 'multipath_id': '330000000c2ce75e0'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:14:56.792351 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:14:56.889551 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "4ce32a9b-fc5a-4931-9880-dd7638009cc5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:14:56.890156 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "4ce32a9b-fc5a-4931-9880-dd7638009cc5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:14:57.064325 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:14:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1722593881',display_name='tempest-TestVolumeBootPatternV346-server-1722593881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpatternv346-server-1722593881',id=75,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbEV5EpMk8TD/JMl9q94xI07WMKeq+7uwufxX5ppffET/qe5CaI2B5EPSWlpYD54YJuCZA/PCJIL/KwgoEN9C7arA++M77IsZqrD6GlTm+AfxZfjZIjcn94RmhD5yFbKA==',key_name='tempest-keypair-439171385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d80b528594ac4ee5b3b56bf7c94c7ffa',ramdisk_id='',reservation_id='r-hd4t3ijz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-204163382',owner_user_name='tempest-TestVolumeBootPatternV346-204163382-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:14:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ffa50296592417a99dd0566355e09f9',uuid=7de5b639-f7aa-46af-8f5e-a34503673ba0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ca42655-a086-4ab1-9be6-d413a2c17cb2", "address": "fa:16:3e:af:0f:dd", "network": {"id": "83f5548a-aebf-46e0-a4d2-07f06d3967d4", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1141449765-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d80b528594ac4ee5b3b56bf7c94c7ffa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca42655-a0", "ovs_interfaceid": "9ca42655-a086-4ab1-9be6-d413a2c17cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:14:57.064607 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Converting VIF {"id": "9ca42655-a086-4ab1-9be6-d413a2c17cb2", "address": "fa:16:3e:af:0f:dd", "network": {"id": "83f5548a-aebf-46e0-a4d2-07f06d3967d4", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1141449765-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d80b528594ac4ee5b3b56bf7c94c7ffa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca42655-a0", "ovs_interfaceid": "9ca42655-a086-4ab1-9be6-d413a2c17cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:14:57.065626 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:0f:dd,bridge_name='br-int',has_traffic_filtering=True,id=9ca42655-a086-4ab1-9be6-d413a2c17cb2,network=Network(83f5548a-aebf-46e0-a4d2-07f06d3967d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ca42655-a0') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:14:57.066366 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lazy-loading 'pci_devices' on Instance uuid 7de5b639-f7aa-46af-8f5e-a34503673ba0 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:14:57.296490 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:14:57.391309 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:14:57.571334 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] End _get_guest_xml xml=<domain type="qemu">
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:   <uuid>7de5b639-f7aa-46af-8f5e-a34503673ba0</uuid>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:   <name>instance-0000004b</name>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:       <nova:name>tempest-TestVolumeBootPatternV346-server-1722593881</nova:name>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:14:53</nova:creationTime>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:       <nova:image uuid="">
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:         <nova:user uuid="7ffa50296592417a99dd0566355e09f9">tempest-TestVolumeBootPatternV346-204163382-project-member</nova:user>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:         <nova:project uuid="d80b528594ac4ee5b3b56bf7c94c7ffa">tempest-TestVolumeBootPatternV346-204163382</nova:project>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:       <nova:root type="volume" uuid=""/>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:         <nova:port uuid="9ca42655-a086-4ab1-9be6-d413a2c17cb2">
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:     <system>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:       <entry name="serial">7de5b639-f7aa-46af-8f5e-a34503673ba0</entry>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:       <entry name="uuid">7de5b639-f7aa-46af-8f5e-a34503673ba0</entry>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:     </system>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:   <os>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:   </os>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:   <features>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:   </features>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:   <devices>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/7de5b639-f7aa-46af-8f5e-a34503673ba0/disk.config"/>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:     </disk>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:       <alias name="ua-052c293f-59e1-402b-9305-6ebf50a25311"/>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-9"/>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:       <serial>052c293f-59e1-402b-9305-6ebf50a25311</serial>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:     </disk>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:af:0f:dd"/>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:       <target dev="tap9ca42655-a0"/>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:     </interface>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/7de5b639-f7aa-46af-8f5e-a34503673ba0/console.log" append="off"/>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:     </serial>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:     <video>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:     </video>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:     </rng>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:   </devices>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]: </domain>
May 28 10:14:57.571334 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:14:57.582442 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Preparing to wait for external event network-vif-plugged-9ca42655-a086-4ab1-9be6-d413a2c17cb2 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:14:57.582442 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Acquiring lock "7de5b639-f7aa-46af-8f5e-a34503673ba0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:14:57.582442 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "7de5b639-f7aa-46af-8f5e-a34503673ba0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:14:57.582442 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "7de5b639-f7aa-46af-8f5e-a34503673ba0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:14:57.582442 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:14:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1722593881',display_name='tempest-TestVolumeBootPatternV346-server-1722593881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpatternv346-server-1722593881',id=75,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbEV5EpMk8TD/JMl9q94xI07WMKeq+7uwufxX5ppffET/qe5CaI2B5EPSWlpYD54YJuCZA/PCJIL/KwgoEN9C7arA++M77IsZqrD6GlTm+AfxZfjZIjcn94RmhD5yFbKA==',key_name='tempest-keypair-439171385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d80b528594ac4ee5b3b56bf7c94c7ffa',ramdisk_id='',reservation_id='r-hd4t3ijz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-204163382',owner_user_name='tempest-TestVolumeBootPatternV346-204163382-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:14:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ffa50296592417a99dd0566355e09f9',uuid=7de5b639-f7aa-46af-8f5e-a34503673ba0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ca42655-a086-4ab1-9be6-d413a2c17cb2", "address": "fa:16:3e:af:0f:dd", "network": {"id": "83f5548a-aebf-46e0-a4d2-07f06d3967d4", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1141449765-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d80b528594ac4ee5b3b56bf7c94c7ffa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca42655-a0", "ovs_interfaceid": "9ca42655-a086-4ab1-9be6-d413a2c17cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:14:57.582442 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Converting VIF {"id": "9ca42655-a086-4ab1-9be6-d413a2c17cb2", "address": "fa:16:3e:af:0f:dd", "network": {"id": "83f5548a-aebf-46e0-a4d2-07f06d3967d4", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1141449765-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d80b528594ac4ee5b3b56bf7c94c7ffa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca42655-a0", "ovs_interfaceid": "9ca42655-a086-4ab1-9be6-d413a2c17cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:14:57.582442 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:0f:dd,bridge_name='br-int',has_traffic_filtering=True,id=9ca42655-a086-4ab1-9be6-d413a2c17cb2,network=Network(83f5548a-aebf-46e0-a4d2-07f06d3967d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ca42655-a0') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:14:57.582442 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:0f:dd,bridge_name='br-int',has_traffic_filtering=True,id=9ca42655-a086-4ab1-9be6-d413a2c17cb2,network=Network(83f5548a-aebf-46e0-a4d2-07f06d3967d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ca42655-a0') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:14:57.582442 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:57.582442 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:14:57.582442 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:14:57.582442 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:57.582442 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'db68178d-2ba1-5f0b-a072-eb48526113c0', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:14:57.584780 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:57.585507 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:14:57.589384 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:57.589384 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9ca42655-a0, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:14:57.589384 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9ca42655-a0, col_values=(('qos', UUID('c2156572-0aab-41af-8406-e98ac367770f')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:14:57.590100 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9ca42655-a0, col_values=(('external_ids', {'iface-id': '9ca42655-a086-4ab1-9be6-d413a2c17cb2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:0f:dd', 'vm-uuid': '7de5b639-f7aa-46af-8f5e-a34503673ba0'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:14:57.592233 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:14:57.596693 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:57.597889 np0000001613 nova-compute[98321]: INFO os_vif [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:0f:dd,bridge_name='br-int',has_traffic_filtering=True,id=9ca42655-a086-4ab1-9be6-d413a2c17cb2,network=Network(83f5548a-aebf-46e0-a4d2-07f06d3967d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ca42655-a0')
May 28 10:14:57.894841 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:14:57.939961 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:14:57.940169 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:14:57.943516 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:14:57.943632 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Claim successful on node np0000001613
May 28 10:14:59.117296 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:14:59.117718 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:14:59.117718 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] No VIF found with MAC fa:16:3e:af:0f:dd, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:14:59.118264 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Using config drive
May 28 10:14:59.259425 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:14:59.259666 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:14:59.627321 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:14:59.751525 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Creating config drive at /opt/stack/data/nova/instances/7de5b639-f7aa-46af-8f5e-a34503673ba0/disk.config
May 28 10:14:59.755864 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7de5b639-f7aa-46af-8f5e-a34503673ba0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf4hkxnka {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:14:59.773901 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:14:59.820090 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7de5b639-f7aa-46af-8f5e-a34503673ba0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf4hkxnka" returned: 0 in 0.064s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:14:59.979518 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.00044879799997943337 future=<Future at 0x73c1f41bbd40 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:14:59.979610 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:14:59.980131 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Emitting event <LifecycleEvent: 1779963284.9789686, 0cffddf7-ea43-43a0-83c1-6bddb8e42884 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:14:59.980332 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] VM Stopped (Lifecycle Event)
May 28 10:15:00.075864 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:00.187750 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:00.212483 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:00.215345 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:00.284907 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.345s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:15:00.285248 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:15:00.301682 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:00.347113 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:00.368256 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-425c7b1e-cdb4-446d-ba42-b1cf1f516a22 req-bc5c73dd-43da-45f6-84e5-b4f7f40de53e service nova] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Received event network-vif-plugged-9ca42655-a086-4ab1-9be6-d413a2c17cb2 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:15:00.368444 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-425c7b1e-cdb4-446d-ba42-b1cf1f516a22 req-bc5c73dd-43da-45f6-84e5-b4f7f40de53e service nova] Acquiring lock "7de5b639-f7aa-46af-8f5e-a34503673ba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:15:00.368604 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-425c7b1e-cdb4-446d-ba42-b1cf1f516a22 req-bc5c73dd-43da-45f6-84e5-b4f7f40de53e service nova] Lock "7de5b639-f7aa-46af-8f5e-a34503673ba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:15:00.368715 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-425c7b1e-cdb4-446d-ba42-b1cf1f516a22 req-bc5c73dd-43da-45f6-84e5-b4f7f40de53e service nova] Lock "7de5b639-f7aa-46af-8f5e-a34503673ba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:15:00.368835 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-425c7b1e-cdb4-446d-ba42-b1cf1f516a22 req-bc5c73dd-43da-45f6-84e5-b4f7f40de53e service nova] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Processing event network-vif-plugged-9ca42655-a086-4ab1-9be6-d413a2c17cb2 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:15:00.482878 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 0cffddf7-ea43-43a0-83c1-6bddb8e42884] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:15:00.791846 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:15:00.792506 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:15:00.792863 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:15:00.793111 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:15:00.854606 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec58233d3b2848bbb2e0b00650398cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e9651268114327a9cc6c6c59bef01e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:15:00.877656 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963300.877354, 7de5b639-f7aa-46af-8f5e-a34503673ba0 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:15:00.877778 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] VM Started (Lifecycle Event)
May 28 10:15:00.878909 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:15:00.880970 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:15:00.884375 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Instance spawned successfully.
May 28 10:15:00.884802 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:15:01.296180 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:15:01.299724 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Successfully created port: eba7bb57-5c95-42bd-beb9-6e9af82baa89 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:15:01.380240 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:15:01.383051 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:15:01.392269 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:15:01.392435 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:15:01.392790 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:15:01.393059 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:15:01.393398 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:15:01.393856 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:15:01.801860 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:15:01.859717 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Successfully updated port: eba7bb57-5c95-42bd-beb9-6e9af82baa89 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:15:01.887714 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:15:01.888355 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963301.888086, 7de5b639-f7aa-46af-8f5e-a34503673ba0 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:15:01.888523 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] VM Paused (Lifecycle Event)
May 28 10:15:01.899638 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Took 8.46 seconds to spawn the instance on the hypervisor.
May 28 10:15:01.899638 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:15:01.939720 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e0a437ad-9f01-474f-b23b-182a1e49eeaf req-47e76e29-5c2b-4b89-b7d2-b2eabc3549ba service nova] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Received event network-changed-eba7bb57-5c95-42bd-beb9-6e9af82baa89 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:15:01.940924 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-e0a437ad-9f01-474f-b23b-182a1e49eeaf req-47e76e29-5c2b-4b89-b7d2-b2eabc3549ba service nova] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Refreshing instance network info cache due to event network-changed-eba7bb57-5c95-42bd-beb9-6e9af82baa89. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:15:01.942062 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e0a437ad-9f01-474f-b23b-182a1e49eeaf req-47e76e29-5c2b-4b89-b7d2-b2eabc3549ba service nova] Acquiring lock "refresh_cache-4ce32a9b-fc5a-4931-9880-dd7638009cc5" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:15:01.942062 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e0a437ad-9f01-474f-b23b-182a1e49eeaf req-47e76e29-5c2b-4b89-b7d2-b2eabc3549ba service nova] Acquired lock "refresh_cache-4ce32a9b-fc5a-4931-9880-dd7638009cc5" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:15:01.942257 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-e0a437ad-9f01-474f-b23b-182a1e49eeaf req-47e76e29-5c2b-4b89-b7d2-b2eabc3549ba service nova] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Refreshing network info cache for port eba7bb57-5c95-42bd-beb9-6e9af82baa89 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:15:02.296223 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:15:02.296638 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:15:02.296638 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:15:02.296638 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 10:15:02.296857 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:15:02.296919 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Cleaning up deleted instances {{(pid=98321) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
May 28 10:15:02.305748 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Booting with volume 36963ede-84ce-4a49-afed-c6e79cfb9ae1 at /dev/vda
May 28 10:15:02.349162 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:15:02.360389 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:15:02.362309 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "refresh_cache-4ce32a9b-fc5a-4931-9880-dd7638009cc5" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:15:02.380189 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:15:02.396520 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:15:02.403693 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963302.403033, 7de5b639-f7aa-46af-8f5e-a34503673ba0 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:15:02.403840 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] VM Resumed (Lifecycle Event)
May 28 10:15:02.414941 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Took 15.59 seconds to build instance.
May 28 10:15:02.424360 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:15:02.424813 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:15:02.434942 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:15:02.435964 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe49:8be9', 'fe80::2c59:8cff:fea1:3a8', 'fe80::fc16:3eff:fe38:919c', 'fe80::fc16:3eff:feed:769b', 'fe80::e4eb:4cff:fe5c:5eb7', 'fe80::fc16:3eff:fe72:cbb7', 'fe80::428:aaff:fee4:e565', 'fe80::fc16:3eff:feaf:fdd'] 
May 28 10:15:02.436115 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:15:02.436273 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:15:02.436522 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:15:02.436743 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Updating existing volume attachment record: dd83d77e-e6b4-4f4a-bf7f-6dcc95044d79 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:15:02.442464 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-bf92b7ba-8dee-425f-8d98-4192f91d39be req-6f1ed26e-2d02-4d05-9c70-7f5eef5a2ee1 service nova] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Received event network-vif-plugged-9ca42655-a086-4ab1-9be6-d413a2c17cb2 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:15:02.443092 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-bf92b7ba-8dee-425f-8d98-4192f91d39be req-6f1ed26e-2d02-4d05-9c70-7f5eef5a2ee1 service nova] Acquiring lock "7de5b639-f7aa-46af-8f5e-a34503673ba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:15:02.443345 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-bf92b7ba-8dee-425f-8d98-4192f91d39be req-6f1ed26e-2d02-4d05-9c70-7f5eef5a2ee1 service nova] Lock "7de5b639-f7aa-46af-8f5e-a34503673ba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:15:02.443496 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-bf92b7ba-8dee-425f-8d98-4192f91d39be req-6f1ed26e-2d02-4d05-9c70-7f5eef5a2ee1 service nova] Lock "7de5b639-f7aa-46af-8f5e-a34503673ba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:15:02.443620 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-bf92b7ba-8dee-425f-8d98-4192f91d39be req-6f1ed26e-2d02-4d05-9c70-7f5eef5a2ee1 service nova] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] No waiting events found dispatching network-vif-plugged-9ca42655-a086-4ab1-9be6-d413a2c17cb2 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:15:02.443742 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-bf92b7ba-8dee-425f-8d98-4192f91d39be req-6f1ed26e-2d02-4d05-9c70-7f5eef5a2ee1 service nova] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Received unexpected event network-vif-plugged-9ca42655-a086-4ab1-9be6-d413a2c17cb2 for instance with vm_state active and task_state None.
May 28 10:15:02.446502 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-e0a437ad-9f01-474f-b23b-182a1e49eeaf req-47e76e29-5c2b-4b89-b7d2-b2eabc3549ba service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:15:02.513692 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-e0a437ad-9f01-474f-b23b-182a1e49eeaf req-47e76e29-5c2b-4b89-b7d2-b2eabc3549ba service nova] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:15:02.590713 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:02.651618 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-e0a437ad-9f01-474f-b23b-182a1e49eeaf req-47e76e29-5c2b-4b89-b7d2-b2eabc3549ba service nova] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:15:02.799239 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] There are 0 instances to clean {{(pid=98321) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
May 28 10:15:02.799478 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.49 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:15:02.917076 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:15:02.918113 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-e97bb1ef-acc4-462f-9f22-0bea973b8112 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "7de5b639-f7aa-46af-8f5e-a34503673ba0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.103s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:15:02.919936 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:15:03.153585 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-e0a437ad-9f01-474f-b23b-182a1e49eeaf req-47e76e29-5c2b-4b89-b7d2-b2eabc3549ba service nova] Releasing lock "refresh_cache-4ce32a9b-fc5a-4931-9880-dd7638009cc5" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:15:03.155150 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquired lock "refresh_cache-4ce32a9b-fc5a-4931-9880-dd7638009cc5" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:15:03.155150 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:15:03.294578 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:15:03.294920 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.49 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:15:03.640738 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-06d83e09-5a58-45b3-a59f-f1e08baddfdd req-eaad74f4-fc33-41b3-bb2a-575c68750ac9 service nova] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Received event network-changed-9ca42655-a086-4ab1-9be6-d413a2c17cb2 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:15:03.641208 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-06d83e09-5a58-45b3-a59f-f1e08baddfdd req-eaad74f4-fc33-41b3-bb2a-575c68750ac9 service nova] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Refreshing instance network info cache due to event network-changed-9ca42655-a086-4ab1-9be6-d413a2c17cb2. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:15:03.641709 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-06d83e09-5a58-45b3-a59f-f1e08baddfdd req-eaad74f4-fc33-41b3-bb2a-575c68750ac9 service nova] Acquiring lock "refresh_cache-7de5b639-f7aa-46af-8f5e-a34503673ba0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:15:03.641709 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-06d83e09-5a58-45b3-a59f-f1e08baddfdd req-eaad74f4-fc33-41b3-bb2a-575c68750ac9 service nova] Acquired lock "refresh_cache-7de5b639-f7aa-46af-8f5e-a34503673ba0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:15:03.641709 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-06d83e09-5a58-45b3-a59f-f1e08baddfdd req-eaad74f4-fc33-41b3-bb2a-575c68750ac9 service nova] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Refreshing network info cache for port 9ca42655-a086-4ab1-9be6-d413a2c17cb2 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:15:03.715942 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:15:03.787754 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:15:03.788050 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:15:03.791377 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:15:03.861843 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:15:03.976552 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Updating instance_info_cache with network_info: [{"id": "eba7bb57-5c95-42bd-beb9-6e9af82baa89", "address": "fa:16:3e:f0:e6:55", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba7bb57-5c", "ovs_interfaceid": "eba7bb57-5c95-42bd-beb9-6e9af82baa89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:15:04.143385 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-06d83e09-5a58-45b3-a59f-f1e08baddfdd req-eaad74f4-fc33-41b3-bb2a-575c68750ac9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:15:04.296666 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:15:04.296826 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:15:04.296960 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:15:04.297124 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Auditing locally available compute resources for np0000001613 (node: np0000001613) {{(pid=98321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 10:15:04.478363 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Releasing lock "refresh_cache-4ce32a9b-fc5a-4931-9880-dd7638009cc5" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:15:04.478632 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Instance network_info: |[{"id": "eba7bb57-5c95-42bd-beb9-6e9af82baa89", "address": "fa:16:3e:f0:e6:55", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba7bb57-5c", "ovs_interfaceid": "eba7bb57-5c95-42bd-beb9-6e9af82baa89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:15:04.487184 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-06d83e09-5a58-45b3-a59f-f1e08baddfdd req-eaad74f4-fc33-41b3-bb2a-575c68750ac9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:15:04.542223 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:15:04.543853 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:15:04.543916 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Creating image(s)
May 28 10:15:04.544250 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Did not create local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 10:15:04.544417 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Ensure instance console log exists: /opt/stack/data/nova/instances/4ce32a9b-fc5a-4931-9880-dd7638009cc5/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:15:04.544670 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:15:04.544873 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:15:04.545039 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:15:04.545641 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Start _get_guest_xml network_info=[{"id": "eba7bb57-5c95-42bd-beb9-6e9af82baa89", "address": "fa:16:3e:f0:e6:55", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba7bb57-5c", "ovs_interfaceid": "eba7bb57-5c95-42bd-beb9-6e9af82baa89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1', 'iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '36963ede-84ce-4a49-afed-c6e79cfb9ae1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '4ce32a9b-fc5a-4931-9880-dd7638009cc5', 'attached_at': '', 'detached_at': '', 'volume_id': '36963ede-84ce-4a49-afed-c6e79cfb9ae1', 'serial': '36963ede-84ce-4a49-afed-c6e79cfb9ae1'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'dd83d77e-e6b4-4f4a-bf7f-6dcc95044d79', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:15:04.548442 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:15:04.550199 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-531621314', uuid='4ce32a9b-fc5a-4931-9880-dd7638009cc5'), owner=OwnerMeta(userid='ec58233d3b2848bbb2e0b00650398cd1', username='tempest-TestVolumeBootPattern-327944304-project-member', projectid='23e9651268114327a9cc6c6c59bef01e', projectname='tempest-TestVolumeBootPattern-327944304'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "eba7bb57-5c95-42bd-beb9-6e9af82baa89", "address": "fa:16:3e:f0:e6:55", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba7bb57-5c", "ovs_interfaceid": "eba7bb57-5c95-42bd-beb9-6e9af82baa89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779963304.5494452) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:15:04.551180 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:15:04.554718 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:15:04.558187 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:15:04.558187 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:15:04.558187 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:15:04.558187 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:15:04.558187 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:15:04.558187 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:15:04.558187 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:15:04.558414 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:15:04.558414 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:15:04.558610 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:15:04.558739 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:15:04.558872 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:15:04.559005 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:15:04.559186 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:15:04.574723 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:15:04.575133 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1', 'iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '36963ede-84ce-4a49-afed-c6e79cfb9ae1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:15:04.575325 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:15:04.617015 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-06d83e09-5a58-45b3-a59f-f1e08baddfdd req-eaad74f4-fc33-41b3-bb2a-575c68750ac9 service nova] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Updated VIF entry in instance network info cache for port 9ca42655-a086-4ab1-9be6-d413a2c17cb2. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:15:04.617337 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-06d83e09-5a58-45b3-a59f-f1e08baddfdd req-eaad74f4-fc33-41b3-bb2a-575c68750ac9 service nova] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Updating instance_info_cache with network_info: [{"id": "9ca42655-a086-4ab1-9be6-d413a2c17cb2", "address": "fa:16:3e:af:0f:dd", "network": {"id": "83f5548a-aebf-46e0-a4d2-07f06d3967d4", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1141449765-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d80b528594ac4ee5b3b56bf7c94c7ffa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca42655-a0", "ovs_interfaceid": "9ca42655-a086-4ab1-9be6-d413a2c17cb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:15:05.077815 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:05.119373 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-06d83e09-5a58-45b3-a59f-f1e08baddfdd req-eaad74f4-fc33-41b3-bb2a-575c68750ac9 service nova] Releasing lock "refresh_cache-7de5b639-f7aa-46af-8f5e-a34503673ba0" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:15:05.326336 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-9 (vda) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:15:05.328046 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:15:05.329330 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-6 (vda) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:15:05.330613 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:15:05.331960 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543ae6b-cda1-4986-bc88-2982f1610eec/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:15:05.423833 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543ae6b-cda1-4986-bc88-2982f1610eec/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:15:05.424467 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543ae6b-cda1-4986-bc88-2982f1610eec/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:15:05.512186 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2543ae6b-cda1-4986-bc88-2982f1610eec/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:15:05.521229 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:15:05.522709 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:15:05.572724 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "env LANG=C uptime" returned: 0 in 0.049s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:15:05.573282 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Hypervisor/Node resource view: name=np0000001613 free_ram=12269MB free_disk=72.64261245727539GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 10:15:05.573511 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:15:05.573836 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:15:05.841152 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.266s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:15:05.841480 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1', 'iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '36963ede-84ce-4a49-afed-c6e79cfb9ae1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:15:05.853254 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:15:05.853859 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:15:05.854352 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:15:05.854580 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:15:05.854999 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:15:05.855289 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:15:05.866784 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:15:05.866784 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:05.870388 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:15:05.870388 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:05.878445 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1] added
May 28 10:15:05.878445 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:15:05.878445 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:15:05.878445 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:15:05.878445 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:15:05.878445 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:15:05.878445 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:05.878724 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:15:05.878940 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0243(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:15:05.879185 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:15:05.882944 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1] added
May 28 10:15:05.882944 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:15:05.882944 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:15:05.882944 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:15:05.882944 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:15:05.882944 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:15:05.882944 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:05.883144 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:15:05.883252 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.028(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:15:05.883390 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:15:06.664950 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 93a38b6d-e199-4653-a617-290247c8e430 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:15:06.665463 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance bf181571-acd7-4482-90b1-50b7223411fc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:15:06.665463 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 0327fb6e-6b30-4f70-8877-a3859969f5ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:15:06.666078 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 2543ae6b-cda1-4986-bc88-2982f1610eec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:15:06.666182 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 7de5b639-f7aa-46af-8f5e-a34503673ba0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:15:06.666302 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 4ce32a9b-fc5a-4931-9880-dd7638009cc5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:15:06.666481 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 10:15:06.666634 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Final resource view: name=np0000001613 phys_ram=24030MB used_ram=1664MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=6 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 10:15:05 up 47 min,  2 users,  load average: 4.97, 6.65, 5.49\n', 'num_instances': '6', 'num_vm_active': '5', 'num_task_None': '5', 'num_os_type_None': '6', 'num_proj_d80b528594ac4ee5b3b56bf7c94c7ffa': '3', 'io_workload': '1', 'num_proj_23e9651268114327a9cc6c6c59bef01e': '2', 'num_proj_2a515533ba1c4e23a52f472549e5211f': '1', 'num_vm_building': '1', 'num_task_spawning': '1'} {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 10:15:06.879557 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:15:06.883734 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:15:06.892506 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:15:06.892506 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:15:06.901939 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:15:06.901939 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:06.904967 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:06.913838 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:06.922645 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:06.922645 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:06.922645 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:06.922645 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:06.922645 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:06.922645 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:06.922645 np0000001613 nova-compute[98321]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:15:06.922645 np0000001613 nova-compute[98321]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:15:06.922645 np0000001613 nova-compute[98321]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d340710-424e-45ff-b451-7a2d32944fd8 (non-flash)
May 28 10:15:06.922645 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:15:06.922961 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:06.922961 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:06.922961 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:06.922961 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:06.922961 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:06.922961 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:06.922961 np0000001613 nova-compute[98321]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:15:06.922961 np0000001613 nova-compute[98321]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:15:06.922961 np0000001613 nova-compute[98321]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d340710-424e-45ff-b451-7a2d32944fd8 (non-flash)
May 28 10:15:06.922961 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:15:06.933454 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:06.933454 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:06.933454 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:06.933454 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:06.933454 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:06.933454 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:06.933454 np0000001613 nova-compute[98321]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:15:06.933454 np0000001613 nova-compute[98321]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:15:06.933454 np0000001613 nova-compute[98321]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d340710-424e-45ff-b451-7a2d32944fd8 (non-flash)
May 28 10:15:06.933454 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:15:06.933703 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:06.933703 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:06.933703 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:06.933703 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:06.933703 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:06.933703 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:06.933703 np0000001613 nova-compute[98321]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:15:06.933703 np0000001613 nova-compute[98321]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:15:06.933703 np0000001613 nova-compute[98321]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d340710-424e-45ff-b451-7a2d32944fd8 (non-flash)
May 28 10:15:06.933703 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:15:06.959583 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1, portal: 192.168.40.100,3260]
May 28 10:15:06.959583 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1, portal: 192.168.40.100,3260] successful.
May 28 10:15:06.959583 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:06.972214 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:06.982825 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:15:06.983040 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:15:06.986003 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1, portal: 192.168.50.100,3260]
May 28 10:15:06.986003 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1, portal: 192.168.50.100,3260] successful.
May 28 10:15:06.986003 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:06.991690 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:06.991690 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:06.991690 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:06.991690 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:06.991690 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:06.991690 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:06.991690 np0000001613 nova-compute[98321]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:15:06.991690 np0000001613 nova-compute[98321]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:15:06.991690 np0000001613 nova-compute[98321]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d340710-424e-45ff-b451-7a2d32944fd8 (non-flash)
May 28 10:15:06.991690 np0000001613 nova-compute[98321]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1 (non-flash)
May 28 10:15:06.991690 np0000001613 nova-compute[98321]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1 (non-flash)
May 28 10:15:06.991690 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:15:06.992045 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:06.992045 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:06.992045 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:06.992045 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:06.992045 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:06.992045 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:06.992045 np0000001613 nova-compute[98321]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:15:06.992045 np0000001613 nova-compute[98321]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:15:06.992045 np0000001613 nova-compute[98321]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d340710-424e-45ff-b451-7a2d32944fd8 (non-flash)
May 28 10:15:06.992045 np0000001613 nova-compute[98321]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1 (non-flash)
May 28 10:15:06.992045 np0000001613 nova-compute[98321]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1 (non-flash)
May 28 10:15:06.992045 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:15:06.992386 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.138s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:15:06.992505 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:15:06.993548 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] HCTL ('16', '-', '-', 0) found on session 207 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:15:06.993649 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:15:07.002608 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:07.028498 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:07.028498 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:07.028498 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:07.028498 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:07.028498 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:07.028498 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:07.028498 np0000001613 nova-compute[98321]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:15:07.028498 np0000001613 nova-compute[98321]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:15:07.028498 np0000001613 nova-compute[98321]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d340710-424e-45ff-b451-7a2d32944fd8 (non-flash)
May 28 10:15:07.028498 np0000001613 nova-compute[98321]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1 (non-flash)
May 28 10:15:07.028498 np0000001613 nova-compute[98321]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1 (non-flash)
May 28 10:15:07.028498 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:15:07.028498 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:07.028498 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:07.028498 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:07.028498 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:07.028498 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:07.028498 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:07.028498 np0000001613 nova-compute[98321]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:15:07.028498 np0000001613 nova-compute[98321]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:15:07.028498 np0000001613 nova-compute[98321]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d340710-424e-45ff-b451-7a2d32944fd8 (non-flash)
May 28 10:15:07.028498 np0000001613 nova-compute[98321]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1 (non-flash)
May 28 10:15:07.028498 np0000001613 nova-compute[98321]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1 (non-flash)
May 28 10:15:07.028498 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:15:07.028498 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.173s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:15:07.028498 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:15:07.029172 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching for a device in session 207 and hctl ['16', '*', '*', 0] yield: None {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:15:07.031737 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] HCTL ('17', '-', '-', 0) found on session 208 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:15:07.031859 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:15:07.048101 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching for a device in session 208 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:15:07.048101 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '36963ede-84ce-4a49-afed-c6e79cfb9ae1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:15:07.485904 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:15:07.592676 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:07.993398 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Compute_service record updated for np0000001613:np0000001613 {{(pid=98321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 10:15:07.993859 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.420s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:15:07.993859 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:15:08.029760 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Searching for a device in session 207 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:15:08.029934 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '36963ede-84ce-4a49-afed-c6e79cfb9ae1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:15:08.876870 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Found WWN 33000000009356007 for multipath device dm-12 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:15:08.877146 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:15:08.877336 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] <== connect_volume: return (4301ms) {'type': 'block', 'scsi_wwn': '33000000009356007', 'path': '/dev/dm-12', 'multipath_id': '33000000009356007'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:15:08.877469 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000009356007', 'path': '/dev/dm-12', 'multipath_id': '33000000009356007'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:15:09.253136 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.49 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:15:09.385753 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:14:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-531621314',display_name='tempest-TestVolumeBootPattern-server-531621314',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpattern-server-531621314',id=76,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIssEW3wFq5Z5UVaYZuW5cmCRsiPiqbdvADCw1wCLU3ZToJr2mBO+GTeBlReOodZ6qxe1OJNXGES/jiq9J2PvBGzYYtKCDR4nIPiT2JecYH/bovKreakXe+d0IlAq6PNVA==',key_name='tempest-TestVolumeBootPattern-1325122028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23e9651268114327a9cc6c6c59bef01e',ramdisk_id='',reservation_id='r-dv2kjgh1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-327944304',owner_user_name='tempest-TestVolumeBootPattern-327944304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:15:02Z,user_data=None,user_id='ec58233d3b2848bbb2e0b00650398cd1',uuid=4ce32a9b-fc5a-4931-9880-dd7638009cc5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eba7bb57-5c95-42bd-beb9-6e9af82baa89", "address": "fa:16:3e:f0:e6:55", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba7bb57-5c", "ovs_interfaceid": "eba7bb57-5c95-42bd-beb9-6e9af82baa89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:15:09.385948 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converting VIF {"id": "eba7bb57-5c95-42bd-beb9-6e9af82baa89", "address": "fa:16:3e:f0:e6:55", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba7bb57-5c", "ovs_interfaceid": "eba7bb57-5c95-42bd-beb9-6e9af82baa89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:15:09.386502 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e6:55,bridge_name='br-int',has_traffic_filtering=True,id=eba7bb57-5c95-42bd-beb9-6e9af82baa89,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeba7bb57-5c') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:15:09.387084 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ce32a9b-fc5a-4931-9880-dd7638009cc5 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:15:09.894910 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] End _get_guest_xml xml=<domain type="qemu">
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:   <uuid>4ce32a9b-fc5a-4931-9880-dd7638009cc5</uuid>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:   <name>instance-0000004c</name>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:       <nova:name>tempest-TestVolumeBootPattern-server-531621314</nova:name>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:15:04</nova:creationTime>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:       <nova:image uuid="">
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:         <nova:user uuid="ec58233d3b2848bbb2e0b00650398cd1">tempest-TestVolumeBootPattern-327944304-project-member</nova:user>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:         <nova:project uuid="23e9651268114327a9cc6c6c59bef01e">tempest-TestVolumeBootPattern-327944304</nova:project>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:       <nova:root type="volume" uuid=""/>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:         <nova:port uuid="eba7bb57-5c95-42bd-beb9-6e9af82baa89">
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:     <system>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:       <entry name="serial">4ce32a9b-fc5a-4931-9880-dd7638009cc5</entry>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:       <entry name="uuid">4ce32a9b-fc5a-4931-9880-dd7638009cc5</entry>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:     </system>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:   <os>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:   </os>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:   <features>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:   </features>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:   <devices>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/4ce32a9b-fc5a-4931-9880-dd7638009cc5/disk.config"/>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:     </disk>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:       <alias name="ua-36963ede-84ce-4a49-afed-c6e79cfb9ae1"/>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-12"/>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:       <serial>36963ede-84ce-4a49-afed-c6e79cfb9ae1</serial>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:     </disk>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:f0:e6:55"/>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:       <target dev="tapeba7bb57-5c"/>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:     </interface>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/4ce32a9b-fc5a-4931-9880-dd7638009cc5/console.log" append="off"/>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:     </serial>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:     <video>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:     </video>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:     </rng>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:   </devices>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]: </domain>
May 28 10:15:09.894910 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:15:09.896977 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Preparing to wait for external event network-vif-plugged-eba7bb57-5c95-42bd-beb9-6e9af82baa89 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:15:09.896977 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "4ce32a9b-fc5a-4931-9880-dd7638009cc5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:15:09.896977 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "4ce32a9b-fc5a-4931-9880-dd7638009cc5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:15:09.896977 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "4ce32a9b-fc5a-4931-9880-dd7638009cc5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:15:09.898480 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:14:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-531621314',display_name='tempest-TestVolumeBootPattern-server-531621314',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpattern-server-531621314',id=76,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIssEW3wFq5Z5UVaYZuW5cmCRsiPiqbdvADCw1wCLU3ZToJr2mBO+GTeBlReOodZ6qxe1OJNXGES/jiq9J2PvBGzYYtKCDR4nIPiT2JecYH/bovKreakXe+d0IlAq6PNVA==',key_name='tempest-TestVolumeBootPattern-1325122028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23e9651268114327a9cc6c6c59bef01e',ramdisk_id='',reservation_id='r-dv2kjgh1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-327944304',owner_user_name='tempest-TestVolumeBootPattern-327944304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:15:02Z,user_data=None,user_id='ec58233d3b2848bbb2e0b00650398cd1',uuid=4ce32a9b-fc5a-4931-9880-dd7638009cc5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eba7bb57-5c95-42bd-beb9-6e9af82baa89", "address": "fa:16:3e:f0:e6:55", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba7bb57-5c", "ovs_interfaceid": "eba7bb57-5c95-42bd-beb9-6e9af82baa89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:15:09.899172 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converting VIF {"id": "eba7bb57-5c95-42bd-beb9-6e9af82baa89", "address": "fa:16:3e:f0:e6:55", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba7bb57-5c", "ovs_interfaceid": "eba7bb57-5c95-42bd-beb9-6e9af82baa89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:15:09.900470 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e6:55,bridge_name='br-int',has_traffic_filtering=True,id=eba7bb57-5c95-42bd-beb9-6e9af82baa89,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeba7bb57-5c') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:15:09.902547 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e6:55,bridge_name='br-int',has_traffic_filtering=True,id=eba7bb57-5c95-42bd-beb9-6e9af82baa89,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeba7bb57-5c') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:15:09.906295 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:09.906698 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:15:09.907043 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:15:09.911567 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:09.911567 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf25a58f-1dd9-562a-95aa-bf447f8f23c4', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:15:09.913547 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:15:09.915565 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:09.915803 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeba7bb57-5c, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:15:09.916143 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeba7bb57-5c, col_values=(('qos', UUID('980d3cb3-3791-4fbb-ad24-df4c5ed4906f')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:15:09.916355 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeba7bb57-5c, col_values=(('external_ids', {'iface-id': 'eba7bb57-5c95-42bd-beb9-6e9af82baa89', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:e6:55', 'vm-uuid': '4ce32a9b-fc5a-4931-9880-dd7638009cc5'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:15:09.917419 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:09.918360 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:15:09.923627 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:09.924994 np0000001613 nova-compute[98321]: INFO os_vif [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e6:55,bridge_name='br-int',has_traffic_filtering=True,id=eba7bb57-5c95-42bd-beb9-6e9af82baa89,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeba7bb57-5c')
May 28 10:15:09.993984 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:15:09.994244 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:15:09.994556 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.79 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:15:10.079313 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:11.448085 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:15:11.448578 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:15:11.448578 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] No VIF found with MAC fa:16:3e:f0:e6:55, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:15:11.448822 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Using config drive
May 28 10:15:11.788137 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:15:11.788653 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 30.92 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:15:11.957887 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:15:12.067662 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Creating config drive at /opt/stack/data/nova/instances/4ce32a9b-fc5a-4931-9880-dd7638009cc5/disk.config
May 28 10:15:12.070609 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4ce32a9b-fc5a-4931-9880-dd7638009cc5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvp86ufvt {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:15:12.132338 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4ce32a9b-fc5a-4931-9880-dd7638009cc5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvp86ufvt" returned: 0 in 0.061s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:15:12.636202 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:12.662473 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:12.666076 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:12.765119 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:12.831531 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:12.835544 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:12.862268 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c0e53d60-3aa7-449f-93ea-aade8135e241 req-a8527fa7-e412-4039-8dd9-3c915226961c service nova] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Received event network-vif-plugged-eba7bb57-5c95-42bd-beb9-6e9af82baa89 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:15:12.863641 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c0e53d60-3aa7-449f-93ea-aade8135e241 req-a8527fa7-e412-4039-8dd9-3c915226961c service nova] Acquiring lock "4ce32a9b-fc5a-4931-9880-dd7638009cc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:15:12.864735 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c0e53d60-3aa7-449f-93ea-aade8135e241 req-a8527fa7-e412-4039-8dd9-3c915226961c service nova] Lock "4ce32a9b-fc5a-4931-9880-dd7638009cc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:15:12.864945 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c0e53d60-3aa7-449f-93ea-aade8135e241 req-a8527fa7-e412-4039-8dd9-3c915226961c service nova] Lock "4ce32a9b-fc5a-4931-9880-dd7638009cc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:15:12.865045 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c0e53d60-3aa7-449f-93ea-aade8135e241 req-a8527fa7-e412-4039-8dd9-3c915226961c service nova] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Processing event network-vif-plugged-eba7bb57-5c95-42bd-beb9-6e9af82baa89 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:15:13.441665 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963313.439772, 4ce32a9b-fc5a-4931-9880-dd7638009cc5 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:15:13.441665 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] VM Started (Lifecycle Event)
May 28 10:15:13.442043 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:15:13.448212 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:15:13.451553 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Instance spawned successfully.
May 28 10:15:13.451934 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:15:13.946118 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:15:13.950645 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:15:13.963418 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:15:13.963459 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:15:13.963826 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:15:13.964125 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:15:13.964390 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:15:13.964657 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:15:14.454143 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:15:14.454416 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963314.454234, 4ce32a9b-fc5a-4931-9880-dd7638009cc5 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:15:14.454538 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] VM Paused (Lifecycle Event)
May 28 10:15:14.469879 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Took 9.93 seconds to spawn the instance on the hypervisor.
May 28 10:15:14.470046 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:15:14.916933 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:14.923787 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a9ad32c6-3dbb-42c4-8030-2e39ea538d77 req-e86b2eee-6002-437b-bc6d-72a27cfdf16a service nova] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Received event network-vif-plugged-eba7bb57-5c95-42bd-beb9-6e9af82baa89 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:15:14.924056 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a9ad32c6-3dbb-42c4-8030-2e39ea538d77 req-e86b2eee-6002-437b-bc6d-72a27cfdf16a service nova] Acquiring lock "4ce32a9b-fc5a-4931-9880-dd7638009cc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:15:14.924412 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a9ad32c6-3dbb-42c4-8030-2e39ea538d77 req-e86b2eee-6002-437b-bc6d-72a27cfdf16a service nova] Lock "4ce32a9b-fc5a-4931-9880-dd7638009cc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:15:14.924412 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a9ad32c6-3dbb-42c4-8030-2e39ea538d77 req-e86b2eee-6002-437b-bc6d-72a27cfdf16a service nova] Lock "4ce32a9b-fc5a-4931-9880-dd7638009cc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:15:14.924493 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a9ad32c6-3dbb-42c4-8030-2e39ea538d77 req-e86b2eee-6002-437b-bc6d-72a27cfdf16a service nova] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] No waiting events found dispatching network-vif-plugged-eba7bb57-5c95-42bd-beb9-6e9af82baa89 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:15:14.924604 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-a9ad32c6-3dbb-42c4-8030-2e39ea538d77 req-e86b2eee-6002-437b-bc6d-72a27cfdf16a service nova] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Received unexpected event network-vif-plugged-eba7bb57-5c95-42bd-beb9-6e9af82baa89 for instance with vm_state active and task_state None.
May 28 10:15:14.957481 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:15:14.960616 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963314.9602854, 4ce32a9b-fc5a-4931-9880-dd7638009cc5 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:15:14.960802 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] VM Resumed (Lifecycle Event)
May 28 10:15:14.979331 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Took 17.08 seconds to build instance.
May 28 10:15:15.080764 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:15.463329 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:15:15.465899 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:15:15.480787 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "4ce32a9b-fc5a-4931-9880-dd7638009cc5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.591s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:15:16.607071 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-0537095c-107b-4d45-b624-33ec7bb7a415 req-36dd4c55-b25e-46f9-bdf1-5a70604ac89a service nova] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Received event network-changed-eba7bb57-5c95-42bd-beb9-6e9af82baa89 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:15:16.607602 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-0537095c-107b-4d45-b624-33ec7bb7a415 req-36dd4c55-b25e-46f9-bdf1-5a70604ac89a service nova] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Refreshing instance network info cache due to event network-changed-eba7bb57-5c95-42bd-beb9-6e9af82baa89. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:15:16.607716 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0537095c-107b-4d45-b624-33ec7bb7a415 req-36dd4c55-b25e-46f9-bdf1-5a70604ac89a service nova] Acquiring lock "refresh_cache-4ce32a9b-fc5a-4931-9880-dd7638009cc5" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:15:16.607864 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0537095c-107b-4d45-b624-33ec7bb7a415 req-36dd4c55-b25e-46f9-bdf1-5a70604ac89a service nova] Acquired lock "refresh_cache-4ce32a9b-fc5a-4931-9880-dd7638009cc5" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:15:16.608023 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-0537095c-107b-4d45-b624-33ec7bb7a415 req-36dd4c55-b25e-46f9-bdf1-5a70604ac89a service nova] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Refreshing network info cache for port eba7bb57-5c95-42bd-beb9-6e9af82baa89 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:15:17.110213 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-0537095c-107b-4d45-b624-33ec7bb7a415 req-36dd4c55-b25e-46f9-bdf1-5a70604ac89a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:15:17.435468 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-0537095c-107b-4d45-b624-33ec7bb7a415 req-36dd4c55-b25e-46f9-bdf1-5a70604ac89a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:15:17.559803 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-0537095c-107b-4d45-b624-33ec7bb7a415 req-36dd4c55-b25e-46f9-bdf1-5a70604ac89a service nova] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Updated VIF entry in instance network info cache for port eba7bb57-5c95-42bd-beb9-6e9af82baa89. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:15:17.560066 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-0537095c-107b-4d45-b624-33ec7bb7a415 req-36dd4c55-b25e-46f9-bdf1-5a70604ac89a service nova] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Updating instance_info_cache with network_info: [{"id": "eba7bb57-5c95-42bd-beb9-6e9af82baa89", "address": "fa:16:3e:f0:e6:55", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba7bb57-5c", "ovs_interfaceid": "eba7bb57-5c95-42bd-beb9-6e9af82baa89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:15:18.063791 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0537095c-107b-4d45-b624-33ec7bb7a415 req-36dd4c55-b25e-46f9-bdf1-5a70604ac89a service nova] Releasing lock "refresh_cache-4ce32a9b-fc5a-4931-9880-dd7638009cc5" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:15:18.255086 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquiring lock "2543ae6b-cda1-4986-bc88-2982f1610eec" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:15:18.255504 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "2543ae6b-cda1-4986-bc88-2982f1610eec" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:15:18.758257 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lazy-loading 'flavor' on Instance uuid 2543ae6b-cda1-4986-bc88-2982f1610eec {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:15:19.763881 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "2543ae6b-cda1-4986-bc88-2982f1610eec" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:15:19.926614 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:20.082966 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:20.996445 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquiring lock "2543ae6b-cda1-4986-bc88-2982f1610eec" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:15:20.999224 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "2543ae6b-cda1-4986-bc88-2982f1610eec" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:15:20.999224 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Attaching volume 75a408de-7ad1-441e-8c61-7ab24afacba1 to /dev/vdb
May 28 10:15:21.037185 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:15:21.048124 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:15:21.074260 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:15:21.120604 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:15:21.121183 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:15:21.133841 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:15:21.135346 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe49:8be9', 'fe80::2c59:8cff:fea1:3a8', 'fe80::fc16:3eff:fe38:919c', 'fe80::fc16:3eff:feed:769b', 'fe80::e4eb:4cff:fe5c:5eb7', 'fe80::fc16:3eff:fe72:cbb7', 'fe80::428:aaff:fee4:e565', 'fe80::fc16:3eff:feaf:fdd', 'fe80::fc16:3eff:fef0:e655'] 
May 28 10:15:21.135687 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:15:21.135951 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:15:21.136338 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] <== get_connector_properties: return (99ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:15:21.136710 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Updating existing volume attachment record: 7a269190-fd7b-4f36-b612-2ea0d91b0b1d {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:15:21.709633 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1', 'iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '75a408de-7ad1-441e-8c61-7ab24afacba1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '2543ae6b-cda1-4986-bc88-2982f1610eec', 'attached_at': '', 'detached_at': '', 'volume_id': '75a408de-7ad1-441e-8c61-7ab24afacba1', 'serial': '75a408de-7ad1-441e-8c61-7ab24afacba1'} {{(pid=98321) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 10:15:21.713329 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:15:21.713682 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1', 'iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '75a408de-7ad1-441e-8c61-7ab24afacba1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:15:21.713825 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:15:22.075480 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.362s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:15:22.075833 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1', 'iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '75a408de-7ad1-441e-8c61-7ab24afacba1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:15:22.087545 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:15:22.088097 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:15:22.088549 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:15:22.088785 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:15:22.091555 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:15:22.091756 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:15:22.100032 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:15:22.100032 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:22.106246 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:15:22.106246 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:22.111474 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1] added
May 28 10:15:22.111474 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:15:22.111474 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:15:22.111474 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:15:22.111474 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:15:22.111474 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:15:22.111474 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:22.111712 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:15:22.111873 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0231(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:15:22.112044 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:15:22.116066 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1] added
May 28 10:15:22.116066 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:15:22.116066 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:15:22.116066 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:15:22.116066 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:15:22.116066 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:15:22.116066 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:22.116251 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:15:22.116359 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0246(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:15:22.116477 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:15:23.112544 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:15:23.117423 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:15:23.125377 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:15:23.125377 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:15:23.133379 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:15:23.133379 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:23.140209 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:23.146397 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:23.157860 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:23.157860 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:23.157860 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:23.157860 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:23.157860 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:23.157860 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:23.157860 np0000001613 nova-compute[98321]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:15:23.157860 np0000001613 nova-compute[98321]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:15:23.157860 np0000001613 nova-compute[98321]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1 (non-flash)
May 28 10:15:23.157860 np0000001613 nova-compute[98321]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1 (non-flash)
May 28 10:15:23.157860 np0000001613 nova-compute[98321]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20561d76-f7d4-4638-b2d7-4a110a4ff30c (non-flash)
May 28 10:15:23.157860 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:15:23.158199 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsi session list stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:23.158199 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:23.158199 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:23.158199 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:23.158199 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:23.158199 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:23.158199 np0000001613 nova-compute[98321]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:15:23.158199 np0000001613 nova-compute[98321]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:15:23.158199 np0000001613 nova-compute[98321]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1 (non-flash)
May 28 10:15:23.158199 np0000001613 nova-compute[98321]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1 (non-flash)
May 28 10:15:23.158199 np0000001613 nova-compute[98321]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20561d76-f7d4-4638-b2d7-4a110a4ff30c (non-flash)
May 28 10:15:23.158199 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:15:23.164404 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:23.164404 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:23.164404 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:23.164404 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:23.164404 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:23.164404 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:23.164404 np0000001613 nova-compute[98321]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:15:23.164404 np0000001613 nova-compute[98321]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:15:23.164404 np0000001613 nova-compute[98321]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1 (non-flash)
May 28 10:15:23.164404 np0000001613 nova-compute[98321]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1 (non-flash)
May 28 10:15:23.164404 np0000001613 nova-compute[98321]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20561d76-f7d4-4638-b2d7-4a110a4ff30c (non-flash)
May 28 10:15:23.164404 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:15:23.164752 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsi session list stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:23.164752 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:23.164752 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:23.164752 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:23.164752 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:23.164752 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:23.164752 np0000001613 nova-compute[98321]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:15:23.164752 np0000001613 nova-compute[98321]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:15:23.164752 np0000001613 nova-compute[98321]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1 (non-flash)
May 28 10:15:23.164752 np0000001613 nova-compute[98321]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1 (non-flash)
May 28 10:15:23.164752 np0000001613 nova-compute[98321]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20561d76-f7d4-4638-b2d7-4a110a4ff30c (non-flash)
May 28 10:15:23.164752 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:15:23.204561 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1, portal: 192.168.40.100,3260]
May 28 10:15:23.204561 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1, portal: 192.168.40.100,3260] successful.
May 28 10:15:23.204561 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:23.216370 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:23.221401 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1, portal: 192.168.50.100,3260]
May 28 10:15:23.221401 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1, portal: 192.168.50.100,3260] successful.
May 28 10:15:23.221401 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:23.235358 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:23.236888 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:23.236888 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:23.236888 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:23.236888 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:23.236888 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:23.236888 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:23.236888 np0000001613 nova-compute[98321]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:15:23.236888 np0000001613 nova-compute[98321]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:15:23.236888 np0000001613 nova-compute[98321]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1 (non-flash)
May 28 10:15:23.236888 np0000001613 nova-compute[98321]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1 (non-flash)
May 28 10:15:23.236888 np0000001613 nova-compute[98321]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20561d76-f7d4-4638-b2d7-4a110a4ff30c (non-flash)
May 28 10:15:23.236888 np0000001613 nova-compute[98321]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1 (non-flash)
May 28 10:15:23.236888 np0000001613 nova-compute[98321]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1 (non-flash)
May 28 10:15:23.236888 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:15:23.237537 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsi session list stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:23.237537 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:23.237537 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:23.237537 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:23.237537 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:23.237537 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:23.237537 np0000001613 nova-compute[98321]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:15:23.237537 np0000001613 nova-compute[98321]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:15:23.237537 np0000001613 nova-compute[98321]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1 (non-flash)
May 28 10:15:23.237537 np0000001613 nova-compute[98321]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1 (non-flash)
May 28 10:15:23.237537 np0000001613 nova-compute[98321]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20561d76-f7d4-4638-b2d7-4a110a4ff30c (non-flash)
May 28 10:15:23.237537 np0000001613 nova-compute[98321]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1 (non-flash)
May 28 10:15:23.237537 np0000001613 nova-compute[98321]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1 (non-flash)
May 28 10:15:23.237537 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:15:23.238012 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.149s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:15:23.238254 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:15:23.240025 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] HCTL ('18', '-', '-', 0) found on session 210 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:15:23.240223 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:15:23.257699 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Searching for a device in session 210 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:15:23.258037 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '75a408de-7ad1-441e-8c61-7ab24afacba1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:15:23.258688 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:23.258688 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:23.258688 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:23.258688 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:23.258688 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:23.258688 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:23.258688 np0000001613 nova-compute[98321]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:15:23.258688 np0000001613 nova-compute[98321]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:15:23.258688 np0000001613 nova-compute[98321]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1 (non-flash)
May 28 10:15:23.258688 np0000001613 nova-compute[98321]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1 (non-flash)
May 28 10:15:23.258688 np0000001613 nova-compute[98321]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20561d76-f7d4-4638-b2d7-4a110a4ff30c (non-flash)
May 28 10:15:23.258688 np0000001613 nova-compute[98321]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1 (non-flash)
May 28 10:15:23.258688 np0000001613 nova-compute[98321]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1 (non-flash)
May 28 10:15:23.258688 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:15:23.258947 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsi session list stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:23.258947 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:23.258947 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:23.258947 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:23.258947 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:23.258947 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:23.258947 np0000001613 nova-compute[98321]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:15:23.258947 np0000001613 nova-compute[98321]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:15:23.258947 np0000001613 nova-compute[98321]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1 (non-flash)
May 28 10:15:23.258947 np0000001613 nova-compute[98321]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1 (non-flash)
May 28 10:15:23.258947 np0000001613 nova-compute[98321]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20561d76-f7d4-4638-b2d7-4a110a4ff30c (non-flash)
May 28 10:15:23.258947 np0000001613 nova-compute[98321]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1 (non-flash)
May 28 10:15:23.258947 np0000001613 nova-compute[98321]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1 (non-flash)
May 28 10:15:23.258947 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:15:23.259280 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:15:23.259360 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:15:23.260400 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] HCTL ('19', '-', '-', 0) found on session 211 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:15:23.260451 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:15:23.274508 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Searching for a device in session 211 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:15:23.274508 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '75a408de-7ad1-441e-8c61-7ab24afacba1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:15:24.089451 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:15:24.938051 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:25.086070 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:25.105122 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Found WWN 3300000004c9f4ed7 for multipath device dm-15 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:15:25.105408 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:15:25.106323 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] <== connect_volume: return (3392ms) {'type': 'block', 'scsi_wwn': '3300000004c9f4ed7', 'path': '/dev/disk/by-id/os-brick+dev+dm-15', 'multipath_id': '3300000004c9f4ed7'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:15:25.106477 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004c9f4ed7', 'path': '/dev/disk/by-id/os-brick+dev+dm-15', 'multipath_id': '3300000004c9f4ed7'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:15:25.108750 np0000001613 nova-compute[98321]: WARNING stevedore.named [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 10:15:25.108941 np0000001613 nova-compute[98321]: WARNING castellan.key_manager [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 10:15:25.109083 np0000001613 nova-compute[98321]: WARNING nova.keymgr.conf_key_mgr [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 10:15:25.123818 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 10:15:25.123818 np0000001613 nova-compute[98321]:   <usage type="volume">
May 28 10:15:25.123818 np0000001613 nova-compute[98321]:     <volume>75a408de-7ad1-441e-8c61-7ab24afacba1</volume>
May 28 10:15:25.123818 np0000001613 nova-compute[98321]:   </usage>
May 28 10:15:25.123818 np0000001613 nova-compute[98321]: </secret>
May 28 10:15:25.123818 np0000001613 nova-compute[98321]:  {{(pid=98321) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 10:15:25.129576 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lazy-loading 'flavor' on Instance uuid 2543ae6b-cda1-4986-bc88-2982f1610eec {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:15:25.633840 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Attempting to attach volume 75a408de-7ad1-441e-8c61-7ab24afacba1 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 10:15:25.635185 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] attach device xml: <disk type="block" device="disk">
May 28 10:15:25.635185 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:15:25.635185 np0000001613 nova-compute[98321]:   <alias name="ua-75a408de-7ad1-441e-8c61-7ab24afacba1"/>
May 28 10:15:25.635185 np0000001613 nova-compute[98321]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-15"/>
May 28 10:15:25.635185 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:15:25.635185 np0000001613 nova-compute[98321]:   <serial>75a408de-7ad1-441e-8c61-7ab24afacba1</serial>
May 28 10:15:25.635185 np0000001613 nova-compute[98321]:   <encryption format="luks">
May 28 10:15:25.635185 np0000001613 nova-compute[98321]:     <secret type="passphrase" uuid="9ccaab79-b8d6-4b47-8274-7b91a699f1cc"/>
May 28 10:15:25.635185 np0000001613 nova-compute[98321]:   </encryption>
May 28 10:15:25.635185 np0000001613 nova-compute[98321]: </disk>
May 28 10:15:25.635185 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 10:15:28.302106 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:15:28.302567 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:15:28.302567 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:15:28.302567 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] No VIF found with MAC fa:16:3e:72:cb:b7, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:15:29.863974 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-128ec55c-aabd-4585-bd47-e991aef401af tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "2543ae6b-cda1-4986-bc88-2982f1610eec" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.867s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:15:29.939724 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:30.087907 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:30.787509 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquiring lock "2543ae6b-cda1-4986-bc88-2982f1610eec" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:15:30.787727 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "2543ae6b-cda1-4986-bc88-2982f1610eec" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:15:31.290229 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Detaching volume 75a408de-7ad1-441e-8c61-7ab24afacba1
May 28 10:15:31.329606 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Attempting to driver detach volume 75a408de-7ad1-441e-8c61-7ab24afacba1 from mountpoint /dev/vdb
May 28 10:15:31.363576 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1', 'iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '75a408de-7ad1-441e-8c61-7ab24afacba1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-15'}, 'status': 'reserved', 'instance': '2543ae6b-cda1-4986-bc88-2982f1610eec', 'attached_at': '', 'detached_at': '', 'volume_id': '75a408de-7ad1-441e-8c61-7ab24afacba1', 'serial': '75a408de-7ad1-441e-8c61-7ab24afacba1'} {{(pid=98321) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 10:15:31.367239 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Found disk vdb by alias ua-75a408de-7ad1-441e-8c61-7ab24afacba1 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:15:31.368510 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Found disk vdb by alias ua-75a408de-7ad1-441e-8c61-7ab24afacba1 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:15:31.368660 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Attempting to detach device vdb from instance 2543ae6b-cda1-4986-bc88-2982f1610eec from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 10:15:31.369054 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:15:31.369054 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:15:31.369054 np0000001613 nova-compute[98321]:   <alias name="ua-75a408de-7ad1-441e-8c61-7ab24afacba1"/>
May 28 10:15:31.369054 np0000001613 nova-compute[98321]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-15"/>
May 28 10:15:31.369054 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:15:31.369054 np0000001613 nova-compute[98321]:   <serial>75a408de-7ad1-441e-8c61-7ab24afacba1</serial>
May 28 10:15:31.369054 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:15:31.369054 np0000001613 nova-compute[98321]:   <encryption format="luks">
May 28 10:15:31.369054 np0000001613 nova-compute[98321]:     <secret type="passphrase" uuid="9ccaab79-b8d6-4b47-8274-7b91a699f1cc"/>
May 28 10:15:31.369054 np0000001613 nova-compute[98321]:   </encryption>
May 28 10:15:31.369054 np0000001613 nova-compute[98321]: </disk>
May 28 10:15:31.369054 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:15:31.373874 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Successfully detached device vdb from instance 2543ae6b-cda1-4986-bc88-2982f1610eec from the persistent domain config.
May 28 10:15:31.374108 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] (1/8): Attempting to detach device vdb with device alias ua-75a408de-7ad1-441e-8c61-7ab24afacba1 from instance 2543ae6b-cda1-4986-bc88-2982f1610eec from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 10:15:31.374411 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:15:31.374411 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:15:31.374411 np0000001613 nova-compute[98321]:   <alias name="ua-75a408de-7ad1-441e-8c61-7ab24afacba1"/>
May 28 10:15:31.374411 np0000001613 nova-compute[98321]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-15"/>
May 28 10:15:31.374411 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:15:31.374411 np0000001613 nova-compute[98321]:   <serial>75a408de-7ad1-441e-8c61-7ab24afacba1</serial>
May 28 10:15:31.374411 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:15:31.374411 np0000001613 nova-compute[98321]:   <encryption format="luks">
May 28 10:15:31.374411 np0000001613 nova-compute[98321]:     <secret type="passphrase" uuid="9ccaab79-b8d6-4b47-8274-7b91a699f1cc"/>
May 28 10:15:31.374411 np0000001613 nova-compute[98321]:   </encryption>
May 28 10:15:31.374411 np0000001613 nova-compute[98321]: </disk>
May 28 10:15:31.374411 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:15:31.871116 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779963331.8701975, 2543ae6b-cda1-4986-bc88-2982f1610eec => ua-75a408de-7ad1-441e-8c61-7ab24afacba1> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 10:15:31.871584 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-75a408de-7ad1-441e-8c61-7ab24afacba1 for instance 2543ae6b-cda1-4986-bc88-2982f1610eec {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 10:15:31.874972 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Successfully detached device vdb from instance 2543ae6b-cda1-4986-bc88-2982f1610eec from the live domain config.
May 28 10:15:31.877501 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:15:31.877791 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1', 'iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '75a408de-7ad1-441e-8c61-7ab24afacba1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-15'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:15:31.878045 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:15:31.878439 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:15:31.878757 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1', 'iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '75a408de-7ad1-441e-8c61-7ab24afacba1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-15'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:15:31.878924 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:15:31.909826 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:31.909826 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:31.909826 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:31.909826 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:31.909826 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:31.909826 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:31.909826 np0000001613 nova-compute[98321]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:15:31.909826 np0000001613 nova-compute[98321]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:15:31.909826 np0000001613 nova-compute[98321]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1 (non-flash)
May 28 10:15:31.909826 np0000001613 nova-compute[98321]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1 (non-flash)
May 28 10:15:31.909826 np0000001613 nova-compute[98321]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20561d76-f7d4-4638-b2d7-4a110a4ff30c (non-flash)
May 28 10:15:31.909826 np0000001613 nova-compute[98321]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1 (non-flash)
May 28 10:15:31.909826 np0000001613 nova-compute[98321]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1 (non-flash)
May 28 10:15:31.909826 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:15:31.910481 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsi session list stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:31.910481 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:31.910481 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:31.910481 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:31.910481 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:31.910481 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:31.910481 np0000001613 nova-compute[98321]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:15:31.910481 np0000001613 nova-compute[98321]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:15:31.910481 np0000001613 nova-compute[98321]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1 (non-flash)
May 28 10:15:31.910481 np0000001613 nova-compute[98321]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1 (non-flash)
May 28 10:15:31.910481 np0000001613 nova-compute[98321]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20561d76-f7d4-4638-b2d7-4a110a4ff30c (non-flash)
May 28 10:15:31.910481 np0000001613 nova-compute[98321]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1 (non-flash)
May 28 10:15:31.910481 np0000001613 nova-compute[98321]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1 (non-flash)
May 28 10:15:31.910481 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:15:31.910481 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', '176'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', '177'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c', '189'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c', '190'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', '193'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', '194'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311', '204'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311', '205'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1', '207'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1', '208'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-20561d76-f7d4-4638-b2d7-4a110a4ff30c', '209'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1', '210'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1', '211')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:15:31.910481 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1', '210')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:15:31.911650 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1', '211')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:15:31.912710 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc343ec0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1'): ({'sdm'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1'): ({'sdn'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:15:31.913000 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Removing multipathed devices sdn, sdm {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:15:31.913375 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Flush multipath device 3300000004c9f4ed7 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:15:31.949412 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:15:32.007638 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:15:32.043569 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Checking to see if SCSI volumes sdn, sdm have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:15:32.043757 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] SCSI volumes sdn, sdm have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:15:32.045309 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Checking to see if device paths {'sdn', 'sdm'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:15:32.058541 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Device paths {'sdn', 'sdm'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:15:32.058708 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:15:32.071887 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:32.110448 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 210, target: iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1, portal: 192.168.40.100,3260]
May 28 10:15:32.110448 np0000001613 nova-compute[98321]: Logout of [sid: 210, target: iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1, portal: 192.168.40.100,3260] successful.
May 28 10:15:32.110448 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:32.132844 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:32.144447 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:32.181997 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 211, target: iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1, portal: 192.168.50.100,3260]
May 28 10:15:32.181997 np0000001613 nova-compute[98321]: Logout of [sid: 211, target: iqn.2023-03.storpool.com:os--volume-75a408de-7ad1-441e-8c61-7ab24afacba1, portal: 192.168.50.100,3260] successful.
May 28 10:15:32.181997 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:32.202092 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:32.204039 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:15:32.204039 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] <== disconnect_volume: return (326ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:15:32.204039 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:15:32.763359 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lazy-loading 'flavor' on Instance uuid 2543ae6b-cda1-4986-bc88-2982f1610eec {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:15:33.769264 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-88d827f1-c4f8-476f-b0b1-37f9ba541692 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "2543ae6b-cda1-4986-bc88-2982f1610eec" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.981s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:15:34.091766 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b763547a-0b10-4c22-b372-7d7b310e6450 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquiring lock "2543ae6b-cda1-4986-bc88-2982f1610eec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:15:34.091895 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b763547a-0b10-4c22-b372-7d7b310e6450 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "2543ae6b-cda1-4986-bc88-2982f1610eec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:15:34.092327 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b763547a-0b10-4c22-b372-7d7b310e6450 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquiring lock "2543ae6b-cda1-4986-bc88-2982f1610eec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:15:34.092327 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b763547a-0b10-4c22-b372-7d7b310e6450 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "2543ae6b-cda1-4986-bc88-2982f1610eec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:15:34.092327 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b763547a-0b10-4c22-b372-7d7b310e6450 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "2543ae6b-cda1-4986-bc88-2982f1610eec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:15:34.093948 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-b763547a-0b10-4c22-b372-7d7b310e6450 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Terminating instance
May 28 10:15:34.597098 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-b763547a-0b10-4c22-b372-7d7b310e6450 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:15:34.615347 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:34.634562 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:34.655288 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:34.751863 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-22bc121e-6031-49e0-9196-6a239862a445 req-20f07e97-5808-4144-a582-a39a4867c62b service nova] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Received event network-vif-unplugged-4c7bfebd-7e6f-4b71-a583-88587f20f87c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:15:34.752053 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-22bc121e-6031-49e0-9196-6a239862a445 req-20f07e97-5808-4144-a582-a39a4867c62b service nova] Acquiring lock "2543ae6b-cda1-4986-bc88-2982f1610eec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:15:34.752213 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-22bc121e-6031-49e0-9196-6a239862a445 req-20f07e97-5808-4144-a582-a39a4867c62b service nova] Lock "2543ae6b-cda1-4986-bc88-2982f1610eec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:15:34.752359 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-22bc121e-6031-49e0-9196-6a239862a445 req-20f07e97-5808-4144-a582-a39a4867c62b service nova] Lock "2543ae6b-cda1-4986-bc88-2982f1610eec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:15:34.752490 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-22bc121e-6031-49e0-9196-6a239862a445 req-20f07e97-5808-4144-a582-a39a4867c62b service nova] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] No waiting events found dispatching network-vif-unplugged-4c7bfebd-7e6f-4b71-a583-88587f20f87c {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:15:34.752607 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-22bc121e-6031-49e0-9196-6a239862a445 req-20f07e97-5808-4144-a582-a39a4867c62b service nova] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Received event network-vif-unplugged-4c7bfebd-7e6f-4b71-a583-88587f20f87c for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:15:34.912617 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999593504000131 future=<Future at 0x73c1f473e390 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:15:34.913079 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999332658000185 future=<Future at 0x73c1f473e390 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:15:34.913079 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999210321000191 future=<Future at 0x73c1f473e390 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:15:34.914799 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Instance destroyed successfully.
May 28 10:15:34.915365 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-b763547a-0b10-4c22-b372-7d7b310e6450 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lazy-loading 'resources' on Instance uuid 2543ae6b-cda1-4986-bc88-2982f1610eec {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:15:34.950549 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:35.089996 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:35.417655 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-b763547a-0b10-4c22-b372-7d7b310e6450 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:14:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-973170547',display_name='tempest-TestEncryptedCinderVolumes-server-973170547',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testencryptedcindervolumes-server-973170547',id=74,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAspM3MUEQp/CLwGSyf9HiiiHVasYSSjr1W1iTCGBS6Sc+blFuh06DungdVsKorsYe9FudoaMzjR9hwr6pUShsTdju0H/Fz5dl5hvmLsZGKv1F+IN1eCVR1ZMV69xzZJtg==',key_name='tempest-keypair-1780126761',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:14:40Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a515533ba1c4e23a52f472549e5211f',ramdisk_id='',reservation_id='r-ktcitt0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-678033643',owner_user_name='tempest-TestEncryptedCinderVolumes-678033643-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:14:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cabed30cb95f4f7b9f96187fc336f7c4',uuid=2543ae6b-cda1-4986-bc88-2982f1610eec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c7bfebd-7e6f-4b71-a583-88587f20f87c", "address": "fa:16:3e:72:cb:b7", "network": {"id": "07ee30b7-dd9c-433d-81cc-42ab11aded18", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1881482359-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a515533ba1c4e23a52f472549e5211f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c7bfebd-7e", "ovs_interfaceid": "4c7bfebd-7e6f-4b71-a583-88587f20f87c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:15:35.417893 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-b763547a-0b10-4c22-b372-7d7b310e6450 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Converting VIF {"id": "4c7bfebd-7e6f-4b71-a583-88587f20f87c", "address": "fa:16:3e:72:cb:b7", "network": {"id": "07ee30b7-dd9c-433d-81cc-42ab11aded18", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1881482359-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a515533ba1c4e23a52f472549e5211f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c7bfebd-7e", "ovs_interfaceid": "4c7bfebd-7e6f-4b71-a583-88587f20f87c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:15:35.418402 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-b763547a-0b10-4c22-b372-7d7b310e6450 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:cb:b7,bridge_name='br-int',has_traffic_filtering=True,id=4c7bfebd-7e6f-4b71-a583-88587f20f87c,network=Network(07ee30b7-dd9c-433d-81cc-42ab11aded18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c7bfebd-7e') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:15:35.418681 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-b763547a-0b10-4c22-b372-7d7b310e6450 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:cb:b7,bridge_name='br-int',has_traffic_filtering=True,id=4c7bfebd-7e6f-4b71-a583-88587f20f87c,network=Network(07ee30b7-dd9c-433d-81cc-42ab11aded18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c7bfebd-7e') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:15:35.419986 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:35.420278 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c7bfebd-7e, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:15:35.421337 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:35.423121 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:15:35.423755 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:35.423930 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aff1ada1-9a9f-4f2e-ba4b-0137aea2a8de) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:15:35.424464 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:35.424962 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:15:35.425249 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:35.427438 np0000001613 nova-compute[98321]: INFO os_vif [None req-b763547a-0b10-4c22-b372-7d7b310e6450 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:cb:b7,bridge_name='br-int',has_traffic_filtering=True,id=4c7bfebd-7e6f-4b71-a583-88587f20f87c,network=Network(07ee30b7-dd9c-433d-81cc-42ab11aded18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c7bfebd-7e')
May 28 10:15:35.427837 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-b763547a-0b10-4c22-b372-7d7b310e6450 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Deleting instance files /opt/stack/data/nova/instances/2543ae6b-cda1-4986-bc88-2982f1610eec_del
May 28 10:15:35.428598 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-b763547a-0b10-4c22-b372-7d7b310e6450 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Deletion of /opt/stack/data/nova/instances/2543ae6b-cda1-4986-bc88-2982f1610eec_del complete
May 28 10:15:35.934776 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-b763547a-0b10-4c22-b372-7d7b310e6450 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Took 1.34 seconds to destroy the instance on the hypervisor.
May 28 10:15:35.935314 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-b763547a-0b10-4c22-b372-7d7b310e6450 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:15:35.935445 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:15:35.935535 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:15:35.936073 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:15:36.024643 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:15:36.805760 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a2039fa6-b8cc-4ad9-b059-ea26d2cd15f1 req-2bb9a1bb-9269-4de2-9519-ec7520019dac service nova] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Received event network-vif-unplugged-4c7bfebd-7e6f-4b71-a583-88587f20f87c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:15:36.806359 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a2039fa6-b8cc-4ad9-b059-ea26d2cd15f1 req-2bb9a1bb-9269-4de2-9519-ec7520019dac service nova] Acquiring lock "2543ae6b-cda1-4986-bc88-2982f1610eec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:15:36.806789 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a2039fa6-b8cc-4ad9-b059-ea26d2cd15f1 req-2bb9a1bb-9269-4de2-9519-ec7520019dac service nova] Lock "2543ae6b-cda1-4986-bc88-2982f1610eec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:15:36.807008 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a2039fa6-b8cc-4ad9-b059-ea26d2cd15f1 req-2bb9a1bb-9269-4de2-9519-ec7520019dac service nova] Lock "2543ae6b-cda1-4986-bc88-2982f1610eec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:15:36.807198 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a2039fa6-b8cc-4ad9-b059-ea26d2cd15f1 req-2bb9a1bb-9269-4de2-9519-ec7520019dac service nova] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] No waiting events found dispatching network-vif-unplugged-4c7bfebd-7e6f-4b71-a583-88587f20f87c {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:15:36.807341 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a2039fa6-b8cc-4ad9-b059-ea26d2cd15f1 req-2bb9a1bb-9269-4de2-9519-ec7520019dac service nova] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Received event network-vif-unplugged-4c7bfebd-7e6f-4b71-a583-88587f20f87c for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:15:36.807435 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a2039fa6-b8cc-4ad9-b059-ea26d2cd15f1 req-2bb9a1bb-9269-4de2-9519-ec7520019dac service nova] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Received event network-vif-deleted-4c7bfebd-7e6f-4b71-a583-88587f20f87c {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:15:36.807540 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-a2039fa6-b8cc-4ad9-b059-ea26d2cd15f1 req-2bb9a1bb-9269-4de2-9519-ec7520019dac service nova] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Neutron deleted interface 4c7bfebd-7e6f-4b71-a583-88587f20f87c; detaching it from the instance and deleting it from the info cache
May 28 10:15:36.809788 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a2039fa6-b8cc-4ad9-b059-ea26d2cd15f1 req-2bb9a1bb-9269-4de2-9519-ec7520019dac service nova] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Detach interface failed, port_id=4c7bfebd-7e6f-4b71-a583-88587f20f87c, reason: Instance 2543ae6b-cda1-4986-bc88-2982f1610eec could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:15:36.850109 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:15:37.353448 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Took 1.42 seconds to deallocate network for instance.
May 28 10:15:37.860237 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b763547a-0b10-4c22-b372-7d7b310e6450 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:15:37.860237 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b763547a-0b10-4c22-b372-7d7b310e6450 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:15:38.003795 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-b763547a-0b10-4c22-b372-7d7b310e6450 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Refreshing inventories for resource provider ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 28 10:15:38.049547 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-b763547a-0b10-4c22-b372-7d7b310e6450 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Updating ProviderTree inventory for provider ad4de091-3626-4008-ac9a-3e83de44a510 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 28 10:15:38.049762 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-b763547a-0b10-4c22-b372-7d7b310e6450 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Updating inventory in ProviderTree for provider ad4de091-3626-4008-ac9a-3e83de44a510 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 28 10:15:38.097636 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-b763547a-0b10-4c22-b372-7d7b310e6450 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Refreshing aggregate associations for resource provider ad4de091-3626-4008-ac9a-3e83de44a510, aggregates: None {{(pid=98321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 28 10:15:38.153851 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-b763547a-0b10-4c22-b372-7d7b310e6450 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Refreshing trait associations for resource provider ad4de091-3626-4008-ac9a-3e83de44a510, traits: COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ARCH_PPC64LE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ARCH_RISCV64,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_ARCH_S390X,COMPUTE_VOLUME_EXTEND,COMPUTE_ARCH_AARCH64,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOUND_MODEL_SB16,COMPUTE_ACCELERATORS,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_SOUND_MODEL_AC97,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_ARCH_MIPSEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_LAN9118,HW_ARCH_X86_64,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ARCH_X86_64,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOUND_MODEL_USB,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=98321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 28 10:15:38.427799 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b763547a-0b10-4c22-b372-7d7b310e6450 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:15:38.428139 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-b763547a-0b10-4c22-b372-7d7b310e6450 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:15:38.930739 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-b763547a-0b10-4c22-b372-7d7b310e6450 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:15:39.437524 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b763547a-0b10-4c22-b372-7d7b310e6450 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.578s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:15:39.483561 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-b763547a-0b10-4c22-b372-7d7b310e6450 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Deleted allocations for instance 2543ae6b-cda1-4986-bc88-2982f1610eec
May 28 10:15:40.092013 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:40.310295 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Acquiring lock "7de5b639-f7aa-46af-8f5e-a34503673ba0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:15:40.310422 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "7de5b639-f7aa-46af-8f5e-a34503673ba0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:15:40.310601 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Acquiring lock "7de5b639-f7aa-46af-8f5e-a34503673ba0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:15:40.310742 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "7de5b639-f7aa-46af-8f5e-a34503673ba0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:15:40.310897 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "7de5b639-f7aa-46af-8f5e-a34503673ba0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:15:40.313580 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Terminating instance
May 28 10:15:40.425903 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:40.494737 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b763547a-0b10-4c22-b372-7d7b310e6450 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "2543ae6b-cda1-4986-bc88-2982f1610eec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.403s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:15:40.817532 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:15:40.839485 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:40.842449 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:40.861349 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:40.992399 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3e261488-691f-4931-a37b-b94901d8366f req-56cf5d29-f908-41c1-8a7e-9978a651f9bb service nova] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Received event network-vif-unplugged-9ca42655-a086-4ab1-9be6-d413a2c17cb2 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:15:40.992785 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3e261488-691f-4931-a37b-b94901d8366f req-56cf5d29-f908-41c1-8a7e-9978a651f9bb service nova] Acquiring lock "7de5b639-f7aa-46af-8f5e-a34503673ba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:15:40.992785 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3e261488-691f-4931-a37b-b94901d8366f req-56cf5d29-f908-41c1-8a7e-9978a651f9bb service nova] Lock "7de5b639-f7aa-46af-8f5e-a34503673ba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:15:40.992785 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3e261488-691f-4931-a37b-b94901d8366f req-56cf5d29-f908-41c1-8a7e-9978a651f9bb service nova] Lock "7de5b639-f7aa-46af-8f5e-a34503673ba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:15:40.992872 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3e261488-691f-4931-a37b-b94901d8366f req-56cf5d29-f908-41c1-8a7e-9978a651f9bb service nova] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] No waiting events found dispatching network-vif-unplugged-9ca42655-a086-4ab1-9be6-d413a2c17cb2 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:15:40.992972 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3e261488-691f-4931-a37b-b94901d8366f req-56cf5d29-f908-41c1-8a7e-9978a651f9bb service nova] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Received event network-vif-unplugged-9ca42655-a086-4ab1-9be6-d413a2c17cb2 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:15:41.050251 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:41.056524 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:41.144435 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999742220999906 future=<Future at 0x73c1f423a3f0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:15:41.146923 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Instance destroyed successfully.
May 28 10:15:41.147549 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lazy-loading 'resources' on Instance uuid 7de5b639-f7aa-46af-8f5e-a34503673ba0 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:15:41.650628 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:14:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1722593881',display_name='tempest-TestVolumeBootPatternV346-server-1722593881',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpatternv346-server-1722593881',id=75,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbEV5EpMk8TD/JMl9q94xI07WMKeq+7uwufxX5ppffET/qe5CaI2B5EPSWlpYD54YJuCZA/PCJIL/KwgoEN9C7arA++M77IsZqrD6GlTm+AfxZfjZIjcn94RmhD5yFbKA==',key_name='tempest-keypair-439171385',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:15:01Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d80b528594ac4ee5b3b56bf7c94c7ffa',ramdisk_id='',reservation_id='r-hd4t3ijz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-204163382',owner_user_name='tempest-TestVolumeBootPatternV346-204163382-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:15:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ffa50296592417a99dd0566355e09f9',uuid=7de5b639-f7aa-46af-8f5e-a34503673ba0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ca42655-a086-4ab1-9be6-d413a2c17cb2", "address": "fa:16:3e:af:0f:dd", "network": {"id": "83f5548a-aebf-46e0-a4d2-07f06d3967d4", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1141449765-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d80b528594ac4ee5b3b56bf7c94c7ffa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca42655-a0", "ovs_interfaceid": "9ca42655-a086-4ab1-9be6-d413a2c17cb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:15:41.651293 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Converting VIF {"id": "9ca42655-a086-4ab1-9be6-d413a2c17cb2", "address": "fa:16:3e:af:0f:dd", "network": {"id": "83f5548a-aebf-46e0-a4d2-07f06d3967d4", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1141449765-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d80b528594ac4ee5b3b56bf7c94c7ffa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca42655-a0", "ovs_interfaceid": "9ca42655-a086-4ab1-9be6-d413a2c17cb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:15:41.651521 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:0f:dd,bridge_name='br-int',has_traffic_filtering=True,id=9ca42655-a086-4ab1-9be6-d413a2c17cb2,network=Network(83f5548a-aebf-46e0-a4d2-07f06d3967d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ca42655-a0') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:15:41.651833 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:0f:dd,bridge_name='br-int',has_traffic_filtering=True,id=9ca42655-a086-4ab1-9be6-d413a2c17cb2,network=Network(83f5548a-aebf-46e0-a4d2-07f06d3967d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ca42655-a0') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:15:41.654611 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:41.654611 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ca42655-a0, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:15:41.666697 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:41.668181 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:15:41.669048 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:41.669048 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c2156572-0aab-41af-8406-e98ac367770f) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:15:41.669441 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:41.670035 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:15:41.672132 np0000001613 nova-compute[98321]: INFO os_vif [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:0f:dd,bridge_name='br-int',has_traffic_filtering=True,id=9ca42655-a086-4ab1-9be6-d413a2c17cb2,network=Network(83f5548a-aebf-46e0-a4d2-07f06d3967d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ca42655-a0')
May 28 10:15:41.674103 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:15:41.674479 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311', 'iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '052c293f-59e1-402b-9305-6ebf50a25311', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:15:41.674592 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:15:41.674933 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:15:41.675317 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311', 'iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '052c293f-59e1-402b-9305-6ebf50a25311', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:15:41.675446 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:15:41.707070 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:41.707070 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:41.707070 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:41.707070 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:41.707070 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:41.707070 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:41.707070 np0000001613 nova-compute[98321]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:15:41.707070 np0000001613 nova-compute[98321]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:15:41.707070 np0000001613 nova-compute[98321]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1 (non-flash)
May 28 10:15:41.707070 np0000001613 nova-compute[98321]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1 (non-flash)
May 28 10:15:41.707070 np0000001613 nova-compute[98321]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20561d76-f7d4-4638-b2d7-4a110a4ff30c (non-flash)
May 28 10:15:41.707070 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:15:41.707459 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsi session list stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:41.707459 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:41.707459 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:41.707459 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:41.707459 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:41.707459 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:41.707459 np0000001613 nova-compute[98321]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:15:41.707459 np0000001613 nova-compute[98321]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311 (non-flash)
May 28 10:15:41.707459 np0000001613 nova-compute[98321]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1 (non-flash)
May 28 10:15:41.707459 np0000001613 nova-compute[98321]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1 (non-flash)
May 28 10:15:41.707459 np0000001613 nova-compute[98321]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20561d76-f7d4-4638-b2d7-4a110a4ff30c (non-flash)
May 28 10:15:41.707459 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:15:41.707459 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', '176'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', '177'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c', '189'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c', '190'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', '193'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', '194'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311', '204'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311', '205'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1', '207'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1', '208'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-20561d76-f7d4-4638-b2d7-4a110a4ff30c', '212')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:15:41.707459 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311', '204')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:15:41.708397 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311', '205')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:15:41.709230 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc22cc20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311'): ({'sdj'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:15:41.709404 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Removing multipathed devices sdg, sdj {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:15:41.709586 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Flush multipath device 330000000c2ce75e0 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:15:41.787384 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:15:41.837290 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:15:41.893705 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Checking to see if SCSI volumes sdg, sdj have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:15:41.893915 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] SCSI volumes sdg, sdj have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:15:41.895377 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Checking to see if device paths {'sdg', 'sdj'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:15:41.908857 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Device paths {'sdg', 'sdj'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:15:41.909055 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:15:41.924145 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:41.971286 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 204, target: iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311, portal: 192.168.40.100,3260]
May 28 10:15:41.971286 np0000001613 nova-compute[98321]: Logout of [sid: 204, target: iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311, portal: 192.168.40.100,3260] successful.
May 28 10:15:41.971286 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:41.991862 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:42.007341 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:42.051813 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 205, target: iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311, portal: 192.168.50.100,3260]
May 28 10:15:42.051813 np0000001613 nova-compute[98321]: Logout of [sid: 205, target: iqn.2023-03.storpool.com:os--volume-052c293f-59e1-402b-9305-6ebf50a25311, portal: 192.168.50.100,3260] successful.
May 28 10:15:42.051813 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:42.077703 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:42.077933 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:15:42.078081 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] <== disconnect_volume: return (403ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:15:42.078143 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:15:42.078414 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Deleting instance files /opt/stack/data/nova/instances/7de5b639-f7aa-46af-8f5e-a34503673ba0_del
May 28 10:15:42.078906 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Deletion of /opt/stack/data/nova/instances/7de5b639-f7aa-46af-8f5e-a34503673ba0_del complete
May 28 10:15:42.588866 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Took 1.77 seconds to destroy the instance on the hypervisor.
May 28 10:15:42.589299 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:15:42.590530 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:15:42.590530 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:15:42.590846 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:15:42.700173 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:15:42.711902 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._sync_power_states {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:15:43.052897 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c13b1818-4bde-4152-9c33-1ce4843e6cf7 req-fac00cc6-baa7-402e-a157-fa25ad0fc452 service nova] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Received event network-vif-unplugged-9ca42655-a086-4ab1-9be6-d413a2c17cb2 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:15:43.053098 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c13b1818-4bde-4152-9c33-1ce4843e6cf7 req-fac00cc6-baa7-402e-a157-fa25ad0fc452 service nova] Acquiring lock "7de5b639-f7aa-46af-8f5e-a34503673ba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:15:43.053295 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c13b1818-4bde-4152-9c33-1ce4843e6cf7 req-fac00cc6-baa7-402e-a157-fa25ad0fc452 service nova] Lock "7de5b639-f7aa-46af-8f5e-a34503673ba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:15:43.053685 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c13b1818-4bde-4152-9c33-1ce4843e6cf7 req-fac00cc6-baa7-402e-a157-fa25ad0fc452 service nova] Lock "7de5b639-f7aa-46af-8f5e-a34503673ba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:15:43.053685 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c13b1818-4bde-4152-9c33-1ce4843e6cf7 req-fac00cc6-baa7-402e-a157-fa25ad0fc452 service nova] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] No waiting events found dispatching network-vif-unplugged-9ca42655-a086-4ab1-9be6-d413a2c17cb2 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:15:43.053685 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c13b1818-4bde-4152-9c33-1ce4843e6cf7 req-fac00cc6-baa7-402e-a157-fa25ad0fc452 service nova] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Received event network-vif-unplugged-9ca42655-a086-4ab1-9be6-d413a2c17cb2 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:15:43.149695 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-0b52f542-c3fe-4cf1-a825-a9079839fcdc req-4fabdb0d-284b-4342-b2c4-e27b59a6d78f service nova] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Received event network-vif-deleted-9ca42655-a086-4ab1-9be6-d413a2c17cb2 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:15:43.150127 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-0b52f542-c3fe-4cf1-a825-a9079839fcdc req-4fabdb0d-284b-4342-b2c4-e27b59a6d78f service nova] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Neutron deleted interface 9ca42655-a086-4ab1-9be6-d413a2c17cb2; detaching it from the instance and deleting it from the info cache
May 28 10:15:43.152030 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-0b52f542-c3fe-4cf1-a825-a9079839fcdc req-4fabdb0d-284b-4342-b2c4-e27b59a6d78f service nova] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Detach interface failed, port_id=9ca42655-a086-4ab1-9be6-d413a2c17cb2, reason: Instance 7de5b639-f7aa-46af-8f5e-a34503673ba0 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:15:43.219189 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] While synchronizing instance power states, found 5 instances in the database and 4 instances on the hypervisor.
May 28 10:15:43.219189 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Triggering sync for uuid 93a38b6d-e199-4653-a617-290247c8e430 {{(pid=98321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 10:15:43.219189 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Triggering sync for uuid bf181571-acd7-4482-90b1-50b7223411fc {{(pid=98321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 10:15:43.219189 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Triggering sync for uuid 0327fb6e-6b30-4f70-8877-a3859969f5ca {{(pid=98321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 10:15:43.219189 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Triggering sync for uuid 7de5b639-f7aa-46af-8f5e-a34503673ba0 {{(pid=98321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 10:15:43.219189 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Triggering sync for uuid 4ce32a9b-fc5a-4931-9880-dd7638009cc5 {{(pid=98321) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 10:15:43.220023 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "93a38b6d-e199-4653-a617-290247c8e430" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:15:43.221143 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "bf181571-acd7-4482-90b1-50b7223411fc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:15:43.221380 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "0327fb6e-6b30-4f70-8877-a3859969f5ca" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:15:43.221540 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "0327fb6e-6b30-4f70-8877-a3859969f5ca" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:15:43.221825 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "7de5b639-f7aa-46af-8f5e-a34503673ba0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:15:43.222036 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 20.08 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:15:43.222200 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "93a38b6d-e199-4653-a617-290247c8e430" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:15:43.222337 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "bf181571-acd7-4482-90b1-50b7223411fc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:15:43.222802 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "4ce32a9b-fc5a-4931-9880-dd7638009cc5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:15:43.222802 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "4ce32a9b-fc5a-4931-9880-dd7638009cc5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:15:43.601566 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:15:43.732676 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "0327fb6e-6b30-4f70-8877-a3859969f5ca" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.511s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:15:43.733687 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "4ce32a9b-fc5a-4931-9880-dd7638009cc5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.511s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:15:43.741442 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "bf181571-acd7-4482-90b1-50b7223411fc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.520s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:15:43.741998 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "93a38b6d-e199-4653-a617-290247c8e430" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.521s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:15:44.103363 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Took 1.51 seconds to deallocate network for instance.
May 28 10:15:44.654058 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Took 0.55 seconds to detach 1 volumes for instance.
May 28 10:15:45.103801 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:45.159464 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:15:45.159788 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:15:45.431181 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:15:45.431381 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:15:45.934495 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:15:46.440526 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.281s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:15:46.483828 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Deleted allocations for instance 7de5b639-f7aa-46af-8f5e-a34503673ba0
May 28 10:15:46.669129 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:47.492793 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-dbfd07e3-ae92-4ac7-92ad-65168655796c tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "7de5b639-f7aa-46af-8f5e-a34503673ba0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.182s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:15:47.493499 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "7de5b639-f7aa-46af-8f5e-a34503673ba0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.272s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:15:47.493650 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] During sync_power_state the instance has a pending task (deleting). Skip.
May 28 10:15:47.493786 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "7de5b639-f7aa-46af-8f5e-a34503673ba0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:15:49.912544 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0003440469999986817 future=<Future at 0x73c1f473e390 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:15:49.913017 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:15:49.913017 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=6.231436999999914 future=<Future at 0x73c1f423a3f0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:15:49.913017 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=6.231365737000033 future=<Future at 0x73c1f423a3f0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:15:49.913286 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Emitting event <LifecycleEvent: 1779963334.9120834, 2543ae6b-cda1-4986-bc88-2982f1610eec => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:15:49.913488 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] VM Stopped (Lifecycle Event)
May 28 10:15:50.105403 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:50.415666 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 2543ae6b-cda1-4986-bc88-2982f1610eec] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:15:51.366590 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Acquiring lock "bf181571-acd7-4482-90b1-50b7223411fc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:15:51.367036 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "bf181571-acd7-4482-90b1-50b7223411fc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:15:51.367036 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Acquiring lock "bf181571-acd7-4482-90b1-50b7223411fc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:15:51.367036 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "bf181571-acd7-4482-90b1-50b7223411fc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:15:51.367182 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "bf181571-acd7-4482-90b1-50b7223411fc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:15:51.369354 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Terminating instance
May 28 10:15:51.669863 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:51.872628 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:15:51.896882 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:51.899883 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:51.923290 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:52.102148 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:52.109660 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:52.146108 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-93eb399d-d89b-460a-9f69-54871cb872f1 req-5a24b550-58eb-4c24-8ddc-d5662e685ad3 service nova] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Received event network-vif-unplugged-4ba3c950-6075-4485-8352-d019b6137361 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:15:52.147944 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-93eb399d-d89b-460a-9f69-54871cb872f1 req-5a24b550-58eb-4c24-8ddc-d5662e685ad3 service nova] Acquiring lock "bf181571-acd7-4482-90b1-50b7223411fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:15:52.148281 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-93eb399d-d89b-460a-9f69-54871cb872f1 req-5a24b550-58eb-4c24-8ddc-d5662e685ad3 service nova] Lock "bf181571-acd7-4482-90b1-50b7223411fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:15:52.148473 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-93eb399d-d89b-460a-9f69-54871cb872f1 req-5a24b550-58eb-4c24-8ddc-d5662e685ad3 service nova] Lock "bf181571-acd7-4482-90b1-50b7223411fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:15:52.148830 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-93eb399d-d89b-460a-9f69-54871cb872f1 req-5a24b550-58eb-4c24-8ddc-d5662e685ad3 service nova] [instance: bf181571-acd7-4482-90b1-50b7223411fc] No waiting events found dispatching network-vif-unplugged-4ba3c950-6075-4485-8352-d019b6137361 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:15:52.148968 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-93eb399d-d89b-460a-9f69-54871cb872f1 req-5a24b550-58eb-4c24-8ddc-d5662e685ad3 service nova] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Received event network-vif-unplugged-4ba3c950-6075-4485-8352-d019b6137361 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:15:52.219076 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999680416000047 future=<Future at 0x73c1fc315cd0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:15:52.224625 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Instance destroyed successfully.
May 28 10:15:52.225292 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lazy-loading 'resources' on Instance uuid bf181571-acd7-4482-90b1-50b7223411fc {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:15:52.727791 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:13:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1166496640',display_name='tempest-TestVolumeBootPatternV346-server-1166496640',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpatternv346-server-1166496640',id=72,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDovb6GcHgfJLeWhkHeKDk4pr+NYI9gRs5uwNkn54JOZpQHE3U5GYfLmxjgF7LyGlOvcApcsHheS/8INQnLBu7/CCYA9CtGqCv0qIUbHvDdVeVbaSFNRFcHIsB/jI3EHHg==',key_name='tempest-keypair-1639758246',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:13:57Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d80b528594ac4ee5b3b56bf7c94c7ffa',ramdisk_id='',reservation_id='r-59apzmeq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-204163382',owner_user_name='tempest-TestVolumeBootPatternV346-204163382-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:13:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ffa50296592417a99dd0566355e09f9',uuid=bf181571-acd7-4482-90b1-50b7223411fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ba3c950-6075-4485-8352-d019b6137361", "address": "fa:16:3e:38:91:9c", "network": {"id": "83f5548a-aebf-46e0-a4d2-07f06d3967d4", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1141449765-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d80b528594ac4ee5b3b56bf7c94c7ffa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ba3c950-60", "ovs_interfaceid": "4ba3c950-6075-4485-8352-d019b6137361", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:15:52.728498 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Converting VIF {"id": "4ba3c950-6075-4485-8352-d019b6137361", "address": "fa:16:3e:38:91:9c", "network": {"id": "83f5548a-aebf-46e0-a4d2-07f06d3967d4", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1141449765-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d80b528594ac4ee5b3b56bf7c94c7ffa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ba3c950-60", "ovs_interfaceid": "4ba3c950-6075-4485-8352-d019b6137361", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:15:52.728498 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:91:9c,bridge_name='br-int',has_traffic_filtering=True,id=4ba3c950-6075-4485-8352-d019b6137361,network=Network(83f5548a-aebf-46e0-a4d2-07f06d3967d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ba3c950-60') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:15:52.728705 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:91:9c,bridge_name='br-int',has_traffic_filtering=True,id=4ba3c950-6075-4485-8352-d019b6137361,network=Network(83f5548a-aebf-46e0-a4d2-07f06d3967d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ba3c950-60') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:15:52.729480 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:52.729644 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ba3c950-60, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:15:52.730578 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:52.731281 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:15:52.733141 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:52.733858 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:52.734033 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=57e16dc3-4470-4969-8828-9d5dfda99486) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:15:52.734649 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:52.735260 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:15:52.736742 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:52.742000 np0000001613 nova-compute[98321]: INFO os_vif [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:91:9c,bridge_name='br-int',has_traffic_filtering=True,id=4ba3c950-6075-4485-8352-d019b6137361,network=Network(83f5548a-aebf-46e0-a4d2-07f06d3967d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ba3c950-60')
May 28 10:15:52.746650 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:15:52.746887 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c', 'iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3e7b8c65-f460-4db9-91ae-2b3e144f0b5c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:15:52.747037 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:15:52.747353 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:15:52.747631 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c', 'iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3e7b8c65-f460-4db9-91ae-2b3e144f0b5c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:15:52.747742 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:15:52.778348 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:52.778348 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:52.778348 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:52.778348 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:52.778348 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:52.778348 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:52.778348 np0000001613 nova-compute[98321]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1 (non-flash)
May 28 10:15:52.778348 np0000001613 nova-compute[98321]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1 (non-flash)
May 28 10:15:52.778348 np0000001613 nova-compute[98321]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb (non-flash)
May 28 10:15:52.778348 np0000001613 nova-compute[98321]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb (non-flash)
May 28 10:15:52.778348 np0000001613 nova-compute[98321]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20561d76-f7d4-4638-b2d7-4a110a4ff30c (non-flash)
May 28 10:15:52.778348 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:15:52.778731 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsi session list stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:52.778731 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:52.778731 np0000001613 nova-compute[98321]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:52.778731 np0000001613 nova-compute[98321]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c (non-flash)
May 28 10:15:52.778731 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:52.778731 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:52.778731 np0000001613 nova-compute[98321]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1 (non-flash)
May 28 10:15:52.778731 np0000001613 nova-compute[98321]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1 (non-flash)
May 28 10:15:52.778731 np0000001613 nova-compute[98321]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb (non-flash)
May 28 10:15:52.778731 np0000001613 nova-compute[98321]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb (non-flash)
May 28 10:15:52.778731 np0000001613 nova-compute[98321]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20561d76-f7d4-4638-b2d7-4a110a4ff30c (non-flash)
May 28 10:15:52.778731 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:15:52.778731 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', '176'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', '177'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c', '189'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c', '190'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', '193'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', '194'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1', '207'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1', '208'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb', '213'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb', '214'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-20561d76-f7d4-4638-b2d7-4a110a4ff30c', '215')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:15:52.779142 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c', '189')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:15:52.780184 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c', '190')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:15:52.782196 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc22d8a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c'): ({'sdc'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:15:52.782490 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Removing multipathed devices sdb, sdc {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:15:52.782731 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Flush multipath device 330000000ccc2d9bd {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:15:52.853501 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:15:52.917260 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:15:52.979229 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:15:52.979402 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:15:52.980752 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:15:52.993230 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:15:52.993488 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:15:53.006494 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:53.051082 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 189, target: iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c, portal: 192.168.40.100,3260]
May 28 10:15:53.051082 np0000001613 nova-compute[98321]: Logout of [sid: 189, target: iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c, portal: 192.168.40.100,3260] successful.
May 28 10:15:53.051082 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:53.072107 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:53.084790 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:53.134257 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 190, target: iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c, portal: 192.168.50.100,3260]
May 28 10:15:53.134257 np0000001613 nova-compute[98321]: Logout of [sid: 190, target: iqn.2023-03.storpool.com:os--volume-3e7b8c65-f460-4db9-91ae-2b3e144f0b5c, portal: 192.168.50.100,3260] successful.
May 28 10:15:53.134257 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:53.158796 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:53.159070 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.412s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:15:53.159248 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] <== disconnect_volume: return (412ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:15:53.159487 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:15:53.159743 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Deleting instance files /opt/stack/data/nova/instances/bf181571-acd7-4482-90b1-50b7223411fc_del
May 28 10:15:53.160335 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Deletion of /opt/stack/data/nova/instances/bf181571-acd7-4482-90b1-50b7223411fc_del complete
May 28 10:15:53.667718 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Took 1.79 seconds to destroy the instance on the hypervisor.
May 28 10:15:53.668384 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:15:53.668707 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:15:53.668844 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: bf181571-acd7-4482-90b1-50b7223411fc] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:15:53.669225 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:15:53.680732 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:53.775379 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:15:53.881303 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-79f10a76-90b3-497d-8c8d-f33c30186379 req-b03dc8f6-574a-4c15-92db-9daa23063fe7 service nova] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Received event network-changed-eba7bb57-5c95-42bd-beb9-6e9af82baa89 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:15:53.882618 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-79f10a76-90b3-497d-8c8d-f33c30186379 req-b03dc8f6-574a-4c15-92db-9daa23063fe7 service nova] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Refreshing instance network info cache due to event network-changed-eba7bb57-5c95-42bd-beb9-6e9af82baa89. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:15:53.883042 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-79f10a76-90b3-497d-8c8d-f33c30186379 req-b03dc8f6-574a-4c15-92db-9daa23063fe7 service nova] Acquiring lock "refresh_cache-4ce32a9b-fc5a-4931-9880-dd7638009cc5" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:15:53.883268 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-79f10a76-90b3-497d-8c8d-f33c30186379 req-b03dc8f6-574a-4c15-92db-9daa23063fe7 service nova] Acquired lock "refresh_cache-4ce32a9b-fc5a-4931-9880-dd7638009cc5" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:15:53.883677 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-79f10a76-90b3-497d-8c8d-f33c30186379 req-b03dc8f6-574a-4c15-92db-9daa23063fe7 service nova] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Refreshing network info cache for port eba7bb57-5c95-42bd-beb9-6e9af82baa89 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:15:54.219857 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a7f35519-1f0d-40a1-9525-6ac7ce1720cf req-f97b436a-5666-422e-87d0-6f9e7bec256a service nova] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Received event network-vif-unplugged-4ba3c950-6075-4485-8352-d019b6137361 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:15:54.220386 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a7f35519-1f0d-40a1-9525-6ac7ce1720cf req-f97b436a-5666-422e-87d0-6f9e7bec256a service nova] Acquiring lock "bf181571-acd7-4482-90b1-50b7223411fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:15:54.220637 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a7f35519-1f0d-40a1-9525-6ac7ce1720cf req-f97b436a-5666-422e-87d0-6f9e7bec256a service nova] Lock "bf181571-acd7-4482-90b1-50b7223411fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:15:54.220806 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-a7f35519-1f0d-40a1-9525-6ac7ce1720cf req-f97b436a-5666-422e-87d0-6f9e7bec256a service nova] Lock "bf181571-acd7-4482-90b1-50b7223411fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:15:54.221115 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a7f35519-1f0d-40a1-9525-6ac7ce1720cf req-f97b436a-5666-422e-87d0-6f9e7bec256a service nova] [instance: bf181571-acd7-4482-90b1-50b7223411fc] No waiting events found dispatching network-vif-unplugged-4ba3c950-6075-4485-8352-d019b6137361 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:15:54.222055 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-a7f35519-1f0d-40a1-9525-6ac7ce1720cf req-f97b436a-5666-422e-87d0-6f9e7bec256a service nova] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Received event network-vif-unplugged-4ba3c950-6075-4485-8352-d019b6137361 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:15:54.387077 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-79f10a76-90b3-497d-8c8d-f33c30186379 req-b03dc8f6-574a-4c15-92db-9daa23063fe7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:15:54.423663 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "4ce32a9b-fc5a-4931-9880-dd7638009cc5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:15:54.423841 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "4ce32a9b-fc5a-4931-9880-dd7638009cc5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:15:54.424016 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "4ce32a9b-fc5a-4931-9880-dd7638009cc5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:15:54.424128 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "4ce32a9b-fc5a-4931-9880-dd7638009cc5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:15:54.424241 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "4ce32a9b-fc5a-4931-9880-dd7638009cc5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:15:54.426092 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Terminating instance
May 28 10:15:54.697421 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-79f10a76-90b3-497d-8c8d-f33c30186379 req-b03dc8f6-574a-4c15-92db-9daa23063fe7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:15:54.729859 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:15:54.829330 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-79f10a76-90b3-497d-8c8d-f33c30186379 req-b03dc8f6-574a-4c15-92db-9daa23063fe7 service nova] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Updated VIF entry in instance network info cache for port eba7bb57-5c95-42bd-beb9-6e9af82baa89. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:15:54.829662 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-79f10a76-90b3-497d-8c8d-f33c30186379 req-b03dc8f6-574a-4c15-92db-9daa23063fe7 service nova] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Updating instance_info_cache with network_info: [{"id": "eba7bb57-5c95-42bd-beb9-6e9af82baa89", "address": "fa:16:3e:f0:e6:55", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba7bb57-5c", "ovs_interfaceid": "eba7bb57-5c95-42bd-beb9-6e9af82baa89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:15:54.929110 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:15:54.949601 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:54.955646 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:54.975627 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:55.106779 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:55.137037 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:55.143267 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:55.235190 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Took 1.56 seconds to deallocate network for instance.
May 28 10:15:55.255324 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.99968701700027 future=<Future at 0x73c1f4239be0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:15:55.257635 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Instance destroyed successfully.
May 28 10:15:55.257635 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lazy-loading 'resources' on Instance uuid 4ce32a9b-fc5a-4931-9880-dd7638009cc5 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:15:55.332515 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-79f10a76-90b3-497d-8c8d-f33c30186379 req-b03dc8f6-574a-4c15-92db-9daa23063fe7 service nova] Releasing lock "refresh_cache-4ce32a9b-fc5a-4931-9880-dd7638009cc5" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:15:55.759978 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:14:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-531621314',display_name='tempest-TestVolumeBootPattern-server-531621314',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpattern-server-531621314',id=76,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIssEW3wFq5Z5UVaYZuW5cmCRsiPiqbdvADCw1wCLU3ZToJr2mBO+GTeBlReOodZ6qxe1OJNXGES/jiq9J2PvBGzYYtKCDR4nIPiT2JecYH/bovKreakXe+d0IlAq6PNVA==',key_name='tempest-TestVolumeBootPattern-1325122028',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:15:14Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='23e9651268114327a9cc6c6c59bef01e',ramdisk_id='',reservation_id='r-dv2kjgh1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-327944304',owner_user_name='tempest-TestVolumeBootPattern-327944304-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:15:14Z,user_data=None,user_id='ec58233d3b2848bbb2e0b00650398cd1',uuid=4ce32a9b-fc5a-4931-9880-dd7638009cc5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eba7bb57-5c95-42bd-beb9-6e9af82baa89", "address": "fa:16:3e:f0:e6:55", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba7bb57-5c", "ovs_interfaceid": "eba7bb57-5c95-42bd-beb9-6e9af82baa89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:15:55.760250 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converting VIF {"id": "eba7bb57-5c95-42bd-beb9-6e9af82baa89", "address": "fa:16:3e:f0:e6:55", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba7bb57-5c", "ovs_interfaceid": "eba7bb57-5c95-42bd-beb9-6e9af82baa89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:15:55.760748 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:e6:55,bridge_name='br-int',has_traffic_filtering=True,id=eba7bb57-5c95-42bd-beb9-6e9af82baa89,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeba7bb57-5c') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:15:55.761042 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:e6:55,bridge_name='br-int',has_traffic_filtering=True,id=eba7bb57-5c95-42bd-beb9-6e9af82baa89,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeba7bb57-5c') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:15:55.762125 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:55.762420 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeba7bb57-5c, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:15:55.767585 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:55.767585 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:15:55.767585 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:55.768113 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:55.768365 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=980d3cb3-3791-4fbb-ad24-df4c5ed4906f) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:15:55.769075 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:55.769954 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:15:55.770544 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:15:55.772599 np0000001613 nova-compute[98321]: INFO os_vif [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:e6:55,bridge_name='br-int',has_traffic_filtering=True,id=eba7bb57-5c95-42bd-beb9-6e9af82baa89,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeba7bb57-5c')
May 28 10:15:55.774676 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:15:55.775039 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1', 'iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '36963ede-84ce-4a49-afed-c6e79cfb9ae1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:15:55.775236 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:15:55.775620 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:15:55.775989 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1', 'iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '36963ede-84ce-4a49-afed-c6e79cfb9ae1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:15:55.776149 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:15:55.799935 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Took 0.57 seconds to detach 1 volumes for instance.
May 28 10:15:55.805508 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:55.805508 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:55.805508 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:55.805508 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:55.805508 np0000001613 nova-compute[98321]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1 (non-flash)
May 28 10:15:55.805508 np0000001613 nova-compute[98321]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1 (non-flash)
May 28 10:15:55.805508 np0000001613 nova-compute[98321]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb (non-flash)
May 28 10:15:55.805508 np0000001613 nova-compute[98321]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb (non-flash)
May 28 10:15:55.805508 np0000001613 nova-compute[98321]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20561d76-f7d4-4638-b2d7-4a110a4ff30c (non-flash)
May 28 10:15:55.805508 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:15:55.805887 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:55.805887 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:15:55.805887 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:55.805887 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:15:55.805887 np0000001613 nova-compute[98321]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1 (non-flash)
May 28 10:15:55.805887 np0000001613 nova-compute[98321]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1 (non-flash)
May 28 10:15:55.805887 np0000001613 nova-compute[98321]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb (non-flash)
May 28 10:15:55.805887 np0000001613 nova-compute[98321]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb (non-flash)
May 28 10:15:55.805887 np0000001613 nova-compute[98321]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20561d76-f7d4-4638-b2d7-4a110a4ff30c (non-flash)
May 28 10:15:55.805887 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:15:55.806301 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', '176'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', '177'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', '193'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', '194'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1', '207'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1', '208'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb', '213'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb', '214'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-20561d76-f7d4-4638-b2d7-4a110a4ff30c', '215')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:15:55.806301 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1', '207')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:15:55.808101 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1', '208')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:15:55.808997 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc3785e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1'): ({'sdl'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:15:55.809229 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Removing multipathed devices sdl, sdk {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:15:55.809468 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Flush multipath device 33000000009356007 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:15:55.867463 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:15:55.927758 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:15:55.969617 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Checking to see if SCSI volumes sdl, sdk have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:15:55.969841 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] SCSI volumes sdl, sdk have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:15:55.970944 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Checking to see if device paths {'sdl', 'sdk'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:15:55.982927 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Device paths {'sdl', 'sdk'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:15:55.983125 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:15:55.994033 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:56.025800 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 207, target: iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1, portal: 192.168.40.100,3260]
May 28 10:15:56.025800 np0000001613 nova-compute[98321]: Logout of [sid: 207, target: iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1, portal: 192.168.40.100,3260] successful.
May 28 10:15:56.025800 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:56.043000 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:56.053625 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:56.085818 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 208, target: iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1, portal: 192.168.50.100,3260]
May 28 10:15:56.085818 np0000001613 nova-compute[98321]: Logout of [sid: 208, target: iqn.2023-03.storpool.com:os--volume-36963ede-84ce-4a49-afed-c6e79cfb9ae1, portal: 192.168.50.100,3260] successful.
May 28 10:15:56.085818 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:56.101721 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:15:56.101969 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:15:56.102083 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] <== disconnect_volume: return (326ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:15:56.102224 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:15:56.102440 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Deleting instance files /opt/stack/data/nova/instances/4ce32a9b-fc5a-4931-9880-dd7638009cc5_del
May 28 10:15:56.102898 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Deletion of /opt/stack/data/nova/instances/4ce32a9b-fc5a-4931-9880-dd7638009cc5_del complete
May 28 10:15:56.145388 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.001205334000133007 future=<Future at 0x73c1f423a3f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:15:56.146041 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Emitting event <LifecycleEvent: 1779963341.144092, 7de5b639-f7aa-46af-8f5e-a34503673ba0 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:15:56.146222 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:15:56.146410 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] VM Stopped (Lifecycle Event)
May 28 10:15:56.146505 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=11.072200628000246 future=<Future at 0x73c1fc315cd0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:15:56.147692 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=11.071023768000032 future=<Future at 0x73c1fc315cd0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:15:56.285687 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-70ca0179-4f80-4ee2-b181-686bee4cd07c req-e1cfab5a-f286-4afd-817a-650e2704d1e0 service nova] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Received event network-vif-deleted-4ba3c950-6075-4485-8352-d019b6137361 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:15:56.286326 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-70ca0179-4f80-4ee2-b181-686bee4cd07c req-e1cfab5a-f286-4afd-817a-650e2704d1e0 service nova] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Received event network-vif-unplugged-eba7bb57-5c95-42bd-beb9-6e9af82baa89 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:15:56.286576 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-70ca0179-4f80-4ee2-b181-686bee4cd07c req-e1cfab5a-f286-4afd-817a-650e2704d1e0 service nova] Acquiring lock "4ce32a9b-fc5a-4931-9880-dd7638009cc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:15:56.286894 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-70ca0179-4f80-4ee2-b181-686bee4cd07c req-e1cfab5a-f286-4afd-817a-650e2704d1e0 service nova] Lock "4ce32a9b-fc5a-4931-9880-dd7638009cc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:15:56.287099 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-70ca0179-4f80-4ee2-b181-686bee4cd07c req-e1cfab5a-f286-4afd-817a-650e2704d1e0 service nova] Lock "4ce32a9b-fc5a-4931-9880-dd7638009cc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:15:56.287302 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-70ca0179-4f80-4ee2-b181-686bee4cd07c req-e1cfab5a-f286-4afd-817a-650e2704d1e0 service nova] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] No waiting events found dispatching network-vif-unplugged-eba7bb57-5c95-42bd-beb9-6e9af82baa89 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:15:56.287600 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-70ca0179-4f80-4ee2-b181-686bee4cd07c req-e1cfab5a-f286-4afd-817a-650e2704d1e0 service nova] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Received event network-vif-unplugged-eba7bb57-5c95-42bd-beb9-6e9af82baa89 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:15:56.287788 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-70ca0179-4f80-4ee2-b181-686bee4cd07c req-e1cfab5a-f286-4afd-817a-650e2704d1e0 service nova] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Received event network-vif-unplugged-eba7bb57-5c95-42bd-beb9-6e9af82baa89 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:15:56.288531 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-70ca0179-4f80-4ee2-b181-686bee4cd07c req-e1cfab5a-f286-4afd-817a-650e2704d1e0 service nova] Acquiring lock "4ce32a9b-fc5a-4931-9880-dd7638009cc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:15:56.288820 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-70ca0179-4f80-4ee2-b181-686bee4cd07c req-e1cfab5a-f286-4afd-817a-650e2704d1e0 service nova] Lock "4ce32a9b-fc5a-4931-9880-dd7638009cc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:15:56.288988 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-70ca0179-4f80-4ee2-b181-686bee4cd07c req-e1cfab5a-f286-4afd-817a-650e2704d1e0 service nova] Lock "4ce32a9b-fc5a-4931-9880-dd7638009cc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:15:56.289210 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-70ca0179-4f80-4ee2-b181-686bee4cd07c req-e1cfab5a-f286-4afd-817a-650e2704d1e0 service nova] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] No waiting events found dispatching network-vif-unplugged-eba7bb57-5c95-42bd-beb9-6e9af82baa89 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:15:56.289395 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-70ca0179-4f80-4ee2-b181-686bee4cd07c req-e1cfab5a-f286-4afd-817a-650e2704d1e0 service nova] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Received event network-vif-unplugged-eba7bb57-5c95-42bd-beb9-6e9af82baa89 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:15:56.308195 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:15:56.308429 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:15:56.541414 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:15:56.541588 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:15:56.609790 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Took 1.68 seconds to destroy the instance on the hypervisor.
May 28 10:15:56.610450 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:15:56.611070 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:15:56.611170 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:15:56.611452 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:15:56.649327 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f47af16d-98ab-47ad-832a-4d6bced8e7a1 tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 7de5b639-f7aa-46af-8f5e-a34503673ba0] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:15:56.709246 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:15:56.954052 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-9965b9d5-7377-4694-9b76-12a5af78d42e req-2de3595e-e11a-4649-ba1d-cd63fecbf064 service nova] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Received event network-vif-deleted-eba7bb57-5c95-42bd-beb9-6e9af82baa89 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:15:56.954418 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-9965b9d5-7377-4694-9b76-12a5af78d42e req-2de3595e-e11a-4649-ba1d-cd63fecbf064 service nova] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Neutron deleted interface eba7bb57-5c95-42bd-beb9-6e9af82baa89; detaching it from the instance and deleting it from the info cache
May 28 10:15:56.958193 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-9965b9d5-7377-4694-9b76-12a5af78d42e req-2de3595e-e11a-4649-ba1d-cd63fecbf064 service nova] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Detach interface failed, port_id=eba7bb57-5c95-42bd-beb9-6e9af82baa89, reason: Instance 4ce32a9b-fc5a-4931-9880-dd7638009cc5 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:15:57.044248 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:15:57.409399 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:15:57.556787 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.248s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:15:57.608239 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Deleted allocations for instance bf181571-acd7-4482-90b1-50b7223411fc
May 28 10:15:57.919878 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Took 1.31 seconds to deallocate network for instance.
May 28 10:15:58.469286 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Took 0.55 seconds to detach 1 volumes for instance.
May 28 10:15:58.616472 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-fd4e14cd-25dc-4a72-91a1-7fcce0e68195 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "bf181571-acd7-4482-90b1-50b7223411fc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.250s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:15:58.975152 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:15:58.975342 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:15:59.150186 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:15:59.150731 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:15:59.654003 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:16:00.161530 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.186s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:16:00.216154 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Deleted allocations for instance 4ce32a9b-fc5a-4931-9880-dd7638009cc5
May 28 10:16:00.352550 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquiring lock "f5d8064e-6dbe-4e13-87ae-b4dd67e60797" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:16:00.352775 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "f5d8064e-6dbe-4e13-87ae-b4dd67e60797" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:16:00.769743 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:00.854345 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:16:01.224092 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-08ba0d59-a787-4b0d-88fe-9001f300a609 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "4ce32a9b-fc5a-4931-9880-dd7638009cc5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.800s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:16:01.402570 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:16:01.402749 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:16:01.406173 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:16:01.406357 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Claim successful on node np0000001613
May 28 10:16:02.241850 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Acquiring lock "93a38b6d-e199-4653-a617-290247c8e430" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:16:02.242312 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "93a38b6d-e199-4653-a617-290247c8e430" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:16:02.242312 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Acquiring lock "93a38b6d-e199-4653-a617-290247c8e430-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:16:02.242312 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "93a38b6d-e199-4653-a617-290247c8e430-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:16:02.242444 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "93a38b6d-e199-4653-a617-290247c8e430-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:16:02.244594 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Terminating instance
May 28 10:16:02.561057 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:16:02.561299 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:16:02.747540 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:16:02.775694 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:02.777742 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:02.793282 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:02.812822 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:02.911479 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b46697be-e8a2-490e-97a6-ad61592fee67 req-e8206766-6c11-44aa-8619-64795c4bbf0a service nova] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Received event network-vif-unplugged-e9818d03-4fce-4fba-a66e-524f18ac36fd {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:16:02.912239 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b46697be-e8a2-490e-97a6-ad61592fee67 req-e8206766-6c11-44aa-8619-64795c4bbf0a service nova] Acquiring lock "93a38b6d-e199-4653-a617-290247c8e430-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:16:02.912383 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b46697be-e8a2-490e-97a6-ad61592fee67 req-e8206766-6c11-44aa-8619-64795c4bbf0a service nova] Lock "93a38b6d-e199-4653-a617-290247c8e430-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:16:02.912493 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-b46697be-e8a2-490e-97a6-ad61592fee67 req-e8206766-6c11-44aa-8619-64795c4bbf0a service nova] Lock "93a38b6d-e199-4653-a617-290247c8e430-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:16:02.912608 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b46697be-e8a2-490e-97a6-ad61592fee67 req-e8206766-6c11-44aa-8619-64795c4bbf0a service nova] [instance: 93a38b6d-e199-4653-a617-290247c8e430] No waiting events found dispatching network-vif-unplugged-e9818d03-4fce-4fba-a66e-524f18ac36fd {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:16:02.912708 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-b46697be-e8a2-490e-97a6-ad61592fee67 req-e8206766-6c11-44aa-8619-64795c4bbf0a service nova] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Received event network-vif-unplugged-e9818d03-4fce-4fba-a66e-524f18ac36fd for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:16:03.035927 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:03.042064 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:03.062405 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.99966937499994 future=<Future at 0x73c1f423b1a0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:16:03.063862 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:16:03.070841 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Instance destroyed successfully.
May 28 10:16:03.072184 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lazy-loading 'resources' on Instance uuid 93a38b6d-e199-4653-a617-290247c8e430 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:16:03.301581 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:16:03.301967 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:16:03.302115 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.49 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:16:03.570935 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.168s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:16:03.571337 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:16:03.575047 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:12:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-288419323',display_name='tempest-TestVolumeBootPatternV346-server-288419323',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpatternv346-server-288419323',id=69,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3cEaRHItP11PmI2SEJKC/OwfP7HVOzMTvMY4PVBNkeeAtDxTqgCv/kW8CrWC9tHTkoNin6B2ta1TiZI7ymjl1xZ3t9rfiDefeyUBvFiaVO02aMlQPC2u8XZcNAikqsbQ==',key_name='tempest-keypair-474001042',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:12:56Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d80b528594ac4ee5b3b56bf7c94c7ffa',ramdisk_id='',reservation_id='r-vpifr2gp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-204163382',owner_user_name='tempest-TestVolumeBootPatternV346-204163382-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:12:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ffa50296592417a99dd0566355e09f9',uuid=93a38b6d-e199-4653-a617-290247c8e430,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9818d03-4fce-4fba-a66e-524f18ac36fd", "address": "fa:16:3e:49:8b:e9", "network": {"id": "83f5548a-aebf-46e0-a4d2-07f06d3967d4", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1141449765-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d80b528594ac4ee5b3b56bf7c94c7ffa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9818d03-4f", "ovs_interfaceid": "e9818d03-4fce-4fba-a66e-524f18ac36fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:16:03.575651 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Converting VIF {"id": "e9818d03-4fce-4fba-a66e-524f18ac36fd", "address": "fa:16:3e:49:8b:e9", "network": {"id": "83f5548a-aebf-46e0-a4d2-07f06d3967d4", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1141449765-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d80b528594ac4ee5b3b56bf7c94c7ffa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9818d03-4f", "ovs_interfaceid": "e9818d03-4fce-4fba-a66e-524f18ac36fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:16:03.576485 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:8b:e9,bridge_name='br-int',has_traffic_filtering=True,id=e9818d03-4fce-4fba-a66e-524f18ac36fd,network=Network(83f5548a-aebf-46e0-a4d2-07f06d3967d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9818d03-4f') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:16:03.576793 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:8b:e9,bridge_name='br-int',has_traffic_filtering=True,id=e9818d03-4fce-4fba-a66e-524f18ac36fd,network=Network(83f5548a-aebf-46e0-a4d2-07f06d3967d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9818d03-4f') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:16:03.577873 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:03.578187 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9818d03-4f, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:16:03.579327 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:03.580466 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:16:03.580876 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:03.581039 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d1799ea0-6194-4892-9dbc-1f4c2738e3de) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:16:03.582879 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:16:03.584041 np0000001613 nova-compute[98321]: INFO os_vif [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:8b:e9,bridge_name='br-int',has_traffic_filtering=True,id=e9818d03-4fce-4fba-a66e-524f18ac36fd,network=Network(83f5548a-aebf-46e0-a4d2-07f06d3967d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9818d03-4f')
May 28 10:16:03.586666 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:16:03.586984 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a22ccd2b-8f27-4899-85c7-6ea7af4453a2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:16:03.587128 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:16:03.587376 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:16:03.587782 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a22ccd2b-8f27-4899-85c7-6ea7af4453a2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:16:03.587782 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:16:03.616551 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:16:03.616551 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:16:03.616551 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:16:03.616551 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:16:03.616551 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:16:03.616811 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsi session list stdout=tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:16:03.616811 np0000001613 nova-compute[98321]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2 (non-flash)
May 28 10:16:03.616811 np0000001613 nova-compute[98321]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:16:03.616811 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:16:03.616811 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:16:03.617008 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', '176'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', '177'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', '193'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', '194')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:16:03.617008 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', '176')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:16:03.617676 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2', '177')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:16:03.618789 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc3799e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2'): ({'sdi'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:16:03.618789 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Removing multipathed devices sdh, sdi {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:16:03.618789 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Flush multipath device 330000000be9ab1c7 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:16:03.680687 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:16:03.722616 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:16:03.781713 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:16:03.781848 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:16:03.782691 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:16:03.791326 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:16:03.791610 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:16:03.791755 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 10:16:03.792016 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:16:03.794251 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:16:03.794456 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:16:03.806717 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:03.843985 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 176, target: iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2, portal: 192.168.40.100,3260]
May 28 10:16:03.843985 np0000001613 nova-compute[98321]: Logout of [sid: 176, target: iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2, portal: 192.168.40.100,3260] successful.
May 28 10:16:03.843985 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:03.859035 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:03.869578 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:03.898001 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 177, target: iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2, portal: 192.168.50.100,3260]
May 28 10:16:03.898001 np0000001613 nova-compute[98321]: Logout of [sid: 177, target: iqn.2023-03.storpool.com:os--volume-a22ccd2b-8f27-4899-85c7-6ea7af4453a2, portal: 192.168.50.100,3260] successful.
May 28 10:16:03.898001 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:03.910302 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:03.910485 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:16:03.910598 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] <== disconnect_volume: return (323ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:16:03.911506 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:16:03.911506 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Deleting instance files /opt/stack/data/nova/instances/93a38b6d-e199-4653-a617-290247c8e430_del
May 28 10:16:03.911506 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Deletion of /opt/stack/data/nova/instances/93a38b6d-e199-4653-a617-290247c8e430_del complete
May 28 10:16:03.998801 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "0327fb6e-6b30-4f70-8877-a3859969f5ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:16:03.999044 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "0327fb6e-6b30-4f70-8877-a3859969f5ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:16:03.999285 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "0327fb6e-6b30-4f70-8877-a3859969f5ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:16:03.999471 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "0327fb6e-6b30-4f70-8877-a3859969f5ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:16:03.999634 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "0327fb6e-6b30-4f70-8877-a3859969f5ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:16:04.002133 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Terminating instance
May 28 10:16:04.076781 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:16:04.077626 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:16:04.077905 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:16:04.079042 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:16:04.151326 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cabed30cb95f4f7b9f96187fc336f7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a515533ba1c4e23a52f472549e5211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:16:04.417761 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Took 1.67 seconds to destroy the instance on the hypervisor.
May 28 10:16:04.418324 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:16:04.418607 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:16:04.418695 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 93a38b6d-e199-4653-a617-290247c8e430] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:16:04.418883 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:16:04.498075 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:16:04.505563 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:16:04.524664 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:04.544815 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Successfully created port: c88f6a8c-e28c-42ba-8b7f-108be62aeaee {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:16:04.546752 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:04.549273 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:04.563927 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:04.567943 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:04.578938 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:16:04.790530 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:16:04.790864 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:16:04.791319 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:16:04.829100 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.99972697200019 future=<Future at 0x73c1f41ba330 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:16:04.834047 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Instance destroyed successfully.
May 28 10:16:04.834520 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lazy-loading 'resources' on Instance uuid 0327fb6e-6b30-4f70-8877-a3859969f5ca {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:16:05.011081 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-522158fe-bcb0-421f-a332-727eab9f0e11 req-04dacc63-4ccd-4480-8882-3830752c5526 service nova] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Received event network-vif-unplugged-e9818d03-4fce-4fba-a66e-524f18ac36fd {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:16:05.011081 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-522158fe-bcb0-421f-a332-727eab9f0e11 req-04dacc63-4ccd-4480-8882-3830752c5526 service nova] Acquiring lock "93a38b6d-e199-4653-a617-290247c8e430-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:16:05.011081 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-522158fe-bcb0-421f-a332-727eab9f0e11 req-04dacc63-4ccd-4480-8882-3830752c5526 service nova] Lock "93a38b6d-e199-4653-a617-290247c8e430-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:16:05.011081 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-522158fe-bcb0-421f-a332-727eab9f0e11 req-04dacc63-4ccd-4480-8882-3830752c5526 service nova] Lock "93a38b6d-e199-4653-a617-290247c8e430-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:16:05.011081 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-522158fe-bcb0-421f-a332-727eab9f0e11 req-04dacc63-4ccd-4480-8882-3830752c5526 service nova] [instance: 93a38b6d-e199-4653-a617-290247c8e430] No waiting events found dispatching network-vif-unplugged-e9818d03-4fce-4fba-a66e-524f18ac36fd {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:16:05.011081 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-522158fe-bcb0-421f-a332-727eab9f0e11 req-04dacc63-4ccd-4480-8882-3830752c5526 service nova] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Received event network-vif-unplugged-e9818d03-4fce-4fba-a66e-524f18ac36fd for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:16:05.011081 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-522158fe-bcb0-421f-a332-727eab9f0e11 req-04dacc63-4ccd-4480-8882-3830752c5526 service nova] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Received event network-changed-4e515a16-b64c-41b0-8aac-6c77cd0b75cd {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:16:05.011081 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-522158fe-bcb0-421f-a332-727eab9f0e11 req-04dacc63-4ccd-4480-8882-3830752c5526 service nova] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Refreshing instance network info cache due to event network-changed-4e515a16-b64c-41b0-8aac-6c77cd0b75cd. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:16:05.011081 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-522158fe-bcb0-421f-a332-727eab9f0e11 req-04dacc63-4ccd-4480-8882-3830752c5526 service nova] Acquiring lock "refresh_cache-0327fb6e-6b30-4f70-8877-a3859969f5ca" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:16:05.011081 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-522158fe-bcb0-421f-a332-727eab9f0e11 req-04dacc63-4ccd-4480-8882-3830752c5526 service nova] Acquired lock "refresh_cache-0327fb6e-6b30-4f70-8877-a3859969f5ca" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:16:05.011081 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-522158fe-bcb0-421f-a332-727eab9f0e11 req-04dacc63-4ccd-4480-8882-3830752c5526 service nova] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Refreshing network info cache for port 4e515a16-b64c-41b0-8aac-6c77cd0b75cd {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:16:05.064096 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Successfully updated port: c88f6a8c-e28c-42ba-8b7f-108be62aeaee {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:16:05.083058 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:16:05.124593 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5cb4dcca-07a6-4fa2-88a6-538fbd02edf6 req-ecc3a23a-c511-4220-9fab-a2a6d4732e80 service nova] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Received event network-changed-c88f6a8c-e28c-42ba-8b7f-108be62aeaee {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:16:05.124821 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5cb4dcca-07a6-4fa2-88a6-538fbd02edf6 req-ecc3a23a-c511-4220-9fab-a2a6d4732e80 service nova] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Refreshing instance network info cache due to event network-changed-c88f6a8c-e28c-42ba-8b7f-108be62aeaee. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:16:05.124956 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5cb4dcca-07a6-4fa2-88a6-538fbd02edf6 req-ecc3a23a-c511-4220-9fab-a2a6d4732e80 service nova] Acquiring lock "refresh_cache-f5d8064e-6dbe-4e13-87ae-b4dd67e60797" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:16:05.125085 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5cb4dcca-07a6-4fa2-88a6-538fbd02edf6 req-ecc3a23a-c511-4220-9fab-a2a6d4732e80 service nova] Acquired lock "refresh_cache-f5d8064e-6dbe-4e13-87ae-b4dd67e60797" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:16:05.125213 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-5cb4dcca-07a6-4fa2-88a6-538fbd02edf6 req-ecc3a23a-c511-4220-9fab-a2a6d4732e80 service nova] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Refreshing network info cache for port c88f6a8c-e28c-42ba-8b7f-108be62aeaee {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:16:05.306105 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:16:05.306278 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:16:05.306392 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:16:05.306524 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Auditing locally available compute resources for np0000001613 (node: np0000001613) {{(pid=98321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 10:16:05.336596 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:13:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-3389747',display_name='tempest-TestVolumeBootPattern-server-3389747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testvolumebootpattern-server-3389747',id=73,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIssEW3wFq5Z5UVaYZuW5cmCRsiPiqbdvADCw1wCLU3ZToJr2mBO+GTeBlReOodZ6qxe1OJNXGES/jiq9J2PvBGzYYtKCDR4nIPiT2JecYH/bovKreakXe+d0IlAq6PNVA==',key_name='tempest-TestVolumeBootPattern-1325122028',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:14:14Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='23e9651268114327a9cc6c6c59bef01e',ramdisk_id='',reservation_id='r-t4xe30cs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-327944304',owner_user_name='tempest-TestVolumeBootPattern-327944304-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:14:14Z,user_data=None,user_id='ec58233d3b2848bbb2e0b00650398cd1',uuid=0327fb6e-6b30-4f70-8877-a3859969f5ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e515a16-b64c-41b0-8aac-6c77cd0b75cd", "address": "fa:16:3e:ed:76:9b", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e515a16-b6", "ovs_interfaceid": "4e515a16-b64c-41b0-8aac-6c77cd0b75cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:16:05.336774 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converting VIF {"id": "4e515a16-b64c-41b0-8aac-6c77cd0b75cd", "address": "fa:16:3e:ed:76:9b", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e515a16-b6", "ovs_interfaceid": "4e515a16-b64c-41b0-8aac-6c77cd0b75cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:16:05.337224 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:76:9b,bridge_name='br-int',has_traffic_filtering=True,id=4e515a16-b64c-41b0-8aac-6c77cd0b75cd,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e515a16-b6') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:16:05.337397 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:76:9b,bridge_name='br-int',has_traffic_filtering=True,id=4e515a16-b64c-41b0-8aac-6c77cd0b75cd,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e515a16-b6') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:16:05.338035 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:05.338205 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e515a16-b6, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:16:05.338990 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:05.340772 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:16:05.341084 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:05.341214 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d3359475-d7c2-4667-a97d-20bc34021455) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:16:05.341981 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:05.342528 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:16:05.344035 np0000001613 nova-compute[98321]: INFO os_vif [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:76:9b,bridge_name='br-int',has_traffic_filtering=True,id=4e515a16-b64c-41b0-8aac-6c77cd0b75cd,network=Network(da998f17-d4ed-4b8b-b88a-215d0e3f9f1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e515a16-b6')
May 28 10:16:05.345336 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:16:05.345562 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b23f5880-1872-41fd-becc-baf8432031f3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:16:05.345677 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:16:05.345960 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:16:05.346202 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b23f5880-1872-41fd-becc-baf8432031f3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:16:05.346314 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:16:05.370253 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:16:05.370253 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:16:05.370253 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:16:05.370369 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsi session list stdout=tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:16:05.370369 np0000001613 nova-compute[98321]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3 (non-flash)
May 28 10:16:05.370369 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:16:05.370449 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', '193'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', '194')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:16:05.370540 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', '193')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:16:05.371177 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3', '194')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:16:05.371739 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc22cea0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3'): ({'sdf'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:16:05.371901 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Removing multipathed devices sdf, sde {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:16:05.372113 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Flush multipath device 330000000eafe978e {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:16:05.430576 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:16:05.469532 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:16:05.504785 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-522158fe-bcb0-421f-a332-727eab9f0e11 req-04dacc63-4ccd-4480-8882-3830752c5526 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:16:05.512508 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Checking to see if SCSI volumes sdf, sde have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:16:05.512646 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] SCSI volumes sdf, sde have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:16:05.513312 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Checking to see if device paths {'sdf', 'sde'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:16:05.523803 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Device paths {'sdf', 'sde'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:16:05.523965 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:16:05.534752 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:05.563301 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 193, target: iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3, portal: 192.168.40.100,3260]
May 28 10:16:05.563301 np0000001613 nova-compute[98321]: Logout of [sid: 193, target: iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3, portal: 192.168.40.100,3260] successful.
May 28 10:16:05.563301 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:05.566463 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquiring lock "refresh_cache-f5d8064e-6dbe-4e13-87ae-b4dd67e60797" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:16:05.574860 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:05.585388 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:05.586966 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Booting with volume befe7a60-6d3a-484d-8d41-820fb02e69cb at /dev/vda
May 28 10:16:05.609578 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 194, target: iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3, portal: 192.168.50.100,3260]
May 28 10:16:05.609578 np0000001613 nova-compute[98321]: Logout of [sid: 194, target: iqn.2023-03.storpool.com:os--volume-b23f5880-1872-41fd-becc-baf8432031f3, portal: 192.168.50.100,3260] successful.
May 28 10:16:05.609578 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:05.620092 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:05.620092 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:16:05.620092 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] <== disconnect_volume: return (274ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:16:05.620290 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:16:05.621025 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Deleting instance files /opt/stack/data/nova/instances/0327fb6e-6b30-4f70-8877-a3859969f5ca_del
May 28 10:16:05.625383 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Deletion of /opt/stack/data/nova/instances/0327fb6e-6b30-4f70-8877-a3859969f5ca_del complete
May 28 10:16:05.627857 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:16:05.628542 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:16:05.628818 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-5cb4dcca-07a6-4fa2-88a6-538fbd02edf6 req-ecc3a23a-c511-4220-9fab-a2a6d4732e80 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:16:05.638459 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:16:05.658797 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:16:05.710642 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-5cb4dcca-07a6-4fa2-88a6-538fbd02edf6 req-ecc3a23a-c511-4220-9fab-a2a6d4732e80 service nova] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:16:05.712395 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:16:05.712819 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:16:05.721194 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:16:05.721608 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641'] 
May 28 10:16:05.721723 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:16:05.721858 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:16:05.722055 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] <== get_connector_properties: return (94ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:16:05.722260 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Updating existing volume attachment record: 4c82b8d6-bfc4-4356-a456-7dd642f175da {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:16:05.791914 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-522158fe-bcb0-421f-a332-727eab9f0e11 req-04dacc63-4ccd-4480-8882-3830752c5526 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:16:05.840612 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-5cb4dcca-07a6-4fa2-88a6-538fbd02edf6 req-ecc3a23a-c511-4220-9fab-a2a6d4732e80 service nova] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:16:05.918285 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-522158fe-bcb0-421f-a332-727eab9f0e11 req-04dacc63-4ccd-4480-8882-3830752c5526 service nova] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Updated VIF entry in instance network info cache for port 4e515a16-b64c-41b0-8aac-6c77cd0b75cd. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:16:05.918697 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-522158fe-bcb0-421f-a332-727eab9f0e11 req-04dacc63-4ccd-4480-8882-3830752c5526 service nova] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Updating instance_info_cache with network_info: [{"id": "4e515a16-b64c-41b0-8aac-6c77cd0b75cd", "address": "fa:16:3e:ed:76:9b", "network": {"id": "da998f17-d4ed-4b8b-b88a-215d0e3f9f1e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1953196285-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23e9651268114327a9cc6c6c59bef01e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e515a16-b6", "ovs_interfaceid": "4e515a16-b64c-41b0-8aac-6c77cd0b75cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:16:06.131379 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Took 1.71 seconds to deallocate network for instance.
May 28 10:16:06.137193 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Took 1.63 seconds to destroy the instance on the hypervisor.
May 28 10:16:06.137868 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:16:06.138311 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:16:06.138438 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:16:06.138676 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:16:06.193045 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:16:06.326572 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Error from libvirt while getting description of instance-00000049: [Error Code 42] Domain not found: no domain with matching uuid '0327fb6e-6b30-4f70-8877-a3859969f5ca' (instance-00000049): libvirt.libvirtError: Domain not found: no domain with matching uuid '0327fb6e-6b30-4f70-8877-a3859969f5ca' (instance-00000049)
May 28 10:16:06.328662 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:16:06.329567 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:16:06.344020 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5cb4dcca-07a6-4fa2-88a6-538fbd02edf6 req-ecc3a23a-c511-4220-9fab-a2a6d4732e80 service nova] Releasing lock "refresh_cache-f5d8064e-6dbe-4e13-87ae-b4dd67e60797" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:16:06.344999 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquired lock "refresh_cache-f5d8064e-6dbe-4e13-87ae-b4dd67e60797" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:16:06.345327 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:16:06.373995 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "env LANG=C uptime" returned: 0 in 0.044s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:16:06.375460 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Hypervisor/Node resource view: name=np0000001613 free_ram=13482MB free_disk=72.64881896972656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 10:16:06.375628 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:16:06.376209 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:16:06.420806 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-522158fe-bcb0-421f-a332-727eab9f0e11 req-04dacc63-4ccd-4480-8882-3830752c5526 service nova] Releasing lock "refresh_cache-0327fb6e-6b30-4f70-8877-a3859969f5ca" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:16:06.421055 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-522158fe-bcb0-421f-a332-727eab9f0e11 req-04dacc63-4ccd-4480-8882-3830752c5526 service nova] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Received event network-vif-unplugged-4e515a16-b64c-41b0-8aac-6c77cd0b75cd {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:16:06.421326 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-522158fe-bcb0-421f-a332-727eab9f0e11 req-04dacc63-4ccd-4480-8882-3830752c5526 service nova] Acquiring lock "0327fb6e-6b30-4f70-8877-a3859969f5ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:16:06.421419 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-522158fe-bcb0-421f-a332-727eab9f0e11 req-04dacc63-4ccd-4480-8882-3830752c5526 service nova] Lock "0327fb6e-6b30-4f70-8877-a3859969f5ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:16:06.421541 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-522158fe-bcb0-421f-a332-727eab9f0e11 req-04dacc63-4ccd-4480-8882-3830752c5526 service nova] Lock "0327fb6e-6b30-4f70-8877-a3859969f5ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:16:06.421645 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-522158fe-bcb0-421f-a332-727eab9f0e11 req-04dacc63-4ccd-4480-8882-3830752c5526 service nova] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] No waiting events found dispatching network-vif-unplugged-4e515a16-b64c-41b0-8aac-6c77cd0b75cd {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:16:06.421760 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-522158fe-bcb0-421f-a332-727eab9f0e11 req-04dacc63-4ccd-4480-8882-3830752c5526 service nova] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Received event network-vif-unplugged-4e515a16-b64c-41b0-8aac-6c77cd0b75cd for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:16:06.674081 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Took 0.54 seconds to detach 1 volumes for instance.
May 28 10:16:06.881283 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:16:06.904130 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:16:07.032645 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:16:07.054936 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-85e27730-9402-4bc4-8431-e24c481ee516 req-c7234be7-de51-480c-abd9-b7cea636e5a3 service nova] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Received event network-vif-unplugged-4e515a16-b64c-41b0-8aac-6c77cd0b75cd {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:16:07.055073 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-85e27730-9402-4bc4-8431-e24c481ee516 req-c7234be7-de51-480c-abd9-b7cea636e5a3 service nova] Acquiring lock "0327fb6e-6b30-4f70-8877-a3859969f5ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:16:07.055244 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-85e27730-9402-4bc4-8431-e24c481ee516 req-c7234be7-de51-480c-abd9-b7cea636e5a3 service nova] Lock "0327fb6e-6b30-4f70-8877-a3859969f5ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:16:07.055360 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-85e27730-9402-4bc4-8431-e24c481ee516 req-c7234be7-de51-480c-abd9-b7cea636e5a3 service nova] Lock "0327fb6e-6b30-4f70-8877-a3859969f5ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:16:07.055469 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-85e27730-9402-4bc4-8431-e24c481ee516 req-c7234be7-de51-480c-abd9-b7cea636e5a3 service nova] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] No waiting events found dispatching network-vif-unplugged-4e515a16-b64c-41b0-8aac-6c77cd0b75cd {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:16:07.055571 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-85e27730-9402-4bc4-8431-e24c481ee516 req-c7234be7-de51-480c-abd9-b7cea636e5a3 service nova] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Received event network-vif-unplugged-4e515a16-b64c-41b0-8aac-6c77cd0b75cd for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:16:07.055667 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-85e27730-9402-4bc4-8431-e24c481ee516 req-c7234be7-de51-480c-abd9-b7cea636e5a3 service nova] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Received event network-vif-deleted-e9818d03-4fce-4fba-a66e-524f18ac36fd {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:16:07.147882 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Updating instance_info_cache with network_info: [{"id": "c88f6a8c-e28c-42ba-8b7f-108be62aeaee", "address": "fa:16:3e:b4:5a:13", "network": {"id": "07ee30b7-dd9c-433d-81cc-42ab11aded18", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1881482359-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a515533ba1c4e23a52f472549e5211f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88f6a8c-e2", "ovs_interfaceid": "c88f6a8c-e28c-42ba-8b7f-108be62aeaee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:16:07.179173 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:16:07.180593 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-92eed280-710a-4ac2-898b-249c5353a6f6 req-7b3cdcb2-0898-4221-8a3e-118fe3af209e service nova] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Received event network-vif-deleted-4e515a16-b64c-41b0-8aac-6c77cd0b75cd {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:16:07.219225 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.00046020399986446137 future=<Future at 0x73c1fc315cd0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:16:07.219845 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Emitting event <LifecycleEvent: 1779963352.2186496, bf181571-acd7-4482-90b1-50b7223411fc => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:16:07.220054 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:16:07.220262 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] VM Stopped (Lifecycle Event)
May 28 10:16:07.220812 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=3.034210334999898 future=<Future at 0x73c1f4239be0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:16:07.220883 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=3.034105639000245 future=<Future at 0x73c1f4239be0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:16:07.383185 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Took 1.24 seconds to deallocate network for instance.
May 28 10:16:07.431052 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 93a38b6d-e199-4653-a617-290247c8e430 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:16:07.431183 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 0327fb6e-6b30-4f70-8877-a3859969f5ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:16:07.431290 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance f5d8064e-6dbe-4e13-87ae-b4dd67e60797 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:16:07.431453 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 10:16:07.431594 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Final resource view: name=np0000001613 phys_ram=24030MB used_ram=1088MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 10:16:06 up 48 min,  2 users,  load average: 4.07, 6.08, 5.37\n', 'num_instances': '3', 'num_vm_active': '2', 'num_task_deleting': '2', 'num_os_type_None': '3', 'num_proj_d80b528594ac4ee5b3b56bf7c94c7ffa': '1', 'io_workload': '1', 'num_proj_23e9651268114327a9cc6c6c59bef01e': '1', 'num_vm_building': '1', 'num_task_block_device_mapping': '1', 'num_proj_2a515533ba1c4e23a52f472549e5211f': '1'} {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 10:16:07.584779 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:16:07.584980 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:16:07.650036 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Releasing lock "refresh_cache-f5d8064e-6dbe-4e13-87ae-b4dd67e60797" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:16:07.650357 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Instance network_info: |[{"id": "c88f6a8c-e28c-42ba-8b7f-108be62aeaee", "address": "fa:16:3e:b4:5a:13", "network": {"id": "07ee30b7-dd9c-433d-81cc-42ab11aded18", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1881482359-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a515533ba1c4e23a52f472549e5211f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88f6a8c-e2", "ovs_interfaceid": "c88f6a8c-e28c-42ba-8b7f-108be62aeaee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:16:07.722777 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: bf181571-acd7-4482-90b1-50b7223411fc] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:16:07.806270 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:16:07.807317 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:16:07.807536 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Creating image(s)
May 28 10:16:07.807954 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Did not create local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 10:16:07.808077 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Ensure instance console log exists: /opt/stack/data/nova/instances/f5d8064e-6dbe-4e13-87ae-b4dd67e60797/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:16:07.808306 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:16:07.808447 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:16:07.808555 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:16:07.809047 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Start _get_guest_xml network_info=[{"id": "c88f6a8c-e28c-42ba-8b7f-108be62aeaee", "address": "fa:16:3e:b4:5a:13", "network": {"id": "07ee30b7-dd9c-433d-81cc-42ab11aded18", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1881482359-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a515533ba1c4e23a52f472549e5211f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88f6a8c-e2", "ovs_interfaceid": "c88f6a8c-e28c-42ba-8b7f-108be62aeaee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb', 'iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'befe7a60-6d3a-484d-8d41-820fb02e69cb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'f5d8064e-6dbe-4e13-87ae-b4dd67e60797', 'attached_at': '', 'detached_at': '', 'volume_id': 'befe7a60-6d3a-484d-8d41-820fb02e69cb', 'serial': 'befe7a60-6d3a-484d-8d41-820fb02e69cb'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '4c82b8d6-bfc4-4356-a456-7dd642f175da', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:16:07.811614 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:16:07.812544 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1321799985', uuid='f5d8064e-6dbe-4e13-87ae-b4dd67e60797'), owner=OwnerMeta(userid='cabed30cb95f4f7b9f96187fc336f7c4', username='tempest-TestEncryptedCinderVolumes-678033643-project-member', projectid='2a515533ba1c4e23a52f472549e5211f', projectname='tempest-TestEncryptedCinderVolumes-678033643'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c88f6a8c-e28c-42ba-8b7f-108be62aeaee", "address": "fa:16:3e:b4:5a:13", "network": {"id": "07ee30b7-dd9c-433d-81cc-42ab11aded18", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1881482359-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a515533ba1c4e23a52f472549e5211f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88f6a8c-e2", "ovs_interfaceid": "c88f6a8c-e28c-42ba-8b7f-108be62aeaee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779963367.8122597) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:16:07.813547 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:16:07.813822 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:16:07.814713 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:16:07.814858 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:16:07.815755 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:16:07.816016 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:16:07.816145 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:16:07.816244 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:16:07.816358 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:16:07.816448 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:16:07.816528 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:16:07.816662 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:16:07.816749 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:16:07.816849 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:16:07.816972 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:16:07.817084 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:16:07.826770 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:16:07.827030 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb', 'iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'befe7a60-6d3a-484d-8d41-820fb02e69cb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:16:07.827199 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:16:07.929515 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Took 0.55 seconds to detach 1 volumes for instance.
May 28 10:16:08.087458 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:16:08.435503 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:16:08.579176 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.752s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:16:08.579423 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb', 'iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'befe7a60-6d3a-484d-8d41-820fb02e69cb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:16:08.592082 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:16:08.593152 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Compute_service record updated for np0000001613:np0000001613 {{(pid=98321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 10:16:08.593298 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.217s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:16:08.593774 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.415s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:16:08.594498 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:16:08.594734 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:16:08.595359 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:16:08.595359 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:16:08.595881 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:16:08.595881 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:16:08.607622 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:16:08.607622 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:08.611507 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:16:08.611507 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:08.618945 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb] added
May 28 10:16:08.618945 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:16:08.618945 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:16:08.618945 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:16:08.618945 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:16:08.618945 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:16:08.618945 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:08.618945 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:16:08.619151 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0232(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:16:08.619229 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:16:08.624666 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb] added
May 28 10:16:08.624666 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:16:08.624666 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:16:08.624666 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:16:08.624666 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:16:08.624666 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:16:08.624666 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:08.624813 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:16:08.625020 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0303(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:16:08.625143 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:16:08.748269 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:16:08.748656 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:16:09.251014 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:16:09.619973 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:16:09.625561 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:16:09.632674 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:16:09.632674 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:16:09.638991 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:16:09.638991 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:09.644759 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:09.650086 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:09.656626 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407 (non-flash)
May 28 10:16:09.656626 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:16:09.656730 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsi session list stdout=tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407 (non-flash)
May 28 10:16:09.656730 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:16:09.661752 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407 (non-flash)
May 28 10:16:09.661752 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:16:09.661860 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsi session list stdout=tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407 (non-flash)
May 28 10:16:09.661860 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:16:09.691452 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb, portal: 192.168.50.100,3260]
May 28 10:16:09.691452 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb, portal: 192.168.50.100,3260] successful.
May 28 10:16:09.691452 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:09.704098 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:09.710083 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb, portal: 192.168.40.100,3260]
May 28 10:16:09.710083 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb, portal: 192.168.40.100,3260] successful.
May 28 10:16:09.710083 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:09.717419 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407 (non-flash)
May 28 10:16:09.717419 np0000001613 nova-compute[98321]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb (non-flash)
May 28 10:16:09.717419 np0000001613 nova-compute[98321]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb (non-flash)
May 28 10:16:09.717419 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:16:09.717684 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsi session list stdout=tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407 (non-flash)
May 28 10:16:09.717684 np0000001613 nova-compute[98321]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb (non-flash)
May 28 10:16:09.717684 np0000001613 nova-compute[98321]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb (non-flash)
May 28 10:16:09.717684 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:16:09.717876 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.122s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:16:09.718014 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:16:09.718712 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] HCTL ('8', '-', '-', 0) found on session 217 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:16:09.718846 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:16:09.723618 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:09.733590 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Searching for a device in session 217 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:16:09.733590 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'befe7a60-6d3a-484d-8d41-820fb02e69cb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:16:09.737563 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407 (non-flash)
May 28 10:16:09.737563 np0000001613 nova-compute[98321]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb (non-flash)
May 28 10:16:09.737563 np0000001613 nova-compute[98321]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb (non-flash)
May 28 10:16:09.737563 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:16:09.737760 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsi session list stdout=tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407 (non-flash)
May 28 10:16:09.737760 np0000001613 nova-compute[98321]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb (non-flash)
May 28 10:16:09.737760 np0000001613 nova-compute[98321]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb (non-flash)
May 28 10:16:09.737760 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:16:09.737995 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.144s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:16:09.738092 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:16:09.738770 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] HCTL ('9', '-', '-', 0) found on session 218 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:16:09.738869 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:16:09.752401 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Searching for a device in session 218 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:16:09.752401 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'befe7a60-6d3a-484d-8d41-820fb02e69cb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:16:09.756597 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.163s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:16:09.758063 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.322s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:16:09.824292 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Deleted allocations for instance 93a38b6d-e199-4653-a617-290247c8e430
May 28 10:16:09.921858 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:16:09.922056 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:16:10.255402 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0003691819997584389 future=<Future at 0x73c1f4239be0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:16:10.255800 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] Emitting event <LifecycleEvent: 1779963355.2549329, 4ce32a9b-fc5a-4931-9880-dd7638009cc5 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:16:10.255933 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] VM Stopped (Lifecycle Event)
May 28 10:16:10.257024 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:16:10.257024 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=7.805123285000263 future=<Future at 0x73c1f423b1a0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:16:10.257024 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=7.8050170980000075 future=<Future at 0x73c1f423b1a0 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:16:10.346037 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:16:10.346306 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:16:10.346376 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=98321) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 10:16:10.346439 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98321) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 10:16:10.357333 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:10.357597 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98321) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 10:16:10.424477 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:16:10.595489 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:16:10.758115 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-bc5ddd66-6268-4698-961a-a6f19e9966b2 tempest-SnapshotDataIntegrityTests-331511523 tempest-SnapshotDataIntegrityTests-331511523-project-member] [instance: 4ce32a9b-fc5a-4931-9880-dd7638009cc5] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:16:10.836439 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4af0a8d8-54fe-4d56-91a4-5bb16c2502b6 tempest-TestVolumeBootPatternV346-204163382 tempest-TestVolumeBootPatternV346-204163382-project-member] Lock "93a38b6d-e199-4653-a617-290247c8e430" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.594s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:16:10.933351 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.175s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:16:10.992066 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Deleted allocations for instance 0327fb6e-6b30-4f70-8877-a3859969f5ca
May 28 10:16:11.594960 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:16:11.595468 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:16:11.595591 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 52.20 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:16:11.614100 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Found WWN 3300000000c096806 for multipath device dm-0 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:16:11.614490 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:16:11.615901 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] <== connect_volume: return (3788ms) {'type': 'block', 'scsi_wwn': '3300000000c096806', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '3300000000c096806'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:16:11.616074 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000c096806', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '3300000000c096806'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:16:11.650107 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb', 'iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'befe7a60-6d3a-484d-8d41-820fb02e69cb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': 'f5d8064e-6dbe-4e13-87ae-b4dd67e60797', 'attached_at': '', 'detached_at': '', 'volume_id': 'befe7a60-6d3a-484d-8d41-820fb02e69cb', 'serial': 'befe7a60-6d3a-484d-8d41-820fb02e69cb'} {{(pid=98321) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 10:16:11.650849 np0000001613 nova-compute[98321]: WARNING stevedore.named [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 10:16:11.651158 np0000001613 nova-compute[98321]: WARNING castellan.key_manager [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 10:16:11.651366 np0000001613 nova-compute[98321]: WARNING nova.keymgr.conf_key_mgr [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 10:16:11.666848 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 10:16:11.666848 np0000001613 nova-compute[98321]:   <usage type="volume">
May 28 10:16:11.666848 np0000001613 nova-compute[98321]:     <volume>befe7a60-6d3a-484d-8d41-820fb02e69cb</volume>
May 28 10:16:11.666848 np0000001613 nova-compute[98321]:   </usage>
May 28 10:16:11.666848 np0000001613 nova-compute[98321]: </secret>
May 28 10:16:11.666848 np0000001613 nova-compute[98321]:  {{(pid=98321) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 10:16:12.000606 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-692968c2-9b05-4ff4-a291-88b8c6932619 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Lock "0327fb6e-6b30-4f70-8877-a3859969f5ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:16:12.176977 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:15:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1321799985',display_name='tempest-TestEncryptedCinderVolumes-server-1321799985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testencryptedcindervolumes-server-1321799985',id=77,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpoRVALe7c4eQpRGN1VpZp9dYLl+jRMKefrPnTrudxsOQfg/5SdK2JJSsZS0Z3ILznoiWwVdnG5s+L6s6eVazdKobR/BLpkSVCCl0f5CnhsJ7UyqsnyUak+PFh9njYeag==',key_name='tempest-TestEncryptedCinderVolumes-1905729309',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a515533ba1c4e23a52f472549e5211f',ramdisk_id='',reservation_id='r-2mnrnkg7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-678033643',owner_user_name='tempest-TestEncryptedCinderVolumes-678033643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:16:05Z,user_data=None,user_id='cabed30cb95f4f7b9f96187fc336f7c4',uuid=f5d8064e-6dbe-4e13-87ae-b4dd67e60797,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c88f6a8c-e28c-42ba-8b7f-108be62aeaee", "address": "fa:16:3e:b4:5a:13", "network": {"id": "07ee30b7-dd9c-433d-81cc-42ab11aded18", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1881482359-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a515533ba1c4e23a52f472549e5211f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88f6a8c-e2", "ovs_interfaceid": "c88f6a8c-e28c-42ba-8b7f-108be62aeaee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:16:12.176977 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Converting VIF {"id": "c88f6a8c-e28c-42ba-8b7f-108be62aeaee", "address": "fa:16:3e:b4:5a:13", "network": {"id": "07ee30b7-dd9c-433d-81cc-42ab11aded18", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1881482359-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a515533ba1c4e23a52f472549e5211f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88f6a8c-e2", "ovs_interfaceid": "c88f6a8c-e28c-42ba-8b7f-108be62aeaee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:16:12.178247 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:5a:13,bridge_name='br-int',has_traffic_filtering=True,id=c88f6a8c-e28c-42ba-8b7f-108be62aeaee,network=Network(07ee30b7-dd9c-433d-81cc-42ab11aded18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc88f6a8c-e2') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:16:12.178796 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lazy-loading 'pci_devices' on Instance uuid f5d8064e-6dbe-4e13-87ae-b4dd67e60797 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:16:12.682040 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] End _get_guest_xml xml=<domain type="qemu">
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:   <uuid>f5d8064e-6dbe-4e13-87ae-b4dd67e60797</uuid>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:   <name>instance-0000004d</name>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1321799985</nova:name>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:16:07</nova:creationTime>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:       <nova:image uuid="">
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:         <nova:user uuid="cabed30cb95f4f7b9f96187fc336f7c4">tempest-TestEncryptedCinderVolumes-678033643-project-member</nova:user>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:         <nova:project uuid="2a515533ba1c4e23a52f472549e5211f">tempest-TestEncryptedCinderVolumes-678033643</nova:project>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:       <nova:root type="volume" uuid=""/>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:         <nova:port uuid="c88f6a8c-e28c-42ba-8b7f-108be62aeaee">
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:     <system>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:       <entry name="serial">f5d8064e-6dbe-4e13-87ae-b4dd67e60797</entry>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:       <entry name="uuid">f5d8064e-6dbe-4e13-87ae-b4dd67e60797</entry>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:     </system>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:   <os>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:   </os>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:   <features>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:   </features>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:   <devices>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/f5d8064e-6dbe-4e13-87ae-b4dd67e60797/disk.config"/>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:     </disk>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:       <alias name="ua-befe7a60-6d3a-484d-8d41-820fb02e69cb"/>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:       <serial>befe7a60-6d3a-484d-8d41-820fb02e69cb</serial>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:       <encryption format="luks">
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:         <secret type="passphrase" uuid="543ec2c2-76b9-48b4-bf57-fa9281728a21"/>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:       </encryption>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:     </disk>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:b4:5a:13"/>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:       <target dev="tapc88f6a8c-e2"/>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:     </interface>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/f5d8064e-6dbe-4e13-87ae-b4dd67e60797/console.log" append="off"/>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:     </serial>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:     <video>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:     </video>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:     </rng>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:   </devices>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]: </domain>
May 28 10:16:12.682040 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:16:12.685118 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Preparing to wait for external event network-vif-plugged-c88f6a8c-e28c-42ba-8b7f-108be62aeaee {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:16:12.685118 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquiring lock "f5d8064e-6dbe-4e13-87ae-b4dd67e60797-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:16:12.685118 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "f5d8064e-6dbe-4e13-87ae-b4dd67e60797-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:16:12.685118 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "f5d8064e-6dbe-4e13-87ae-b4dd67e60797-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:16:12.685118 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:15:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1321799985',display_name='tempest-TestEncryptedCinderVolumes-server-1321799985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testencryptedcindervolumes-server-1321799985',id=77,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpoRVALe7c4eQpRGN1VpZp9dYLl+jRMKefrPnTrudxsOQfg/5SdK2JJSsZS0Z3ILznoiWwVdnG5s+L6s6eVazdKobR/BLpkSVCCl0f5CnhsJ7UyqsnyUak+PFh9njYeag==',key_name='tempest-TestEncryptedCinderVolumes-1905729309',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a515533ba1c4e23a52f472549e5211f',ramdisk_id='',reservation_id='r-2mnrnkg7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-678033643',owner_user_name='tempest-TestEncryptedCinderVolumes-678033643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:16:05Z,user_data=None,user_id='cabed30cb95f4f7b9f96187fc336f7c4',uuid=f5d8064e-6dbe-4e13-87ae-b4dd67e60797,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c88f6a8c-e28c-42ba-8b7f-108be62aeaee", "address": "fa:16:3e:b4:5a:13", "network": {"id": "07ee30b7-dd9c-433d-81cc-42ab11aded18", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1881482359-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a515533ba1c4e23a52f472549e5211f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88f6a8c-e2", "ovs_interfaceid": "c88f6a8c-e28c-42ba-8b7f-108be62aeaee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:16:12.685118 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Converting VIF {"id": "c88f6a8c-e28c-42ba-8b7f-108be62aeaee", "address": "fa:16:3e:b4:5a:13", "network": {"id": "07ee30b7-dd9c-433d-81cc-42ab11aded18", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1881482359-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a515533ba1c4e23a52f472549e5211f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88f6a8c-e2", "ovs_interfaceid": "c88f6a8c-e28c-42ba-8b7f-108be62aeaee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:16:12.685118 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:5a:13,bridge_name='br-int',has_traffic_filtering=True,id=c88f6a8c-e28c-42ba-8b7f-108be62aeaee,network=Network(07ee30b7-dd9c-433d-81cc-42ab11aded18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc88f6a8c-e2') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:16:12.685118 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:5a:13,bridge_name='br-int',has_traffic_filtering=True,id=c88f6a8c-e28c-42ba-8b7f-108be62aeaee,network=Network(07ee30b7-dd9c-433d-81cc-42ab11aded18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc88f6a8c-e2') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:16:12.685118 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:12.685118 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:16:12.685724 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:16:12.685941 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:12.686072 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6fed41a8-c6f3-56a1-a674-1d90254d3549', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:16:12.686759 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:12.687515 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:16:12.688229 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:12.690254 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:12.690432 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc88f6a8c-e2, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:16:12.690789 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc88f6a8c-e2, col_values=(('qos', UUID('3e3c8577-f967-4ab0-b03b-247a4b4749d6')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:16:12.691008 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc88f6a8c-e2, col_values=(('external_ids', {'iface-id': 'c88f6a8c-e28c-42ba-8b7f-108be62aeaee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:5a:13', 'vm-uuid': 'f5d8064e-6dbe-4e13-87ae-b4dd67e60797'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:16:12.691790 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:12.693247 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:16:12.698059 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:12.699392 np0000001613 nova-compute[98321]: INFO os_vif [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:5a:13,bridge_name='br-int',has_traffic_filtering=True,id=c88f6a8c-e28c-42ba-8b7f-108be62aeaee,network=Network(07ee30b7-dd9c-433d-81cc-42ab11aded18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc88f6a8c-e2')
May 28 10:16:13.595361 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:14.223822 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:16:14.224116 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:16:14.224287 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] No VIF found with MAC fa:16:3e:b4:5a:13, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:16:14.224808 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Using config drive
May 28 10:16:14.730393 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:16:14.926311 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Creating config drive at /opt/stack/data/nova/instances/f5d8064e-6dbe-4e13-87ae-b4dd67e60797/disk.config
May 28 10:16:14.930430 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f5d8064e-6dbe-4e13-87ae-b4dd67e60797/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpz2914zrg {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:16:14.987837 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f5d8064e-6dbe-4e13-87ae-b4dd67e60797/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpz2914zrg" returned: 0 in 0.057s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:16:15.386144 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:15.415332 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:15.439252 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:15.536391 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:15.542278 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:15.621449 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:15.723814 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ebc5f597-fe58-4b89-bf74-a3bd7d40d17d req-42929093-517d-4c94-ba69-1b477e8965f6 service nova] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Received event network-vif-plugged-c88f6a8c-e28c-42ba-8b7f-108be62aeaee {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:16:15.723814 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ebc5f597-fe58-4b89-bf74-a3bd7d40d17d req-42929093-517d-4c94-ba69-1b477e8965f6 service nova] Acquiring lock "f5d8064e-6dbe-4e13-87ae-b4dd67e60797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:16:15.723814 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ebc5f597-fe58-4b89-bf74-a3bd7d40d17d req-42929093-517d-4c94-ba69-1b477e8965f6 service nova] Lock "f5d8064e-6dbe-4e13-87ae-b4dd67e60797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:16:15.723814 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-ebc5f597-fe58-4b89-bf74-a3bd7d40d17d req-42929093-517d-4c94-ba69-1b477e8965f6 service nova] Lock "f5d8064e-6dbe-4e13-87ae-b4dd67e60797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:16:15.723814 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ebc5f597-fe58-4b89-bf74-a3bd7d40d17d req-42929093-517d-4c94-ba69-1b477e8965f6 service nova] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Processing event network-vif-plugged-c88f6a8c-e28c-42ba-8b7f-108be62aeaee {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:16:15.763788 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:15.767035 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:15.769547 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:15.771643 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:15.790339 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:17.199678 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963377.1991315, f5d8064e-6dbe-4e13-87ae-b4dd67e60797 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:16:17.200047 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] VM Started (Lifecycle Event)
May 28 10:16:17.201352 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:16:17.204482 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:16:17.207792 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Instance spawned successfully.
May 28 10:16:17.208371 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:16:17.692959 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:17.702701 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:16:17.706744 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:16:17.720420 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:16:17.724184 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:16:17.724184 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:16:17.724184 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:16:17.724184 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:16:17.724184 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:16:17.789615 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5ac59e2c-eb3e-4134-b810-bdc10b4bb2c5 req-3593c667-6ad5-4e15-849a-f195e9ec889a service nova] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Received event network-vif-plugged-c88f6a8c-e28c-42ba-8b7f-108be62aeaee {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:16:17.791290 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5ac59e2c-eb3e-4134-b810-bdc10b4bb2c5 req-3593c667-6ad5-4e15-849a-f195e9ec889a service nova] Acquiring lock "f5d8064e-6dbe-4e13-87ae-b4dd67e60797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:16:17.791930 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5ac59e2c-eb3e-4134-b810-bdc10b4bb2c5 req-3593c667-6ad5-4e15-849a-f195e9ec889a service nova] Lock "f5d8064e-6dbe-4e13-87ae-b4dd67e60797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:16:17.791930 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5ac59e2c-eb3e-4134-b810-bdc10b4bb2c5 req-3593c667-6ad5-4e15-849a-f195e9ec889a service nova] Lock "f5d8064e-6dbe-4e13-87ae-b4dd67e60797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:16:17.792146 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5ac59e2c-eb3e-4134-b810-bdc10b4bb2c5 req-3593c667-6ad5-4e15-849a-f195e9ec889a service nova] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] No waiting events found dispatching network-vif-plugged-c88f6a8c-e28c-42ba-8b7f-108be62aeaee {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:16:17.792308 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-5ac59e2c-eb3e-4134-b810-bdc10b4bb2c5 req-3593c667-6ad5-4e15-849a-f195e9ec889a service nova] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Received unexpected event network-vif-plugged-c88f6a8c-e28c-42ba-8b7f-108be62aeaee for instance with vm_state building and task_state spawning.
May 28 10:16:17.946710 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:18.062743 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0006650629998148361 future=<Future at 0x73c1f423b1a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:16:18.064212 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] Emitting event <LifecycleEvent: 1779963363.0619829, 93a38b6d-e199-4653-a617-290247c8e430 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:16:18.066175 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:16:18.066311 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=1.761763813000016 future=<Future at 0x73c1f41ba330 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:16:18.066414 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=1.7616434189999381 future=<Future at 0x73c1f41ba330 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:16:18.066755 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] VM Stopped (Lifecycle Event)
May 28 10:16:18.208799 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:16:18.209154 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963378.2089067, f5d8064e-6dbe-4e13-87ae-b4dd67e60797 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:16:18.209154 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] VM Paused (Lifecycle Event)
May 28 10:16:18.229094 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Took 10.42 seconds to spawn the instance on the hypervisor.
May 28 10:16:18.229342 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:16:18.569744 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-8d390984-9817-4f90-903b-34d47dfd50df tempest-VolumesSnapshotTestJSON-4375881 tempest-VolumesSnapshotTestJSON-4375881-project-member] [instance: 93a38b6d-e199-4653-a617-290247c8e430] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:16:18.711476 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:16:18.720044 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963378.7197537, f5d8064e-6dbe-4e13-87ae-b4dd67e60797 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:16:18.720129 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] VM Resumed (Lifecycle Event)
May 28 10:16:18.746074 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Took 17.39 seconds to build instance.
May 28 10:16:19.223189 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:16:19.228732 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:16:19.247604 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "f5d8064e-6dbe-4e13-87ae-b4dd67e60797" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.895s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:16:19.828592 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0004007849997833546 future=<Future at 0x73c1f41ba330 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:16:19.828739 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:16:19.830107 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] Emitting event <LifecycleEvent: 1779963364.8280056, 0327fb6e-6b30-4f70-8877-a3859969f5ca => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:16:19.830107 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] VM Stopped (Lifecycle Event)
May 28 10:16:20.111222 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:20.132068 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-9a8a5612-89b8-438f-8a93-e4acd1f13f73 req-828eb63e-467d-40af-a28b-756854294a50 service nova] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Received event network-changed-c88f6a8c-e28c-42ba-8b7f-108be62aeaee {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:16:20.132233 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-9a8a5612-89b8-438f-8a93-e4acd1f13f73 req-828eb63e-467d-40af-a28b-756854294a50 service nova] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Refreshing instance network info cache due to event network-changed-c88f6a8c-e28c-42ba-8b7f-108be62aeaee. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:16:20.132375 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9a8a5612-89b8-438f-8a93-e4acd1f13f73 req-828eb63e-467d-40af-a28b-756854294a50 service nova] Acquiring lock "refresh_cache-f5d8064e-6dbe-4e13-87ae-b4dd67e60797" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:16:20.132450 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9a8a5612-89b8-438f-8a93-e4acd1f13f73 req-828eb63e-467d-40af-a28b-756854294a50 service nova] Acquired lock "refresh_cache-f5d8064e-6dbe-4e13-87ae-b4dd67e60797" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:16:20.132615 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-9a8a5612-89b8-438f-8a93-e4acd1f13f73 req-828eb63e-467d-40af-a28b-756854294a50 service nova] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Refreshing network info cache for port c88f6a8c-e28c-42ba-8b7f-108be62aeaee {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:16:20.332135 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-05170c80-c38e-4770-a503-941708eed955 tempest-TestVolumeBootPattern-327944304 tempest-TestVolumeBootPattern-327944304-project-member] [instance: 0327fb6e-6b30-4f70-8877-a3859969f5ca] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:16:20.636356 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-9a8a5612-89b8-438f-8a93-e4acd1f13f73 req-828eb63e-467d-40af-a28b-756854294a50 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:16:20.969517 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-9a8a5612-89b8-438f-8a93-e4acd1f13f73 req-828eb63e-467d-40af-a28b-756854294a50 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:16:21.121596 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-9a8a5612-89b8-438f-8a93-e4acd1f13f73 req-828eb63e-467d-40af-a28b-756854294a50 service nova] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Updated VIF entry in instance network info cache for port c88f6a8c-e28c-42ba-8b7f-108be62aeaee. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:16:21.121948 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-9a8a5612-89b8-438f-8a93-e4acd1f13f73 req-828eb63e-467d-40af-a28b-756854294a50 service nova] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Updating instance_info_cache with network_info: [{"id": "c88f6a8c-e28c-42ba-8b7f-108be62aeaee", "address": "fa:16:3e:b4:5a:13", "network": {"id": "07ee30b7-dd9c-433d-81cc-42ab11aded18", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1881482359-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a515533ba1c4e23a52f472549e5211f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88f6a8c-e2", "ovs_interfaceid": "c88f6a8c-e28c-42ba-8b7f-108be62aeaee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:16:21.623948 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9a8a5612-89b8-438f-8a93-e4acd1f13f73 req-828eb63e-467d-40af-a28b-756854294a50 service nova] Releasing lock "refresh_cache-f5d8064e-6dbe-4e13-87ae-b4dd67e60797" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:16:22.693818 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:25.124665 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:25.370777 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Acquiring lock "476c3a01-2dd3-46b3-acae-8e0c236760ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:16:25.371174 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Lock "476c3a01-2dd3-46b3-acae-8e0c236760ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:16:25.872760 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:16:26.418246 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:16:26.418578 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:16:26.422480 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:16:26.422722 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Claim successful on node np0000001613
May 28 10:16:27.550534 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:16:27.550859 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:16:27.707531 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:28.054286 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:16:28.561131 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.142s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:16:28.561758 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:16:29.068243 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:16:29.071401 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:16:29.071401 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:16:29.071687 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:16:29.146367 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '20eea0a089ca4b6e9680a7c301682b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005a061f46764b61909c64d38b242678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:16:29.571746 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:16:29.582179 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Successfully created port: 48aaa82e-10ec-4f32-b923-0e02bd572150 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:16:30.025413 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Successfully updated port: 48aaa82e-10ec-4f32-b923-0e02bd572150 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:16:30.077855 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c9808d50-b859-4cef-8b36-1a4bedf9fcc1 req-b7954462-edcc-4d5e-b5bc-5e55c8f38cb4 service nova] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Received event network-changed-48aaa82e-10ec-4f32-b923-0e02bd572150 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:16:30.078284 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-c9808d50-b859-4cef-8b36-1a4bedf9fcc1 req-b7954462-edcc-4d5e-b5bc-5e55c8f38cb4 service nova] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Refreshing instance network info cache due to event network-changed-48aaa82e-10ec-4f32-b923-0e02bd572150. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:16:30.078505 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c9808d50-b859-4cef-8b36-1a4bedf9fcc1 req-b7954462-edcc-4d5e-b5bc-5e55c8f38cb4 service nova] Acquiring lock "refresh_cache-476c3a01-2dd3-46b3-acae-8e0c236760ee" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:16:30.078653 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c9808d50-b859-4cef-8b36-1a4bedf9fcc1 req-b7954462-edcc-4d5e-b5bc-5e55c8f38cb4 service nova] Acquired lock "refresh_cache-476c3a01-2dd3-46b3-acae-8e0c236760ee" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:16:30.078817 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-c9808d50-b859-4cef-8b36-1a4bedf9fcc1 req-b7954462-edcc-4d5e-b5bc-5e55c8f38cb4 service nova] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Refreshing network info cache for port 48aaa82e-10ec-4f32-b923-0e02bd572150 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:16:30.144063 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:30.527430 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Acquiring lock "refresh_cache-476c3a01-2dd3-46b3-acae-8e0c236760ee" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:16:30.580281 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:16:30.586187 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-c9808d50-b859-4cef-8b36-1a4bedf9fcc1 req-b7954462-edcc-4d5e-b5bc-5e55c8f38cb4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:16:30.637181 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-c9808d50-b859-4cef-8b36-1a4bedf9fcc1 req-b7954462-edcc-4d5e-b5bc-5e55c8f38cb4 service nova] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:16:30.760128 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-c9808d50-b859-4cef-8b36-1a4bedf9fcc1 req-b7954462-edcc-4d5e-b5bc-5e55c8f38cb4 service nova] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:16:31.084061 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Booting with volume 40d5c210-113b-4a2b-a7c9-df205fe3c407 at /dev/vdb
May 28 10:16:31.117212 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:16:31.127455 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:16:31.148701 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:16:31.196183 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:16:31.196451 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:16:31.205982 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:16:31.206909 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:feb4:5a13', 'fe80::428:aaff:fee4:e565'] 
May 28 10:16:31.207058 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:16:31.207222 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:16:31.207501 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] <== get_connector_properties: return (89ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:16:31.207729 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Updating existing volume attachment record: a594f25b-72e3-4449-a512-2c201ba5d553 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:16:31.262565 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-c9808d50-b859-4cef-8b36-1a4bedf9fcc1 req-b7954462-edcc-4d5e-b5bc-5e55c8f38cb4 service nova] Releasing lock "refresh_cache-476c3a01-2dd3-46b3-acae-8e0c236760ee" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:16:31.262769 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Acquired lock "refresh_cache-476c3a01-2dd3-46b3-acae-8e0c236760ee" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:16:31.262938 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:16:31.829053 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:16:31.981450 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:16:32.108650 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Updating instance_info_cache with network_info: [{"id": "48aaa82e-10ec-4f32-b923-0e02bd572150", "address": "fa:16:3e:f3:07:a9", "network": {"id": "1215fcb1-9aad-46d4-92f9-d86a7f6a50ea", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1510342586-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "005a061f46764b61909c64d38b242678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48aaa82e-10", "ovs_interfaceid": "48aaa82e-10ec-4f32-b923-0e02bd572150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:16:32.610336 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Releasing lock "refresh_cache-476c3a01-2dd3-46b3-acae-8e0c236760ee" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:16:32.610609 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Instance network_info: |[{"id": "48aaa82e-10ec-4f32-b923-0e02bd572150", "address": "fa:16:3e:f3:07:a9", "network": {"id": "1215fcb1-9aad-46d4-92f9-d86a7f6a50ea", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1510342586-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "005a061f46764b61909c64d38b242678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48aaa82e-10", "ovs_interfaceid": "48aaa82e-10ec-4f32-b923-0e02bd572150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:16:32.716548 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:33.316299 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:16:33.317305 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:16:33.317516 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Creating image(s)
May 28 10:16:33.317961 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Acquiring lock "/opt/stack/data/nova/instances/476c3a01-2dd3-46b3-acae-8e0c236760ee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:16:33.318111 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Lock "/opt/stack/data/nova/instances/476c3a01-2dd3-46b3-acae-8e0c236760ee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:16:33.318616 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Lock "/opt/stack/data/nova/instances/476c3a01-2dd3-46b3-acae-8e0c236760ee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:16:33.319188 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:16:33.321632 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:16:33.322669 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:16:33.410179 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.087s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:16:33.410666 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:16:33.411307 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:16:33.411719 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:16:33.414468 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:16:33.414785 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:16:33.520206 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.105s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:16:33.520703 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/476c3a01-2dd3-46b3-acae-8e0c236760ee/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:16:33.574995 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/476c3a01-2dd3-46b3-acae-8e0c236760ee/disk 1073741824" returned: 0 in 0.054s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:16:33.575338 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.164s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:16:33.575880 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:16:33.674972 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.099s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:16:33.675441 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Checking if we can resize image /opt/stack/data/nova/instances/476c3a01-2dd3-46b3-acae-8e0c236760ee/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:16:33.675727 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476c3a01-2dd3-46b3-acae-8e0c236760ee/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:16:33.763886 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476c3a01-2dd3-46b3-acae-8e0c236760ee/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:16:33.764314 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Cannot resize image /opt/stack/data/nova/instances/476c3a01-2dd3-46b3-acae-8e0c236760ee/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:16:33.765052 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:16:33.765281 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Ensure instance console log exists: /opt/stack/data/nova/instances/476c3a01-2dd3-46b3-acae-8e0c236760ee/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:16:33.765743 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:16:33.765977 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:16:33.766113 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:16:33.768352 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Start _get_guest_xml network_info=[{"id": "48aaa82e-10ec-4f32-b923-0e02bd572150", "address": "fa:16:3e:f3:07:a9", "network": {"id": "1215fcb1-9aad-46d4-92f9-d86a7f6a50ea", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1510342586-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "005a061f46764b61909c64d38b242678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48aaa82e-10", "ovs_interfaceid": "48aaa82e-10ec-4f32-b923-0e02bd572150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407', 'iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '40d5c210-113b-4a2b-a7c9-df205fe3c407', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '476c3a01-2dd3-46b3-acae-8e0c236760ee', 'attached_at': '', 'detached_at': '', 'volume_id': '40d5c210-113b-4a2b-a7c9-df205fe3c407', 'serial': '40d5c210-113b-4a2b-a7c9-df205fe3c407'}, 'boot_index': -1, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': 'a594f25b-72e3-4449-a512-2c201ba5d553', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:16:33.774211 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:16:33.775689 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-instance-1931568946', uuid='476c3a01-2dd3-46b3-acae-8e0c236760ee'), owner=OwnerMeta(userid='20eea0a089ca4b6e9680a7c301682b02', username='tempest-VolumesBackupsTest-128677527-project-member', projectid='005a061f46764b61909c64d38b242678', projectname='tempest-VolumesBackupsTest-128677527'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "48aaa82e-10ec-4f32-b923-0e02bd572150", "address": "fa:16:3e:f3:07:a9", "network": {"id": "1215fcb1-9aad-46d4-92f9-d86a7f6a50ea", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1510342586-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "005a061f46764b61909c64d38b242678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48aaa82e-10", "ovs_interfaceid": "48aaa82e-10ec-4f32-b923-0e02bd572150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779963393.7752953) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:16:33.777357 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:16:33.777693 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:16:33.778801 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:16:33.779030 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:16:33.780252 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:16:33.780576 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:16:33.780732 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:16:33.780828 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:16:33.780941 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:16:33.781041 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:16:33.781128 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:16:33.781305 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:16:33.781394 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:16:33.781505 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:16:33.781594 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:16:33.781742 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:16:33.793108 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:16:33.793509 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407', 'iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '40d5c210-113b-4a2b-a7c9-df205fe3c407', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:16:33.793819 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:16:33.794285 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:16:33.794524 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407', 'iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '40d5c210-113b-4a2b-a7c9-df205fe3c407', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:16:33.806216 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:16:33.806987 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:16:33.807329 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:16:33.809004 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:16:33.809193 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:16:33.809511 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:16:33.820746 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:16:33.820746 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:33.825815 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:16:33.825815 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:33.832694 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407] added
May 28 10:16:33.832694 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:16:33.832694 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:16:33.832694 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:16:33.832694 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:16:33.832694 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:16:33.832694 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:33.832927 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:16:33.833127 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0239(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:16:33.833325 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:16:33.839217 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407] added
May 28 10:16:33.839217 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:16:33.839217 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:16:33.839217 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:16:33.839217 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:16:33.839217 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:16:33.839217 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:33.839217 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:16:33.839398 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0303(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:16:33.839398 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:16:34.833794 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:16:34.839700 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:16:34.845567 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:16:34.845567 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:16:34.855742 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:16:34.855742 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:34.862016 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:34.870022 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:34.876623 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb (non-flash)
May 28 10:16:34.876623 np0000001613 nova-compute[98321]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb (non-flash)
May 28 10:16:34.876623 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:16:34.876940 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] iscsi session list stdout=tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb (non-flash)
May 28 10:16:34.876940 np0000001613 nova-compute[98321]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb (non-flash)
May 28 10:16:34.876940 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:16:34.882495 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb (non-flash)
May 28 10:16:34.882495 np0000001613 nova-compute[98321]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb (non-flash)
May 28 10:16:34.882495 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:16:34.882627 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] iscsi session list stdout=tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb (non-flash)
May 28 10:16:34.882627 np0000001613 nova-compute[98321]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb (non-flash)
May 28 10:16:34.882627 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:16:34.904420 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407, portal: 192.168.50.100,3260]
May 28 10:16:34.904420 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407, portal: 192.168.50.100,3260] successful.
May 28 10:16:34.904420 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:34.915049 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:34.920782 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407, portal: 192.168.40.100,3260]
May 28 10:16:34.920782 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407, portal: 192.168.40.100,3260] successful.
May 28 10:16:34.920782 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:34.928281 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb (non-flash)
May 28 10:16:34.928281 np0000001613 nova-compute[98321]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb (non-flash)
May 28 10:16:34.928281 np0000001613 nova-compute[98321]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407 (non-flash)
May 28 10:16:34.928281 np0000001613 nova-compute[98321]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407 (non-flash)
May 28 10:16:34.928281 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:16:34.928477 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] iscsi session list stdout=tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb (non-flash)
May 28 10:16:34.928477 np0000001613 nova-compute[98321]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb (non-flash)
May 28 10:16:34.928477 np0000001613 nova-compute[98321]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407 (non-flash)
May 28 10:16:34.928477 np0000001613 nova-compute[98321]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407 (non-flash)
May 28 10:16:34.928477 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:16:34.928624 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.121s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:16:34.928710 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:16:34.929357 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] HCTL ('7', '-', '-', 0) found on session 219 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:16:34.929457 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:16:34.934382 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:34.944968 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Searching for a device in session 219 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:16:34.944968 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '40d5c210-113b-4a2b-a7c9-df205fe3c407', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:16:34.947896 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb (non-flash)
May 28 10:16:34.947896 np0000001613 nova-compute[98321]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb (non-flash)
May 28 10:16:34.947896 np0000001613 nova-compute[98321]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407 (non-flash)
May 28 10:16:34.947896 np0000001613 nova-compute[98321]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407 (non-flash)
May 28 10:16:34.947896 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:16:34.948039 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] iscsi session list stdout=tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb (non-flash)
May 28 10:16:34.948039 np0000001613 nova-compute[98321]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb (non-flash)
May 28 10:16:34.948039 np0000001613 nova-compute[98321]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407 (non-flash)
May 28 10:16:34.948039 np0000001613 nova-compute[98321]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407 (non-flash)
May 28 10:16:34.948039 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:16:34.948263 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.141s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:16:34.948356 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:16:34.949198 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] HCTL ('10', '-', '-', 0) found on session 220 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:16:34.949198 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:16:34.963036 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Searching for a device in session 220 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:16:34.963036 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '40d5c210-113b-4a2b-a7c9-df205fe3c407', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:16:35.156255 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:35.807703 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:16:36.822858 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Found WWN 3300000001c17c406 for multipath device dm-1 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:16:36.823241 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:16:36.823241 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] <== connect_volume: return (3029ms) {'type': 'block', 'scsi_wwn': '3300000001c17c406', 'path': '/dev/dm-1', 'multipath_id': '3300000001c17c406'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:16:36.823322 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001c17c406', 'path': '/dev/dm-1', 'multipath_id': '3300000001c17c406'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:16:37.328423 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:16:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-instance-1931568946',display_name='tempest-instance-1931568946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-instance-1931568946',id=78,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmriiIsSNGjFeJO0g5I6rv1nKPgYb6C8FP6y6VW5OuZVW+3VniXZKTyvU9tyP9+m36GiJXUX86eNbwcM2NaT4uYREfXCInTEL0dhhrY2YLvAXEI6DTjSRzyv2EA1G9WWQ==',key_name='tempest-keypair-1572210996',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='005a061f46764b61909c64d38b242678',ramdisk_id='',reservation_id='r-he9504wl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-128677527',owner_user_name='tempest-VolumesBackupsTest-128677527-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:16:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='20eea0a089ca4b6e9680a7c301682b02',uuid=476c3a01-2dd3-46b3-acae-8e0c236760ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48aaa82e-10ec-4f32-b923-0e02bd572150", "address": "fa:16:3e:f3:07:a9", "network": {"id": "1215fcb1-9aad-46d4-92f9-d86a7f6a50ea", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1510342586-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "005a061f46764b61909c64d38b242678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48aaa82e-10", "ovs_interfaceid": "48aaa82e-10ec-4f32-b923-0e02bd572150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:16:37.328570 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Converting VIF {"id": "48aaa82e-10ec-4f32-b923-0e02bd572150", "address": "fa:16:3e:f3:07:a9", "network": {"id": "1215fcb1-9aad-46d4-92f9-d86a7f6a50ea", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1510342586-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "005a061f46764b61909c64d38b242678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48aaa82e-10", "ovs_interfaceid": "48aaa82e-10ec-4f32-b923-0e02bd572150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:16:37.329146 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:07:a9,bridge_name='br-int',has_traffic_filtering=True,id=48aaa82e-10ec-4f32-b923-0e02bd572150,network=Network(1215fcb1-9aad-46d4-92f9-d86a7f6a50ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48aaa82e-10') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:16:37.329665 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Lazy-loading 'pci_devices' on Instance uuid 476c3a01-2dd3-46b3-acae-8e0c236760ee {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:16:37.735555 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:37.832340 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] End _get_guest_xml xml=<domain type="qemu">
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:   <uuid>476c3a01-2dd3-46b3-acae-8e0c236760ee</uuid>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:   <name>instance-0000004e</name>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:       <nova:name>tempest-instance-1931568946</nova:name>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:16:33</nova:creationTime>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:         <nova:user uuid="20eea0a089ca4b6e9680a7c301682b02">tempest-VolumesBackupsTest-128677527-project-member</nova:user>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:         <nova:project uuid="005a061f46764b61909c64d38b242678">tempest-VolumesBackupsTest-128677527</nova:project>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:         <nova:port uuid="48aaa82e-10ec-4f32-b923-0e02bd572150">
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:     <system>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:       <entry name="serial">476c3a01-2dd3-46b3-acae-8e0c236760ee</entry>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:       <entry name="uuid">476c3a01-2dd3-46b3-acae-8e0c236760ee</entry>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:     </system>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:   <os>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:   </os>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:   <features>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:   </features>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:   <devices>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/476c3a01-2dd3-46b3-acae-8e0c236760ee/disk"/>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:     </disk>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/476c3a01-2dd3-46b3-acae-8e0c236760ee/disk.config"/>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:     </disk>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:       <alias name="ua-40d5c210-113b-4a2b-a7c9-df205fe3c407"/>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:       <source dev="/dev/dm-1"/>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:       <target dev="vdb" bus="virtio"/>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:       <serial>40d5c210-113b-4a2b-a7c9-df205fe3c407</serial>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:     </disk>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:f3:07:a9"/>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:       <target dev="tap48aaa82e-10"/>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:     </interface>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/476c3a01-2dd3-46b3-acae-8e0c236760ee/console.log" append="off"/>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:     </serial>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:     <video>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:     </video>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:     </rng>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:   </devices>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]: </domain>
May 28 10:16:37.832340 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:16:37.835897 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Preparing to wait for external event network-vif-plugged-48aaa82e-10ec-4f32-b923-0e02bd572150 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:16:37.835897 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Acquiring lock "476c3a01-2dd3-46b3-acae-8e0c236760ee-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:16:37.835897 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Lock "476c3a01-2dd3-46b3-acae-8e0c236760ee-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:16:37.835897 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Lock "476c3a01-2dd3-46b3-acae-8e0c236760ee-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:16:37.835897 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:16:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-instance-1931568946',display_name='tempest-instance-1931568946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-instance-1931568946',id=78,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmriiIsSNGjFeJO0g5I6rv1nKPgYb6C8FP6y6VW5OuZVW+3VniXZKTyvU9tyP9+m36GiJXUX86eNbwcM2NaT4uYREfXCInTEL0dhhrY2YLvAXEI6DTjSRzyv2EA1G9WWQ==',key_name='tempest-keypair-1572210996',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='005a061f46764b61909c64d38b242678',ramdisk_id='',reservation_id='r-he9504wl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-128677527',owner_user_name='tempest-VolumesBackupsTest-128677527-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:16:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='20eea0a089ca4b6e9680a7c301682b02',uuid=476c3a01-2dd3-46b3-acae-8e0c236760ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48aaa82e-10ec-4f32-b923-0e02bd572150", "address": "fa:16:3e:f3:07:a9", "network": {"id": "1215fcb1-9aad-46d4-92f9-d86a7f6a50ea", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1510342586-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "005a061f46764b61909c64d38b242678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48aaa82e-10", "ovs_interfaceid": "48aaa82e-10ec-4f32-b923-0e02bd572150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:16:37.835897 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Converting VIF {"id": "48aaa82e-10ec-4f32-b923-0e02bd572150", "address": "fa:16:3e:f3:07:a9", "network": {"id": "1215fcb1-9aad-46d4-92f9-d86a7f6a50ea", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1510342586-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "005a061f46764b61909c64d38b242678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48aaa82e-10", "ovs_interfaceid": "48aaa82e-10ec-4f32-b923-0e02bd572150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:16:37.835897 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:07:a9,bridge_name='br-int',has_traffic_filtering=True,id=48aaa82e-10ec-4f32-b923-0e02bd572150,network=Network(1215fcb1-9aad-46d4-92f9-d86a7f6a50ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48aaa82e-10') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:16:37.835897 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:07:a9,bridge_name='br-int',has_traffic_filtering=True,id=48aaa82e-10ec-4f32-b923-0e02bd572150,network=Network(1215fcb1-9aad-46d4-92f9-d86a7f6a50ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48aaa82e-10') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:16:37.835897 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:37.836244 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:16:37.836244 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:16:37.836888 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:37.837044 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '65f6e297-0479-5926-b128-b096bea7a7d1', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:16:37.837752 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:37.838388 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:16:37.838531 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:37.840363 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:37.840486 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48aaa82e-10, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:16:37.840765 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap48aaa82e-10, col_values=(('qos', UUID('dde0c30f-16de-4ed1-8522-83d60ea1abc3')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:16:37.840940 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap48aaa82e-10, col_values=(('external_ids', {'iface-id': '48aaa82e-10ec-4f32-b923-0e02bd572150', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:07:a9', 'vm-uuid': '476c3a01-2dd3-46b3-acae-8e0c236760ee'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:16:37.841479 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:37.842831 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:16:37.846890 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:37.847748 np0000001613 nova-compute[98321]: INFO os_vif [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:07:a9,bridge_name='br-int',has_traffic_filtering=True,id=48aaa82e-10ec-4f32-b923-0e02bd572150,network=Network(1215fcb1-9aad-46d4-92f9-d86a7f6a50ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48aaa82e-10')
May 28 10:16:39.362260 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:16:39.362260 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:16:39.362260 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:16:39.362260 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] No VIF found with MAC fa:16:3e:f3:07:a9, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:16:39.362717 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Using config drive
May 28 10:16:39.867915 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:16:39.975478 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Creating config drive at /opt/stack/data/nova/instances/476c3a01-2dd3-46b3-acae-8e0c236760ee/disk.config
May 28 10:16:39.979440 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/476c3a01-2dd3-46b3-acae-8e0c236760ee/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppvu1x0je {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:16:40.033096 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/476c3a01-2dd3-46b3-acae-8e0c236760ee/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppvu1x0je" returned: 0 in 0.053s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:16:40.163943 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:40.416917 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:40.440013 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:40.443926 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:40.532772 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:40.602191 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6a83e751-9a5f-4073-a625-95974df1b0fb req-b41ddc7c-7973-44de-976d-9eea3922e2ad service nova] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Received event network-vif-plugged-48aaa82e-10ec-4f32-b923-0e02bd572150 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:16:40.602438 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6a83e751-9a5f-4073-a625-95974df1b0fb req-b41ddc7c-7973-44de-976d-9eea3922e2ad service nova] Acquiring lock "476c3a01-2dd3-46b3-acae-8e0c236760ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:16:40.602671 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6a83e751-9a5f-4073-a625-95974df1b0fb req-b41ddc7c-7973-44de-976d-9eea3922e2ad service nova] Lock "476c3a01-2dd3-46b3-acae-8e0c236760ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:16:40.606076 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6a83e751-9a5f-4073-a625-95974df1b0fb req-b41ddc7c-7973-44de-976d-9eea3922e2ad service nova] Lock "476c3a01-2dd3-46b3-acae-8e0c236760ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:16:40.606275 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6a83e751-9a5f-4073-a625-95974df1b0fb req-b41ddc7c-7973-44de-976d-9eea3922e2ad service nova] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Processing event network-vif-plugged-48aaa82e-10ec-4f32-b923-0e02bd572150 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:16:40.868449 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:40.870908 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:40.874184 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:40.890839 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:41.138638 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963401.138203, 476c3a01-2dd3-46b3-acae-8e0c236760ee => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:16:41.139138 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:16:41.139340 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] VM Started (Lifecycle Event)
May 28 10:16:41.143974 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:16:41.147606 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Instance spawned successfully.
May 28 10:16:41.147606 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:16:41.642794 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:16:41.644819 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:16:41.660143 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:16:41.660272 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:16:41.660612 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:16:41.660825 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:16:41.661079 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:16:41.661361 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:16:42.146945 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:16:42.147390 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963402.147175, 476c3a01-2dd3-46b3-acae-8e0c236760ee => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:16:42.147553 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] VM Paused (Lifecycle Event)
May 28 10:16:42.166581 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Took 8.85 seconds to spawn the instance on the hypervisor.
May 28 10:16:42.166725 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:16:42.652984 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:16:42.655675 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963402.6554644, 476c3a01-2dd3-46b3-acae-8e0c236760ee => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:16:42.655794 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] VM Resumed (Lifecycle Event)
May 28 10:16:42.676727 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-89e2c4f2-d08f-4979-a8a4-cfbc1ac84d16 req-1f9a8bd7-3eb2-46e7-81e1-11de813d7ea6 service nova] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Received event network-vif-plugged-48aaa82e-10ec-4f32-b923-0e02bd572150 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:16:42.677376 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Took 16.30 seconds to build instance.
May 28 10:16:42.678790 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-89e2c4f2-d08f-4979-a8a4-cfbc1ac84d16 req-1f9a8bd7-3eb2-46e7-81e1-11de813d7ea6 service nova] Acquiring lock "476c3a01-2dd3-46b3-acae-8e0c236760ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:16:42.679632 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-89e2c4f2-d08f-4979-a8a4-cfbc1ac84d16 req-1f9a8bd7-3eb2-46e7-81e1-11de813d7ea6 service nova] Lock "476c3a01-2dd3-46b3-acae-8e0c236760ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:16:42.679632 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-89e2c4f2-d08f-4979-a8a4-cfbc1ac84d16 req-1f9a8bd7-3eb2-46e7-81e1-11de813d7ea6 service nova] Lock "476c3a01-2dd3-46b3-acae-8e0c236760ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:16:42.679632 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-89e2c4f2-d08f-4979-a8a4-cfbc1ac84d16 req-1f9a8bd7-3eb2-46e7-81e1-11de813d7ea6 service nova] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] No waiting events found dispatching network-vif-plugged-48aaa82e-10ec-4f32-b923-0e02bd572150 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:16:42.679632 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-89e2c4f2-d08f-4979-a8a4-cfbc1ac84d16 req-1f9a8bd7-3eb2-46e7-81e1-11de813d7ea6 service nova] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Received unexpected event network-vif-plugged-48aaa82e-10ec-4f32-b923-0e02bd572150 for instance with vm_state active and task_state None.
May 28 10:16:42.842954 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:43.160185 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:16:43.162758 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:16:43.180446 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-2c9d6f86-086e-49e8-9aa4-f9bff66ecc62 tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Lock "476c3a01-2dd3-46b3-acae-8e0c236760ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.809s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:16:44.729688 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-9bb5f888-ba38-447b-a39f-6a16a4456b8f req-594759f9-b359-4795-a866-8a9bea038803 service nova] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Received event network-changed-48aaa82e-10ec-4f32-b923-0e02bd572150 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:16:44.729968 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-9bb5f888-ba38-447b-a39f-6a16a4456b8f req-594759f9-b359-4795-a866-8a9bea038803 service nova] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Refreshing instance network info cache due to event network-changed-48aaa82e-10ec-4f32-b923-0e02bd572150. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:16:44.729968 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9bb5f888-ba38-447b-a39f-6a16a4456b8f req-594759f9-b359-4795-a866-8a9bea038803 service nova] Acquiring lock "refresh_cache-476c3a01-2dd3-46b3-acae-8e0c236760ee" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:16:44.729968 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9bb5f888-ba38-447b-a39f-6a16a4456b8f req-594759f9-b359-4795-a866-8a9bea038803 service nova] Acquired lock "refresh_cache-476c3a01-2dd3-46b3-acae-8e0c236760ee" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:16:44.730238 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-9bb5f888-ba38-447b-a39f-6a16a4456b8f req-594759f9-b359-4795-a866-8a9bea038803 service nova] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Refreshing network info cache for port 48aaa82e-10ec-4f32-b923-0e02bd572150 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:16:45.172748 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:45.232649 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-9bb5f888-ba38-447b-a39f-6a16a4456b8f req-594759f9-b359-4795-a866-8a9bea038803 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:16:45.511527 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-9bb5f888-ba38-447b-a39f-6a16a4456b8f req-594759f9-b359-4795-a866-8a9bea038803 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:16:45.646727 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-9bb5f888-ba38-447b-a39f-6a16a4456b8f req-594759f9-b359-4795-a866-8a9bea038803 service nova] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Updated VIF entry in instance network info cache for port 48aaa82e-10ec-4f32-b923-0e02bd572150. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:16:45.647142 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-9bb5f888-ba38-447b-a39f-6a16a4456b8f req-594759f9-b359-4795-a866-8a9bea038803 service nova] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Updating instance_info_cache with network_info: [{"id": "48aaa82e-10ec-4f32-b923-0e02bd572150", "address": "fa:16:3e:f3:07:a9", "network": {"id": "1215fcb1-9aad-46d4-92f9-d86a7f6a50ea", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1510342586-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "005a061f46764b61909c64d38b242678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48aaa82e-10", "ovs_interfaceid": "48aaa82e-10ec-4f32-b923-0e02bd572150", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:16:46.149341 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9bb5f888-ba38-447b-a39f-6a16a4456b8f req-594759f9-b359-4795-a866-8a9bea038803 service nova] Releasing lock "refresh_cache-476c3a01-2dd3-46b3-acae-8e0c236760ee" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:16:47.845402 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:50.191686 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:52.847803 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:55.198608 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:57.147097 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:57.532233 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquiring lock "f5d8064e-6dbe-4e13-87ae-b4dd67e60797" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:16:57.532479 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "f5d8064e-6dbe-4e13-87ae-b4dd67e60797" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:16:57.532733 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquiring lock "f5d8064e-6dbe-4e13-87ae-b4dd67e60797-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:16:57.533453 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "f5d8064e-6dbe-4e13-87ae-b4dd67e60797-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:16:57.533595 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "f5d8064e-6dbe-4e13-87ae-b4dd67e60797-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:16:57.535535 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Terminating instance
May 28 10:16:57.849215 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:58.038911 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:16:58.055278 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:58.057093 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:58.072188 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:58.074864 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:58.088142 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:58.093021 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:58.298155 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-368b0e84-c1e7-44c1-a86b-e07519306247 req-41766a37-27ce-4753-ac4f-8c85b3061a35 service nova] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Received event network-vif-unplugged-c88f6a8c-e28c-42ba-8b7f-108be62aeaee {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:16:58.298517 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-368b0e84-c1e7-44c1-a86b-e07519306247 req-41766a37-27ce-4753-ac4f-8c85b3061a35 service nova] Acquiring lock "f5d8064e-6dbe-4e13-87ae-b4dd67e60797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:16:58.298688 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-368b0e84-c1e7-44c1-a86b-e07519306247 req-41766a37-27ce-4753-ac4f-8c85b3061a35 service nova] Lock "f5d8064e-6dbe-4e13-87ae-b4dd67e60797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:16:58.298803 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-368b0e84-c1e7-44c1-a86b-e07519306247 req-41766a37-27ce-4753-ac4f-8c85b3061a35 service nova] Lock "f5d8064e-6dbe-4e13-87ae-b4dd67e60797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:16:58.298953 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-368b0e84-c1e7-44c1-a86b-e07519306247 req-41766a37-27ce-4753-ac4f-8c85b3061a35 service nova] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] No waiting events found dispatching network-vif-unplugged-c88f6a8c-e28c-42ba-8b7f-108be62aeaee {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:16:58.299059 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-368b0e84-c1e7-44c1-a86b-e07519306247 req-41766a37-27ce-4753-ac4f-8c85b3061a35 service nova] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Received event network-vif-unplugged-c88f6a8c-e28c-42ba-8b7f-108be62aeaee for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:16:58.334088 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:58.342711 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:58.358017 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.99974273099997 future=<Future at 0x73c1f40d0f80 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:16:58.358387 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999357514999701 future=<Future at 0x73c1f40d0f80 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:16:58.358540 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999223484999675 future=<Future at 0x73c1f40d0f80 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:16:58.359982 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Instance destroyed successfully.
May 28 10:16:58.360366 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lazy-loading 'resources' on Instance uuid f5d8064e-6dbe-4e13-87ae-b4dd67e60797 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:16:58.865369 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:15:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1321799985',display_name='tempest-TestEncryptedCinderVolumes-server-1321799985',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testencryptedcindervolumes-server-1321799985',id=77,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpoRVALe7c4eQpRGN1VpZp9dYLl+jRMKefrPnTrudxsOQfg/5SdK2JJSsZS0Z3ILznoiWwVdnG5s+L6s6eVazdKobR/BLpkSVCCl0f5CnhsJ7UyqsnyUak+PFh9njYeag==',key_name='tempest-TestEncryptedCinderVolumes-1905729309',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:16:18Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a515533ba1c4e23a52f472549e5211f',ramdisk_id='',reservation_id='r-2mnrnkg7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestEncryptedCinderVolumes-678033643',owner_user_name='tempest-TestEncryptedCinderVolumes-678033643-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:16:18Z,user_data=None,user_id='cabed30cb95f4f7b9f96187fc336f7c4',uuid=f5d8064e-6dbe-4e13-87ae-b4dd67e60797,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c88f6a8c-e28c-42ba-8b7f-108be62aeaee", "address": "fa:16:3e:b4:5a:13", "network": {"id": "07ee30b7-dd9c-433d-81cc-42ab11aded18", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1881482359-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a515533ba1c4e23a52f472549e5211f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88f6a8c-e2", "ovs_interfaceid": "c88f6a8c-e28c-42ba-8b7f-108be62aeaee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:16:58.865596 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Converting VIF {"id": "c88f6a8c-e28c-42ba-8b7f-108be62aeaee", "address": "fa:16:3e:b4:5a:13", "network": {"id": "07ee30b7-dd9c-433d-81cc-42ab11aded18", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1881482359-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a515533ba1c4e23a52f472549e5211f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc88f6a8c-e2", "ovs_interfaceid": "c88f6a8c-e28c-42ba-8b7f-108be62aeaee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:16:58.866299 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:5a:13,bridge_name='br-int',has_traffic_filtering=True,id=c88f6a8c-e28c-42ba-8b7f-108be62aeaee,network=Network(07ee30b7-dd9c-433d-81cc-42ab11aded18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc88f6a8c-e2') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:16:58.866573 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:5a:13,bridge_name='br-int',has_traffic_filtering=True,id=c88f6a8c-e28c-42ba-8b7f-108be62aeaee,network=Network(07ee30b7-dd9c-433d-81cc-42ab11aded18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc88f6a8c-e2') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:16:58.867910 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:58.868235 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc88f6a8c-e2, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:16:58.877360 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:58.878318 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:16:58.879140 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:58.879321 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3e3c8577-f967-4ab0-b03b-247a4b4749d6) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:16:58.879714 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:58.880265 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:16:58.880480 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:16:58.882786 np0000001613 nova-compute[98321]: INFO os_vif [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:5a:13,bridge_name='br-int',has_traffic_filtering=True,id=c88f6a8c-e28c-42ba-8b7f-108be62aeaee,network=Network(07ee30b7-dd9c-433d-81cc-42ab11aded18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc88f6a8c-e2')
May 28 10:16:58.886436 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:16:58.886759 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb', 'iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'befe7a60-6d3a-484d-8d41-820fb02e69cb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:16:58.886926 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:16:58.887360 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:16:58.887657 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb', 'iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'befe7a60-6d3a-484d-8d41-820fb02e69cb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:16:58.887793 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:16:58.911911 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb (non-flash)
May 28 10:16:58.911911 np0000001613 nova-compute[98321]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb (non-flash)
May 28 10:16:58.911911 np0000001613 nova-compute[98321]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407 (non-flash)
May 28 10:16:58.911911 np0000001613 nova-compute[98321]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407 (non-flash)
May 28 10:16:58.911911 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:16:58.912093 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsi session list stdout=tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb (non-flash)
May 28 10:16:58.912093 np0000001613 nova-compute[98321]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb (non-flash)
May 28 10:16:58.912093 np0000001613 nova-compute[98321]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407 (non-flash)
May 28 10:16:58.912093 np0000001613 nova-compute[98321]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407 (non-flash)
May 28 10:16:58.912093 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:16:58.912239 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb', '217'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb', '218'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407', '219'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407', '220')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:16:58.912324 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb', '218')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:16:58.913071 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb', '217')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:16:58.913782 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc22cf40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb'): ({'sdc'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:16:58.913989 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Removing multipathed devices sdc, sdd {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:16:58.914223 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Flush multipath device 3300000000c096806 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:16:58.953375 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:16:58.996564 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:16:59.038455 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Checking to see if SCSI volumes sdc, sdd have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:16:59.038634 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] SCSI volumes sdc, sdd have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:16:59.039402 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Checking to see if device paths {'sdc', 'sdd'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:16:59.050301 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Device paths {'sdc', 'sdd'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:16:59.050522 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:16:59.061131 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:59.093277 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 218, target: iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb, portal: 192.168.40.100,3260]
May 28 10:16:59.093277 np0000001613 nova-compute[98321]: Logout of [sid: 218, target: iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb, portal: 192.168.40.100,3260] successful.
May 28 10:16:59.093277 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:59.107384 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:59.118991 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:59.145133 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 217, target: iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb, portal: 192.168.50.100,3260]
May 28 10:16:59.145133 np0000001613 nova-compute[98321]: Logout of [sid: 217, target: iqn.2023-03.storpool.com:os--volume-befe7a60-6d3a-484d-8d41-820fb02e69cb, portal: 192.168.50.100,3260] successful.
May 28 10:16:59.145133 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:59.157437 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:16:59.158493 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:16:59.158659 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] <== disconnect_volume: return (271ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:16:59.158800 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:16:59.159134 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Deleting instance files /opt/stack/data/nova/instances/f5d8064e-6dbe-4e13-87ae-b4dd67e60797_del
May 28 10:16:59.159757 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Deletion of /opt/stack/data/nova/instances/f5d8064e-6dbe-4e13-87ae-b4dd67e60797_del complete
May 28 10:16:59.667315 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Took 1.63 seconds to destroy the instance on the hypervisor.
May 28 10:16:59.667915 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:16:59.668072 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:16:59.668194 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:16:59.668421 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:16:59.751564 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:16:59.757778 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:00.200036 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:00.353018 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5dbb2aae-934f-4701-a164-4592876da1a0 req-448b1fb8-f30b-4275-bf6f-f7f5918002f7 service nova] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Received event network-vif-unplugged-c88f6a8c-e28c-42ba-8b7f-108be62aeaee {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:17:00.353694 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5dbb2aae-934f-4701-a164-4592876da1a0 req-448b1fb8-f30b-4275-bf6f-f7f5918002f7 service nova] Acquiring lock "f5d8064e-6dbe-4e13-87ae-b4dd67e60797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:17:00.353935 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5dbb2aae-934f-4701-a164-4592876da1a0 req-448b1fb8-f30b-4275-bf6f-f7f5918002f7 service nova] Lock "f5d8064e-6dbe-4e13-87ae-b4dd67e60797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:17:00.354105 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5dbb2aae-934f-4701-a164-4592876da1a0 req-448b1fb8-f30b-4275-bf6f-f7f5918002f7 service nova] Lock "f5d8064e-6dbe-4e13-87ae-b4dd67e60797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:17:00.354408 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5dbb2aae-934f-4701-a164-4592876da1a0 req-448b1fb8-f30b-4275-bf6f-f7f5918002f7 service nova] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] No waiting events found dispatching network-vif-unplugged-c88f6a8c-e28c-42ba-8b7f-108be62aeaee {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:17:00.354454 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5dbb2aae-934f-4701-a164-4592876da1a0 req-448b1fb8-f30b-4275-bf6f-f7f5918002f7 service nova] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Received event network-vif-unplugged-c88f6a8c-e28c-42ba-8b7f-108be62aeaee for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:17:00.354569 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5dbb2aae-934f-4701-a164-4592876da1a0 req-448b1fb8-f30b-4275-bf6f-f7f5918002f7 service nova] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Received event network-vif-deleted-c88f6a8c-e28c-42ba-8b7f-108be62aeaee {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:17:00.354724 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-5dbb2aae-934f-4701-a164-4592876da1a0 req-448b1fb8-f30b-4275-bf6f-f7f5918002f7 service nova] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Neutron deleted interface c88f6a8c-e28c-42ba-8b7f-108be62aeaee; detaching it from the instance and deleting it from the info cache
May 28 10:17:00.356549 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5dbb2aae-934f-4701-a164-4592876da1a0 req-448b1fb8-f30b-4275-bf6f-f7f5918002f7 service nova] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Detach interface failed, port_id=c88f6a8c-e28c-42ba-8b7f-108be62aeaee, reason: Instance f5d8064e-6dbe-4e13-87ae-b4dd67e60797 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:17:00.585793 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:17:01.087514 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Took 1.42 seconds to deallocate network for instance.
May 28 10:17:01.631158 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Took 0.54 seconds to detach 1 volumes for instance.
May 28 10:17:01.693029 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:02.137381 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:17:02.137763 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:17:02.259915 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:17:02.260125 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:17:02.762488 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:17:03.269411 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.132s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:17:03.320958 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Deleted allocations for instance f5d8064e-6dbe-4e13-87ae-b4dd67e60797
May 28 10:17:03.792712 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:17:03.792712 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:17:03.792910 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:17:03.793327 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:17:03.853866 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:03.880620 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:04.329157 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-db7f190f-2bcf-4edc-a6cf-34fe169d3519 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "f5d8064e-6dbe-4e13-87ae-b4dd67e60797" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.797s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:17:04.788520 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:17:04.789018 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:17:04.791494 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:17:04.791685 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 10:17:04.791949 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:17:05.201045 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:05.296777 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:17:05.296996 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:17:05.297088 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:17:05.297293 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Auditing locally available compute resources for np0000001613 (node: np0000001613) {{(pid=98321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 10:17:05.459544 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:06.327444 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476c3a01-2dd3-46b3-acae-8e0c236760ee/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:17:06.414439 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476c3a01-2dd3-46b3-acae-8e0c236760ee/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:17:06.414943 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476c3a01-2dd3-46b3-acae-8e0c236760ee/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:17:06.499593 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476c3a01-2dd3-46b3-acae-8e0c236760ee/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:17:06.500091 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:17:06.504519 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:17:06.505749 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:17:06.548417 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "env LANG=C uptime" returned: 0 in 0.042s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:17:06.548817 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Hypervisor/Node resource view: name=np0000001613 free_ram=13567MB free_disk=72.62139511108398GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 10:17:06.548997 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:17:06.549254 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:17:07.609884 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 476c3a01-2dd3-46b3-acae-8e0c236760ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:17:07.610155 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 10:17:07.610211 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Final resource view: name=np0000001613 phys_ram=24030MB used_ram=704MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 10:17:06 up 49 min,  2 users,  load average: 3.16, 5.47, 5.20\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '1', 'num_proj_005a061f46764b61909c64d38b242678': '1', 'io_workload': '0'} {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 10:17:07.694413 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:17:07.694691 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:17:08.198015 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:17:08.705041 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Compute_service record updated for np0000001613:np0000001613 {{(pid=98321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 10:17:08.705489 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.156s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:17:08.705489 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:17:08.894822 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:09.245139 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:17:10.209833 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:13.358172 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.00042479000012463075 future=<Future at 0x73c1f40d0f80 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:17:13.359014 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Emitting event <LifecycleEvent: 1779963418.3576467, f5d8064e-6dbe-4e13-87ae-b4dd67e60797 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:17:13.359324 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:17:13.359542 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] VM Stopped (Lifecycle Event)
May 28 10:17:13.705452 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:17:13.705844 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:17:13.706179 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.08 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:17:13.864216 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: f5d8064e-6dbe-4e13-87ae-b4dd67e60797] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:17:13.895601 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:13.979825 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:14.788185 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:17:14.788971 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:17:15.209820 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:15.469199 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:18.282818 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquiring lock "9ba4df01-b7d4-43df-9c63-c190784d5584" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:17:18.283184 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "9ba4df01-b7d4-43df-9c63-c190784d5584" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:17:18.771280 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:18.784731 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:17:18.896545 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:19.329963 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:17:19.330381 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:17:19.333883 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:17:19.334182 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Claim successful on node np0000001613
May 28 10:17:20.211397 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:20.499666 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:17:20.500045 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:17:20.897058 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Acquiring lock "476c3a01-2dd3-46b3-acae-8e0c236760ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:17:20.897058 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Lock "476c3a01-2dd3-46b3-acae-8e0c236760ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:17:20.897058 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Acquiring lock "476c3a01-2dd3-46b3-acae-8e0c236760ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:17:20.897058 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Lock "476c3a01-2dd3-46b3-acae-8e0c236760ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:17:20.897282 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Lock "476c3a01-2dd3-46b3-acae-8e0c236760ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:17:20.899503 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Terminating instance
May 28 10:17:20.902138 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:21.002650 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:17:21.402763 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:17:21.422619 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:21.424597 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:21.441309 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:21.461960 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:21.510473 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.180s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:17:21.510924 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:17:21.551013 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-88edd099-4ad7-468e-85e4-b591137aba6c req-763c83bc-7bf3-49dd-a919-f95f2be75acf service nova] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Received event network-vif-unplugged-48aaa82e-10ec-4f32-b923-0e02bd572150 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:17:21.552219 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-88edd099-4ad7-468e-85e4-b591137aba6c req-763c83bc-7bf3-49dd-a919-f95f2be75acf service nova] Acquiring lock "476c3a01-2dd3-46b3-acae-8e0c236760ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:17:21.552219 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-88edd099-4ad7-468e-85e4-b591137aba6c req-763c83bc-7bf3-49dd-a919-f95f2be75acf service nova] Lock "476c3a01-2dd3-46b3-acae-8e0c236760ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:17:21.552219 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-88edd099-4ad7-468e-85e4-b591137aba6c req-763c83bc-7bf3-49dd-a919-f95f2be75acf service nova] Lock "476c3a01-2dd3-46b3-acae-8e0c236760ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:17:21.552586 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-88edd099-4ad7-468e-85e4-b591137aba6c req-763c83bc-7bf3-49dd-a919-f95f2be75acf service nova] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] No waiting events found dispatching network-vif-unplugged-48aaa82e-10ec-4f32-b923-0e02bd572150 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:17:21.552586 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-88edd099-4ad7-468e-85e4-b591137aba6c req-763c83bc-7bf3-49dd-a919-f95f2be75acf service nova] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Received event network-vif-unplugged-48aaa82e-10ec-4f32-b923-0e02bd572150 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:17:21.722662 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999672461000046 future=<Future at 0x73c1f4245d90 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:17:21.723260 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999025306000021 future=<Future at 0x73c1f4245d90 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:17:21.723411 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.998842515999968 future=<Future at 0x73c1f4245d90 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:17:21.725150 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Instance destroyed successfully.
May 28 10:17:21.725696 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Lazy-loading 'resources' on Instance uuid 476c3a01-2dd3-46b3-acae-8e0c236760ee {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:17:22.018515 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:17:22.018780 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:17:22.019114 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:17:22.019389 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:17:22.080558 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cabed30cb95f4f7b9f96187fc336f7c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a515533ba1c4e23a52f472549e5211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:17:22.229663 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:16:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-instance-1931568946',display_name='tempest-instance-1931568946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-instance-1931568946',id=78,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmriiIsSNGjFeJO0g5I6rv1nKPgYb6C8FP6y6VW5OuZVW+3VniXZKTyvU9tyP9+m36GiJXUX86eNbwcM2NaT4uYREfXCInTEL0dhhrY2YLvAXEI6DTjSRzyv2EA1G9WWQ==',key_name='tempest-keypair-1572210996',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:16:42Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='005a061f46764b61909c64d38b242678',ramdisk_id='',reservation_id='r-he9504wl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-128677527',owner_user_name='tempest-VolumesBackupsTest-128677527-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:16:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='20eea0a089ca4b6e9680a7c301682b02',uuid=476c3a01-2dd3-46b3-acae-8e0c236760ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48aaa82e-10ec-4f32-b923-0e02bd572150", "address": "fa:16:3e:f3:07:a9", "network": {"id": "1215fcb1-9aad-46d4-92f9-d86a7f6a50ea", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1510342586-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "005a061f46764b61909c64d38b242678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48aaa82e-10", "ovs_interfaceid": "48aaa82e-10ec-4f32-b923-0e02bd572150", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:17:22.229862 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Converting VIF {"id": "48aaa82e-10ec-4f32-b923-0e02bd572150", "address": "fa:16:3e:f3:07:a9", "network": {"id": "1215fcb1-9aad-46d4-92f9-d86a7f6a50ea", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1510342586-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "005a061f46764b61909c64d38b242678", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48aaa82e-10", "ovs_interfaceid": "48aaa82e-10ec-4f32-b923-0e02bd572150", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:17:22.230630 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:07:a9,bridge_name='br-int',has_traffic_filtering=True,id=48aaa82e-10ec-4f32-b923-0e02bd572150,network=Network(1215fcb1-9aad-46d4-92f9-d86a7f6a50ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48aaa82e-10') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:17:22.230897 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:07:a9,bridge_name='br-int',has_traffic_filtering=True,id=48aaa82e-10ec-4f32-b923-0e02bd572150,network=Network(1215fcb1-9aad-46d4-92f9-d86a7f6a50ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48aaa82e-10') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:17:22.232392 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:22.233287 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48aaa82e-10, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:17:22.234389 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:22.235292 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:17:22.236152 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:22.236342 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dde0c30f-16de-4ed1-8522-83d60ea1abc3) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:17:22.236734 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:22.237270 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:17:22.237404 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:22.239392 np0000001613 nova-compute[98321]: INFO os_vif [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:07:a9,bridge_name='br-int',has_traffic_filtering=True,id=48aaa82e-10ec-4f32-b923-0e02bd572150,network=Network(1215fcb1-9aad-46d4-92f9-d86a7f6a50ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48aaa82e-10')
May 28 10:17:22.241013 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:17:22.241332 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407', 'iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '40d5c210-113b-4a2b-a7c9-df205fe3c407', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:17:22.241478 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:17:22.241853 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:17:22.242136 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407', 'iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '40d5c210-113b-4a2b-a7c9-df205fe3c407', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:17:22.242317 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:17:22.267260 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407 (non-flash)
May 28 10:17:22.267260 np0000001613 nova-compute[98321]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407 (non-flash)
May 28 10:17:22.267260 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:17:22.267434 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] iscsi session list stdout=tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407 (non-flash)
May 28 10:17:22.267434 np0000001613 nova-compute[98321]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407 (non-flash)
May 28 10:17:22.267434 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:17:22.267557 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407', '219'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407', '220')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:17:22.267643 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407', '220')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:17:22.268407 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407', '219')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:17:22.269020 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc773ce0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407'): ({'sdb'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:17:22.269232 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Removing multipathed devices sdb, sde {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:17:22.269438 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Flush multipath device 3300000001c17c406 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:17:22.317672 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:17:22.358620 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:17:22.411485 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Checking to see if SCSI volumes sdb, sde have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:17:22.411745 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] SCSI volumes sdb, sde have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:17:22.412414 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Checking to see if device paths {'sdb', 'sde'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:17:22.424656 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Device paths {'sdb', 'sde'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:17:22.424962 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:17:22.435277 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:17:22.464275 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 220, target: iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407, portal: 192.168.40.100,3260]
May 28 10:17:22.464275 np0000001613 nova-compute[98321]: Logout of [sid: 220, target: iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407, portal: 192.168.40.100,3260] successful.
May 28 10:17:22.464275 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:17:22.474818 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:17:22.484249 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:17:22.502348 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Successfully created port: 8c4c3171-55fb-44b2-866e-e7f47fa6f006 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:17:22.515330 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 219, target: iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407, portal: 192.168.50.100,3260]
May 28 10:17:22.515330 np0000001613 nova-compute[98321]: Logout of [sid: 219, target: iqn.2023-03.storpool.com:os--volume-40d5c210-113b-4a2b-a7c9-df205fe3c407, portal: 192.168.50.100,3260] successful.
May 28 10:17:22.515330 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:17:22.521426 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:17:22.527646 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:17:22.527908 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:17:22.528091 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] <== disconnect_volume: return (286ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:17:22.528300 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:17:22.528875 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Deleting instance files /opt/stack/data/nova/instances/476c3a01-2dd3-46b3-acae-8e0c236760ee_del
May 28 10:17:22.529458 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Deletion of /opt/stack/data/nova/instances/476c3a01-2dd3-46b3-acae-8e0c236760ee_del complete
May 28 10:17:22.906504 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Successfully updated port: 8c4c3171-55fb-44b2-866e-e7f47fa6f006 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:17:22.949560 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3782a2c9-07e5-4cfb-acb9-83911d3dfbd9 req-90a46203-3771-455b-a56c-80f61da972a0 service nova] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Received event network-changed-8c4c3171-55fb-44b2-866e-e7f47fa6f006 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:17:22.950236 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-3782a2c9-07e5-4cfb-acb9-83911d3dfbd9 req-90a46203-3771-455b-a56c-80f61da972a0 service nova] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Refreshing instance network info cache due to event network-changed-8c4c3171-55fb-44b2-866e-e7f47fa6f006. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:17:22.950586 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3782a2c9-07e5-4cfb-acb9-83911d3dfbd9 req-90a46203-3771-455b-a56c-80f61da972a0 service nova] Acquiring lock "refresh_cache-9ba4df01-b7d4-43df-9c63-c190784d5584" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:17:22.951844 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3782a2c9-07e5-4cfb-acb9-83911d3dfbd9 req-90a46203-3771-455b-a56c-80f61da972a0 service nova] Acquired lock "refresh_cache-9ba4df01-b7d4-43df-9c63-c190784d5584" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:17:22.951844 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-3782a2c9-07e5-4cfb-acb9-83911d3dfbd9 req-90a46203-3771-455b-a56c-80f61da972a0 service nova] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Refreshing network info cache for port 8c4c3171-55fb-44b2-866e-e7f47fa6f006 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:17:23.024563 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:17:23.037889 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Took 1.63 seconds to destroy the instance on the hypervisor.
May 28 10:17:23.038040 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:17:23.038609 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:17:23.038609 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:17:23.038745 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:17:23.132440 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:17:23.357929 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:23.408320 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquiring lock "refresh_cache-9ba4df01-b7d4-43df-9c63-c190784d5584" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:17:23.453127 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-3782a2c9-07e5-4cfb-acb9-83911d3dfbd9 req-90a46203-3771-455b-a56c-80f61da972a0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:17:23.515149 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-3782a2c9-07e5-4cfb-acb9-83911d3dfbd9 req-90a46203-3771-455b-a56c-80f61da972a0 service nova] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:17:23.529015 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Booting with volume 1935bb06-9875-461e-b2c4-772dd575ffa9 at /dev/vda
May 28 10:17:23.568579 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:17:23.578966 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:17:23.602778 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:17:23.628220 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6093d602-60fe-4ea0-b059-9eaed171c387 req-b87afce0-5bef-4dc9-8010-a68a325b0a61 service nova] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Received event network-vif-unplugged-48aaa82e-10ec-4f32-b923-0e02bd572150 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:17:23.628220 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6093d602-60fe-4ea0-b059-9eaed171c387 req-b87afce0-5bef-4dc9-8010-a68a325b0a61 service nova] Acquiring lock "476c3a01-2dd3-46b3-acae-8e0c236760ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:17:23.628725 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6093d602-60fe-4ea0-b059-9eaed171c387 req-b87afce0-5bef-4dc9-8010-a68a325b0a61 service nova] Lock "476c3a01-2dd3-46b3-acae-8e0c236760ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:17:23.628972 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6093d602-60fe-4ea0-b059-9eaed171c387 req-b87afce0-5bef-4dc9-8010-a68a325b0a61 service nova] Lock "476c3a01-2dd3-46b3-acae-8e0c236760ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:17:23.629282 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6093d602-60fe-4ea0-b059-9eaed171c387 req-b87afce0-5bef-4dc9-8010-a68a325b0a61 service nova] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] No waiting events found dispatching network-vif-unplugged-48aaa82e-10ec-4f32-b923-0e02bd572150 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:17:23.629511 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6093d602-60fe-4ea0-b059-9eaed171c387 req-b87afce0-5bef-4dc9-8010-a68a325b0a61 service nova] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Received event network-vif-unplugged-48aaa82e-10ec-4f32-b923-0e02bd572150 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:17:23.653256 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:17:23.653969 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:17:23.661554 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:17:23.662446 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641'] 
May 28 10:17:23.662583 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:17:23.662736 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:17:23.663034 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] <== get_connector_properties: return (94ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:17:23.663288 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Updating existing volume attachment record: c2029dfe-cb7f-440c-a13b-ddf2076c8b8d {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:17:23.685487 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-3782a2c9-07e5-4cfb-acb9-83911d3dfbd9 req-90a46203-3771-455b-a56c-80f61da972a0 service nova] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:17:24.032618 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:17:24.187541 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-3782a2c9-07e5-4cfb-acb9-83911d3dfbd9 req-90a46203-3771-455b-a56c-80f61da972a0 service nova] Releasing lock "refresh_cache-9ba4df01-b7d4-43df-9c63-c190784d5584" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:17:24.188408 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquired lock "refresh_cache-9ba4df01-b7d4-43df-9c63-c190784d5584" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:17:24.189041 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:17:24.534518 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Took 1.50 seconds to deallocate network for instance.
May 28 10:17:24.753391 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:17:24.892189 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:17:25.005659 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2b94b97a-082c-4c21-b4d1-2856d9871992 req-73424a72-8e94-4a93-9281-ed066df2d42c service nova] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Received event network-vif-deleted-48aaa82e-10ec-4f32-b923-0e02bd572150 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:17:25.018531 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Updating instance_info_cache with network_info: [{"id": "8c4c3171-55fb-44b2-866e-e7f47fa6f006", "address": "fa:16:3e:76:2c:61", "network": {"id": "07ee30b7-dd9c-433d-81cc-42ab11aded18", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1881482359-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a515533ba1c4e23a52f472549e5211f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c4c3171-55", "ovs_interfaceid": "8c4c3171-55fb-44b2-866e-e7f47fa6f006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:17:25.080213 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Took 0.54 seconds to detach 1 volumes for instance.
May 28 10:17:25.213833 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:25.420602 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:25.520910 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Releasing lock "refresh_cache-9ba4df01-b7d4-43df-9c63-c190784d5584" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:17:25.521045 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Instance network_info: |[{"id": "8c4c3171-55fb-44b2-866e-e7f47fa6f006", "address": "fa:16:3e:76:2c:61", "network": {"id": "07ee30b7-dd9c-433d-81cc-42ab11aded18", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1881482359-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a515533ba1c4e23a52f472549e5211f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c4c3171-55", "ovs_interfaceid": "8c4c3171-55fb-44b2-866e-e7f47fa6f006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:17:25.585640 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:17:25.586072 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:17:25.721241 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:17:25.721578 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:17:25.755068 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:17:25.756454 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:17:25.756692 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Creating image(s)
May 28 10:17:25.757009 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Did not create local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 10:17:25.757134 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Ensure instance console log exists: /opt/stack/data/nova/instances/9ba4df01-b7d4-43df-9c63-c190784d5584/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:17:25.757385 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:17:25.757537 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:17:25.757657 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:17:25.758176 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Start _get_guest_xml network_info=[{"id": "8c4c3171-55fb-44b2-866e-e7f47fa6f006", "address": "fa:16:3e:76:2c:61", "network": {"id": "07ee30b7-dd9c-433d-81cc-42ab11aded18", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1881482359-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a515533ba1c4e23a52f472549e5211f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c4c3171-55", "ovs_interfaceid": "8c4c3171-55fb-44b2-866e-e7f47fa6f006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9', 'iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1935bb06-9875-461e-b2c4-772dd575ffa9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '9ba4df01-b7d4-43df-9c63-c190784d5584', 'attached_at': '', 'detached_at': '', 'volume_id': '1935bb06-9875-461e-b2c4-772dd575ffa9', 'serial': '1935bb06-9875-461e-b2c4-772dd575ffa9'}, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'c2029dfe-cb7f-440c-a13b-ddf2076c8b8d', 'guest_format': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:17:25.761237 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:17:25.762214 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-381336326', uuid='9ba4df01-b7d4-43df-9c63-c190784d5584'), owner=OwnerMeta(userid='cabed30cb95f4f7b9f96187fc336f7c4', username='tempest-TestEncryptedCinderVolumes-678033643-project-member', projectid='2a515533ba1c4e23a52f472549e5211f', projectname='tempest-TestEncryptedCinderVolumes-678033643'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8c4c3171-55fb-44b2-866e-e7f47fa6f006", "address": "fa:16:3e:76:2c:61", "network": {"id": "07ee30b7-dd9c-433d-81cc-42ab11aded18", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1881482359-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a515533ba1c4e23a52f472549e5211f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c4c3171-55", "ovs_interfaceid": "8c4c3171-55fb-44b2-866e-e7f47fa6f006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779963445.7618911) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:17:25.763402 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:17:25.763701 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:17:25.764906 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:17:25.765079 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:17:25.766483 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:17:25.766764 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:17:25.766957 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:17:25.767066 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:17:25.767268 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:17:25.767312 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:17:25.767382 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:17:25.767526 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:17:25.767620 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:17:25.767727 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:17:25.767834 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:17:25.767951 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:17:25.777126 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:17:25.777435 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9', 'iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1935bb06-9875-461e-b2c4-772dd575ffa9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:17:25.777567 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:17:25.777957 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:17:25.778121 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9', 'iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1935bb06-9875-461e-b2c4-772dd575ffa9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:17:25.789587 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:17:25.790322 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:17:25.790763 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:17:25.791016 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:17:25.791436 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:17:25.791737 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:17:25.804117 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:17:25.804117 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:17:25.808971 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:17:25.808971 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:17:25.815588 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9] added
May 28 10:17:25.815588 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:17:25.815588 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:17:25.815588 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:17:25.815588 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:17:25.815588 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:17:25.815588 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:17:25.815863 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:17:25.816548 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0249(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:17:25.816548 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:17:25.820481 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9] added
May 28 10:17:25.820481 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:17:25.820481 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:17:25.820481 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:17:25.820481 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:17:25.820481 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:17:25.820481 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:17:25.820671 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:17:25.820889 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0292(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:17:25.821029 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:17:26.225766 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:17:26.734412 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.148s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:17:26.784298 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Deleted allocations for instance 476c3a01-2dd3-46b3-acae-8e0c236760ee
May 28 10:17:26.816656 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:17:26.821413 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:17:26.828113 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:17:26.828113 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:17:26.833059 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:17:26.833059 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:17:26.839600 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:17:26.844962 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:17:26.850802 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 10:17:26.850802 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:17:26.850971 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 10:17:26.850971 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:17:26.851155 np0000001613 nova-compute[98321]: WARNING os_brick.initiator.connectors.iscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 10:17:26.851155 np0000001613 nova-compute[98321]: 
May 28 10:17:26.856305 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 10:17:26.856305 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:17:26.856451 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 10:17:26.856451 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:17:26.856514 np0000001613 nova-compute[98321]: WARNING os_brick.initiator.connectors.iscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 10:17:26.856514 np0000001613 nova-compute[98321]: 
May 28 10:17:26.873407 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9, portal: 192.168.40.100,3260]
May 28 10:17:26.873407 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9, portal: 192.168.40.100,3260] successful.
May 28 10:17:26.873407 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:17:26.884052 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:17:26.889903 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9, portal: 192.168.50.100,3260]
May 28 10:17:26.889903 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9, portal: 192.168.50.100,3260] successful.
May 28 10:17:26.889903 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:17:26.896588 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9 (non-flash)
May 28 10:17:26.896588 np0000001613 nova-compute[98321]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9 (non-flash)
May 28 10:17:26.896588 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:17:26.896766 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsi session list stdout=tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9 (non-flash)
May 28 10:17:26.896766 np0000001613 nova-compute[98321]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9 (non-flash)
May 28 10:17:26.896766 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:17:26.897062 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.107s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:17:26.897215 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:17:26.897717 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] HCTL ('7', '-', '-', 0) found on session 223 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:17:26.897857 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:17:26.902270 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:17:26.910696 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Searching for a device in session 223 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:17:26.910825 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1935bb06-9875-461e-b2c4-772dd575ffa9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:17:26.913750 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9 (non-flash)
May 28 10:17:26.913750 np0000001613 nova-compute[98321]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9 (non-flash)
May 28 10:17:26.913750 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:17:26.913942 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsi session list stdout=tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9 (non-flash)
May 28 10:17:26.913942 np0000001613 nova-compute[98321]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9 (non-flash)
May 28 10:17:26.913942 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:17:26.914227 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.123s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:17:26.914390 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:17:26.914929 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] HCTL ('8', '-', '-', 0) found on session 224 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:17:26.915069 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:17:26.929602 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Searching for a device in session 224 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:17:26.929602 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '1935bb06-9875-461e-b2c4-772dd575ffa9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:17:27.237561 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:27.792153 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:17:27.792538 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-00a08fad-1a9a-4f7a-89a2-fd79313477bf tempest-VolumesBackupsTest-128677527 tempest-VolumesBackupsTest-128677527-project-member] Lock "476c3a01-2dd3-46b3-acae-8e0c236760ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.896s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:17:28.402894 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:17:28.403060 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:17:28.806132 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Found WWN 33000000096066f8d for multipath device dm-0 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:17:28.806512 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.028s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:17:28.807258 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] <== connect_volume: return (3029ms) {'type': 'block', 'scsi_wwn': '33000000096066f8d', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '33000000096066f8d'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:17:28.807413 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000096066f8d', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '33000000096066f8d'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:17:28.833409 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9', 'iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1935bb06-9875-461e-b2c4-772dd575ffa9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '9ba4df01-b7d4-43df-9c63-c190784d5584', 'attached_at': '', 'detached_at': '', 'volume_id': '1935bb06-9875-461e-b2c4-772dd575ffa9', 'serial': '1935bb06-9875-461e-b2c4-772dd575ffa9'} {{(pid=98321) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 10:17:28.833969 np0000001613 nova-compute[98321]: WARNING stevedore.named [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 10:17:28.834263 np0000001613 nova-compute[98321]: WARNING castellan.key_manager [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 10:17:28.834421 np0000001613 nova-compute[98321]: WARNING nova.keymgr.conf_key_mgr [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 10:17:28.847100 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 10:17:28.847100 np0000001613 nova-compute[98321]:   <usage type="volume">
May 28 10:17:28.847100 np0000001613 nova-compute[98321]:     <volume>1935bb06-9875-461e-b2c4-772dd575ffa9</volume>
May 28 10:17:28.847100 np0000001613 nova-compute[98321]:   </usage>
May 28 10:17:28.847100 np0000001613 nova-compute[98321]: </secret>
May 28 10:17:28.847100 np0000001613 nova-compute[98321]:  {{(pid=98321) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 10:17:28.904538 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:17:29.354698 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:17:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-381336326',display_name='tempest-TestEncryptedCinderVolumes-server-381336326',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testencryptedcindervolumes-server-381336326',id=79,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpoRVALe7c4eQpRGN1VpZp9dYLl+jRMKefrPnTrudxsOQfg/5SdK2JJSsZS0Z3ILznoiWwVdnG5s+L6s6eVazdKobR/BLpkSVCCl0f5CnhsJ7UyqsnyUak+PFh9njYeag==',key_name='tempest-TestEncryptedCinderVolumes-1905729309',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a515533ba1c4e23a52f472549e5211f',ramdisk_id='',reservation_id='r-svk1lmwg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-678033643',owner_user_name='tempest-TestEncryptedCinderVolumes-678033643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:17:23Z,user_data=None,user_id='cabed30cb95f4f7b9f96187fc336f7c4',uuid=9ba4df01-b7d4-43df-9c63-c190784d5584,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c4c3171-55fb-44b2-866e-e7f47fa6f006", "address": "fa:16:3e:76:2c:61", "network": {"id": "07ee30b7-dd9c-433d-81cc-42ab11aded18", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1881482359-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a515533ba1c4e23a52f472549e5211f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c4c3171-55", "ovs_interfaceid": "8c4c3171-55fb-44b2-866e-e7f47fa6f006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:17:29.354921 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Converting VIF {"id": "8c4c3171-55fb-44b2-866e-e7f47fa6f006", "address": "fa:16:3e:76:2c:61", "network": {"id": "07ee30b7-dd9c-433d-81cc-42ab11aded18", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1881482359-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a515533ba1c4e23a52f472549e5211f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c4c3171-55", "ovs_interfaceid": "8c4c3171-55fb-44b2-866e-e7f47fa6f006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:17:29.355409 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:2c:61,bridge_name='br-int',has_traffic_filtering=True,id=8c4c3171-55fb-44b2-866e-e7f47fa6f006,network=Network(07ee30b7-dd9c-433d-81cc-42ab11aded18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c4c3171-55') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:17:29.356220 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ba4df01-b7d4-43df-9c63-c190784d5584 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:17:29.447668 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:17:29.447841 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:17:29.450856 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:17:29.451245 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Claim successful on node np0000001613
May 28 10:17:29.858617 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] End _get_guest_xml xml=<domain type="qemu">
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:   <uuid>9ba4df01-b7d4-43df-9c63-c190784d5584</uuid>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:   <name>instance-0000004f</name>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-381336326</nova:name>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:17:25</nova:creationTime>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:       <nova:image uuid="">
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:         <nova:user uuid="cabed30cb95f4f7b9f96187fc336f7c4">tempest-TestEncryptedCinderVolumes-678033643-project-member</nova:user>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:         <nova:project uuid="2a515533ba1c4e23a52f472549e5211f">tempest-TestEncryptedCinderVolumes-678033643</nova:project>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:       <nova:root type="volume" uuid=""/>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:         <nova:port uuid="8c4c3171-55fb-44b2-866e-e7f47fa6f006">
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:     <system>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:       <entry name="serial">9ba4df01-b7d4-43df-9c63-c190784d5584</entry>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:       <entry name="uuid">9ba4df01-b7d4-43df-9c63-c190784d5584</entry>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:     </system>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:   <os>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:   </os>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:   <features>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:   </features>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:   <devices>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/9ba4df01-b7d4-43df-9c63-c190784d5584/disk.config"/>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:     </disk>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:     <disk type="block" device="disk">
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:       <alias name="ua-1935bb06-9875-461e-b2c4-772dd575ffa9"/>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:       <serial>1935bb06-9875-461e-b2c4-772dd575ffa9</serial>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:       <encryption format="luks">
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:         <secret type="passphrase" uuid="806089cf-92f1-4306-9080-29c336b7c44f"/>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:       </encryption>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:     </disk>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:76:2c:61"/>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:       <target dev="tap8c4c3171-55"/>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:     </interface>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/9ba4df01-b7d4-43df-9c63-c190784d5584/console.log" append="off"/>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:     </serial>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:     <video>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:     </video>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:     </rng>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:   </devices>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]: </domain>
May 28 10:17:29.858617 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:17:29.860800 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Preparing to wait for external event network-vif-plugged-8c4c3171-55fb-44b2-866e-e7f47fa6f006 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:17:29.860800 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquiring lock "9ba4df01-b7d4-43df-9c63-c190784d5584-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:17:29.860800 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "9ba4df01-b7d4-43df-9c63-c190784d5584-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:17:29.860800 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "9ba4df01-b7d4-43df-9c63-c190784d5584-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:17:29.860800 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:17:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-381336326',display_name='tempest-TestEncryptedCinderVolumes-server-381336326',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testencryptedcindervolumes-server-381336326',id=79,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpoRVALe7c4eQpRGN1VpZp9dYLl+jRMKefrPnTrudxsOQfg/5SdK2JJSsZS0Z3ILznoiWwVdnG5s+L6s6eVazdKobR/BLpkSVCCl0f5CnhsJ7UyqsnyUak+PFh9njYeag==',key_name='tempest-TestEncryptedCinderVolumes-1905729309',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a515533ba1c4e23a52f472549e5211f',ramdisk_id='',reservation_id='r-svk1lmwg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-678033643',owner_user_name='tempest-TestEncryptedCinderVolumes-678033643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:17:23Z,user_data=None,user_id='cabed30cb95f4f7b9f96187fc336f7c4',uuid=9ba4df01-b7d4-43df-9c63-c190784d5584,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c4c3171-55fb-44b2-866e-e7f47fa6f006", "address": "fa:16:3e:76:2c:61", "network": {"id": "07ee30b7-dd9c-433d-81cc-42ab11aded18", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1881482359-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a515533ba1c4e23a52f472549e5211f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c4c3171-55", "ovs_interfaceid": "8c4c3171-55fb-44b2-866e-e7f47fa6f006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:17:29.860800 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Converting VIF {"id": "8c4c3171-55fb-44b2-866e-e7f47fa6f006", "address": "fa:16:3e:76:2c:61", "network": {"id": "07ee30b7-dd9c-433d-81cc-42ab11aded18", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1881482359-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a515533ba1c4e23a52f472549e5211f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c4c3171-55", "ovs_interfaceid": "8c4c3171-55fb-44b2-866e-e7f47fa6f006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:17:29.860800 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:2c:61,bridge_name='br-int',has_traffic_filtering=True,id=8c4c3171-55fb-44b2-866e-e7f47fa6f006,network=Network(07ee30b7-dd9c-433d-81cc-42ab11aded18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c4c3171-55') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:17:29.860800 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:2c:61,bridge_name='br-int',has_traffic_filtering=True,id=8c4c3171-55fb-44b2-866e-e7f47fa6f006,network=Network(07ee30b7-dd9c-433d-81cc-42ab11aded18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c4c3171-55') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:17:29.861281 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:29.861549 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:17:29.861759 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:17:29.862450 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:29.862603 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '27c341a3-5150-5fd3-ab26-496076f4e94c', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:17:29.863594 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:29.864455 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:17:29.865786 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:29.865921 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c4c3171-55, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:17:29.866199 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c4c3171-55, col_values=(('qos', UUID('de4d47f9-c262-4bf8-b1fc-0ca42ab9a0ad')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:17:29.866340 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c4c3171-55, col_values=(('external_ids', {'iface-id': '8c4c3171-55fb-44b2-866e-e7f47fa6f006', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:2c:61', 'vm-uuid': '9ba4df01-b7d4-43df-9c63-c190784d5584'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:17:29.866992 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:29.867963 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:17:29.871927 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:29.872610 np0000001613 nova-compute[98321]: INFO os_vif [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:2c:61,bridge_name='br-int',has_traffic_filtering=True,id=8c4c3171-55fb-44b2-866e-e7f47fa6f006,network=Network(07ee30b7-dd9c-433d-81cc-42ab11aded18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c4c3171-55')
May 28 10:17:30.215467 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:30.570680 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:17:30.570882 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:17:31.073484 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:17:31.385892 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:17:31.386032 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:17:31.386132 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] No VIF found with MAC fa:16:3e:76:2c:61, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:17:31.386581 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Using config drive
May 28 10:17:31.580180 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.132s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:17:31.580774 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:17:31.891932 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:17:32.007462 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Creating config drive at /opt/stack/data/nova/instances/9ba4df01-b7d4-43df-9c63-c190784d5584/disk.config
May 28 10:17:32.010480 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9ba4df01-b7d4-43df-9c63-c190784d5584/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpe83wulsb {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:17:32.065118 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9ba4df01-b7d4-43df-9c63-c190784d5584/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpe83wulsb" returned: 0 in 0.054s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:17:32.089560 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:17:32.089994 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:17:32.090350 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:17:32.090645 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:17:32.155607 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f68f80c0467244b696935ee039759675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd45e575a1740e8aa1c09f4f908d747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:17:32.438355 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:32.459024 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:32.542084 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:32.548105 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:32.592055 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:17:32.615365 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-60134b88-2be9-448b-812c-412741b8d9ab req-85692ac9-fce5-49eb-a8b8-b13eb119073a service nova] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Received event network-vif-plugged-8c4c3171-55fb-44b2-866e-e7f47fa6f006 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:17:32.615817 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-60134b88-2be9-448b-812c-412741b8d9ab req-85692ac9-fce5-49eb-a8b8-b13eb119073a service nova] Acquiring lock "9ba4df01-b7d4-43df-9c63-c190784d5584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:17:32.616142 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-60134b88-2be9-448b-812c-412741b8d9ab req-85692ac9-fce5-49eb-a8b8-b13eb119073a service nova] Lock "9ba4df01-b7d4-43df-9c63-c190784d5584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:17:32.616418 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-60134b88-2be9-448b-812c-412741b8d9ab req-85692ac9-fce5-49eb-a8b8-b13eb119073a service nova] Lock "9ba4df01-b7d4-43df-9c63-c190784d5584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:17:32.616794 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-60134b88-2be9-448b-812c-412741b8d9ab req-85692ac9-fce5-49eb-a8b8-b13eb119073a service nova] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Processing event network-vif-plugged-8c4c3171-55fb-44b2-866e-e7f47fa6f006 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:17:32.670634 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Successfully created port: f9ff28e0-ba0e-42c9-9b36-7d9719abe94e {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:17:32.786102 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:32.788372 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:32.789364 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:32.807833 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:33.098386 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:17:33.234374 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Successfully updated port: f9ff28e0-ba0e-42c9-9b36-7d9719abe94e {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:17:33.736766 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "refresh_cache-5d8c2bb9-680c-4a83-876f-3be446a4c0f8" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:17:33.736922 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquired lock "refresh_cache-5d8c2bb9-680c-4a83-876f-3be446a4c0f8" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:17:33.737061 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:17:34.105836 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:17:34.106711 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:17:34.106967 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Creating image(s)
May 28 10:17:34.107412 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "/opt/stack/data/nova/instances/5d8c2bb9-680c-4a83-876f-3be446a4c0f8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:17:34.108051 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "/opt/stack/data/nova/instances/5d8c2bb9-680c-4a83-876f-3be446a4c0f8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:17:34.108489 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "/opt/stack/data/nova/instances/5d8c2bb9-680c-4a83-876f-3be446a4c0f8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:17:34.109098 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:17:34.112015 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:17:34.113155 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:17:34.150147 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:17:34.151620 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963454.1511126, 9ba4df01-b7d4-43df-9c63-c190784d5584 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:17:34.152107 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] VM Started (Lifecycle Event)
May 28 10:17:34.154332 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:17:34.158258 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Instance spawned successfully.
May 28 10:17:34.158618 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:17:34.197545 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.084s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:17:34.197917 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:17:34.198592 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:17:34.199009 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:17:34.201720 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:17:34.202127 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:17:34.298318 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.096s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:17:34.298729 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/5d8c2bb9-680c-4a83-876f-3be446a4c0f8/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:17:34.344058 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:17:34.355327 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/5d8c2bb9-680c-4a83-876f-3be446a4c0f8/disk 1073741824" returned: 0 in 0.056s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:17:34.355744 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.157s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:17:34.356073 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:17:34.458757 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.102s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:17:34.459610 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5d8c2bb9-680c-4a83-876f-3be446a4c0f8/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:17:34.459934 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d8c2bb9-680c-4a83-876f-3be446a4c0f8/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:17:34.537588 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:17:34.559288 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d8c2bb9-680c-4a83-876f-3be446a4c0f8/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:17:34.559726 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Cannot resize image /opt/stack/data/nova/instances/5d8c2bb9-680c-4a83-876f-3be446a4c0f8/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:17:34.560336 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:17:34.560654 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Ensure instance console log exists: /opt/stack/data/nova/instances/5d8c2bb9-680c-4a83-876f-3be446a4c0f8/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:17:34.561045 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:17:34.561286 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:17:34.561463 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:17:34.657489 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:17:34.666557 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:17:34.670313 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:17:34.670473 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:17:34.670780 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:17:34.671095 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:17:34.671325 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:17:34.671576 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:17:34.689017 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Updating instance_info_cache with network_info: [{"id": "f9ff28e0-ba0e-42c9-9b36-7d9719abe94e", "address": "fa:16:3e:9d:d1:c1", "network": {"id": "fd85d7ca-665d-4c88-a0fc-f5b183b538d1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-852450606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dd45e575a1740e8aa1c09f4f908d747", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9ff28e0-ba", "ovs_interfaceid": "f9ff28e0-ba0e-42c9-9b36-7d9719abe94e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:17:34.696275 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2d4ced40-c227-42e4-8df0-b81ad319e4a7 req-788b8c16-4677-4f9d-b036-4979b3504738 service nova] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Received event network-vif-plugged-8c4c3171-55fb-44b2-866e-e7f47fa6f006 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:17:34.697112 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2d4ced40-c227-42e4-8df0-b81ad319e4a7 req-788b8c16-4677-4f9d-b036-4979b3504738 service nova] Acquiring lock "9ba4df01-b7d4-43df-9c63-c190784d5584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:17:34.697382 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2d4ced40-c227-42e4-8df0-b81ad319e4a7 req-788b8c16-4677-4f9d-b036-4979b3504738 service nova] Lock "9ba4df01-b7d4-43df-9c63-c190784d5584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:17:34.697650 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2d4ced40-c227-42e4-8df0-b81ad319e4a7 req-788b8c16-4677-4f9d-b036-4979b3504738 service nova] Lock "9ba4df01-b7d4-43df-9c63-c190784d5584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:17:34.697650 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2d4ced40-c227-42e4-8df0-b81ad319e4a7 req-788b8c16-4677-4f9d-b036-4979b3504738 service nova] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] No waiting events found dispatching network-vif-plugged-8c4c3171-55fb-44b2-866e-e7f47fa6f006 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:17:34.697864 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-2d4ced40-c227-42e4-8df0-b81ad319e4a7 req-788b8c16-4677-4f9d-b036-4979b3504738 service nova] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Received unexpected event network-vif-plugged-8c4c3171-55fb-44b2-866e-e7f47fa6f006 for instance with vm_state building and task_state spawning.
May 28 10:17:34.698710 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2d4ced40-c227-42e4-8df0-b81ad319e4a7 req-788b8c16-4677-4f9d-b036-4979b3504738 service nova] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Received event network-changed-f9ff28e0-ba0e-42c9-9b36-7d9719abe94e {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:17:34.698710 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2d4ced40-c227-42e4-8df0-b81ad319e4a7 req-788b8c16-4677-4f9d-b036-4979b3504738 service nova] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Refreshing instance network info cache due to event network-changed-f9ff28e0-ba0e-42c9-9b36-7d9719abe94e. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:17:34.698710 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2d4ced40-c227-42e4-8df0-b81ad319e4a7 req-788b8c16-4677-4f9d-b036-4979b3504738 service nova] Acquiring lock "refresh_cache-5d8c2bb9-680c-4a83-876f-3be446a4c0f8" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:17:34.875288 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:35.176029 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:17:35.176477 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963455.1762116, 9ba4df01-b7d4-43df-9c63-c190784d5584 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:17:35.176645 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] VM Paused (Lifecycle Event)
May 28 10:17:35.179394 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Took 9.42 seconds to spawn the instance on the hypervisor.
May 28 10:17:35.179638 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:17:35.192126 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Releasing lock "refresh_cache-5d8c2bb9-680c-4a83-876f-3be446a4c0f8" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:17:35.192411 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Instance network_info: |[{"id": "f9ff28e0-ba0e-42c9-9b36-7d9719abe94e", "address": "fa:16:3e:9d:d1:c1", "network": {"id": "fd85d7ca-665d-4c88-a0fc-f5b183b538d1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-852450606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dd45e575a1740e8aa1c09f4f908d747", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9ff28e0-ba", "ovs_interfaceid": "f9ff28e0-ba0e-42c9-9b36-7d9719abe94e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:17:35.194935 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Start _get_guest_xml network_info=[{"id": "f9ff28e0-ba0e-42c9-9b36-7d9719abe94e", "address": "fa:16:3e:9d:d1:c1", "network": {"id": "fd85d7ca-665d-4c88-a0fc-f5b183b538d1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-852450606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dd45e575a1740e8aa1c09f4f908d747", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9ff28e0-ba", "ovs_interfaceid": "f9ff28e0-ba0e-42c9-9b36-7d9719abe94e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:17:35.195985 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2d4ced40-c227-42e4-8df0-b81ad319e4a7 req-788b8c16-4677-4f9d-b036-4979b3504738 service nova] Acquired lock "refresh_cache-5d8c2bb9-680c-4a83-876f-3be446a4c0f8" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:17:35.198230 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-2d4ced40-c227-42e4-8df0-b81ad319e4a7 req-788b8c16-4677-4f9d-b036-4979b3504738 service nova] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Refreshing network info cache for port f9ff28e0-ba0e-42c9-9b36-7d9719abe94e {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:17:35.202173 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:17:35.203756 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-1379017230', uuid='5d8c2bb9-680c-4a83-876f-3be446a4c0f8'), owner=OwnerMeta(userid='f68f80c0467244b696935ee039759675', username='tempest-VolumeMultiattachTests-1491725275-project-member', projectid='9dd45e575a1740e8aa1c09f4f908d747', projectname='tempest-VolumeMultiattachTests-1491725275'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f9ff28e0-ba0e-42c9-9b36-7d9719abe94e", "address": "fa:16:3e:9d:d1:c1", "network": {"id": "fd85d7ca-665d-4c88-a0fc-f5b183b538d1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-852450606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dd45e575a1740e8aa1c09f4f908d747", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9ff28e0-ba", "ovs_interfaceid": "f9ff28e0-ba0e-42c9-9b36-7d9719abe94e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779963455.2032971) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:17:35.207613 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:17:35.207989 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:17:35.210108 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:17:35.210318 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:17:35.211589 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:17:35.211990 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:17:35.212243 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:17:35.212375 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:17:35.212530 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:17:35.212653 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:17:35.212761 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:17:35.212966 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:17:35.213091 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:17:35.213294 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:17:35.214948 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:17:35.215112 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:17:35.224267 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:35.236187 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:17:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1379017230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumemultiattachtests-server-1379017230',id=80,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwYjtkPyDRwaN7lG/Ges1nPjaQJSEIkreLgqYiqypDXxmPWGcyfsisy2A7gM0FS3C15tLuAwP3yhgLZ3hrVGouaoGnnTGGlktMEdDHF0SzKTbbZlRZ7yxKDPVse6ZbzNg==',key_name='tempest-keypair-344224413',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dd45e575a1740e8aa1c09f4f908d747',ramdisk_id='',reservation_id='r-gbylvyai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1491725275',owner_user_name='tempest-VolumeMultiattachTests-1491725275-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:17:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f68f80c0467244b696935ee039759675',uuid=5d8c2bb9-680c-4a83-876f-3be446a4c0f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9ff28e0-ba0e-42c9-9b36-7d9719abe94e", "address": "fa:16:3e:9d:d1:c1", "network": {"id": "fd85d7ca-665d-4c88-a0fc-f5b183b538d1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-852450606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dd45e575a1740e8aa1c09f4f908d747", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9ff28e0-ba", "ovs_interfaceid": "f9ff28e0-ba0e-42c9-9b36-7d9719abe94e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:17:35.236187 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Converting VIF {"id": "f9ff28e0-ba0e-42c9-9b36-7d9719abe94e", "address": "fa:16:3e:9d:d1:c1", "network": {"id": "fd85d7ca-665d-4c88-a0fc-f5b183b538d1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-852450606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dd45e575a1740e8aa1c09f4f908d747", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9ff28e0-ba", "ovs_interfaceid": "f9ff28e0-ba0e-42c9-9b36-7d9719abe94e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:17:35.237081 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:d1:c1,bridge_name='br-int',has_traffic_filtering=True,id=f9ff28e0-ba0e-42c9-9b36-7d9719abe94e,network=Network(fd85d7ca-665d-4c88-a0fc-f5b183b538d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9ff28e0-ba') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:17:35.237288 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lazy-loading 'pci_devices' on Instance uuid 5d8c2bb9-680c-4a83-876f-3be446a4c0f8 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:17:35.685064 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:17:35.689416 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963455.6890903, 9ba4df01-b7d4-43df-9c63-c190784d5584 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:17:35.689710 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] VM Resumed (Lifecycle Event)
May 28 10:17:35.691823 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Took 16.40 seconds to build instance.
May 28 10:17:35.706326 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-2d4ced40-c227-42e4-8df0-b81ad319e4a7 req-788b8c16-4677-4f9d-b036-4979b3504738 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:17:35.742017 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] End _get_guest_xml xml=<domain type="qemu">
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:   <uuid>5d8c2bb9-680c-4a83-876f-3be446a4c0f8</uuid>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:   <name>instance-00000050</name>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:       <nova:name>tempest-VolumeMultiattachTests-server-1379017230</nova:name>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:17:35</nova:creationTime>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:         <nova:user uuid="f68f80c0467244b696935ee039759675">tempest-VolumeMultiattachTests-1491725275-project-member</nova:user>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:         <nova:project uuid="9dd45e575a1740e8aa1c09f4f908d747">tempest-VolumeMultiattachTests-1491725275</nova:project>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:         <nova:port uuid="f9ff28e0-ba0e-42c9-9b36-7d9719abe94e">
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:     <system>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:       <entry name="serial">5d8c2bb9-680c-4a83-876f-3be446a4c0f8</entry>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:       <entry name="uuid">5d8c2bb9-680c-4a83-876f-3be446a4c0f8</entry>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:     </system>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:   <os>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:   </os>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:   <features>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:   </features>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:   <devices>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/5d8c2bb9-680c-4a83-876f-3be446a4c0f8/disk"/>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:     </disk>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/5d8c2bb9-680c-4a83-876f-3be446a4c0f8/disk.config"/>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:     </disk>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:9d:d1:c1"/>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:       <target dev="tapf9ff28e0-ba"/>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:     </interface>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/5d8c2bb9-680c-4a83-876f-3be446a4c0f8/console.log" append="off"/>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:     </serial>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:     <video>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:     </video>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:     </rng>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:   </devices>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]: </domain>
May 28 10:17:35.742017 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:17:35.744975 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Preparing to wait for external event network-vif-plugged-f9ff28e0-ba0e-42c9-9b36-7d9719abe94e {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:17:35.744975 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:17:35.744975 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:17:35.744975 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:17:35.744975 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:17:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1379017230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumemultiattachtests-server-1379017230',id=80,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwYjtkPyDRwaN7lG/Ges1nPjaQJSEIkreLgqYiqypDXxmPWGcyfsisy2A7gM0FS3C15tLuAwP3yhgLZ3hrVGouaoGnnTGGlktMEdDHF0SzKTbbZlRZ7yxKDPVse6ZbzNg==',key_name='tempest-keypair-344224413',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dd45e575a1740e8aa1c09f4f908d747',ramdisk_id='',reservation_id='r-gbylvyai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1491725275',owner_user_name='tempest-VolumeMultiattachTests-1491725275-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:17:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f68f80c0467244b696935ee039759675',uuid=5d8c2bb9-680c-4a83-876f-3be446a4c0f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9ff28e0-ba0e-42c9-9b36-7d9719abe94e", "address": "fa:16:3e:9d:d1:c1", "network": {"id": "fd85d7ca-665d-4c88-a0fc-f5b183b538d1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-852450606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dd45e575a1740e8aa1c09f4f908d747", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9ff28e0-ba", "ovs_interfaceid": "f9ff28e0-ba0e-42c9-9b36-7d9719abe94e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:17:35.744975 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Converting VIF {"id": "f9ff28e0-ba0e-42c9-9b36-7d9719abe94e", "address": "fa:16:3e:9d:d1:c1", "network": {"id": "fd85d7ca-665d-4c88-a0fc-f5b183b538d1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-852450606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dd45e575a1740e8aa1c09f4f908d747", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9ff28e0-ba", "ovs_interfaceid": "f9ff28e0-ba0e-42c9-9b36-7d9719abe94e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:17:35.744975 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:d1:c1,bridge_name='br-int',has_traffic_filtering=True,id=f9ff28e0-ba0e-42c9-9b36-7d9719abe94e,network=Network(fd85d7ca-665d-4c88-a0fc-f5b183b538d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9ff28e0-ba') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:17:35.745838 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:d1:c1,bridge_name='br-int',has_traffic_filtering=True,id=f9ff28e0-ba0e-42c9-9b36-7d9719abe94e,network=Network(fd85d7ca-665d-4c88-a0fc-f5b183b538d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9ff28e0-ba') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:17:35.746347 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:35.746622 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:17:35.746930 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:17:35.747847 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:35.748082 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e7cb6b96-a034-5e07-b934-d9fc6bb9bc44', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:17:35.751196 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:35.751196 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:17:35.751637 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:35.756546 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:35.756746 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9ff28e0-ba, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:17:35.758190 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf9ff28e0-ba, col_values=(('qos', UUID('46fb8b90-525e-41b4-a2bd-d7eca8cb1cd2')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:17:35.758190 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf9ff28e0-ba, col_values=(('external_ids', {'iface-id': 'f9ff28e0-ba0e-42c9-9b36-7d9719abe94e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:d1:c1', 'vm-uuid': '5d8c2bb9-680c-4a83-876f-3be446a4c0f8'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:17:35.762344 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:17:35.766518 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:35.767502 np0000001613 nova-compute[98321]: INFO os_vif [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:d1:c1,bridge_name='br-int',has_traffic_filtering=True,id=f9ff28e0-ba0e-42c9-9b36-7d9719abe94e,network=Network(fd85d7ca-665d-4c88-a0fc-f5b183b538d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9ff28e0-ba')
May 28 10:17:36.024182 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-2d4ced40-c227-42e4-8df0-b81ad319e4a7 req-788b8c16-4677-4f9d-b036-4979b3504738 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:17:36.161348 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-2d4ced40-c227-42e4-8df0-b81ad319e4a7 req-788b8c16-4677-4f9d-b036-4979b3504738 service nova] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Updated VIF entry in instance network info cache for port f9ff28e0-ba0e-42c9-9b36-7d9719abe94e. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:17:36.161625 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-2d4ced40-c227-42e4-8df0-b81ad319e4a7 req-788b8c16-4677-4f9d-b036-4979b3504738 service nova] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Updating instance_info_cache with network_info: [{"id": "f9ff28e0-ba0e-42c9-9b36-7d9719abe94e", "address": "fa:16:3e:9d:d1:c1", "network": {"id": "fd85d7ca-665d-4c88-a0fc-f5b183b538d1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-852450606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dd45e575a1740e8aa1c09f4f908d747", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9ff28e0-ba", "ovs_interfaceid": "f9ff28e0-ba0e-42c9-9b36-7d9719abe94e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:17:36.193421 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:17:36.194441 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-1f44556f-77e4-42a9-90ac-31a63d0b8166 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "9ba4df01-b7d4-43df-9c63-c190784d5584" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.910s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:17:36.196576 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:17:36.665722 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2d4ced40-c227-42e4-8df0-b81ad319e4a7 req-788b8c16-4677-4f9d-b036-4979b3504738 service nova] Releasing lock "refresh_cache-5d8c2bb9-680c-4a83-876f-3be446a4c0f8" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:17:36.723289 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.0003837949998342083 future=<Future at 0x73c1f4245d90 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:17:36.723289 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] Emitting event <LifecycleEvent: 1779963441.7221875, 476c3a01-2dd3-46b3-acae-8e0c236760ee => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:17:36.723445 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:17:36.724033 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] VM Stopped (Lifecycle Event)
May 28 10:17:37.227246 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-c9208449-bd3c-4739-b449-a20b4d8e70ed tempest-TestServerVolumeAttachScenarioOldVersion-1790847208 tempest-TestServerVolumeAttachScenarioOldVersion-1790847208-project-member] [instance: 476c3a01-2dd3-46b3-acae-8e0c236760ee] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:17:37.291984 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:17:37.292084 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:17:37.292208 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] No VIF found with MAC fa:16:3e:9d:d1:c1, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:17:37.292565 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Using config drive
May 28 10:17:37.798146 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:17:37.919741 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Creating config drive at /opt/stack/data/nova/instances/5d8c2bb9-680c-4a83-876f-3be446a4c0f8/disk.config
May 28 10:17:37.924941 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5d8c2bb9-680c-4a83-876f-3be446a4c0f8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp64nhoqzr {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:17:37.952118 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-dfdaa415-05f3-42b9-93ba-0cfbc6e02bb8 req-4154e8db-f7c8-471c-989a-dcd4aff81ee2 service nova] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Received event network-changed-8c4c3171-55fb-44b2-866e-e7f47fa6f006 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:17:37.953646 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-dfdaa415-05f3-42b9-93ba-0cfbc6e02bb8 req-4154e8db-f7c8-471c-989a-dcd4aff81ee2 service nova] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Refreshing instance network info cache due to event network-changed-8c4c3171-55fb-44b2-866e-e7f47fa6f006. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:17:37.954525 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-dfdaa415-05f3-42b9-93ba-0cfbc6e02bb8 req-4154e8db-f7c8-471c-989a-dcd4aff81ee2 service nova] Acquiring lock "refresh_cache-9ba4df01-b7d4-43df-9c63-c190784d5584" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:17:37.955332 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-dfdaa415-05f3-42b9-93ba-0cfbc6e02bb8 req-4154e8db-f7c8-471c-989a-dcd4aff81ee2 service nova] Acquired lock "refresh_cache-9ba4df01-b7d4-43df-9c63-c190784d5584" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:17:37.955542 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-dfdaa415-05f3-42b9-93ba-0cfbc6e02bb8 req-4154e8db-f7c8-471c-989a-dcd4aff81ee2 service nova] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Refreshing network info cache for port 8c4c3171-55fb-44b2-866e-e7f47fa6f006 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:17:37.985852 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5d8c2bb9-680c-4a83-876f-3be446a4c0f8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp64nhoqzr" returned: 0 in 0.061s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:17:38.429539 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:38.454055 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:38.462961 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-dfdaa415-05f3-42b9-93ba-0cfbc6e02bb8 req-4154e8db-f7c8-471c-989a-dcd4aff81ee2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:17:38.527808 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:38.666790 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4f6d7001-3061-401f-afc6-51c19095d303 req-79568b2c-994f-4882-89bc-b9345bb2fbb9 service nova] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Received event network-vif-plugged-f9ff28e0-ba0e-42c9-9b36-7d9719abe94e {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:17:38.666790 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4f6d7001-3061-401f-afc6-51c19095d303 req-79568b2c-994f-4882-89bc-b9345bb2fbb9 service nova] Acquiring lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:17:38.666790 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4f6d7001-3061-401f-afc6-51c19095d303 req-79568b2c-994f-4882-89bc-b9345bb2fbb9 service nova] Lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:17:38.666905 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-4f6d7001-3061-401f-afc6-51c19095d303 req-79568b2c-994f-4882-89bc-b9345bb2fbb9 service nova] Lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:17:38.666942 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-4f6d7001-3061-401f-afc6-51c19095d303 req-79568b2c-994f-4882-89bc-b9345bb2fbb9 service nova] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Processing event network-vif-plugged-f9ff28e0-ba0e-42c9-9b36-7d9719abe94e {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:17:38.817351 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:38.820258 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:38.822368 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:38.823577 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:38.840820 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:38.886240 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-dfdaa415-05f3-42b9-93ba-0cfbc6e02bb8 req-4154e8db-f7c8-471c-989a-dcd4aff81ee2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:17:39.034375 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-dfdaa415-05f3-42b9-93ba-0cfbc6e02bb8 req-4154e8db-f7c8-471c-989a-dcd4aff81ee2 service nova] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Updated VIF entry in instance network info cache for port 8c4c3171-55fb-44b2-866e-e7f47fa6f006. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:17:39.034918 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-dfdaa415-05f3-42b9-93ba-0cfbc6e02bb8 req-4154e8db-f7c8-471c-989a-dcd4aff81ee2 service nova] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Updating instance_info_cache with network_info: [{"id": "8c4c3171-55fb-44b2-866e-e7f47fa6f006", "address": "fa:16:3e:76:2c:61", "network": {"id": "07ee30b7-dd9c-433d-81cc-42ab11aded18", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1881482359-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a515533ba1c4e23a52f472549e5211f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c4c3171-55", "ovs_interfaceid": "8c4c3171-55fb-44b2-866e-e7f47fa6f006", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:17:39.183129 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963459.182489, 5d8c2bb9-680c-4a83-876f-3be446a4c0f8 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:17:39.183275 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] VM Started (Lifecycle Event)
May 28 10:17:39.186058 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:17:39.187097 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:17:39.190009 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Instance spawned successfully.
May 28 10:17:39.190338 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:17:39.538861 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-dfdaa415-05f3-42b9-93ba-0cfbc6e02bb8 req-4154e8db-f7c8-471c-989a-dcd4aff81ee2 service nova] Releasing lock "refresh_cache-9ba4df01-b7d4-43df-9c63-c190784d5584" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:17:39.687000 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:17:39.689228 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:17:39.697678 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:17:39.697842 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:17:39.698198 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:17:39.698533 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:17:39.698890 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:17:39.699117 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:17:40.191403 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:17:40.191650 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963460.1914937, 5d8c2bb9-680c-4a83-876f-3be446a4c0f8 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:17:40.191745 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] VM Paused (Lifecycle Event)
May 28 10:17:40.208353 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Took 6.10 seconds to spawn the instance on the hypervisor.
May 28 10:17:40.208581 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:17:40.219124 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:40.693890 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:17:40.696353 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963460.6960905, 5d8c2bb9-680c-4a83-876f-3be446a4c0f8 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:17:40.696515 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] VM Resumed (Lifecycle Event)
May 28 10:17:40.718127 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Took 11.31 seconds to build instance.
May 28 10:17:40.728660 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-9674b2a8-eeae-4cfa-89fa-17da31dd2bd7 req-4444b6e2-4f58-4bee-a3af-25fcf94c62e9 service nova] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Received event network-vif-plugged-f9ff28e0-ba0e-42c9-9b36-7d9719abe94e {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:17:40.729080 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9674b2a8-eeae-4cfa-89fa-17da31dd2bd7 req-4444b6e2-4f58-4bee-a3af-25fcf94c62e9 service nova] Acquiring lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:17:40.729223 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9674b2a8-eeae-4cfa-89fa-17da31dd2bd7 req-4444b6e2-4f58-4bee-a3af-25fcf94c62e9 service nova] Lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:17:40.729350 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9674b2a8-eeae-4cfa-89fa-17da31dd2bd7 req-4444b6e2-4f58-4bee-a3af-25fcf94c62e9 service nova] Lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:17:40.729451 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-9674b2a8-eeae-4cfa-89fa-17da31dd2bd7 req-4444b6e2-4f58-4bee-a3af-25fcf94c62e9 service nova] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] No waiting events found dispatching network-vif-plugged-f9ff28e0-ba0e-42c9-9b36-7d9719abe94e {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:17:40.729531 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-9674b2a8-eeae-4cfa-89fa-17da31dd2bd7 req-4444b6e2-4f58-4bee-a3af-25fcf94c62e9 service nova] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Received unexpected event network-vif-plugged-f9ff28e0-ba0e-42c9-9b36-7d9719abe94e for instance with vm_state active and task_state None.
May 28 10:17:40.758982 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:41.199723 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:17:41.201971 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:17:41.220153 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.817s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:17:41.441803 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cda95f1e-d86f-43f1-a946-1908e2016432 req-eb88c541-56d4-49a2-b764-653b780aa947 service nova] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Received event network-changed-f9ff28e0-ba0e-42c9-9b36-7d9719abe94e {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:17:41.442050 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cda95f1e-d86f-43f1-a946-1908e2016432 req-eb88c541-56d4-49a2-b764-653b780aa947 service nova] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Refreshing instance network info cache due to event network-changed-f9ff28e0-ba0e-42c9-9b36-7d9719abe94e. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:17:41.442241 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cda95f1e-d86f-43f1-a946-1908e2016432 req-eb88c541-56d4-49a2-b764-653b780aa947 service nova] Acquiring lock "refresh_cache-5d8c2bb9-680c-4a83-876f-3be446a4c0f8" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:17:41.442404 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cda95f1e-d86f-43f1-a946-1908e2016432 req-eb88c541-56d4-49a2-b764-653b780aa947 service nova] Acquired lock "refresh_cache-5d8c2bb9-680c-4a83-876f-3be446a4c0f8" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:17:41.442568 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-cda95f1e-d86f-43f1-a946-1908e2016432 req-eb88c541-56d4-49a2-b764-653b780aa947 service nova] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Refreshing network info cache for port f9ff28e0-ba0e-42c9-9b36-7d9719abe94e {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:17:41.944881 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-cda95f1e-d86f-43f1-a946-1908e2016432 req-eb88c541-56d4-49a2-b764-653b780aa947 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:17:42.229003 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-cda95f1e-d86f-43f1-a946-1908e2016432 req-eb88c541-56d4-49a2-b764-653b780aa947 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:17:42.379690 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-cda95f1e-d86f-43f1-a946-1908e2016432 req-eb88c541-56d4-49a2-b764-653b780aa947 service nova] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Updated VIF entry in instance network info cache for port f9ff28e0-ba0e-42c9-9b36-7d9719abe94e. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:17:42.379690 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-cda95f1e-d86f-43f1-a946-1908e2016432 req-eb88c541-56d4-49a2-b764-653b780aa947 service nova] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Updating instance_info_cache with network_info: [{"id": "f9ff28e0-ba0e-42c9-9b36-7d9719abe94e", "address": "fa:16:3e:9d:d1:c1", "network": {"id": "fd85d7ca-665d-4c88-a0fc-f5b183b538d1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-852450606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dd45e575a1740e8aa1c09f4f908d747", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9ff28e0-ba", "ovs_interfaceid": "f9ff28e0-ba0e-42c9-9b36-7d9719abe94e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:17:42.880919 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cda95f1e-d86f-43f1-a946-1908e2016432 req-eb88c541-56d4-49a2-b764-653b780aa947 service nova] Releasing lock "refresh_cache-5d8c2bb9-680c-4a83-876f-3be446a4c0f8" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:17:45.223192 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:45.760351 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:50.232013 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:50.761684 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:55.233820 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:17:55.762654 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:00.237246 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:00.763686 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:04.791593 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:18:04.792126 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:18:05.237012 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:05.764790 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:05.787994 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:18:05.788542 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:18:05.791497 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:18:05.791937 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:18:05.792294 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:18:05.792294 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 10:18:05.792429 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:18:06.299105 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:18:06.299354 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:18:06.299546 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:18:06.299830 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Auditing locally available compute resources for np0000001613 (node: np0000001613) {{(pid=98321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 10:18:07.323524 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-0 (vda) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:18:07.324798 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d8c2bb9-680c-4a83-876f-3be446a4c0f8/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:18:07.411127 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d8c2bb9-680c-4a83-876f-3be446a4c0f8/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:18:07.411565 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d8c2bb9-680c-4a83-876f-3be446a4c0f8/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:18:07.501946 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d8c2bb9-680c-4a83-876f-3be446a4c0f8/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:18:07.506387 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:18:07.507574 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:18:07.558463 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "env LANG=C uptime" returned: 0 in 0.050s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:18:07.559334 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Hypervisor/Node resource view: name=np0000001613 free_ram=12991MB free_disk=72.56420516967773GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 10:18:07.559588 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:18:07.559943 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:18:08.094650 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:18:08.094833 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:18:08.598118 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lazy-loading 'flavor' on Instance uuid 5d8c2bb9-680c-4a83-876f-3be446a4c0f8 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:18:08.618436 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 9ba4df01-b7d4-43df-9c63-c190784d5584 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:18:08.618713 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 5d8c2bb9-680c-4a83-876f-3be446a4c0f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:18:08.618885 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 10:18:08.619026 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Final resource view: name=np0000001613 phys_ram=24030MB used_ram=896MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 10:18:07 up 50 min,  2 users,  load average: 2.87, 4.94, 5.03\n', 'num_instances': '2', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '2', 'num_proj_2a515533ba1c4e23a52f472549e5211f': '1', 'io_workload': '0', 'num_proj_9dd45e575a1740e8aa1c09f4f908d747': '1'} {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 10:18:08.741109 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:18:08.741349 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:18:09.243827 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:18:09.604435 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:18:09.750269 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Compute_service record updated for np0000001613:np0000001613 {{(pid=98321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 10:18:09.750474 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.191s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:18:09.750817 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:18:10.238296 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:10.687338 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:18:10.687803 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:18:10.687803 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Attaching volume 2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 to /dev/vdb
May 28 10:18:10.724481 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:18:10.735068 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:18:10.757755 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:18:10.769305 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:10.801686 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:18:10.801997 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:18:10.811254 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:18:10.812311 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe76:2c61', 'fe80::428:aaff:fee4:e565', 'fe80::fc16:3eff:fe9d:d1c1', 'fe80::b01d:8aff:fede:b711'] 
May 28 10:18:10.812448 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:18:10.812544 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:18:10.812760 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] <== get_connector_properties: return (88ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:18:10.812997 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Updating existing volume attachment record: 57cf6915-68a1-48cc-b126-23d0dcd64301 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:18:11.365141 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:18:11.365469 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7', 'iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2a3987dd-17ca-4f7d-b97b-b69ce400fbd7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:18:11.365700 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:18:11.366110 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:18:11.366333 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7', 'iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2a3987dd-17ca-4f7d-b97b-b69ce400fbd7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:18:11.378095 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:18:11.379495 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:18:11.379989 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:18:11.380283 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:18:11.380955 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:18:11.381032 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:18:11.393759 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:18:11.393759 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:11.399012 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:18:11.399012 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:11.406651 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7] added
May 28 10:18:11.406651 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:18:11.406651 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:18:11.406651 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:18:11.406651 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:18:11.406651 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:18:11.406651 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:11.406899 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:18:11.406989 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0267(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:18:11.407146 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:18:11.409922 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7] added
May 28 10:18:11.409922 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:18:11.409922 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:18:11.409922 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:18:11.409922 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:18:11.409922 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:18:11.409922 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:11.410250 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:18:11.410310 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0292(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:18:11.410466 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:18:12.407539 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:18:12.410877 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:18:12.419604 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:18:12.419604 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:18:12.425048 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:18:12.425048 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:12.430911 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:12.435377 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:12.441960 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9 (non-flash)
May 28 10:18:12.441960 np0000001613 nova-compute[98321]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9 (non-flash)
May 28 10:18:12.441960 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:18:12.442124 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsi session list stdout=tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9 (non-flash)
May 28 10:18:12.442124 np0000001613 nova-compute[98321]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9 (non-flash)
May 28 10:18:12.442124 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:18:12.446598 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9 (non-flash)
May 28 10:18:12.446598 np0000001613 nova-compute[98321]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9 (non-flash)
May 28 10:18:12.446598 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:18:12.446786 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsi session list stdout=tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9 (non-flash)
May 28 10:18:12.446786 np0000001613 nova-compute[98321]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9 (non-flash)
May 28 10:18:12.446786 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:18:12.472660 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7, portal: 192.168.40.100,3260]
May 28 10:18:12.472660 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7, portal: 192.168.40.100,3260] successful.
May 28 10:18:12.472660 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:12.484405 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:12.499238 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7, portal: 192.168.50.100,3260]
May 28 10:18:12.499238 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7, portal: 192.168.50.100,3260] successful.
May 28 10:18:12.499238 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:12.499624 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9 (non-flash)
May 28 10:18:12.499624 np0000001613 nova-compute[98321]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9 (non-flash)
May 28 10:18:12.499624 np0000001613 nova-compute[98321]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:12.499624 np0000001613 nova-compute[98321]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:12.499624 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:18:12.499788 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsi session list stdout=tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9 (non-flash)
May 28 10:18:12.499788 np0000001613 nova-compute[98321]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9 (non-flash)
May 28 10:18:12.499788 np0000001613 nova-compute[98321]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:12.499788 np0000001613 nova-compute[98321]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:12.499788 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:18:12.500152 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.120s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:18:12.500324 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:18:12.500907 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] HCTL ('9', '-', '-', 0) found on session 227 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:18:12.501048 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:18:12.509523 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:12.515510 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Searching for a device in session 227 and hctl ['9', '*', '*', 0] yield: None {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:18:12.521955 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9 (non-flash)
May 28 10:18:12.521955 np0000001613 nova-compute[98321]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9 (non-flash)
May 28 10:18:12.521955 np0000001613 nova-compute[98321]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:12.521955 np0000001613 nova-compute[98321]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:12.521955 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:18:12.522083 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsi session list stdout=tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9 (non-flash)
May 28 10:18:12.522083 np0000001613 nova-compute[98321]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9 (non-flash)
May 28 10:18:12.522083 np0000001613 nova-compute[98321]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:12.522083 np0000001613 nova-compute[98321]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:12.522083 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:18:12.522362 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.142s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:18:12.522470 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:18:12.522989 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] HCTL ('10', '-', '-', 0) found on session 228 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:18:12.523096 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:18:12.537354 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Searching for a device in session 228 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:18:12.537354 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2a3987dd-17ca-4f7d-b97b-b69ce400fbd7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:18:12.853697 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:13.131821 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:13.515665 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Searching for a device in session 227 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:18:13.516226 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2a3987dd-17ca-4f7d-b97b-b69ce400fbd7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:18:13.750221 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:18:13.750521 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:18:13.750842 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 51.04 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:18:14.397670 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Found WWN 3300000007b30c6a7 for multipath device dm-1 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:18:14.397937 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:18:14.398092 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '3300000007b30c6a7', 'path': '/dev/dm-1', 'multipath_id': '3300000007b30c6a7'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:18:14.398230 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007b30c6a7', 'path': '/dev/dm-1', 'multipath_id': '3300000007b30c6a7'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:18:14.401050 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lazy-loading 'flavor' on Instance uuid 5d8c2bb9-680c-4a83-876f-3be446a4c0f8 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:18:14.904147 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Attempting to attach volume 2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 10:18:14.905387 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] attach device xml: <disk type="block" device="disk">
May 28 10:18:14.905387 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:18:14.905387 np0000001613 nova-compute[98321]:   <alias name="ua-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7"/>
May 28 10:18:14.905387 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-1"/>
May 28 10:18:14.905387 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:18:14.905387 np0000001613 nova-compute[98321]:   <serial>2a3987dd-17ca-4f7d-b97b-b69ce400fbd7</serial>
May 28 10:18:14.905387 np0000001613 nova-compute[98321]: </disk>
May 28 10:18:14.905387 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 10:18:15.014618 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquiring lock "9ba4df01-b7d4-43df-9c63-c190784d5584" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:18:15.014798 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "9ba4df01-b7d4-43df-9c63-c190784d5584" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:18:15.014988 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquiring lock "9ba4df01-b7d4-43df-9c63-c190784d5584-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:18:15.015105 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "9ba4df01-b7d4-43df-9c63-c190784d5584-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:18:15.015230 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "9ba4df01-b7d4-43df-9c63-c190784d5584-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:18:15.017286 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Terminating instance
May 28 10:18:15.250612 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:15.519907 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:18:15.534300 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:15.536924 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:15.551238 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:15.571783 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:15.722752 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-9aa5ab05-320f-4cdc-a8c5-3dcb1df38e17 req-5ee4e4c9-067d-46e1-98af-dc7497caa0a6 service nova] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Received event network-vif-unplugged-8c4c3171-55fb-44b2-866e-e7f47fa6f006 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:18:15.723422 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9aa5ab05-320f-4cdc-a8c5-3dcb1df38e17 req-5ee4e4c9-067d-46e1-98af-dc7497caa0a6 service nova] Acquiring lock "9ba4df01-b7d4-43df-9c63-c190784d5584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:18:15.723602 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9aa5ab05-320f-4cdc-a8c5-3dcb1df38e17 req-5ee4e4c9-067d-46e1-98af-dc7497caa0a6 service nova] Lock "9ba4df01-b7d4-43df-9c63-c190784d5584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:18:15.723756 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-9aa5ab05-320f-4cdc-a8c5-3dcb1df38e17 req-5ee4e4c9-067d-46e1-98af-dc7497caa0a6 service nova] Lock "9ba4df01-b7d4-43df-9c63-c190784d5584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:18:15.723898 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-9aa5ab05-320f-4cdc-a8c5-3dcb1df38e17 req-5ee4e4c9-067d-46e1-98af-dc7497caa0a6 service nova] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] No waiting events found dispatching network-vif-unplugged-8c4c3171-55fb-44b2-866e-e7f47fa6f006 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:18:15.724018 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-9aa5ab05-320f-4cdc-a8c5-3dcb1df38e17 req-5ee4e4c9-067d-46e1-98af-dc7497caa0a6 service nova] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Received event network-vif-unplugged-8c4c3171-55fb-44b2-866e-e7f47fa6f006 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:18:15.771749 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:15.816860 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:15.825558 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:15.845049 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999672150000151 future=<Future at 0x73c1f470e810 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:18:15.845394 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999308283000119 future=<Future at 0x73c1f470e810 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:18:15.845580 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999146432000089 future=<Future at 0x73c1f470e810 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:18:15.847263 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Instance destroyed successfully.
May 28 10:18:15.847672 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lazy-loading 'resources' on Instance uuid 9ba4df01-b7d4-43df-9c63-c190784d5584 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:18:16.350040 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:17:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-381336326',display_name='tempest-TestEncryptedCinderVolumes-server-381336326',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-testencryptedcindervolumes-server-381336326',id=79,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpoRVALe7c4eQpRGN1VpZp9dYLl+jRMKefrPnTrudxsOQfg/5SdK2JJSsZS0Z3ILznoiWwVdnG5s+L6s6eVazdKobR/BLpkSVCCl0f5CnhsJ7UyqsnyUak+PFh9njYeag==',key_name='tempest-TestEncryptedCinderVolumes-1905729309',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:17:35Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a515533ba1c4e23a52f472549e5211f',ramdisk_id='',reservation_id='r-svk1lmwg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestEncryptedCinderVolumes-678033643',owner_user_name='tempest-TestEncryptedCinderVolumes-678033643-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:17:35Z,user_data=None,user_id='cabed30cb95f4f7b9f96187fc336f7c4',uuid=9ba4df01-b7d4-43df-9c63-c190784d5584,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c4c3171-55fb-44b2-866e-e7f47fa6f006", "address": "fa:16:3e:76:2c:61", "network": {"id": "07ee30b7-dd9c-433d-81cc-42ab11aded18", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1881482359-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a515533ba1c4e23a52f472549e5211f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c4c3171-55", "ovs_interfaceid": "8c4c3171-55fb-44b2-866e-e7f47fa6f006", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:18:16.350598 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Converting VIF {"id": "8c4c3171-55fb-44b2-866e-e7f47fa6f006", "address": "fa:16:3e:76:2c:61", "network": {"id": "07ee30b7-dd9c-433d-81cc-42ab11aded18", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1881482359-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a515533ba1c4e23a52f472549e5211f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c4c3171-55", "ovs_interfaceid": "8c4c3171-55fb-44b2-866e-e7f47fa6f006", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:18:16.350944 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:2c:61,bridge_name='br-int',has_traffic_filtering=True,id=8c4c3171-55fb-44b2-866e-e7f47fa6f006,network=Network(07ee30b7-dd9c-433d-81cc-42ab11aded18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c4c3171-55') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:18:16.351208 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:2c:61,bridge_name='br-int',has_traffic_filtering=True,id=8c4c3171-55fb-44b2-866e-e7f47fa6f006,network=Network(07ee30b7-dd9c-433d-81cc-42ab11aded18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c4c3171-55') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:18:16.352540 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:16.352821 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c4c3171-55, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:18:16.369562 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:16.370291 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:18:16.370548 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:16.371139 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:16.371269 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=de4d47f9-c262-4bf8-b1fc-0ca42ab9a0ad) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:18:16.371643 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:16.372047 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:18:16.372251 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:16.373977 np0000001613 nova-compute[98321]: INFO os_vif [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:2c:61,bridge_name='br-int',has_traffic_filtering=True,id=8c4c3171-55fb-44b2-866e-e7f47fa6f006,network=Network(07ee30b7-dd9c-433d-81cc-42ab11aded18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c4c3171-55')
May 28 10:18:16.377118 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:18:16.377426 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9', 'iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1935bb06-9875-461e-b2c4-772dd575ffa9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:18:16.377547 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:18:16.377882 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:18:16.378180 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9', 'iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1935bb06-9875-461e-b2c4-772dd575ffa9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:18:16.378331 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:18:16.398687 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9 (non-flash)
May 28 10:18:16.398687 np0000001613 nova-compute[98321]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9 (non-flash)
May 28 10:18:16.398687 np0000001613 nova-compute[98321]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:16.398687 np0000001613 nova-compute[98321]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:16.398687 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:18:16.398896 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsi session list stdout=tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9 (non-flash)
May 28 10:18:16.398896 np0000001613 nova-compute[98321]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9 (non-flash)
May 28 10:18:16.398896 np0000001613 nova-compute[98321]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:16.398896 np0000001613 nova-compute[98321]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:16.398896 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:18:16.398997 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9', '223'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9', '224'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7', '227'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7', '228')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:18:16.398997 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9', '223')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:18:16.399916 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9', '224')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:18:16.400562 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc7dc720>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9'): ({'sdc'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:18:16.400774 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Removing multipathed devices sdb, sdc {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:18:16.401004 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Flush multipath device 33000000096066f8d {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:18:16.429958 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:18:16.469463 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:18:16.511553 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:18:16.511691 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:18:16.512371 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:18:16.522936 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:18:16.523107 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:18:16.533821 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:16.534885 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:18:16.535142 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:18:16.535271 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:18:16.535381 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] No VIF found with MAC fa:16:3e:9d:d1:c1, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:18:16.565027 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 223, target: iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9, portal: 192.168.40.100,3260]
May 28 10:18:16.565027 np0000001613 nova-compute[98321]: Logout of [sid: 223, target: iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9, portal: 192.168.40.100,3260] successful.
May 28 10:18:16.565027 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:16.577758 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:16.587003 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:16.612010 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 224, target: iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9, portal: 192.168.50.100,3260]
May 28 10:18:16.612010 np0000001613 nova-compute[98321]: Logout of [sid: 224, target: iqn.2023-03.storpool.com:os--volume-1935bb06-9875-461e-b2c4-772dd575ffa9, portal: 192.168.50.100,3260] successful.
May 28 10:18:16.612010 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:16.623567 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:16.624374 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.246s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:18:16.624496 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] <== disconnect_volume: return (246ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:18:16.624612 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:18:16.624860 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Deleting instance files /opt/stack/data/nova/instances/9ba4df01-b7d4-43df-9c63-c190784d5584_del
May 28 10:18:16.625333 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Deletion of /opt/stack/data/nova/instances/9ba4df01-b7d4-43df-9c63-c190784d5584_del complete
May 28 10:18:17.131653 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Took 1.61 seconds to destroy the instance on the hypervisor.
May 28 10:18:17.132289 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:18:17.132570 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:18:17.132676 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:18:17.132929 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:18:17.187670 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:18:17.640569 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ed41cd89-fe62-4c89-ab0c-f8f4ef4f24f9 req-a8d8cc35-1cca-4ded-b2ae-b8157cb9360d service nova] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Received event network-vif-deleted-8c4c3171-55fb-44b2-866e-e7f47fa6f006 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:18:17.640998 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-ed41cd89-fe62-4c89-ab0c-f8f4ef4f24f9 req-a8d8cc35-1cca-4ded-b2ae-b8157cb9360d service nova] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Neutron deleted interface 8c4c3171-55fb-44b2-866e-e7f47fa6f006; detaching it from the instance and deleting it from the info cache
May 28 10:18:17.642736 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-ed41cd89-fe62-4c89-ab0c-f8f4ef4f24f9 req-a8d8cc35-1cca-4ded-b2ae-b8157cb9360d service nova] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Detach interface failed, port_id=8c4c3171-55fb-44b2-866e-e7f47fa6f006, reason: Instance 9ba4df01-b7d4-43df-9c63-c190784d5584 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:18:17.773176 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2876ec3e-1124-4d48-a64d-d717c6e13912 req-14f81c74-ea4c-4124-b037-6827c2ce9c73 service nova] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Received event network-vif-unplugged-8c4c3171-55fb-44b2-866e-e7f47fa6f006 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:18:17.773350 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2876ec3e-1124-4d48-a64d-d717c6e13912 req-14f81c74-ea4c-4124-b037-6827c2ce9c73 service nova] Acquiring lock "9ba4df01-b7d4-43df-9c63-c190784d5584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:18:17.773893 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2876ec3e-1124-4d48-a64d-d717c6e13912 req-14f81c74-ea4c-4124-b037-6827c2ce9c73 service nova] Lock "9ba4df01-b7d4-43df-9c63-c190784d5584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:18:17.773893 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-2876ec3e-1124-4d48-a64d-d717c6e13912 req-14f81c74-ea4c-4124-b037-6827c2ce9c73 service nova] Lock "9ba4df01-b7d4-43df-9c63-c190784d5584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:18:17.773893 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2876ec3e-1124-4d48-a64d-d717c6e13912 req-14f81c74-ea4c-4124-b037-6827c2ce9c73 service nova] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] No waiting events found dispatching network-vif-unplugged-8c4c3171-55fb-44b2-866e-e7f47fa6f006 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:18:17.773893 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-2876ec3e-1124-4d48-a64d-d717c6e13912 req-14f81c74-ea4c-4124-b037-6827c2ce9c73 service nova] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Received event network-vif-unplugged-8c4c3171-55fb-44b2-866e-e7f47fa6f006 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:18:17.919480 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:18:18.031483 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:18:18.076547 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bf054ab6-69be-4a17-b9a6-babb4bc3a563 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.389s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:18:18.077252 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.157s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:18:18.534085 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Took 1.40 seconds to deallocate network for instance.
May 28 10:18:18.580290 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lazy-loading 'flavor' on Instance uuid 5d8c2bb9-680c-4a83-876f-3be446a4c0f8 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:18:19.073806 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Took 0.54 seconds to detach 1 volumes for instance.
May 28 10:18:19.579303 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:18:19.580225 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:18:19.584348 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:18:19.736666 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:18:19.736878 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:18:20.239478 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:18:20.492021 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:18:20.492150 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:18:20.492397 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Attaching volume 67cea768-f66c-4806-88cf-45bc61ac5dd3 to /dev/vdc
May 28 10:18:20.534133 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:18:20.544772 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:18:20.565226 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:18:20.611002 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:18:20.611317 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:18:20.618630 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:18:20.619576 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe9d:d1c1', 'fe80::b01d:8aff:fede:b711'] 
May 28 10:18:20.619708 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:18:20.619840 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:18:20.620050 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] <== get_connector_properties: return (85ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:18:20.620315 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Updating existing volume attachment record: e23a1215-2488-468a-b9e7-f3dc1ec62053 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:18:20.746697 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.167s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:18:20.794376 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Deleted allocations for instance 9ba4df01-b7d4-43df-9c63-c190784d5584
May 28 10:18:21.185586 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3', 'iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67cea768-f66c-4806-88cf-45bc61ac5dd3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '5d8c2bb9-680c-4a83-876f-3be446a4c0f8', 'attached_at': '', 'detached_at': '', 'volume_id': '67cea768-f66c-4806-88cf-45bc61ac5dd3', 'serial': '67cea768-f66c-4806-88cf-45bc61ac5dd3'} {{(pid=98321) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 10:18:21.188849 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:18:21.189222 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3', 'iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67cea768-f66c-4806-88cf-45bc61ac5dd3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:18:21.189386 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:18:21.189873 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:18:21.190080 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3', 'iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67cea768-f66c-4806-88cf-45bc61ac5dd3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:18:21.202053 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:18:21.204789 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:18:21.205138 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:18:21.205429 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:18:21.206029 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:18:21.206029 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:18:21.215648 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:18:21.215648 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:21.220948 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:18:21.220948 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:21.228647 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3] added
May 28 10:18:21.228647 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:18:21.228647 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:18:21.228647 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:18:21.228647 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:18:21.228647 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:18:21.228647 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:21.228869 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:18:21.228983 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0235(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:18:21.229128 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:18:21.230838 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3] added
May 28 10:18:21.230838 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:18:21.230838 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:18:21.230838 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:18:21.230838 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:18:21.230838 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:18:21.230838 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:21.231063 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:18:21.231140 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0251(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:18:21.231299 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:18:21.373411 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:18:21.373833 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:18:21.373833 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=98321) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 10:18:21.373926 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98321) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 10:18:21.384056 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:21.384261 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98321) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 10:18:21.802743 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7f918de0-7f86-4cfc-b888-d44c9ec614a4 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Lock "9ba4df01-b7d4-43df-9c63-c190784d5584" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.788s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:18:22.229544 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:18:22.231542 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:18:22.241461 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:18:22.241461 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:18:22.246191 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:18:22.246191 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:22.254449 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:22.259289 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:22.266901 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:22.266901 np0000001613 nova-compute[98321]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:22.266901 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:18:22.267012 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:22.267012 np0000001613 nova-compute[98321]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:22.267012 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:18:22.271340 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:22.271340 np0000001613 nova-compute[98321]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:22.271340 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:18:22.271457 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:22.271457 np0000001613 nova-compute[98321]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:22.271457 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:18:22.303389 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3, portal: 192.168.40.100,3260]
May 28 10:18:22.303389 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3, portal: 192.168.40.100,3260] successful.
May 28 10:18:22.303389 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:22.314421 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:22.323578 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3, portal: 192.168.50.100,3260]
May 28 10:18:22.323578 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3, portal: 192.168.50.100,3260] successful.
May 28 10:18:22.323578 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:22.328056 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:22.328056 np0000001613 nova-compute[98321]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:22.328056 np0000001613 nova-compute[98321]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3 (non-flash)
May 28 10:18:22.328056 np0000001613 nova-compute[98321]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3 (non-flash)
May 28 10:18:22.328056 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:18:22.328281 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:22.328281 np0000001613 nova-compute[98321]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:22.328281 np0000001613 nova-compute[98321]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3 (non-flash)
May 28 10:18:22.328281 np0000001613 nova-compute[98321]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3 (non-flash)
May 28 10:18:22.328281 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:18:22.328520 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.124s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:18:22.328635 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:18:22.329493 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] HCTL ('7', '-', '-', 0) found on session 229 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:18:22.329599 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:18:22.334407 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:22.343052 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Searching for a device in session 229 and hctl ['7', '*', '*', 0] yield: None {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:18:22.347361 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:22.347361 np0000001613 nova-compute[98321]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:22.347361 np0000001613 nova-compute[98321]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3 (non-flash)
May 28 10:18:22.347361 np0000001613 nova-compute[98321]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3 (non-flash)
May 28 10:18:22.347361 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:18:22.347489 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:22.347489 np0000001613 nova-compute[98321]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:22.347489 np0000001613 nova-compute[98321]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3 (non-flash)
May 28 10:18:22.347489 np0000001613 nova-compute[98321]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3 (non-flash)
May 28 10:18:22.347489 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:18:22.347737 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.142s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:18:22.347802 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:18:22.348342 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] HCTL ('8', '-', '-', 0) found on session 230 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:18:22.348490 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:18:22.360150 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Searching for a device in session 230 and hctl ['8', '*', '*', 0] yield: None {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:18:23.343149 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Searching for a device in session 229 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:18:23.343559 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67cea768-f66c-4806-88cf-45bc61ac5dd3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:18:23.360824 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Searching for a device in session 230 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:18:23.360982 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '67cea768-f66c-4806-88cf-45bc61ac5dd3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:18:24.205788 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:18:25.220804 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Found WWN 3300000003a2b46b7 for multipath device dm-0 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:18:25.221198 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.031s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:18:25.222052 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] <== connect_volume: return (4032ms) {'type': 'block', 'scsi_wwn': '3300000003a2b46b7', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '3300000003a2b46b7'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:18:25.222283 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003a2b46b7', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '3300000003a2b46b7'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:18:25.224367 np0000001613 nova-compute[98321]: WARNING stevedore.named [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 10:18:25.224542 np0000001613 nova-compute[98321]: WARNING castellan.key_manager [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 10:18:25.224683 np0000001613 nova-compute[98321]: WARNING nova.keymgr.conf_key_mgr [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 10:18:25.240774 np0000001613 nova-compute[98321]: WARNING os_brick.encryptors.luks [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 28 10:18:25.241053 np0000001613 nova-compute[98321]: WARNING stevedore.named [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 10:18:25.241226 np0000001613 nova-compute[98321]: WARNING castellan.key_manager [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 10:18:25.241338 np0000001613 nova-compute[98321]: WARNING nova.keymgr.conf_key_mgr [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 10:18:25.241774 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x73c1f43cf770>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3', 'iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67cea768-f66c-4806-88cf-45bc61ac5dd3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '5d8c2bb9-680c-4a83-876f-3be446a4c0f8', 'attached_at': '', 'detached_at': '', 'volume_id': '67cea768-f66c-4806-88cf-45bc61ac5dd3', 'serial': '67cea768-f66c-4806-88cf-45bc61ac5dd3'} {{(pid=98321) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 10:18:25.241897 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors.luks [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] formatting encrypted volume /dev/dm-0 {{(pid=98321) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 28 10:18:25.571876 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:26.392211 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:27.067951 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:29.102795 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 10:18:29.102795 np0000001613 nova-compute[98321]:   <usage type="volume">
May 28 10:18:29.102795 np0000001613 nova-compute[98321]:     <volume>67cea768-f66c-4806-88cf-45bc61ac5dd3</volume>
May 28 10:18:29.102795 np0000001613 nova-compute[98321]:   </usage>
May 28 10:18:29.102795 np0000001613 nova-compute[98321]: </secret>
May 28 10:18:29.102795 np0000001613 nova-compute[98321]:  {{(pid=98321) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 10:18:29.108404 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lazy-loading 'flavor' on Instance uuid 5d8c2bb9-680c-4a83-876f-3be446a4c0f8 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:18:29.611357 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Attempting to attach volume 67cea768-f66c-4806-88cf-45bc61ac5dd3 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 10:18:29.612686 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] attach device xml: <disk type="block" device="disk">
May 28 10:18:29.612686 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:18:29.612686 np0000001613 nova-compute[98321]:   <alias name="ua-67cea768-f66c-4806-88cf-45bc61ac5dd3"/>
May 28 10:18:29.612686 np0000001613 nova-compute[98321]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 28 10:18:29.612686 np0000001613 nova-compute[98321]:   <target dev="vdc" bus="virtio"/>
May 28 10:18:29.612686 np0000001613 nova-compute[98321]:   <serial>67cea768-f66c-4806-88cf-45bc61ac5dd3</serial>
May 28 10:18:29.612686 np0000001613 nova-compute[98321]:   <encryption format="luks">
May 28 10:18:29.612686 np0000001613 nova-compute[98321]:     <secret type="passphrase" uuid="30909bbd-6a2f-4909-a8b4-87d102690e1c"/>
May 28 10:18:29.612686 np0000001613 nova-compute[98321]:   </encryption>
May 28 10:18:29.612686 np0000001613 nova-compute[98321]: </disk>
May 28 10:18:29.612686 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 10:18:30.845110 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.00038602399990850245 future=<Future at 0x73c1f470e810 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:18:30.845567 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Emitting event <LifecycleEvent: 1779963495.8446112, 9ba4df01-b7d4-43df-9c63-c190784d5584 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:18:30.845763 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:18:30.845985 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] VM Stopped (Lifecycle Event)
May 28 10:18:31.348552 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-2f292b25-1179-4a5e-a765-a8df8f7278dc tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: 9ba4df01-b7d4-43df-9c63-c190784d5584] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:18:31.393734 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:32.201939 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:18:32.202394 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:18:32.202394 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:18:32.202394 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:18:32.202394 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] No VIF found with MAC fa:16:3e:9d:d1:c1, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:18:33.745620 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-05b67f05-09d2-4716-8752-8ec07640ed6e tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.253s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:18:34.474671 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:18:34.475003 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:18:34.978018 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lazy-loading 'flavor' on Instance uuid 5d8c2bb9-680c-4a83-876f-3be446a4c0f8 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:18:35.263662 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:35.982650 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.507s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:18:36.413325 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:37.038499 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:18:37.038921 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:18:37.038921 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Attaching volume a7d08180-9fbd-457d-aa39-f3b814fcdc92 to /dev/vdd
May 28 10:18:37.071646 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:18:37.081870 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:18:37.101322 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:18:37.144914 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:18:37.145257 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:18:37.155655 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:18:37.156552 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe9d:d1c1', 'fe80::b01d:8aff:fede:b711'] 
May 28 10:18:37.156674 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:18:37.156815 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:18:37.157054 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] <== get_connector_properties: return (85ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:18:37.157255 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Updating existing volume attachment record: 098fd309-33d2-44c7-96df-aa0bf1286751 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:18:37.706477 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:18:37.706833 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92', 'iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7d08180-9fbd-457d-aa39-f3b814fcdc92', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:18:37.707060 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:18:37.707610 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:18:37.707800 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92', 'iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7d08180-9fbd-457d-aa39-f3b814fcdc92', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:18:37.718811 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:18:37.719429 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:18:37.719861 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:18:37.720066 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:18:37.720512 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:18:37.720751 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:18:37.731324 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:18:37.731324 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:37.736053 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:18:37.736053 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:37.742616 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92] added
May 28 10:18:37.742616 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:18:37.742616 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:18:37.742616 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:18:37.742616 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:18:37.742616 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:18:37.742616 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:37.742802 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:18:37.743138 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0229(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:18:37.743242 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:18:37.746769 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92] added
May 28 10:18:37.746769 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:18:37.746769 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:18:37.746769 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:18:37.746769 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:18:37.746769 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:18:37.746769 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:37.746929 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:18:37.747046 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0263(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:18:37.747172 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:18:38.743660 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:18:38.747627 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:18:38.755779 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:18:38.755779 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:18:38.760699 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:18:38.760699 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:38.767617 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:38.772464 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:38.779486 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:38.779486 np0000001613 nova-compute[98321]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:38.779486 np0000001613 nova-compute[98321]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3 (non-flash)
May 28 10:18:38.779486 np0000001613 nova-compute[98321]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3 (non-flash)
May 28 10:18:38.779486 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:18:38.779612 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:38.779612 np0000001613 nova-compute[98321]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:38.779612 np0000001613 nova-compute[98321]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3 (non-flash)
May 28 10:18:38.779612 np0000001613 nova-compute[98321]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3 (non-flash)
May 28 10:18:38.779612 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:18:38.785094 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:38.785094 np0000001613 nova-compute[98321]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:38.785094 np0000001613 nova-compute[98321]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3 (non-flash)
May 28 10:18:38.785094 np0000001613 nova-compute[98321]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3 (non-flash)
May 28 10:18:38.785094 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:18:38.785303 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:38.785303 np0000001613 nova-compute[98321]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:38.785303 np0000001613 nova-compute[98321]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3 (non-flash)
May 28 10:18:38.785303 np0000001613 nova-compute[98321]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3 (non-flash)
May 28 10:18:38.785303 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:18:38.812454 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92, portal: 192.168.40.100,3260]
May 28 10:18:38.812454 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92, portal: 192.168.40.100,3260] successful.
May 28 10:18:38.812454 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:38.819151 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92, portal: 192.168.50.100,3260]
May 28 10:18:38.819151 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92, portal: 192.168.50.100,3260] successful.
May 28 10:18:38.819151 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:38.824685 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:38.829469 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:18:38.838639 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:38.838639 np0000001613 nova-compute[98321]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:38.838639 np0000001613 nova-compute[98321]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3 (non-flash)
May 28 10:18:38.838639 np0000001613 nova-compute[98321]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3 (non-flash)
May 28 10:18:38.838639 np0000001613 nova-compute[98321]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92 (non-flash)
May 28 10:18:38.838639 np0000001613 nova-compute[98321]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92 (non-flash)
May 28 10:18:38.838639 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:18:38.838820 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:38.838820 np0000001613 nova-compute[98321]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:38.838820 np0000001613 nova-compute[98321]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3 (non-flash)
May 28 10:18:38.838820 np0000001613 nova-compute[98321]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3 (non-flash)
May 28 10:18:38.838820 np0000001613 nova-compute[98321]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92 (non-flash)
May 28 10:18:38.838820 np0000001613 nova-compute[98321]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92 (non-flash)
May 28 10:18:38.838820 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:18:38.839074 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.119s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:18:38.839205 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:18:38.839994 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] HCTL ('11', '-', '-', 0) found on session 231 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:18:38.840105 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:18:38.844957 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:38.844957 np0000001613 nova-compute[98321]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:38.844957 np0000001613 nova-compute[98321]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3 (non-flash)
May 28 10:18:38.844957 np0000001613 nova-compute[98321]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3 (non-flash)
May 28 10:18:38.844957 np0000001613 nova-compute[98321]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92 (non-flash)
May 28 10:18:38.844957 np0000001613 nova-compute[98321]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92 (non-flash)
May 28 10:18:38.844957 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:18:38.845101 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:38.845101 np0000001613 nova-compute[98321]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:18:38.845101 np0000001613 nova-compute[98321]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3 (non-flash)
May 28 10:18:38.845101 np0000001613 nova-compute[98321]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3 (non-flash)
May 28 10:18:38.845101 np0000001613 nova-compute[98321]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92 (non-flash)
May 28 10:18:38.845101 np0000001613 nova-compute[98321]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92 (non-flash)
May 28 10:18:38.845101 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:18:38.845372 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.125s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:18:38.845481 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:18:38.846129 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] HCTL ('12', '-', '-', 0) found on session 232 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:18:38.846317 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:18:38.855081 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Searching for a device in session 231 and hctl ['11', '*', '*', 0] yield: None {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:18:38.859504 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Searching for a device in session 232 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:18:38.859504 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a7d08180-9fbd-457d-aa39-f3b814fcdc92', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:18:39.855773 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Searching for a device in session 231 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:18:39.856265 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7d08180-9fbd-457d-aa39-f3b814fcdc92', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:18:40.734677 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Found WWN 330000000eacb8178 for multipath device dm-2 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:18:40.734901 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.027s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:18:40.735036 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] <== connect_volume: return (3028ms) {'type': 'block', 'scsi_wwn': '330000000eacb8178', 'path': '/dev/dm-2', 'multipath_id': '330000000eacb8178'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:18:40.735144 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000eacb8178', 'path': '/dev/dm-2', 'multipath_id': '330000000eacb8178'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:18:40.738061 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lazy-loading 'flavor' on Instance uuid 5d8c2bb9-680c-4a83-876f-3be446a4c0f8 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:18:41.241337 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Attempting to attach volume a7d08180-9fbd-457d-aa39-f3b814fcdc92 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 10:18:41.242882 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] attach device xml: <disk type="block" device="disk">
May 28 10:18:41.242882 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:18:41.242882 np0000001613 nova-compute[98321]:   <alias name="ua-a7d08180-9fbd-457d-aa39-f3b814fcdc92"/>
May 28 10:18:41.242882 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-2"/>
May 28 10:18:41.242882 np0000001613 nova-compute[98321]:   <target dev="vdd" bus="virtio"/>
May 28 10:18:41.242882 np0000001613 nova-compute[98321]:   <serial>a7d08180-9fbd-457d-aa39-f3b814fcdc92</serial>
May 28 10:18:41.242882 np0000001613 nova-compute[98321]:   <shareable/>
May 28 10:18:41.242882 np0000001613 nova-compute[98321]: </disk>
May 28 10:18:41.242882 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 10:18:41.414823 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:42.885115 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:18:42.885601 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:18:42.885601 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:18:42.885601 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] No BDM found with device name vdd, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:18:42.885601 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:18:42.885781 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] No VIF found with MAC fa:16:3e:9d:d1:c1, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:18:44.429707 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-bb19753b-b8d0-455b-9d03-16593ae39ff4 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.391s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:18:45.266204 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:46.417288 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:46.873522 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "c2eccafd-0a91-4c01-aa90-d3b031af3aa2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:18:46.873766 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "c2eccafd-0a91-4c01-aa90-d3b031af3aa2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:18:47.375640 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:18:47.924300 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:18:47.924646 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:18:47.927679 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:18:47.927819 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Claim successful on node np0000001613
May 28 10:18:49.051219 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:18:49.051532 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:18:49.554201 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:18:50.060222 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.136s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:18:50.060661 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:18:50.268286 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:50.566202 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:18:50.566576 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:18:50.567280 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:18:50.567599 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:18:50.645812 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f68f80c0467244b696935ee039759675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd45e575a1740e8aa1c09f4f908d747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:18:51.068131 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Successfully created port: a9edb7a2-d9a3-48b3-9e74-c0479fab8d30 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:18:51.070575 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:18:51.418647 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:51.531744 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Successfully updated port: a9edb7a2-d9a3-48b3-9e74-c0479fab8d30 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:18:51.574419 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:18:51.607569 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-0e5a55a9-9ec3-4d19-9447-4d7a80e4016a req-133b5f88-9c4e-43ea-96f8-cdb05ef0ce16 service nova] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Received event network-changed-a9edb7a2-d9a3-48b3-9e74-c0479fab8d30 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:18:51.607754 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-0e5a55a9-9ec3-4d19-9447-4d7a80e4016a req-133b5f88-9c4e-43ea-96f8-cdb05ef0ce16 service nova] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Refreshing instance network info cache due to event network-changed-a9edb7a2-d9a3-48b3-9e74-c0479fab8d30. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:18:51.607902 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0e5a55a9-9ec3-4d19-9447-4d7a80e4016a req-133b5f88-9c4e-43ea-96f8-cdb05ef0ce16 service nova] Acquiring lock "refresh_cache-c2eccafd-0a91-4c01-aa90-d3b031af3aa2" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:18:51.608334 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0e5a55a9-9ec3-4d19-9447-4d7a80e4016a req-133b5f88-9c4e-43ea-96f8-cdb05ef0ce16 service nova] Acquired lock "refresh_cache-c2eccafd-0a91-4c01-aa90-d3b031af3aa2" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:18:51.608514 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-0e5a55a9-9ec3-4d19-9447-4d7a80e4016a req-133b5f88-9c4e-43ea-96f8-cdb05ef0ce16 service nova] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Refreshing network info cache for port a9edb7a2-d9a3-48b3-9e74-c0479fab8d30 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:18:52.036362 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "refresh_cache-c2eccafd-0a91-4c01-aa90-d3b031af3aa2" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:18:52.111057 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-0e5a55a9-9ec3-4d19-9447-4d7a80e4016a req-133b5f88-9c4e-43ea-96f8-cdb05ef0ce16 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:18:52.166301 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-0e5a55a9-9ec3-4d19-9447-4d7a80e4016a req-133b5f88-9c4e-43ea-96f8-cdb05ef0ce16 service nova] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:18:52.285057 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-0e5a55a9-9ec3-4d19-9447-4d7a80e4016a req-133b5f88-9c4e-43ea-96f8-cdb05ef0ce16 service nova] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:18:52.583306 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:18:52.583896 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:18:52.584136 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Creating image(s)
May 28 10:18:52.584742 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "/opt/stack/data/nova/instances/c2eccafd-0a91-4c01-aa90-d3b031af3aa2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:18:52.584936 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "/opt/stack/data/nova/instances/c2eccafd-0a91-4c01-aa90-d3b031af3aa2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:18:52.585399 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "/opt/stack/data/nova/instances/c2eccafd-0a91-4c01-aa90-d3b031af3aa2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:18:52.585922 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:18:52.588314 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:18:52.589113 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:18:52.677542 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.088s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:18:52.678119 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:18:52.679035 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:18:52.679555 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:18:52.681860 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:18:52.682204 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:18:52.776800 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.094s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:18:52.777321 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/c2eccafd-0a91-4c01-aa90-d3b031af3aa2/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:18:52.789759 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-0e5a55a9-9ec3-4d19-9447-4d7a80e4016a req-133b5f88-9c4e-43ea-96f8-cdb05ef0ce16 service nova] Releasing lock "refresh_cache-c2eccafd-0a91-4c01-aa90-d3b031af3aa2" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:18:52.790904 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquired lock "refresh_cache-c2eccafd-0a91-4c01-aa90-d3b031af3aa2" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:18:52.791258 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:18:52.835696 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/c2eccafd-0a91-4c01-aa90-d3b031af3aa2/disk 1073741824" returned: 0 in 0.058s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:18:52.836063 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.157s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:18:52.836388 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:18:52.929892 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.093s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:18:52.930353 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c2eccafd-0a91-4c01-aa90-d3b031af3aa2/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:18:52.930600 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2eccafd-0a91-4c01-aa90-d3b031af3aa2/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:18:53.022512 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2eccafd-0a91-4c01-aa90-d3b031af3aa2/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:18:53.023442 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Cannot resize image /opt/stack/data/nova/instances/c2eccafd-0a91-4c01-aa90-d3b031af3aa2/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:18:53.023693 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:18:53.023901 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Ensure instance console log exists: /opt/stack/data/nova/instances/c2eccafd-0a91-4c01-aa90-d3b031af3aa2/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:18:53.024204 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:18:53.024389 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:18:53.024517 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:18:53.348464 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:18:53.481019 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:18:53.589442 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Updating instance_info_cache with network_info: [{"id": "a9edb7a2-d9a3-48b3-9e74-c0479fab8d30", "address": "fa:16:3e:5f:bc:d7", "network": {"id": "fd85d7ca-665d-4c88-a0fc-f5b183b538d1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-852450606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dd45e575a1740e8aa1c09f4f908d747", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9edb7a2-d9", "ovs_interfaceid": "a9edb7a2-d9a3-48b3-9e74-c0479fab8d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:18:54.091771 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Releasing lock "refresh_cache-c2eccafd-0a91-4c01-aa90-d3b031af3aa2" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:18:54.092105 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Instance network_info: |[{"id": "a9edb7a2-d9a3-48b3-9e74-c0479fab8d30", "address": "fa:16:3e:5f:bc:d7", "network": {"id": "fd85d7ca-665d-4c88-a0fc-f5b183b538d1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-852450606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dd45e575a1740e8aa1c09f4f908d747", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9edb7a2-d9", "ovs_interfaceid": "a9edb7a2-d9a3-48b3-9e74-c0479fab8d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:18:54.093879 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Start _get_guest_xml network_info=[{"id": "a9edb7a2-d9a3-48b3-9e74-c0479fab8d30", "address": "fa:16:3e:5f:bc:d7", "network": {"id": "fd85d7ca-665d-4c88-a0fc-f5b183b538d1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-852450606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dd45e575a1740e8aa1c09f4f908d747", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9edb7a2-d9", "ovs_interfaceid": "a9edb7a2-d9a3-48b3-9e74-c0479fab8d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:18:54.098546 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:18:54.100017 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-940717995', uuid='c2eccafd-0a91-4c01-aa90-d3b031af3aa2'), owner=OwnerMeta(userid='f68f80c0467244b696935ee039759675', username='tempest-VolumeMultiattachTests-1491725275-project-member', projectid='9dd45e575a1740e8aa1c09f4f908d747', projectname='tempest-VolumeMultiattachTests-1491725275'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a9edb7a2-d9a3-48b3-9e74-c0479fab8d30", "address": "fa:16:3e:5f:bc:d7", "network": {"id": "fd85d7ca-665d-4c88-a0fc-f5b183b538d1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-852450606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dd45e575a1740e8aa1c09f4f908d747", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9edb7a2-d9", "ovs_interfaceid": "a9edb7a2-d9a3-48b3-9e74-c0479fab8d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779963534.099616) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:18:54.101270 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:18:54.101788 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:18:54.102937 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:18:54.103092 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:18:54.104138 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:18:54.104465 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:18:54.104610 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:18:54.104709 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:18:54.104826 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:18:54.104905 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:18:54.104998 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:18:54.105147 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:18:54.105476 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:18:54.105476 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:18:54.105476 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:18:54.105605 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:18:54.117326 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:18:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-940717995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumemultiattachtests-server-940717995',id=81,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwYjtkPyDRwaN7lG/Ges1nPjaQJSEIkreLgqYiqypDXxmPWGcyfsisy2A7gM0FS3C15tLuAwP3yhgLZ3hrVGouaoGnnTGGlktMEdDHF0SzKTbbZlRZ7yxKDPVse6ZbzNg==',key_name='tempest-keypair-344224413',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dd45e575a1740e8aa1c09f4f908d747',ramdisk_id='',reservation_id='r-cszdtgzl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1491725275',owner_user_name='tempest-VolumeMultiattachTests-1491725275-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:18:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f68f80c0467244b696935ee039759675',uuid=c2eccafd-0a91-4c01-aa90-d3b031af3aa2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9edb7a2-d9a3-48b3-9e74-c0479fab8d30", "address": "fa:16:3e:5f:bc:d7", "network": {"id": "fd85d7ca-665d-4c88-a0fc-f5b183b538d1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-852450606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dd45e575a1740e8aa1c09f4f908d747", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9edb7a2-d9", "ovs_interfaceid": "a9edb7a2-d9a3-48b3-9e74-c0479fab8d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:18:54.117540 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Converting VIF {"id": "a9edb7a2-d9a3-48b3-9e74-c0479fab8d30", "address": "fa:16:3e:5f:bc:d7", "network": {"id": "fd85d7ca-665d-4c88-a0fc-f5b183b538d1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-852450606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dd45e575a1740e8aa1c09f4f908d747", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9edb7a2-d9", "ovs_interfaceid": "a9edb7a2-d9a3-48b3-9e74-c0479fab8d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:18:54.118310 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:bc:d7,bridge_name='br-int',has_traffic_filtering=True,id=a9edb7a2-d9a3-48b3-9e74-c0479fab8d30,network=Network(fd85d7ca-665d-4c88-a0fc-f5b183b538d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9edb7a2-d9') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:18:54.119221 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lazy-loading 'pci_devices' on Instance uuid c2eccafd-0a91-4c01-aa90-d3b031af3aa2 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:18:54.621925 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] End _get_guest_xml xml=<domain type="qemu">
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:   <uuid>c2eccafd-0a91-4c01-aa90-d3b031af3aa2</uuid>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:   <name>instance-00000051</name>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:       <nova:name>tempest-VolumeMultiattachTests-server-940717995</nova:name>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:18:54</nova:creationTime>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:         <nova:user uuid="f68f80c0467244b696935ee039759675">tempest-VolumeMultiattachTests-1491725275-project-member</nova:user>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:         <nova:project uuid="9dd45e575a1740e8aa1c09f4f908d747">tempest-VolumeMultiattachTests-1491725275</nova:project>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:         <nova:port uuid="a9edb7a2-d9a3-48b3-9e74-c0479fab8d30">
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:     <system>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:       <entry name="serial">c2eccafd-0a91-4c01-aa90-d3b031af3aa2</entry>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:       <entry name="uuid">c2eccafd-0a91-4c01-aa90-d3b031af3aa2</entry>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:     </system>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:   <os>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:   </os>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:   <features>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:   </features>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:   <devices>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/c2eccafd-0a91-4c01-aa90-d3b031af3aa2/disk"/>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:     </disk>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/c2eccafd-0a91-4c01-aa90-d3b031af3aa2/disk.config"/>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:     </disk>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:5f:bc:d7"/>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:       <target dev="tapa9edb7a2-d9"/>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:     </interface>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/c2eccafd-0a91-4c01-aa90-d3b031af3aa2/console.log" append="off"/>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:     </serial>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:     <video>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:     </video>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:     </rng>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:   </devices>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]: </domain>
May 28 10:18:54.621925 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:18:54.624139 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Preparing to wait for external event network-vif-plugged-a9edb7a2-d9a3-48b3-9e74-c0479fab8d30 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:18:54.624139 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "c2eccafd-0a91-4c01-aa90-d3b031af3aa2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:18:54.624139 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "c2eccafd-0a91-4c01-aa90-d3b031af3aa2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:18:54.624139 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "c2eccafd-0a91-4c01-aa90-d3b031af3aa2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:18:54.624139 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:18:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-940717995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumemultiattachtests-server-940717995',id=81,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwYjtkPyDRwaN7lG/Ges1nPjaQJSEIkreLgqYiqypDXxmPWGcyfsisy2A7gM0FS3C15tLuAwP3yhgLZ3hrVGouaoGnnTGGlktMEdDHF0SzKTbbZlRZ7yxKDPVse6ZbzNg==',key_name='tempest-keypair-344224413',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dd45e575a1740e8aa1c09f4f908d747',ramdisk_id='',reservation_id='r-cszdtgzl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1491725275',owner_user_name='tempest-VolumeMultiattachTests-1491725275-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:18:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f68f80c0467244b696935ee039759675',uuid=c2eccafd-0a91-4c01-aa90-d3b031af3aa2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9edb7a2-d9a3-48b3-9e74-c0479fab8d30", "address": "fa:16:3e:5f:bc:d7", "network": {"id": "fd85d7ca-665d-4c88-a0fc-f5b183b538d1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-852450606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dd45e575a1740e8aa1c09f4f908d747", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9edb7a2-d9", "ovs_interfaceid": "a9edb7a2-d9a3-48b3-9e74-c0479fab8d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:18:54.624139 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Converting VIF {"id": "a9edb7a2-d9a3-48b3-9e74-c0479fab8d30", "address": "fa:16:3e:5f:bc:d7", "network": {"id": "fd85d7ca-665d-4c88-a0fc-f5b183b538d1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-852450606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dd45e575a1740e8aa1c09f4f908d747", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9edb7a2-d9", "ovs_interfaceid": "a9edb7a2-d9a3-48b3-9e74-c0479fab8d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:18:54.624139 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:bc:d7,bridge_name='br-int',has_traffic_filtering=True,id=a9edb7a2-d9a3-48b3-9e74-c0479fab8d30,network=Network(fd85d7ca-665d-4c88-a0fc-f5b183b538d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9edb7a2-d9') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:18:54.624139 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:bc:d7,bridge_name='br-int',has_traffic_filtering=True,id=a9edb7a2-d9a3-48b3-9e74-c0479fab8d30,network=Network(fd85d7ca-665d-4c88-a0fc-f5b183b538d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9edb7a2-d9') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:18:54.624604 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:54.624969 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:18:54.625265 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:18:54.625974 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:54.626116 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1d9416d8-6d02-5aa7-a37d-28e0a30461db', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:18:54.626947 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:54.627753 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:18:54.628371 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:54.629932 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:54.630066 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9edb7a2-d9, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:18:54.630392 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa9edb7a2-d9, col_values=(('qos', UUID('3e6fbaae-79a8-4edb-893f-27d2f79b9117')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:18:54.630532 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa9edb7a2-d9, col_values=(('external_ids', {'iface-id': 'a9edb7a2-d9a3-48b3-9e74-c0479fab8d30', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:bc:d7', 'vm-uuid': 'c2eccafd-0a91-4c01-aa90-d3b031af3aa2'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:18:54.631145 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:54.632789 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:18:54.637519 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:54.638327 np0000001613 nova-compute[98321]: INFO os_vif [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:bc:d7,bridge_name='br-int',has_traffic_filtering=True,id=a9edb7a2-d9a3-48b3-9e74-c0479fab8d30,network=Network(fd85d7ca-665d-4c88-a0fc-f5b183b538d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9edb7a2-d9')
May 28 10:18:56.153107 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:18:56.153774 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:18:56.153774 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] No VIF found with MAC fa:16:3e:5f:bc:d7, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:18:56.154537 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Using config drive
May 28 10:18:56.659697 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:18:56.765264 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Creating config drive at /opt/stack/data/nova/instances/c2eccafd-0a91-4c01-aa90-d3b031af3aa2/disk.config
May 28 10:18:56.768857 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c2eccafd-0a91-4c01-aa90-d3b031af3aa2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7bqn7mc2 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:18:56.822561 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c2eccafd-0a91-4c01-aa90-d3b031af3aa2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7bqn7mc2" returned: 0 in 0.053s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:18:57.194725 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:57.214752 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:57.216697 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:57.294469 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:57.347855 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:57.357856 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-280e2467-7d11-4722-9434-c61aec01cb40 req-25b3d71a-e017-4de4-ac57-a671e28df945 service nova] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Received event network-vif-plugged-a9edb7a2-d9a3-48b3-9e74-c0479fab8d30 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:18:57.358146 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-280e2467-7d11-4722-9434-c61aec01cb40 req-25b3d71a-e017-4de4-ac57-a671e28df945 service nova] Acquiring lock "c2eccafd-0a91-4c01-aa90-d3b031af3aa2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:18:57.358421 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-280e2467-7d11-4722-9434-c61aec01cb40 req-25b3d71a-e017-4de4-ac57-a671e28df945 service nova] Lock "c2eccafd-0a91-4c01-aa90-d3b031af3aa2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:18:57.358597 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-280e2467-7d11-4722-9434-c61aec01cb40 req-25b3d71a-e017-4de4-ac57-a671e28df945 service nova] Lock "c2eccafd-0a91-4c01-aa90-d3b031af3aa2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:18:57.358768 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-280e2467-7d11-4722-9434-c61aec01cb40 req-25b3d71a-e017-4de4-ac57-a671e28df945 service nova] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Processing event network-vif-plugged-a9edb7a2-d9a3-48b3-9e74-c0479fab8d30 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:18:57.845878 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:18:57.846634 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963537.8461113, c2eccafd-0a91-4c01-aa90-d3b031af3aa2 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:18:57.846775 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] VM Started (Lifecycle Event)
May 28 10:18:57.849086 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:18:57.851478 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Instance spawned successfully.
May 28 10:18:57.852196 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:18:58.352759 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:18:58.357314 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:18:58.359721 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:18:58.361890 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:18:58.362172 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:18:58.362399 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:18:58.362629 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:18:58.362876 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:18:58.862198 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:18:58.862198 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963538.8607068, c2eccafd-0a91-4c01-aa90-d3b031af3aa2 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:18:58.862198 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] VM Paused (Lifecycle Event)
May 28 10:18:58.867903 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Took 6.28 seconds to spawn the instance on the hypervisor.
May 28 10:18:58.867903 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:18:59.366121 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:18:59.367256 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963539.3669794, c2eccafd-0a91-4c01-aa90-d3b031af3aa2 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:18:59.367533 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] VM Resumed (Lifecycle Event)
May 28 10:18:59.381090 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Took 11.50 seconds to build instance.
May 28 10:18:59.414067 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7f722bb2-6253-42dc-a3e2-91b9faab4c6d req-308dda4a-992a-45e8-9468-4de965ae15cc service nova] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Received event network-vif-plugged-a9edb7a2-d9a3-48b3-9e74-c0479fab8d30 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:18:59.414518 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7f722bb2-6253-42dc-a3e2-91b9faab4c6d req-308dda4a-992a-45e8-9468-4de965ae15cc service nova] Acquiring lock "c2eccafd-0a91-4c01-aa90-d3b031af3aa2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:18:59.414686 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7f722bb2-6253-42dc-a3e2-91b9faab4c6d req-308dda4a-992a-45e8-9468-4de965ae15cc service nova] Lock "c2eccafd-0a91-4c01-aa90-d3b031af3aa2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:18:59.414836 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7f722bb2-6253-42dc-a3e2-91b9faab4c6d req-308dda4a-992a-45e8-9468-4de965ae15cc service nova] Lock "c2eccafd-0a91-4c01-aa90-d3b031af3aa2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:18:59.414960 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7f722bb2-6253-42dc-a3e2-91b9faab4c6d req-308dda4a-992a-45e8-9468-4de965ae15cc service nova] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] No waiting events found dispatching network-vif-plugged-a9edb7a2-d9a3-48b3-9e74-c0479fab8d30 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:18:59.415212 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-7f722bb2-6253-42dc-a3e2-91b9faab4c6d req-308dda4a-992a-45e8-9468-4de965ae15cc service nova] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Received unexpected event network-vif-plugged-a9edb7a2-d9a3-48b3-9e74-c0479fab8d30 for instance with vm_state active and task_state None.
May 28 10:18:59.631412 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:18:59.870750 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:18:59.872082 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:18:59.882899 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "c2eccafd-0a91-4c01-aa90-d3b031af3aa2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.009s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:19:00.269218 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:00.850566 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7a3addff-4740-423a-843f-f75d7f6abd7e req-67530281-14a5-4bd6-a8c8-aa80dfb1dd49 service nova] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Received event network-changed-f9ff28e0-ba0e-42c9-9b36-7d9719abe94e {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:19:00.851018 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7a3addff-4740-423a-843f-f75d7f6abd7e req-67530281-14a5-4bd6-a8c8-aa80dfb1dd49 service nova] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Refreshing instance network info cache due to event network-changed-f9ff28e0-ba0e-42c9-9b36-7d9719abe94e. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:19:00.851242 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7a3addff-4740-423a-843f-f75d7f6abd7e req-67530281-14a5-4bd6-a8c8-aa80dfb1dd49 service nova] Acquiring lock "refresh_cache-5d8c2bb9-680c-4a83-876f-3be446a4c0f8" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:19:00.851373 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7a3addff-4740-423a-843f-f75d7f6abd7e req-67530281-14a5-4bd6-a8c8-aa80dfb1dd49 service nova] Acquired lock "refresh_cache-5d8c2bb9-680c-4a83-876f-3be446a4c0f8" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:19:00.851541 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-7a3addff-4740-423a-843f-f75d7f6abd7e req-67530281-14a5-4bd6-a8c8-aa80dfb1dd49 service nova] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Refreshing network info cache for port f9ff28e0-ba0e-42c9-9b36-7d9719abe94e {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:19:01.354365 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-7a3addff-4740-423a-843f-f75d7f6abd7e req-67530281-14a5-4bd6-a8c8-aa80dfb1dd49 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:19:01.621045 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-7a3addff-4740-423a-843f-f75d7f6abd7e req-67530281-14a5-4bd6-a8c8-aa80dfb1dd49 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:19:01.731269 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-7a3addff-4740-423a-843f-f75d7f6abd7e req-67530281-14a5-4bd6-a8c8-aa80dfb1dd49 service nova] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Updated VIF entry in instance network info cache for port f9ff28e0-ba0e-42c9-9b36-7d9719abe94e. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:19:01.731599 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-7a3addff-4740-423a-843f-f75d7f6abd7e req-67530281-14a5-4bd6-a8c8-aa80dfb1dd49 service nova] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Updating instance_info_cache with network_info: [{"id": "f9ff28e0-ba0e-42c9-9b36-7d9719abe94e", "address": "fa:16:3e:9d:d1:c1", "network": {"id": "fd85d7ca-665d-4c88-a0fc-f5b183b538d1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-852450606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dd45e575a1740e8aa1c09f4f908d747", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9ff28e0-ba", "ovs_interfaceid": "f9ff28e0-ba0e-42c9-9b36-7d9719abe94e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:19:02.233380 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-7a3addff-4740-423a-843f-f75d7f6abd7e req-67530281-14a5-4bd6-a8c8-aa80dfb1dd49 service nova] Releasing lock "refresh_cache-5d8c2bb9-680c-4a83-876f-3be446a4c0f8" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:19:02.905389 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-fb9610ef-bcd7-44a7-ac4f-b2da5f5464c8 req-f67a8619-437f-4eee-87d6-c7f86a60a945 service nova] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Received event network-changed-a9edb7a2-d9a3-48b3-9e74-c0479fab8d30 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:19:02.905513 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-fb9610ef-bcd7-44a7-ac4f-b2da5f5464c8 req-f67a8619-437f-4eee-87d6-c7f86a60a945 service nova] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Refreshing instance network info cache due to event network-changed-a9edb7a2-d9a3-48b3-9e74-c0479fab8d30. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:19:02.906094 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-fb9610ef-bcd7-44a7-ac4f-b2da5f5464c8 req-f67a8619-437f-4eee-87d6-c7f86a60a945 service nova] Acquiring lock "refresh_cache-c2eccafd-0a91-4c01-aa90-d3b031af3aa2" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:19:02.906201 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-fb9610ef-bcd7-44a7-ac4f-b2da5f5464c8 req-f67a8619-437f-4eee-87d6-c7f86a60a945 service nova] Acquired lock "refresh_cache-c2eccafd-0a91-4c01-aa90-d3b031af3aa2" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:19:02.906329 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-fb9610ef-bcd7-44a7-ac4f-b2da5f5464c8 req-f67a8619-437f-4eee-87d6-c7f86a60a945 service nova] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Refreshing network info cache for port a9edb7a2-d9a3-48b3-9e74-c0479fab8d30 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:19:03.408421 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-fb9610ef-bcd7-44a7-ac4f-b2da5f5464c8 req-f67a8619-437f-4eee-87d6-c7f86a60a945 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:19:03.661831 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-fb9610ef-bcd7-44a7-ac4f-b2da5f5464c8 req-f67a8619-437f-4eee-87d6-c7f86a60a945 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:19:03.781250 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-fb9610ef-bcd7-44a7-ac4f-b2da5f5464c8 req-f67a8619-437f-4eee-87d6-c7f86a60a945 service nova] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Updated VIF entry in instance network info cache for port a9edb7a2-d9a3-48b3-9e74-c0479fab8d30. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:19:03.781720 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-fb9610ef-bcd7-44a7-ac4f-b2da5f5464c8 req-f67a8619-437f-4eee-87d6-c7f86a60a945 service nova] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Updating instance_info_cache with network_info: [{"id": "a9edb7a2-d9a3-48b3-9e74-c0479fab8d30", "address": "fa:16:3e:5f:bc:d7", "network": {"id": "fd85d7ca-665d-4c88-a0fc-f5b183b538d1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-852450606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dd45e575a1740e8aa1c09f4f908d747", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9edb7a2-d9", "ovs_interfaceid": "a9edb7a2-d9a3-48b3-9e74-c0479fab8d30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:19:04.283524 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-fb9610ef-bcd7-44a7-ac4f-b2da5f5464c8 req-f67a8619-437f-4eee-87d6-c7f86a60a945 service nova] Releasing lock "refresh_cache-c2eccafd-0a91-4c01-aa90-d3b031af3aa2" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:19:04.632270 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:04.792236 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:19:04.792752 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:19:05.270293 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:05.791589 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:19:05.792102 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:19:06.296365 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:19:06.296602 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:19:06.296788 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:19:06.296959 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Auditing locally available compute resources for np0000001613 (node: np0000001613) {{(pid=98321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 10:19:07.318005 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d8c2bb9-680c-4a83-876f-3be446a4c0f8/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:19:07.408714 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d8c2bb9-680c-4a83-876f-3be446a4c0f8/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:19:07.409216 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d8c2bb9-680c-4a83-876f-3be446a4c0f8/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:19:07.496927 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d8c2bb9-680c-4a83-876f-3be446a4c0f8/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:19:07.497364 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:19:07.497479 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-0 (vdc) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:19:07.497596 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] skipping disk /dev/dm-2 (vdd) as it is a volume {{(pid=98321) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 10:19:07.501977 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2eccafd-0a91-4c01-aa90-d3b031af3aa2/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:19:07.588834 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2eccafd-0a91-4c01-aa90-d3b031af3aa2/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:19:07.589239 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2eccafd-0a91-4c01-aa90-d3b031af3aa2/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:19:07.675605 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2eccafd-0a91-4c01-aa90-d3b031af3aa2/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:19:07.681626 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:19:07.683067 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:19:07.728429 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "env LANG=C uptime" returned: 0 in 0.045s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:19:07.728790 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Hypervisor/Node resource view: name=np0000001613 free_ram=13369MB free_disk=72.55873107910156GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 10:19:07.728928 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:19:07.729361 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:19:08.781112 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance 5d8c2bb9-680c-4a83-876f-3be446a4c0f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:19:08.781468 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance c2eccafd-0a91-4c01-aa90-d3b031af3aa2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:19:08.781468 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 10:19:08.781573 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Final resource view: name=np0000001613 phys_ram=24030MB used_ram=896MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 10:19:07 up 51 min,  2 users,  load average: 1.62, 4.20, 4.77\n', 'num_instances': '2', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '2', 'num_proj_9dd45e575a1740e8aa1c09f4f908d747': '2', 'io_workload': '0'} {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 10:19:08.894363 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:19:08.894596 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:19:09.247220 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:19:09.397020 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:19:09.633820 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:09.903764 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Compute_service record updated for np0000001613:np0000001613 {{(pid=98321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 10:19:09.904247 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.175s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:19:09.904247 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:19:10.270898 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:10.900114 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:19:10.900531 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:19:10.900788 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:19:10.900952 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 10:19:10.901178 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.89 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:19:11.791858 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:19:11.792337 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:19:12.792055 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:19:12.792485 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 7.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:19:14.635875 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:15.272819 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:19.636670 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:19.788033 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:19:19.788345 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 39.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:19:20.274195 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:24.174862 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "c2eccafd-0a91-4c01-aa90-d3b031af3aa2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:19:24.175318 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "c2eccafd-0a91-4c01-aa90-d3b031af3aa2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:19:24.638067 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:24.678333 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lazy-loading 'flavor' on Instance uuid c2eccafd-0a91-4c01-aa90-d3b031af3aa2 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:19:25.275107 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:25.683032 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "c2eccafd-0a91-4c01-aa90-d3b031af3aa2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:19:26.743743 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "c2eccafd-0a91-4c01-aa90-d3b031af3aa2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:19:26.744283 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "c2eccafd-0a91-4c01-aa90-d3b031af3aa2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:19:26.744283 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Attaching volume a7d08180-9fbd-457d-aa39-f3b814fcdc92 to /dev/vdb
May 28 10:19:26.777963 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:19:26.787789 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:19:26.806058 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:19:26.849998 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:19:26.850276 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:19:26.858225 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:19:26.859107 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe9d:d1c1', 'fe80::b01d:8aff:fede:b711', 'fe80::fc16:3eff:fe5f:bcd7'] 
May 28 10:19:26.859238 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:19:26.859329 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:19:26.859554 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] <== get_connector_properties: return (81ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:19:26.859811 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Updating existing volume attachment record: e6287bda-0e61-4743-8b32-7930306e8396 {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:19:27.409221 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:19:27.409559 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92', 'iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7d08180-9fbd-457d-aa39-f3b814fcdc92', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:19:27.409734 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:19:27.410155 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:19:27.410374 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92', 'iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7d08180-9fbd-457d-aa39-f3b814fcdc92', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:19:27.421302 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:19:27.421831 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:19:27.422268 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:19:27.422690 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:19:27.423124 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:19:27.423397 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.startup = automatic
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.session.scan = manual
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:19:27.434672 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:19:27.434672 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.startup = automatic
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.session.scan = manual
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:19:27.440784 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:19:27.440784 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:19:27.447447 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:19:27.455923 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:19:27.462026 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:19:27.462026 np0000001613 nova-compute[98321]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:19:27.462026 np0000001613 nova-compute[98321]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3 (non-flash)
May 28 10:19:27.462026 np0000001613 nova-compute[98321]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3 (non-flash)
May 28 10:19:27.462026 np0000001613 nova-compute[98321]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92 (non-flash)
May 28 10:19:27.462026 np0000001613 nova-compute[98321]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92 (non-flash)
May 28 10:19:27.462026 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:19:27.462245 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:19:27.462245 np0000001613 nova-compute[98321]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:19:27.462245 np0000001613 nova-compute[98321]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3 (non-flash)
May 28 10:19:27.462245 np0000001613 nova-compute[98321]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3 (non-flash)
May 28 10:19:27.462245 np0000001613 nova-compute[98321]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92 (non-flash)
May 28 10:19:27.462245 np0000001613 nova-compute[98321]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92 (non-flash)
May 28 10:19:27.462245 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:19:27.462496 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.040s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:19:27.462636 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:19:27.463176 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] HCTL ('11', '0', '0', 0) found on session 231 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:19:27.463338 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Scanning host 11 c: 0, t: 0, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:19:27.470484 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:19:27.470484 np0000001613 nova-compute[98321]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:19:27.470484 np0000001613 nova-compute[98321]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3 (non-flash)
May 28 10:19:27.470484 np0000001613 nova-compute[98321]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3 (non-flash)
May 28 10:19:27.470484 np0000001613 nova-compute[98321]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92 (non-flash)
May 28 10:19:27.470484 np0000001613 nova-compute[98321]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92 (non-flash)
May 28 10:19:27.470484 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:19:27.470735 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:19:27.470735 np0000001613 nova-compute[98321]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:19:27.470735 np0000001613 nova-compute[98321]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3 (non-flash)
May 28 10:19:27.470735 np0000001613 nova-compute[98321]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3 (non-flash)
May 28 10:19:27.470735 np0000001613 nova-compute[98321]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92 (non-flash)
May 28 10:19:27.470735 np0000001613 nova-compute[98321]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92 (non-flash)
May 28 10:19:27.470735 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:19:27.470965 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.049s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:19:27.471117 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:19:27.471852 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Searching for a device in session 231 and hctl ('11', '0', '0', 0) yield: sdf {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:19:27.472016 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7d08180-9fbd-457d-aa39-f3b814fcdc92', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:19:27.472493 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] HCTL ('12', '0', '0', 0) found on session 232 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:19:27.472629 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Scanning host 12 c: 0, t: 0, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:19:27.480300 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Searching for a device in session 232 and hctl ('12', '0', '0', 0) yield: sdg {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:19:27.480415 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a7d08180-9fbd-457d-aa39-f3b814fcdc92', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:19:28.423246 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 10:19:29.438402 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Found WWN 330000000eacb8178 for multipath device dm-2 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:19:29.438909 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.028s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:19:29.438909 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] <== connect_volume: return (2029ms) {'type': 'block', 'scsi_wwn': '330000000eacb8178', 'path': '/dev/dm-2', 'multipath_id': '330000000eacb8178'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:19:29.439022 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000eacb8178', 'path': '/dev/dm-2', 'multipath_id': '330000000eacb8178'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:19:29.441941 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lazy-loading 'flavor' on Instance uuid c2eccafd-0a91-4c01-aa90-d3b031af3aa2 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:19:29.639902 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:29.945414 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Attempting to attach volume a7d08180-9fbd-457d-aa39-f3b814fcdc92 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 10:19:29.946798 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] attach device xml: <disk type="block" device="disk">
May 28 10:19:29.946798 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:19:29.946798 np0000001613 nova-compute[98321]:   <alias name="ua-a7d08180-9fbd-457d-aa39-f3b814fcdc92"/>
May 28 10:19:29.946798 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-2"/>
May 28 10:19:29.946798 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:19:29.946798 np0000001613 nova-compute[98321]:   <serial>a7d08180-9fbd-457d-aa39-f3b814fcdc92</serial>
May 28 10:19:29.946798 np0000001613 nova-compute[98321]:   <shareable/>
May 28 10:19:29.946798 np0000001613 nova-compute[98321]: </disk>
May 28 10:19:29.946798 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 10:19:30.276389 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:31.582391 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:19:31.582792 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:19:31.582792 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:19:31.582792 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] No VIF found with MAC fa:16:3e:5f:bc:d7, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:19:33.126504 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-a34e2bef-02aa-4ac0-8488-84f9ca31e691 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "c2eccafd-0a91-4c01-aa90-d3b031af3aa2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.382s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:19:34.641642 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:34.840999 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0572b51c-58b7-4d3d-a768-414c64294ecb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "c2eccafd-0a91-4c01-aa90-d3b031af3aa2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:19:34.841172 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0572b51c-58b7-4d3d-a768-414c64294ecb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "c2eccafd-0a91-4c01-aa90-d3b031af3aa2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:19:35.277791 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:35.343276 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-0572b51c-58b7-4d3d-a768-414c64294ecb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Detaching volume a7d08180-9fbd-457d-aa39-f3b814fcdc92
May 28 10:19:35.378770 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-0572b51c-58b7-4d3d-a768-414c64294ecb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Attempting to driver detach volume a7d08180-9fbd-457d-aa39-f3b814fcdc92 from mountpoint /dev/vdb
May 28 10:19:35.383188 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0572b51c-58b7-4d3d-a768-414c64294ecb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Found disk vdb by alias ua-a7d08180-9fbd-457d-aa39-f3b814fcdc92 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:19:35.384448 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0572b51c-58b7-4d3d-a768-414c64294ecb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Found disk vdb by alias ua-a7d08180-9fbd-457d-aa39-f3b814fcdc92 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:19:35.384599 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0572b51c-58b7-4d3d-a768-414c64294ecb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Attempting to detach device vdb from instance c2eccafd-0a91-4c01-aa90-d3b031af3aa2 from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 10:19:35.384827 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-0572b51c-58b7-4d3d-a768-414c64294ecb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:19:35.384827 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:19:35.384827 np0000001613 nova-compute[98321]:   <alias name="ua-a7d08180-9fbd-457d-aa39-f3b814fcdc92"/>
May 28 10:19:35.384827 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-2"/>
May 28 10:19:35.384827 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:19:35.384827 np0000001613 nova-compute[98321]:   <serial>a7d08180-9fbd-457d-aa39-f3b814fcdc92</serial>
May 28 10:19:35.384827 np0000001613 nova-compute[98321]:   <shareable/>
May 28 10:19:35.384827 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:19:35.384827 np0000001613 nova-compute[98321]: </disk>
May 28 10:19:35.384827 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:19:35.391127 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-0572b51c-58b7-4d3d-a768-414c64294ecb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Successfully detached device vdb from instance c2eccafd-0a91-4c01-aa90-d3b031af3aa2 from the persistent domain config.
May 28 10:19:35.391423 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0572b51c-58b7-4d3d-a768-414c64294ecb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] (1/8): Attempting to detach device vdb with device alias ua-a7d08180-9fbd-457d-aa39-f3b814fcdc92 from instance c2eccafd-0a91-4c01-aa90-d3b031af3aa2 from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 10:19:35.391673 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-0572b51c-58b7-4d3d-a768-414c64294ecb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:19:35.391673 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:19:35.391673 np0000001613 nova-compute[98321]:   <alias name="ua-a7d08180-9fbd-457d-aa39-f3b814fcdc92"/>
May 28 10:19:35.391673 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-2"/>
May 28 10:19:35.391673 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:19:35.391673 np0000001613 nova-compute[98321]:   <serial>a7d08180-9fbd-457d-aa39-f3b814fcdc92</serial>
May 28 10:19:35.391673 np0000001613 nova-compute[98321]:   <shareable/>
May 28 10:19:35.391673 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:19:35.391673 np0000001613 nova-compute[98321]: </disk>
May 28 10:19:35.391673 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:19:35.826854 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779963575.8263798, c2eccafd-0a91-4c01-aa90-d3b031af3aa2 => ua-a7d08180-9fbd-457d-aa39-f3b814fcdc92> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 10:19:35.827907 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-0572b51c-58b7-4d3d-a768-414c64294ecb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-a7d08180-9fbd-457d-aa39-f3b814fcdc92 for instance c2eccafd-0a91-4c01-aa90-d3b031af3aa2 {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 10:19:35.830005 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-0572b51c-58b7-4d3d-a768-414c64294ecb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Successfully detached device vdb from instance c2eccafd-0a91-4c01-aa90-d3b031af3aa2 from the live domain config.
May 28 10:19:36.363681 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-0572b51c-58b7-4d3d-a768-414c64294ecb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Detected multiple connections on this host for volume: a7d08180-9fbd-457d-aa39-f3b814fcdc92, skipping target disconnect.
May 28 10:19:36.920896 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-0572b51c-58b7-4d3d-a768-414c64294ecb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lazy-loading 'flavor' on Instance uuid c2eccafd-0a91-4c01-aa90-d3b031af3aa2 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:19:37.926239 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-0572b51c-58b7-4d3d-a768-414c64294ecb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "c2eccafd-0a91-4c01-aa90-d3b031af3aa2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.085s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:19:38.022188 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3e9ba0db-c3cb-4cde-9909-65978cf37e43 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "c2eccafd-0a91-4c01-aa90-d3b031af3aa2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:19:38.022317 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3e9ba0db-c3cb-4cde-9909-65978cf37e43 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "c2eccafd-0a91-4c01-aa90-d3b031af3aa2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:19:38.022557 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3e9ba0db-c3cb-4cde-9909-65978cf37e43 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "c2eccafd-0a91-4c01-aa90-d3b031af3aa2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:19:38.022742 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3e9ba0db-c3cb-4cde-9909-65978cf37e43 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "c2eccafd-0a91-4c01-aa90-d3b031af3aa2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:19:38.022891 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3e9ba0db-c3cb-4cde-9909-65978cf37e43 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "c2eccafd-0a91-4c01-aa90-d3b031af3aa2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:19:38.024820 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-3e9ba0db-c3cb-4cde-9909-65978cf37e43 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Terminating instance
May 28 10:19:38.527657 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-3e9ba0db-c3cb-4cde-9909-65978cf37e43 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:19:38.542695 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:38.544682 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:38.559720 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:38.662454 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-1c52926c-068c-4f7b-b6a7-afae54d2e54f req-18fa608b-479d-4dd4-8597-817170ac3285 service nova] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Received event network-vif-unplugged-a9edb7a2-d9a3-48b3-9e74-c0479fab8d30 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:19:38.662661 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1c52926c-068c-4f7b-b6a7-afae54d2e54f req-18fa608b-479d-4dd4-8597-817170ac3285 service nova] Acquiring lock "c2eccafd-0a91-4c01-aa90-d3b031af3aa2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:19:38.663019 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1c52926c-068c-4f7b-b6a7-afae54d2e54f req-18fa608b-479d-4dd4-8597-817170ac3285 service nova] Lock "c2eccafd-0a91-4c01-aa90-d3b031af3aa2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:19:38.663134 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-1c52926c-068c-4f7b-b6a7-afae54d2e54f req-18fa608b-479d-4dd4-8597-817170ac3285 service nova] Lock "c2eccafd-0a91-4c01-aa90-d3b031af3aa2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:19:38.663275 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-1c52926c-068c-4f7b-b6a7-afae54d2e54f req-18fa608b-479d-4dd4-8597-817170ac3285 service nova] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] No waiting events found dispatching network-vif-unplugged-a9edb7a2-d9a3-48b3-9e74-c0479fab8d30 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:19:38.663390 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-1c52926c-068c-4f7b-b6a7-afae54d2e54f req-18fa608b-479d-4dd4-8597-817170ac3285 service nova] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Received event network-vif-unplugged-a9edb7a2-d9a3-48b3-9e74-c0479fab8d30 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:19:38.695205 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:38.700125 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:38.725880 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:38.830909 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999701043999721 future=<Future at 0x73c1d4774b90 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:19:38.831295 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999338539999826 future=<Future at 0x73c1d4774b90 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:19:38.831443 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999138797999876 future=<Future at 0x73c1d4774b90 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:19:38.833562 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Instance destroyed successfully.
May 28 10:19:38.833967 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-3e9ba0db-c3cb-4cde-9909-65978cf37e43 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lazy-loading 'resources' on Instance uuid c2eccafd-0a91-4c01-aa90-d3b031af3aa2 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:19:39.336254 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-3e9ba0db-c3cb-4cde-9909-65978cf37e43 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:18:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-940717995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumemultiattachtests-server-940717995',id=81,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwYjtkPyDRwaN7lG/Ges1nPjaQJSEIkreLgqYiqypDXxmPWGcyfsisy2A7gM0FS3C15tLuAwP3yhgLZ3hrVGouaoGnnTGGlktMEdDHF0SzKTbbZlRZ7yxKDPVse6ZbzNg==',key_name='tempest-keypair-344224413',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:18:58Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9dd45e575a1740e8aa1c09f4f908d747',ramdisk_id='',reservation_id='r-cszdtgzl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-1491725275',owner_user_name='tempest-VolumeMultiattachTests-1491725275-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:18:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f68f80c0467244b696935ee039759675',uuid=c2eccafd-0a91-4c01-aa90-d3b031af3aa2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9edb7a2-d9a3-48b3-9e74-c0479fab8d30", "address": "fa:16:3e:5f:bc:d7", "network": {"id": "fd85d7ca-665d-4c88-a0fc-f5b183b538d1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-852450606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dd45e575a1740e8aa1c09f4f908d747", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9edb7a2-d9", "ovs_interfaceid": "a9edb7a2-d9a3-48b3-9e74-c0479fab8d30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:19:39.336770 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-3e9ba0db-c3cb-4cde-9909-65978cf37e43 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Converting VIF {"id": "a9edb7a2-d9a3-48b3-9e74-c0479fab8d30", "address": "fa:16:3e:5f:bc:d7", "network": {"id": "fd85d7ca-665d-4c88-a0fc-f5b183b538d1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-852450606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dd45e575a1740e8aa1c09f4f908d747", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9edb7a2-d9", "ovs_interfaceid": "a9edb7a2-d9a3-48b3-9e74-c0479fab8d30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:19:39.337057 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-3e9ba0db-c3cb-4cde-9909-65978cf37e43 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:bc:d7,bridge_name='br-int',has_traffic_filtering=True,id=a9edb7a2-d9a3-48b3-9e74-c0479fab8d30,network=Network(fd85d7ca-665d-4c88-a0fc-f5b183b538d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9edb7a2-d9') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:19:39.337302 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-3e9ba0db-c3cb-4cde-9909-65978cf37e43 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:bc:d7,bridge_name='br-int',has_traffic_filtering=True,id=a9edb7a2-d9a3-48b3-9e74-c0479fab8d30,network=Network(fd85d7ca-665d-4c88-a0fc-f5b183b538d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9edb7a2-d9') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:19:39.338927 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:39.339111 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9edb7a2-d9, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:19:39.340073 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:39.340785 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:19:39.341085 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:39.341674 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:39.341788 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3e6fbaae-79a8-4edb-893f-27d2f79b9117) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:19:39.342180 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:39.342608 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:19:39.342875 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:39.344412 np0000001613 nova-compute[98321]: INFO os_vif [None req-3e9ba0db-c3cb-4cde-9909-65978cf37e43 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:bc:d7,bridge_name='br-int',has_traffic_filtering=True,id=a9edb7a2-d9a3-48b3-9e74-c0479fab8d30,network=Network(fd85d7ca-665d-4c88-a0fc-f5b183b538d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9edb7a2-d9')
May 28 10:19:39.344727 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-3e9ba0db-c3cb-4cde-9909-65978cf37e43 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Deleting instance files /opt/stack/data/nova/instances/c2eccafd-0a91-4c01-aa90-d3b031af3aa2_del
May 28 10:19:39.345414 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-3e9ba0db-c3cb-4cde-9909-65978cf37e43 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Deletion of /opt/stack/data/nova/instances/c2eccafd-0a91-4c01-aa90-d3b031af3aa2_del complete
May 28 10:19:39.851034 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-3e9ba0db-c3cb-4cde-9909-65978cf37e43 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Took 1.32 seconds to destroy the instance on the hypervisor.
May 28 10:19:39.851697 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-3e9ba0db-c3cb-4cde-9909-65978cf37e43 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:19:39.851901 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:19:39.852033 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:19:39.852332 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:19:39.944671 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:19:40.308916 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-531b49f4-55d2-4f7e-8119-99bd808e52fa req-965e68b0-1796-4973-b00a-8563456c011e service nova] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Received event network-vif-deleted-a9edb7a2-d9a3-48b3-9e74-c0479fab8d30 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:19:40.309075 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-531b49f4-55d2-4f7e-8119-99bd808e52fa req-965e68b0-1796-4973-b00a-8563456c011e service nova] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Neutron deleted interface a9edb7a2-d9a3-48b3-9e74-c0479fab8d30; detaching it from the instance and deleting it from the info cache
May 28 10:19:40.310713 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-531b49f4-55d2-4f7e-8119-99bd808e52fa req-965e68b0-1796-4973-b00a-8563456c011e service nova] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Detach interface failed, port_id=a9edb7a2-d9a3-48b3-9e74-c0479fab8d30, reason: Instance c2eccafd-0a91-4c01-aa90-d3b031af3aa2 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:19:40.715143 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8449c59b-28bd-4f7e-91df-a6058b5d3e8c req-a3706ba3-a467-472b-8801-f645f932b362 service nova] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Received event network-vif-unplugged-a9edb7a2-d9a3-48b3-9e74-c0479fab8d30 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:19:40.715509 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8449c59b-28bd-4f7e-91df-a6058b5d3e8c req-a3706ba3-a467-472b-8801-f645f932b362 service nova] Acquiring lock "c2eccafd-0a91-4c01-aa90-d3b031af3aa2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:19:40.715509 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8449c59b-28bd-4f7e-91df-a6058b5d3e8c req-a3706ba3-a467-472b-8801-f645f932b362 service nova] Lock "c2eccafd-0a91-4c01-aa90-d3b031af3aa2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:19:40.715639 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8449c59b-28bd-4f7e-91df-a6058b5d3e8c req-a3706ba3-a467-472b-8801-f645f932b362 service nova] Lock "c2eccafd-0a91-4c01-aa90-d3b031af3aa2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:19:40.715694 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8449c59b-28bd-4f7e-91df-a6058b5d3e8c req-a3706ba3-a467-472b-8801-f645f932b362 service nova] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] No waiting events found dispatching network-vif-unplugged-a9edb7a2-d9a3-48b3-9e74-c0479fab8d30 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:19:40.715802 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8449c59b-28bd-4f7e-91df-a6058b5d3e8c req-a3706ba3-a467-472b-8801-f645f932b362 service nova] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Received event network-vif-unplugged-a9edb7a2-d9a3-48b3-9e74-c0479fab8d30 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:19:40.768392 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:19:41.270598 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Took 1.42 seconds to deallocate network for instance.
May 28 10:19:41.776706 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3e9ba0db-c3cb-4cde-9909-65978cf37e43 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:19:41.777261 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3e9ba0db-c3cb-4cde-9909-65978cf37e43 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:19:41.896570 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-3e9ba0db-c3cb-4cde-9909-65978cf37e43 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:19:41.896851 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-3e9ba0db-c3cb-4cde-9909-65978cf37e43 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:19:42.399505 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-3e9ba0db-c3cb-4cde-9909-65978cf37e43 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:19:42.905849 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3e9ba0db-c3cb-4cde-9909-65978cf37e43 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.129s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:19:42.949958 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-3e9ba0db-c3cb-4cde-9909-65978cf37e43 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Deleted allocations for instance c2eccafd-0a91-4c01-aa90-d3b031af3aa2
May 28 10:19:43.957221 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-3e9ba0db-c3cb-4cde-9909-65978cf37e43 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "c2eccafd-0a91-4c01-aa90-d3b031af3aa2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.935s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:19:44.343411 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:45.084707 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:19:45.085131 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:19:45.587499 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Detaching volume a7d08180-9fbd-457d-aa39-f3b814fcdc92
May 28 10:19:45.622104 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Attempting to driver detach volume a7d08180-9fbd-457d-aa39-f3b814fcdc92 from mountpoint /dev/vdd
May 28 10:19:45.626603 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Found disk vdd by alias ua-a7d08180-9fbd-457d-aa39-f3b814fcdc92 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:19:45.627990 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Found disk vdd by alias ua-a7d08180-9fbd-457d-aa39-f3b814fcdc92 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:19:45.628131 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Attempting to detach device vdd from instance 5d8c2bb9-680c-4a83-876f-3be446a4c0f8 from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 10:19:45.628447 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:19:45.628447 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:19:45.628447 np0000001613 nova-compute[98321]:   <alias name="ua-a7d08180-9fbd-457d-aa39-f3b814fcdc92"/>
May 28 10:19:45.628447 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-2"/>
May 28 10:19:45.628447 np0000001613 nova-compute[98321]:   <target dev="vdd" bus="virtio"/>
May 28 10:19:45.628447 np0000001613 nova-compute[98321]:   <serial>a7d08180-9fbd-457d-aa39-f3b814fcdc92</serial>
May 28 10:19:45.628447 np0000001613 nova-compute[98321]:   <shareable/>
May 28 10:19:45.628447 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x09" function="0x0"/>
May 28 10:19:45.628447 np0000001613 nova-compute[98321]: </disk>
May 28 10:19:45.628447 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:19:45.635259 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Successfully detached device vdd from instance 5d8c2bb9-680c-4a83-876f-3be446a4c0f8 from the persistent domain config.
May 28 10:19:45.635413 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] (1/8): Attempting to detach device vdd with device alias ua-a7d08180-9fbd-457d-aa39-f3b814fcdc92 from instance 5d8c2bb9-680c-4a83-876f-3be446a4c0f8 from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 10:19:45.635636 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:19:45.635636 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:19:45.635636 np0000001613 nova-compute[98321]:   <alias name="ua-a7d08180-9fbd-457d-aa39-f3b814fcdc92"/>
May 28 10:19:45.635636 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-2"/>
May 28 10:19:45.635636 np0000001613 nova-compute[98321]:   <target dev="vdd" bus="virtio"/>
May 28 10:19:45.635636 np0000001613 nova-compute[98321]:   <serial>a7d08180-9fbd-457d-aa39-f3b814fcdc92</serial>
May 28 10:19:45.635636 np0000001613 nova-compute[98321]:   <shareable/>
May 28 10:19:45.635636 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x09" function="0x0"/>
May 28 10:19:45.635636 np0000001613 nova-compute[98321]: </disk>
May 28 10:19:45.635636 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:19:46.117020 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779963586.116647, 5d8c2bb9-680c-4a83-876f-3be446a4c0f8 => ua-a7d08180-9fbd-457d-aa39-f3b814fcdc92> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 10:19:46.118039 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Start waiting for the detach event from libvirt for device vdd with device alias ua-a7d08180-9fbd-457d-aa39-f3b814fcdc92 for instance 5d8c2bb9-680c-4a83-876f-3be446a4c0f8 {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 10:19:46.120487 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Successfully detached device vdd from instance 5d8c2bb9-680c-4a83-876f-3be446a4c0f8 from the live domain config.
May 28 10:19:46.147683 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:19:46.147940 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92', 'iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7d08180-9fbd-457d-aa39-f3b814fcdc92', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:19:46.148057 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:19:46.148352 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:19:46.148645 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92', 'iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7d08180-9fbd-457d-aa39-f3b814fcdc92', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:19:46.148807 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:19:46.173072 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:19:46.173072 np0000001613 nova-compute[98321]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:19:46.173072 np0000001613 nova-compute[98321]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3 (non-flash)
May 28 10:19:46.173072 np0000001613 nova-compute[98321]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3 (non-flash)
May 28 10:19:46.173072 np0000001613 nova-compute[98321]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92 (non-flash)
May 28 10:19:46.173072 np0000001613 nova-compute[98321]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92 (non-flash)
May 28 10:19:46.173072 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:19:46.173484 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:19:46.173484 np0000001613 nova-compute[98321]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:19:46.173484 np0000001613 nova-compute[98321]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3 (non-flash)
May 28 10:19:46.173484 np0000001613 nova-compute[98321]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3 (non-flash)
May 28 10:19:46.173484 np0000001613 nova-compute[98321]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92 (non-flash)
May 28 10:19:46.173484 np0000001613 nova-compute[98321]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92 (non-flash)
May 28 10:19:46.173484 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:19:46.173484 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7', '227'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7', '228'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3', '229'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3', '230'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92', '231'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92', '232')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:19:46.173484 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92', '231')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:19:46.174327 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92', '232')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:19:46.175019 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1f4714ea0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92'): ({'sdg'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:19:46.175283 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Removing multipathed devices sdf, sdg {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:19:46.175494 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Flush multipath device 330000000eacb8178 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:19:46.211480 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:19:46.251541 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:19:46.289559 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:19:46.289777 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:19:46.290494 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:19:46.302807 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:19:46.302981 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:19:46.314869 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:19:46.352067 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 231, target: iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92, portal: 192.168.40.100,3260]
May 28 10:19:46.352067 np0000001613 nova-compute[98321]: Logout of [sid: 231, target: iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92, portal: 192.168.40.100,3260] successful.
May 28 10:19:46.352067 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:19:46.366878 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:19:46.377210 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:19:46.401913 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 232, target: iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92, portal: 192.168.50.100,3260]
May 28 10:19:46.401913 np0000001613 nova-compute[98321]: Logout of [sid: 232, target: iqn.2023-03.storpool.com:os--volume-a7d08180-9fbd-457d-aa39-f3b814fcdc92, portal: 192.168.50.100,3260] successful.
May 28 10:19:46.401913 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:19:46.414731 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:19:46.414938 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:19:46.415050 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] <== disconnect_volume: return (267ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:19:46.415156 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:19:46.956228 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lazy-loading 'flavor' on Instance uuid 5d8c2bb9-680c-4a83-876f-3be446a4c0f8 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:19:47.961349 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6a1e3705-bf8b-4e12-8e53-bdc70c5ef934 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.876s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:19:48.334568 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:19:48.334721 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:19:48.836694 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Detaching volume 67cea768-f66c-4806-88cf-45bc61ac5dd3
May 28 10:19:48.872086 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Attempting to driver detach volume 67cea768-f66c-4806-88cf-45bc61ac5dd3 from mountpoint /dev/vdc
May 28 10:19:48.900310 np0000001613 nova-compute[98321]: DEBUG os_brick.encryptors [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3', 'iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67cea768-f66c-4806-88cf-45bc61ac5dd3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '5d8c2bb9-680c-4a83-876f-3be446a4c0f8', 'attached_at': '', 'detached_at': '', 'volume_id': '67cea768-f66c-4806-88cf-45bc61ac5dd3', 'serial': '67cea768-f66c-4806-88cf-45bc61ac5dd3'} {{(pid=98321) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 10:19:48.904462 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Found disk vdc by alias ua-67cea768-f66c-4806-88cf-45bc61ac5dd3 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:19:48.905583 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Found disk vdc by alias ua-67cea768-f66c-4806-88cf-45bc61ac5dd3 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:19:48.905731 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Attempting to detach device vdc from instance 5d8c2bb9-680c-4a83-876f-3be446a4c0f8 from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 10:19:48.905945 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:19:48.905945 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:19:48.905945 np0000001613 nova-compute[98321]:   <alias name="ua-67cea768-f66c-4806-88cf-45bc61ac5dd3"/>
May 28 10:19:48.905945 np0000001613 nova-compute[98321]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 28 10:19:48.905945 np0000001613 nova-compute[98321]:   <target dev="vdc" bus="virtio"/>
May 28 10:19:48.905945 np0000001613 nova-compute[98321]:   <serial>67cea768-f66c-4806-88cf-45bc61ac5dd3</serial>
May 28 10:19:48.905945 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 10:19:48.905945 np0000001613 nova-compute[98321]:   <encryption format="luks">
May 28 10:19:48.905945 np0000001613 nova-compute[98321]:     <secret type="passphrase" uuid="30909bbd-6a2f-4909-a8b4-87d102690e1c"/>
May 28 10:19:48.905945 np0000001613 nova-compute[98321]:   </encryption>
May 28 10:19:48.905945 np0000001613 nova-compute[98321]: </disk>
May 28 10:19:48.905945 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:19:48.911487 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Successfully detached device vdc from instance 5d8c2bb9-680c-4a83-876f-3be446a4c0f8 from the persistent domain config.
May 28 10:19:48.911602 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] (1/8): Attempting to detach device vdc with device alias ua-67cea768-f66c-4806-88cf-45bc61ac5dd3 from instance 5d8c2bb9-680c-4a83-876f-3be446a4c0f8 from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 10:19:48.911861 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:19:48.911861 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:19:48.911861 np0000001613 nova-compute[98321]:   <alias name="ua-67cea768-f66c-4806-88cf-45bc61ac5dd3"/>
May 28 10:19:48.911861 np0000001613 nova-compute[98321]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 28 10:19:48.911861 np0000001613 nova-compute[98321]:   <target dev="vdc" bus="virtio"/>
May 28 10:19:48.911861 np0000001613 nova-compute[98321]:   <serial>67cea768-f66c-4806-88cf-45bc61ac5dd3</serial>
May 28 10:19:48.911861 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 10:19:48.911861 np0000001613 nova-compute[98321]:   <encryption format="luks">
May 28 10:19:48.911861 np0000001613 nova-compute[98321]:     <secret type="passphrase" uuid="30909bbd-6a2f-4909-a8b4-87d102690e1c"/>
May 28 10:19:48.911861 np0000001613 nova-compute[98321]:   </encryption>
May 28 10:19:48.911861 np0000001613 nova-compute[98321]: </disk>
May 28 10:19:48.911861 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:19:49.343942 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:19:49.344525 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:19:49.344525 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5000 ms, sending inactivity probe {{(pid=98321) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 10:19:49.344525 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98321) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 10:19:49.344842 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:49.345050 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98321) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 10:19:49.368384 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779963589.36802, 5d8c2bb9-680c-4a83-876f-3be446a4c0f8 => ua-67cea768-f66c-4806-88cf-45bc61ac5dd3> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 10:19:49.368900 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-67cea768-f66c-4806-88cf-45bc61ac5dd3 for instance 5d8c2bb9-680c-4a83-876f-3be446a4c0f8 {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 10:19:49.371864 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Successfully detached device vdc from instance 5d8c2bb9-680c-4a83-876f-3be446a4c0f8 from the live domain config.
May 28 10:19:49.374761 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:19:49.375127 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3', 'iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67cea768-f66c-4806-88cf-45bc61ac5dd3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:19:49.375341 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:19:49.375750 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:19:49.376114 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3', 'iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67cea768-f66c-4806-88cf-45bc61ac5dd3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:19:49.376303 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:19:49.398184 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:19:49.398184 np0000001613 nova-compute[98321]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:19:49.398184 np0000001613 nova-compute[98321]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3 (non-flash)
May 28 10:19:49.398184 np0000001613 nova-compute[98321]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3 (non-flash)
May 28 10:19:49.398184 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:19:49.398453 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:19:49.398453 np0000001613 nova-compute[98321]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:19:49.398453 np0000001613 nova-compute[98321]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3 (non-flash)
May 28 10:19:49.398453 np0000001613 nova-compute[98321]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3 (non-flash)
May 28 10:19:49.398453 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:19:49.398453 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7', '227'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7', '228'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3', '229'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3', '230')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:19:49.398656 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3', '229')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:19:49.399295 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3', '230')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:19:49.399912 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1f4736de0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3'): ({'sdc'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:19:49.400070 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Removing multipathed devices sdb, sdc {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:19:49.400307 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Flush multipath device 3300000003a2b46b7 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:19:49.432468 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:19:49.492752 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:19:49.546726 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:19:49.546963 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:19:49.547909 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:19:49.559581 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:19:49.559824 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:19:49.571184 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:19:49.604521 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 229, target: iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3, portal: 192.168.40.100,3260]
May 28 10:19:49.604521 np0000001613 nova-compute[98321]: Logout of [sid: 229, target: iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3, portal: 192.168.40.100,3260] successful.
May 28 10:19:49.604521 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:19:49.618037 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:19:49.628995 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:19:49.654015 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 230, target: iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3, portal: 192.168.50.100,3260]
May 28 10:19:49.654015 np0000001613 nova-compute[98321]: Logout of [sid: 230, target: iqn.2023-03.storpool.com:os--volume-67cea768-f66c-4806-88cf-45bc61ac5dd3, portal: 192.168.50.100,3260] successful.
May 28 10:19:49.654015 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:19:49.665910 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:19:49.666916 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:19:49.667026 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] <== disconnect_volume: return (291ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:19:49.667159 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:19:50.207258 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lazy-loading 'flavor' on Instance uuid 5d8c2bb9-680c-4a83-876f-3be446a4c0f8 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:19:51.212845 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-c9531911-fd14-46ce-968e-de78c49a592d tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.878s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:19:51.583689 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:19:51.583832 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:19:52.086022 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Detaching volume 2a3987dd-17ca-4f7d-b97b-b69ce400fbd7
May 28 10:19:52.123486 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Attempting to driver detach volume 2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 from mountpoint /dev/vdb
May 28 10:19:52.128656 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Found disk vdb by alias ua-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:19:52.129913 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Found disk vdb by alias ua-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:19:52.130048 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Attempting to detach device vdb from instance 5d8c2bb9-680c-4a83-876f-3be446a4c0f8 from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 10:19:52.130299 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:19:52.130299 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:19:52.130299 np0000001613 nova-compute[98321]:   <alias name="ua-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7"/>
May 28 10:19:52.130299 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-1"/>
May 28 10:19:52.130299 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:19:52.130299 np0000001613 nova-compute[98321]:   <serial>2a3987dd-17ca-4f7d-b97b-b69ce400fbd7</serial>
May 28 10:19:52.130299 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:19:52.130299 np0000001613 nova-compute[98321]: </disk>
May 28 10:19:52.130299 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:19:52.135691 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Successfully detached device vdb from instance 5d8c2bb9-680c-4a83-876f-3be446a4c0f8 from the persistent domain config.
May 28 10:19:52.135857 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] (1/8): Attempting to detach device vdb with device alias ua-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 from instance 5d8c2bb9-680c-4a83-876f-3be446a4c0f8 from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 10:19:52.136105 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:19:52.136105 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:19:52.136105 np0000001613 nova-compute[98321]:   <alias name="ua-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7"/>
May 28 10:19:52.136105 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-1"/>
May 28 10:19:52.136105 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:19:52.136105 np0000001613 nova-compute[98321]:   <serial>2a3987dd-17ca-4f7d-b97b-b69ce400fbd7</serial>
May 28 10:19:52.136105 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:19:52.136105 np0000001613 nova-compute[98321]: </disk>
May 28 10:19:52.136105 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:19:52.595944 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779963592.5956244, 5d8c2bb9-680c-4a83-876f-3be446a4c0f8 => ua-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 10:19:52.596948 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 for instance 5d8c2bb9-680c-4a83-876f-3be446a4c0f8 {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 10:19:52.598996 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Successfully detached device vdb from instance 5d8c2bb9-680c-4a83-876f-3be446a4c0f8 from the live domain config.
May 28 10:19:52.600031 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:19:52.600304 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7', 'iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2a3987dd-17ca-4f7d-b97b-b69ce400fbd7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:19:52.600426 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:19:52.600728 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:19:52.600940 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7', 'iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2a3987dd-17ca-4f7d-b97b-b69ce400fbd7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:19:52.601053 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:19:52.621627 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:19:52.621627 np0000001613 nova-compute[98321]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:19:52.621627 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:19:52.621811 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:19:52.621811 np0000001613 nova-compute[98321]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7 (non-flash)
May 28 10:19:52.621811 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:19:52.621811 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7', '227'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7', '228')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:19:52.621921 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7', '227')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:19:52.622566 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7', '228')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:19:52.623102 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1f41087c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7'): ({'sde'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:19:52.623289 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Removing multipathed devices sdd, sde {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:19:52.623482 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Flush multipath device 3300000007b30c6a7 {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:19:52.655324 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:19:52.697567 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:19:52.741548 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:19:52.741694 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:19:52.742220 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:19:52.752549 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:19:52.752704 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:19:52.763386 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:19:52.791057 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 227, target: iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7, portal: 192.168.40.100,3260]
May 28 10:19:52.791057 np0000001613 nova-compute[98321]: Logout of [sid: 227, target: iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7, portal: 192.168.40.100,3260] successful.
May 28 10:19:52.791057 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:19:52.801904 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:19:52.810656 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:19:52.837806 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 228, target: iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7, portal: 192.168.50.100,3260]
May 28 10:19:52.837806 np0000001613 nova-compute[98321]: Logout of [sid: 228, target: iqn.2023-03.storpool.com:os--volume-2a3987dd-17ca-4f7d-b97b-b69ce400fbd7, portal: 192.168.50.100,3260] successful.
May 28 10:19:52.837806 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:19:52.847884 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:19:52.848028 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.247s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:19:52.848138 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] <== disconnect_volume: return (247ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:19:52.848269 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:19:53.387407 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lazy-loading 'flavor' on Instance uuid 5d8c2bb9-680c-4a83-876f-3be446a4c0f8 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:19:53.830986 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.00036976699993829243 future=<Future at 0x73c1d4774b90 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:19:53.831837 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Emitting event <LifecycleEvent: 1779963578.8305051, c2eccafd-0a91-4c01-aa90-d3b031af3aa2 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:19:53.832034 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:19:53.832150 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] VM Stopped (Lifecycle Event)
May 28 10:19:54.334694 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-4175bcc8-d350-48ee-be0d-01975204c9bb tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: c2eccafd-0a91-4c01-aa90-d3b031af3aa2] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:19:54.345397 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:54.544314 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f7ee1142-122b-4222-97aa-7c74e1266673 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.960s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:19:58.119415 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b4f966b8-be1f-4bad-912c-edb23180275c tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:19:58.119822 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b4f966b8-be1f-4bad-912c-edb23180275c tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:19:58.119822 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b4f966b8-be1f-4bad-912c-edb23180275c tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:19:58.119822 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b4f966b8-be1f-4bad-912c-edb23180275c tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:19:58.119822 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b4f966b8-be1f-4bad-912c-edb23180275c tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:19:58.121584 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-b4f966b8-be1f-4bad-912c-edb23180275c tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Terminating instance
May 28 10:19:58.623813 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-b4f966b8-be1f-4bad-912c-edb23180275c tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:19:58.638876 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:58.639914 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:58.653678 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:58.654345 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:58.671629 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:58.758653 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cd6471c9-f42b-4704-8abb-0b084310dc22 req-b5ebf45e-e25b-4d8d-ab8b-49e3ecf15748 service nova] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Received event network-vif-unplugged-f9ff28e0-ba0e-42c9-9b36-7d9719abe94e {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:19:58.758883 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cd6471c9-f42b-4704-8abb-0b084310dc22 req-b5ebf45e-e25b-4d8d-ab8b-49e3ecf15748 service nova] Acquiring lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:19:58.759401 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cd6471c9-f42b-4704-8abb-0b084310dc22 req-b5ebf45e-e25b-4d8d-ab8b-49e3ecf15748 service nova] Lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:19:58.759549 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cd6471c9-f42b-4704-8abb-0b084310dc22 req-b5ebf45e-e25b-4d8d-ab8b-49e3ecf15748 service nova] Lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:19:58.759813 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cd6471c9-f42b-4704-8abb-0b084310dc22 req-b5ebf45e-e25b-4d8d-ab8b-49e3ecf15748 service nova] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] No waiting events found dispatching network-vif-unplugged-f9ff28e0-ba0e-42c9-9b36-7d9719abe94e {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:19:58.759973 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cd6471c9-f42b-4704-8abb-0b084310dc22 req-b5ebf45e-e25b-4d8d-ab8b-49e3ecf15748 service nova] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Received event network-vif-unplugged-f9ff28e0-ba0e-42c9-9b36-7d9719abe94e for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:19:58.791764 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:19:58.791917 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98321) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
May 28 10:19:58.908078 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:58.913775 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:58.935123 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999732452999979 future=<Future at 0x73c1f4091970 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:19:58.935434 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999404471999696 future=<Future at 0x73c1f4091970 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:19:58.935546 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999283276999904 future=<Future at 0x73c1f4091970 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:19:58.936628 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Instance destroyed successfully.
May 28 10:19:58.936911 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-b4f966b8-be1f-4bad-912c-edb23180275c tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lazy-loading 'resources' on Instance uuid 5d8c2bb9-680c-4a83-876f-3be446a4c0f8 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:19:59.293854 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 7.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:19:59.346643 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:59.439052 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-b4f966b8-be1f-4bad-912c-edb23180275c tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:17:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1379017230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumemultiattachtests-server-1379017230',id=80,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwYjtkPyDRwaN7lG/Ges1nPjaQJSEIkreLgqYiqypDXxmPWGcyfsisy2A7gM0FS3C15tLuAwP3yhgLZ3hrVGouaoGnnTGGlktMEdDHF0SzKTbbZlRZ7yxKDPVse6ZbzNg==',key_name='tempest-keypair-344224413',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:17:40Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9dd45e575a1740e8aa1c09f4f908d747',ramdisk_id='',reservation_id='r-gbylvyai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-1491725275',owner_user_name='tempest-VolumeMultiattachTests-1491725275-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:17:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f68f80c0467244b696935ee039759675',uuid=5d8c2bb9-680c-4a83-876f-3be446a4c0f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9ff28e0-ba0e-42c9-9b36-7d9719abe94e", "address": "fa:16:3e:9d:d1:c1", "network": {"id": "fd85d7ca-665d-4c88-a0fc-f5b183b538d1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-852450606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dd45e575a1740e8aa1c09f4f908d747", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9ff28e0-ba", "ovs_interfaceid": "f9ff28e0-ba0e-42c9-9b36-7d9719abe94e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:19:59.439346 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-b4f966b8-be1f-4bad-912c-edb23180275c tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Converting VIF {"id": "f9ff28e0-ba0e-42c9-9b36-7d9719abe94e", "address": "fa:16:3e:9d:d1:c1", "network": {"id": "fd85d7ca-665d-4c88-a0fc-f5b183b538d1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-852450606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dd45e575a1740e8aa1c09f4f908d747", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9ff28e0-ba", "ovs_interfaceid": "f9ff28e0-ba0e-42c9-9b36-7d9719abe94e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:19:59.439812 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-b4f966b8-be1f-4bad-912c-edb23180275c tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:d1:c1,bridge_name='br-int',has_traffic_filtering=True,id=f9ff28e0-ba0e-42c9-9b36-7d9719abe94e,network=Network(fd85d7ca-665d-4c88-a0fc-f5b183b538d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9ff28e0-ba') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:19:59.440009 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-b4f966b8-be1f-4bad-912c-edb23180275c tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:d1:c1,bridge_name='br-int',has_traffic_filtering=True,id=f9ff28e0-ba0e-42c9-9b36-7d9719abe94e,network=Network(fd85d7ca-665d-4c88-a0fc-f5b183b538d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9ff28e0-ba') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:19:59.440959 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:59.441177 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9ff28e0-ba, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:19:59.441981 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:59.442912 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:19:59.443531 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:59.443691 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=46fb8b90-525e-41b4-a2bd-d7eca8cb1cd2) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:19:59.444045 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:19:59.444668 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:19:59.446180 np0000001613 nova-compute[98321]: INFO os_vif [None req-b4f966b8-be1f-4bad-912c-edb23180275c tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:d1:c1,bridge_name='br-int',has_traffic_filtering=True,id=f9ff28e0-ba0e-42c9-9b36-7d9719abe94e,network=Network(fd85d7ca-665d-4c88-a0fc-f5b183b538d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9ff28e0-ba')
May 28 10:19:59.446461 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-b4f966b8-be1f-4bad-912c-edb23180275c tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Deleting instance files /opt/stack/data/nova/instances/5d8c2bb9-680c-4a83-876f-3be446a4c0f8_del
May 28 10:19:59.447173 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-b4f966b8-be1f-4bad-912c-edb23180275c tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Deletion of /opt/stack/data/nova/instances/5d8c2bb9-680c-4a83-876f-3be446a4c0f8_del complete
May 28 10:19:59.952929 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-b4f966b8-be1f-4bad-912c-edb23180275c tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Took 1.33 seconds to destroy the instance on the hypervisor.
May 28 10:19:59.953350 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-b4f966b8-be1f-4bad-912c-edb23180275c tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:19:59.953617 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:19:59.953734 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:19:59.953944 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:20:00.041521 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:20:00.257525 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7b404f63-f781-40a3-a6c8-e9d3b9483c16 req-c1cf9f8a-314d-47ae-bec4-5120a792c244 service nova] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Received event network-vif-deleted-f9ff28e0-ba0e-42c9-9b36-7d9719abe94e {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:20:00.258070 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-7b404f63-f781-40a3-a6c8-e9d3b9483c16 req-c1cf9f8a-314d-47ae-bec4-5120a792c244 service nova] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Neutron deleted interface f9ff28e0-ba0e-42c9-9b36-7d9719abe94e; detaching it from the instance and deleting it from the info cache
May 28 10:20:00.259887 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-7b404f63-f781-40a3-a6c8-e9d3b9483c16 req-c1cf9f8a-314d-47ae-bec4-5120a792c244 service nova] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Detach interface failed, port_id=f9ff28e0-ba0e-42c9-9b36-7d9719abe94e, reason: Instance 5d8c2bb9-680c-4a83-876f-3be446a4c0f8 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:20:00.714493 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:20:00.814309 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-edc67884-d797-4065-9e8d-a42f62a99797 req-42262779-b1c3-40c9-b975-b3e99172c3dd service nova] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Received event network-vif-unplugged-f9ff28e0-ba0e-42c9-9b36-7d9719abe94e {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:20:00.814481 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-edc67884-d797-4065-9e8d-a42f62a99797 req-42262779-b1c3-40c9-b975-b3e99172c3dd service nova] Acquiring lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:20:00.815000 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-edc67884-d797-4065-9e8d-a42f62a99797 req-42262779-b1c3-40c9-b975-b3e99172c3dd service nova] Lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:20:00.815315 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-edc67884-d797-4065-9e8d-a42f62a99797 req-42262779-b1c3-40c9-b975-b3e99172c3dd service nova] Lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:20:00.815442 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-edc67884-d797-4065-9e8d-a42f62a99797 req-42262779-b1c3-40c9-b975-b3e99172c3dd service nova] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] No waiting events found dispatching network-vif-unplugged-f9ff28e0-ba0e-42c9-9b36-7d9719abe94e {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:20:00.815546 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-edc67884-d797-4065-9e8d-a42f62a99797 req-42262779-b1c3-40c9-b975-b3e99172c3dd service nova] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Received event network-vif-unplugged-f9ff28e0-ba0e-42c9-9b36-7d9719abe94e for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:20:01.216423 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Took 1.26 seconds to deallocate network for instance.
May 28 10:20:01.722088 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b4f966b8-be1f-4bad-912c-edb23180275c tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:20:01.722517 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b4f966b8-be1f-4bad-912c-edb23180275c tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:20:01.819240 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-b4f966b8-be1f-4bad-912c-edb23180275c tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:20:01.819517 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-b4f966b8-be1f-4bad-912c-edb23180275c tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:20:02.321847 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-b4f966b8-be1f-4bad-912c-edb23180275c tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:20:02.827893 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b4f966b8-be1f-4bad-912c-edb23180275c tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.105s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:20:02.869259 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-b4f966b8-be1f-4bad-912c-edb23180275c tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Deleted allocations for instance 5d8c2bb9-680c-4a83-876f-3be446a4c0f8
May 28 10:20:03.876462 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-b4f966b8-be1f-4bad-912c-edb23180275c tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "5d8c2bb9-680c-4a83-876f-3be446a4c0f8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.757s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:20:04.445327 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:20:06.293709 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:20:06.294019 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:20:06.294294 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.50 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:20:06.763130 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "e02b7452-5f2a-436f-8685-5003d070aab4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:20:06.763606 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "e02b7452-5f2a-436f-8685-5003d070aab4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:20:06.791559 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:20:06.791559 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 10:20:06.791922 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:20:07.265076 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Starting instance... {{(pid=98321) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 10:20:07.791615 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:20:07.809508 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:20:07.809744 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:20:07.812874 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98321) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 10:20:07.812997 np0000001613 nova-compute[98321]: INFO nova.compute.claims [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Claim successful on node np0000001613
May 28 10:20:08.296301 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:20:08.909090 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:20:08.909433 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:20:09.411913 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:20:09.446097 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:20:09.446366 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:20:09.446449 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5000 ms, sending inactivity probe {{(pid=98321) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 10:20:09.446539 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98321) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 10:20:09.455969 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:20:09.456174 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98321) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 10:20:09.917870 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.108s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:20:09.918531 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.622s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:20:09.918816 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Start building networks asynchronously for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 10:20:09.920815 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:20:09.921011 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Auditing locally available compute resources for np0000001613 (node: np0000001613) {{(pid=98321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 10:20:09.933740 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:20:09.934486 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:20:09.989529 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "env LANG=C uptime" returned: 0 in 0.055s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:20:09.989759 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Hypervisor/Node resource view: name=np0000001613 free_ram=14036MB free_disk=72.58610916137695GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 10:20:09.989883 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:20:09.990096 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:20:10.425073 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Allocating IP information in the background. {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 10:20:10.425457 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] allocate_for_instance() {{(pid=98321) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 10:20:10.425889 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:20:10.426228 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:20:10.486858 np0000001613 nova-compute[98321]: DEBUG nova.policy [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f68f80c0467244b696935ee039759675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd45e575a1740e8aa1c09f4f908d747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98321) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 10:20:10.928733 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 10:20:10.933519 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Successfully created port: 1d2e1a39-c279-4d4b-b2d8-83ec19007310 {{(pid=98321) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 10:20:11.041920 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance e02b7452-5f2a-436f-8685-5003d070aab4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:20:11.042114 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 10:20:11.042274 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Final resource view: name=np0000001613 phys_ram=24030MB used_ram=704MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 10:20:09 up 52 min,  2 users,  load average: 1.26, 3.60, 4.52\n', 'num_instances': '1', 'num_vm_building': '1', 'num_task_networking': '1', 'num_os_type_None': '1', 'num_proj_9dd45e575a1740e8aa1c09f4f908d747': '1', 'io_workload': '1'} {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 10:20:11.124402 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:20:11.124624 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:20:11.330006 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Successfully updated port: 1d2e1a39-c279-4d4b-b2d8-83ec19007310 {{(pid=98321) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 10:20:11.372151 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8900ce99-2c5e-4b8c-9b07-e85032907551 req-3a771944-d2e8-460f-af02-0ec912a962b9 service nova] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Received event network-changed-1d2e1a39-c279-4d4b-b2d8-83ec19007310 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:20:11.372583 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-8900ce99-2c5e-4b8c-9b07-e85032907551 req-3a771944-d2e8-460f-af02-0ec912a962b9 service nova] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Refreshing instance network info cache due to event network-changed-1d2e1a39-c279-4d4b-b2d8-83ec19007310. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:20:11.372851 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8900ce99-2c5e-4b8c-9b07-e85032907551 req-3a771944-d2e8-460f-af02-0ec912a962b9 service nova] Acquiring lock "refresh_cache-e02b7452-5f2a-436f-8685-5003d070aab4" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:20:11.372911 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8900ce99-2c5e-4b8c-9b07-e85032907551 req-3a771944-d2e8-460f-af02-0ec912a962b9 service nova] Acquired lock "refresh_cache-e02b7452-5f2a-436f-8685-5003d070aab4" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:20:11.373041 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-8900ce99-2c5e-4b8c-9b07-e85032907551 req-3a771944-d2e8-460f-af02-0ec912a962b9 service nova] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Refreshing network info cache for port 1d2e1a39-c279-4d4b-b2d8-83ec19007310 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:20:11.432384 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Start building block device mappings for instance. {{(pid=98321) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 10:20:11.626949 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:20:11.831772 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "refresh_cache-e02b7452-5f2a-436f-8685-5003d070aab4" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:20:11.874856 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-8900ce99-2c5e-4b8c-9b07-e85032907551 req-3a771944-d2e8-460f-af02-0ec912a962b9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:20:11.927556 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-8900ce99-2c5e-4b8c-9b07-e85032907551 req-3a771944-d2e8-460f-af02-0ec912a962b9 service nova] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:20:12.054114 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-8900ce99-2c5e-4b8c-9b07-e85032907551 req-3a771944-d2e8-460f-af02-0ec912a962b9 service nova] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:20:12.132233 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Compute_service record updated for np0000001613:np0000001613 {{(pid=98321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 10:20:12.132406 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.142s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:20:12.132669 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:20:12.132827 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Cleaning up deleted instances {{(pid=98321) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
May 28 10:20:12.439109 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Start spawning the instance on the hypervisor. {{(pid=98321) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 10:20:12.439896 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Creating instance directory {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 10:20:12.440123 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Creating image(s)
May 28 10:20:12.440552 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "/opt/stack/data/nova/instances/e02b7452-5f2a-436f-8685-5003d070aab4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:20:12.440751 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "/opt/stack/data/nova/instances/e02b7452-5f2a-436f-8685-5003d070aab4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:20:12.441145 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "/opt/stack/data/nova/instances/e02b7452-5f2a-436f-8685-5003d070aab4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:20:12.441648 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:20:12.444007 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:20:12.445080 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:20:12.529222 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.084s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:20:12.529652 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:20:12.530095 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:20:12.531849 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:20:12.534247 np0000001613 nova-compute[98321]: DEBUG oslo_utils.imageutils.format_inspector [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98321) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 10:20:12.534523 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:20:12.557694 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-8900ce99-2c5e-4b8c-9b07-e85032907551 req-3a771944-d2e8-460f-af02-0ec912a962b9 service nova] Releasing lock "refresh_cache-e02b7452-5f2a-436f-8685-5003d070aab4" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:20:12.558610 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquired lock "refresh_cache-e02b7452-5f2a-436f-8685-5003d070aab4" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:20:12.558890 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Building network info cache for instance {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 10:20:12.622717 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.088s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:20:12.623062 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/e02b7452-5f2a-436f-8685-5003d070aab4/disk 1073741824 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:20:12.636828 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] There are 0 instances to clean {{(pid=98321) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
May 28 10:20:12.638062 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:20:12.677031 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9,backing_fmt=raw /opt/stack/data/nova/instances/e02b7452-5f2a-436f-8685-5003d070aab4/disk 1073741824" returned: 0 in 0.054s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:20:12.677450 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "8b9cc104db491a0d919ea8223cb8eb3d71014ac9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.147s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:20:12.677747 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:20:12.763869 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b9cc104db491a0d919ea8223cb8eb3d71014ac9 --force-share --output=json" returned: 0 in 0.086s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:20:12.764380 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e02b7452-5f2a-436f-8685-5003d070aab4/disk. size=1073741824 {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 10:20:12.764822 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e02b7452-5f2a-436f-8685-5003d070aab4/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:20:12.853364 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e02b7452-5f2a-436f-8685-5003d070aab4/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:20:12.853739 np0000001613 nova-compute[98321]: DEBUG nova.virt.disk.api [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Cannot resize image /opt/stack/data/nova/instances/e02b7452-5f2a-436f-8685-5003d070aab4/disk to a smaller size. {{(pid=98321) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 10:20:12.854078 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Created local disks {{(pid=98321) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 10:20:12.854249 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Ensure instance console log exists: /opt/stack/data/nova/instances/e02b7452-5f2a-436f-8685-5003d070aab4/console.log {{(pid=98321) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 10:20:12.854513 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:20:12.854733 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:20:12.854858 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:20:13.115593 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Instance cache missing network info. {{(pid=98321) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 10:20:13.140868 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:20:13.238094 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:20:13.343060 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Updating instance_info_cache with network_info: [{"id": "1d2e1a39-c279-4d4b-b2d8-83ec19007310", "address": "fa:16:3e:84:c1:94", "network": {"id": "fd85d7ca-665d-4c88-a0fc-f5b183b538d1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-852450606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dd45e575a1740e8aa1c09f4f908d747", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d2e1a39-c2", "ovs_interfaceid": "1d2e1a39-c279-4d4b-b2d8-83ec19007310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:20:13.845217 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Releasing lock "refresh_cache-e02b7452-5f2a-436f-8685-5003d070aab4" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:20:13.845449 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Instance network_info: |[{"id": "1d2e1a39-c279-4d4b-b2d8-83ec19007310", "address": "fa:16:3e:84:c1:94", "network": {"id": "fd85d7ca-665d-4c88-a0fc-f5b183b538d1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-852450606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dd45e575a1740e8aa1c09f4f908d747", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d2e1a39-c2", "ovs_interfaceid": "1d2e1a39-c279-4d4b-b2d8-83ec19007310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98321) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 10:20:13.847131 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Start _get_guest_xml network_info=[{"id": "1d2e1a39-c279-4d4b-b2d8-83ec19007310", "address": "fa:16:3e:84:c1:94", "network": {"id": "fd85d7ca-665d-4c88-a0fc-f5b183b538d1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-852450606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dd45e575a1740e8aa1c09f4f908d747", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d2e1a39-c2", "ovs_interfaceid": "1d2e1a39-c279-4d4b-b2d8-83ec19007310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'image_id': 'a913bae7-5d99-49fe-9222-68cf52a5f9bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 10:20:13.851534 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:20:13.852806 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-257338520', uuid='e02b7452-5f2a-436f-8685-5003d070aab4'), owner=OwnerMeta(userid='f68f80c0467244b696935ee039759675', username='tempest-VolumeMultiattachTests-1491725275-project-member', projectid='9dd45e575a1740e8aa1c09f4f908d747', projectname='tempest-VolumeMultiattachTests-1491725275'), image=ImageMeta(id='a913bae7-5d99-49fe-9222-68cf52a5f9bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1d2e1a39-c279-4d4b-b2d8-83ec19007310", "address": "fa:16:3e:84:c1:94", "network": {"id": "fd85d7ca-665d-4c88-a0fc-f5b183b538d1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-852450606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dd45e575a1740e8aa1c09f4f908d747", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d2e1a39-c2", "ovs_interfaceid": "1d2e1a39-c279-4d4b-b2d8-83ec19007310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779963613.8524532) {{(pid=98321) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 10:20:13.853871 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V1... {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 10:20:13.854205 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] CPU controller missing on host. {{(pid=98321) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 10:20:13.855149 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Searching host: 'np0000001613' for CPU controller through CGroups V2... {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 10:20:13.855300 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.host [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] CPU controller found on host. {{(pid=98321) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 10:20:13.856135 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98321) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 10:20:13.856437 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T09:55:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T09:55:08Z,direct_url=<?>,disk_format='qcow2',id=a913bae7-5d99-49fe-9222-68cf52a5f9bb,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c0ee907e07b942d09d375f1b1647d9b3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T09:55:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 10:20:13.856566 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Flavor limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 10:20:13.856676 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Image limits 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 10:20:13.856794 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Flavor pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 10:20:13.856891 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Image pref 0:0:0 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 10:20:13.856978 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 10:20:13.857121 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 10:20:13.857232 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 10:20:13.857333 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Got 1 possible topologies {{(pid=98321) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 10:20:13.857425 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 10:20:13.857532 np0000001613 nova-compute[98321]: DEBUG nova.virt.hardware [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98321) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 10:20:13.867614 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:20:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-257338520',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumemultiattachtests-server-257338520',id=82,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAH6BSLjqU2Yhd457TbMlI7aeoSjD2DIHIMQmNNls5XiUOiT//XsWFWJMO313RYSp6aCGJIGO2l42VXiQT7wYAc8DUhQ/44AuVqi+3UZSrOPxWvb31BBt4qOkR6aMDB1Q==',key_name='tempest-keypair-751618786',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dd45e575a1740e8aa1c09f4f908d747',ramdisk_id='',reservation_id='r-93j90cu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1491725275',owner_user_name='tempest-VolumeMultiattachTests-1491725275-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:20:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f68f80c0467244b696935ee039759675',uuid=e02b7452-5f2a-436f-8685-5003d070aab4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d2e1a39-c279-4d4b-b2d8-83ec19007310", "address": "fa:16:3e:84:c1:94", "network": {"id": "fd85d7ca-665d-4c88-a0fc-f5b183b538d1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-852450606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dd45e575a1740e8aa1c09f4f908d747", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d2e1a39-c2", "ovs_interfaceid": "1d2e1a39-c279-4d4b-b2d8-83ec19007310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98321) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 10:20:13.867783 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Converting VIF {"id": "1d2e1a39-c279-4d4b-b2d8-83ec19007310", "address": "fa:16:3e:84:c1:94", "network": {"id": "fd85d7ca-665d-4c88-a0fc-f5b183b538d1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-852450606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dd45e575a1740e8aa1c09f4f908d747", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d2e1a39-c2", "ovs_interfaceid": "1d2e1a39-c279-4d4b-b2d8-83ec19007310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:20:13.868372 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:c1:94,bridge_name='br-int',has_traffic_filtering=True,id=1d2e1a39-c279-4d4b-b2d8-83ec19007310,network=Network(fd85d7ca-665d-4c88-a0fc-f5b183b538d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d2e1a39-c2') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:20:13.868886 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lazy-loading 'pci_devices' on Instance uuid e02b7452-5f2a-436f-8685-5003d070aab4 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:20:13.935275 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.00041626400025052135 future=<Future at 0x73c1f4091970 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:20:13.935766 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Emitting event <LifecycleEvent: 1779963598.9347544, 5d8c2bb9-680c-4a83-876f-3be446a4c0f8 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:20:13.935893 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:20:13.936016 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] VM Stopped (Lifecycle Event)
May 28 10:20:14.136868 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:20:14.137321 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:20:14.137321 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:20:14.137503 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:20:14.137789 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 51.65 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:20:14.371451 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] End _get_guest_xml xml=<domain type="qemu">
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:   <uuid>e02b7452-5f2a-436f-8685-5003d070aab4</uuid>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:   <name>instance-00000052</name>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:   <memory>196608</memory>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:   <vcpu>1</vcpu>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:   <metadata>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:       <nova:package version="33.1.0"/>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:       <nova:name>tempest-VolumeMultiattachTests-server-257338520</nova:name>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:       <nova:creationTime>2026-05-28 10:20:13</nova:creationTime>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:       <nova:flavor name="m1.nano" id="42">
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:         <nova:memory>192</nova:memory>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:         <nova:disk>1</nova:disk>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:         <nova:swap>0</nova:swap>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:         <nova:ephemeral>0</nova:ephemeral>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:         <nova:vcpus>1</nova:vcpus>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:         <nova:extraSpecs>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:         </nova:extraSpecs>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:       </nova:flavor>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:       <nova:image uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb">
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:         <nova:minDisk>1</nova:minDisk>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:         <nova:minRam>0</nova:minRam>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:         <nova:properties>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:         </nova:properties>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:       </nova:image>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:       <nova:owner>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:         <nova:user uuid="f68f80c0467244b696935ee039759675">tempest-VolumeMultiattachTests-1491725275-project-member</nova:user>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:         <nova:project uuid="9dd45e575a1740e8aa1c09f4f908d747">tempest-VolumeMultiattachTests-1491725275</nova:project>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:       </nova:owner>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:       <nova:root type="image" uuid="a913bae7-5d99-49fe-9222-68cf52a5f9bb"/>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:       <nova:ports>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:         <nova:port uuid="1d2e1a39-c279-4d4b-b2d8-83ec19007310">
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:         </nova:port>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:       </nova:ports>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:     </nova:instance>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:   </metadata>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:   <sysinfo type="smbios">
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:     <system>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:       <entry name="product">OpenStack Nova</entry>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:       <entry name="version">33.1.0</entry>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:       <entry name="serial">e02b7452-5f2a-436f-8685-5003d070aab4</entry>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:       <entry name="uuid">e02b7452-5f2a-436f-8685-5003d070aab4</entry>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:       <entry name="family">Virtual Machine</entry>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:     </system>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:   </sysinfo>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:   <os>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:     <boot dev="hd"/>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:     <smbios mode="sysinfo"/>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:   </os>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:   <features>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:     <acpi/>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:     <tcg>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:       <tb-cache unit="MiB">128</tb-cache>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:     </tcg>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:     <vmcoreinfo/>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:   </features>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:   <iothreads>1</iothreads>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:   <clock offset="utc"/>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:   <cpu mode="custom" match="exact">
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:     <model>Nehalem</model>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:     <topology sockets="1" cores="1" threads="1"/>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:   </cpu>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:   <devices>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:     <disk type="file" device="disk">
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/e02b7452-5f2a-436f-8685-5003d070aab4/disk"/>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:       <target dev="vda" bus="virtio"/>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:     </disk>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:     <disk type="file" device="cdrom">
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:       <driver name="qemu" type="raw" cache="none"/>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:       <source file="/opt/stack/data/nova/instances/e02b7452-5f2a-436f-8685-5003d070aab4/disk.config"/>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:       <target dev="hda" bus="ide"/>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:     </disk>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:     <interface type="ethernet">
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:       <mac address="fa:16:3e:84:c1:94"/>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:       <driver name="qemu"/>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:       <mtu size="1372"/>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:       <target dev="tap1d2e1a39-c2"/>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:     </interface>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:     <serial type="pty">
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:       <log file="/opt/stack/data/nova/instances/e02b7452-5f2a-436f-8685-5003d070aab4/console.log" append="off"/>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:     </serial>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:     <video>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:       <model type="virtio"/>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:     </video>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:     <rng model="virtio">
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:       <backend model="random">/dev/urandom</backend>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:     </rng>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:     <controller type="usb" index="0" model="none"/>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:       <stats period="10"/>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:     </memballoon>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:   </devices>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]: </domain>
May 28 10:20:14.371451 np0000001613 nova-compute[98321]:  {{(pid=98321) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 10:20:14.373453 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Preparing to wait for external event network-vif-plugged-1d2e1a39-c279-4d4b-b2d8-83ec19007310 {{(pid=98321) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 10:20:14.373453 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "e02b7452-5f2a-436f-8685-5003d070aab4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:20:14.373453 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "e02b7452-5f2a-436f-8685-5003d070aab4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:20:14.373453 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "e02b7452-5f2a-436f-8685-5003d070aab4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:20:14.373453 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T10:20:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-257338520',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumemultiattachtests-server-257338520',id=82,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAH6BSLjqU2Yhd457TbMlI7aeoSjD2DIHIMQmNNls5XiUOiT//XsWFWJMO313RYSp6aCGJIGO2l42VXiQT7wYAc8DUhQ/44AuVqi+3UZSrOPxWvb31BBt4qOkR6aMDB1Q==',key_name='tempest-keypair-751618786',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dd45e575a1740e8aa1c09f4f908d747',ramdisk_id='',reservation_id='r-93j90cu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1491725275',owner_user_name='tempest-VolumeMultiattachTests-1491725275-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T10:20:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f68f80c0467244b696935ee039759675',uuid=e02b7452-5f2a-436f-8685-5003d070aab4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d2e1a39-c279-4d4b-b2d8-83ec19007310", "address": "fa:16:3e:84:c1:94", "network": {"id": "fd85d7ca-665d-4c88-a0fc-f5b183b538d1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-852450606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dd45e575a1740e8aa1c09f4f908d747", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d2e1a39-c2", "ovs_interfaceid": "1d2e1a39-c279-4d4b-b2d8-83ec19007310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 10:20:14.373453 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Converting VIF {"id": "1d2e1a39-c279-4d4b-b2d8-83ec19007310", "address": "fa:16:3e:84:c1:94", "network": {"id": "fd85d7ca-665d-4c88-a0fc-f5b183b538d1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-852450606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dd45e575a1740e8aa1c09f4f908d747", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d2e1a39-c2", "ovs_interfaceid": "1d2e1a39-c279-4d4b-b2d8-83ec19007310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:20:14.373453 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:c1:94,bridge_name='br-int',has_traffic_filtering=True,id=1d2e1a39-c279-4d4b-b2d8-83ec19007310,network=Network(fd85d7ca-665d-4c88-a0fc-f5b183b538d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d2e1a39-c2') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:20:14.373749 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:c1:94,bridge_name='br-int',has_traffic_filtering=True,id=1d2e1a39-c279-4d4b-b2d8-83ec19007310,network=Network(fd85d7ca-665d-4c88-a0fc-f5b183b538d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d2e1a39-c2') {{(pid=98321) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 10:20:14.373998 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:20:14.374310 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:20:14.374603 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 10:20:14.375079 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:20:14.375246 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1f6cb33a-4440-576f-a6b4-d1dedddaf269', '_type': 'linux-noop'}}, row=False) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:20:14.376081 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:20:14.376748 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:20:14.377000 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:20:14.378885 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:20:14.379062 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d2e1a39-c2, may_exist=True, interface_attrs={}) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:20:14.379380 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1d2e1a39-c2, col_values=(('qos', UUID('eef62f37-b239-43de-a1bc-2d65d18def6b')),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:20:14.379553 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1d2e1a39-c2, col_values=(('external_ids', {'iface-id': '1d2e1a39-c279-4d4b-b2d8-83ec19007310', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:c1:94', 'vm-uuid': 'e02b7452-5f2a-436f-8685-5003d070aab4'}),), if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:20:14.380339 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:20:14.381332 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:20:14.386612 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:20:14.387484 np0000001613 nova-compute[98321]: INFO os_vif [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:c1:94,bridge_name='br-int',has_traffic_filtering=True,id=1d2e1a39-c279-4d4b-b2d8-83ec19007310,network=Network(fd85d7ca-665d-4c88-a0fc-f5b183b538d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d2e1a39-c2')
May 28 10:20:14.438388 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-87bfd712-e670-4f03-b894-d45aa900f4db tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: 5d8c2bb9-680c-4a83-876f-3be446a4c0f8] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:20:15.904063 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:20:15.904486 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:20:15.904486 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] No VIF found with MAC fa:16:3e:84:c1:94, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:20:15.904747 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Using config drive
May 28 10:20:16.409736 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:20:16.516911 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Creating config drive at /opt/stack/data/nova/instances/e02b7452-5f2a-436f-8685-5003d070aab4/disk.config
May 28 10:20:16.520471 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e02b7452-5f2a-436f-8685-5003d070aab4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf7ugxy10 {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:20:16.574256 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e02b7452-5f2a-436f-8685-5003d070aab4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf7ugxy10" returned: 0 in 0.053s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:20:16.933155 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:20:16.948540 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:20:16.951149 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:20:17.040033 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:20:17.045963 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:20:17.071266 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5f16faa4-0c2c-4421-aba8-e550b9dd684a req-2cd53f69-bdd0-4e2e-96e3-a3c7c02ea6dd service nova] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Received event network-vif-plugged-1d2e1a39-c279-4d4b-b2d8-83ec19007310 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:20:17.071846 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5f16faa4-0c2c-4421-aba8-e550b9dd684a req-2cd53f69-bdd0-4e2e-96e3-a3c7c02ea6dd service nova] Acquiring lock "e02b7452-5f2a-436f-8685-5003d070aab4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:20:17.071990 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5f16faa4-0c2c-4421-aba8-e550b9dd684a req-2cd53f69-bdd0-4e2e-96e3-a3c7c02ea6dd service nova] Lock "e02b7452-5f2a-436f-8685-5003d070aab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:20:17.072152 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-5f16faa4-0c2c-4421-aba8-e550b9dd684a req-2cd53f69-bdd0-4e2e-96e3-a3c7c02ea6dd service nova] Lock "e02b7452-5f2a-436f-8685-5003d070aab4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:20:17.072323 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-5f16faa4-0c2c-4421-aba8-e550b9dd684a req-2cd53f69-bdd0-4e2e-96e3-a3c7c02ea6dd service nova] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Processing event network-vif-plugged-1d2e1a39-c279-4d4b-b2d8-83ec19007310 {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 10:20:17.242516 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:20:17.244223 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:20:17.246184 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:20:17.257923 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:20:17.585603 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963617.585261, e02b7452-5f2a-436f-8685-5003d070aab4 => Started> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:20:17.585976 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98321) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 10:20:17.586111 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] VM Started (Lifecycle Event)
May 28 10:20:17.589226 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Guest created on hypervisor {{(pid=98321) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 10:20:17.591873 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Instance spawned successfully.
May 28 10:20:17.592329 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 10:20:18.088665 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:20:18.090732 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:20:18.099419 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Found default for hw_cdrom_bus of ide {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:20:18.099565 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Found default for hw_disk_bus of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:20:18.099928 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Found default for hw_input_bus of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:20:18.100232 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Found default for hw_pointer_model of None {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:20:18.100702 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Found default for hw_video_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:20:18.101056 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Found default for hw_vif_model of virtio {{(pid=98321) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 10:20:18.592719 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 10:20:18.592915 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963618.592716, e02b7452-5f2a-436f-8685-5003d070aab4 => Paused> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:20:18.593057 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] VM Paused (Lifecycle Event)
May 28 10:20:18.605437 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Took 6.17 seconds to spawn the instance on the hypervisor.
May 28 10:20:18.605597 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:20:19.095121 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:20:19.097345 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Emitting event <LifecycleEvent: 1779963619.097108, e02b7452-5f2a-436f-8685-5003d070aab4 => Resumed> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:20:19.097408 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] VM Resumed (Lifecycle Event)
May 28 10:20:19.115376 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Took 11.35 seconds to build instance.
May 28 10:20:19.127889 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f30f2259-ef71-4da8-a575-12a9ae73be00 req-d7d17205-adc7-4233-8343-5747eff3dda0 service nova] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Received event network-vif-plugged-1d2e1a39-c279-4d4b-b2d8-83ec19007310 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:20:19.131344 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f30f2259-ef71-4da8-a575-12a9ae73be00 req-d7d17205-adc7-4233-8343-5747eff3dda0 service nova] Acquiring lock "e02b7452-5f2a-436f-8685-5003d070aab4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:20:19.131537 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f30f2259-ef71-4da8-a575-12a9ae73be00 req-d7d17205-adc7-4233-8343-5747eff3dda0 service nova] Lock "e02b7452-5f2a-436f-8685-5003d070aab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:20:19.131672 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-f30f2259-ef71-4da8-a575-12a9ae73be00 req-d7d17205-adc7-4233-8343-5747eff3dda0 service nova] Lock "e02b7452-5f2a-436f-8685-5003d070aab4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:20:19.131797 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-f30f2259-ef71-4da8-a575-12a9ae73be00 req-d7d17205-adc7-4233-8343-5747eff3dda0 service nova] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] No waiting events found dispatching network-vif-plugged-1d2e1a39-c279-4d4b-b2d8-83ec19007310 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:20:19.131934 np0000001613 nova-compute[98321]: WARNING nova.compute.manager [req-f30f2259-ef71-4da8-a575-12a9ae73be00 req-d7d17205-adc7-4233-8343-5747eff3dda0 service nova] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Received unexpected event network-vif-plugged-1d2e1a39-c279-4d4b-b2d8-83ec19007310 for instance with vm_state active and task_state None.
May 28 10:20:19.390309 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:20:19.509457 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6165a429-3a25-4f08-84c3-1d2a88a23cc5 req-c6d407cc-4446-422e-8063-fb29a931f0f6 service nova] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Received event network-changed-1d2e1a39-c279-4d4b-b2d8-83ec19007310 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:20:19.509812 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-6165a429-3a25-4f08-84c3-1d2a88a23cc5 req-c6d407cc-4446-422e-8063-fb29a931f0f6 service nova] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Refreshing instance network info cache due to event network-changed-1d2e1a39-c279-4d4b-b2d8-83ec19007310. {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 10:20:19.509978 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6165a429-3a25-4f08-84c3-1d2a88a23cc5 req-c6d407cc-4446-422e-8063-fb29a931f0f6 service nova] Acquiring lock "refresh_cache-e02b7452-5f2a-436f-8685-5003d070aab4" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 10:20:19.510059 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6165a429-3a25-4f08-84c3-1d2a88a23cc5 req-c6d407cc-4446-422e-8063-fb29a931f0f6 service nova] Acquired lock "refresh_cache-e02b7452-5f2a-436f-8685-5003d070aab4" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 10:20:19.510205 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-6165a429-3a25-4f08-84c3-1d2a88a23cc5 req-c6d407cc-4446-422e-8063-fb29a931f0f6 service nova] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Refreshing network info cache for port 1d2e1a39-c279-4d4b-b2d8-83ec19007310 {{(pid=98321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 10:20:19.599636 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:20:19.601727 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98321) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 10:20:19.617619 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-75a394c9-a184-4bdd-850c-f57d495d32f9 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "e02b7452-5f2a-436f-8685-5003d070aab4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.854s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:20:20.012056 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-6165a429-3a25-4f08-84c3-1d2a88a23cc5 req-c6d407cc-4446-422e-8063-fb29a931f0f6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:20:20.283342 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:20:20.302385 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [req-6165a429-3a25-4f08-84c3-1d2a88a23cc5 req-c6d407cc-4446-422e-8063-fb29a931f0f6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:20:20.429216 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-6165a429-3a25-4f08-84c3-1d2a88a23cc5 req-c6d407cc-4446-422e-8063-fb29a931f0f6 service nova] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Updated VIF entry in instance network info cache for port 1d2e1a39-c279-4d4b-b2d8-83ec19007310. {{(pid=98321) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 10:20:20.429511 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [req-6165a429-3a25-4f08-84c3-1d2a88a23cc5 req-c6d407cc-4446-422e-8063-fb29a931f0f6 service nova] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Updating instance_info_cache with network_info: [{"id": "1d2e1a39-c279-4d4b-b2d8-83ec19007310", "address": "fa:16:3e:84:c1:94", "network": {"id": "fd85d7ca-665d-4c88-a0fc-f5b183b538d1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-852450606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dd45e575a1740e8aa1c09f4f908d747", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d2e1a39-c2", "ovs_interfaceid": "1d2e1a39-c279-4d4b-b2d8-83ec19007310", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:20:20.933468 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-6165a429-3a25-4f08-84c3-1d2a88a23cc5 req-c6d407cc-4446-422e-8063-fb29a931f0f6 service nova] Releasing lock "refresh_cache-e02b7452-5f2a-436f-8685-5003d070aab4" {{(pid=98321) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 10:20:24.393429 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:20:25.283735 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:20:29.395984 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:20:30.284645 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:20:34.398944 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:20:35.286229 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:20:39.402701 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:20:40.287116 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:20:44.405525 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:20:45.288556 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:20:49.407921 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:20:50.290469 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:20:54.412006 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:20:55.292390 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:20:56.867310 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "e02b7452-5f2a-436f-8685-5003d070aab4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:20:56.867685 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "e02b7452-5f2a-436f-8685-5003d070aab4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:20:57.370577 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lazy-loading 'flavor' on Instance uuid e02b7452-5f2a-436f-8685-5003d070aab4 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:20:58.375221 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "e02b7452-5f2a-436f-8685-5003d070aab4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.507s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:20:59.414785 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:20:59.434188 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "e02b7452-5f2a-436f-8685-5003d070aab4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:20:59.434354 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "e02b7452-5f2a-436f-8685-5003d070aab4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:20:59.434506 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Attaching volume 39126af2-55fa-4133-8567-a1cf5bf2235a to /dev/vdb
May 28 10:20:59.467948 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.111', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001613', 'execute': None}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:20:59.478178 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.scaleio [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98321) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 10:20:59.497183 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Running cmd (subprocess): nvme version {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:20:59.541873 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] 'nvme version' failed. Not Retrying. {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 10:20:59.542086 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] nvme not present on system {{(pid=98321) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 10:20:59.549624 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98321) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 10:20:59.550572 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.lightos [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Current host hostNQN  and IP(s) are ['10.4.3.111', 'fe80::f816:3eff:fe72:4efd', '192.168.40.6', 'fe80::f816:3eff:fe88:c7c2', '192.168.50.6', 'fe80::f816:3eff:fec4:61ea', '192.168.10.6', 'fe80::f816:3eff:fe05:f412', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9895:a0ff:fe6f:2641', 'fe80::fc16:3eff:fe84:c194', 'fe80::b01d:8aff:fede:b711'] 
May 28 10:20:59.550676 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 10:20:59.550814 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.lightos [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] LIGHTOS: no hostnqn found. {{(pid=98321) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 10:20:59.551065 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] <== get_connector_properties: return (83ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.111', 'host': 'np0000001613', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:75ad9278aff9', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '4f389ae4-5440-4643-b4e5-95bdfbec49be', 'nvme_native_multipath': False} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:20:59.551338 np0000001613 nova-compute[98321]: DEBUG nova.virt.block_device [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Updating existing volume attachment record: 31382749-8d18-4140-bc9a-3319491a091e {{(pid=98321) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 10:21:00.097752 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Calling os-brick to attach iSCSI Volume {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 10:21:00.098092 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a', 'iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '39126af2-55fa-4133-8567-a1cf5bf2235a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:21:00.098250 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:21:00.098898 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:21:00.099076 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a', 'iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '39126af2-55fa-4133-8567-a1cf5bf2235a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 10:21:00.110814 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:21:00.111508 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:21:00.111923 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:21:00.112099 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:21:00.112456 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:21:00.112697 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:21:00.122465 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:21:00.122465 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:21:00.127112 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 10:21:00.127112 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:21:00.133507 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a] added
May 28 10:21:00.133507 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:21:00.133507 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:21:00.133507 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:21:00.133507 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:21:00.133507 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:21:00.133507 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:21:00.133721 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:21:00.133848 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0217(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:21:00.133987 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:21:00.138015 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a] added
May 28 10:21:00.138015 np0000001613 nova-compute[98321]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 10:21:00.138015 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:21:00.138015 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:21:00.138015 np0000001613 nova-compute[98321]: iscsiadm: Config file line 363 does not have value
May 28 10:21:00.138015 np0000001613 nova-compute[98321]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 10:21:00.138015 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:21:00.138174 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98321) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 10:21:00.138266 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0256(s), this was the 1st time calling it. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 10:21:00.138383 np0000001613 nova-compute[98321]: DEBUG os_brick.utils [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98321) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 10:21:00.293416 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:21:01.134426 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 10:21:01.138685 np0000001613 nova-compute[98321]: INFO os_brick.initiator.connectors.iscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.40.100
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:21:01.145622 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:21:01.145622 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.name = iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.tpgt = -1
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.startup = manual
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.leading_login = No
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.iscsi_ifacename = default
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.net_ifacename = <empty>
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.ipaddress = <empty>
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.prefix_len = 0
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.hwaddress = <empty>
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.transport_name = tcp
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.initiatorname = <empty>
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.state = <empty>
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.vlan_id = 0
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.vlan_priority = 0
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.vlan_state = <empty>
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.iface_num = 0
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.mtu = 0
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.port = 0
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.bootproto = <empty>
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.subnet_mask = <empty>
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.gateway = <empty>
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id_state = <empty>
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.dhcp_alt_client_id = <empty>
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.dhcp_dns = <empty>
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.dhcp_learn_iqn = <empty>
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.dhcp_req_vendor_id_state = <empty>
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id_state = <empty>
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.dhcp_vendor_id = <empty>
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.dhcp_slp_da = <empty>
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.fragmentation = <empty>
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.gratuitous_arp = <empty>
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.incoming_forwarding = <empty>
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.tos_state = <empty>
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.tos = 0
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.ttl = 0
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.delayed_ack = <empty>
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.tcp_nagle = <empty>
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.tcp_wsf_state = <empty>
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.tcp_wsf = 0
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.tcp_timer_scale = 0
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.tcp_timestamp = <empty>
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.redirect = <empty>
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.def_task_mgmt_timeout = 0
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.header_digest = <empty>
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.data_digest = <empty>
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.immediate_data = <empty>
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.initial_r2t = <empty>
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.data_seq_inorder = <empty>
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.data_pdu_inorder = <empty>
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.erl = 0
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.max_receive_data_len = 0
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.first_burst_len = 0
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.max_outstanding_r2t = 0
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.max_burst_len = 0
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.chap_auth = <empty>
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.bidi_chap = <empty>
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.strict_login_compliance = <empty>
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.discovery_auth = <empty>
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: iface.discovery_logout = <empty>
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.discovery_address = <empty>
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.discovery_port = 0
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.discovery_type = fw
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.session.initial_cmdsn = 0
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.session.initial_login_retry_max = 8
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.session.xmit_thread_priority = 0
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.session.cmds_max = 128
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.session.queue_depth = 32
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.session.nr_sessions = 1
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.session.auth.authmethod = None
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.session.auth.username = <empty>
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.session.auth.password = ***
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.session.auth.username_in = <empty>
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.session.auth.password_in = <empty>
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.session.auth.chap_algs = SHA256
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.session.timeo.replacement_timeout = 120
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.session.err_timeo.abort_timeout = 15
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.session.err_timeo.lu_reset_timeout = 30
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.session.err_timeo.host_reset_timeout = 60
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.session.iscsi.FastAbort = Yes
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.session.iscsi.InitialR2T = No
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.session.iscsi.ImmediateData = Yes
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.session.iscsi.FirstBurstLength = 262144
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.session.iscsi.MaxBurstLength = 16776192
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Retain = 0
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.session.iscsi.DefaultTime2Wait = 2
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.session.iscsi.MaxConnections = 1
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.session.iscsi.ERL = 0
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.session.scan = auto
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.session.reopen_max = 0
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.conn[0].address = 192.168.50.100
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.conn[0].port = 3260
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.conn[0].startup = manual
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.conn[0].tcp.window_size = 524288
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.conn[0].tcp.type_of_service = 0
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.conn[0].timeo.logout_timeout = 15
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.conn[0].timeo.login_timeout = 15
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.conn[0].timeo.auth_timeout = 45
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_interval = 5
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.conn[0].timeo.noop_out_timeout = 5
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.conn[0].iscsi.HeaderDigest = None
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.conn[0].iscsi.DataDigest = None
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.conn[0].iscsi.IFMarker = No
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: node.conn[0].iscsi.OFMarker = No
May 28 10:21:01.151460 np0000001613 nova-compute[98321]: # END RECORD
May 28 10:21:01.151460 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:21:01.157181 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:21:01.163102 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:21:01.169569 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 10:21:01.169569 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:21:01.169732 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 10:21:01.169732 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:21:01.169804 np0000001613 nova-compute[98321]: WARNING os_brick.initiator.connectors.iscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 10:21:01.169804 np0000001613 nova-compute[98321]: 
May 28 10:21:01.175538 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 10:21:01.175538 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:21:01.175721 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 10:21:01.175721 np0000001613 nova-compute[98321]:  {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:21:01.175805 np0000001613 nova-compute[98321]: WARNING os_brick.initiator.connectors.iscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 10:21:01.175805 np0000001613 nova-compute[98321]: 
May 28 10:21:02.197622 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a, portal: 192.168.40.100,3260]
May 28 10:21:02.197622 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a, portal: 192.168.40.100,3260] successful.
May 28 10:21:02.197622 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:21:02.198352 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a, portal: 192.168.50.100,3260]
May 28 10:21:02.198352 np0000001613 nova-compute[98321]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a, portal: 192.168.50.100,3260] successful.
May 28 10:21:02.198352 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:21:02.208703 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:21:02.214085 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:21:02.220773 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [233] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a (non-flash)
May 28 10:21:02.220773 np0000001613 nova-compute[98321]: tcp: [234] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a (non-flash)
May 28 10:21:02.220773 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:21:02.220932 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsi session list stdout=tcp: [233] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a (non-flash)
May 28 10:21:02.220932 np0000001613 nova-compute[98321]: tcp: [234] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a (non-flash)
May 28 10:21:02.220932 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:21:02.221121 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.109s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:21:02.221256 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Connected to 192.168.40.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:21:02.221725 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] HCTL ('7', '-', '-', 0) found on session 233 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:21:02.221828 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:21:02.226232 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [233] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a (non-flash)
May 28 10:21:02.226232 np0000001613 nova-compute[98321]: tcp: [234] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a (non-flash)
May 28 10:21:02.226232 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:21:02.226364 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsi session list stdout=tcp: [233] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a (non-flash)
May 28 10:21:02.226364 np0000001613 nova-compute[98321]: tcp: [234] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a (non-flash)
May 28 10:21:02.226364 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:21:02.226630 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.114s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:21:02.226731 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Connected to 192.168.50.100:3260 {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 10:21:02.227155 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] HCTL ('8', '-', '-', 0) found on session 234 with lun 0 {{(pid=98321) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 10:21:02.227270 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98321) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 10:21:02.237971 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Searching for a device in session 233 and hctl ['7', '*', '*', 0] yield: None {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:21:02.243146 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Searching for a device in session 234 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:21:02.243395 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '39126af2-55fa-4133-8567-a1cf5bf2235a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:21:03.237727 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Searching for a device in session 233 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98321) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 10:21:03.238139 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '39126af2-55fa-4133-8567-a1cf5bf2235a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98321) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 10:21:04.126707 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Found WWN 330000000becec16c for multipath device dm-0 {{(pid=98321) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 10:21:04.126944 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.028s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:21:04.127085 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] <== connect_volume: return (4028ms) {'type': 'block', 'scsi_wwn': '330000000becec16c', 'path': '/dev/dm-0', 'multipath_id': '330000000becec16c'} {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:21:04.127211 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000becec16c', 'path': '/dev/dm-0', 'multipath_id': '330000000becec16c'} {{(pid=98321) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 10:21:04.129952 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lazy-loading 'flavor' on Instance uuid e02b7452-5f2a-436f-8685-5003d070aab4 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:21:04.416440 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:21:04.633211 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Attempting to attach volume 39126af2-55fa-4133-8567-a1cf5bf2235a with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98321) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 10:21:04.634654 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] attach device xml: <disk type="block" device="disk">
May 28 10:21:04.634654 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:21:04.634654 np0000001613 nova-compute[98321]:   <alias name="ua-39126af2-55fa-4133-8567-a1cf5bf2235a"/>
May 28 10:21:04.634654 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-0"/>
May 28 10:21:04.634654 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:21:04.634654 np0000001613 nova-compute[98321]:   <serial>39126af2-55fa-4133-8567-a1cf5bf2235a</serial>
May 28 10:21:04.634654 np0000001613 nova-compute[98321]:   <shareable/>
May 28 10:21:04.634654 np0000001613 nova-compute[98321]: </disk>
May 28 10:21:04.634654 np0000001613 nova-compute[98321]:  {{(pid=98321) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 10:21:05.792252 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:21:05.792622 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:21:06.265591 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] No BDM found with device name vda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:21:06.265748 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:21:06.265864 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] No BDM found with device name hda, not building metadata. {{(pid=98321) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 10:21:06.265966 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] No VIF found with MAC fa:16:3e:84:c1:94, not building metadata {{(pid=98321) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 10:21:07.791678 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:21:07.792128 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:21:07.792281 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 10:21:07.792560 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:21:07.809427 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-57bd5c77-9523-4f40-bb8e-d5b64997f40f tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "e02b7452-5f2a-436f-8685-5003d070aab4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.375s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:21:08.345236 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "e02b7452-5f2a-436f-8685-5003d070aab4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:21:08.345609 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "e02b7452-5f2a-436f-8685-5003d070aab4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:21:08.788509 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:21:08.788837 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:21:08.791381 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:21:08.847706 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Detaching volume 39126af2-55fa-4133-8567-a1cf5bf2235a
May 28 10:21:08.884849 np0000001613 nova-compute[98321]: INFO nova.virt.block_device [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Attempting to driver detach volume 39126af2-55fa-4133-8567-a1cf5bf2235a from mountpoint /dev/vdb
May 28 10:21:08.889906 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Found disk vdb by alias ua-39126af2-55fa-4133-8567-a1cf5bf2235a {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:21:08.891046 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Found disk vdb by alias ua-39126af2-55fa-4133-8567-a1cf5bf2235a {{(pid=98321) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 10:21:08.891158 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Attempting to detach device vdb from instance e02b7452-5f2a-436f-8685-5003d070aab4 from the persistent domain config. {{(pid=98321) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 10:21:08.891373 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:21:08.891373 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:21:08.891373 np0000001613 nova-compute[98321]:   <alias name="ua-39126af2-55fa-4133-8567-a1cf5bf2235a"/>
May 28 10:21:08.891373 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-0"/>
May 28 10:21:08.891373 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:21:08.891373 np0000001613 nova-compute[98321]:   <serial>39126af2-55fa-4133-8567-a1cf5bf2235a</serial>
May 28 10:21:08.891373 np0000001613 nova-compute[98321]:   <shareable/>
May 28 10:21:08.891373 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:21:08.891373 np0000001613 nova-compute[98321]: </disk>
May 28 10:21:08.891373 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:21:08.897381 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Successfully detached device vdb from instance e02b7452-5f2a-436f-8685-5003d070aab4 from the persistent domain config.
May 28 10:21:08.897515 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] (1/8): Attempting to detach device vdb with device alias ua-39126af2-55fa-4133-8567-a1cf5bf2235a from instance e02b7452-5f2a-436f-8685-5003d070aab4 from the live domain config. {{(pid=98321) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 10:21:08.897757 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.guest [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] detach device xml: <disk type="block" device="disk">
May 28 10:21:08.897757 np0000001613 nova-compute[98321]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 10:21:08.897757 np0000001613 nova-compute[98321]:   <alias name="ua-39126af2-55fa-4133-8567-a1cf5bf2235a"/>
May 28 10:21:08.897757 np0000001613 nova-compute[98321]:   <source dev="/dev/dm-0"/>
May 28 10:21:08.897757 np0000001613 nova-compute[98321]:   <target dev="vdb" bus="virtio"/>
May 28 10:21:08.897757 np0000001613 nova-compute[98321]:   <serial>39126af2-55fa-4133-8567-a1cf5bf2235a</serial>
May 28 10:21:08.897757 np0000001613 nova-compute[98321]:   <shareable/>
May 28 10:21:08.897757 np0000001613 nova-compute[98321]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 10:21:08.897757 np0000001613 nova-compute[98321]: </disk>
May 28 10:21:08.897757 np0000001613 nova-compute[98321]:  {{(pid=98321) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 10:21:09.249443 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:21:09.295566 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:21:09.295771 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:21:09.295909 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:21:09.296035 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Auditing locally available compute resources for np0000001613 (node: np0000001613) {{(pid=98321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 10:21:09.347081 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Received event <DeviceRemovedEvent: 1779963669.346746, e02b7452-5f2a-436f-8685-5003d070aab4 => ua-39126af2-55fa-4133-8567-a1cf5bf2235a> from libvirt while the driver is waiting for it; dispatched. {{(pid=98321) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 10:21:09.347895 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-39126af2-55fa-4133-8567-a1cf5bf2235a for instance e02b7452-5f2a-436f-8685-5003d070aab4 {{(pid=98321) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 10:21:09.350147 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Successfully detached device vdb from instance e02b7452-5f2a-436f-8685-5003d070aab4 from the live domain config.
May 28 10:21:09.384777 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] calling os-brick to detach iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 10:21:09.385014 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x73c1fc1ceba0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a', 'iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '39126af2-55fa-4133-8567-a1cf5bf2235a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 10:21:09.385208 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 10:21:09.385519 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 10:21:09.385962 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a', 'iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '39126af2-55fa-4133-8567-a1cf5bf2235a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 10:21:09.386077 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a', 0)] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 10:21:09.407091 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [233] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a (non-flash)
May 28 10:21:09.407091 np0000001613 nova-compute[98321]: tcp: [234] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a (non-flash)
May 28 10:21:09.407091 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 10:21:09.407295 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsi session list stdout=tcp: [233] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a (non-flash)
May 28 10:21:09.407295 np0000001613 nova-compute[98321]: tcp: [234] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a (non-flash)
May 28 10:21:09.407295 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 10:21:09.407295 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a', '233'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a', '234')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 10:21:09.407440 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a', '233')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:21:09.408564 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a', '234')] {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 10:21:09.409142 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x73c1fc37a0c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a'): ({'sdc'}, set())}) {{(pid=98321) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 10:21:09.409322 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Removing multipathed devices sdb, sdc {{(pid=98321) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 10:21:09.409525 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Flush multipath device 330000000becec16c {{(pid=98321) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 10:21:09.419439 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:21:09.440261 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:21:09.482493 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98321) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 10:21:09.524412 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 10:21:09.524556 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98321) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 10:21:09.525093 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 10:21:09.535570 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.linuxscsi [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98321) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 10:21:09.535673 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a')] {{(pid=98321) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 10:21:09.545566 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:21:09.572034 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 233, target: iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a, portal: 192.168.40.100,3260]
May 28 10:21:09.572034 np0000001613 nova-compute[98321]: Logout of [sid: 233, target: iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a, portal: 192.168.40.100,3260] successful.
May 28 10:21:09.572034 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:21:09.586828 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:21:09.597886 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:21:09.630851 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 234, target: iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a, portal: 192.168.50.100,3260]
May 28 10:21:09.630851 np0000001613 nova-compute[98321]: Logout of [sid: 234, target: iqn.2023-03.storpool.com:os--volume-39126af2-55fa-4133-8567-a1cf5bf2235a, portal: 192.168.50.100,3260] successful.
May 28 10:21:09.630851 np0000001613 nova-compute[98321]:  stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:21:09.641227 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98321) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 10:21:09.641496 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.base [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.256s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 10:21:09.641673 np0000001613 nova-compute[98321]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] <== disconnect_volume: return (255ms) None {{(pid=98321) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 10:21:09.641833 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Disconnected iSCSI Volume {{(pid=98321) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 10:21:10.187583 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lazy-loading 'flavor' on Instance uuid e02b7452-5f2a-436f-8685-5003d070aab4 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:21:10.364605 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e02b7452-5f2a-436f-8685-5003d070aab4/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:21:10.452393 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e02b7452-5f2a-436f-8685-5003d070aab4/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:21:10.452845 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e02b7452-5f2a-436f-8685-5003d070aab4/disk --force-share --output=json {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:21:10.544254 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e02b7452-5f2a-436f-8685-5003d070aab4/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:21:10.548350 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:21:10.549297 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:21:10.596208 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "env LANG=C uptime" returned: 0 in 0.047s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:21:10.596563 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Hypervisor/Node resource view: name=np0000001613 free_ram=13680MB free_disk=72.55449676513672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 10:21:10.596725 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:21:10.596976 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:21:11.193396 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-6cc63fb1-018b-44cc-9875-d24ccba266b2 tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "e02b7452-5f2a-436f-8685-5003d070aab4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.848s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:21:11.720100 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Instance e02b7452-5f2a-436f-8685-5003d070aab4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98321) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 10:21:11.720318 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 10:21:11.720454 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Final resource view: name=np0000001613 phys_ram=24030MB used_ram=704MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 10:21:10 up 53 min,  2 users,  load average: 0.83, 3.06, 4.28\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '1', 'num_proj_9dd45e575a1740e8aa1c09f4f908d747': '1', 'io_workload': '0'} {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 10:21:11.759884 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Refreshing inventories for resource provider ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 28 10:21:11.798270 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Updating ProviderTree inventory for provider ad4de091-3626-4008-ac9a-3e83de44a510 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 28 10:21:11.798501 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Updating inventory in ProviderTree for provider ad4de091-3626-4008-ac9a-3e83de44a510 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 28 10:21:11.837170 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Refreshing aggregate associations for resource provider ad4de091-3626-4008-ac9a-3e83de44a510, aggregates: None {{(pid=98321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 28 10:21:11.878175 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Refreshing trait associations for resource provider ad4de091-3626-4008-ac9a-3e83de44a510, traits: COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ARCH_PPC64LE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ARCH_RISCV64,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_ARCH_S390X,COMPUTE_VOLUME_EXTEND,COMPUTE_ARCH_AARCH64,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOUND_MODEL_SB16,COMPUTE_ACCELERATORS,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_SOUND_MODEL_AC97,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_ARCH_MIPSEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_LAN9118,HW_ARCH_X86_64,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ARCH_X86_64,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOUND_MODEL_USB,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=98321) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 28 10:21:11.955915 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:21:11.956110 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:21:12.458450 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:21:12.662445 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f138eca8-db41-46a0-8940-e25f2f9b1d0b tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "e02b7452-5f2a-436f-8685-5003d070aab4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:21:12.662680 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f138eca8-db41-46a0-8940-e25f2f9b1d0b tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "e02b7452-5f2a-436f-8685-5003d070aab4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:21:12.662876 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f138eca8-db41-46a0-8940-e25f2f9b1d0b tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "e02b7452-5f2a-436f-8685-5003d070aab4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:21:12.663014 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f138eca8-db41-46a0-8940-e25f2f9b1d0b tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "e02b7452-5f2a-436f-8685-5003d070aab4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:21:12.663149 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f138eca8-db41-46a0-8940-e25f2f9b1d0b tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "e02b7452-5f2a-436f-8685-5003d070aab4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:21:12.665270 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-f138eca8-db41-46a0-8940-e25f2f9b1d0b tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Terminating instance
May 28 10:21:12.964509 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Compute_service record updated for np0000001613:np0000001613 {{(pid=98321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 10:21:12.964656 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.368s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:21:12.964942 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:21:13.168189 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-f138eca8-db41-46a0-8940-e25f2f9b1d0b tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Start destroying the instance on the hypervisor. {{(pid=98321) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 10:21:13.195626 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:21:13.210327 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:21:13.217869 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:21:13.232787 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:21:13.332385 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cebf84c7-0b3a-48e4-91b2-7caf1b94d308 req-534781f3-f623-4138-b7d9-7924337fb5b6 service nova] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Received event network-vif-unplugged-1d2e1a39-c279-4d4b-b2d8-83ec19007310 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:21:13.332829 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cebf84c7-0b3a-48e4-91b2-7caf1b94d308 req-534781f3-f623-4138-b7d9-7924337fb5b6 service nova] Acquiring lock "e02b7452-5f2a-436f-8685-5003d070aab4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:21:13.333006 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cebf84c7-0b3a-48e4-91b2-7caf1b94d308 req-534781f3-f623-4138-b7d9-7924337fb5b6 service nova] Lock "e02b7452-5f2a-436f-8685-5003d070aab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:21:13.333136 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-cebf84c7-0b3a-48e4-91b2-7caf1b94d308 req-534781f3-f623-4138-b7d9-7924337fb5b6 service nova] Lock "e02b7452-5f2a-436f-8685-5003d070aab4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:21:13.333284 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cebf84c7-0b3a-48e4-91b2-7caf1b94d308 req-534781f3-f623-4138-b7d9-7924337fb5b6 service nova] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] No waiting events found dispatching network-vif-unplugged-1d2e1a39-c279-4d4b-b2d8-83ec19007310 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:21:13.333394 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-cebf84c7-0b3a-48e4-91b2-7caf1b94d308 req-534781f3-f623-4138-b7d9-7924337fb5b6 service nova] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Received event network-vif-unplugged-1d2e1a39-c279-4d4b-b2d8-83ec19007310 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:21:13.398487 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:21:13.459680 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:21:13.465731 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:21:13.487911 np0000001613 nova-compute[98321]: DEBUG nova.utils [None req-a5a1cbf3-1f53-446d-a508-4767e82abe72 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.99971851600003 future=<Future at 0x73c1f470c710 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:21:13.488174 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999419911000132 future=<Future at 0x73c1f470c710 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:21:13.488300 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=14.999275712000326 future=<Future at 0x73c1f470c710 state=pending>) {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:21:13.489678 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [-] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Instance destroyed successfully.
May 28 10:21:13.490022 np0000001613 nova-compute[98321]: DEBUG nova.objects.instance [None req-f138eca8-db41-46a0-8940-e25f2f9b1d0b tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lazy-loading 'resources' on Instance uuid e02b7452-5f2a-436f-8685-5003d070aab4 {{(pid=98321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 10:21:13.965132 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:21:13.965434 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:21:13.965807 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.83 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:21:13.992691 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.vif [None req-f138eca8-db41-46a0-8940-e25f2f9b1d0b tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T10:20:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-257338520',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001613',hostname='tempest-volumemultiattachtests-server-257338520',id=82,image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAH6BSLjqU2Yhd457TbMlI7aeoSjD2DIHIMQmNNls5XiUOiT//XsWFWJMO313RYSp6aCGJIGO2l42VXiQT7wYAc8DUhQ/44AuVqi+3UZSrOPxWvb31BBt4qOkR6aMDB1Q==',key_name='tempest-keypair-751618786',keypairs=<?>,launch_index=0,launched_at=2026-05-28T10:20:18Z,launched_on='np0000001613',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001613',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9dd45e575a1740e8aa1c09f4f908d747',ramdisk_id='',reservation_id='r-93j90cu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a913bae7-5d99-49fe-9222-68cf52a5f9bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-1491725275',owner_user_name='tempest-VolumeMultiattachTests-1491725275-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T10:20:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f68f80c0467244b696935ee039759675',uuid=e02b7452-5f2a-436f-8685-5003d070aab4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d2e1a39-c279-4d4b-b2d8-83ec19007310", "address": "fa:16:3e:84:c1:94", "network": {"id": "fd85d7ca-665d-4c88-a0fc-f5b183b538d1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-852450606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dd45e575a1740e8aa1c09f4f908d747", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d2e1a39-c2", "ovs_interfaceid": "1d2e1a39-c279-4d4b-b2d8-83ec19007310", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 10:21:13.993027 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-f138eca8-db41-46a0-8940-e25f2f9b1d0b tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Converting VIF {"id": "1d2e1a39-c279-4d4b-b2d8-83ec19007310", "address": "fa:16:3e:84:c1:94", "network": {"id": "fd85d7ca-665d-4c88-a0fc-f5b183b538d1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-852450606-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9dd45e575a1740e8aa1c09f4f908d747", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d2e1a39-c2", "ovs_interfaceid": "1d2e1a39-c279-4d4b-b2d8-83ec19007310", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 10:21:13.993880 np0000001613 nova-compute[98321]: DEBUG nova.network.os_vif_util [None req-f138eca8-db41-46a0-8940-e25f2f9b1d0b tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:c1:94,bridge_name='br-int',has_traffic_filtering=True,id=1d2e1a39-c279-4d4b-b2d8-83ec19007310,network=Network(fd85d7ca-665d-4c88-a0fc-f5b183b538d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d2e1a39-c2') {{(pid=98321) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 10:21:13.994235 np0000001613 nova-compute[98321]: DEBUG os_vif [None req-f138eca8-db41-46a0-8940-e25f2f9b1d0b tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:c1:94,bridge_name='br-int',has_traffic_filtering=True,id=1d2e1a39-c279-4d4b-b2d8-83ec19007310,network=Network(fd85d7ca-665d-4c88-a0fc-f5b183b538d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d2e1a39-c2') {{(pid=98321) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 10:21:13.997065 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:21:13.997373 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d2e1a39-c2, bridge=br-int, if_exists=True) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:21:13.998421 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:21:13.999115 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:21:13.999368 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:21:14.000004 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:21:14.000004 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eef62f37-b239-43de-a1bc-2d65d18def6b) {{(pid=98321) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 10:21:14.000460 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:21:14.000844 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:21:14.001179 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:21:14.002712 np0000001613 nova-compute[98321]: INFO os_vif [None req-f138eca8-db41-46a0-8940-e25f2f9b1d0b tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:c1:94,bridge_name='br-int',has_traffic_filtering=True,id=1d2e1a39-c279-4d4b-b2d8-83ec19007310,network=Network(fd85d7ca-665d-4c88-a0fc-f5b183b538d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d2e1a39-c2')
May 28 10:21:14.002950 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-f138eca8-db41-46a0-8940-e25f2f9b1d0b tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Deleting instance files /opt/stack/data/nova/instances/e02b7452-5f2a-436f-8685-5003d070aab4_del
May 28 10:21:14.003714 np0000001613 nova-compute[98321]: INFO nova.virt.libvirt.driver [None req-f138eca8-db41-46a0-8940-e25f2f9b1d0b tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Deletion of /opt/stack/data/nova/instances/e02b7452-5f2a-436f-8685-5003d070aab4_del complete
May 28 10:21:14.509618 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-f138eca8-db41-46a0-8940-e25f2f9b1d0b tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Took 1.34 seconds to destroy the instance on the hypervisor.
May 28 10:21:14.510216 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._common.loopingcall [None req-f138eca8-db41-46a0-8940-e25f2f9b1d0b tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98321) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 10:21:14.510541 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [-] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Deallocating network for instance {{(pid=98321) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 10:21:14.510689 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] deallocate_for_instance() {{(pid=98321) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 10:21:14.510877 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:21:14.603203 np0000001613 nova-compute[98321]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 10:21:15.003923 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-9c2ccb80-8d6a-479f-92c8-fd95c7db65bc req-c4c4ec63-9faf-4878-8609-5d2dcf35794d service nova] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Received event network-vif-deleted-1d2e1a39-c279-4d4b-b2d8-83ec19007310 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:21:15.004074 np0000001613 nova-compute[98321]: INFO nova.compute.manager [req-9c2ccb80-8d6a-479f-92c8-fd95c7db65bc req-c4c4ec63-9faf-4878-8609-5d2dcf35794d service nova] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Neutron deleted interface 1d2e1a39-c279-4d4b-b2d8-83ec19007310; detaching it from the instance and deleting it from the info cache
May 28 10:21:15.005991 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-9c2ccb80-8d6a-479f-92c8-fd95c7db65bc req-c4c4ec63-9faf-4878-8609-5d2dcf35794d service nova] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Detach interface failed, port_id=1d2e1a39-c279-4d4b-b2d8-83ec19007310, reason: Instance e02b7452-5f2a-436f-8685-5003d070aab4 could not be found. {{(pid=98321) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 10:21:15.385639 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-09b26309-f4ef-441f-93f6-605df54958e5 req-2b307785-1342-435c-858b-9de8ab43079f service nova] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Received event network-vif-unplugged-1d2e1a39-c279-4d4b-b2d8-83ec19007310 {{(pid=98321) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 10:21:15.385639 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-09b26309-f4ef-441f-93f6-605df54958e5 req-2b307785-1342-435c-858b-9de8ab43079f service nova] Acquiring lock "e02b7452-5f2a-436f-8685-5003d070aab4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:21:15.385639 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-09b26309-f4ef-441f-93f6-605df54958e5 req-2b307785-1342-435c-858b-9de8ab43079f service nova] Lock "e02b7452-5f2a-436f-8685-5003d070aab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:21:15.385639 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [req-09b26309-f4ef-441f-93f6-605df54958e5 req-2b307785-1342-435c-858b-9de8ab43079f service nova] Lock "e02b7452-5f2a-436f-8685-5003d070aab4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:21:15.385898 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-09b26309-f4ef-441f-93f6-605df54958e5 req-2b307785-1342-435c-858b-9de8ab43079f service nova] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] No waiting events found dispatching network-vif-unplugged-1d2e1a39-c279-4d4b-b2d8-83ec19007310 {{(pid=98321) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 10:21:15.386063 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [req-09b26309-f4ef-441f-93f6-605df54958e5 req-2b307785-1342-435c-858b-9de8ab43079f service nova] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Received event network-vif-unplugged-1d2e1a39-c279-4d4b-b2d8-83ec19007310 for instance with task_state deleting. {{(pid=98321) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 10:21:15.456843 np0000001613 nova-compute[98321]: DEBUG nova.network.neutron [-] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Updating instance_info_cache with network_info: [] {{(pid=98321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 10:21:15.791571 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:21:15.792031 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:21:15.958641 np0000001613 nova-compute[98321]: INFO nova.compute.manager [-] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Took 1.45 seconds to deallocate network for instance.
May 28 10:21:16.464157 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f138eca8-db41-46a0-8940-e25f2f9b1d0b tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:21:16.464344 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f138eca8-db41-46a0-8940-e25f2f9b1d0b tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:21:16.546536 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-f138eca8-db41-46a0-8940-e25f2f9b1d0b tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:21:16.546768 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-f138eca8-db41-46a0-8940-e25f2f9b1d0b tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:21:17.049095 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-f138eca8-db41-46a0-8940-e25f2f9b1d0b tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:21:17.556601 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f138eca8-db41-46a0-8940-e25f2f9b1d0b tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.092s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:21:17.598104 np0000001613 nova-compute[98321]: INFO nova.scheduler.client.report [None req-f138eca8-db41-46a0-8940-e25f2f9b1d0b tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Deleted allocations for instance e02b7452-5f2a-436f-8685-5003d070aab4
May 28 10:21:18.605498 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-f138eca8-db41-46a0-8940-e25f2f9b1d0b tempest-VolumeMultiattachTests-1491725275 tempest-VolumeMultiattachTests-1491725275-project-member] Lock "e02b7452-5f2a-436f-8685-5003d070aab4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.943s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:21:19.001756 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:21:19.787946 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:21:19.788907 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 46.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:21:20.777705 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:21:22.303501 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:21:24.010081 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:21:28.488091 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x73c206fb5760>>, remaining_delay=-0.000454311999874335 future=<Future at 0x73c1f470c710 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x73c2047a48f0> {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:21:28.488557 np0000001613 nova-compute[98321]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98321) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 10:21:28.488627 np0000001613 nova-compute[98321]: DEBUG nova.virt.driver [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] Emitting event <LifecycleEvent: 1779963673.487512, e02b7452-5f2a-436f-8685-5003d070aab4 => Stopped> {{(pid=98321) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 10:21:28.488758 np0000001613 nova-compute[98321]: INFO nova.compute.manager [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] VM Stopped (Lifecycle Event)
May 28 10:21:28.991139 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-cf9a5446-6a25-49ed-aba4-b67568f3f4d2 tempest-TestEncryptedCinderVolumes-678033643 tempest-TestEncryptedCinderVolumes-678033643-project-member] [instance: e02b7452-5f2a-436f-8685-5003d070aab4] Checking state {{(pid=98321) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 10:21:29.012143 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:21:34.014041 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:21:39.016221 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:21:44.018138 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:21:49.020093 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:21:54.022204 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:21:59.023472 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:22:04.024582 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:22:05.791838 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:22:05.792374 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:22:07.791595 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:22:07.792102 np0000001613 nova-compute[98321]: DEBUG nova.compute.manager [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98321) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 10:22:07.792102 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:22:08.791628 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:22:09.025573 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:22:09.296091 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:22:09.296306 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:22:09.296453 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:22:09.296613 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Auditing locally available compute resources for np0000001613 (node: np0000001613) {{(pid=98321) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 10:22:09.309013 np0000001613 nova-compute[98321]: WARNING nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 10:22:09.309785 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 10:22:09.355836 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.processutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] CMD "env LANG=C uptime" returned: 0 in 0.046s {{(pid=98321) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 10:22:09.356209 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Hypervisor/Node resource view: name=np0000001613 free_ram=14219MB free_disk=72.58303451538086GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98321) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 10:22:09.356669 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 10:22:09.356669 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 10:22:10.404561 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 10:22:10.404872 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Final resource view: name=np0000001613 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 10:22:09 up 54 min,  1 user,  load average: 0.34, 2.51, 4.01\n'} {{(pid=98321) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 10:22:10.447437 np0000001613 nova-compute[98321]: DEBUG nova.virt.libvirt.driver [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98321) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 10:22:10.447664 np0000001613 nova-compute[98321]: DEBUG nova.compute.provider_tree [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed in ProviderTree for provider: ad4de091-3626-4008-ac9a-3e83de44a510 {{(pid=98321) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 10:22:10.950270 np0000001613 nova-compute[98321]: DEBUG nova.scheduler.client.report [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Inventory has not changed for provider ad4de091-3626-4008-ac9a-3e83de44a510 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98321) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 10:22:11.456859 np0000001613 nova-compute[98321]: DEBUG nova.compute.resource_tracker [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Compute_service record updated for np0000001613:np0000001613 {{(pid=98321) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 10:22:11.457291 np0000001613 nova-compute[98321]: DEBUG oslo_concurrency.lockutils [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.100s {{(pid=98321) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 10:22:11.457291 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:22:12.453120 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:22:12.453454 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:22:12.453651 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:22:12.453888 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.34 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:22:13.791528 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:22:13.791980 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:22:14.027416 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:22:15.791549 np0000001613 nova-compute[98321]: DEBUG oslo_service.periodic_task [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98321) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 10:22:15.791969 np0000001613 nova-compute[98321]: DEBUG oslo.service.backend._threading.loopingcall [None req-7fc860e7-90d7-4178-a354-cd8edd8e5f95 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.00 seconds {{(pid=98321) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 10:22:19.028763 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:22:24.029751 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:22:29.030592 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:22:34.031946 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:22:39.032430 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:22:39.032926 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 10:22:39.032926 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5000 ms, sending inactivity probe {{(pid=98321) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 10:22:39.032926 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98321) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 10:22:39.033022 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 10:22:39.033141 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98321) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 10:22:44.034033 np0000001613 nova-compute[98321]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98321) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}